To clearly clarify the effects of different upstream boundary layer thickness and tip clearance size to the detailed tip flow field and flow mechanism, numerical simulations are performed on a subsonic compressor rotor, which is used for low-speed model testing of a rear stage embedded in a modern high-pressure compressor. First, available experimental data are adopted to validate the numerical method. Second, comparisons are made for tip leakage vortex (TLV) structure, the interface of leakage flow/mainflow, endwall loss, isentropic efficiency and pressure-rise among different operating conditions. Then, effects of different clearance sizes and inflow boundary layer thicknesses are investigated. Finally, the self-induced unsteadiness at one near-stall (NS) operating condition is studied for different cases. Results show that the increment of tip clearance size has a deleterious effect on rotor efficiency and pressure-rise performance over the whole operating range, while thickening the inflow boundary layer is almost the same except that its pressure-rise performance will be increased at mass flow rate larger than design operating condition. Self-induced unsteadiness occurs at NS operating conditions, and its appearance largely depends on tip clearance size, while the effect of upstream boundary layer thickness is little.