For high-rise building of RC Frame Structures, its security problems with wind load is more important, in this paper the mechanical model is established to simulate the atmospheric flow field around high-rise building, and the modal analysis is carried on for the structure. The simulation results show that velocity contour of wind field and pressure change contour describe the wind field characteristics. Wind velocity and pressure change near frontwall and backwall will affect obviously the vibration characteristics of high-rise building. Natural frequency and vibration mode can be obtained though modal analysis of high-rise building with wind load action, and necessary measures will be taken to avoid unnecessary losses due to resonance factors. And harmonic response is analyzed for high-rise building with load action to avoid resonance.