In order to evaluate the seismic performance of infilled reinforced concrete frame building in strong earthquakes, numerical models are established in OpenSees. The column or beam components are simulated by concentrated plastic hinge element based on the modified Ibarra-Medina-Krawinkler model while the infills are simulated by a pair of compression-only struts based on the Clough model. With the different arrangements of the infills, four frame models are designed, the incremental dynamic analysis of 44 seismic records and the fragility analysis are carried out. The analysis shows that the first model and the fourth model cannot satisfied the seismic performance requirements of national codes in frame building subjected to strong earthquakes, this type of frame buildings should be avoided or reinforced.