In order to improve the performance deficiency of cement-based materials such as low tensile strength, poor toughness and easy cracking, the basic mechanical properties of cement-based materials reinforced by micron grade CaCO3 whisker and centimeter-grade short AR-glass fiber were studied by testing. The results show that the mechanical properties of reinforced cement-based material can be improved by the proper addition of CaCO3 whisker and/or AR-glass fiber, and the improvement degree is related to the content and length of fibers. For the cement-based materials compound reinforced with CaCO3 whisker and AR-glass fiber, the improvement of mechanical properties of the cement-based materials can be explained that the reinforcing roles of the two kinds of fibers can be played at the micro and macro structural levels respectively, and the flexural and tensile strength of reinforced cement-based materials can be increased by up to 60% and 80% compared with that of non-reinforced cement-based materials.