As an essential indicator of teaching effect evaluation, test scores can reasonably reflect the ability level of the subjects. However, the paper scores in the traditional sense cannot fully reflect the relationship between the test scores and the ability level of the subjects. Because of this, this paper proposes a test score calculation method that adjusts the test scores according to the difficulty of the test questions and analyzes its specific application by taking the civil engineering course "Architectural Structure Design" as an example. The results show that the value of the objective difficulty coefficient of the test questions has little influence on the high section of the paper surface but has a significant influence on the low section; The maximum absolute value of the score change rate is between the lowest score and the highest score on the roll surface, which is biased toward the lowest score side. The closer the roll surface score is to the highest or lowest score, the less it will be affected. When the objective difficulty coefficient is taken as 0, the score change rate is between - 55.4% ～ - 15.0%; when it is taken as 0.5, it is between - 11.7% ～ - 3.9%; when it is taken as 0.7, it is between - 5.7% ～ 2.5%; The smaller the objective difficulty coefficient is, the greater the deviation between the calculated score and the paper score, the more dispersed the score is, the greater the difference between the test paper difficulty coefficients of different teaching classes is, and the more significant the difference between the scores calculated by the teaching class alone and by the combined calculation of multiple classes is. When the objective difficulty coefficient is 0.5, the deviation between the scores calculated by the teaching class alone and by the combined calculation of multiple classes is within - 10% ～ + 3%, and when it is 0.7, the deviation is within - 4% ～ + 3%; The test score calculation method considering the difficulty of the test questions can reasonably reflect the relationship between the scores and the ability level of the examinees. The objective difficulty coefficient is recommended to be 0.5 ~ 0.7. When there are multiple teaching classes in the same civil engineering professional course, when the objective difficulty coefficient is not greater than 0.6, it is recommended that multiple classes be calculated together. Each teaching class can be calculated separately when it is more significant than 0.6.