The existing evaluation system of academic journals of humanities and social sciences in China is mainly based on quantitative indexes, and to some extent it is reasonable, but problems such as evaluating papers by journals, lack of academic innovation, stressing quantity over quality are prominent. Under the background of the current academic evaluation advocating "breaking with the five-only", building high-quality academic journals, and showing Chinese characteristics, construction of quality evaluation system of academic journals of humanity and social sciences needs to follow their characteristics, avoid excessive reliance on quantitative indexes and adopt quality evaluation which truly goes deep into the content of academic journals and pays attention to qualitative indexes such as academic innovation, academic reputation, characteristics and styles, and function realization. Based on the built evaluation system, 20 literature journals are selected as samples to test the effects of the evaluation system. The results show that the evaluation system can reflect characteristics of journals what quantitative indexes can’t reflect, and it can achieve better evaluation results.