After entering the zero-agriculture tax era, from the point of benefit, the direct conflict between township government and farmers is reduced. Thus, how to remodel township government’s credibility is the necessitous problem of constructing a new socialist countryside. The remodeling of township government’s credibility directly influences the effectiveness of rural governance in the zero-agriculture tax era. In this article, the author analyzes performance and causations of the loss of government’s credibility, and puts forward some effective approaches to improve credibility of township government.