It is imperative to improve the teaching competence of teachers in colleges and universities, but there are still many problems for front-line teachers in different stages and states. From the perspective of the front-line teachers in colleges and universities, the concept of "teaching competence of college teachers" is defined according to the boundary definition method, that is, the competence of the front-line teachers in colleges and universities to complete the teaching design, teaching implementation and evaluation of teaching, and their own teaching expertise, including knowledge, skills and attitudes. This competence has a multi-level upgrade space from novice level to advanced beginner level, competent level, proficient level and expert level, which includes both gradient and mutation. Based on the task characteristics and personal characteristics, we construct the multi-level goal of improving the teaching competence of college teachers, that is, to improve the teaching design, implementation and evaluation ability, as well as to strengthen the knowledge base, develop multi-skills and establish a professional attitude. Combining relevant policies, theories and the author’s practice, the paper points out the influences of the multiple paths on improving teaching competence, and analyzes the applicability of teaching competence improving paths to teachers at different levels.