The prefabricated building, with good quality, fast construction, reduced labor, and less environmental pollution, has become an important hand in the transformation and upgrading of China's construction industry. Factory prefabrication, mechanized installation and information management are the typical characteristics of prefabricated building, which brings about higher requirements on the technical level of construction workers. Therefore, how to train high-quality industrial construction workers for prefabricated building has become one of the key issues that constrain the benign and healthy development of prefabricated buildings. To grasp the actual state of the prefabricated building construction workers, related survey, in terms of age, gender, education, years of experience and training situation, was conducted on the workers of relevant component production factories and construction companies. The achieved data showed that the prefabricated building construction workers serious issues of aging population, low education level, and lack of systematic training. The growth of the professional construction workers was seriously out of step with the industrial technological development and was not able to support the rapid development of the prefabricated building. Therefore, it has become an urgent task to train construction workers for prefabricated building efficiently. Regarding the current systematic problems of the prefabricated building construction workers, the targeted training path was discussed in depth from three aspects of vocational education, professional education, and vocational training. The training of technical talents in vocational education and skilled talents in professional education can meet the demand for high-quality talents in the industry in the medium and long term; vocational training can improve the skills of the existing workers to solve the short-term shortage of industrial workers and form a system of lifelong growth of individual workers' ability. The multi-level industrial construction worker training system for high-quality talents and the multi-channel worker ability growth system based on vocational training promote the high-quality training of prefabricated industry construction workers in multiple directions and help the sustainable and high-quality development of prefabricated buildings.