Chat GPT, an artificial intelligence (AI) chatbot developed by the United States Open Artificial Intelligence Research Center (OpenAI), can understand and respond to natural language input based on the language model of "Generate Pre-training Converter" (GPT), which was officially released on November 30, 2022, and has caused heated discussion and attention in the global Internet, academia and industry in a short time. The AI chatbots represented by ChatGPT and Microsoft Bing are based on huge amounts of data and trained with "reinforcement learning from human feedback" (RLHF). They have three main functions: intelligent interactive dialogue, intelligent content generation, and intelligent document crawling.The core competitiveness of the AI chatbot is to adopt the AI generated content technology (AIGC) and have strong content generation or text generation ability. In addition to generating general applied manuscripts, it can also engage in scientific writing, thus leading and promoting the transformation of the mode of knowledge production and academic research paradigm. The process of knowledge production and academic research will be significantly accelerated, and knowledge producers will be liberated from non-creative labor, the mode of knowledge production will move from "manual" and "semi-automatic" to "automatic" and "intelligent".This change will have a significant impact on the traditional evaluation mechanism of scientific research achievements, and further will have a significant impact on talent evaluation. In general, the application of AI chatbot represented by ChatGPT in academic research will obscure the evolution of academic history of achievements and affect the innovative evaluation of scientific research achievements, and challenge the intellectual property protection system and affect the ownership of scientific research achievements, and bring academic ethical risks and affect the evaluation ecology of scientific research achievements, and impact the basic standards of talent evaluation and affect the objectivity of talent evaluation. In view of the penetration, diffusion and subversion of AI, first of all, we should face it positively rather than passively in ideological understanding, utilize its strengths and avoid its weaknesses prudently, and exert its positive role in promoting knowledge production and promoting academic progress. Secondly, institution construction should be further improved to set up "guardrails" for AI chatbot according to the imbalance between the current relevant laws and regulations and the rapid progress of AI technology. Third, AI chatbot technology open source should be promoted to disclose its intelligent generation logic, and enhance the technical credibility of AI chat robots. Fourth, human-computer cooperation mechanism should be established to give play to the advantages of technology in data processing and human rational thinking, and finally let people check the knowledge production, scientific research achievements and talent evaluation.