The starting and stopping process of a hybrid electric vehicle engine often results in torque ripple, leading to torsional vibrations in the vehicle’s powertrain system and causing irregular vehicle power delivery. To solve these problems, an active control method for torsional vibrations based on active control of electromagnetic damping torque of the motor is proposed. Firstly, a dynamic simulation model and engine start-stop control logic under engine start-stop condition is established. Additionally, an adaptive fuzzy control strategy for engine start-stop torsional vibration is proposed. Finally, the simulation model is used to simulate the engine starting and stopping conditions under two driving conditions of the vehicle. The torsional vibration response curves of the driveline under the proposed control method and without any control are compared and analyzed. The results show that the average torsional vibration attenuation rates achieved by the proposed method are 23.8% and 30.1%, respectively, during stationary stop engine conditions, compared to the uncontrolled state. Moreover, the average attenuation rate of torsional vibration under the starting-stopping conditions during vehicle travel is 12.1% and 23.6%, respectively. This proposed method effectively attenuates the torsional vibrations of the driveline during engine starting and stopping conditions, thereby improving the NVH (noise, vibration, and harshness) performance of the hybrid electric vehicle during these operational states.