This paper presents a modulation phenomenon of complex vibration which occured when gear teeth broke or shaft seriously bent in gearbox. Based on the mechanism of gear vibration and modulation sideband,the peper analyzes this complex modulation phenomenon.