The mesh stiffness of gear tooth is simulated by spring elements, the connected bolt between various housings are simplified as bar elements, and the sliding bearing and rolling bearing are simplified as spring dumping elements. Based on them, the gear-shaft-bearing-housing coupled finite element model and boundary element model of GWC6066 marine gearbox are established. Finally, the dynamic response under internal dynamic excitation is analyzed and the vibration severity, structural-borne noise and air-borne noise of the gear system are forecasted. Through the experimental modal analysis of gear system, and the test of vibration response and air pressure, the natural frequencies, vibration severity, structural-borne noise and air-borne noise are obtained. Compared with numerical results, two results show good agreement.