In order to solve the problems of vague sight and unchangeable driver's perspective in the visual display of driving simulation system, the 3D model of Dianjiang Vehicle Proving Ground(VPG) is built by 3Ds Max. Then, the virtual reality display system is built based on Unity 3D and HTC Vive, which realizes the rendering and VR display of the whole environment of the VPG. Finally, the car dynamic simulation platform is built with Carsim and Labview RT. Thus, all the driving simulation system construction steps based on VR are completed. The simulation results show that the driving simulation system based on virtual VPG has high definition sight, and the driver has high elevation angel and flexible observation angle, which effectively improves the driver's immersion.