The problem of computer vision in the vehicle intelligent auxiliary driving system is studied. It discusses the way of image segment based on region growing to follow road and points of its two sides. In this paper, one effective and real time method in highway surface searching and following is presented; it applies the polynomial data fitting to find the both sides of the driving area; with its help,it also can figure out the way stretching correctly, therefore, the vehicle can self anti deviation. It also supplies some valuable discussion on problems existing in its experiments. [WT5HZ]