This paper studies the problem of computer vision in the vehicle intelligent auxiliary driving system. An effective and real time method in highway to search and track obstacle is presented. Obstacle candidates are tracked and analyzed, false alarms generated by the object detector are recognized and rejected. It also supplies some valuable discussion on problems existing in its experiments.