Aiming at the problem that there are many switching delay and switching times in fuzzy control system, a fuzzy control based vertical handoff algorithm is proposed to solve the problem of handoff. The received signal strength is adopted to set up the threshold, and the ability of decision is improved. The network parameters and service type are set as decision factors, and analytic hierarchy process is combined with the parallel fuzzy control system to shorten decision time and select the best suitable network for users. The simulation result shows that the algorithm can reduce the time and frequency of handoff and enhance the performance of the system. Compared with the traditional handover algorithm, the algorithm considers comprehensive decision factors, and it not only takes the use of the environment and the cost of the user terminal into account, but effectively ensures the quality of service of the network.