A novel scheme is present to improve the conversion accuracy of ADC. The proposed approach uses adaptive sinusoidal filter. For the measurement of the signal with given frequency, the automatic adjustment of filter coefficients is based on least mean-square error rule, which is a mathematical tool can be employed to make filter output signal achieve the best approximation to the needed one. Then based on the result, it is able to get the amplitude and phase of the measured signal accurately. MATLAB software is used to verify the effectiveness of the algorithm. It proves that adaptive filter has improved the accuracy and signal-to-noise ratio of ADC, which is equal to increase the conversion digits.