In this paper, we propose a scheme of recognizing un-constraint handwritten numerals,in which on-line methods and off-line methods are combined. This scheme inherits the good quality,and overcoming the defect of both on-line methods and off-line methods. Experiments show the scheme has achieved impressive performance and the preliminary results are very encourgine for recongnizing un-contraint handwritten numerals.