Monitoring the material decay make use of the technique of video, computer image processing and pattern identify to detect, process and manage the external material decay image. The color character of the external material decay image are analyzed. The statistics character of the material decay image is pick-up by color histogram, color coherence vector and color correlogram. The comparability of the material decay image is presented by Euclidean distance of the color character. The match and query system of material decay based on image retrieval technology is implemented.