Cloud removal is an important step in remote sensing image process. In this paper, the author proposed a new algorithm for cloud removal using multi-temporal Landsat TM image data based on spectral characteristics analysis. Through the spectral characteristics analysis of the thick cloud region and its shadow region, the thick cloud and its shadow identification models were designed. Using image regression, unsupervised classification and pixel replacing techniques as well as these models, the influence of thick clouds and its shadows can be eliminated or reduced in the Landsat TM images. The result shows that the algorithm can eliminate or significantly reduce the cloud influence from Landsat TM image data.