Abstract: To solve the problem of tracking nonrigid targets for image sequence in dynamic scene,a tracking framework based on support vector machine(SVM) and Mean-Shift is proposed.The rectangle in which the tracked target lies in is selected in the intial image,and the pixels in the given region around the target are taken as scene data.Then both the target and the scene pixel data are applied to train a two-value SVM classifier.The obtained SVM classifier is employed to classify the pixel data lying in the same region of the next image,thus the confidence map including two pixel values is got.The Mean-Shift algorithm is performed to get the position of the current target within the area of the confidence map.Similarly,the new SVM classifiers are trained for tracking the images to be followed until the whole image sequence tracking is completed.The experiment results show that the proposed method is suitable for tracking nonrigid targets and active scenes,and has the real-time characteristic.