Video-based human motion analysis is an important research direction in the field of computer vision. It detects moving objects from video sequences, extracts key parts of the human body, and obtains useful information for human movements. Further analysis and identification. In this paper, the joints of the teeing arm are first color-coded. The tennis teeing video is collected by a high-speed camera. The coordinates of the tacking points in each frame are used instead of the knuckles to study the trajectory of the teeing arm. In the process of video processing, after constructing a dictionary for a series of noise maps, the sparse representation idea was used to reconstruct an interference-free service diagram, and a mixture of Gaussian background modeling was used to extract the foreground of the motion. After obtaining the motion foreground, the marker points are extracted through the color features, and binarization operations are performed on the marker points. Next, the outline of the marker points is searched, the outline is surrounded by the minimum circle, and the returned circle center coordinates are used as the joint point coordinates. Taking the trajectory of the shoulder marking point as a research object, a tennis serving model based on an improved support vector machine was established.