With the development of people’s living standard, the consumption of the precious marine products is getting higher, and a class of the sea cucumber which grows in the northeast sea area in China is among them. However, the fishing operation of this products remains rough and extensive, which means it is totally human labor dependent, and brings detrimental risks to their health. It is of great necessity to develop an automation system for the sea cucumber fishing. This thesis is focusing on a key technical point of this procedure, that is to develop a technical route for applying the visual object tracking. The image pretreatment methods contraposing the sea cucumber detecting and the servo visual object tracking for the sea cucumbers are introduced and developed. On-site videos are recorded from the main producing area in China, and the introduced and developed tracking algorithms are applied to the videos. The results are illustrated and prove the application to be practical and realistic.