Tracking a Swinging Target with a Robot Manipulator using Visual Sensing

Abstract

In this paper we develop a method for loading parts onto a swinging target using an industrial robot. The orientation of the target is estimated by a particle filter using camera images as measurements. Robust and accurate tracking is achieved by using an accurate dynamic model of the target. The dynamical model is also used to compensate for the time delay between the acquisition of images and the motion response of the robot. The target dynamics is modeled as a spherical pendulum. To ensure robust visual tracking the position of the target mass center is estimated. The method is experimentally validated in a laboratory loading station with a swinging conveyor trolley as target, which is commonly used in industry.