By Topic

An autonomous mobile grasping system using visual servoing and nonlinear model predictive control

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

3 Author(s)
Ying Wang ; Div. of Eng., Southern Polytech. State Univ., Marietta, GA, USA ; Haoxiang Lang ; de Silva Clarence, W.

This paper presents an autonomous grasping system using visual servoing and mobile robots. While this kind of system has many potential significant applications, there have been several key challenges, for example, localization accuracy, visibility and velocity constraints, obstacle avoidance, and so on, to prevent the implementation of such a system. The main contribution of this paper is to develop an adaptive nonlinear model predictive controller (NMPC) to meet all these challenges in one single controller. In particular, the model of the vision-based mobile grasping system is first derived. Then, based on the model, a nonlinear predictive control strategy with vision feedback is proposed to deal with the issues of optimal control and constraints simultaneously. Different from other work in this field, in order to improve the performance, an adaptive mechanism is proposed in the paper to update the model online so that it can track the nonlinear time-varying plant in a real time manner. To the best of our knowledge, this is the first work to apply model predictive control to mobile visual servoing and consider various constraints at the same time. The approach was validated with two physical experiments. It was shown that the system with the new control strategy was quite successful to carry out an autonomous mobile grasping task in a complex environment.

Published in:

Control and Automation (ICCA), 2010 8th IEEE International Conference on

Date of Conference:

9-11 June 2010