I. Introduction
Nonholonomic optimal control problems arise in many engineering applications, for instance systems with wheels, such as cars and bicycles, and systems with blades or skates. There are thus multiple applications in the context of wheeled motion, space or mobile robotics and robotic manipulation. The earliest work on control of nonholonomic systems is by R. W. Brockett in [9]. A. M. Bloch [2], [3] has examined several control theoretic issues which pertain to both holonomic and nonholonomic systems in a very general form. The seminal works about stabilization in nonholonomic control systems were done by A. M. Bloch, N. H. McClamroch, and M. Reyhanoglu in [3], [5], [6], [7], and more recently by A. Zuryev [27].