CUBot: Prototype of a computer-using robot

Pointing at objects on screen through cursor is a significant function for manipulating a personal computer. A prototypical robot CUBot¹, which can perceive the content displayed on the PC's screen and control the PC's mouse to perform the interaction with PC like a computer user, is presented in this paper. A heuristic control algorithm is developed for the CUBot so that it possesses the ability of eye-hand coordination to perform the pointing strategy onto PC's screen like human. Two missions of CUBot manipulating a PC are implemented to demonstrate the feasibility of the proposed design.