A training system using virtual machines for teaching assembling/disassembling operation to novices

A number of expert systems have been developed so far but most of them failed to know if a user has correctly responded to what the system told him/her to do. Such a system can not find and correct careless mistakes which a novice will easily violate. The system described shows a technical illustration of a mechanical subassembly and instructs a novice to operate a part. The part to be operated is designated using the name and movement of the user's hand is monitored by the system. When the novice understands the instruction, his/her hands will move toward the part or will open to grasp it. If neither of them are observed, it means he/she does not understand the instruction, then the color of the part is changed to teach part-name correspondence. If he/she is going to grasp a wrong part, the correct one will be shown by the system.