Acquisition of Object Shape Using a HMD's Depth Sensor and MR Presentation of Manipulation Method

In industrial environments such as factories, systems have been developed to present tool usage instructions to Head Mounted Display (HMD) users. However, existing systems make it difficult to understand specific actions intuitively, as they typically rely on instructions in text or video formats. Additionally, automatically generating these instructions is challenging, while manual creation places a significant burden on humans. This research implements a system that recalls possible object manipulation methods based on object shapes acquired from HMD sensor data and presents these recalled manipulation methods through Mixed Reality (MR).