A Structural Design and Interaction Algorithm of Smart Microscope Embedded on Virtual and Real Fusion Technologies

The microscope is an important teaching tool in secondary school biology. This important equipment needs to be understood and mastered through biological experiments. However, in actual experimental teaching in China, microscope samples are difficult to produce, preserve and share, and the implementation status is not ideal. These conditions seriously affect student enthusiasm and require additional participant labor. Moreover, they hinder teachers' evaluation of experimental learning. Thus, this paper constructs a smart microscope physical interaction kit for secondary school biology experiments. First, the main components of the traditional microscope are replaced by a variety of different sensing elements, which are 3D printed. Then, a novel multichannel information integration strategy based on visual, auditory and tactile information is proposed to manage different channels of information, to understand the user's operational intent and to organize reasonable interactions (including the display of real-time adjustment effects). Then, we propose a navigational interaction paradigm based on multimodal intent understanding, aiming at reminding users of invalid behavior and providing necessary operational guidance for users, thus achieving the purpose of intelligent interaction and intelligent experimental teaching. The experimental results show that the proposed microscope kit, multichannel integration strategy and navigation interaction algorithm not only imbue microscopy experiments with the characteristics of intelligent interaction but also stimulate student enthusiasm and help the evaluation of experimental learning. We find that these capabilities are well received by users.