Edge-Computing Enabled Si Photonics Multimodal Sensor with Integrated Photonic Convolutional Processor

Photonic integrated circuits provide compact and efficient solutions for multimodal spectroscopic sensors. However, the resulting sensory data is highly complex and contains significant redundancy. To circumvent high communication cost for redundancy, the photonic sensor and processor are brought into intimacy and propose a photonic multimodal edge computing system. A microring resonator crossbar is used as photonic processor with 5-bit accuracy. The in-situ processing of sensory data is demonstrated in this system, achieving a classification accuracy of 94.27% across 45 different classes. The multimodal edge computing system demonstrates the feasibility of integrating photonic processors and photonic sensors to enhance the photonic data processing capability.