A Computer Vision Based Beamforming Scheme for Millimeter Wave Communication in LOS Scenarios

A novel location-aware beamforming scheme for millimeter wave communication is proposed for line of sight (LOS) and low mobility scenarios, in which computer vision is introduced to derive the required position or spatial angular information from the image or video captured by camera(s) colocated with mmWave antenna array at base stations. A wireless coverage model is built to investigate the coverage performance and influence of positioning accuracy achieved by convolutional neural network (CNN) for image processing. In addition, videos could be intentionally blurred, or even low-resolution videos could be directly applied, to protect users' privacy with acceptable positioning precision, lower computation complexity and lower camera cost. It is proved by simulations that the beamforming scheme is practicable and the mainstream CNN we employed is sufficient in both aspects of beam directivity accuracy and processing speed in frame per second.