SeaSense: Pioneering AI-Based Vision Integration with a GPS Drone and a Multi-Function Boat for Shallow Ocean Ecosystem Study

This paper presents the design and implementation of SeaSense, the first affordable multi-vehicle system working in a trisphere environment, to collect and analyze data in shallow ocean ecosystems. SeaSense integrates a drone, a mini boat, and an underwater AI camera remotely operated at shore, saving costly human diving or life-size research ships. The synergy of AI vision, drone and long-range RF technologies, and camera control automation efficiently address the underwater challenge of data collection on the invasive sea urchins within kelp ecosystems. Machine learning algorithms further enhance the process by efficiently analyzing images and assessing sea urchin population. This integrated approach offers a lightweight and inexpensive means of studying the underwater ecosystem. SeaSense facilitates the shallow ocean habitat population study, utilizing a machine learning YOLOv8 object detection model retrained with more than 900 urchin images. It achieved an accuracy of 0.98 when detecting on urchin images taken by the underwater AI camera, HuskyLens, which integrates computer object detection and classification model training and inference with image acquisition and storage capabilities into a compact and energy-efficient mini-board for convenient use in the field. The SeaSense system is portable, less than 3 lbs, and powered by common batteries. The RF remotes control up to 200 meters of the drone and boat navigation, suitable for shallow ocean applications. These results have proved the concept of the SeaSense system, which incorporates the drone and remotely operated vehicle (ROV) technologies with the underwater HuskyLens, aims to survey underwater objects, e.g. purple sea urchins or starfishes, to monitor population, to predict trend, and to provide valuable insights into ecosystem dynamics. In conclusion, SeaSense offers a path to cost-effective solutions for study of underwater creatures such as sea urchins or their predator starfishes in shallow ocean ecosystems, contributing to the preservation of marine ecological balance.