Implementation of Speech to Text and Geolocation Technology on the Travelling Merchant System

Travelling merchants are a type of business providing food needs in the informal sector. Currently, when consumers want to make an order, they have to type in the criteria in the form of a fairly long text. Consumers also often have difficulty detecting the location of travelling merchants in their vicinity. This research developed a responsive mobile webbased application utilizing speech recognition technology, specifically speech-to-text. The speech-to-text feature is powered by the Hugging Face Whisper API, which is applied during the food ordering process and geolocation technology in the form of Location Based Service to detect travelling merchants’ locations in real-time. The notification feature uses service workers and socket.io to provide information when a travelling merchant is nearby the buyer’s location. The software was developed using an agile methodology model. Based on the test results, 100% of all features were running well, 82.4% of travelling merchants, and 94.4% of buyers agreed that the implementation of the research results could simplify the process of ordering food and meeting between travelling merchants and buyers.