Science and Technology Index (SINTA) Data Acquisition Model with Web Scraping Method

A recapitulation of scientific article publications by each researcher at an educational institution is needed to determine collective research performance. Science and Technology Index (SINTA) is a web-based research information system that can be used to measure the performance of researchers, institutions, and journals in Indonesia. Although the publication information of each lecturer or researcher is already available on the SINTA website and can be accessed publicly (without having to log in), the information records displayed are limited, so if complete information is needed, you must log in first. In addition, for data processing or reporting purposes, sometimes publication recapitulation data is needed in other formats such as PDF or xlsx. Therefore, this study took data from the SINTA website to create a recapitulation of scientific article publication data by applying web scraping technology using the Cascading Style Sheet (CSS) method. Identification of elements on the SINTA web is carried out on the Hyper Text Markup Language (HTML) file to determine which parts to download. Web scraping testing was carried out with 2 different scenarios: using credentials and without credentials. Based on the experimental results, bandwidth usage in data scraping using credentials is 55.20% greater than bandwidth usage in scraping without using credentials. The execution time of data scraping using credentials is 22.46% greater than the execution time for data scraping without using credentials. The scraped data has also been successfully reused by a web-based application prototype that provides a research publication recapitulation feature in PDF and XLSX formats.