Recommendation Systems: Issues, Challenges and Regulations

The European Parliament’s ratification of the Artificial Intelligence Act in March 2024 represents a crucial step in regulating AI technologies. Aimed at mitigating risks, enhancing opportunities, and promoting transparency and democratic values, the Act targets AI practices with potential societal implications. Notably, it imposes strict risk assessment processes, particularly on high-risk systems like recommendation systems. These systems permeate various aspects of modern life, influencing everything from entertainment to politics. Operating by collecting personal data to generate personalized suggestions, they raise concerns about privacy, discrimination, and manipulation. This paper examines the literature to explore the risks posed by recommendation systems, explores challenges, and highlights regulations initiatives.