Actor-Critic Network for O-RAN Resource Allocation: xApp Design, Deployment, and Analysis

Open Radio Access Network (O-RAN) has introduced an emerging RAN architecture that enables openness, intelligence, and automated control. The RAN Intelligent Controller (RIC) provides the platform to design and deploy network controllers. xApps are the applications that can leverage machine learning (ML) algorithms for near-real time control. Despite the opportunities provided by this new architecture, the progress of practical artificial intelligence (AI)-based solutions for network control and automation has been slow. There is a lack of end-to-end solutions for designing, deploying, and testing AI-based xApps in production-like network settings. This paper introduces an end-to-end O-RAN design and evaluation procedure using the latest O-RAN architecture and interface releases. We provide details on the development of a reinforcement learning (RL)-based xApp, considering two RL approaches and present numerical results to validate the xApp.