Distributed Self-Optimization of Modular Production Units: A State-Based Potential Game Approach

This article presents a novel approach for distributed optimization of production units based on potential game (PG) theory and machine learning. The core of our approach is split into two parts: the first part concentrates on the conceptual treatment of modular installed production units in terms of a PG scenario. The second part focuses on the development and incorporation of suitable learning algorithms to finally form an intelligent autonomous system. In this context, we model the production environment as a state-based PG where each actuator of each module has the role of an agent in the game aiming to maximize its utility value by learning the optimal process behavior. The benefit of the additional state information is visible in the performance of the algorithm making the environment dynamic and serving as a connector between the players. We propose a novel learning algorithm based on a global interpolation method that is applied to a laboratory scale modular bulk good system. The thorough analysis of the encouraging results yields to highly interesting insights into the learning dynamics and the process itself. The benefits of our distributed optimization approach are the plug-and-play functionality, the online capability, fast adaption to changing production requirements, and the possibility of an IEC 61131 conforming to PLC implementation.