A New Approach to Modeling Emotions and Their Use on a Decision-Making System for Artificial Agents

In this paper, a new approach to the generation and the role of artificial emotions in the decision-making process of autonomous agents (physical and virtual) is presented. The proposed decision-making system is biologically inspired and it is based on drives, motivations, and emotions. The agent has certain needs or drives that must be within a certain range, and motivations are understood as what moves the agent to satisfy a drive. Considering that the well-being of the agent is a function of its drives, the goal of the agent is to optimize it. Currently, the implemented artificial emotions are happiness, sadness, and fear. The novelties of our approach are, on one hand, that the generation method and the role of each of the artificial emotions are not defined as a whole, as most authors do. Each artificial emotion is treated separately. On the other hand, in the proposed system it is not mandatory to predefine either the situations that must release any artificial emotion or the actions that must be executed in each case. Both the emotional releaser and the actions can be learned by the agent, as happens on some occasions in nature, based on its own experience. In order to test the decision-making process, it has been implemented on virtual agents (software entities) living in a simple virtual environment. The results presented in this paper correspond to the implementation of the decision-making system on an agent whose main goal is to learn from scratch how to behave in order to maximize its well-being by satisfying its drives or needs. The learning process, as shown by the experiments, produces very natural results. The usefulness of the artificial emotions in the decision-making system is proven by making the same experiments with and without artificial emotions, and then comparing the performance of the agent.

1 Introduction

According to LeDoux [1], at the beginning of the 1960s, the artificial intelligence precursor Herbert Simon was convinced that including emotions in cognitive models was necessary to approximate the human mind. But only in recent years has the well-known emotional intelligence been taken into account as an essential factor to understand and evaluate human behavior. Moreover, some researchers have realized the importance of emotions in intelligent thinking and behaviors [2], [3], [4]. Several studies have shown that emotions have influence on many cognitive mechanisms, such as memory, attention, perception, and reasoning [5], [6]. Besides, emotions play a very important role in survival, social interaction, and learning of new behaviors [7].