Application-based Attention Mechanisms in Deep Learning

Attention is the process of reflecting intensely on several items when overlooking others. As a blooming aspect of machine learning, the field of natural language processing incorporated this cognitive process into one of its mechanisms. This mechanism has helped in terms of reducing computation power as it focuses on only the specific states. This paper presents the cognitive process applied to different other fields in deep learning along with challenges faced by the same.