Attention is the important ability to flexibly control limited computational resources. It has been studied in conjunction with many other topics in neuroscience and psychology including awareness, vigilance, saliency, executive control, and learning. It has also recently been applied in several domains in machine learning. The relationship between the study of biological attention and its use as a tool to enhance artificial neural networks is not always clear. This review starts by providing an overview of how attention is conceptualized in the neuroscience and psychology literature. It then covers several use cases of attention in machine learning, indicating their biological counterparts where they exist. Finally, the ways in which artificial attention can be further inspired by biology for the production of complex and integrative systems is explored.

中文翻译：

---

关注心理学、神经科学和机器学习

注意力是灵活控制有限计算资源的重要能力。它已与神经科学和心理学的许多其他主题结合进行研究，包括意识、警惕性、显着性、执行控制和学习。它最近也被应用于机器学习的多个领域。生物注意力的研究与其用作增强人工神经网络的工具之间的关系并不总是很清楚。本综述首先概述了神经科学和心理学文献中注意力是如何概念化的。然后它涵盖了机器学习中注意力的几个用例，指出它们存在的生物学对应物。最后，