There are some metrics to evaluate automatic text translations in the literature. However, the state-of-the-art of these metrics still has limitations. One of them is the dependence of an exact and ordered pairing of words for evaluating similarity among texts. Another, is the non-consideration of the semantics of the text in such comparison. Previous studies point out the need to analyze the semantics of words in the evaluation of translations. In this scenario, this paper presents a novel metric capable of evaluating the differences in automatic text translations that takes into account the semantics of the words presented in the texts. As a proof of concept, we selected ten journalistic texts written in English. These texts have been translated to Portuguese by specialists and by automatic text translation tools. Experimental results show the potential of the proposed metric in evaluating these translations, indicating it can perform better than the state-of-the-art metric.

中文翻译：

---

BRAPT：一种基于心理语言学视角的翻译评价新指标

有一些指标可以评估文献中的自动文本翻译。然而，这些指标的最新技术仍然存在局限性。其中之一是依赖精确且有序的单词配对来评估文本之间的相似性。另一个是在这种比较中不考虑文本的语义。以往的研究指出，在评价翻译时需要对词的语义进行分析。在这种情况下，本文提出了一种新颖的度量标准，能够评估自动文本翻译中的差异，该度量考虑了文本中出现的单词的语义。作为概念证明，我们选择了十篇用英语撰写的新闻文本。这些文本已由专家和自动文本翻译工具翻译成葡萄牙语。