This paper proposes an evaluation framework for autonomous systems, called LENS. It is an instrument to make an assessment of a system through the lens of abilities related to adaptation and smartness. The assessment can then help engineers understand in which direction it is worth investing to make their system smarter. It also helps to identify possible improvement directions and to plan for concrete activities. Finally, it helps to make a re-assessment when the improvement has been performed in order to check whether the activity plan has been accomplished. Given the high variability in the various domains in which autonomous systems are and can be used, LENS is defined in abstract terms and instantiated to a specific and important class of medical devices, i.e., Programmable Electronic Medical Systems (PEMS). The instantiation, called LENS ${}_{\textit{PEMS}}$ , is validated in terms of applicability , i.e., how it is applicable to real PEMS, generalizability , i.e., to what extent LENS ${}_{\textit{PEMS}}$ is generalizable to the PEMS class of systems, and usefulness , i.e., how it is useful in making an assessment and identifying possible directions of improvement towards smartness.

中文翻译：

---

自主系统评估框架：可编程电子医疗系统案例

本文提出了一种自治系统的评估框架，称为 LENS。它是一种通过与适应和智能相关的能力来评估系统的工具。然后，评估可以帮助工程师了解值得朝哪个方向投资以使他们的系统更加智能。它还有助于确定可能的改进方向并规划具体活动。最后，有助于在改进完成后进行重新评估，以检查活动计划是否完成。鉴于自主系统在其中和可以使用的各个领域的高度可变性，LENS 以抽象术语进行定义，并实例化为特定且重要的医疗设备类别，即可编程电子医疗系统 (PEMS)。实例化，称为 LENS ${}_{\textit{PEMS}}$，在适用性 方面进行验证 ，即如何适用于真实的PEMS，概括性 ，即LENS到什么程度 ${}_{\textit{PEMS}}$可推广到 PEMS 系统类别，以及有用性 ，即它在进行评估和确定智能改进的可能方向方面如何有用。