We present a System for Processing In-situ Bio-signal Data for Emotion Recog-nition and Sensing (SPIDERS$+$) – a low-cost, wireless, glasses-based platform for continuous in-situ monitoring of user’s facial expressions (apparent emotions) and real emotions. We present algorithms to provide four core functions to detect eye shape and eyebrow movements, pupillometry, zygomaticus muscle movements, and head movements, using the bio-signals acquired from three non-contact sensors (IR camera, proximity sensor, and IMU). SPIDERS$+$ distinguishes between different classes of apparent and real emotion states based on the aforementioned four bio-signals. We prototype advanced functionalities including facial expression detection and real emotion classification with a facial expression detector based on landmarks and optical flow that leverages changes in a user’s eyebrows and eye shapes to achieve the average true positive rate up to 83.87%, as well as a pupillometry-based real emotion classifier with higher accuracy than existing low-cost wearable platforms that use sensors requiring skin contact. In addition, SPIDERS$+$ also includes optional contact-based sensors such as photoplethysmography (PPG) and multi-channel electroencephalogram (EEG) to monitor other bio-signals. SPIDERS$+$ costs less than $20 to assemble and can continuously run for up to 9 h before recharging. We design, implement and evaluate accompanying desktop and smartphone applications to demonstrate that SPIDERS$+$ is a truly wireless and portable platform that can impact a wide range of applications, where the knowledge of the user’s emotional state is critical.

我们提出了一个小号ystem为P rocessing我正原位生物信号d为ATA Ë运动ř ECOG-nition和š ensing（SPIDERS$+$) – 一种低成本、无线、基于眼镜的平台，用于连续原位监测用户的面部表情（表观情绪）和真实情绪。我们提出了使用从三个非接触式传感器（红外摄像机、接近传感器和 IMU）获取的生物信号来提供四个核心功能的算法，以检测眼睛形状和眉毛运动、瞳孔测量、颧骨肌肉运动和头部运动。蜘蛛$+$基于上述四种生物信号区分不同类别的表观情绪状态和真实情绪状态。我们使用基于地标和光流的面部表情检测器对包括面部表情检测和真实情绪分类在内的高级功能进行原型设计，该检测器利用用户眉毛和眼睛形状的变化来实现高达 83.87% 的平均真实阳性率，以及瞳孔测量基于真实情感分类器的准确度高于现有的低成本可穿戴平台，这些平台使用需要皮肤接触的传感器。此外，蜘蛛$+$还包括可选的基于接触的传感器，例如光电容积脉搏波 (PPG) 和多通道脑电图 (EEG)，以监测其他生物信号。蜘蛛$+$组装成本不到 20 美元，并且可以在充电前连续运行长达 9 小时。我们设计、实施和评估随附的桌面和智能手机应用程序，以证明 SPIDER$+$ 是一个真正的无线和便携式平台，可以影响广泛的应用程序，其中用户情绪状态的知识至关重要。