INSMA: An integrated system for multimodal data acquisition and analysis in the intensive care unit

Highlights

• Integrated system for ICU multimodal data acquisition, analysis and visualization.

• Multimodal data are acquired and visualized in a user-centered interface.

• Acquired time-series are analyzed for patient state tracking at the bedside.

• Multimodal Human-Computer Interaction assists with clinical decision-making.

Abstract

Modern intensive care units (ICU) are equipped with a variety of different medical devices to monitor the physiological status of patients. These devices can generate large amounts of multimodal data daily that include physiological waveform signals (arterial blood pressure, electrocardiogram, respiration), patient alarm messages, numeric vitals data, etc. In order to provide opportunities for increasingly improved patient care, it is necessary to develop an effective data acquisition and analysis system that can assist clinicians and provide decision support at the patient bedside. Previous research has discussed various data collection methods, but a comprehensive solution for bedside data acquisition to analysis has not been achieved. In this paper, we proposed a multimodal data acquisition and analysis system called INSMA, with the ability to acquire, store, process, and visualize multiple types of data from the Philips IntelliVue patient monitor. We also discuss how the acquired data can be used for patient state tracking. INSMA is being tested in the ICU at University Hospitals Cleveland Medical Center.