Cross-modal applications that elaborately integrate audio, video, and haptic streams will become the mainstream of the eHealth systems. However, existing stream schedulers usually fail to simultaneously meet the cross-modal transmission requests in terms of low latency, high reliability, high throughput, and low complexity. To circumvent this dilemma, this article proposes a general cross-modal stream scheduling scheme by fully taking advantage of the characteristics of different modal streams and their underlying temporal, spatial, and semantic relevance. Specifically, we first propose a hierarchical stream category framework, in which the transmission priority of the modal stream instead of the data flow can be flexibly settled. Next, we design a series of modal-aware stream scheduling schemes by jointly making use of the network slice and mobile edge computing to achieve the tradeoff among the various metrics. Importantly, the transmission strategy can be adjusted adaptively to realize the optimal resource allocation. Subsequently, we analyze the relationship among the user experience, multi-modal impact, and stream scheduling through investigating the interacted impacts among the different modal streams, then develop a user experience based scheduling switch strategy to improve the application generality and reduce the performance fluctuation. Numerical objective and subjective results demonstrate the efficiency of the proposed cross-modal scheduling scheme.

中文翻译：

---

电子健康的跨模式流调度

精心集成音频、视频和触觉流的跨模式应用将成为电子医疗系统的主流。然而，现有的流调度器在低延迟、高可靠性、高吞吐量和低复杂度方面通常无法同时满足跨模式传输请求。为了规避这一困境，本文充分利用不同模态流的特性及其潜在的时间、空间和语义相关性，提出了一种通用的跨模态流调度方案。具体来说，我们首先提出了一个分层的流类别框架，其中可以灵活设置模态流而不是数据流的传输优先级。下一个，我们通过联合使用网络切片和移动边缘计算来设计一系列模态感知流调度方案，以实现各种指标之间的权衡。重要的是，可以自适应地调整传输策略以实现最佳资源分配。随后，我们通过调查不同模态流之间的交互影响来分析用户体验、多模态影响和流调度之间的关系，然后开发一种基于用户体验的调度切换策略，以提高应用程序的通用性并减少性能波动。数值客观和主观结果证明了所提出的跨模式调度方案的效率。可以自适应调整传输策略，实现资源的最优分配。随后，我们通过调查不同模态流之间的交互影响来分析用户体验、多模态影响和流调度之间的关系，然后开发一种基于用户体验的调度切换策略，以提高应用程序的通用性并减少性能波动。数值客观和主观结果证明了所提出的跨模式调度方案的效率。可以自适应调整传输策略，实现资源的最优分配。随后，我们通过调查不同模态流之间的交互影响来分析用户体验、多模态影响和流调度之间的关系，然后开发一种基于用户体验的调度切换策略，以提高应用程序的通用性并减少性能波动。数值客观和主观结果证明了所提出的跨模式调度方案的效率。然后开发基于用户体验的调度切换策略，提高应用的通用性，减少性能波动。数值客观和主观结果证明了所提出的跨模式调度方案的效率。然后开发基于用户体验的调度切换策略，提高应用的通用性，减少性能波动。数值客观和主观结果证明了所提出的跨模式调度方案的效率。