This Letter proposes a stochastic model of the wearable sensor nodes of a wireless body area network (WBAN) based on Markov decision process (MDP). The proposed technique tackles the problem of maximising the likelihood of data transmission while minimising the computational cost and energy. Suitable transmission strategies subject to the energy level of the nodes and channel conditions are needed to be investigated to strike a balance between network lifetime and packet delivery ratio. MDP formulation of the problem is solved offline to find out the optimal transmission strategies for the representative input conditions. The results of this offline computation approach can directly map to optimal transmission policies for intra-WBAN communications. The experimental results demonstrate the robustness of the proposed scheme in handling both favourable and unfavourable operating conditions.

中文翻译：

---

为WBAN内部通信寻找最佳传输策略

这封信提出了基于马尔可夫决策过程（MDP）的无线人体局域网（WBAN）的可穿戴传感器节点的随机模型。所提出的技术解决了最大化数据传输可能性同时最小化计算成本和能量的问题。需要研究受节点能量水平和信道条件影响的合适传输策略，以在网络寿命和数据包传输率之间取得平衡。离线解决问题的MDP公式，以找出代表输入条件的最佳传输策略。这种离线计算方法的结果可以直接映射到WBAN内部通信的最佳传输策略。