Temporal dynamics is an open issue for modeling human body gestures. A solution is resorting to the generative models, such as the hidden Markov model (HMM). Nevertheless, most of the work assumes fixed anchors for each hidden state, which make it hard to describe the explicit temporal structure of gestures. Based on the observation that a gesture is a time series with distinctly defined phases, we propose a new formulation to build temporal compositions of gestures by the low-rank matrix decomposition. The only assumption is that the gesture's “hold” phases with static poses are linearly correlated among each other. As such, a gesture sequence could be segmented into temporal states with semantically meaningful and discriminative concepts. Furthermore, different to traditional HMMs which tend to use specific distance metric for clustering and ignore the temporal contextual information when estimating the emission probability, we utilize the long short-term memory to learn probability distributions over states of HMM. The proposed method is validated on multiple challenging datasets. Experiments demonstrate that our approach can effectively work on a wide range of gestures, and achieve state-of-the-art performance.

中文翻译：

---

通过隐藏状态探索进行 3D 骨骼手势识别


时间动力学是人体姿势建模的一个悬而未决的问题。一种解决方案是求助于生成模型，例如隐马尔可夫模型（HMM）。然而，大多数工作都假设每个隐藏状态都有固定的锚点，这使得很难描述手势的显式时间结构。基于手势是具有明确定义的阶段的时间序列的观察，我们提出了一种新的公式来通过低秩矩阵分解来构建手势的时间组合。唯一的假设是手势的“保持”阶段与静态姿势彼此线性相关。因此，手势序列可以被分割成具有语义意义和区分性概念的时间状态。此外，与传统的 HMM 不同，传统的 HMM 在估计发射概率时倾向于使用特定的距离度量进行聚类并忽略时间上下文信息，我们利用长短期记忆来学习 HMM 状态的概率分布。所提出的方法在多个具有挑战性的数据集上得到验证。实验表明，我们的方法可以有效地处理各种手势，并实现最先进的性能。