Elsevier

Neuroscience Research

Volume 176, March 2022, Pages 49-56
Neuroscience Research

Markerless analysis of hindlimb kinematics in spinal cord-injured mice through deep learning

https://doi.org/10.1016/j.neures.2021.09.001Get rights and content

Highlights

  • A deep learning based markerless 2D kinematic analysis in SCI mice was developed.

  • Markerless approach reduced skin error from soft tissue movement on the knee joint.

  • 30 extracted kinematic parameters distinguished intact and SCI locomotion.

Abstract

Rodent models are commonly used to understand the underlying mechanisms of spinal cord injury (SCI). Kinematic analysis, an important technique to measure dysfunction of locomotion after SCI, is generally based on the capture of physical markers placed on bony landmarks. However, marker-based studies face significant experimental hurdles such as labor-intensive manual joint tracking, alteration of natural gait by markers, and skin error from soft tissue movement on the knee joint. Although the pose estimation strategy using deep neural networks can solve some of these issues, it remains unclear whether this method is adaptive to SCI mice with abnormal gait. In the present study, we developed a deep learning based markerless method of 2D kinematic analysis to automatically track joint positions. We found that a relatively small number (< 200) of manually labeled video frames was sufficient to train the network to extract trajectories. The mean test error was on average 3.43 pixels in intact mice and 3.95 pixels in SCI mice, which is comparable to the manual tracking error (3.15 pixels, less than 1 mm). Thereafter, we extracted 30 gait kinematic parameters and found that certain parameters such as step height and maximal hip joint amplitude distinguished intact and SCI locomotion.

Introduction

Potential treatments for spinal cord injury commonly occur in rodent models. In recent decades, various interventions have been developed, including cell replacement therapy (Kajikawa et al., 2020; Kamata et al., 2021; Kojima et al., 2019; Nori et al., 2011; Okubo et al., 2018; Tsuji et al., 2019), a combination of multiple treatments (Ito et al., 2018; Maier et al., 2009), and genetically modified animals (Takeoka et al., 2014), and consequently, gait patterns after interventions have become more diverse and complex. Thus, these rodent studies require reliable, consistent, and objective behavioral assessments of gait function to accurately determine the effects of these treatments.

Kinematic analyses using reflective markers attached on animals’ skin have been used for evaluating locomotor deficits; however, this marker-based approach has some issues to consider in both recording and analysis. First, the attached markers are potentially distracting to animals (Pérez-Escudero et al., 2014). Moreover, it is empirically known that SCI mice tend to have low motivation for stable walking, causing them to fail to complete their walking task. Second, reflective markers placed on distal joints such as the toe or the metatarsophalangeal (MTP) joint may affect the natural gait of mice. Notably, this effect is even more pronounced in SCI mice that have difficulty locomotion. Finally, the marker positions are often manually digitized afterward, which is a labor-intensive and time-consuming procedure that constrains the number of groups, mice, and evaluations that can be included within the experimental plan.

Besides the recording and analysis issues described above, reflective markers placed on the skin surface relative to the bone are a primary factor limiting the resolution of detailed joint movements. Soft tissue movement around the knee joint is the principal source of error during locomotion in rodents (Bauman and Chang, 2010). Previous kinematic analyses have either neglected to account for skin error or utilized a triangulation algorithm for estimating the knee joint position (Filipe et al., 2006).

Developing markerless-based analyses would avoid the drawbacks of reflective marker-based analyses (Sheets et al., 2013). Recently, machine learning-based motion capture has become common. In the present study, we demonstrate that markerless kinematic analysis using deep learning can quantitatively assess locomotion in intact and SCI mice. Using this method, we present a variety of gait parameters and show that these parameters change robustly after SCI.

Section snippets

Animals

Female C57Bl6/J mice (8 weeks old, 18–20 g, n = 30) were used in the present study. The animals were housed under a 12 h light/dark cycle, with food and water ad libitum. All animal experiments were approved by the ethics committee of Keio University (#13020) and were in accordance with the guidelines of the National Institutes of Health.

Experimental procedures

Mice were anesthetized with an intraperitoneal injection of ketamine (100 mg/kg) and xylazine (10 mg/kg), and a contusive SCI was produced at Th10 using an IH

Deep neural network performance

The datasets generated in this study used training images of intact mice for tracking the location of the joints in intact mice (Fig. 1), and training images of SCI mice to track the joints’ location in SCI mice. The time required for manual labeling was approximately 1 h per 100 images. To verify whether a single dataset can track the labeled body parts of intact and SCI mice, we created combined datasets using training images of intact and SCI mice.

Discussion

In the present study, we demonstrated a markerless 2D kinematic analysis in intact and SCI mice using a deep learning approach to evaluate the abnormal gait caused by SCI accurately. Using this method, we were able to record enough steps to analyze from SCI mice which tend to have low motivation for stable walking, to exclude the effect of distracting markers on natural gait, to reduce the error by skin movement, and to avoid the hand-digitized joint tracking procedure which is time-consuming

Author contributions

RS performed the animal surgeries. RS, YS, and TK performed behavioral tests. YS, TK, and MS analyzed the data. YS, TK, MS, NN, JU, MN, and HO designed the study. MS, NN, JU, MN, and HO supervised the study.

This work has not been published elsewhere and is not under review with another journal.

Declaration of Competing Interest

HO is a compensated scientific consultant of San Bio, Co., Ltd., and K Pharma, Inc., and has received research funding from Dainippon Sumitomo Pharmaceutical Co., Ltd. MN is a compensated scientific consultant at K Pharma, Inc. JU is a founder and the Representative Director of the University Startup Company, Connect Inc., for the research, development, and sale of rehabilitation devices including the brain-computer interface. He received a salary from Connect Inc. and held shares in Connect

Acknowledgments

We thank Akito Kosugi and Seitaro Iwama for their technical assistance. This research was supported by AMED under grant No. JP21bm0204001h (to H.O. and M.N.), and JSPS KAKENHI Grant Nos. JP19H03983, 19K16190, and JP20H05480.

References (26)

  • G. Courtine et al.

    Transformation of nonfunctional spinal circuits into functional states after the loss of brain input

    Nat. Neurosci.

    (2009)
  • K. He et al.

    Delving deep into rectifiers: surpassing human-level performance on imagenet classification

    Proceedings of the IEEE International Conference on Computer Vision

    (2015)
  • S. Ito et al.

    Lotus inhibits neuronal apoptosis and promotes tract regeneration in contusive spinal cord injury model mice

    eNeuro

    (2018)
  • 1

    These authors contributed equally to this work.

    View full text