Next Article in Journal
Fabrication and Characterization of Line-by-Line Inscribed Tilted Fiber Bragg Gratings Using Femtosecond Laser
Next Article in Special Issue
DATSURYOKU Sensor—A Capacitive-Sensor-Based Belt for Predicting Muscle Tension: Preliminary Results
Previous Article in Journal
A Cipher Based on Prefix Codes
Previous Article in Special Issue
Wearable Detection of Trunk Flexions: Capacitive Elastomeric Sensors Compared to Inertial Sensors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Study on the Classification Effect of sEMG Signals in Different Vibration Environments Based on the LDA Algorithm

1
School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
2
Beijing Advanced Innovation Center for Intelligent Robot and System, Beijing 100081, China
3
Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo 182-8585, Japan
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(18), 6234; https://doi.org/10.3390/s21186234
Submission received: 8 August 2021 / Revised: 13 September 2021 / Accepted: 14 September 2021 / Published: 17 September 2021
(This article belongs to the Collection Wearable Sensors for Risk Assessment and Injury Prevention)

Abstract

:
Myoelectric prosthesis has become an important aid to disabled people. Although it can help people to recover to a nearly normal life, whether they can adapt to severe working conditions is a subject that is yet to be studied. Generally speaking, the working environment is dominated by vibration. This paper takes the gripping action as its research object, and focuses on the identification of grasping intentions under different vibration frequencies in different working conditions. In this way, the possibility of the disabled people who wear myoelectric prosthesis to work in various vibration environment is studied. In this paper, an experimental test platform capable of simulating 0–50 Hz vibration was established, and the Surface Electromyography (sEMG) signals of the human arm in the open and grasping states were obtained through the MP160 physiological record analysis system. Considering the reliability of human intention recognition and the rapidity of algorithm processing, six different time-domain features and the Linear Discriminant Analysis (LDA) classifier were selected as the sEMG signal feature extraction and recognition algorithms in this paper. When two kinds of features, Zero Crossing (ZC) and Root Mean Square (RMS), were used as input, the accuracy of LDA algorithm can reach 96.9%. When three features, RMS, Minimum Value (MIN), and Variance (VAR), were used as inputs, the accuracy of the LDA algorithm can reach 98.0%. When the six features were used as inputs, the accuracy of the LDA algorithm reached 98.4%. In the analysis of different vibration frequencies, it was found that when the vibration frequency reached 20 Hz, the average accuracy of the LDA algorithm in recognizing actions was low, while at 0 Hz, 40 Hz and 50 Hz, the average accuracy was relatively high. This is of great significance in guiding disabled people to work in a vibration environment in the future.

1. Introduction

The hand is an important functional and motor organ of the human body. The inability to work due to upper limb motor dysfunction and limb deformity caused by various accidents imposes a great burden on the lives of patients, making them unable to work and earn their own living. The common method is to install artificial limbs to help them recover their hand function. In the current application of artificial limbs, myoelectric prosthesis [1] is the most widely used, which is characterized by strong sense of control and convenient use. Although artificial limbs can help people recover to a nearly normal life, whether they can adapt to severe working conditions is a subject that is yet to be studied. Generally speaking, the working environment is dominated by vibration. Therefore, this paper takes the gripping action as the research object, and focuses on the identification of grasping intentions under different vibration frequencies in different working conditions, so as to explore the possibility that patients with hand functional defects are engaged in different work vibration environments.
Surface Electromyography (sEMG) signals are a type of electrophysiological signal that has been widely studied and applied in clinical medicine and engineering [2]. It is a non-invasive procedure involving the detection, recording and interpretation of the electric activity of groups of muscles at rest (i.e., static) and during activity (i.e., dynamic). One important application of sEMG signals is their use in the control of prosthetic hands. However, in the prosthesis market, almost all sEMG controlled prosthetics are controlled outside a vibration environment, and there are few reports on the effects of different vibration environments on the sEMG signals of the upper limbs. Most of the studies focus on the effects of body vibration on the sEMG signals in the lateral thigh muscles [3,4,5,6,7]. The optimal vibration frequency (OVF), which corresponds to the maximal sEMG muscle response during whole-body vibration, between young, middle-aged, and older women in four muscles of the lower limbs was compared by Flaminia et al. [3]. The frequency corresponding to the maximal root mean square of the surface electromyogram (RMSmax) was found to be higher in older rather than younger women in all muscles. Giombini pointed out that the frequency of whole-body vibration (WBV) that elicits the greatest improvement in lower-limb power output after an acute exposure in older women should be prescribed in an individualized fashion, within the range of 30–35 Hz [8]. Marco Cardinale reported that the frequency, 30 Hz, as the one eliciting the highest reflex response in vastus lateralis muscle during WBVs in the half-squat position, would result in the highest sEMGrms [9]. Thus, in this paper, we focus on the influence of different vibration frequencies on the sEMG signals of the upper limbs.
sEMG signals, up to 6 mV and within a frequency range of 0–500 Hz, are one-dimensional time-series signals recorded by electrodes which are on the body skin over muscle bandage during neuromuscular system activity [10,11]. They present nonstationarity, nonlinearity, complexity, and large variation, which lead to difficulty in analyzing sEMG signals [12]. Therefore, it is difficult to identify the motion intention of upper limbs by sEMG signals. At present, the recognition of human movement intention through sEMG signals is mainly divided into three steps [13]: sEMG signal preprocessing, feature extraction and feature classification [14,15,16]. The sEMG signal preprocessing generally includes sEMG signal amplification, filtering and notch. In this process, noise removal is a significant step [17] that directly affects the authenticity of the signal. The next important step is feature extraction, which is performed to highlight the relevant structures in the sEMG signal and reject noise and unimportant sEMG signals. sEMG signal feature extraction mainly involves time-domain analysis, which includes the integrated EMG, mean absolute value (MAV), root mean square (RMS), and zero crossing (ZC) [18], frequency-domain analysis, which includes the autoregressive coefficient (AR) and modified median frequency (MMDF) [19], and time-frequency-domain analysis, which includes the wavelet transform (WT) and Wigner-Ville distribution (WVD) [20]. The more mature sEMG signal feature extraction method, which is safer and more reliable, is the time-domain analysis method because of its computational simplicity and wide use in research and in clinical practice. Hudgins et al. recognized four forearm motions by using five time-domain features, i.e., MAV, mean absolute value slope (MAVS), ZC, slope sign change (SSC) and waveform length (WL), and achieved an average accuracy rate of 91% [21]. Kim et al. successfully classified four wrist movements by using the integrated absolute value (IAV) and RMS [22]. The combination of different features is used for the characteristic classification of sEMG signals. Some feature classification algorithms such as linear discriminant analysis (LDA) [23], fuzzy logic, artificial neural networks (ANNs) [24], and the support vector machine (SVM) [25] have been used in several studies to assess the performance in classifying motion classes. Among them, the LDA classifier is much simpler to implement and much faster to train. Using LDA to reduce the dimensionality of the extracted feature signals, Chu et al. [26] identified nine movements of the forearm, wrist and palm with four electrodes and obtained an accuracy of 97.4%. When recognizing 10 independent and associated motions of fingers, Khushaba et al. used LDA to reduce a series of features to nine dimensions and achieved an accuracy of 90% [27].
Since sEMG signals are collected and extracted in the more complex external vibration environment, a simpler, safer and more reliable algorithm should be selected in the process of sEMG signal extraction and recognition to ensure the accuracy of signal recognition. In this research, the influence of various vibration frequencies on sEMG signals is studied by using the time-domain analysis method and LDA. The main aim of this study was to recognize the grasping and opening gestures in different vibration environments. This can be a good guide to evaluate whether it is suitable for disable people to work in such conditions, and help them return to work. First, we propose this new method using sEMG signal to recognize grasping and opening gestures toward to the real industry environment. Second, we develop the special system for the collection of sEMG signal for gesture recognition. Thirdly, we also make a full study on the recognition performance of different feature combination and vibration environment, so as to improve the performance of the system. This paper is organized as follows: Data acquisition from sEMG signals under a vibration environment and an illustration of how sEMG signals are converted to time series are introduced in Section 2. The main data processing algorithms, including feature extraction and feature classification, are introduced in Section 3. The results and a discussion are given in Section 4, and finally, the conclusions are presented in Section 5.

2. Data Acquisition

2.1. Data Platform Construction

Based on the complex characteristics of sEMG signals, to ensure the authenticity of sEMG signals, a professional electrode, 42 mm × 26 mm, Ag/AgCl, type LT-7, which is produced by Shanghai LITU Medical Appliances Co., Ltd, was used in this paper. After the skin was wiped clean with medical alcohol or saline, the electrodes were tightly attached to the skin. The amplitude of the original sEMG signal collected by the electrode was only 0–6 mV. This signal was amplified by an amplifier circuit and then preprocessed to remove noise. Finally, a usable sEMG signal was obtained. Figure 1 shows the process of acquiring sEMG signals.
It is difficult to acquire sEMG signals stably. However, with the development of electronic technology, new detection and recording technologies have reached relative maturity, and many sEMG acquisition systems have been widely used in medical and scientific research fields, such as Trigno (produced by Delsys of the United States) and Myoscan (produced by Thought Technology of Canada). The equipment used to collect sEMG signals in this paper was the MP160 physiological record analysis system made by BIOPAC. The sEMG signal sampling frequency was 1000 Hz. Signal data transmission occurred via wireless Bluetooth. The sEMG signal detection platform established in this paper is shown in Figure 2. Based on our survey, the vibration frequency is often the same for a certain working environment in real life. In addition disabled people can often only do the same job, which usually requires a single vibration environment. Our training set and testing set are from the same frequency environment.

2.2. Acquisition of Signals at Various Vibration Frequencies

In everyday life, there are various kinds of vibration equipment, such as electric toothbrushes, household cleaners, hair dryers, and juicers. Of course, among the commonly used construction tools, there is also some equipment with larger vibration amplitudes, such as electric drills, polishing machines, and cutting machines which have mixed vibration. The range of vibration frequency is selected based on the engineering equipment we operate in the real industrial environment. Thus, how to simulate this kind of mixed vibration in the laboratory environment is the primary problem. Figure 3 presents the vibration simulator designed in this paper, which can simulate various vibration environments that contains the vertical and horizontal vibration within the frequency range of 0–50 Hz. In the design of the vibration simulator, the safety and reliability factors in the operation process are considered, and the hoisting hook, emergency stop button and other facilities are set up. At the same time, combined with most operating modes in daily construction, the operating handle and cooperating handle are set on both sides of the vibration simulator. Throughout the test, the vibration simulator was placed on a 750 mm high platform, which is a suitable height to subjects. Thus, it can be easy for subjects to grasp while standing. The vibration direction is mixed. At the same time, in order to approximate a real application, our experiment is based on a real operating environment in which subjects are required to operate vibration equipment with a comfortable grasp force.
In this system, after being amplified and filtered, the acquired sEMG signals are converted to digital signals by an analog/digital converter and transmitted to a PC to undergo signal processing for feature extraction. In this paper, the 0 Hz, 10 Hz, 20 Hz, 30 Hz, 40 Hz and 50 Hz vibration frequencies are selected as the frequencies to measure from the vibration frequency range of 0–50 Hz. The digital signals collected in each frequency environment, where the signals of each pattern last for 1.5 s, are shown in Figure 4. The sEMG signals generated during the different state transitions are removed. In total, we collected 132 samples of each individual for experiment. The ratio of the training set to testing set is 1/1, and these two sets are collected at different times to avoid overfitting.

2.3. Signal Window Processing

The selection of signal sampling points is always limited, and the computer processes the signal data using the windowed overlapping algorithm. The algorithm iteratively extracts the eigenvectors of a sequence of signal data by intercepting the nearest signal fragment. This process is shown in Figure 5, where a window is used to generate the raw samples. To be specific, for each instance of recognition, the segment of signals in the current window is cut from the sEMG series to compose a raw sample for recognition, where the width of window w determines the length for each sample. Then, the window moves forward s steps, and a new raw sample is obtained. The real-time recognition is realized by repeating this process successively. Thus, the period between two adjacent instances of recognition is obtained by T r = 1 / f r = s / f s , where f s is the frequency of signal sampling. In Figure 5, when N = 1 , the signals in the current window are Data(0) − Data( w 1 ), and when N = 2 , Data(s) − Data( w + s 1 ), where Data(x) is the signal acquired at time x / f s and N = k corresponds to the kth instance of recognition. The original signal waveforms are shown in Figure 4. Since the sampling frequency of the signal in this paper is 1000 Hz, the window size should be as small as possible to ensure smooth and accurate signal extraction, and the signal sliding increment needs to be reasonably set. In this paper, the optimal window size and optimal movement increment are verified through supervised training to ensure that each signal can be extracted at various frequencies and the correct rate of action classification is the highest.

3. Algorithm Description

Since this paper mainly studies the effects of sEMG signal classification and recognition under environments of various vibration frequencies, the external environment is more complex. Considering the safety and reliability factors comprehensively, and by combining the existing signal processing means, in this paper, we extract signal feature vectors by various time-domain analysis algorithms, and the grasping and opening modes of the hand are classified by the LDA algorithm. The relevant algorithms are introduced from the following two aspects: signal feature extraction and motion classification.

3.1. Feature Extraction Methods

SEMG signal processing can be divided into three categories: time domain, frequency domain, and time-frequency domain. These approaches make it easier for researchers to characterize sEMG signals. Figure 6 provides an overview of the sEMG signal processing methods that are introduced in this paper.
Among them, the integral myoelectric value, defined in Equation (1), the RMS value, defined in Equation (2), and the MAV, defined in Equation (3), can reflect the variation characteristics of the sEMG signal amplitude in the time domain.
i E M G = t t + T E M G ( t ) d t
R M S = 1 N n = 1 N x n 2
M A V = 1 N n = 1 N x n
where N = number of samples in a signal segment and x n is the nth sample in the sEMG signal.
ZC is the number of times the voltage amplitude of an sEMG signal crosses the 0-y-axis, i.e., the number of times the amplitude of the signal exceeds the zero-amplitude level due to low voltage fluctuation or background noise. To avoid the influence of low voltage fluctuation or background noise, the threshold condition is applied to the signal amplitude, and the following formula is obtained:
Z C = i = 1 N 1 s g n ( x n × x n 1 ) x n x n 1 t h r e s h o l d ; s g n ( x ) = 1 , if x t h r e s h o l d 0 , otherwise .
Variance (VAR) is a measure of the degree of dispersion in a random variable or a set of data. Probability variance is used to measure the degree of deviation between a random variable and its mathematical expectations, known as the mean. Thus, for a set of random variables, for N samples taken at random, the variance of this set of samples is X i squared divided by N minus 1.
V A R = i = 1 n ( X i X ¯ ) 2 n 1 .
where X i represents the ith sample, X ¯ represents the population mean of the sample data and n represents the total number of samples.
In the aspect of frequency-domain analysis, the main analysis method is to apply the fast Fourier transform to the sEMG signals to obtain their spectrum or power spectrum, which can reflect the changes in the sEMG signals in different frequency components.
In frequency-domain analysis, the AR time-series model, where the coefficients are linearly combined and formulated as estimations of previous samples, is one of the most commonly used methods to analyze sEMG signals. An equation for the AR coefficient is shown in Equation (5).
A R = x ¯ ( k ) = i = 1 P a j ( i ) x ¯ j ( k i ) + μ k , k = 0 , 1 , 2 . . .
where x ¯ ( k ) denotes the signal, a j represents the AR coefficients, p is the order of the AR model, and μ k is the white noise sequence.
To a certain extent, the mean frequency obtained by the short-time Fourier transform (STFT) can better represent the fatigue changes of muscles. The formula for calculating the median frequency is shown in Equation (6).
f 1 M D F P S ( f ) d f = M D F f 2 P S ( f ) d f
where P S ( f ) is the spectrum of the sEMG signal and f 1 , f 2 is the frequency range of the sEMG signal.
The STFT introduced by Gabor [28] retains the time information of the traditional Fourier transform through a window of fixed size. The WT is the solution of the high time-frequency characteristic obtained by introducing the variable window. The WT is defined mathematically as shown in Equation (7).
f , Ψ a , b = 1 a f ( t ) Ψ t b ¯ a d t
where Ψ ( t ) is the mother wavelet, which is scaled by factor a and delayed by time b, and f ( t ) is the signal for analysis.
The WVD was first introduced by Wigner in the area of quantum mechanics in 1932, and later in 1948, Ville developed and applied the same transformation to signal processing and spectral analysis [29]. Equation (8) shows the formula for the WVD.
W x ( t , f ) = x t + τ 2 x * τ τ 2 e 2 j π f τ d τ
where x t + τ 2 x * τ τ 2 is the instantaneous autocorrelation function and * denotes the conjugate operation.
In addition to the processing techniques listed in this paper, there are several techniques such as the Hilbert-Huang transform [30] and S-transform [31] that have been used to analyze sEMG signals. Currently, the sEMG signal processing algorithms used by sEMG prostheses are mainly the integrated EMG, RMS value, and median frequency due to their good qualities, including linearity, high efficiency, and simplicity.

3.2. Feature Classification

Many mature algorithms for feature classification are commonly used at present, such as LDA, principal component analysis (PCA), the SVM, K-nearest neighbors (KNN), the ANN, and decision trees. LDA is a classic, simple and practical method for dimensional reduction, first proposed by Fisher [32] in 1936 for the dichotomy problem, also known as Fisher’s linear discrimination. The basic idea of the LDA classifier is to find an optimal discriminant vector space to maximize the ratio of the interclass dispersion to intraclass dispersion of samples projected into a space.
The calculation steps of the LDA algorithm are as follows:
(a) The mean vector for each class is defined to be:
u i = 1 n i x c l a s s i x
where n i is the number of samples of each class and x denotes the original feature vectors of each class.
(b) The population mean of the sample is calculated as:
u = 1 m i = 1 m x i
where m is the total number of classes.
(c) The interclass divergence matrix and the intraclass divergence matrix are calculated as:
S b = i = 1 c n i ( u i u ) ( u i u ) T
S w = i = 1 c x c l a s s i ( u i x k ) ( u i x k ) T
Here, it is important to note that a weighted average is needed when calculating the total S b and S w , as the number of samples for each class may be different.
(d) Finally, the Fisher criterion can be expressed in terms of S b and S w as:
J ( w ) = w T S b w w T S w w
By maximizing the generalized Rayleigh quotient, we can use the Lagrange multiplier method [33] to find the required eigenvectors. Then, the original feature matrix (mxn) is projected by:
y = w T x
The matrix y represents the eigenvector of the projection of the original data, through which we can obtain the best recognition accuracy.

4. Data Analysis and Processing

4.1. Window Size Selection

Through the established experimental platform, the 0–50 Hz vibration environment can be simulated, among which five vibration environments of 10 Hz, 20 Hz, 30 Hz, 40 Hz and 50 Hz are selected for testing.The sampling frequency of the sEMG signal is 1000 Hz. A suitable sliding window size can improve not only the algorithm speed but also the accuracy of algorithm recognition. If the window is greater than 300 ms, the characteristic value of the calculated sEMG signal will be too large in terms of the time scale, which will cause people to feel frustrated. Thus, the time from muscle contraction to the system producing the corresponding classification decision should not be less than 300 ms. The curve in Figure 7 shows the recognition accuracy of the algorithm under sliding windows of different sizes. Clearly, the best effect is achieved when the size of the sliding window is set to 250 ms.
On the other hand, setting the window too small will place a high computational burden on the system and affect the accuracy. Due to the nonlinear nature of sEMG signals, it is very difficult to make a correct decision through a window. Moreover, by making as many decisions as possible, you can smooth those decisions and obtain the final decision. The overlapping windowing scheme can solve these problems. The number of windows can be calculated as:
N o . o f w i n d o w s = d a t a l e n g t h w i n d o w s i z e w i n d o w i n c r e m e n t + 1
In this paper, the window length is set to 250 ms, and the window increment is set to 100 ms. Out of 5000 data points, 48 eigenvalues are eventually obtained.

4.2. Combinatorial Optimization Design of Two-Feature Classification

In this paper, 5000 points of data are intercepted for each action, and the time-domain features are extracted. The LDA algorithm is used to classify two actions, i.e., opening and grasping, of the hand under different vibration frequencies. Two types of features of each action are randomly selected as the input parameters of the LDA algorithm. In this paper, six time-domain eigenvalues (MAV, VAR, RMS, ZC, MIN, MAX) are used as input. The total number of eigenvalue combinations is 15.
Figure 8, Figure 9 and Figure 10 respectively present the recognition of sEMG signals in the opening and grasping states of a hand by the LDA algorithm when using the ZC and RMS eigenvalues, VAR and RMS eigenvalues, and MIN and RMS eigenvalues in combination. In the above three figures, the blue upper triangle and the red upper triangle represent the mean values of the internal eigenvalues of the opening and grasping states of the hand, respectively. The lower cyan triangle represents the average of all eigenvalues. The green lines represent the best projection lines that can distinguish different features (classes). The red crosses and blue plus signs are the features after projection for open and grasp respectively. The LDA algorithm is a supervised learning algorithm. After learning the training data, we test the corresponding unknown classified action data, obtain a group of data lists, and calculate its accuracy. The test accuracy is formulated as:
A c c u r a c y = T o t a l N o . o f f e a t u r e s N o . o f f e a t u r e c l a s s i f i c a t i o n e r r o r s T o t a l N o . o f f e a t u r e s × 100 %
The LDA algorithm is used to train and learn the sEMG signal data of the two motion modes under different vibration frequencies. In this paper, six different metrics for extracting the time-domain eigenvalues are selected, i.e., MAV, VAR, RMS, ZC, MIN, an MAX, with combinations of these characteristic values (15 in total) selected as input to the LDA algorithm.
Table 1 shows the accuracy of the action state recognition of the grasping and opening of human hands in a 0–50 Hz vibration environment when selecting any two time-domain features as input signals through the LDA algorithm under a sampling frequency of the sEMG signal of 1000 Hz, a signal processing window size of 250 ms, and a step size increment of 100 ms. Clearly, when the RMS and ZC eigenvalues are used as the classification characteristic signals, the LDA algorithm has the best accuracy in terms of pattern recognition of the opening and gripping movements of hands at different vibration frequencies. When the RMS and VAR, and RMS and MIN eigenvalues are used as classification inputs, the classification effect is also relatively good. Their accuracy is poor (i.e., less than 90%) only at a vibration frequency of 20 Hz. However, when ZC and MAX, ZC and MIN, and MAX and MIN are combined as inputs, the accuracy of the classification action recognition of the LDA algorithm is poor, with the lowest accuracy being only 63%. The distribution state of the accuracy can be observed more intuitively through Figure 11.

4.3. Combinatorial Optimization Design of Three-Feature Classification

When three eigenvalues are combined for the LDA algorithm, a total of 20 combinations can be generated from the six eigenvalues. Figure 12 shows the classification statuses of MAV, RMS, and ZC when the three eigenvalues are used as input. The green data point represents the eigenvalue when the hand is open, and the pink data point represents the eigenvalue when the hand is in the grasp state. Figure 11 shows that when three features are used as the input of the LDA classification algorithm, the opening and grasping movements of the hand are easy to distinguish.
Table 2 shows the classification accuracy of the LDA algorithm for hand opening and hand grasping at different vibration frequencies from 0–50 Hz when three different time-domain eigenvalues are used as the input conditions. Figure 13 can more intuitively show the accuracy of the LDA algorithm at different vibration frequencies. By comparison, it can be seen that when RMS, MIN, VAR and RMS, MIN, ZC are respectively input into the LDA algorithm as feature combinations, the classification accuracy is relatively high. The accuracy is low only at the 20 Hz vibration frequency, with a minimum accuracy of 88%, while a maximum accuracy rate of 98% is achieved in the rest of the vibration environments, with the rate always exceeding 90%. By contrast, when MAX, MIN, VAR and MAX, MIN, ZC are input into the LDA algorithm as feature combinations, the classification accuracy is relatively low.

4.4. Combinatorial Optimization Design of Classification Using All Features as Input

When all the selected time-domain features in this paper are used as the input conditions for the classification of actions by the LDA algorithm, the final accuracy of the classification of the hand opening and grasping actions is as shown in Table 3. Clearly, we can see that our method can always keep a high accuracy from the frequency of 0 Hz to 50 Hz. Overall, the accuracy for the frequencies of 0 Hz, 10 Hz, 40 Hz, 50 Hz are often higher than that of 20 Hz and 30 Hz.

4.5. Comparison of Average Accuracy

In the 0–50 Hz vibration environment, to more intuitively represent the accuracy of the action classification for each characteristic value combination in the LDA algorithm, this paper uses the average accuracy, obtained by the following formula.
A v e r a g e a c c u r a c y = 1 m i = 1 m ( A c c u r a c y ) i
where m represents the total number of each two-feature combination of the time-domain features.
Figure 14 shows the average accuracy of LDA algorithm classification under six different vibration environments, namely, 0 Hz, 10 Hz, 20 Hz, 30 Hz, 40 Hz and 50 Hz, when two, three and all six eigenvalues are used as the input conditions of the LDA algorithm. It can be seen from the figure that with the increase in the number of input conditions of the LDA algorithm, the classification accuracy of the LDA algorithm gradually increases, that is, the more types of input eigenvalues there are, the higher the accuracy. At the same time, it can be seen that the classification accuracy achieved by the LDA algorithm is low at a vibration frequency of 20 Hz relative to that at 0 Hz, 40 Hz and 50 Hz.
Feature importance on recognition accuracy in different vibration conditions.
As discussed above, we illustrate the recognition accuracy when only using two and three features for classification. Through the results, we can find an interesting thing when observing the contribution in accuracy. There are two factors that will influence the recognition accuracy, namely the feature number and feature quality, respectively. When the feature number increases, the average recognition follows, which is a well-known method for accuracy improvement.
We define the feature importance or feature contribution for the second finding. Based on our comparison, we find that combinations with some special features may often have high and low recognition accuracy, whatever the vibration frequency is. For example, it is general considered that RMS should be a feature of good quality, which means that if a combination contains this feature, the accuracy will always be better. This can be seen in the recognition results with two feature combinations, as well as three feature combinations. As Table 1 and Table 2 show, the combinations containing this feature are always able to show a high accuracy, whatever the vibration frequency is. In contrast, MIN and MAX should be worse features, and the combination which contains them may show a lower accuracy. There is no denying that when the number of features increases, these positive or negative influences will be weakened.
So, the better way to enhance accuracy in the future is to select the features with high contribution and avoid features with worse performance, which can be a good method to guide us for good application without complex research.

5. Conclusions

In this paper, we aimed to find a suitable scheme to improve the recognition performance of grasping and opening in an industrial environment, and thus provided a potential guide for disabled people who want to work well in different vibration environments. We mainly studied an industry situation where disabled people work only with simple gestures. Also, to allow disabled people to work freely, it may only be necessary for them to hold and control a machine, e.g., with grasp and opening movements. Our main aim is testing whether people can work in a particular vibration situation. To improve the reliability of hand-motion intention detection and reduce the computational complexity, this paper adopts a structure combining the time-domain features and LDA algorithm to identify opening and grasping hand motions under a vibration environment. In this paper, through a comparative test, it is determined that the LDA algorithm is the most accurate for human-motion-intention recognition when the sEMG signal feature extraction window size is 250 ms and the window increment is 100 ms. By a comparison of the number of eigenvalues input into the LDA algorithm, it is found that the greater the number of eigenvalues is, the higher the accuracy of hand-motion recognition by the LDA algorithm. When the number of input eigenvalues reaches 6, the accuracy of action recognition is the highest, up to 98.4%. At the same time, under a vibration frequency of 20 Hz, the sEMG signal is greatly affected by the vibration environment, and the accuracy of action recognition by the LDA algorithm is relatively low, only 88.5%, while at 0 Hz, 40 Hz and 50 Hz, the accuracy of action recognition by the LDA algorithm is relatively high.
To further study the impact of the vibration environment on sEMG signals, the following future research directions will be taken:
(1)
Enlarge the vibration frequency of the vibration environment and study the influence of a wider range of vibration frequencies on sEMG signals.
(2)
Study the accuracy of the LDA algorithm in terms of human intention recognition by comparing the time-domain and frequency-domain characteristics of sEMG signals.
(3)
Further compare the classification effects of various classifiers, such as the SVM, fuzzy logic, and the ANN.

Author Contributions

Manuscript writing, Y.W. and J.Z.; Data analysis, Y.W. and Y.T.; Charts making, Y.W. and J.Z.; Data collection, H.S.; Study design, H.Y. and Q.H.; Literature search, Y.J. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Beijing Advanced Innovation Center of Intelligent Robots and Systems under Grant 2016IRS23.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board of The University of Electro-Communications (10006(5) approved on 8 June 2018).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
sEMGsurface electromyographic
LDAlinear discriminant analysis
RMSroot mean square
ANNartificial neural network
MAVmean absolute value
ZCzero crossing
VARvariance

References

  1. Xing, K.; Yang, P.; Huang, J.; Wang, Y.; Zhu, Q. A real-time EMG pattern recognition method for virtual myoelectric hand control. Neurocomputing 2014, 136, 345–355. [Google Scholar] [CrossRef]
  2. Veer, K.; Sharma, T. A novel feature extraction for robust EMG pattern recognition. J. Med. Eng. Technol. 2016, 40, 149–154. [Google Scholar] [CrossRef] [PubMed]
  3. Carlucci, F.; Orlando, G.; Haxhi, J.; Laudani, L.; Giombini, A.; Macaluso, A.; Pigozzi, F.; Sacchetti, M. Older Age Is Associated with Lower Optimal Vibration Frequency in Lower-Limb Muscles During Whole-Body Vibration. Am. J. Phys. Med. Rehabil. 2015, 94, 522–529. [Google Scholar] [CrossRef] [PubMed]
  4. Lienhard, K.; Vienneau, J.; Nigg, S.; Friesenbichler, B.; Nigg, B.M. Older adults show higher increases in lower-limb muscle activity during whole-body vibration exercise. J. Biomech. 2017, 52, 55–60. [Google Scholar] [CrossRef] [PubMed]
  5. Zaidell, L.N.; Mileva, K.N.; Sumners, D.P.; Bowtell, J.L. Experimental Evidence of the Tonic Vibration Reflex during Whole-Body Vibration of the Loaded and Unloaded Leg. PLoS ONE 2013, 8, e85247. [Google Scholar]
  6. Roelants, M.; Delecluse, C.; Verschueren, S.M. Whole-Body-Vibration Training Increases Knee-Extension Strength and Speed of Movement in Older Women. J. Am. Geriatr. Soc. 2004, 52, 901–908. [Google Scholar] [CrossRef]
  7. Perchthaler, D.; Horstmann, T.; Grau, S. Variations in neuromuscular activity of thigh muscles during whole-body vibration in consideration of different biomechanical variables. J. Sports Sci. Med. 2013, 12, 439–446. [Google Scholar]
  8. Giombini, A.; Macaluso, A.; Laudani, L.; Di Cesare, A.; Piccinini, A.; Pigozzi, F.; Saraceni, V.M. Acute Effect of Whole-Body Vibration at Optimal Frequency on Muscle Power Output of the Lower Limbs in Older Women. Am. J. Phys. Med. Rehabil. 2013, 92, 797–804. [Google Scholar] [CrossRef]
  9. Cardinale, M.; Leiper, J.; Erskine, J.; Milroy, M.; Bell, S. The acute effects of different whole body vibration amplitudes on the endocrine system of young healthy men: A preliminary study. Clin. Physiol. Funct. Imaging 2010, 26, 380–384. [Google Scholar] [CrossRef] [PubMed]
  10. Chu, J.U.; Moon, I.; Lee, Y.J.; Kim, S.K.; Mun, M.S. A Supervised Feature-Projection-Based Real-Time EMG Pattern Recognition for Multifunction Myoelectric Hand Control. IEEE/ASME Trans. Mechatron. 2007, 12, 282–290. [Google Scholar] [CrossRef]
  11. Konrad, P. The ABC of EMG. A Practical Introduction to Kinesiological Electromyography; Noraxon Inc.: Scottsdale, AZ, USA, 2005. [Google Scholar]
  12. Scheme, E.J.; Englehart, K.B.; Hudgins, B.S. Selective Classification for Improved Robustness of Myoelectric Control Under Nonideal Conditions. IEEE Trans. Biomed. Eng. 2011, 58, 1698–1705. [Google Scholar] [CrossRef]
  13. Shair, E.F.; Ahmad, S.A.; Marhaban, M.H.; Mohd Tamrin, S.B.; Abdullah, A.R. EMG Processing Based Measures of Fatigue Assessment during Manual Lifting. BioMed Res. Int. 2017, 2017, 3937254. [Google Scholar] [CrossRef]
  14. Nsugbe, E.; Phillips, C.; Fraser, M.; McIntosh, J. Gesture Recognition for Trans-humeral Prosthesis Control Using EMG and NIR. IET Cyber-Syst. Robot. 2020, 2, 122–131. [Google Scholar] [CrossRef]
  15. Phinyomark, A.; Hirunviriya, S.; Limsakul, C.; Phukpattaranont, P. Evaluation of EMG feature extraction for hand movement recognition based on Euclidean distance and standard deviation. In Proceedings of the ECTI-CON2010: The 2010 ECTI International Confernce on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology, Chiang Mai, Thailand, 19–21 May 2010. [Google Scholar]
  16. Wang, N.; Lao, K.; Zhang, X. Design and Myoelectric Control of an Anthropomorphic Prosthetic Hand. J. Bionic Eng. 2017, 14, 47–59. [Google Scholar] [CrossRef]
  17. Farina, D.; Lucas, M.F.; Doncarli, C. Optimized wavelets for blind separation of non-stationnary surface myoelectric signals. IEEE Trans. Biomed. Eng. 2007, 55, 78–86. [Google Scholar] [CrossRef] [PubMed]
  18. Tkach, D.; Huang, H.; Kuiken, T.A. Study of stability of time-domain features for electromyographic pattern recognition. J. Neuroeng. Rehabil. 2010, 7, 21. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Potluri, C.; Kumar, P.; Anugolu, M.; Urfer, A.; Chiu, S.; Naidu, D.S.; Schoen, M.P. Frequency domain surface EMG sensor fusion for estimating finger forces. In Proceedings of the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, Buenos Aires, Argentina, 31 August–4 September 2010; pp. 5975–5978. [Google Scholar]
  20. Sapsanis, C.; Georgoulas, G.; Tzes, A. EMG based classification of basic hand movements based on time-frequency features. In Proceedings of the 21st Mediterranean Conference on Control and Automation, Platanias, Greece, 25–28 June 2013. [Google Scholar]
  21. Hudgins, B.; Parker, P.; Scott, R.N. A new strategy for multifunction myoelectric control. IEEE Trans. Biomed. Eng. 1993, 40, 82–94. [Google Scholar] [CrossRef]
  22. Kim, K.S.; Choi, H.H.; Moon, C.S.; Mun, C.W. Comparison of k-nearest neighbor, quadratic discriminant and linear discriminant analysis in classification of electromyogram signals based on the wrist-motion directions. Curr. Appl. Phys. 2011, 11, 740–745. [Google Scholar] [CrossRef]
  23. Zhang, H.; Zhao, Y.; Yao, F.; Xu, L.; Shang, P.; Li, G. An adaptation strategy of using LDA classifier for EMG pattern recognition. In Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan, 3–7 July 2013; pp. 4267–4270. [Google Scholar]
  24. Mane, S.M.; Kambli, R.A.; Kazi, F.S.; Singh, N.M. Hand Motion Recognition from Single Channel Surface EMG Using Wavelet and Artificial Neural Network. Procedia Comput. Sci. 2015, 49, 58–65. [Google Scholar] [CrossRef] [Green Version]
  25. Oskoei, M.A.; Hu, H. Support Vector Machine-Based Classification Scheme for Myoelectric Control Applied to Upper Limb. IEEE Trans. Biomed. Eng. 2008, 55, 1956–1965. [Google Scholar] [CrossRef]
  26. Zecca, M.; Micera, S.; Carrozza, M.C.; Dario, P. Control of multifunctional prosthetic hands by processing the electromyographic signal. Crit. Rev. Biomed. Eng. 2002, 30, 459–485. [Google Scholar] [CrossRef] [Green Version]
  27. Khushaba, R.N.; Kodagoda, S.; Takruri, M.; Dissanayake, G. Toward improved control of prosthetic fingers using surface electromyogram (EMG) signals. Expert Syst. Appl. 2012, 39, 10731–10738. [Google Scholar] [CrossRef]
  28. Stankovic, L.; Stankovic, S.; Dakovic, M. From the STFT to the Wigner Distribution [Lecture Notes]. IEEE Signal Process. Mag. 2014, 31, 163–174. [Google Scholar] [CrossRef]
  29. Chi, P.J.; Russell, C.T. Use of the Wigner-Ville distribution in interpreting and identifying ULF waves in triaxial magnetic records. J. Geophys. Res. Space Phys. 2008, 113. [Google Scholar] [CrossRef] [Green Version]
  30. Adam, O. The use of the Hilbert-Huang transform to analyze transient signals emitted by sperm whales. Appl. Acoust. 2006, 67, 1134–1143. [Google Scholar] [CrossRef]
  31. She, H.; Zhu, J.; Tian, Y.; Wang, Y.; Yokoi, H.; Huang, Q. sEMG Feature Extraction Based on Stockwell Transform Improves Hand Movement Recognition Accuracy. Sensors 2019, 19, 4457. [Google Scholar] [CrossRef] [Green Version]
  32. Rabiei, B.; Rahimi, M.D. Evaluation of Different Grouping Methods of Rapeseed Genotypes Using Fisher’s Linear Discrimination Function Analysis. J. Sci. Technol. Agric. Nat. Resour. 2009, 13, 529–543. [Google Scholar]
  33. Choi, J.; Park, D. A stable feedback control of the buffer state using the controlled Lagrange multiplier method. IEEE Trans. Image Process. 1994, 3, 546–558. [Google Scholar] [CrossRef]
Figure 1. Sampling sEMG signals.
Figure 1. Sampling sEMG signals.
Sensors 21 06234 g001
Figure 2. sEMG signal acquisition platform.
Figure 2. sEMG signal acquisition platform.
Sensors 21 06234 g002
Figure 3. Vibration simulator (1, external shell; 2, hook; 3, frequency adjustment knob; 41, industrial handle; 42, commonly used handle; 5, switch button; 6, emergency stop button).
Figure 3. Vibration simulator (1, external shell; 2, hook; 3, frequency adjustment knob; 41, industrial handle; 42, commonly used handle; 5, switch button; 6, emergency stop button).
Sensors 21 06234 g003
Figure 4. The sEMG signals for the open and grip modes of the prosthetic hand under various vibration frequencies.
Figure 4. The sEMG signals for the open and grip modes of the prosthetic hand under various vibration frequencies.
Sensors 21 06234 g004
Figure 5. EMG signal feature extraction process.
Figure 5. EMG signal feature extraction process.
Sensors 21 06234 g005
Figure 6. An overview of several sEMG signal processing algorithms.
Figure 6. An overview of several sEMG signal processing algorithms.
Sensors 21 06234 g006
Figure 7. Optimized selection of sliding window size.
Figure 7. Optimized selection of sliding window size.
Sensors 21 06234 g007
Figure 8. LDA classification based on the ZC and RMS feature extraction algorithm.
Figure 8. LDA classification based on the ZC and RMS feature extraction algorithm.
Sensors 21 06234 g008
Figure 9. LDA classification based on the VAR and RMS feature extraction algorithm.
Figure 9. LDA classification based on the VAR and RMS feature extraction algorithm.
Sensors 21 06234 g009
Figure 10. LDA classification based on the MIN and RMS feature extraction algorithm.
Figure 10. LDA classification based on the MIN and RMS feature extraction algorithm.
Sensors 21 06234 g010
Figure 11. The recognition accuracy of each feature combination for the LDA algorithm.
Figure 11. The recognition accuracy of each feature combination for the LDA algorithm.
Sensors 21 06234 g011
Figure 12. LDA classification based on the RMS, MAV and ZC feature extraction algorithm.
Figure 12. LDA classification based on the RMS, MAV and ZC feature extraction algorithm.
Sensors 21 06234 g012
Figure 13. The recognition accuracy of all three-feature combinations for the LDA algorithm.
Figure 13. The recognition accuracy of all three-feature combinations for the LDA algorithm.
Sensors 21 06234 g013
Figure 14. Accuracy comparison under different numbers of features for the LDA algorithm.
Figure 14. Accuracy comparison under different numbers of features for the LDA algorithm.
Sensors 21 06234 g014
Table 1. Classification accuracy (%) under several combinations of two different time-domain features.
Table 1. Classification accuracy (%) under several combinations of two different time-domain features.
No.Subject0 Hz10 Hz20 Hz30 Hz40 Hz50 Hz
1ZC, RMS91.6794.7990.6394.7996.8896.88
2VAR, RMS93.7594.7982.2994.7997.9294.79
3MIN, RMS93.7594.7980.2192.7196.8893.75
4MAV, RMS89.5889.5887.5090.6397.9690.63
5MAX, RMS89.5893.7579.1788.5495.8394.79
6MAV, VAR86.4688.5481.2590.6394.7991.67
7MAV, ZC89.5892.7188.5493.7598.9696.88
8MAV, MAX88.5493.7583.3390.6395.8391.67
9MAV, MIN91.6791.6783.3395.8398.9691.67
10VAR, ZC87.593.7577.0893.7595.8396.88
11VAR, MAX87.590.6378.1394.7995.8392.71
12VAR, MIN83.3395.8377.0884.3892.7194.79
13ZC, MAX65.6384.3668.7581.2585.4284.38
14ZC, MIN73.9663.5466.6778.1382.2981.25
15MAX, MIN77.0881.2569.7978.1391.6783.33
Table 2. Classification accuracy (%) under combinations of three different time-domain features.
Table 2. Classification accuracy (%) under combinations of three different time-domain features.
No.Subject0 Hz10 Hz20 Hz30 Hz40 Hz50 Hz
1RMS, MAV, ZC86.4690.6389.5889.5897.9295.83
2RMS, MAV, VAR90.6392.7176.0495.8396.8892.71
3RMS, MAV, MAN89.5890.6381.2591.6794.7991.67
4RMS, MAV, MIN90.6390.6382.2991.6797.7992.71
5RMS, VAR, MIN92.7195.8388.5494.7996.8894.79
6RMS, VAR, MAX91.6792.7182.2994.7996.8895.83
7RMS, VAR, ZC91.6793.7585.4295.8397.9296.88
8RMS, MIN, MAX88.5491.6787.586.4695.8392.71
9RMS, MIN, ZC91.6794.7990.6392.7196.8896.88
10RMS, MAX, ZC87.593.7585.4288.5495.8395.83
11MAV, VAR, MIN89.5888.5479.1792.7195.8391.67
12MAV, VAR, MAX90.6390.6383.3390.6395.8391.67
13MAV, VAR, ZC85.4290.6389.5891.6796.8896.88
14MAV, MIN, ZC90.6392.7187.595.8398.9696.88
15MAV, MIN, MAX87.591.6783.3388.5494.7991.67
16MAV, MAX, ZC89.5894.7986.4690.6395.8395.83
17VAR, MIN, MAX88.5487.579.1783.3393.7593.75
18VAR, MIN, ZC88.5495.8379.1783.3394.7996.88
19VAR, MAX, ZC85.4290.6373.9691.6791.6795.83
20MIN, MAX, ZC80.2177.0872.9284.3891.6787.5
Table 3. Classification accuracy (%) under all time-domain features.
Table 3. Classification accuracy (%) under all time-domain features.
No.Subject0 Hz10 Hz20 Hz30 Hz40 Hz50 Hz
1All Features96.8896.8892.1993.7598.4498.44
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wang, Y.; Tian, Y.; Zhu, J.; She, H.; Yokoi, H.; Jiang, Y.; Huang, Q. A Study on the Classification Effect of sEMG Signals in Different Vibration Environments Based on the LDA Algorithm. Sensors 2021, 21, 6234. https://doi.org/10.3390/s21186234

AMA Style

Wang Y, Tian Y, Zhu J, She H, Yokoi H, Jiang Y, Huang Q. A Study on the Classification Effect of sEMG Signals in Different Vibration Environments Based on the LDA Algorithm. Sensors. 2021; 21(18):6234. https://doi.org/10.3390/s21186234

Chicago/Turabian Style

Wang, Yanchao, Ye Tian, Jinying Zhu, Haotian She, Hiroshi Yokoi, Yinlai Jiang, and Qiang Huang. 2021. "A Study on the Classification Effect of sEMG Signals in Different Vibration Environments Based on the LDA Algorithm" Sensors 21, no. 18: 6234. https://doi.org/10.3390/s21186234

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop