Skip to main content
  • Research article
  • Open access
  • Published:

A combination of 3-D discrete wavelet transform and 3-D local binary pattern for classification of mild cognitive impairment

Abstract

Background

The detection of Alzheimer’s Disease (AD) in its formative stages, especially in Mild Cognitive Impairments (MCI), has the potential of helping the clinicians in understanding the condition. The literature review shows that the classification of MCI-converts and MCI-non-converts has not been explored profusely and the maximum classification accuracy reported is rather low. Thus, this paper proposes a Machine Learning approach for classifying patients of MCI into two groups one who converted to AD and the others who are not diagnosed with any signs of AD. The proposed algorithm is also used to distinguish MCI patients from controls (CN). This work uses the Structural Magnetic Resonance Imaging data.

Methods

This work proposes a 3-D variant of Local Binary Pattern (LBP), called LBP-20 for extracting features. The method has been compared with 3D-Discrete Wavelet Transform (3D-DWT). Subsequently, a combination of 3D-DWT and LBP-20 has been used for extracting features. The relevant features are selected using the Fisher Discriminant Ratio (FDR) and finally the classification has been carried out using the Support Vector Machine.

Results

The combination of 3D-DWT with LBP-20 results in a maximum accuracy of 88.77. Similarly, the proposed combination of methods is also applied to distinguish MCI from CN. The proposed method results in the classification accuracy of 90.31 in this data.

Conclusion

The proposed combination is able to extract relevant distribution of microstructures from each component, obtained with the use of DWT and thereby improving the classification accuracy. Moreover, the number of features used for classification is significantly less as compared to those obtained by 3D-DWT. The performance of the proposed method is measured in terms of accuracy, specificity and sensitivity and is found superior in comparison to the existing methods. Thus, the proposed method may contribute to effective diagnosis of MCI and may prove advantageous in clinical settings.

Peer Review reports

Background

Alzheimer’s Disease (AD) is one of the most common neuro-degenerative disease in elderly people [1]. According to the National Institute of Ageing, though Alzheimer’s is incurable, it is not intractable [2]. Medicines are available for treating the symptoms and the established strategies can be employed to enhance the general brain and mental conditions. However, the treatment is effective only in the case of early detection. Mild Cognitive Impairment (MCI) is a prodromal stage of dementia and can be considered as a transitional phase from the likely cognitive decline of normal aging to the graver decline of dementia [3]. This makes the diagnosis of MCI predominantly vital as appropriate steps can be taken to slow down the progression.

MCI causes a slight but noticeable and measurable decline in cognitive abilities, including memory and thinking skills [4]. As per Ward [5], the Annual Conversion Rates, from MCI to AD ranged from 7.5 to 16.5 per person-year. Researchers have identified the following changes in the autopsy studies of people suffering from MCI [6]:

  • Abnormal clusters of beta-amyloid protein (plaques)

  • Microscopic protein clumps of tau characteristic of AD (tangles)

  • Lewy bodies, which are microscopic clumps of another protein associated with forms of dementia like AD and

  • Small strokes or reduced blood flow through brain blood vessels.

MCI can be detected by either clinical tests or by brain scans. A medical professional determines the presence or absence of MCI by evaluating a person’s cognitive and behavioural changes and by using professional judgement about the possible causes and severity of the symptoms [6]. Some of the common clinical tests used for the detection of MCI are Mini Mental State Examination, Clock Test, Logical Memory, Rey Auditory Verbal Learning Test, Digit Span Category Fluency Tests, Trail Making Test A-B, Boston Naming Test, American National Adult Reading Test, Alzheimer’s Disease Assessment Scale-Cognitive Behaviour, Geriatric Depression Scale and Functional Assessment Questionnaire [7, 8]. In recent years, the veracity of the brain imaging techniques has been used for the classification of

  1. a)

    MCI and controls and

  2. b)

    MCI-C and MCI-NC.

Imaging modalities like Functional Magnetic Resonance Imaging (fMRI) [9, 10], Positron Emission Tomography (PET) [11], structural Magnetic Resonance Imaging (s-MRI) [12,13,14,15,16,17,18,19,20,21,22,23,24,25,26], etc. have been used to diagnose MCI.

Manual assessment of MCI requires more time, resources and expertise, which is highly inconvenient and costly to the patient. In the past two decades, detection of MCI has drawn the attention of Image Processing (IP) and Machine Learning (ML) community. ML based methods can be used to distinguish MCI patients from AD patients or controls. These methods require lesser manual intervention of experts and may be less costly. Moreover, these techniques provide better visualization of the huge data compared to manual methods.

It was found, from research works [12,13,14,15,16,17,18,19,20,21,22,23,24], that the classification of i) MCI-C and MCI-NC and ii) MCI and CN require immediate attention owing to two reasons: i) The above classes have not been explored copiously ii) The maximum classification accuracy reported is rather low [12,13,14,15,16,17,18,19,20,21,22,23,24]. This calls for the application of pertinent feature extraction and feature selection methods which can improve the performance.

The s-MRI can be used to access the structural changes in the brain associated with MCI. Researchers have used cortical atrophy for diagnosing MCI [27]. Moreover, the regions of the brain namely hippocampus, amygdala and ehorhinal cortex have found to be important in the diagnosis of MCI [28]. Researchers [27,28,29] have explored the Regions of Interest (ROIs) based analysis for automatic MCI diagnosis. These ROIs have been determined either by predefinition or by adaptive parcellation. These methods can be segregated into single ROI methods and multiple ROIs methods. The hippocampal volume was used to discriminate MCI and NC patients by Chupin [15]. The combination of hippocampus features and cerebrospinal fluid (CSF) volume was used for this task by Ahmed et al. [23]. Magnin et al. [26] used 90 features to represent 90 ROIs of the whole brain, where each feature describes relative weight of GM compared to WM and CSF. These approaches miss out the effect of the other regions on the disease and also subdue the fact that the regions of the brain are interconnected.

Texture classification acts like a significant protagonist in the bids of computer vision like image retrieval, video retrieval, and medical diagnosis [30]. In order to carry out texture classification, it is essential to extract good features from an image to distinguish diverse textures. Texture analysis methods like Gray Level Co-occurrence Matrices (GLCM) [31, 32], Discrete Wavelet Transform (DWT) [33], Local Binary Pattern (LBP) [34] etc. have been used in medical image analysis. GLCM measures the average degree correlation between pairs of pixels in different aspects [32]. The discrimination capabilities of GLCM depends on the choice of the separation distance between pixels, which is difficult to ascertain. The Wavelet Transform (WT) allows localization in both spatial and local transients like surfaces in 3D volumes, which help in apprehending finer minutiae of brain MRI data present in different directions. However, the number of features obtained by the DWT is huge. LBP, another popular feature extraction technique, can be used to gauge the statistical and structural information to represent the image [34]. It captures the underlying distribution of various microstructures like edges etc. [35,36,37]. Moreover, it also represents original data with lesser number of features. However, it does not retain the spatial distribution of different patterns present in the image.

In this paper, in order to generate a rich representation of anatomical structures, which will be more discriminative to separate different groups of subjects, a combination of 3D-DWT and a variant of 3D-LBP is proposed. First level decomposition of an MRI using 3D-DWT provides one approximate and seven detailed components. Each detailed component captures different orientation of micro-structures. However, the number of features obtained from the seven detailed components is large. Each of these seven detailed components is represented compactly using 3D-LBP.

The 3D-LBP with 18 neighbours results in 262,144 features. Further reduction in the number of features can be done by applying the rotation invariant and uniform variants of the LBP. We have investigated i) basic 3D-LBP, ii) rotation invariant 3D-LBP and iii) uniform 3D-LBP and out of these the one which gives the best result has been clubbed with 3D-DWT. To the best of our knowledge, no research work carried out till date has applied a combination of 3D-DWT and 3D-LBP on the s-MRI data to distinguish MCI-C from MCI-NC and MCI from CN. Further, Fisher Discriminant ratio (FDR) is applied to determine a set of relevant features and the well-known Support Vector Machine is used to develop a decision model. The performance of the proposed method is compared with existing methods on a publicly available ADNI data.

Availability of data and materials

ADNI database

The datasets supporting the conclusions of this article are available in the Alzheimer’s Disease Neuroimaging Initiative (ADNI) repository, Data used in the preparation of this article were obtained from the ADNI database (adni.loni.usc.edu). The ADNI was launched in 2003 as a public-private partnership, led by Principal Investigator Michael W. Weiner, MD. The primary goal of ADNI has been to test whether Magnetic Resonance Imaging (MRI), PET, other biological markers, and clinical and neuropsychological assessment can be combined to measure the progression of MCI and early AD.

Retrieval of data

The ADNI database was queried for controls (CN), those converted to AD (MCI-C) and those not converted to AD (MCI-NC). The protocol of data selection and image acquisition of the subjects takes into consideration age matching, appropriate number of slices, required parameters etc. and has been adopted from paper [38]. However, the data of all the CN subjects was not available and hence more CN subjects were selected from the database. This study uses 75 MCI-C, 89 CN and 112 MCI-NC processed NIFTI images of patients. The MCI-NC patients ranged between the ages 56 and 88. The controls were of the ages between 63 and 90 and MCI-C patients ranged between the ages 55 and 87. All the patents had Mini Mental State Examination score between 18 and 27 and a CDR of 0.5 or 1. The T1 weighted s-MRI images collected had the following field strength: 1.5 Tesla, TE = 3.6099 ms, TE = 3000 ms. Table 1 shows the relevant data of the patients.

Table 1 Demographic and Clinical Information of the subjects

Pre-processing

In the literature, Structural Magnetic Resonance Imaging (s-MRI) has been widely used to detect MCI. However, before extracting features from an image, pre-processing is required. For this, Statistical Parametric Mapping (SPM) is used [39].

The pre-processing of the s-MRI images includes the following: a) Slice time correction, which is required if the temporal dynamics of evoked responses are important. This was performed as it may improve the performance; b) Head motion correction, which is referred to as realignment; c) Spatial Normalization, which is the co-registration with the standard MNI template in order to overcome brain shape variability; d) Special smoothening, in which the weighted average of the neighbouring voxels is found and the intensity value of a voxel is replaced by it and e) Tissue segmentation, which is the segregation of brain tissues into three tissue classes namely gray matter, white matter and cerebro-spinal fluid. In the literature, it has been found that gray matter atrophy is responsible for Mild Cognitive Impairments [40, 41]. For this reason, gray matter is used for building a ML based model to diagnose MCI. The most common method to measure differences in local concentrations of brain tissue is Voxel Based Morphometry (VBM). In VBM a voxel-wise comparison of the local concentration of gray matter between the two groups of subject is carried out [42]. However, in VBM also, pre-processing is required which includes registration to a standard template, followed by smoothening and segmentation.

Methods

3D-discrete wavelet transform

The Fourier Transform (FT) is commonly used to determine the frequency spectrum of a signal, for better analysis of the signal. However, in the case of a non-stationary signal, FT is not of much use. For signals where time localization of spectral components is needed, one solution is to adopt Short-Time-Fourier-Transform (STFT) to get frequency components of local time intervals of fixed duration. However, in the case of signals having non-periodic fast-transitions (i.e. high frequency content for short duration), wavelet transform (WT) is suggested to be a better option in literature [43]. The WT analyses a signal at different frequencies with different resolutions, which makes it to be an excellent tool for the analysis of transient signals.

WT can be categorized on the basis of orthogonal property of wavelet into Continuous wavelet transform (CWT), which uses non-orthogonal wavelet and Discrete Wavelet Transform (DWT) which uses orthogonal wavelet. The CWT is often used to characterize singularities in functions, but disadvantages like infinite number of wavelets, redundancy, no analytical solutions for most of the functions in CWT, etc. make it difficult to use [43]. Hence, DWT is commonly used in literature.

There are two filters involved in the analysis bank of DWT, one is the wavelet (detailed) filter, and the other is the scaling (averaging) filter. Wavelet expansion of a discrete function f(x) in terms of wavelet ψ(x) and scaling function τ(x) is defined as follows [43]:

$$ f(x)=\frac{1}{\sqrt{A}}\sum \limits_a{W}_{\tau}\left(P,a\right){\tau}_{P,a}(x)+\frac{1}{\sqrt{A}}\sum \limits_{p=1}^P\sum \limits_a{W}_{\uppsi}\left(p,a\right){\psi}_{p,a}(x) $$
(1)

where \( \frac{1}{\sqrt{A}} \) is normalizing factor, P is the decomposition level, ψp, a(x) are detailed or wavelet coefficients and τP, a(x) are averaging or scaling coefficients are discrete functions in and where \( a=\left\{\ 0,1,2,\dots, \frac{A}{2^p}-1\right\} \) [44]. The scaling and detailed coefficients are computed as:

$$ {W}_{\tau}\left(P,a\right)=\frac{1}{\sqrt{A}}\sum \limits_{x=0}^{A-1}f(x){\overset{\sim }{\tau}}_{\left(P,a\right)}(x) $$
(2)
$$ {W}_{\psi}\left(p,a\right)=\frac{1}{\sqrt{A}}\sum \limits_{x=0}^{A-1}f(x){\overset{\sim }{\psi}}_{\left(p,a\right)}(x) $$
(3)

1D DWT can be extended to 3D DWT for 3D brain volumes. In 3D DWT [44], we have one 3D approximate coefficient (scaling function) τ(a, b, c) and seven 3D detailed coefficients ψi(l, m, n), where i {1, 2, …, 7}. The function τ(a, b, c) in 3-D, is the product of τ(a), τ(band τ(c). Also, each ψi(a, b, c) is the product of all seven possible combinations of 1-D τ and ψ, with at least one ψ. The above functions help us to find \( {W}_{\uppsi}^i\left(p,a,b,c\right) \). The functions have been defined as follows [44]:

$$ \tau \left(a,b,c\right)=\tau (a)\tau (b)\tau (c) $$
(4)
$$ {\psi}^1\left(a,b,c\right)=\psi (a)\tau (b)\tau (c) $$
(5)
$$ {\psi}^2\left(a,b,c\right)=\tau (a)\psi (b)\tau (c) $$
(6)
$$ {\psi}^3\left(a,b,c\right)=\psi (a)\psi (b)\tau (c) $$
(7)
$$ {\psi}^4\left(a,b,c\right)=\tau (a)\tau (b)\psi (c) $$
(8)
$$ {\psi}^5\left(a,b,c\right)=\psi (a)\tau (b)\psi (c) $$
(9)
$$ {\psi}^6\left(a,b,c\right)=\tau (a)\psi (b)\psi (c) $$
(10)
$$ {\psi}^7\left(a,b,c\right)=\psi (a)\psi (b)\psi (c) $$
(11)

Wavelet expansion of 3D image volume of size A × B × C can be expressed as:

$$ f\left(l,m,n\right)=\frac{1}{\sqrt{ABC}}\sum \limits_a\sum \limits_b\sum \limits_c{W}_{\tau}\left(P,a,b,c\right){\tau}_{P,a,b,c}\left(l,m,n\right)+\frac{1}{\sqrt{ABC}}\sum \limits_{i=1}^7\sum \limits_{p=1}^P\sum \limits_a\sum \limits_b\sum \limits_c{W}_{\uppsi}^i\left(p,a,b,c\right){\psi}_{p,a,b,c}^i\left(l,m,n\right) $$
(12)

where

$$ {W}_{\tau}\left(P,a,b,c\right)=\frac{1}{\sqrt{ABC}}\sum \limits_{a=0}^{a-1}\sum \limits_{b=0}^{b-1}\sum \limits_{c=0}^{c-1}f\left(a,b,c\right){\overset{\sim }{\tau}}_{P,a,b,c}\left(a,b,c\right) $$
(13)
$$ {W}_{\uppsi}^i\left(p,a,b,c\right)=\frac{1}{\sqrt{ABC}}\sum \limits_{a=0}^{a-1}\sum \limits_{b=0}^{b-1}\sum \limits_{c=0}^{c-1}f\left(a,b,c\right){\overset{\sim }{\psi}}_{p,a,b,c}^i\left(a,b,c\right),i=\left\{1,2,\dots, 7\right\}, $$
(14)
$$ {\tau}_{P,a,b,c}\left(l,m,n\right)={2}^{\frac{P}{2}}\tau \left({2}^Pl-a,{2}^Pm-b,{2}^Pn-c\right),\mathrm{and} $$
(15)

This study uses the ‘db2’ wavelet function.

Local binary pattern and its variants

Local Binary Pattern (LBP) is a common feature extraction technique [35]. The technique can be used to gauge the statistical and structural information [35]. The LBP values capture the underlying distribution of various microstructures like edges etc. The LBP value of each pixel is calculated by comparing the pixel value with the intensity of its neighbours using the following formula.

$$ {LBP}_{Q,R}=\sum \limits_{i=1}^Q{2}^{i-1}\times \xi \left({I}_Q-{I}_{center}\right) $$
(16)

where

$$ \xi (x)=\Big\{{\displaystyle \begin{array}{c}1, ifx\ge 0\\ {}0, ifx<0\end{array}}\operatorname{} $$
(17)

Here, Q is the total number of neighbours and R is the radius from the central pixel, Icenter. After the computation of LBP value for each pixel, a histogram of 2Q bins is obtained.

The 2-dimensional LBP can be extended to 3-dimension as follows. For each voxel, its intensity is compared with the intensity of the neighbouring voxels. The 18 neighbouring voxels present at the Axial, Coronal, Sagittal and diagonal planes have been considered.

This work considers 18 neighbours and threshold their intensity with respect to the central one, Icenter.

$$ {LBP}_{Q,R}=\sum \limits_{i=1}^{18}{2}^{i-1}\times f\left({I}_Q-{I}_{center}\right) $$
(18)

where

$$ f(x)=\left\{\begin{array}{c}1, if\ x\ge 0\\ {}0, if\ x<0\end{array}\right. $$
(19)

The above technique results in a histogram with 262,144 bins. This method henceforth would be referred to as the LBP-3D method.

It may be further noted that the number of bins in the histogram, so obtained, is humungous. This can be further reduced by applying the uniform and rotation invariant methods in 3D. The Uniform LBP is one that contains at most two ‘0 to 1’ or ‘1 to 0’ transitions [35, 36]. In case of an n-bit binary number (n-neighbourhood), there are n × (n − 1) + 3 uniform binary patterns. The corresponding histogram of a uniform LBP would therefore contain a lesser number of bins as compared to the conventional LBP, which contain 2n bins. In this work, 18 neighbourhoods have been used, so by the application of uniform LBP, the number of features is reduced to 309. This method would be henceforth referred to as LBP-309.

The uniform-rotation-invariant LBP considers a pattern and all the patterns obtained by shifting the given pattern one bit to the right till the same pattern is obtained [35]. For an n-bit number, the uniform-rotation-invariant LBP has (n + 2) bins thus reducing the number of features to a great extent. For example, in case of 18 neighbourhoods in 3-D, the pattern can be described as a 18-bit number and the number of features to represent each slice 20 in the case of the rotation-invariant version. This method would henceforth be referred to as LBP-20.

3D DWT + LBP-20

The experiments bring forth the point that the performance of LBP-20 exceeds the rest of the variants in terms of specificity, accuracy and sensitivity. Moreover, the number of features in LBP-20 is despondently low. For this reason, this work proposes a combination of 3D-DWT and LBP-20 for extracting features. This method would be henceforth referred to as 3D-DWT + LBP-20. Feature Selection.

Some features extracted in brain imaging may be redundant or noisy and even negatively affect the performance of the decision model. This makes the feature selection an indispensable step before performance classification. Fisher Discriminant Ratio (FDR) is a simple and effective method which measures the discrimination power for a given feature between data of two different classes [45]. The FDR score of the ith feature is calculated as follows:

$$ FDR\ (i)={\left({m}_1^i-{\mathrm{m}}_2^{\mathrm{i}}\right)}^2/\left({\left({\upsigma}_1^{\mathrm{i}}\right)}^2+{\left({\upsigma}_2^{\mathrm{i}}\right)}^2\right) $$
(20)

Where, \( {m}_1^i \) is the mean of samples, of the ith feature, that belong to the first class; \( {m}_2^i \) is the mean of samples, of the ith feature, that belong to the second class, \( {\sigma}_1^i \) is the standard deviation of samples, of the ith feature, that belong to the first class; \( {\sigma}_2^i \) is the standard deviation of samples, of the ith feature, that belong to the second class.

Feature with a higher value is considered to be more relevant. Hence, the calculation of the FDR values of features is followed by the arrangement of the features in descending order of FDR values.

Classification and evaluation

For a two-class problem, the Support Vector Machine crafts a hyperplane, which separates the data points of the two classes by maximum margin [46]. For the purpose of classification, linear kernel is used. To evaluate the performance of the proposed system, accuracy (ACC), sensitivity (SEN), and specificity (SPE) are used, which are calculated as follows:

$$ ACC=\frac{TP+ TN}{TP+ TN+ FP+ FN} $$
(21)
$$ SENS=\frac{TP}{TP+ FN} $$
(22)
$$ SPEC=\frac{TN}{TN+ FP} $$
(23)

where FP, FN, TP and TN and are the number of false positive samples, false negative samples, true positive samples and true negative samples and respectively.

In order to calculate the performance of the proposed decision system and to set the system parameters, nested 10-fold validation scheme is used. In this scheme, the data is divided randomly into 10 equal sized subsets. In each fold 9 subsets are used for training and validation and one subset is used for testing. This process is repeated 10 times and each subset is used exactly once for testing. This constitutes outer folds. In each outer fold, 10 inner fold are made such that the training and validation data is further divided into 10 equal subsets. In each inner fold 9 subsets are used for training data and one for validation. The experimental results of the inner folds are used for setting the system parameters.

In the experiment, for each feature the average accuracy was found over the outer 10 CV-Fold. The variation of this average accuracy with the number of features was then noted. The number of features for which the performance is best is then reported. The average and the standard deviation are then reported as the performance of the proposed system.

The procedure for the proposed framework is summarized as follows. It is also depicted in Fig. 1.

Fig. 1
figure 1

Flowchart of the training phase of 3D-DWT-LBP-20

Diagnosis of MCI

For the given data

  1. 1)

    Divide the data into train and test set.

  2. 2)

    Perform the following computation for each MRI volume of the train set:

    1. a.

      Extract 7 detailed components from each MRI using 3D-DWT.

    2. b.

      Obtain features from each of the 7 detailed components using 3D- LBP-20.

    3. c.

      Concatenate the features obtained from the 7 volumes to obtain 140 features.

  3. 3)

    Apply FDR to order the features obtained from the step 2 in terms of their relevance (decreasing values of their FDR values). The indices so obtained would be used in testing phase.

  4. 4)

    Train the model using the train set.

  5. 5)

    For the test set apply all the steps of 2. Use the indices obtained in step 3) to represent the MRI volume. Obtain accuracy, specificity and sensitivity of the proposed method.

Results

Firstly, the proposed pipeline is applied to distinguish MCI-C from MCI-NC. The features from the pre-processed data are extracted through the LBP-3D method which results in 262,144 features. The features are placed in the descending order of their FDR values and are included incrementally in order of their relevance to develop a decision model. This work uses nested cross validation. It may be noted that the maximum accuracy of 0.7644 is. The same procedure is used with LBP-309 in which the maximum accuracy of 0.8361 is obtained. In the case of LBP-20, the maximum accuracy of 0.8432 is obtained. The application of 3D-DWT results in the maximum accuracy of 0.8574. Based on these observations 3D-DWT is combined with LBP-20, which results in a maximum accuracy of 0.0.8877. Similarly, the proposed combination of methods is also applied to distinguish MCI from CN data. Results similar to those obtained in MCI-C and MCI-NC data are observed.. The summarized results are shown in Table 2.

Table 2 Comparison of performance of various methods to distinguish MCI-C from MCI-NC and MCI from CN

Discussion

From the results presented in Table 2, the following can be inferred:

  • The combination of 3D-DWT with LBP20 after a certain number of features gives better performance than individual feature extraction methods such as 3D-DWT, LBP-3D, LBP-309, LBP-20. The combination provides maximum accuracy of i) 0.8877in the case of MCI-C vs MCI-NC and ii) 0.9031 MCI vs CN.

  • LBP-3D gives poorest performance amongst the variants of LBP and 3D DWT.

  • LBP-20 gives the best performance amongst the variants of LBP and utilize only 20 features for this.

  • For each feature extraction method, the performance improves with the increase in number of features initially and becomes almost stable thereafter.

  • On applying the proposed method, the specificity of 0.9016 and the sensitivity of 0.8916 is obtained in the case of MCI-C vs MCI-NC and the specificity of 0.9022 and the sensitivity of 0.9015 is obtained in the case of MCI vs CN.

The comparison of the accuracy, specificity and sensitivity of the proposed model with the existing models is presented in Table 3. It can be observed from the table that the proposed method performs well not only in terms of classification accuracy but also in terms of specificity and sensitivity for both i) MCI-C vs MCI-NC and ii) MCI vs CN.

Table 3 Comparison of performance of the proposed method with existing works

Although each of the seven detailed components obtained with the application of 3D-DWT captures localized edges of different orientation, the number of features so obtained is quite large. Because of this, it requires large amount of memory and computation time to build a decision model. On the other hand, LBP-20 provides global distribution of patterns present in MRI volume with few features but omits finer details. The combination of 3D-DWT and LBP-20 brings advantages of the two methods. With the use of combination, the MRI volume is compactly represented in terms of distributions of different patterns from each of the seven detailed components obtained from 3D-DWT without omitting any relevant details. Hence, the combination of two methods provides better distinguishing power to differentiate two different types of MRI volumes. This is also reflected in our empirical analysis.

To understand the better performance of the proposed technique in comparison to LBP-20, we initially normalized the individual features of both the methods i.e. LBP-20 and 3D-DWT + LBP-20. Subsequently the average value of individual feature is computed class wise, separately for both the methods. The comparison of the two methods to distinguish the two classes is shown in Fig. 2. The maximum difference between the values, in case of LBP-20 is 0.302 whereas the maximum difference between the values, in case of 3D-DWT + LBP20 is 0.613. This may be attributed to the ability of capturing more relevant patterns to distinguish the data of the two classes using the proposed method in comparison the LBP-20. It may also be noted that there are two or three peaks in most of the graphs, indicating that the corresponding bins may contribute to the classification of the two classes owing to a marked difference between the values of the two classes.

Fig. 2
figure 2

The comparison of the normalized features obtained with LBP-20 and 3D-DWT+ LBP-20: Here, DWT1, DWT2 etc. are the seven detailed components obtained using the 3D-DWT

Conclusion

In this paper, 3D variants of LBP called LBP-3D, LBP-309 and LBP-20 have been proposed. LBP-20 gives a better performance among the three variants of 3D-LBP and is combined with 3D-DWT in the proposed model, 3D-DWT + LBP-20, to extract relevant features from MRI for the classification between i) MCI-C and MCI-NC and ii) MCI and CN. The experimental results on publicly available ADNI datasets show that the proposed pipeline is quite effective to distinguish between the above-mentioned classes. It is also noted that the proposed combination of 3D-DWT and LBP-20 provides a better performance in comparison to 3D-LBP and its variants and it also performs better as compared to 3D-DWT in terms of specificity, accuracy and sensitivity. Also, the proposed method provides a superior performance with lesser number of features in comparison to the existing methods. This is attributed to the representation of MRI volume in terms of relevant and compact features, which are obtained with the application of LBP-20 on each of the seven detailed components of 3D.

In the future, the proposed method will be extended for multi-class classification. Also, in the future works, multivariate methods will be used for feature selection. Moreover, the analysis will be extended for other methods capable of finding out a smaller subset of relevant features which are more discriminative of the above-mentioned classes. As per Antoine Marie Jean-Baptiste Roger “It is only with the heart that one can see rightly; what is essential is invisible to the eye.” The above investigation suggests that “heart” can be replaced by “pertinent feature extraction.”

Availability of data and materials

http://adni.loni.usc.edu/data-samples/access-data/

Abbreviations

AD:

Alzheimer’s Disease

ADNI:

Alzheimer’s DiseaseNeuroimaging Initiative

CN:

Controls

CSF:

Cerebro Spinal Fluid

CWT:

Continuous Wavelet Transform

DWT:

Discrete Wavelet Transform

FDR:

Fisher Discriminant ratio

f-MRI:

Functional-Magnetic Resonance Imaging

FT:

Fourier-Transform

GLCM:

Gray Level Co-occurrence Matrices

GM:

Gray Matter

IP:

Image processing

LBP:

Local Binary Pattern

MCI:

Mild Cognitive Impairment

MCI-C:

Mild Cognitive Impairments Converts

MCI-NC:

Mild Cognitive ImpairmentsNon-Converts

ML:

Machine Learning

PET:

Positron Emission Tomography

ROI:

Region of Interest

s-MRI:

Structural-Magnetic Resonance Imaging

SPM:

Statistical Parametric Mapping

STFT:

Short-Time-Fourier-Transform

WM:

White Matter

WT:

Wavelet Transform

References

  1. Selkoe DJ, Peter J, Lansbury J. Alzheimer’s Disease Is the Most Common Neurodegenerative Disorder. Basic Neurochem Mol Cell Med Asp. 1999;6. https://med.stanford.edu/content/dam/sm/adrc/documents/adrc-information-sheet-mild-cognitive-impairment.pdf.

  2. “Alzheimer’s Disease Fact Sheet,” National Institute on Aging. [Online]. Available: https://www.nia.nih.gov/health/alzheimers-disease-fact-sheet. [Accessed 10 Jan 2019].

  3. Henderson VW. “Mild Cognitive Impairment,”[med.stanford.edu/content/dam/sm/adrc/documents/adrc-information-sheet-mild-cognitive-impairment.pdf]. Accessed 18 Feb 2020.

  4. “Mild Cognitive Impairment (MCI),” Alzheimer’s Disease and Dementia. [Online]. Available: https://alz.org/alzheimers-dementia/what-is-dementia/related_conditions/mild-cognitive-impairment. [Accessed: 01-Jan-2019].

  5. Ward A, Tardiff S, Dye C, Arrighi HM. Rate of conversion from prodromal Alzheimer's disease to Alzheimer's dementia: a systematic review of the literature. Dement Geriatr Cogn Disord. 2013;3(1):320–32.

    Article  Google Scholar 

  6. “The Dementias: Hope Through Research | National Institute of Neurological Disorders and Stroke.” [Online]. Available: https://www.ninds.nih.gov/Disorders/Patient-Caregiver-Education/Hope-Through-Research/Dementia-Hope-Through-Research. [Accessed: 10-Jan-2019].

  7. Battista P, Salvatore C, Castiglioni I. Optimizing neuropsychological assessments for cognitive, behavioral, and functional impairment classification: a machine learning study. Behav. Neurol. 2017:1–19.

    Article  Google Scholar 

  8. Weakley A, Williams JA, Schmitter-Edgecombe M, Cook DJ. Neuropsychological test selection for cognitive impairment classification: a machine learning approach. J Clin Exp Neuropsychol. 2015;37(9):899–916.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Zalesky A, Fornito A, Bullmore ET. Network-based statistic: identifying differences in brain networks. Neuroimage. 2010;53(4):1197–207.

    Article  PubMed  Google Scholar 

  10. H.-I. Suk and D. Shen, “Deep learning-based feature representation for AD/MCI classification,” presented at the International Conference on Medical Image Computing and Computer-Assisted Intervention, 2013, pp. 583–590.

  11. Singh S, et al. Deep Learning based Classification of FDG-PET Data for Alzheimers Disease Categories. Pro SPIE Int Soc Opt Eng. 2017:10572.

  12. Pennanen C, et al. Hippocampus and entorhinal cortex in mild cognitive impairment and early AD. Neurobiol Aging. 2004;25(3):303–10.

    Article  PubMed  Google Scholar 

  13. Colliot O, et al. Discrimination between Alzheimer disease, mild cognitive impairment, and normal aging by using automated segmentation of the hippocampus. Radiology. 2008;248(1):194–201.

    Article  PubMed  Google Scholar 

  14. Gerardin E, et al. Multidimensional classification of hippocampal shape features discriminates Alzheimer’s disease and mild cognitive impairment from normal aging. Neuroimage. 2009;47(4):1476–86.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Chupin M, et al. Fully automatic hippocampus segmentation and classification in Alzheimer’s disease and mild cognitive impairment applied on data from ADNI. Hippocampus. 2009;19(6):579–87.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Chincarini A, et al. Local MRI analysis approach in the diagnosis of early and prodromal Alzheimer’s disease. Neuroimage. 2011;58(2):469–80.

    Article  PubMed  Google Scholar 

  17. Chu C, Hsu A-L, Chou K-H, Bandettini P, Lin C, Alzheimer’s Disease Neuroimaging Initiative. Does feature selection improve classification accuracy? Impact of sample size and feature selection on classification using anatomical magnetic resonance images. Neuroimage. 2012;60(1):59–70.

    Article  PubMed  Google Scholar 

  18. Dai D, He H, Vogelstein JT, Hou Z. Accurate prediction of AD patients using cortical thickness networks. Mach Vis Appl. 2013;24(7):1445–57.

    Article  Google Scholar 

  19. Wee C-Y, Yap P-T, Shen D. Prediction of Alzheimer’s Disease and Mild Cognitive Impairment Using Baseline Cortical Morphological Abnormality Patterns. Hum. Brain Mapp. 2013;34(12):3411–25.

  20. Tong T, et al. Multiple instance learning for classification of dementia in brain MRI. Med Image Anal. 2014;18(5):808–18.

    Article  PubMed  Google Scholar 

  21. Suk H-I, Lee S-W, Shen D, Alzheimer’s Disease Neuroimaging Initiative. Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis. NeuroImage. 2014;101:569–82.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Khedher L, Ramírez J, Górriz JM, Brahim A, Segovia F, Alzheimer′ s Disease Neuroimaging Initiative. Early diagnosis of Alzheimer′ s disease based on partial least squares, principal component analysis and support vector machine using segmented MRI images. Neurocomputing. 2015;151:139–50.

    Article  Google Scholar 

  23. Ahmed OB, Benois-Pineau J, Allard M, Amar CB, Catheline G, Alzheimer’s Disease Neuroimaging Initiative. Classification of Alzheimer’s disease subjects from MRI using hippocampal visual features. Multimed Tools Appl. 2015;74(4):1249–66.

    Article  Google Scholar 

  24. Liu J, Li M, Lan W, Wu F-X, Pan Y, Wang J. Classification of alzheimer’s disease using whole brain hierarchical network. IEEE/ACM Trans Comput Biol Bioinform. 2018;15(2):624–32.

    Article  PubMed  Google Scholar 

  25. Liu F, Wee C-Y, Chen H, Shen D. Inter-modality relationship constrained multi-modality multi-task feature selection for Alzheimer’s disease and mild cognitive impairment identification. NeuroImage. 2014;84:466–75.

    Article  PubMed  Google Scholar 

  26. Magnin B, et al. Support vector machine-based classification of Alzheimer’s disease from whole-brain anatomical MRI. Neuroradiology. 2009;51(2):73–83.

    Article  PubMed  Google Scholar 

  27. Jack C, et al. Atrophy rates accelerate in amnestic mild cognitive impairment. Neurology. 2008;70(19 Part 2):1740–52.

    Article  PubMed  Google Scholar 

  28. Braak H, Braak E. Evolution of neuronal changes in the course of Alzheimer’s disease. In: Ageing and dementia. Vienna: Springer; 1998. p. 127–40.

    Google Scholar 

  29. Schuff N, et al. MRI of hippocampal volume loss in early Alzheimer’s disease in relation to ApoE genotype and biomarkers. Brain. 2009;132(4):1067–77.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Insana MF, Wagner RF, Garra BS, Brown DG, Shawker TH. Analysis of ultrasound image texture via generalized Rician statistics. Opt. Eng. 1986;25(6):256743.

    Article  Google Scholar 

  31. Torabi M, Ardekani RD, Fatemizadeh E. Discrimination between alzheimer’s disease and control group in MR-images based on texture analysis using artificial neural network. In: Biomedical and Pharmaceutical Engineering, 2006. ICBPE 2006: International Conference on.  Singapore: IEEE; 2006: p. 79–83.

  32. Zhang J, Yu C, Jiang G, Liu W, Tong L. 3D texture analysis on MRI images of Alzheimer’s disease. Brain Imaging Behav. 2012;6(1):61–9.

    Article  PubMed  Google Scholar 

  33. Mallat SG. A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell. 1989;11(7):674–93.

    Article  Google Scholar 

  34. Ojala T, Pietikäinen M, Harwood D. A comparative study of texture measures with classification based on featured distributions. Pattern Recogn. 1996;29(1):51–9.

    Article  Google Scholar 

  35. Ojala T, Pietikainen M, Maenpaa T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell. 2002;24(7):971–87.

    Article  Google Scholar 

  36. Ojala T, Pietikäinen M, Mäenpää T. A generalized local binary pattern operator for multiresolution gray scale and rotation invariant texture classification. In: presented at the International Conference on Advances in Pattern Recognition; 2001. p. 399–408.

    Google Scholar 

  37. Pietikäinen M, Hadid A, Zhao G, Ahonen T. Local binary patterns for still images. In: Computer vision using local binary patterns. London: Springer; 2011. p. 13–47.

    Google Scholar 

  38. Salvatore C, et al. Magnetic resonance imaging biomarkers for the early diagnosis of Alzheimer's disease: a machine learning approach. Front Neurosci. 2015;9. https://www.frontiersin.org/articles/10.3389/fnins.2015.00307/full.

  39. Friston KJ, Holmes AP, Worsley KJ, Poline J, Frith CD, Frackowiak RS. Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp. 1994;2(4):189–210.

    Article  Google Scholar 

  40. Zhang H, et al. Gray matter atrophy patterns of mild cognitive impairment subtypes. J Neurol Sci. 2012;315(1–2):26–3.

    Article  PubMed  Google Scholar 

  41. Apostolova LG, et al. Three-dimensional gray matter atrophy mapping in mild cognitive impairment and mild Alzheimer disease. Arch Neurol. 2007;64(10):1489–95.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Ashburner J, Friston KJ. Voxel-based Morphometry—the methods. NeuroImage. 2000;11(6):805–21.

    Article  CAS  PubMed  Google Scholar 

  43. Mallat S. A wavelet tour of signal processing. United States: Acadamic Press; 1999.

  44. Prochazka A, Grafova L, Vyˇsata O, Caregroup N. Three-dimensional wavelet transform in multi-dimensional biomedical volume processing. In: The Proc. of the IASTED International Conference on Graphics and Virtual Reality. Canada: ACTA Press; 2011. p. 263–8.

  45. Duda RO, Hart PE. Pattern recognition and scene analysis; 1973.

    Google Scholar 

  46. Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20(3):273–97.

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank Dr. Sandesha Rayapa for her diligent proofreading of this paper.

Data used for this study were downloaded from the ADNI Repository (http://loni.adni.com). Data collection and sharing for this project was funded by the Alzheimer’s Disease Neuroimaging Initiative (ADNI) (National Institutes of Health Grant U01 AG024904) and DOD ADNI (Department of Defense award number W81XWH-12-2-0012). ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through generous contributions from the following: AbbVie, Alzheimer’s Association; Alzheimer’s Drug Discovery Foundation; Araclon Biotech; BioClinica, Inc.; Biogen; Bristol-Myers Squibb Company; CereSpir, Inc.; Cogstate; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; EuroImmun; F. Hoffmann-La Roche Ltd. and its affiliated company Genentech, Inc.; Fujirebio; GE Healthcare; IXICO Ltd.; Janssen Alzheimer Immunotherapy Research & Development, LLC.; Johnson & Johnson Pharmaceutical Research & Development LLC.; Lumosity; Lundbeck; Merck & Co., Inc.; Meso Scale Diagnostics, LLC.; NeuroRx Research; Neurotrack Technologies; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Takeda Pharmaceutical Company; and Transition Therapeutics. The Canadian Institutes of Health Research is providing funds to support ADNI clinical sites in Canada. Private sector contributions are facilitated by the Foundation for the National Institutes of Health (www.fnih.org). The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimer’s Therapeutic Research Institute at the University of Southern California. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of Southern California.

Funding

The first author has got Visvesvaraya Fellowship from the Ministry of Electronics and Information Technology, Government of India. No funds received for the publication of this article and hence waiver was applied.

Author information

Authors and Affiliations

Authors

Consortia

Contributions

HB and RKA contributed to investigation and methodology of the study. HB and RKA contributed to validation and visualization. HB wrote the manuscript. All authors revised the manuscript and approved the final manuscript.

Corresponding author

Correspondence to Harsh Bhasin.

Ethics declarations

Ethics approval and consent to participate

Not Applicable.

Consent for publication

Not Applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bhasin, H., Agrawal, R.K. & For Alzheimer’s Disease Neuroimaging Initiative. A combination of 3-D discrete wavelet transform and 3-D local binary pattern for classification of mild cognitive impairment. BMC Med Inform Decis Mak 20, 37 (2020). https://doi.org/10.1186/s12911-020-1055-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12911-020-1055-x

Keywords