Image recognition of four rice leaf diseases based on deep learning and support vector machine

https://doi.org/10.1016/j.compag.2020.105824Get rights and content

Highlights

  • This study uses deep learning and SVM approach to identify four rice diseases.

  • The CNNs includes 7 layers and the optimal parameters of SVM are obtained by experiment.

  • The shape and color feature of lesion images are extracted by manual methods and CNNs.

  • The higher recognition performance of CNN plus SVM with optimal parameters is achieved.

Abstract

In the field of agricultural information, identification and prediction of rice leaf diseases has always been a research focus. Deep learning and support vector machine (SVM) technology are hot research topics in the field of pattern recognition at present. Their combination can not only solve the problem effectively, but also improve the recognition accuracy. In this study, firstly, we use convolution neural networks (CNNs) to extract the rice leaf disease images features. Then the SVM method is applied to classify and predict the specific disease. The optimal parameters of SVM model are obtained through the 10-fold cross validation method. The experimental results show that when the penalty parameter C=1 and the kernel parameter g = 50, the average correct recognition rate of the rice disease recognition model based on deep learning and SVM is 96.8%. This accuracy is higher than that of the traditional back propagation neural networks models. This study provides a new method for the further research of crop diseases diagnosis by using deep learning.

Introduction

Rice, wheat and maize are the three major food crops in the world (Li, 2004). Among them, rice has the most sown area, the largest total yield and the highest yield per unit in China which has become one of the main grains of Chinese people. China’s cultivated area accounts for about a quarter of the country’s arable land, and the annual output accounts for half of the country’s total grain output. For more details, we refer readers to the paper (Kavya et al., 2016, Pragati and Surekha, 2017, Yi and Deng, 2017, Shen et al., 2019, Ma and Wang, 2004, Lu et al., 2017). It has been estimated that there will be more than nine billion people in the world by 2050 (Godfray et al., 2010). Nevertheless, rice diseases have been seriously affecting rice production. Consequently, it is a big challenge for the agricultural community to ensure the food security of such a large population. During the growth of rice, many diseases are often accompanied, such as rice blast, sheath blight, jute leaf spot, rice curl disease, bakanae disease, bacterial leaf blight, and bacterial leaf streak disease. These diseases occur in every part of rice, such as leaf, neck, and ear. Among them, rice blast, red blight, stripe blight and sheath blight are the four diseases with the largest occurrence probability and the widest influence.

Diseases will not only lead to production reduction, but also bring environmental pollution. When rice is attacked by diseases, they will seriously affect the yield of crops. Among them, a loss of 10–15% in rice production are caused by rice plant diseases (Peng et al., 2009). In serious cases, it can reach 40–50% or even no income, which will bring huge economic losses to the farmers who have worked hard for a year. However, farmers generally do not know enough about the diseases of rice or even crops, so they can not fully understand the occurrence of each disease and the specific characteristics of the disease spots, and thus can not judge the disease and apply medicine in time. As a result, too much, too little or even wrong medicine will be used, which will delay the treatment of disease and damage the soil and the environment. Therefore, it is very important to find the disease and identify the disease type as soon as possible.

In general, detection of rice plant diseases is based either on the visual assessment of the symptoms or the experimental result by culturing pathogens in the laboratory. The visual assessment is a subjective approach and prone to error. Whereas, culturing the pathogens in the laboratory is a time-consuming process and may not provide the result in time(Barbedo, 2013). Besides these limitations, both the conventional approaches require experts to identify the diseases and it is difficult for farmers to get access to experts due to the interior region of their agriculture field. These issues have prompted the research community to investigate various algorithms and develop automatic methods to detect and classify rice plant diseases, and simultaneously motivates the farmers to decide and choose the right pesticides.

With the development of computer and internet technology, recognition methods based on image processing and pattern recognition technology constantly emerge (Lai et al., 2009, Rahul et al., 2016, Kavya et al., 2016, Li et al., 2013, Pragati and Surekha, 2017). The main research fields include rice disease image acquisition methods, disease image preprocessing methods, feature extraction and optimization of disease spot image, and establishment of rice disease automatic recognition modeled by Bayesian classifier, back propagation neural network, support vector machine (SVM) and other methods (Tharwat et al., 2018, Dey et al., 2017, Guan, 2018, Qiu et al., 2019).

In recent years, digital image processing technology is becoming more and more mature and has been widely used in many fields which promotes the new development of these disciplines. The applications in the field of agriculture mainly includes the identification and diagnosis of crop diseases, pests and weeds (Burks et al., 2000, Geea et al., 2008, Sgaard, 2005), the identification and diagnosis of crop deficiency disease (Mao et al., 2005), the classification and inspection of crop seed quality (Zayas and Flinn, 1998, Steenhoek et al., 2001), the quality detection and classification of agricultural products (Fang et al., 2004), and some results have been achieved. Image processing technology is widely used in agriculture, especially in crop disease recognition which mainly includes the identification of leaf diseases of corn, rice, eggplant and other crops, fruit diseases of cucumber, tomato and other fruits, and common diseases of cashmere cotton, sunflower, tea, tobacco and other economic crops.

At present, many experts and scholars have used the technology of deep learning and SVM to identify and study the rice and general plant diseases. Ze-xin Guan (Guan et al., 2010) has used the image processing technology and the pattern recognition technology to respectively segment the rice disease images and extract the classify features, and a rice disease recognition system has been established. Through the analysis of the experimental results, it is concluded that this system has a better recognition performance. You-wen Tian et al. (Tian and Li, 2006) have studied the recognition of cucumber and corn diseases by using SVM, and have achieved good recognition results. Taking the wheat total erosion disease as the research object, Fu Wei (Fu, 2015) has used the unmanned aerial vehicle to take the wheat disease images and carried on the pretreatment and the characteristic parameter extraction of the collected disease images. Then, the disease degree of wheat total erosion disease has been obtained by comparing the color characteristic parameters. R. Pydipati et al. (Pydipati et al., 2006) have employed color co-occurrence method to determine texture-based hues. Saturation and intensity (HSI) color features combined with statistical classification algorithm have been used to identify diseases and normal citrus leaves under laboratory conditions. Yun-lan Tan et al. (Tan et al., 2019) have used the deep convolution network to establish the rice disease identification model to classify and identify eight kinds of rice diseases, of which the accuracy of sheath blight is 93%. Bo et al. have taken the image of vegetable and fruit diseases as the research object, then the image processing technology, the deep learning method and the convolution neural network (CNN) have been respectively used to preprocess the image, improve the recognition rate of the vegetable and fruit image and build the recognition model so as to accomplish the image recognition task (Bo et al., 2018). Shen Wei Zheng et al. (Shen et al., 2019) have studied the automatic identification method of rice blast, sheath blight and bacterial leaf blight based on BP neural network. The parameters have been optimized by using the single factor analysis of variance and the effect of BP neural network model. The results have shown that the model has a good recognition performance.

Although the main methods used in the above studies include some traditional analysis methods, most of them still use a combination of multiple methods or propose a new research method. In pattern recognition, linear classifier based on statistics (Yusako et al., 2001a), Bayesian decision theory, artificial neural network (Pydipati et al., 2005, El-Faki et al., 2000, Ma and Wang, 2004), fuzzy recognition technology (Mohamed et al., 2006, Vioix et al., 2004, Qiu et al., 2002) and SVM (Tian et al., 2006) are widely used. At present, rice disease recognition based on digital image has become a research hotspot (Barbedo, 2013). Recently, CNN has also been applied to rice plant disease classification (Lu et al., 2017). Yong-gang Shi et al. (Shi et al., 2018) have proposed a segmentation method based on CNN and SVM to get the segmentation of hippo image. They use SVM to replace the output layer of CNN. The model can automatically extract image block features by training deep-seated network, then use the extracted image features to train SVM to improve image classification. The experimental results show that the segmentation accuracy of each region is greatly improved. In this study, in order to extract the effective feature parameters of rice disease images and establish the foundation of disease recognition system, we use mean shift method to separate the normal and abnormal parts of leaves so as to simplify the difficulty of image processing and further improve the processing speed. The motivation of using the mean-shift method as image segmentation method is that the area of the extracted spots is larger than that of the artificial threshold extraction. However, the existing image segmentation technology based on mean shift algorithm is not perfect, and the segmentation results are not stable. Therefore, a disease recognition model combining CNN and SVM is proposed to improve the recognition accuracy.

There are two main motivations to study the image recognition models of four rice diseases. (1) So far, this is still a challenge, and is becoming the main focus of rice disease recognition research. In order to obtain satisfactory disease recognition rate, this paper applies CNN and SVM to rice disease recognition. (2) According to the difference of rice disease spots, the mean shift algorithm and CNN are used to extract the optimal feature parameters.

There are two main contributions of this paper. (1) Aiming at the identification of four rice diseases, a new algorithm which combines CNN with SVM proposed in this paper. It is worth noting that the model can correctly and effectively identify rice diseases. (2) The experimental results show that the best combination of features and the best parameters of the model can not only improve the convergence speed, but also have higher recognition accuracy than the classical models such as feature extraction and disease recognition directly using CNN.

Section snippets

Dataset

Rice leaf disease images used in this paper were taken in rural farmland by the Canon 660D digital camera in 2019, and some images were obtained by rice leaf disease atlas. In total, the rice leaf dataset contains 8911 images including 2274 images of healthy rice, 1634 images of rice blast, 1765 images of rice bacterial spot, 1678 images of rice streak leaf spot and 1560 images of rice sheath blight. Then, 6637 images of disease rice were clipped by manual clipping, which includes one or more

Results and analysis

A total of 6637 disease images and 2274 healthy images were obtained by image feature extraction and segmentation. Effective disease spot images were divided into training set and testing set. Among them, 4757 lesion images are trained including 2017 images of healthy rice, 693 lesion images of rice blast leaf, 780 lesion images of red blight leaf, 705 lesion images of stripe blight leaf and 562 lesion images of sheath blight leaf. 1880 lesion images are tested including 257 images of rice

Support vector machine

In this paper, SVM replaces softmax as the model output for the final classification task for four reasons: (1) In order to solve the problem of using softmax as CNN classifier in image classification task, the generalization ability of the model is insufficient, which can not adapt to rice image classification. In this paper, we make full use of the advantage of CNN to extract features automatically, and use SVM to replace softmax classification function to enhance the robustness and

Conclusions

CNN is a valuable pattern recognition method both in theory and application. In this paper, the mean shift image segmentation method has been used to segment rice blast, red blight, stripe blight and sheath blight leaf lesion images. Based on the artificial calculation method and CNNs, the leaf lesions of four rice diseases have been extracted to determine the best combination of features. Then, SVM has been used to classify and recognize four kinds of rice leaf lesions under different

CRediT authorship contribution statement

Feng Jiang: Writing - original draft, Investigation, Software. Yang Lu: Conceptualization, Supervision, Funding acquisition. Yu Chen: Methodology, Writing - review & editing, Project administration. Di Cai: Formal analysis, Visualization. Gongfa Li: Validation.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

References (46)

  • Jayme Garcia Arnal Barbedo
    (2013)
  • Q. Bo et al.

    Vegetable and fruit species identification method based on convolutional neural network technology

    Comput. Age

    (2018)
  • C.J.C. Burges

    A tutorial on support vector machines for pattern recognition

    Data Min. Knowl. Disc.

    (1998)
  • T.F. Burks et al.

    Back propagation neural network design and evaluation for classifying weed species using color image texture

    Trans. ASAE

    (2000)
  • Dey, N., Ashour, A.S., Hassanien, A.E., 2017. Feature detectors and descriptors generations with numerous images and...
  • M.S. El-Faki et al.

    Weed detection using color machine vision

    Trans. Am. Soc. Agric. Eng.

    (2000)
  • J. Fang et al.

    Recognition of tomato physiological diseases by artificial neural network trained by genetic algorithms

    J. Agric. Eng.

    (2004)
  • W. Fu

    Remote sensing monitoring of wheat total erosion by UAV

    Henan Agricultural University

    (2015)
  • Ch. Geea et al.

    Cropweed discrimination in perspective agronomic images

    Comput. Electron. Agric.

    (2008)
  • H.C.J. Godfray et al.

    Food security: the challenge of feeding 9 billion people

    Science

    (2010)
  • Y. Guan

    Research on fast recognition method of rice leaf diseases based on image processing

    Northeast Agric. Univ.

    (2018)
  • Z. Guan et al.

    Research on Image-based rice disease identification method

    China Rice Sci.

    (2010)
  • R.M. Kavya et al.

    Image processing techniques based plant disease detection

    Int. J. Adv. Found. Res.. Comput.

    (2016)
  • J.C. Lai et al.

    Advances in machine vision diagnosis of crop diseases

    Sci. Agric. Sin.

    (2009)
  • L. Li

    Study on the evolution of farming system in China in the past 50 years and its development trend in the next 20 years

    China Agric. Univ.

    (2004)
  • G. Li et al.

    Development of a single-leaf disease severity automatic grading system based on image processing

  • X. Liu et al.

    Automatic segmentation of color images based on mean shift and GrowCut

    Inform. Technol.

    (2018)
  • Y. Lu et al.

    Identification of rice diseases using deep convolutional neural networks

    Neurocomputing

    (2017)
  • J. Ma et al.

    A method of plant disease and insect recognition based on mathematical morphology

    Shenzhen Univ. J.

    (2004)
  • H. Mao et al.

    Recognition of tomato deficiency based on computer vision neural network

    J. Agric. Eng.

    (2005)
  • Mohamed, S.A.R., Aik, Y.Y., Hong, W.T., 2006. Automated identification and counting of pests in the paddy fields using...
  • R.B. Palm

    Prediction as a Candidate for Learning Deep Hierarchical Models of Data

    (2012)
  • S. Peng et al.

    Current status and challenges of rice production in China

    Plant Prod. Sci.

    (2009)
  • Cited by (207)

    View all citing articles on Scopus

    This work was supported in part by the National Natural Science Foundation of China under Grants 61873058 and 61933007, the Key Projects of Heilongjiang Natural Science Foundation under Grant ZD2019F001, Heilongjiang Natural Science Foundation under Grant LH2020F042, China Postdoctoral Science Foundation under Grant 2016M591560, the Scientific Research Starting Foundation for Post Doctor from Heilongjiang under Grant LBH-Q17134, Heilongjiang Bayi Agricultural University Innovative Research Team Foundation under Grant TDJH201807, and the Open Fund of the Key Laboratory for Metallurgical Equipment and Control of Ministry of Education in Wuhan University of Science and Technology under Grant 2018A02 and MECOF2019B02.

    View full text