Abstract
Rapid, accurate and non-destructive assessment of nutrition status is beneficial not only to the optimization of fertilization strategy in crop production, but also to the improvement of crop productivity. Unmanned aerial vehicle (UAV) remote sensing, as a new monitoring technology, has been widely used in nitrogen nutrition assessment because of its low cost, easy operation and flexibility in data acquisition with high temporal and spatial resolutions. However, most studies have only used mosaicked orthophotos obtained by UAV conventional survey to estimate crop parameters. Few studies have considered whether the multi-view information in UAV-based high-overlapping images is conducive to improving the estimation of crop nitrogen nutrition. To this end, this study evaluated the use of multi-view information from individual high-overlapping images and compared it with those of single-view information from a nadir-view image and a mosaicked orthophoto. A UAV-based color infrared camera (CIR) was employed to collect UAV images at critical growth stages of winter wheat. Three types of machine learning algorithms (support vector regression, SVR; extreme learning machine, ELM; random forest, RF) were used to compare and analyze the performance of these three methods for the estimation of leaf nitrogen concentration (LNC), plant nitrogen concentration (PNC), leaf nitrogen accumulation (LNA) and plant nitrogen accumulation (PNA). The results showed that the performance of the nadir-view image was the worst for the estimation of nitrogen nutrition parameters, while the mosaicked orthophoto yielded moderate estimation accuracy. High-overlapping multi-view images yielded the highest estimation accuracy of LNC and PNC (LNC: R2 = 0.61, RMSE = 0.37%; PNC: R2 = 0.52, RMSE = 0.24%). Similarly, the best predictive accuracy was obtained using UAV-based multi-view information with SVR for LNA (R2 = 0.72, RMSE = 1.45 g/m2) and PNA (R2 = 0.62, RMSE = 3.02 g/m2). This improvement was obtained with SVR but not with ELM and RF, suggesting that SVR performed the best for a small sample size. This study demonstrated that the multi-view information extracted from UAV-based high-overlapping images has great potential in improving the ability of crop growth monitoring.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Breiman, L. (2001). Random forest. Machine Learning, 45, 5–32. https://doi.org/10.1023/A:1010933404324
Bremner, J. M. M. (1982). C.S Nitrogen-total. In Methods of Soil Analysis. Part 2 Chemical and Microbiological Properties. Madison, WI, USA: American Society of Agronomy, 595–624
Clevers, J. G. P. W., & Gitelson, A. A. (2013). Remote estimation of crop and grass chlorophyll and nitrogen content using red-edge bands on Sentinel-2 and – 3. International Journal of Applied Earth Observation & Geoinformation, 23, 344–351. https://doi.org/10.1016/j.jag.2012.10.008
Danner, M., Berger, K., Wocher, M., Mauser, W., & Hank, T. (2017). Retrieval of biophysical crop variables from multi-angular canopy spectroscopy. Remote Sensing, 9, 726. https://doi.org/10.3390/rs9070726
Erdle, K., Mistele, B., & Schmidhalter, U. (2011). Comparison of active and passive spectral sensors in discriminating biomass parameters and nitrogen status in wheat cultivars. Field Crops Research, 124, 74–84. https://doi.org/10.1016/j.fcr.2011.06.007
Gitelson, A. A., Kaufman, Y. J., & Merzlyak, M. N. (1996). Use of a green channel in remote sensing of global vegetation from EOS-MODIS. Remote Sensing of Environment, 58, 289–298. https://doi.org/10.1016/S0034-4257(96)00072-7
Han, L., Yang, G., Dai, H., Xu, B., Yang, H., Feng, H., et al. (2019). Modeling maize above-ground biomass based on machine learning approaches using UAV remote-sensing data. Plant Methods, 15, 10. https://doi.org/10.1186/s13007-019-0394-z
He, L., Song, X., Feng, W., Guo, B. B., Zhang, Y. S., Wang, Y. H., et al. (2016). Improved remote sensing of leaf nitrogen concentration in winter wheat using multi-angular hyperspectral data. Remote Sensing of Environment, 174, 122–133. https://doi.org/10.1016/j.rse.2015.12.007
Huang, G. B., Zhu, Q. Y., & Siew, C. K. (2006). Extreme learning machine: theory and applications. Neurocomputing, 70, 489–501. https://doi.org/10.1016/j.neucom.2005.12.126
Hunt, J. E. R., Hively, W. D., Fujikawa, S. J., Linden, D. S., Daughtry, C. S. T., & McCarty, G. W. (2010). Acquisition of nir-green-blue digital photographs from unmanned aircraft for crop monitoring. Remote Sensing, 2, 290–305. https://doi.org/10.3390/rs2010290
Inoue, Y., Sakaiya, E., Zhu, Y., & Takahashi, W. (2012). Diagnostic mapping of canopy nitrogen content in rice based on hyperspectral measurements. Remote Sensing of Environment, 126, 210–221. https://doi.org/10.1016/j.rse.2012.08.026
Jay, S., Maupas, F., Bendoula, R., & Gorretta, N. (2017). Retrieving LAI, chlorophyll and nitrogen contents in sugar beet crops from multi-angular optical remote sensing: Comparison of vegetation indices and PROSAIL inversion for field phenotyping. Field Crops Research, 210, 33–46. https://doi.org/10.1016/j.fcr.2017.05.005
Jhan, J. P., Rau, J. Y., & Huang, C. Y. (2016). Band-to-band registration and ortho-rectification of multilens/multispectral imagery: A case study of MiniMCA-12 acquired by a fixed-wing UAS. ISPRS Journal of Photogrammetry and Remote Sensing, 114, 66–77. https://doi.org/10.1016/j.isprsjprs.2016.01.008
Kelcey, J., & Lucieer, A. (2012). Sensor correction of a 6-band multispectral imaging sensor for UAV remote sensing. Remote Sensing, 4, 1462–1493. https://doi.org/10.3390/rs4051462
Koukal, T., Atzberger, C., & Schneider, W. (2014). Evaluation of semi-empirical BRDF models inverted against multi-angle data from a digital airborne frame camera for enhancing forest type classification. Remote Sensing of Environment, 151, 27–43. https://doi.org/10.1016/j.rse.2013.12.014
Lebourgeois, V., Bégué, A., Labbé, S., Houlès, M., & Martiné, J. F. (2012). A light-weight multi-spectral aerial imaging system for nitrogen crop monitoring. Precision Agriculture, 13, 525–541. https://doi.org/10.1007/s11119-012-9262-9
Li, D., Miao, Y., Ransom, C. J., Bean, G. M., Kitchen, N. R., Fernández, F. G., et al. (2022). Corn nitrogen nutrition index prediction improved by integrating genetic, environmental, and management factors with active canopy sensing using machine learning. Remote Sensing, 14, 394. https://doi.org/10.3390/rs14020394
Li, D., Wang, X., Zheng, H., Zhou, K., Yao, X., Tian, Y., et al. (2018). Estimation of area- and mass-based leaf nitrogen contents of wheat and rice crops from water-removed spectra using continuous wavelet analysis. Plant Methods, 14, 76. https://doi.org/10.1186/s13007-018-0344-1
Li, W., Niu, Z., Chen, H., Li, D., Wu, M., & Zhao, W. (2016). Remote estimation of canopy height and aboveground biomass of maize using high-resolution stereo images from a low-cost unmanned aerial vehicle system. Ecological Indicators, 67, 637–648. https://doi.org/10.1016/j.ecolind.2016.03.036
Liu, T., & Abd-Elrahman, A. (2018). Multi-view object-based classification of wetland land covers using unmanned aircraft system images. Remote Sensing of Environment, 216, 122–138. https://doi.org/10.1016/j.rse.2018.06.043
Liu, T., Abd-Elrahman, A., Dewitt, B., Smith, S., Morton, J., & Wilhelm, V. L. (2019). Evaluating the potential of multi-view data extraction from small Unmanned Aerial Systems (UASs) for object-based classification for Wetland land covers. GIScience & Remote Sensing, 56, 130–159. https://doi.org/10.1080/15481603.2018.1495395
Lu, N., Wang, W., Zhang, Q., Li, D., Yao, X., Tian, Y., et al. (2019a). Estimation of nitrogen nutrition status in winter wheat from unmanned aerial vehicle based multi-angular multispectral imagery. Frontiers in Plant Science, 10, https://doi.org/10.3389/fpls.2019.01601
Lu, N., Zhou, J., Han, Z., Li, D., Cao, Q., Yao, X., et al. (2019b). Improved estimation of aboveground biomass in wheat from RGB imagery and point cloud data acquired with a low-cost unmanned aerial vehicle system. Plant Methods, 15, 17. https://doi.org/10.1186/s13007-019-0402-3
Maimaitijiang, M., Ghulam, A., Sidike, P., Hartling, S., Maimaitiyiming, M., Peterson, K., et al. (2017). Unmanned Aerial System (UAS)-based phenotyping of soybean using multi-sensor data fusion and extreme learning machine. ISPRS Journal of Photogrammetry and Remote Sensing, 134, 43–58. https://doi.org/10.1016/j.isprsjprs.2017.10.011
Meng, Q., Wang, C., Gu, X., Sun, Y., Zhang, Y., Vatseva, R., et al. (2016). Hot dark spot index method based on multi-angular remote sensing for leaf area index retrieval. Environmental Earth Sciences, 75, 1–11. https://doi.org/10.1007/s12665-016-5549-x
Miao, Y., Stewart, B. A., & Zhang, F. (2010). Long-term experiments for sustainable nutrient management in China. A review. Agronomy for Sustainable Development, 31, 397–414. https://doi.org/10.1051/agro/2010034
Mountrakis, G., Im, J., & Ogole, C. (2011). Support vector machines in remote sensing: A review. ISPRS Journal of Photogrammetry and Remote Sensing, 66, 247–259. https://doi.org/10.1016/j.isprsjprs.2010.11.001
Osco, L. P., Marques Ramos, A. P., Saito Moriya, É. A., de Souza, M., Junior, M., Matsubara, J., E.T., et al. (2019). Improvement of leaf nitrogen content inference in Valencia-orange trees applying spectral analysis algorithms in UAV mounted-sensor images. International Journal of Applied Earth Observation and Geoinformation, 83, 101907. https://doi.org/10.1016/j.jag.2019.101907
Prado Osco, L., Marques Ramos, A. P., Roberto Pereira, D., Akemi Saito Moriya, É., Nobuhiro Imai, N., Matsubara, T., E., et al. (2019). Predicting canopy nitrogen content in citrus-trees using random forest algorithm associated to spectral vegetation indices from UAV-imagery. Remote Sensing, 11, 2925. https://doi.org/10.3390/rs11242925
Rasmussen, J., Ntakos, G., Nielsen, J., Svensgaard, J., Poulsen, R. N., & Christensen, S. (2016). Are vegetation indices derived from consumer-grade cameras mounted on UAVs sufficiently reliable for assessing experimental plots? European Journal of Agronomy, 74, 75–92. https://doi.org/10.1016/j.eja.2015.11.026
Roosjen, P. P. J., Brede, B., Suomalainen, J. M., Bartholomeus, H. M., Kooistra, L., & Clevers, J. G. P. W. (2018). Improved estimation of leaf area index and leaf chlorophyll content of a potato crop using multi-angle spectral data – potential of unmanned aerial vehicle imagery. International Journal of Applied Earth Observation & Geoinformation, 66, 14–26. https://doi.org/10.1016/j.jag.2017.10.012
Shah, S. H., Angel, Y., Houborg, R., Ali, S., & McCabe, M. F. (2019). A random forest machine learning approach for the retrieval of leaf chlorophyll content in wheat. Remote Sensing, 11, 920. https://doi.org/10.3390/rs11080920
Smith, G., & Milton, E. (1999). The use of the empirical line method to calibrate remotely sensed data to reflectance. International Journal of Remote Sensing, 20, 2653–2662. https://doi.org/10.1080/014311699211994
Song, X., Feng, W., He, L., Xu, D., Zhang, H. Y., Li, X., et al. (2016a). Examining view angle effects on leaf N estimation in wheat using field reflectance spectroscopy. ISPRS Journal of Photogrammetry and Remote Sensing, 122, 57–67. https://doi.org/10.1016/j.isprsjprs.2016.10.002
Song, X., Xu, D., He, L., Feng, W., Wang, Y., Wang, Z., et al. (2016b). Using multi-angle hyperspectral data to monitor canopy leaf nitrogen content of wheat. Precision Agriculture, 1–16. https://doi.org/10.1007/s11119-016-9445-x
Thenkabail, P. S., Smith, R. B., & Pauw, E. D. (2000). Hyperspectral vegetation indices and their relationships with agricultural crop characteristics. Remote Sensing of Environment, 71, 158–182. https://doi.org/10.1016/S0034-4257(99)00067-X
Wang, C., & Myint, S. W. (2015). A simplified empirical line method of radiometric calibration for small unmanned aircraft systems-based remote sensing. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing, 8, 1876–1885. https://doi.org/10.1109/JSTARS.2015.2422716
Wang, L., Zhou, X., Zhu, X., Dong, Z., & Guo, W. (2016). Estimation of biomass in wheat using random forest regression algorithm and remote sensing data. The Crop Journal, 4, 212–219. https://doi.org/10.1016/j.cj.2016.01.008
Wu, B., Huang, W., Ye, H., Luo, P., Ren, Y., & Kong, W. (2021). Using multi-angular hyperspectral data to estimate the vertical distribution of leaf chlorophyll content in wheat. Remote Sensing, 13, 1501. https://doi.org/10.3390/rs13081501
Yang, B., Wang, M., Sha, Z., Wang, B., Chen, J., Yao, X., et al. (2019). Evaluation of aboveground nitrogen content of winter wheat using digital imagery of unmanned aerial vehicles. Sensors, 19, 4416. https://doi.org/10.3390/s19204416
Yang, G., Liu, J., Zhao, C., Li, Z., Huang, Y., Yu, H., et al. (2017). Unmanned aerial vehicle remote sensing for field-based crop phenotyping: current status and perspectives. Front Plant Sci, 8, 1111. https://doi.org/10.3389/fpls.2017.01111
Yao, X., Huang, Y., Shang, G., Zhou, C., Cheng, T., Tian, Y., et al. (2015). Evaluation of six algorithms to monitor wheat leaf nitrogen concentration. Remote Sensing, 7, 14939–14966. https://doi.org/10.3390/rs71114939
Zhang, J., Xie, T., Yang, C., Song, H., Jiang, Z., Zhou, G., et al. (2020). Segmenting purple rapeseed leaves in the field from UAV RGB imagery using deep learning as an auxiliary means for nitrogen stress detection. Remote Sensing, 12, 1403. https://doi.org/10.3390/rs12091403
Zheng, H., Cheng, T., Li, D., Zhou, X., Yao, X., Tian, Y., et al. (2018a). Evaluation of RGB, color-infrared and multispectral images acquired from unmanned aerial systems for the estimation of nitrogen accumulation in rice. Remote Sensing, 10, 824. https://doi.org/10.3390/rs10060824
Zheng, H., Li, W., Jiang, J., Liu, Y., Cheng, T., Tian, Y., et al. (2018b). A comparative assessment of different modeling algorithms for estimating leaf nitrogen content in winter wheat using multispectral images from an unmanned aerial vehicle. Remote Sensing, 10, 2026. https://doi.org/10.3390/rs10122026
Zheng, H., Ma, J., Zhou, M., Li, D., Yao, X., Cao, W., et al. (2020). Enhancing the nitrogen signals of rice canopies across critical growth stages through the integration of textural and spectral information from unmanned aerial vehicle (UAV) multispectral imagery. Remote Sensing, 12, 957. https://doi.org/10.3390/rs12060957
Zhu, Y., Yao, X., Tian, Y., Liu, X., & Cao, W. (2008). Analysis of common canopy vegetation indices for indicating leaf nitrogen accumulations in wheat and rice. International Journal of Applied Earth Observation and Geoinformation, 10, 1–10. https://doi.org/10.1016/j.jag.2007.02.006
Acknowledgements
This work was supported by National Key R&D Program of China (2019YFE0125500), the Innovative Research Group Project of the National Natural Science Foundation of China (32021004), and Collaborative Innovation Center for Modern Crop Production co-sponsored by Province and Ministry. We would like to thank Jie Zhou, Dong Li, Min Jia, Xiao Zhang, Jie Zhu, Chaojie Niu and Chunchen Ma for their help in the data collection.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lu, N., Wu, Y., Zheng, H. et al. An assessment of multi-view spectral information from UAV-based color-infrared images for improved estimation of nitrogen nutrition status in winter wheat. Precision Agric 23, 1653–1674 (2022). https://doi.org/10.1007/s11119-022-09901-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11119-022-09901-7