Abstract
Accurate determination of crops growth period plays an important role in field management and agricultural decision-making. The current work mostly extracts the crop normalized difference vegetation index curve from multi-temporal data and identifies the crop phenology based on its trend or special nodes. However, these time-series-based identification methods are difficult to be applied to practically crop monitoring tasks. In this paper, the unmanned aerial vehicle remote sensing platform is used to collect the multi-spectral images of the experimental field and identify the sunflower growth period based on the different population features during its different growth periods. According to the actual field management needs, this study obtains the plot-level sunflower growth period result by analyzing statistically the distribution area of different sunflower periods in a field plot. This study uses the data of 2018 in the study area to build the model and test its performance on the data of 2019. Through comparative experiments, PSPNet can achieve a good balance between accuracy and efficiency in this study. Further, given to time-series relationship between the adjacent growth periods classification, this paper proposes an improved loss function to weight different types of misclassification to optimize model performance. The results show that improved PSPNet with proposed weighted loss function achieves the optimal recognition accuracy of 89.01%, which provides a solution for sunflower growth period recognition based on the single-phase data.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The data is available at https://data.mendeley.com/datasets/79367c6gfn/1.
Code availability
The code is available at https://data.mendeley.com/datasets/79367c6gfn/1.
References
Anjum, M., Nadeem, M., Khan, I., & Hussain, S. (2012). Nutritional and therapeutic potential of sunflower seeds: A review. British Food Journal, 114(4), 544–552. https://doi.org/10.1108/00070701211219559
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017). SegNet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12), 2481–2495. https://doi.org/10.1109/TPAMI.2016.2644615
Cao, F., & Bao, Q. (2020). A survey on image semantic segmentation methods with convolutional neural network. In Proceedings of the 2th International Conference on Communications, Information System and Computer Engineering (CISCE 2020) (pp. 458–462). Kuala Lumpur, Malaysia: IEEE. https://doi.org/10.1109/CISCE50729.2020.00103.
Chauhan, S. K., Chauhan, C. P. S., & Minhas, P. S. (2007). Effect of cyclic use and blending of alkali and good quality waters on soil properties, yield and quality of potato, sunflower and Sesbania. Irrigation Science, 26(1), 81–89. https://doi.org/10.1007/s00271-007-0074-z
Chen, L., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018). Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the 15th European Conference on Computer Vision (ECCV 2018) (pp. 801–818). Munich, Germany: Springer. https://doi.org/10.1007/978-3-030-01234-2_49.
Chollet, F. (2017). Xception: Deep learning with depthwise separable convolutions. In Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017) (pp. 1251–1258). Hawaii, USA: IEEE. https://doi.org/10.1109/CVPR.2017.195.
Chu, L., Liu, Q., Huang, C., & Liu, G. (2016). Monitoring of winter wheat distribution and phenological phases based on MODIS time-series: A case study in the Yellow River Delta. China. Journal of Integrative Agriculture, 15(10), 2403–2416. https://doi.org/10.1016/S2095-3119(15)61319-3
Fajardo, M., & Whelan, B. M. (2021). Within-farm wheat yield forecasting incorporating off-farm information. Precision Agriculture, 22, 569–585. https://doi.org/10.1007/s11119-020-09779-3
Ge, H., Ma, F., Li, Z., Tan, Z., & Du, C. (2021). Improved accuracy of phenological detection in rice breeding by using ensemble models of machine learning based on UAV-RGB imagery. Remote Sensing, 13(14), 2678. https://doi.org/10.3390/rs13142678
Hadsell, R., Chopra, S., & LeCun, Y. (2006). Dimensionality reduction by learning an invariant mapping. In Proceedings of the 19th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2006) (PP. 1735–1742). New York, USA: IEEE. https://doi.org/10.1109/CVPR.2006.100.
Hasan, A., Sohel, F., Diepeveen, D., Laga, H., & Jones, M. (2021). A survey of deep learning techniques for weed detection from images. Computers and Electronics in Agriculture, 184, 106067. https://doi.org/10.1016/j.compag.2021.106067.
Kayad, A., Sozzi, M., Paraforos, D., Rodrigues, F., Cohen, Y., Fountas, S., Francisco, M. J., Pezzuolo, A., Grigolato, S., & Marinello, F. (2022). How many gigabytes per hectare are available in the digital agriculture era? A digitization footprint estimation. Computers and Electronics in Agriculture, 198, 107080. https://doi.org/10.1016/j.compag.2022.107080
Khan, S., Tufail, M., Khan, M. T., Khan, Z. A., & Anwar, S. (2021). Deep learning-based identification system of weeds and crops in strawberry and pea fields for a precision agriculture sprayer. Precision Agriculture, 22, 1711–1727. https://doi.org/10.1007/s11119-021-09808-9
Leon, C. T., Shaw, D. R., Cox, M. S., Abshire, M. J., Ward, B., Wardlaw, M. C., & Watson, C. (2003). Utility of remote sensing in predicting crop and soil characteristics. Precision Agriculture, 4, 359–384. https://doi.org/10.1023/A:1026387830942
Minaee, S., Boykov, Y. Y., Porikli, F., Plaza, A. J., Kehtarnavaz, N., & Terzopoulos, D. (2021). Image segmentation using deep learning: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(7), 3523–3542. https://doi.org/10.1109/TPAMI.2021.3059968
Molina-Cabanillas, M. A., Jiménez-Navarro, M. J., Arjona, R., Martínez-Álvarez, F., & Asencio-Cortés, G. (2022). DIAFAN-TL: An instance weighting-based transfer learning algorithm with application to phenology forecasting. Knowledge-Based Systems. https://doi.org/10.1016/j.knosys.2022.109644
Pan, Z., Huang, J., Zhou, Q., Wang, L., Cheng, Y., Zhang, H., Blackburn, G. A., Yan, J., & Liu, J. (2015). Mapping crop phenology using NDVI time-series derived from HJ-1 A/B data. International Journal of Applied Earth Observation and Geoinformation, 34, 188–197. https://doi.org/10.1016/j.jag.2014.08.011
Rawson, H. M., & Turner, N. C. (1983). Irrigation timing and relationships between leaf area and yield in sunflower. Irrigation Science, 4, 167–175. https://doi.org/10.1007/BF00285523
Rubinstein, R. (1999). The cross-entropy method for combinatorial and continuous optimization. Methodology and Computing in Applied Probability, 1, 127–190. https://doi.org/10.1023/A:1010091220143
Saleem, M., Potgieter, J., & Arif, K. (2021). Automation in agriculture by machine and deep learning techniques: A review of recent developments. Precision Agriculture, 22, 2053–2091. https://doi.org/10.1007/s11119-021-09806-x
Shelhamer, E., Long, J., & Darrell, T. (2017). Fully convolutional networks for semantic segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 640–651. https://doi.org/10.1109/CVPR.2015.7298965
Song, Z., Zhang, Z., Yang, S., Ding, D., & Ning, J. (2020). Identifying sunflower lodging based on image fusion and deep semantic segmentation with UAV remote sensing imaging. Computers and Electronics in Agriculture, 179, 105812. https://doi.org/10.1016/j.compag.2020.105812
Srinivasan, K., Krishnaraj, M., & Mathivanan, N. (2009). Plant growth promotion and the control of sunflower necrosis virus disease by the application of biocontrol agents in sunflower. Archives of Phytopathology and Plant Protection, 42(2), 160–172. https://doi.org/10.1080/03235400600999349
Steduto, P., & Albrizio, R. (2005). Resource use efficiency of field-grown sunflower, sorghum, wheat and chickpea: II. Water use efficiency and comparison with radiation use efficiency. Agricultural and Forest Meteorology, 130, 269–281. https://doi.org/10.1016/j.agrformet.2005.03.009
Taylor, S., & Browning, D. (2022). Classification of daily crop phenology in PhenoCams using deep learning and hidden markov models. Remote Sensing, 14(2), 286. https://doi.org/10.3390/rs14020286
Wan, S., Jiao, Y., Kang, Y., Jiang, S., Tan, J., Liu, W., & Meng, J. (2013). Growth and yield of oleic sunflower (Helianthus annuus L.) under drip irrigation in very strongly saline soils. Irrigation Science, 31, 943–957. https://doi.org/10.1007/s00271-012-0370-0
Wang, L., Wang, P., Li, L., Xun, L., Kong, Q., & Liang, S. (2018). Developing an integrated indicator for monitoring maize growth condition using remotely sensed vegetation temperature condition index and leaf area index. Computers and Electronics in Agriculture, 152, 340–349. https://doi.org/10.1016/j.compag.2018.07.026
Wang, Y., Zhang, Z., Feng, L., & Du, Q. (2021). A new attention-based CNN approach for crop mapping using time series Sentinel-2 images. Computers and Electronics in Agriculture, 184, 106090. https://doi.org/10.1016/j.compag.2021.106090
Wu, M., Wu, J., Tan, X., Huang, J., Jansson, P. E., & Zhang, W. (2019). Simulation of dynamical interactions between soil freezing/thawing and salinization for improving water management in cold/arid agricultural region. Geoderma, 338, 325–342. https://doi.org/10.1016/j.geoderma.2018.12.022
Yang, Q., Shi, L., Han, J., Yu, J., & Huang, K. (2020). A near real-time deep learning approach for detecting rice phenology based on UAV images. Agricultural and Forest Meteorology, 287, 107938. https://doi.org/10.1016/j.agrformet.2020.107938
Zhang, J., Zhang, Z., Chen, J., Chen, H., Jin, J., Han, J., Wang, X., Song, Z., & Wei, G. (2021a). Estimating soil salinity with different fractional vegetation cover using remote sensing. Land Degradation & Development, 32(2), 597–612. https://doi.org/10.1002/ldr.3737
Zhang, W., Zhang, Y., Yang, Y., & Chen, E. (2021). Oilseed rape (Brassica napus L.) phenology estimation by averaged stokes-related parameters. Remote Sensing, 13(14), 2652. https://doi.org/10.3390/rs13142652
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017). Pyramid scene parsing network. In Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017) (pp. 6230–6239). Hawaii, USA: IEEE. https://doi.org/10.1109/CVPR.2017.660.
Zhong, L., Hu, L., Zhou, H., & Tao, X. (2019). Deep learning based winter wheat mapping using statistical data as ground references in Kansas and northern Texas, US. Remote Sensing of Environment, 233, 111411. https://doi.org/10.1016/j.rse.2019.111411
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016). Learning deep features for discriminative localization. In Proceedings of the 29th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016) (pp. 2921–2929). Las Vegas, USA: IEEE. https://doi.org/10.1109/CVPR.2016.319.
Funding
This work was supported by the National Natural Science Foundation of China (52179044, 51979232) and Natural Science Foundation of Shaanxi Province (2022JM-128).
Author information
Authors and Affiliations
Contributions
ZS: Conceptualization, Methodology, Validation, Data curation, Writing-original draft. PW: Writing-review & editing. ZZ: Conceptualization, Investigation, Resources, Writing-review & editing. SY: Conceptualization, Writing-review & editing, Supervision, Funding acquisition. JN: Conceptualization, Writing-review & editing, Supervision.
Corresponding author
Ethics declarations
Competing interests
The authors declare no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Song, Z., Wang, P., Zhang, Z. et al. Recognition of sunflower growth period based on deep learning from UAV remote sensing images. Precision Agric 24, 1417–1438 (2023). https://doi.org/10.1007/s11119-023-09996-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11119-023-09996-6