Skip to main content
Log in

Accuracy and uncertainty analysis of staple food crop modelling by the process-based Agro-C model

  • Original Paper
  • Published:
International Journal of Biometeorology Aims and scope Submit manuscript

Abstract

Accuracy analysis of a process-based model is important for evaluating the reliability of model estimates of crop growth. Uncertainties in projections of crop growth may derive from different sources in modelling. The parameter-induced uncertainty is one of the important aspects. Here we calibrated the parameters for rice, wheat and maize combined with observed data of aboveground biomass (AGB) and leaf area index (LAI) at 16 Chinese Ecosystem Research Network (CERN) sites under different rotation systems and subsequently validated the model at these sites using the data independent of calibration. The results showed that the simulated AGB and LAI exhibited good agreement with the observations. The model performance for rice and maize was better than that for wheat. The statistical analysis of model performance showed that the RMSE (root mean square error), RMD (relative mean deviation) and EF (model efficiency) were 32.52%, − 0.95% and 0.87 of the means, respectively. The three components of the modelling uncertainty, bias of mean (UM), bias of slope (UR) and random residue (UE) accounted 0.1%, 0.9% and 99% of the total errors, respectively. The main contributor to the error was the random disturbances, indicating that the parameters calibration in this study had reached relatively reasonable conditions on the whole. Although the model displayed an overall good prediction in crops AGBs and LAI, there were still notable bias at some sites due to non-random errors (UM and UR). This indicated that there were still uncertainties in the modelling procedure, e.g. the model mechanism or parameterization. The uncertainty of the simulated results may greatly restrict the application of a model. To effectively and reasonably apply a model, it is necessary to evaluate and analyse the main sources of uncertainty in the simulated results. The parameter-induced uncertainty analysis in this study showed that, at the site scale, the range of uncertainty brought by the changes in three parameters (SLA, PL and α) to the modelling results (95% CI) of Agro-C covered more than 90% of the observations and brought approximately 21% uncertainty to the simulated AGBs of the three major crops.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Allen OB, Raktoe BL (1981) Accuracy analysis with special reference to the prediction of grassland yield. Biom J 23:371–388

    Article  Google Scholar 

  • Asseng S, Ewert F, Rosenzweig C, Jones JW, Hatfield JL, Ruane AC, Boote KJ, Thorburn PJ, Rötter RP, Cammarano D, Brisson N, Basso B (2013) Uncertainty in simulating wheat yields under climate change. Nat Clim Chang 3:827–832

    Article  CAS  Google Scholar 

  • Brisson N, Ruget F, Gate P, Lorgeau J, Nicoullaud B, Tayot X, Plenet D, Jeuffroy MH, Bouthier A, Ripoche D, Mary B, Justes E (2002) STICS: a generic model for simulating crops and their water and nitrogen balances. II. Model validation for wheat and maize. Agronomie 22:69–92

    Article  Google Scholar 

  • Godfray HCJ, Beddington JR, Crute IR, Haddad L, Lawrence D, Muir JF, Pretty J, Robinson S, Thomas SM, Toulmin C (2010) Food security: the challenge of feeding 9 billion people. Science 327(5967):812–818

    Article  CAS  Google Scholar 

  • Hu B, Wang YS, Liu G (2007) Spatiotemporal characteristics of photosynthetically active radiation in China. J Geophys Res-Atmos 112. https://doi.org/10.1029/2009GB003544

  • Huang Y, Yu YQ, Zhang W, Sun WJ, Liu SL, Jiang J, Wu JS, Yu WT, Wang Y, Yang ZF (2009) Agro-C: a biogeophysical model for simulating the carbon budget of agroecosystems. Agric For Meteorol 149:106–129

    Article  Google Scholar 

  • Ines AVM, Hansen JW, Robertson AW (2011) Enhancing the utility of daily GCM rainfall for crop yield prediction. Int J Climatol 31:2168–2182

    Article  Google Scholar 

  • IPCC (2000) IPCC good practice guidance and uncertainty management in National Greenhouse Gas Inventories. Penman, J., Kruger, D., Galbally, I., etc. IPCC/OECD/IEA/IGES, Hayama, Japan

  • IPCC (2006) Uncertainties. In: 2006 IPCC guidelines for National Greenhouse gas Inventories, vol 3. The National Greenhouse Gas Inventories Programme, Intergovernmental Panel on Climate Change, Hayama, pp 1–3.66

    Google Scholar 

  • IPCC (2013) Climate change 2013: the physical science basis: working group I contribution to the fifth assessment report of the intergovernmental panel on climate change. Cambridge University Press, Cambridge

    Google Scholar 

  • Jiang XJ, Tang L, Liu XJ, Cao WX, Zhu Y (2013) Spatial and temporal characteristics of Rice potential productivity and potential yield increment in main production regions of China. J Integr Agric 12:45–56

    Article  Google Scholar 

  • Kramer K, Leinonen I, Bartelink HH, Berbigier P, Borghetti M, Bernhofer C et al (2002) Evaluation of six process-based forest growth models using eddy-covariance measurements of CO2 and H2O fluxes at six forest sites in Europe. Glob Chang Biol 8(3):213–230

    Article  Google Scholar 

  • Li T, Huang Y, Zhang W, Yu YQ (2012) Methane emissions associated with the conversion of marshland to cropland and climate change on the Sanjiang Plain of northeast China from 1950 to 2100. Biogeosciences 9:5199–5215

    Article  CAS  Google Scholar 

  • Li X, Takahashi T, Suzuki N, Kaiser HM (2011) The impact of climate change on maize yields in the United States and China. Agric Syst 104:348–353

    Article  Google Scholar 

  • Li SA, Wheeler T, Challinor A, Lin E, Ju H, Xu YL (2010) The observed relationships between wheat and climate in China. Agric For Meteorol 150:1412–1419

    Article  Google Scholar 

  • Lv ZF, Liu XJ, Cao WX, Zhu Y (2013) Climate change impacts on regional winter wheat production in main wheat production regions of China. Agric For Meteorol 171:234–248

    Article  Google Scholar 

  • Masutomi Y, Takahashi K, Harasawa H, Matsuoka Y (2009) Impact assessment of climate change on rice production in Asia in comprehensive consideration of process/parameter uncertainty in general circulation models. Agric Ecosyst Environ 131:281–291

    Article  Google Scholar 

  • Miehle P, Livesley SJ, Li CS, Feikema PM, Adams MA, Arndt SK (2006) Quantifying uncertainty from large-scale model predictions of forest carbon dynamics. Glob Chang Biol 12:1421–1434

    Article  Google Scholar 

  • Moriasi DN, Arnold JG, Van Liew MW, Bingner RL, Harmel RD, Veith TL (2007) Model evaluation guidelines for systematic quantification of accuracy in watershed simulations. Trans ASABE 50(3):885–900

    Article  Google Scholar 

  • Muller A, Schader C, Scialabba NEH, Brüggemann J, Isensee A, Erb KH et al (2017) Strategies for feeding the world more sustainably with organic agriculture. Nat Commun 8(1):1290

    Article  Google Scholar 

  • Ogle SM, Breidt FJ, Easter M, Williams S, Killian K, Paustian K (2010) Scale and uncertainty in modeled soil organic carbon stock changes for US croplands using a process-based model. Glob Chang Biol 16:810–822

    Article  Google Scholar 

  • Ogle SM, Breidt FJ, Easter M, Williams S, Paustian K (2007) An empirically based approach for estimating uncertainty associated with modelling carbon sequestration in soils. Ecol Model 205:453–463

    Article  Google Scholar 

  • Ogle SM, Breidt FJ, Eve MD, Paustian K (2003) Uncertainty in estimating land use and management impacts on soil organic carbon storage for US agricultural lands between 1982 and 1997. Glob Chang Biol 9:1521–1542

    Article  Google Scholar 

  • Palosuo T, Kersebaum KC, Angulo C, Hlavinka P, Moriondo M, Olesen JE, Patil RH, Ruget F, Rumbaur C, Takac J, Trnka M, Bindi M, Caldag B, Ewert F, Ferrise R, Mirschel W, Saylan L, Siska B, Rotter R (2011) Simulation of winter wheat yield and its variability in different climates of Europe: a comparison of eight crop growth models. Eur J Agron 35(3):103–114

    Article  Google Scholar 

  • Pugh TAM, Müller C, Elliott J, Deryng D, Folberth C, Olin S et al (2016) Climate analogues suggest limited potential for intensification of production on current croplands under climate change. Nat Commun 7(1):1–8

    Article  Google Scholar 

  • Rahn KH, Werner C, Kiese R, Haas E, Butterbach-Bahl K (2012) Parameter-induced uncertainty quantification of soil N2O, NO and CO2 emission from Hoglwald spruce forest (Germany) using the LandscapeDNDC model. Biogeosciences 9:3983–3998

    Article  CAS  Google Scholar 

  • Smith P, Smith JU, Powlson DS, McGill WB, Arah JRM, Chertov OG, Coleman K, Franko U, Frolking S, Jenkinson DS, Jensen LS, Kelly RH, Klein-Gunnewiek H, Komarov AS, Li C, Molina JAE, Mueller T, Parton WJ, Thornley JHM, Whitmore AP (1997) A comparison of the performance of nine soil organic matter models using datasets from seven long-term experiments. Geoderma 81:153–225

    Article  Google Scholar 

  • Tao FL, Yokozawa M, Liu JY, Zhang Z (2008) Climate-crop yield relationships at provincial scales in China and the impacts of recent climate trends. Clim Res 38:83–94

    Article  Google Scholar 

  • Tao FL, Yokozawa M, Xu YL, Hayashi Y, Zhang Z (2006) Climate changes and trends in phenology and yields of field crops in China, 1981-2000. Agric For Meteorol 138:82–92

    Article  Google Scholar 

  • Verburg PH, van Bodegom PM, van der Gon HACD, Bergsma A, van Breemen N (2006) Upscaling regional emissions of greenhouse gases from rice cultivation: methods and sources of uncertainty. Plant Ecol 182:89–106

    Article  Google Scholar 

  • Vrugt JA, Gupta HV, Bouten W, Sorooshian S (2003) A shuffled complex evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters. Water Resour Res 39. https://doi.org/10.1029/2002WR001642

  • Xiong W, Conway D, Lin ED, Holman I (2009) Potential impacts of climate change and climate variability on China's rice yield and production. Clim Res 40:23–35

    Article  Google Scholar 

  • Yu YQ, Huang Y, Zhang W (2012) Changes in rice yields in China since 1980 associated with cultivar improvement, climate and crop management. Field Crop Res 136:65–75

    Article  Google Scholar 

  • Zhang TY, Huang Y (2012) Impacts of climate change and inter-annual variability on cereal crops in China from 1980 to 2008. J Sci Food Agric 92:1643–1652

    Article  CAS  Google Scholar 

  • Zhang W, Sun W, Li T (2017) Uncertainties in the national inventory of methane emissions from rice cultivation: field measurements and modeling approaches. Biogeosciences 14:163–176

    Article  CAS  Google Scholar 

  • Zhang Q, Zhang W, Li T, Sun W, Yu Y, Wang G (2017) Projective analysis of staple food crop productivity in adaptation to future climate change in China. Int J Biometeorol 61(8):1–16

    Google Scholar 

  • Zhang TY, Zhu JA, Wassmann R (2010) Responses of rice yields to recent climate change in China: an empirical assessment based on long-term observations at different spatial scales (1981-2005). Agric For Meteorol 150:1128–1137

    Article  Google Scholar 

Download references

Funding

This work was supported by the National Natural Science Foundation of China (Grant No. 41605088), National Key R&D Program of China (Grant No.2017YFE0104600) and the National Key Scientific and Technological Infrastructure project “Earth System Science Numerical Simulator Facility” (EarthLab).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tingting Li.

Supplementary Information

ESM 1

(DOCX 608 kb)

ESM 2

(DOCX 25 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Q., Zhang, W., Li, T. et al. Accuracy and uncertainty analysis of staple food crop modelling by the process-based Agro-C model. Int J Biometeorol 65, 587–599 (2021). https://doi.org/10.1007/s00484-020-02053-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00484-020-02053-1

Keywords

Navigation