Crop model; Phenology prediction; Model evaluation; Wheat
Abstract :
[en] Predicting phenology is essential for adapting varieties to different environmental conditions and for crop management. Therefore, it is important to evaluate how well different crop modeling groups can predict phenology. Multiple evaluation studies have been previously published, but it is still difficult to generalize the findings from such studies since they often test some specific aspect of extrapolation to new conditions, or do not test on data that is truly independent of the data used for calibration. In this study, we analyzed the prediction of wheat phenology in Northern France under observed weather and current management, which is a problem of practical importance for wheat management. The results of 27 modeling groups are evaluated, where modeling group encompasses model structure, i.e. the model equations, the calibration method and the values of those parameters not affected by calibration. The data for calibration and evaluation are sampled from the same target population, thus extrapolation is limited. The calibration and evaluation data have neither year nor site in common, to guarantee rigorous evaluation of prediction for new weather and sites. The best modeling groups, and also the mean and median of the simulations, have a mean absolute error (MAE) of about 3 days, which is comparable to the measurement error. Almost all models do better than using average number of days or average sum of degree days to predict phenology. On the other hand, there are important differences between modeling groups, due to model structural differences and to differences between groups using the same model structure, which emphasizes that model structure alone does not completely determine prediction accuracy. In addition to providing information for our specific environments and varieties, these results are a useful contribution to a knowledge base of how well modeling groups can predict phenology, when provided with calibration data from the target population.
Disciplines :
Computer science Agriculture & agronomy
Author, co-author :
Wallach, Daniel
Palosuo, Taru
Thorburn, Peter
Gourdain, Emmanuelle
Asseng, Senthold
Basso, Bruno
Buis, Samuel
Crout, Neil
Dibari, Camilla
Dumont, Benjamin ; Université de Liège - ULiège > Département GxABT > Plant Sciences
Andarzian, Bahram, Hoogenboom, G., Bannayan, M., Shirali, M., Andarzian, Behnam, Determining optimum sowing date of wheat using CSM-CERES-wheat model. J. Saudi Soc. Agric. Sci. 14 (2015), 189–199, 10.1016/J.JSSAS.2014.04.004.
Asseng, S., Ewert, F., Martre, P., Rötter, R.P., Lobell, D.B., Cammarano, D., et al. Rising temperatures reduce global wheat production. Nat. Clim. Chang. 5 (2015), 143–147, 10.1038/nclimate2470.
Bassu, S., Brisson, N., Durand, J.-L., Boote, K., Lizaso, J., Jones, J.W., Rosenzweig, C., Ruane, A.C., Adam, M., Baron, C., Basso, B., Biernath, C., Boogaard, H., Conijn, S., Corbeels, M., Deryng, D., De Sanctis, G., Gayler, S., Grassini, P., Hatfield, J., Hoek, S., Izaurralde, C., Jongschaap, R., Kemanian, A.R., Kersebaum, K.C., Kim, S.-H., Kumar, N.S., Makowski, D., Müller, C., Nendel, C., Priesack, E., Pravia, M.V., Sau, F., Shcherbak, I., Tao, F., Teixeira, E., Timlin, D., Waha, K., How do various maize crop models vary in their responses to climate change factors?. Glob. Chang. Biol. 20 (2014), 2301–2320, 10.1111/gcb.12520.
Biernath, C., Gayler, S., Bittner, S., Klein, C., Högy, P., Fangmeier, A., Priesack, E., Evaluating the ability of four crop models to predict different environmental impacts on spring wheat grown in open-top chambers. Eur. J. Agron. 35 (2011), 71–82, 10.1016/j.eja.2011.04.001.
Bogard, M., Pierre, J.-B., Huguenin-Bizot, B., Hourcade, D., Paux, E., Le Bris, X., Gouache, D., A simple approach to predict growth stages in winter wheat (Triticum aestivum L.) combining prediction of a crop model and marker based prediction of the deviation to a reference cultivar: a case study in France. Eur. J. Agron. 68 (2015), 57–68, 10.1016/J.EJA.2015.04.007.
Canal, N., Deudon, O., Le Bris, X., Gate, P., Pigeon, G., Regimbeau, M., Calvet, J.-C., Anticipation of the winter wheat growth based on seasonal weather forecasts over France. Meteorol. Appl. 24 (2017), 432–443, 10.1002/met.1642.
Casella, G., Berger, R.L., Statistical Inference. 1990, Wadsworth and Brooks, Pacific Grove, CA.
Ceglar, A., van der Wijngaart, R., de Wit, A., Lecerf, R., Boogaard, H., Seguini, L., van den Berg, M., Toreti, A., Zampieri, M., Fumagalli, D., Baruth, B., Improving WOFOST model to simulate winter wheat phenology in Europe: evaluation and effects on yield. Agric. Syst. 168 (2019), 168–180, 10.1016/J.AGSY.2018.05.002.
Confalonieri, R., Orlando, F., Paleari, L., Stella, T., Gilardelli, C., Movedi, E., Pagani, V., Cappelli, G., Vertemara, A., Alberti, L., Alberti, P., Atanassiu, S., Bonaiti, M., Cappelletti, G., Ceruti, M., Confalonieri, A., Corgatelli, G., Corti, P., Dell'Oro, M., Ghidoni, A., Lamarta, A., Maghini, A., Mambretti, M., Manchia, A., Massoni, G., Mutti, P., Pariani, S., Pasini, D., Pesenti, A., Pizzamiglio, G., Ravasio, A., Rea, A., Santorsola, D., Serafini, G., Slavazza, M., Acutis, M., Uncertainty in crop model predictions: what is the role of users?. Environ. Model. Softw. 81 (2016), 165–173, 10.1016/j.envsoft.2016.04.009.
Corripio, J.G., n.d. Insol: Solar Radiation. R Package Version 1.2. 2019.
Diekkrüger, B., Söndgerath, D., Kersebaum, K.C., McVoy, C.W., Validity of agroecosystem models a comparison of results of different models applied to the same data set. Ecol. Modell. 81 (1995), 3–29, 10.1016/0304-3800(94)00157-D.
Efron, B., How biased is the apparent error rate of a prediction rule?. J. Am. Stat. Assoc. 81 (1986), 461–470, 10.1080/01621459.1986.10478291.
Gouache, D., Le Bris, X., Bogard, M., Deudon, O., Pagé, C., Gate, P., Evaluating agronomic adaptation options to increasing heat stress under climate change during wheat grain filling in France. Eur. J. Agron. 39 (2012), 62–70, 10.1016/j.eja.2012.01.009.
Haughton, N., Abramowitz, G., Pitman, A., Phipps, S.J., Weighting climate model ensembles for mean and variance estimates. Clim. Dyn. 45 (2015), 3169–3181, 10.1007/s00382-015-2531-3.
Hunt, J.R., Lilley, J.M., Trevaskis, B., Flohr, B.M., Peake, A., Fletcher, A., Zwart, A.B., Gobbett, D., Kirkegaard, J.A., Early sowing systems can boost Australian wheat yields despite recent climate change. Nat. Clim. Chang. 9 (2019), 244–247, 10.1038/s41558-019-0417-9.
Hussain, J., Khaliq, T., Ahmad, A., Akhtar, J., Performance of four crop model for simulations of wheat phenology, leaf growth, biomass and yield across planting dates. PLoS One, 13, 2018, e0197546, 10.1371/journal.pone.0197546.
Johnen, T., Boettcher, U., Kage, H., A variable thermal time of the double ridge to flag leaf emergence phase improves the predictive quality of a CERES-Wheat type phenology model. Comput. Electron. Agric. 89 (2012), 62–69, 10.1016/J.COMPAG.2012.08.002.
Kumudini, S., Andrade, F.H., Boote, K.J., Brown, G.A., Dzotsi, K.A., Edmeades, G.O., Gocken, T., Goodwin, M., Halter, A.L., Hammer, G.L., Hatfield, J.L., Jones, J.W., Kemanian, A.R., Kim, S.-H., Kiniry, J., Lizaso, J.I., Nendel, C., Nielsen, R.L., Parent, B., Stӧckle, C.O., Tardieu, F., Thomison, P.R., Timlin, D.J., Vyn, T.J., Wallach, D., Yang, H.S., Tollenaar, M., Predicting maize phenology: intercomparison of functions for developmental response to temperature. Agron. J. 106 (2014), 2087–2097, 10.2134/agronj14.0200.
Lancashire, P.D., Bleiholder, H., Boom Van Den, T., LangelüddekeE, P., Stauss, R., Weber, E., Witzenberger, A., A uniform decimal code for growth stages of crops and weeds. Ann. Appl. Biol. 119 (1991), 561–601, 10.1111/j.1744-7348.1991.tb04895.x.
Le Bris, X., Gate, P., Gouache, D., Garcia, C., Deswarte, J.-C., Prévision de la phénologie du blé tendre et utilisation dans des outils d'aide à la décision. [WWW Document]. Colloq. Francoph. Phenol. 2015, Clermont-Ferrand 17-19/11/2015. URL https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&ved=2ahUKEwiFh9TswNLnAhVPV6wKHUX9B-gQFjAAegQIAxAB&url=https%3A%2F%2Fwww6.inrae.fr%2Fprojet-accaf-perpheclim%2FMedia%2Ffichiers%2FColloque-Pheno%2FS6-2-Arvalis&usg=AOvVaw1Yn66Z6 (accessed 2.14.20), 2015.
Liu, L., Wallach, D., Li, J., Liu, B., Zhang, L., Tang, L., Zhang, Y., Qiu, X., Cao, W., Zhu, Y., Uncertainty in wheat phenology simulation induced by cultivar parameterization under climate warming. Eur. J. Agron. 94 (2018), 46–53, 10.1016/J.EJA.2017.12.001.
Maiorano, A., Martre, P., Asseng, S., Ewert, F., Müller, C., Rötter, R.P., Ruane, A.C., Semenov, M.A., Wallach, D., Wang, E., Alderman, P.D., Kassie, B.T., Biernath, C., Basso, B., Cammarano, D., Challinor, A.J., Doltra, J., Dumont, B., Rezaei, E.E., Gayler, S., Kersebaum, K.C., Kimball, B.A., Koehler, A.-K., Liu, B., O'Leary, G.J., Olesen, J.E., Ottman, M.J., Priesack, E., Reynolds, M., Stratonovitch, P., Streck, T., Thorburn, P.J., Waha, K., Wall, G.W., White, J.W., Zhao, Z., Zhu, Y., Crop model improvement reduces the uncertainty of the response to temperature of multi-model ensembles. F. Crop. Res., 202, 2017, 10.1016/j.fcr.2016.05.001.
Palosuo, T., Kersebaum, K.C., Angulo, C., Hlavinka, P., Moriondo, M., Olesen, J.E., Patil, R.H., Ruget, F., Rumbaur, C., Takáč, J., Trnka, M., Bindi, M., Çaldağ, B., Ewert, F., Ferrise, R., Mirschel, W., Şaylan, L., Šiška, B., Rötter, R., Simulation of winter wheat yield and its variability in different climates of Europe: a comparison of eight crop growth models. Eur. J. Agron. 35 (2011), 103–114, 10.1016/j.eja.2011.05.001.
Piao, S., Liu, Q., Chen, A., Janssens, I.A., Fu, Y., Dai, J., Liu, L., Lian, X., Shen, M., Zhu, X., Plant phenology and global climate change: current progresses and challenges. Glob. Chang. Biol. gcb., 14619, 2019, 10.1111/gcb.14619.
R Core Team, A Language and Environment for Statistical Computing. 2017.
Rauff, K.O., Bello, R., A review of crop growth simulation models as tools for agricultural meteorology. Agric. Sci. 06 (2015), 1098–1105, 10.4236/as.2015.69105.
Rezaei, E.E., Siebert, S., Ewert, F., Intensity of heat stress in winter wheat—phenology compensates for the adverse effect of global warming. Environ. Res. Lett., 10, 2015, 024012, 10.1088/1748-9326/10/2/024012.
Salazar-Gutierrez, M.R., Johnson, J., Chaves-Cordoba, B., Hoogenboom, G., Relationship of base temperature to development of winter wheat. Int. J. Plant Prod. 7 (2013), 741–762.
Svystun, T., Bhalerao, R.P., Jönsson, A.M., Modelling Populus autumn phenology: the importance of temperature and photoperiod. Agric. For. Meteorol. 271 (2019), 346–354, 10.1016/J.AGRFORMET.2019.03.003.
van Bussel, L.G.J., Stehfest, E., Siebert, S., Müller, C., Ewert, F., Simulation of the phenological development of wheat and maize at the global scale. Glob. Ecol. Biogeogr. 24 (2015), 1018–1029, 10.1111/geb.12351.
van Ittersum, M., Leffelaar, P., van Keulen, H., Kropff, M., Bastiaans, L., Goudriaan, J., On approaches and applications of the Wageningen crop models. Eur. J. Agron. 18 (2003), 201–234, 10.1016/S1161-0301(02)00106-5.
Wallach, D., Mearns, L.O., Ruane, A.C., Rötter, R.P., Asseng, S., Lessons from climate modeling on the design and use of ensembles for crop modeling. Clim. Change 139 (2016), 551–564, 10.1007/s10584-016-1803-1.
Wallach, D., Martre, P., Liu, B., Asseng, S., Ewert, F., Thorburn, P.J., van Ittersum, M., Aggarwal, P.K., Ahmed, M., Basso, B., Biernath, C., Cammarano, D., Challinor, A.J., De Sanctis, G., Dumont, B., Eyshi Rezaei, E., Fereres, E., Fitzgerald, G.J., Gao, Y., Garcia-Vila, M., Gayler, S., Girousse, C., Hoogenboom, G., Horan, H., Izaurralde, R.C., Jones, C.D., Kassie, B.T., Kersebaum, K.C., Klein, C., Koehler, A.-K., Maiorano, A., Minoli, S., Müller, C., Naresh Kumar, S., Nendel, C., O'Leary, G.J., Palosuo, T., Priesack, E., Ripoche, D., Rötter, R.P., Semenov, M.A., Stöckle, C., Stratonovitch, P., Streck, T., Supit, I., Tao, F., Wolf, J., Zhang, Z., Multimodel ensembles improve predictions of crop-environment-management interactions. Glob. Chang. Biol. 24 (2018), 5072–5083, 10.1111/gcb.14411.
Wang, E., Martre, P., Zhao, Z., Ewert, F., Maiorano, A., Rötter, R.P., et al. The uncertainty of crop yield projections is reduced by improved temperature response functions. Nat. Plants 3 (2017), 1–13, 10.1038/nplants.2017.102.
Willmott, C.J., Matsuura, K., Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance. Clim. Res. 30 (2005), 79–82.
Yuan, S., Peng, S., Li, T., Evaluation and application of the ORYZA rice model under different crop managements with high-yielding rice cultivars in central China. F. Crop. Res. 212 (2017), 115–125, 10.1016/J.FCR.2017.07.010.
Zadoks, J.C., Chzang, T.T., Konzak, C.F., A decimal code for the growth stages of cereals. Weed Res. 14 (1974), 415–421, 10.1111/j.1365-3180.1974.tb01084.x.