Hydrological model; Model performance; Meuse basin
Abstract :
[en] Streamflow is often the only variable used to evaluate hydrological models. In a previous international comparison study, eight research groups followed an identical protocol to calibrate twelve hydrological models using observed streamflow of catchments within the Meuse basin. In the current study, we quantify the differences in five states and fluxes of these twelve process-based models with similar streamflow performance, in a systematic and comprehensive way. Next, we assess model behavior plausibility by ranking 5 the models for a set of criteria using streamflow and remote sensing data of evaporation, snow cover, soil moisture and total storage anomalies. We found substantial dissimilarities between models for annual interception and seasonal evaporation rates, the annual number of days with water stored as snow, the mean annual maximum snow storage and the size of the root-zone storage capacity. These differences in internal process representation imply that these models cannot all simultaneously be close to reality. Modeled annual evaporation rates are consistent with GLEAM estimates. However, there is a large uncertainty in modeled and remote sensing annual interception. Substantial differences are also found between MODIS and modeled number of days with snow storage. Models with relatively small root-zone storage capacities and without root water uptake reduction under dry conditions tend to have an empty root-zone storage for several days each summer, while this is not suggested by remote sensing data of evaporation, soil moisture and vegetation indices. On the other hand, models with relatively large root-zone storage capacities tend to overestimate very dry total storage anomalies of GRACE. None of the models is systematically consistent with the information available from all different (remote sensing) data sources. Yet, we did not reject models given the uncertainties in these data sources and their changing relevance for the system under investigation.
Research center :
UEE - Urban and Environmental Engineering - ULiège
Disciplines :
Civil engineering
Author, co-author :
Bouaziz, Laurène J. E.; Delft University of Technology & Deltares, The Netherlands
Thirel, Guillaume; Université Paris-Saclay, INRAE, UR HYCAR, 92160, Antony, France
de Boer-Euser, Tanja; Department of Water Management, Faculty of Civil Engineering and Geosciences, Delft University of Technology, P.O. Box5048, NL-2600 GA Delft, The Netherlands
Buitink, Joost; Hydrology and Quantitative Water Management Group, Wageningen University and Research, P.O. Box 47, 6700 AAWageningen, The Netherlands
Brauer, Claudia C.; Hydrology and Quantitative Water Management Group, Wageningen University and Research, P.O. Box 47, 6700 AAWageningen, The Netherlands
De Niel, Jan; Hydraulics division, Department of Civil Engineering, KU Leuven, Kasteelpark Arenberg 40, BE-3001 Leuven, Belgium
Dewals, Benjamin ; Université de Liège - ULiège > Département ArGEnCo > Hydraulics in Environmental and Civil Engineering
Drogue, Gilles; Université de Lorraine, LOTERR, F-57000 Metz, France
Grelier, Benjamin; Université de Lorraine, LOTERR, F-57000 Metz, France
Melsen, Lieke; Hydrology and Quantitative Water Management Group, Wageningen University and Research, P.O. Box 47, 6700 AAWageningen, The Netherlands
Moustakas, Sotirios; Hydraulics division, Department of Civil Engineering, KU Leuven, Kasteelpark Arenberg 40, BE-3001 Leuven, Belgium
Sprokkereef, Eric; Ministry of Infrastructure and Water Management, Zuiderwagenplein 2, 8224 AD Lelystad, The Netherlands
Stam, Jasper; Ministry of Infrastructure and Water Management, Zuiderwagenplein 2, 8224 AD Lelystad, The Netherlands
Weerts, Albrecht H.; Wageningen University and Research & Deltares, The Netherlands
Willems, Patrick; Hydraulics division, Department of Civil Engineering, KU Leuven, Kasteelpark Arenberg 40, BE-3001 Leuven, Belgium
Savenije, Hubert H. G.; Department of Water Management, Faculty of Civil Engineering and Geosciences, Delft University of Technology, P.O. Box5048, NL-2600 GA Delft, The Netherlands
Hrachowitz, Markus; Department of Water Management, Faculty of Civil Engineering and Geosciences, Delft University of Technology, P.O. Box5048, NL-2600 GA Delft, The Netherlands
Addor, N. and Melsen, L. A.: Legacy, Rather Than Adequacy, Drives the Selection of Hydrological Models, Water Resour. Res., 55, 378-390, https://doi.org/10.1029/2018WR022958, 2019.
Adnan, M., Merwade, V., and Yu, Z.: Multi-objective calibration of a hydrologic model using spatially distributed remotely sensed/in-situ soil moisture, J. Hydrol., 536, 192-207, https://doi.org/10.1016/j.jhydrol.2016.02.037, 2016.
Albergel, C., Rüdiger, C., Pellarin, T., Calvet, J.-C., Fritz, N., Froissard, F., Suquia, D., Petitpa, A., Piguet, B., and Martin, E.: From near-surface to root-zone soil moisture using an exponential filter: an assessment of the method based on in-situ observations and model simulations, Hydrol. Earth Syst. Sci., 12, 1323-1337, https://doi.org/10.5194/hess-12-1323-2008, 2008.
Alcamo, J., Döll, P., Henrichs, T., Kaspar, F., Lehner, B., Rösch, T., and Siebert, S.: Development and testing of the WaterGAP 2 global model of water use and availability, Hydrolog. Sci. J., 48, 317-338, https://doi.org/10.1623/hysj.48.3.317.45290, 2003.
Andréassian, V., Le Moine, N., Perrin, C., Ramos, M. H., Oudin, L., Mathevet, T., Lerat, J., and Berthet, L.: All that glitters is not gold: The case of calibrating hydrological models, Hydrol. Process., 26, 2206-2210, https://doi.org/10.1002/hyp.9264, 2012.
Archfield, S. A., Clark, M., Arheimer, B., Hay, L. E., McMillan, H., Kiang, J. E., Seibert, J., Hakala, K., Bock, A., Wagener, T., Farmer, W. H., Andréassian, V., Attinger, S., Viglione, A., Knight, R., Markstrom, S., and Over, T.: Accelerating advances in continental domain hydrologic modeling, Water Resour. Res., 51, 10078-10091, https://doi.org/10.1002/2015WR017498, 2015.
Ault, T. W., Czajkowski, K. P., Benko, T., Coss, J., Struble, J., Spongberg, A., Templin, M., and Gross, C.: Validation of the MODIS snow product and cloud mask using student and NWS cooperative station observations in the Lower Great Lakes Region, Remote Sens. Environ., 105, 341-353, https://doi.org/10.1016/j.rse.2006.07.004, 2006.
Bauer-Marschallinger, B.: Copernicus Global Land Operations "Vegetation and Energy" "CGLOPS-1" Validation Report Soil Water Index Collection 1 km, available at: https://land.copernicus.eu/global/sites/cgls.vito.be/files/ products/CGLOPS1-QAR-SWI1km-V1-I1.11.pdf (last access: 18 September 2020), 2020.
Bauer-Marschallinger, B., Paulik, C., Hochstöger, S., Mistelbauer, T., Modanesi, S., Ciabatta, L., Massari, C., Brocca, L., and Wagner, W.: Soil moisture from fusion of scatterometer and SAR: Closing the scale gap with temporal filtering, Remote Sens., 10, 1-26, https://doi.org/10.3390/rs10071030, 2018.
Beck, H. E., van Dijk, A. I. J. M., de Roo, A., Dutra, E., Fink, G., Orth, R., and Schellekens, J.: Global evaluation of runoff from 10 state-of-the-art hydrological models, Hydrol. Earth Syst. Sci., 21, 2881-2903, https://doi.org/10.5194/hess-21-2881-2017, 2017.
Bennett, K. E., Cherry, J. E., Balk, B., and Lindsey, S.: Using MODIS estimates of fractional snow cover area to improve streamflow forecasts in interior Alaska, Hydrol. Earth Syst. Sci., 23, 2439-2459, https://doi.org/10.5194/hess-23-2439-2019, 2019.
Beven, K.: A manifesto for the equifinality thesis, J. Hydrol., 320, 18-36, https://doi.org/10.1016/j.jhydrol.2005.07.007, 2006.
Beven, K.: Towards a methodology for testing models as hypotheses in the inexact sciences, Philos. T. R. Soc. A, 475, 20180862, https://doi.org/10.1098/rspa.2018.0862, 2019.
Beven, K. and Binley, A.: The future of distributed models: Model calibration and uncertainty prediction, Hydrol. Process., 6, 279- 298, https://doi.org/10.1002/hyp.3360060305, 1992.
Beven, K. J.: Uniqueness of place and process representations in hydrological modelling, Hydrol. Earth Syst. Sci., 4, 203-213, https://doi.org/10.5194/hess-4-203-2000, 2000.
Beven, K. J. and Kirkby, M. J.: A physically based, variable contributing area model of basin hydrology, Hydrol. Sci. B., 24, 43- 69, https://doi.org/10.1080/02626667909491834, 1979.
Blazkova, S., Beven, K. J., and Kulasova, A.: On constraining TOPMODEL hydrograph simulations using partial saturated area information, Hydrol. Process., 16, 441-458, https://doi.org/10.1002/hyp.331, 2002.
Bonin, J. and Chambers, D.: Uncertainty estimates of a GRACE inversion modelling technique over greenland using a simulation, Geophys. J. Int., 194, 212-229, https://doi.org/10.1093/gji/ggt091, 2013.
Bouaziz, L., Weerts, A., Schellekens, J., Sprokkereef, E., Stam, J., Savenije, H., and Hrachowitz, M.: Redressing the balance: quantifying net intercatchment groundwater flows, Hydrol. Earth Syst. Sci., 22, 6415-6434, https://doi.org/10.5194/hess-22-6415- 2018, 2018.
Bouaziz, L., Fenicia, F., Thirel, G., de Boer-Euser, T., Buitink, J., Brauer, C., De Niel, J., Dewals, B., Drogue, G., Grelier, B., Melsen, L., Moustakas, S., Nossent, J., Pereira, F., Sprokkereef, E., Stam, J., Weerts, A., Willems, P., Savenije, H., and Hrachowitz, M.: Data underlying the research of: Behind the scenes of streamflow model performance, (Bouaziz et al. 2021, HESS), 4TU. ResearchData, https://doi.org/10.4121/13221038.v1, 2021.
Bouaziz, L. J., Steele-Dunne, S. C., Schellekens, J., Weerts, A. H., Stam, J., Sprokkereef, E., Winsemius, H. H., Savenije, H. H., and Hrachowitz, M.: Improved understanding of the link between catchment-scale vegetation accessible storage and satellite-derived Soil Water Index, Water Resour. Res., 56, e2019WR026365, https://doi.org/10.1029/2019WR026365, 2020.
Brauer, C. C., Teuling, A. J., Torfs, P. J. J. F., and Uijlenhoet, R.: The Wageningen Lowland Runoff Simulator (WALRUS): a lumped rainfall-runoff model for catchments with shallow groundwater, Geosci. Model Dev., 7, 2313-2332, https://doi.org/10.5194/gmd- 7-2313-2014, 2014a.
Brauer, C. C., Torfs, P. J. J. F., Teuling, A. J., and Uijlenhoet, R.: The Wageningen Lowland Runoff Simulator (WALRUS): application to the Hupsel Brook catchment and the Cabauw polder, Hydrol. Earth Syst. Sci., 18, 4007-4028, https://doi.org/10.5194/hess-18- 4007-2014, 2014b.
Brocca, L., Melone, F., Moramarco, T., Wagner, W., and Hasenauer, S.: ASCAT soil wetness index validation through in situ and modeled soil moisture data in central Italy, Remote Sens. Environ., 114, 2745-2755, https://doi.org/10.1016/j.rse.2010.06.009, 2010.
Buitink, J., Melsen, L. A., Kirchner, J. W., and Teuling, A. J.: A distributed simple dynamical systems approach (dS2 v1.0) for computationally efficient hydrological modelling at high spatio-temporal resolution, Geosci. Model Dev., 13, 6093-6110, https://doi.org/10.5194/gmd-13-6093-2020, 2020.
Burt, T. P. and McDonnell, J. J.: Whither Field Hydrology?, Water Resour. Res., 51, 5919-5928, https://doi.org/10.1002/2014WR016839, 2015.
Ceola, S., Arheimer, B., Baratti, E., Blöschl, G., Capell, R., Castellarin, A., Freer, J., Han, D., Hrachowitz, M., Hundecha, Y., Hutton, C., Lindström, G., Montanari, A., Nijzink, R., Parajka, J., Toth, E., Viglione, A., andWagener, T.: Virtual laboratories: new opportunities for collaborative water science, Hydrol. Earth Syst. Sci., 19, 2101-2117, https://doi.org/10.5194/hess-19-2101-2015, 2015.
Cisneros Vaca, C., van der Tol, C., and Ghimire, C. P.: The influence of long-term changes in canopy structure on rainfall interception loss: a case study in Speulderbos, the Netherlands, Hydrol. Earth Syst. Sci., 22, 3701-3719, https://doi.org/10.5194/hess-22-3701- 2018, 2018.
Clark, M. P., Slater, A. G., Rupp, D. E., Woods, R. A., Vrugt, J. A., Gupta, H. V., Wagener, T., and Hay, L. E.: Framework for Understanding Structural Errors (FUSE): A modular framework to diagnose differences between hydrological models, Water Resour. Res., 44, 1-14, https://doi.org/10.1029/2007wr006735, 2008.
Clark, M. P., Nijssen, B., Lundquist, J. D., Kavetski, D., Rupp, D. E., Woods, R. A., Freer, J. E., Gutmann, E. D., Wood, A. W., Brekke, L. D., Arnold, J. R., Gochis, D. J., and Rasmussen, R. M.: A unified approach for process-based hydrologicmodeling: 1. Modeling concept, Water Resour. Res., 51, 1-17, https://doi.org/10.1002/2015WR017200, 2015.
Clark, M. P., Schaefli, B., Schymanski, S. J., Samaniego, L., Luce, C. H., Jackson, B. M., Freer, J. E., Arnold, J. R., Moore, R. D., Istanbulluoglu, E., and Ceola, S.: Improving the theoretical underpinnings of process-based hydrologic models, Water Resour. Res., 52, 2350-2365, https://doi.org/10.1002/2015WR017910, 2016.
Coenders-Gerrits, A. M., Van Der Ent, R. J., Bogaard, T. A., Wang-Erlandsson, L., Hrachowitz, M., and Savenije, H. H.: Uncertainties in transpiration estimates, Nature, 506, 2013-2015, https://doi.org/10.1038/nature12925, 2014.
Copernicus Global Land Service: Soil Water Index, available at: https://land.copernicus.eu/global/products/swi, last access: 4 January 2019.
Cornes, R., van der Schrier, G., van den Besselaar, E. J. M., and Jones, P. D.: An Ensemble Version of the E-OBS Temperature and Precipitation Datasets, J. Geophys. Res.-Atmos., 123, 9391- 9409, https://doi.org/10.1029/2017JD028200, 2018.
Coron, L., Thirel, G., Delaigue, O., Perrin, C., and Andréassian, V.: The suite of lumped GR hydrological models in an R package, Environ. Model. Softw., 94, 166-171, https://doi.org/10.1016/j.envsoft.2017.05.002, 2017.
Coron, L., Perrin, C., Delaigue, O., Thirel, G., and Michel, C.: airGR: Suite of GR Hydrological Models for Precipitation- Runoff Modelling, R package version 1.0.10.11, Portail Data INRAE, https://doi.org/10.15454/EX11NA, 2019.
de Boer-Euser, T.: Added value of distribution in rainfall-runoff models for the Meuse Basin, PhD thesis, Delft University of Technology, https://doi.org/10.4233/uuid:89a78ae9-7ffb- 4260-b25d-698854210fa8, 2017.
de Boer-Euser, T., Bouaziz, L., De Niel, J., Brauer, C., Dewals, B., Drogue, G., Fenicia, F., Grelier, B., Nossent, J., Pereira, F., Savenije, H., Thirel, G., and Willems, P.: Looking beyond general metrics for model comparison - lessons from an international model intercomparison study, Hydrol. Earth Syst. Sci., 21, 423-440, https://doi.org/10.5194/hess-21-423-2017, 2017.
de Niel, J., van Uytven, E., and Willems, P.: Uncertainty Analysis of Climate Change Impact on River Flow Extremes Based on a Large Multi-Model Ensemble, Water Resour. Manage., 33, 4319-4333, https://doi.org/10.1007/s11269-019-02370-0, 2019.
de Wit, M. J., van den Hurk, B., Warmerdam, P. M., Torfs, P. J., Roulin, E., and Van Deursen, W. P.: Impact of climate change on low-flows in the river Meuse, Climatic Change, 82, 351-372, https://doi.org/10.1007/s10584-006-9195-2, 2007.
Dembélé, M., Hrachowitz, M., Savenije, H. H., Mariéthoz, G., and Schaefli, B.: Improving the Predictive Skill of a Distributed Hydrological Model by Calibration on Spatial Patterns With Multiple Satellite Data Sets, Water Resour. Res., 56, e2019WR026085, https://doi.org/10.1029/2019WR026085, 2020.
Demirel, M. C., Mai, J., Mendiguren, G., Koch, J., Samaniego, L., and Stisen, S.: Combining satellite data and appropriate objective functions for improved spatial pattern performance of a distributed hydrologic model, Hydrol. Earth Syst. Sci., 22, 1299- 1315, https://doi.org/10.5194/hess-22-1299-2018, 2018.
Didan, K.: MOD13A1 MODIS/Terra Vegetation Indices 16-Day L3 Global 500m SIN Grid V006, [NDVI], NASA EOSDIS Land Processes DAAC, https://doi.org/10.5067/MODIS/MOD13A1.006, 2015a.
Didan, K.: MYD13A1 MODIS/Aqua Vegetation Indices 16-day L3 Global 500m SIN Grid V006, [NDVI], NASA EOSDIS Land Processes DAAC, https://doi.org/10.5067/MODIS/MYD13A1.006, 2015b.
Duan, Q., Schaake, J., Andréassian, V., Franks, S., Goteti, G., Gupta, H. V., Gusev, Y. M., Habets, F., Hall, A., Hay, L., Hogue, T., Huang, M., Leavesley, G., Liang, X., Nasonova, O. N., Noilhan, J., Oudin, L., Sorooshian, S., Wagener, T., and Wood, E. F.: Model Parameter Estimation Experiment (MOPEX): An overview of science strategy and major results from the second and third workshops, J. Hydrol., 320, 3-17, https://doi.org/10.1016/j.jhydrol.2005.07.031, 2006.
European Environment Agency: Corine Land Cover (CLC) 2000 data, available at: http://www.eea.europa.eu/data-and-maps/ data/clc-2000-raster-3 (last access: 21 September 2015), 2000.
Feddes, R. A.: Simulation of field water use and crop yield, in: Simulation of plant growth and crop production, edited by: Penning de Vries, F. W. T. and van Laar, H. H., Simulation monographs, Pudoc., 194-209, https://edepot.wur.nl/172222 (last access: 17 February 2021), 1982.
Fenicia, F., McDonnell, J. J., and Savenije, H. H. G.: Learning from model improvement: On the contribution of complementary data to process understanding, Water Resour. Res., 44, 1-13, https://doi.org/10.1029/2007WR006386, 2008.
Fenicia, F., Kavetski, D., and Savenije, H. H. G.: Elements of a flexible approach for conceptual hydrological modeling: 1. Motivation and theoretical development, Water Resour. Res., 47, 1-13, https://doi.org/10.1029/2010WR010174, 2011.
Fenicia, F., Kavetski, D., Savenije, H. H. G., Clark, M. P., Schoups, G., Pfister, L., and Freer, J.: Catchment properties, function, and conceptual model representation: Is there a correspondence?, Hydrol. Process., 28, 2451-2467, https://doi.org/10.1002/hyp.9726, 2014.
Fenicia, F., Kavetski, D., Savenije, H. H., and Pfister, L.: From spatially variable streamflow to distributed hydrological models: Analysis of key modeling decisions, Water Resour. Res. 52, 954- 989, https://doi.org/10.1002/2015WR017398, 2016.
Ficchì, A., Perrin, C., and Andréassian, V.: Hydrological modelling at multiple sub-daily time steps: Model improvement via flux-matching, J. Hydrol., 575, 1308-1327, https://doi.org/10.1016/j.jhydrol.2019.05.084, 2019.
Franks, S. W., Gineste, P., Beven, K. J., and Merot, P.: On constraining the predictions of a distributed model: The incorporation of fuzzy estimates of saturated areas into the calibration process, Water Resour. Res., 34, 787-797, https://doi.org/10.1029/97WR03041, 1998.
Gao, H., Ding, Y., Zhao, Q., Hrachowitz, M., and Savenije, H. H.: The importance of aspect for modelling the hydrological response in a glacier catchment in Central Asia, Hydrol. Process., 31, 2842-2859, https://doi.org/10.1002/hyp.11224, 2017.
Gash, J. H., Wright, I. R., and Lloyd, C. R.: Comparative estimates of interception loss from three coniferous forests in Great Britain, J. Hydrol., 48, 89-105, https://doi.org/10.1016/0022- 1694(80)90068-2, 1980.
Gharari, S., Hrachowitz, M., Fenicia, F., Gao, H., and Savenije, H. H. G.: Using expert knowledge to increase realism in environmental system models can dramatically reduce the need for calibration, Hydrol. Earth Syst. Sci., 18, 4839-4859, https://doi.org/10.5194/hess-18-4839-2014, 2014.
Global Land Evaporation Amsterdam Model (GLEAM): Evaporation estimates from satellite observations, available at: https: //www.gleam.eu/, last access: 23 February 2021.
Güntner, A., Uhlenbrook, S., Seibert, J., and Leibundgut, C.: Multi-criterial validation of TOPMODEL in a mountainous catchment, Hydrol. Process., 13, 1603-1620, https://doi.org/10.1002/(SICI)1099- 1085(19990815)13:11<1603::AID-HYP830>3.0.CO;2-K, 1999.
Gupta, H. V. and Nearing, G. S.: Debates - The future of hydrological sciences: A (common) path forward? Using models and data to learn: A systems theoretic perspective on the future of hydrological science, Water Resour. Res., 50, 5351-5359, https://doi.org/10.1002/2013WR015096, 2014.
Gupta, H. V., Wagener, T., and Liu, Y.: Reconciling theory with observations: Elements of a diagnostic approach to model evaluation, Hydrol. Process., 22, 3802-3813, https://doi.org/10.1002/hyp.6989, 2008.
Gupta, H. V., Cark, M. P., Vrugt, J. A., Abramowitz, G., and Ye, M.: Towards a comprehensive assessment of model structural adequacy, Water Resour. Res., 48, 1-16, https://doi.org/10.1029/2011WR011044, 2012.
Haddeland, I., Clark, D. B., Franssen, W., Ludwig, F., Voß, F., Arnell, N. W., Bertrand, N., Best, M., Folwell, S., Gerten, D., Gomes, S., Gosling, S. N., Hagemann, S., Hanasaki, N., Harding, R., Heinke, J., Kabat, P., Koirala, S., Oki, T., Polcher, J., Stacke, T., Viterbo, P., Weedon, G. P., and Yeh, P.: Multimodel estimate of the global terrestrial water balance: Setup and first results, J. Hydrometeorol., 12, 869-884, https://doi.org/10.1175/2011JHM1324.1, 2011.
Hagemann, S., Chen, C., Clark, D. B., Folwell, S., Gosling, S. N., Haddeland, I., Hanasaki, N., Heinke, J., Ludwig, F., Voss, F., and Wiltshire, A. J.: Climate change impact on available water resources obtained using multiple global climate and hydrology models, Earth Syst. Dynam., 4, 129-144, https://doi.org/10.5194/esd-4-129-2013, 2013.
Hall, D. K. and Riggs, G. A.: Accuracy assessment of the MODIS snow products, Hydrol. Process., 21, 1534-1547, https://doi.org/10.1002/hyp.6715, 2007.
Hall, D. K. and Riggs, G. A.: MOD10A1/MODIS/Terra Snow Cover Daily L3 Global 500m SIN Grid, Version 6, [NDSI], Boulder, Colorado USA, NASA National Snow and Ice Data Center Distributed Active Archive Center, https://doi.org/10.5067/MODIS/MOD10A1.006, 2016a.
Hall, D. K. and Riggs, G. A.: MYD10A1 MODIS/Aqua Snow Cover Daily L3 Global 500m SIN Grid, Version 6, [NDSI], Boulder, Colorado USA. NASA National Snow and Ice Data Center Distributed Active Archive Center, https://doi.org/10.5067/MODIS/MYD10A1.006, 2016b.
Hargreaves, G. H. and Samani, Z. A.: Reference Crop Evapotranspiration from Temperature, Appl. Eng. Agric., 1, 96-99, https://doi.org/10.13031/2013.26773, 1985.
Haylock, M. R., Hofstra, N., Klein Tank, A. M., Klok, E. J., Jones, P. D., and New, M.: A European daily highresolution gridded data set of surface temperature and precipitation for 1950-2006, J. Geophys. Res.-Atmos., 113, D20119, https://doi.org/10.1029/2008JD010201, 2008.
Holländer, H. M., Blume, T., Bormann, H., Buytaert, W., Chirico, G. B., Exbrayat, J.-F., Gustafsson, D., Hölzel, H., Kraft, P., Stamm, C., Stoll, S., Blöschl, G., and Flühler, H.: Comparative predictions of discharge from an artificial catchment (Chicken Creek) using sparse data, Hydrol. Earth Syst. Sci., 13, 2069- 2094, https://doi.org/10.5194/hess-13-2069-2009, 2009.
Hrachowitz, M. and Clark, M. P.: HESS Opinions: The complementary merits of competing modelling philosophies in hydrology, Hydrol. Earth Syst. Sci., 21, 3953-3973, https://doi.org/10.5194/hess-21-3953-2017, 2017.
Hrachowitz, M., Fovet, O., Ruiz, L., Euser, T., Gharari, S., Nijzink, R., Freer, J., Savenije, H. H., and Gascuel-Odoux, C.: Process consistency in models: The importance of system signatures, expert knowledge, and process complexity, Water Resour. Res., 50, 7445-7469, https://doi.org/10.1002/2014WR015484, 2014.
Hulsman, P., Winsemius, H. C., Michailovsky, C. I., Savenije, H. H. G., and Hrachowitz, M.: Using altimetry observations combined with GRACE to select parameter sets of a hydrological model in a data-scarce region, Hydrol. Earth Syst. Sci., 24, 3331-3359, https://doi.org/10.5194/hess-24-3331-2020, 2020.
Jakeman, A. J. and Hornberger, G. M.: How much complexity is warranted in a rainfall-runoff model?, Water Resour. Res., 29, 2637-2649, https://doi.org/10.1029/93WR00877, 1993.
Kirchner, J. W.: Getting the right answers for the right reasons: Linking measurements, analyses, and models to advance the science of hydrology, Water Resour. Res., 42, 1-5, https://doi.org/10.1029/2005WR004362, 2006.
Knoben, W. J. M., Freer, J. E., Peel, M. C., Fowler, K. J. A., and Woods, R. A.: A brief analysis of conceptual model structure uncertainty using 36 models and 559 catchments, Water Resour. Res., 56, e2019WR025975, https://doi.org/10.1029/2019WR025975, 2020.
Koch, J., Cornelissen, T., Fang, Z., Bogena, H., Diekkrüger, B., Kollet, S., and Stisen, S.: Inter-comparison of three distributed hydrological models with respect to seasonal variability of soil moisture patterns at a small forested catchment, J. Hydrol., 533, 234-249, https://doi.org/10.1016/j.jhydrol.2015.12.002, 2016.
Koch, J., Demirel, M. C., and Stisen, S.: The SPAtial EFficiency metric (SPAEF): multiple-component evaluation of spatial patterns for optimization of hydrological models, Geosci. Model Dev., 11, 1873-1886, https://doi.org/10.5194/gmd-11- 1873-2018, 2018.
Kunnath-Poovakka, A., Ryu, D., Renzullo, L. J., and George, B.: The efficacy of calibrating hydrologic model using remotely sensed evapotranspiration and soil moisture for streamflow prediction, J. Hydrol., 535, 509-524, https://doi.org/10.1016/j.jhydrol.2016.02.018, 2016.
Lamb, R., Beven, K., and Myrabø, S.: Use of spatially distributed water table observations to constrain uncertainty in a rainfall-runoff model, Adv. Water Resour., 22, 305-317, https://doi.org/10.1016/S0309-1708(98)00020-7, 1998.
Landerer, F. W. and Swenson, S. C.: Accuracy of scaled GRACE terrestrial water storage estimates, Water Resour. Res., 48, 1-11, https://doi.org/10.1029/2011WR011453, 2012.
Lang, C., Freyermuth, A., Gille, E., and François, D.: Le dispositif PRESAGES (PREvisions et Simulations pour l'Annonce et la Gestion des Etiages Sévères) : des outils pour évaluer et prévoir les étiages, Geocarrefour, 81, 15-24, https://doi.org/10.4000/geocarrefour.1715, 2006 (in French).
Lindström, G., Johansson, B., Persson, M., Gardelin, M., and Bergström, S.: Development and test of the distributed HBV-96 hydrological model, J. Hydrol., 201, 272-288, https://doi.org/10.1016/S0022-1694(97)00041-3, 1997.
Livneh, B. and Lettenmaier, D. P.: Multi-criteria parameter estimation for the Unified Land Model, Hydrol. Earth Syst. Sci., 16, 3029-3048, https://doi.org/10.5194/hess-16-3029-2012, 2012.
López López, P., Sutanudjaja, E. H., Schellekens, J., Sterk, G., and Bierkens, M. F. P.: Calibration of a large-scale hydrological model using satellite-based soil moisture and evapotranspiration products, Hydrol. Earth Syst. Sci., 21, 3125-3144, https://doi.org/10.5194/hess-21-3125-2017, 2017.
Martens, B., Miralles, D. G., Lievens, H., van der Schalie, R., de Jeu, R. A. M., Fernández-Prieto, D., Beck, H. E., Dorigo, W. A., and Verhoest, N. E. C.: GLEAM v3: satellite-based land evaporation and root-zone soil moisture, Geosci. Model Dev., 10, 1903- 1925, https://doi.org/10.5194/gmd-10-1903-2017, 2017.
Mathevet, T.: Which rainfall-runoff model at the hourly time-step? Empirical development and intercomparison of rainfall runoff model on a large sample of watersheds, PhD thesis, ENGREF University, Paris, France, 2005.
McCabe, M. F., Rodell, M., Alsdorf, D. E., Miralles, D. G., Uijlenhoet, R., Wagner, W., Lucieer, A., Houborg, R., Verhoest, N. E. C., Franz, T. E., Shi, J., Gao, H., and Wood, E. F.: The future of Earth observation in hydrology, Hydrol. Earth Syst. Sci., 21, 3879-3914, https://doi.org/10.5194/hess-21-3879-2017, 2017.
Melsen, L. A. and Guse, B.: Hydrological Drought Simulations: How Climate and Model Structure Control Parameter Sensitivity, Water Resour. Res., 55, 10527-10547, https://doi.org/10.1029/2019WR025230, 2019.
Melsen, L. A., Addor, N., Mizukami, N., Newman, A. J., Torfs, P. J. J. F., Clark, M. P., Uijlenhoet, R., and Teuling, A. J.: Mapping (dis)agreement in hydrologic projections, Hydrol. Earth Syst. Sci., 22, 1775-1791, https://doi.org/10.5194/hess-22-1775-2018, 2018.
Melsen, L. A., Teuling, A. J., Torfs, P. J., Zappa, M., Mizukami, N., Mendoza, P. A., Clark, M. P., and Uijlenhoet, R.: Subjec- tive modeling decisions can significantly impact the simulation of flood and drought events, J. Hydrol., 568, 1093-1104, https://doi.org/10.1016/j.jhydrol.2018.11.046, 2019.
Mianabadi, A., Coenders-Gerrits, M., Shirazi, P., Ghahraman, B., and Alizadeh, A.: A global Budyko model to partition evaporation into interception and transpiration, Hydrol. Earth Syst. Sci., 23, 4983-5000, https://doi.org/10.5194/hess-23-4983-2019, 2019.
Miralles, D. G., Holmes, T. R. H., De Jeu, R. A. M., Gash, J. H., Meesters, A. G. C. A., and Dolman, A. J.: Global land-surface evaporation estimated from satellite-based observations, Hydrol. Earth Syst. Sci., 15, 453-469, https://doi.org/10.5194/hess-15- 453-2011, 2011.
Miralles, D. G., Jiménez, C., Jung, M., Michel, D., Ershadi, A., Mc- Cabe, M. F., Hirschi, M., Martens, B., Dolman, A. J., Fisher, J. B., Mu, Q., Seneviratne, S. I., Wood, E. F., and Fernández-Prieto, D.: The WACMOS-ET project - Part 2: Evaluation of global terrestrial evaporation data sets, Hydrol. Earth Syst. Sci., 20, 823- 842, https://doi.org/10.5194/hess-20-823-2016, 2016.
NASA's MEaSUREs Program: GRACE Tellus monthly mass grids - land, available at: http://grace.jpl.nasa.gov, last access: 23 February 2021.
Nielsen, S. and Hansen, E.: Numerical simulation of the rainfall runoff process on a daily basis, Nord. Hydrol., 4, 171-190, 1973.
Nijzink, R. C., Almeida, S., Pechlivanidis, I. G., Capell, R., Gustafssons, D., Arheimer, B., Parajka, J., Freer, J., Han, D., Wagener, T., van Nooijen, R. R., Savenije, H. H., and Hrachowitz, M.: Constraining Conceptual Hydrological Models With Multiple Information Sources, Water Resour. Res., 54, 8332-8362, https://doi.org/10.1029/2017WR021895, 2018.
Orth, R., Staudinger, M., Seneviratne, S. I., Seibert, J., and Zappa, M.: Does model performance improve with complexity? A case study with three hydrological models, J. Hydrol., 523, 147-159, https://doi.org/10.1016/j.jhydrol.2015.01.044, 2015.
Oudin, L., Hervieu, F., Michel, C., Perrin, C., Andréassian, V., Anctil, F., and Loumagne, C.: Which potential evapotranspiration input for a lumped rainfall-runoff model? Part 2 - Towards a simple and efficient potential evapotranspiration model for rainfall-runoff modelling, J. Hydrol., 303, 290-306, https://doi.org/10.1016/j.jhydrol.2004.08.026, 2005.
Parajka, J. and Blöschl, G.: Validation of MODIS snow cover images over Austria, Hydrol. Earth Syst. Sci., 10, 679-689, https://doi.org/10.5194/hess-10-679-2006, 2006.
Perrin, C., Michel, C., and Andréassian, V.: Does a large number of parameters enhance model performance? Comparative assessment of common catchment model structures on 429 catchments, J. Hydrol., 242, 275-301, https://doi.org/10.1016/S0022- 1694(00)00393-0, 2001.
Priestley, C. H. B. and Taylor, R. J.: On the Assessment of Surface Heat Flux and Evaporation Using Large-Scale Parameters, Mon. Weather Rev., 100, 81-92, https://doi.org/10.1175/1520- 0493(1972)100<0081:otaosh>2.3.co;2, 1972.
Rakovec, O., Kumar, R., Attinger, S., and Samaniego, L.: Improving the realism of hydrologic model functioning through multivariate parameter estimation, Water Resour. Res., 52, 7779-7792, https://doi.org/10.1002/2016WR019430, 2016a.
Rakovec, O., Kumar, R., Mai, J., Cuntz, M., Thober, S., Zink, M., Attinger, S., Schãfer, D., Schrön, M., and Samaniego, L.: Multiscale and multivariate evaluation of water fluxes and states over european river Basins, J. Hydrometeorol., 17, 287-307, https://doi.org/10.1175/JHM-D-15-0054.1, 2016b.
Reed, S., Koren, V., Smith, M., Zhang, Z., Moreda, F., and Seo, D. J.: Overall distributed model intercomparison project results, J. Hydrol., 298, 27-60, https://doi.org/10.1016/j.jhydrol.2004.03.031, 2004.
Riboust, P., Thirel, G., Moine, N. L., and Ribstein, P.: Revisiting a simple degree-day model for integrating satellite data: implementation of swe-sca hystereses, J. Hydrol. Hydromech., 67, 70- 81, https://doi.org/10.2478/johh-2018-0004, 2019.
Royal Meteorological Institute Belgium: Klimaatatlas, gemiddeld aantal dagen met sneeuw, available at: https://www.meteo.be/ nl/klimaat/klimaatatlas/klimaatkaarten/sneeuw, last access: 26 March 2020, (in Dutch) 2015.
Royal Netherlands Meteorological Institute (KNMI): Uurgegevens van het weer in Nederland [hourly data of the weather in the Netherlands], available at: http://www.knmi.nl/nederland-nu/ klimatologie/uurgegevens, last access: 30 April 2018 (in Dutch).
Samaniego, L., Kumar, R., and Attinger, S.: Multiscale parameter regionalization of a grid-based hydrologic model at the mesoscale, Water Resour. Res., 46, 1-25, https://doi.org/10.1029/2008WR007327, 2010.
Savenije, H. H. G.: HESS Opinions "Topography driven conceptual modelling (FLEX-Topo)", Hydrol. Earth Syst. Sci., 14, 2681- 2692, https://doi.org/10.5194/hess-14-2681-2010, 2010.
Schellekens, J., Scatena, F. N., Bruijnzeel, L. A., and Wickel, A. J.: Modelling rainfall interception by a lowland tropical rain forest in northeastern Puerto Rico, J. Hydrol., 225, 168-184, https://doi.org/10.1016/S0022-1694(99)00157-2, 1999.
Schewe, J., Heinke, J., Gerten, D., Haddeland, I., Arnell, N. W., Clark, D. B., Dankers, R., Eisner, S., Fekete, B. M., Colón- González, F. J., Gosling, S. N., Kim, H., Liu, X., Masaki, Y., Portmann, F. T., Satoh, Y., Stacke, T., Tang, Q., Wada, Y., Wisser, D., Albrecht, T., Frieler, K., Piontek, F., Warszawski, L., and Kabat, P.: Multimodel assessment of water scarcity under climate change, P. Natl. Acad. Sci. USA, 111, 3245-3250, https://doi.org/10.1073/pnas.1222460110, 2014.
Seibert, J., Bishop, K. H., and Nyberg, L.: A test of TOPMODEL'a ability to predict spatially distributed groundwater levels, Hydrol. Process., 11, 1131-1144, 1997.
Service Public de Wallonie: Direction générale opérationnelle de la Mobilité et des Voies hydrauliques, Département des Etudes et de l'Appui à la Gestion, Direction de la Gestion hydrologique intégrée (Bld du Nord 8-5000 Namur, Belgium), 2018 (in French).
Sheffield, J., Wood, E. F., Pan, M., Beck, H., Coccia, G., Serrat- Capdevila, A., and Verbist, K.: Satellite Remote Sensing forWater Resources Management: Potential for Supporting Sustainable Development in Data-Poor Regions, Water Resour. Res., 54, 9724-9758, https://doi.org/10.1029/2017WR022437, 2018.
Smith, M. B., Koren, V., Reed, S., Zhang, Z., Zhang, Y., Moreda, F., Cui, Z., Mizukami, N., Anderson, E. A., and Cosgrove, B. A.: The distributed model intercomparison project - Phase 2 : Motivation and design of the Oklahoma experiments, J. Hydrol., 418- 419, 3-16, https://doi.org/10.1016/j.jhydrol.2011.08.055, 2012a.
Smith, M. B., Koren, V., Zhang, Z., Zhang, Y., Reed, S. M., Cui, Z., Moreda, F., Cosgrove, B. A., Mizukami, N., Anderson, E. A., and Participants, D.: Results of the DMIP 2 Oklahoma experiments, J. Hydrol., 418-419, 17-48, https://doi.org/10.1016/j.jhydrol.2011.08.056, 2012b.
Stisen, S., Koch, J., Sonnenborg, T. O., Refsgaard, J. C., Bircher, S., Ringgaard, R., and Jensen, K. H.: Moving beyond run-off calibration-Multivariable optimization of a surface- subsurface-atmosphere model, Hydrol. Process., 32, 2654-2668, https://doi.org/10.1002/hyp.13177, 2018.
Sutanudjaja, E. H., Van Beek, L. P., De Jong, S. M., Van Geer, F. C., and Bierkens, M. F.: Calibrating a large-extent highresolution coupled groundwater-land surface model using soil moisture and discharge data, Water Resour. Res., 50, 687-705, https://doi.org/10.1002/2013WR013807, 2014.
Swenson, S.: GRACE monthly land water mass grids NETCDF RELEASE 5.0. Ver. 5.0. PO.DAAC, CA, USA, https://doi.org/10.5067/TELND-NC005, 2012.
Swenson, S. and Wahr, J.: Post-processing removal of correlated errors in GRACE data, Geophys. Res. Lett., 33, 1-4, https://doi.org/10.1029/2005GL025285, 2006.
Thirel, G., Delaigue, O., and Ficchi, A.: Latest developments of the airGR rainfall-runoff modelling R-package: inclusion of an interception store in the hourly model, EGU General Assembly 2020, Online, 4-8 May 2020, EGU2020-15275, https://doi.org/10.5194/egusphere-egu2020-15275, 2020
Valéry, A., Andréassian, V., and Perrin, C.: 'As simple as possible but not simpler': What is useful in a temperature-based snow-accounting routine? Part 2 - Sensitivity analysis of the Cemaneige snow accounting routine on 380 catchments, J. Hydrol., 517, 1176-1187, https://doi.org/10.1016/j.jhydrol.2014.04.058, 2014.
van Dijk, A. I. J. M.: Climate and terrain factors explaining streamflow response and recession in Australian catchments, Hydrol. Earth Syst. Sci., 14, 159-169, https://doi.org/10.5194/hess-14- 159-2010, 2010.
van Emmerik, T., Mulder, G., Eilander, D., Piet, M., and Savenije, H.: Predicting the ungauged basin: Model validation and realism assessment, Front. Earth Sci., 3, 1-11, https://doi.org/10.3389/feart.2015.00062, 2015.
van Emmerik, T., Popp, A., Solcerova, A., Müller, H., and Hut, R.: Reporting negative results to stimulate experimental hydrology: discussion of "The role of experimental work in hydrological sciences-insights from a community survey", Hydrolog. Sci. J., 63, 1269-1272, https://doi.org/10.1080/02626667.2018.1493203, 2018.
Veldkamp, T. I., Zhao, F., Ward, P. J., De Moel, H., Aerts, J. C., Schmied, H. M., Portmann, F. T., Masaki, Y., Pokhrel, Y., Liu, X., Satoh, Y., Gerten, D., Gosling, S. N., Zaherpour, J., andWada, Y.: Human impact parameterizations in global hydrological models improve estimates of monthly discharges and hydrological extremes: A multi-model validation study, Environ. Res. Lett., 13, 055008, https://doi.org/10.1088/1748-9326/aab96f, 2018.
Vidon, P. G.: Field hydrologists needed: A call for young hydrologists to (re)-focus on field studies, Hydrol. Process., 29, 5478- 5480, https://doi.org/10.1002/hyp.10614, 2015.
Wagner, W., Lemoine, G., and Rott, H.: A method for estimating soil moisture from ERS Scatterometer and soil data, Remote Sens. Environ., 70, 191-207, https://doi.org/10.1016/S0034- 4257(99)00036-X, 1999.
Wagner, W., Hahn, S., Kidd, R., Melzer, T., Bartalis, Z., Hasenauer, S., Figa-Saldaña, J., De Rosnay, P., Jann, A., Schneider, S., Komma, J., Kubu, G., Brugger, K., Aubrecht, C., Züger, J., Gangkofner, U., Kienberger, S., Brocca, L., Wang, Y., Blöschl, G., Eitzinger, J., Steinnocher, K., Zeil, P., and Rubel, F.: The ASCAT soil moisture product: A review of its specifications, validation results, and emerging applications, Meteorol. Z., 22, 5-33, https://doi.org/10.1127/0941-2948/2013/0399, 2013.
Werth, S. and Güntner, A.: Calibration analysis for water storage variability of the global hydrological model WGHM, Hydrol. Earth Syst. Sci., 14, 59-78, https://doi.org/10.5194/hess-14-59- 2010, 2010.
Westerberg, I. K., Wagener, T., Coxon, G., McMillan, H. K., Castellarin, A., Montanari, A., and Freer, J.: Uncertainty in hydrological signatures for gauged and ungauged catchments, Water Resour. Res., 52, 1847-1865, https://doi.org/10.1002/2015WR017635, 2016.
Willems, P.: Parsimonious rainfall-runoff model construction supported by time series processing and validation of hydrological extremes - Part 1: Step-wise model-structure identification and calibration approach, J. Hydrol., 510, 578-590, https://doi.org/10.1016/j.jhydrol.2014.01.017, 2014.
Winsemius, H. C., Savenije, H. H. G., Gerrits, A. M. J., Zapreeva, E. A., and Klees, R.: Comparison of two model approaches in the Zambezi river basin with regard to model reliability and identifiability, Hydrol. Earth Syst. Sci., 10, 339-352, https://doi.org/10.5194/hess-10-339-2006, 2006.
Yassin, F., Razavi, S., Wheater, H., Sapriza-Azuri, G., Davison, B., and Pietroniro, A.: Enhanced identification of a hydrologic model using streamflow and satellite water storage data: A multicriteria sensitivity analysis and optimization approach, Hydrol. Process., 31, 3320-3333, https://doi.org/10.1002/hyp.11267, 2017.
Zhong, F., Martens, B., van Dijk, A., Ren, L., Jiang, S., and Miralles, D. G.: Global estimates of rainfall interception loss from satellite observations: recent advances in GLEAM, EGU General Assembly 2020, Online, 4-8 May 2020, EGU2020-13975, https://doi.org/10.5194/egusphere-egu2020-13975, 2020
