Identifying critical climate conditions for use in scenario-neutral climate impact assessments

https://doi.org/10.1016/j.envsoft.2020.104948Get rights and content

Key points

  • It is critical that scenario-neutral assessments consider climate conditions to which system performance is most sensitive.

  • A generic approach is presented to enable such critical conditions to be identified and applied to a reservoir case study.

  • Results demonstrate the utility of the approach as different attributes are critical for different objectives.

Abstract

Scenario-neutral climate impact assessments are being used increasingly to assess water resource system responses to possible climate changes. The purpose of such assessments is to identify system sensitivity to a range of plausible climate conditions, often including an evaluation of the joint effect of multiple climate stressors. Given the large number of climate variables and associated statistics (averages, seasonality, intermittency, extremes, etc.) that could plausibly change and impact on system performance, it is essential that scenario-neutral assessments focus on those to which the system is most sensitive. A generic approach to identifying these ‘critical’ climate conditions is presented and tested on the Lake Como reservoir in Northern Italy considering two system objectives: irrigation deficit and flood reliability. Results indicate that different climate conditions are critical for the two objectives, and that the choice of which climate conditions to include has a significant effect on the climate impact assessment outcome.

Introduction

Climate change can impact water resource systems through stresses to both supply and demand (IPCC, 2014). These stresses are the result of changes to atmospheric variables such as precipitation, temperature and evapotranspiration, which influence water resource systems via a complex set of catchment-scale and system-level processes that in turn are dependent on the system's geography, configuration, operation and performance measures. Understanding the possible impacts of climate change on water resource systems therefore requires mapping changes in large-scale climate processes to changes in system performance, accounting for the unique features of each system (Mastrandrea et al., 2010).

To this end, scenario-neutral climate impact assessments are being used increasingly to assess and convey the sensitivities of water resource systems to changes in climate (Brown and Wilby, 2012; Prudhomme et al., 2010). These assessments work by ‘stress testing’ a system against a set of hydrometeorological time series that represent potential future climate conditions. These time series are then run through a system model, providing information on how the system responds to changes in climate conditions, and identifying critical performance thresholds and other decision-relevant information (Brown et al., 2012; Prudhomme et al., 2010). This creates a scenario-neutral space (also referred to as an exposure space or a response surface) that maps system performance to changes in a range of statistics (e.g. averages, seasonality, intermittency, variability, extremes and low-frequency autocorrelations) of climate variables (e.g. precipitation, temperature, potential evapotranspiration)—the combination of which is hereafter referred to as climate ‘attributes’. The scenario-neutral space can be coupled with climate projections to understand the likelihood and possible timing of these changes (Taner et al., 2017; Turner et al., 2014); moreover scenario-neutral analyses can be used to explore the robustness of different management strategies to the set of plausible future changes (Brown et al., 2012; Culley et al., 2016; Whateley et al., 2014).

The primary stages in the construction of scenario-neutral spaces consist of:

  • (i)

    Selection of the climate attributes against which to stress-test the system (this usually corresponds to the selection of the axes of the scenario-neutral space).

  • (ii)

    Development of a set of perturbed attribute values, representing the plausible changes to be used for stress testing (this is equivalent to selecting the locations in the scenario-neutral space at which to assess system performance).

  • (iii)

    Generation of climate perturbed hydrometeorological time series that reflect the perturbed attribute values (i.e. generation of climate perturbed time series that represent each selected location in the scenario-neutral space).

  • (iv)

    Assessment of system performance at each location in the scenario-neutral space by passing the climate perturbed hydrometeorological time series generated in (iii) through a system model and calculating the corresponding system performance.

A number of methods have been developed to support the above stages. For stage (ii), different approaches have been used to determine the combinations of changes in climate attributes for which to assess system performance. When the system is sensitive to only a small number of climate attributes—such as only changes to annual average rainfall and temperature but not to changes in seasonality, intermittency, variability, extremes or low-frequency oscillations—then it becomes possible to have a low-dimensional (e.g. 2- or 3-dimensional) scenario-neutral space. In these cases, system performance can be evaluated over a regular grid of changes to each attribute (Brown et al., 2012; Culley et al., 2016; Prudhomme et al., 2010; Steinschneider et al., 2015; Turner et al., 2014). In contrast, when the dimensionality of the scenario-neutral space is high (e.g. larger than 10), a variety of sampling techniques have been used to cover representative regions (e.g. Latin hypercube, improved distributed hypercube, eFAST), as the use of a regular grid would be too computationally expensive (Beachkofski and Grandhi, 2002; Gao et al., 2016; Kasprzyk et al., 2013; Stein, 1987). In practice, such high-dimensional scenario-neutral spaces thus far have only been used in cases where changes in climate attributes were combined with other factors affecting system performance, such as demands and costs (Herman et al., 2014; Kasprzyk et al., 2013; Ray et al., 2018; Shortridge and Guikema, 2016), with the number of climate attribute dimensions considered still being small (i.e. 2 to 3).

For stage (iii), different approaches also have been developed and/or used to generate hydroclimatic time series that represent the desired attribute changes. As discussed in Guo et al. (2018), these time series traditionally have been obtained by applying scaling factors to historical data (Culley et al., 2016; Kasprzyk et al., 2013; Kay et al., 2014; Weiβ, 2011; Wetterhall et al., 2011). However, this approach cannot account for changes in attributes such as intermittency, autocorrelation and extremes, or for complex combinations of changes such as an increase in extremes coupled with a decrease in mean. To address this limitation, stochastic weather generators have received increased attention as they have more flexibility to simulate complex combinations of future changes (Borgomeo et al., 2015a; Guo et al., 2018; Ray et al., 2018; Steinschneider and Brown, 2013). However estimation of stochastic weather generator parameters to simulate time series with pre-determined attributes values can be a challenging task (Culley et al., 2019; Guo et al., 2017b, 2018). To address this, Guo et al. (2018) introduced an inverse approach that optimizes the weather generator parameters in order to generate hydrometeorological time series with desired attribute values; this approach was further formalized and refined by Culley et al. (2019).

Despite these advances, a formal approach to identifying the attributes in stage (i) is still missing. For reasons likely to include some combination of a priori judgement, analytical tractability, ease of interpretation and capacity to generate combinations of perturbed attributes, most studies consider changes in two attributes (Bussi et al., 2016; Culley et al., 2016; Singh et al., 2014; Turner et al., 2014; Weiβ, 2011; Wetterhall et al., 2011; Whateley et al., 2014). The selected attributes usually correspond to changes in mean precipitation and mean temperature, or in some cases changes to precipitation seasonality (Kay et al., 2014; Prudhomme et al., 2013a; Prudhomme et al., 2013b) and shifts in peak flows (Borgomeo et al., 2015b; Nazemi et al., 2013; Quinn et al., 2018). However, it is well known that water resources systems can be affected by a much wider range climate attributes (e.g. averages, seasonality, intermittency, variability, extremes and low-frequency autocorrelation), which can change both individually and in combination. For example, groundwater storages are less affected by evaporation than reservoirs but also subject to lower frequency variations in climate (e.g. multi-year droughts), while temperature can be critical for water storages driven by snowmelt (Culley et al., 2016; Eckhardt and Ulbrich, 2003; Ray et al., 2018). Importantly, even for the same system, the climate attributes that have the biggest influence on its performance can vary depending on the performance metrics (Culley et al., 2016; Kasprzyk et al., 2013). This highlights a need to rigorously test the assumptions of stage (i), with omissions of important attributes at this stage potentially leading to the misinterpretation of a system's climate sensitivity, the inability to identify important system failure modes, and/or the incorrect assessment of the relative performance of different decision alternatives.

Given that identification of key system sensitivities is a fundamental principle that underpins scenario-neutral climate impact assessments (Brown and Wilby, 2012; Nazemi and Wheater, 2014), a formal approach for selecting the most appropriate axes of scenario-neutral spaces is warranted. This is because all subsequent stages in scenario-neutral assessments are conditioned on this stage, making it impossible to identify key sensitivities in subsequent analyses if key climate attributes are not considered in the first place. So while stochastic weather generators are opening up the opportunity to simulate a much larger set of climate attributes as part of stage (iii) (Borgomeo et al., 2015b; Guo et al., 2017b; 2018; Herman and Giuliani, 2018; Quinn et al., 2018), for this to be effective it must be accompanied by the appropriate selection of the attributes to be perturbed in the first place as part of stage (i).

The overarching aim of this paper is to develop an approach for identifying the most important climate attributes, so that scenario-neutral climate impact assessments provide accurate information on system sensitivity and the conditions that could lead to system failure (Broderick et al., 2019; Bryant and Lempert, 2010; Culley et al., 2016; Lempert et al., 2008; Prudhomme et al., 2010). This will not only help improve the accuracy of system ‘stress tests’ when applied to current system configurations, but can also help support assessments on the climate conditions for which an alternative system configuration (sometimes referred to as an ‘option’, ‘solution’ or ‘decision’) is preferable to another (Brown et al., 2012; Brown and Wilby, 2012; Giudici et al., 2020; Groves and Lempert, 2007; Hadka et al., 2015; Herman et al., 2015; Kasprzyk et al., 2013; Lempert and Collins, 2007), as well as the relative or absolute robustness of alternative system configurations (Herman et al., 2015; McPhail et al., 2018; McPhail et al., 2020).

To this end, the specific objectives of this paper are (i) to present a general approach for identifying which climate attributes to include in scenario-neutral studies for a given system and performance objectives, and (ii) to evaluate the benefits of using the most appropriate climate attributes in a scenario-neutral impact assessment. The approach is demonstrated and tested using the Lake Como system, a regulated lake in Northern Italy. Two performance criteria are considered—flood reliability and irrigation deficit—to highlight the importance of tailoring the approach to the system under consideration, including different system objectives (Kasprzyk et al., 2013).

Details of the proposed approach can be found in Section 2, with a description of the case study and implementation of the proposed approach in Section 3. A description of further analysis designed to test how well the proposed approach performed is also presented in Section 3, as well as a demonstration of a tipping point type impact assessment (Brown et al., 2012; Frey and Patil, 2002; Guillaume et al., 2016; Haasnoot et al., 2013; Hyde et al., 2005; Raso et al., 2019; Ravalico et al., 2010) using the critical climate attributes. The results of implementing and testing the proposed approach are presented in Section 4, along with a discussion of its advantages and limitations. Conclusions are presented in Section 5.

Section snippets

Overview

The key challenge when identifying the set of critical climate attributes is to balance the need to:

  • (i)

    include all of the climate attributes that could potentially have a significant impact on system performance, to ensure the resulting impact assessment is as accurate as possible and does not miss any key modes of system failure, and

  • (ii) keep the number of attributes as small as possible, to minimize the dimensionality of the scenario-neutral space so as to make it feasible to generate

Case study, implementation and testing of proposed approach

A case study of a regulated reservoir is used to demonstrate and test the approach outlined in Section 2. The critical climate attributes are identified for two competing system objectives (flood mitigation and irrigation supply), to determine whether different critical attributes are identified for each. Section 3.1 describes the case study models and data, and Section 3.2 describes the specific implementation of the steps described in Section 2. Section 3.3.1 presents further analysis used to

Results and discussion

Section 4.1 presents the results for the approach detailed in Section 2. This includes the PMI calculations, as well as an analysis of how many critical attributes should be selected to capture system vulnerabilities for the different performance criteria. Section 4.2.1 presents the results of the additional analysis conducted to test how well the approach performs, and Section 4.2.2 presents the results of the tipping point type analysis detailed in Section 3.3.2.

Summary and conclusions

This study presents a novel approach for selecting critical climate attributes for use in timeseries-driven scenario-neutral impact assessments. This is necessary, given that when large numbers of climate attributes are used to form high-dimensional scenario-neutral spaces, it is extremely difficult to generate the time series that perturb each attribute in the required way. This is likely to be one of the primary reasons why most scenario-neutral studies that use hydrometeorological time

Declaration of competing interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgments

The case study data used in this study are from Agenzia Regionale per la Protezione dell’Ambiente (http://ita.arpalombardia.it/ita/inde) and Consorzio dell'Adda (http://www.addaconsorzio.it/). The authors would like to thank ARPA and Eng. Bertoli from Consorzio dell’Adda for its provision. The authors would also like to thank M. Giuliani and A. Castelletti for their contribution to this research, as well as Robert Wilby and two anonymous reviewers for their comments, which improved the

References (88)

  • D. Anghileri et al.

    Optimizing watershed management by coordinated operation of storing facilities

    J. Water Resour. Plann. Manag.

    (2013)
  • D. Anghileri et al.

    A framework for the quantitative assessment of climate change impacts on water-related activities at the basin scale

    Hydrol. Earth Syst. Sci.

    (2011)
  • B. Beachkofski et al.

    Improved distributed hypercube sampling, 43rd

  • B. Bennett et al.

    foreSIGHT: Systems Insights from Generation of Hydroclimatic Timeseries

    (2018)
  • S. Bergström et al.

    The HBV Model. Computer Models of Watershed Hydrology

    (1995)
  • J. Boé et al.

    Statistical and dynamical downscaling of the Seine basin climate for hydro-meteorological studies

    Int. J. Climatol.

    (2007)
  • E. Borgomeo et al.

    Numerical rivers: a synthetic streamflow generator for water resources vulnerability assessments

    Water Resour. Res.

    (2015)
  • E. Borgomeo et al.

    Assessing water resource system vulnerability to unprecedented hydrological drought using copulas to characterize drought duration and deficit

    Water Resour. Res.

    (2015)
  • G.J. Bowden et al.

    Input determination for neural network models in water resources applications. Part 1—background and methodology

    J. Hydrol.

    (2005)
  • D.R. Broad et al.

    Water distribution system optimization using metamodels

    J. Water Resour. Plann. Manag.

    (2005)
  • D.R. Broad et al.

    A systematic approach to determining metamodel scope for risk-based optimization and its application to water distribution system design

    Environ. Model. Software

    (2015)
  • D.R. Broad et al.

    Optimal operation of complex water distribution systems using metamodels

    J. Water Resour. Plann. Manag.

    (2010)
  • C. Broderick et al.

    Using a scenario-neutral framework to avoid potential maladaptation to future flood risk

    Water Resour. Res.

    (2019)
  • C. Brown et al.

    Decision scaling: linking bottom-up vulnerability analysis with climate projections in the water sector

    Water Resour. Res.

    (2012)
  • C. Brown et al.

    An alternate approach to assessing climate risks

    Eos, Trans. Am. Geophys. Union

    (2012)
  • B.P. Bryant et al.

    Thinking inside the box: a participatory, computer-assisted approach to scenario discovery

    Technol. Forecast. Soc. Change

    (2010)
  • G. Bussi et al.

    Modelling the future impacts of climate and land-use change on suspended sediment transport in the River Thames (UK)

    J. Hydrol.

    (2016)
  • S. Conevski

    A Comprehensive Analysis of the Climate Change and Structural Uncertainty on a Complex Water System. Case Study in Como-Muzza

    (2014)
  • S. Culley et al.

    Generating realistic perturbed hydrometeorological time series to inform scenario-neutral climate impact assessments

    J. Hydrol.

    (2019)
  • S. Culley et al.

    A bottom‐up approach to identifying the maximum operational adaptive capacity of water resource systems to a changing climate

    Water Resour. Res.

    (2016)
  • M. Déqué

    Frequency of precipitation and temperature extremes over France in an anthropogenic scenario: model results and statistical correction according to observed values

    Global Planet. Change

    (2007)
  • K. Eckhardt et al.

    Potential impacts of climate change on groundwater recharge and streamflow in a central European low mountain range

    J. Hydrol.

    (2003)
  • EtccdiTCCDI

    ETCCDI/CRD climate change indices. Xuebin Zhang

    (2013)
  • T.M.K.G. Fernando et al.

    Selection of input variables for data driven models: an average shifted histogram partial mutual information estimator approach

    J. Hydrol.

    (2009)
  • K.J.A. Fowler et al.

    Simulating runoff under changing climatic conditions: revisiting an apparent deficiency of conceptual rainfall-runoff models

    Water Resour. Res.

    (2016)
  • H.C. Frey et al.

    Identification and review of sensitivity analysis methods

    Risk Anal.

    (2002)
  • J. Friedman et al.

    The Elements of Statistical Learning

    (2001)
  • S. Galelli et al.

    Tree-based iterative input variable selection for hydrological modeling

    Water Resour. Res.

    (2013)
  • S. Galelli et al.

    An evaluation framework for input variable selection algorithms for environmental data-driven models

    Environ. Model. Software

    (2014)
  • L. Gao et al.

    Robust global sensitivity analysis under deep uncertainty via scenario analysis

    Environ. Model. Software

    (2016)
  • F. Giudici et al.

    An active learning approach for identifying the smallest subset of informative scenarios for robust planning under deep uncertainty

    Environ. Model. Software

    (2020)
  • M. Giuliani et al.

    Curses, tradeoffs, and scalable management: advancing evolutionary multiobjective direct policy search to improve water reservoir operations

    J. Water Resour. Plann. Manag.

    (2015)
  • M. Giuliani et al.

    Introduction to the HBV Model

    (2014)
  • M. Giuliani et al.

    Many-objective reservoir policy identification and refinement to reduce policy inertia and myopia in water management

    Water Resour. Res.

    (2014)
  • D.G. Groves et al.

    A new analytic method for finding policy-relevant scenarios

    Global Environ. Change

    (2007)
  • J.H.A. Guillaume et al.

    Robust discrimination between uncertain management alternatives by iterative reflection on crossover point scenarios: principles, design and implementations

    Environ. Model. Software

    (2016)
  • D. Guo et al.

    Impact of evapotranspiration process representation on runoff projections from conceptual rainfall‐runoff models

    Water Resour. Res.

    (2017)
  • D. Guo et al.

    Use of a scenario-neutral approach to identify the key hydro-meteorological attributes that impact runoff from a natural catchment

    J. Hydrol.

    (2017)
  • D. Guo et al.

    An inverse approach to perturb historical rainfall data for scenario-neutral climate impact studies

    J. Hydrol.

    (2018)
  • M. Haasnoot et al.

    Dynamic adaptive policy pathways: a method for crafting robust decisions for a deeply uncertain world

    Global Environ. Change

    (2013)
  • D. Hadka et al.

    An open source framework for many-objective robust decision making

    Environ. Model. Software

    (2015)
  • W.R. Hamon

    Estimating Potential Evapotranspiration

    (1960)
  • J.D. Herman et al.

    Policy tree optimization for threshold-based water resources management over multiple timescales

    Environ. Model. Software

    (2018)
  • J.D. Herman et al.

    How should robustness be defined for water systems planning under change?

    J. Water Resour. Plann. Manag.

    (2015)
  • Cited by (0)

    View full text