<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing with OASIS Tables v3.0 20080202//EN" "journalpub-oasis3.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:oasis="http://docs.oasis-open.org/ns/oasis-exchange/table" xml:lang="en" dtd-version="3.0"><?xmltex \makeatother\@nolinetrue\makeatletter?>
  <front>
    <journal-meta><journal-id journal-id-type="publisher">HESS</journal-id><journal-title-group>
    <journal-title>Hydrology and Earth System Sciences</journal-title>
    <abbrev-journal-title abbrev-type="publisher">HESS</abbrev-journal-title><abbrev-journal-title abbrev-type="nlm-ta">Hydrol. Earth Syst. Sci.</abbrev-journal-title>
  </journal-title-group><issn pub-type="epub">1607-7938</issn><publisher>
    <publisher-name>Copernicus Publications</publisher-name>
    <publisher-loc>Göttingen, Germany</publisher-loc>
  </publisher></journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.5194/hess-23-3247-2019</article-id><title-group><article-title>A multi-objective ensemble approach to hydrological modelling in the UK: an application to historic drought reconstruction</article-title><alt-title>A multi-objective modelling approach for drought reconstruction</alt-title>
      </title-group><?xmltex \runningtitle{A multi-objective modelling approach for drought reconstruction}?><?xmltex \runningauthor{K.~A. Smith et al.}?>
      <contrib-group>
        <contrib contrib-type="author" corresp="yes" rid="aff1">
          <name><surname>Smith</surname><given-names>Katie A.</given-names></name>
          
        <ext-link>https://orcid.org/0000-0003-1060-9103</ext-link></contrib>
        <contrib contrib-type="author" corresp="no" rid="aff1">
          <name><surname>Barker</surname><given-names>Lucy J.</given-names></name>
          
        <ext-link>https://orcid.org/0000-0002-2913-0664</ext-link></contrib>
        <contrib contrib-type="author" corresp="no" rid="aff1">
          <name><surname>Tanguy</surname><given-names>Maliko</given-names></name>
          
        <ext-link>https://orcid.org/0000-0002-1516-6834</ext-link></contrib>
        <contrib contrib-type="author" corresp="no" rid="aff1">
          <name><surname>Parry</surname><given-names>Simon</given-names></name>
          
        </contrib>
        <contrib contrib-type="author" corresp="no" rid="aff2">
          <name><surname>Harrigan</surname><given-names>Shaun</given-names></name>
          
        <ext-link>https://orcid.org/0000-0002-0992-3667</ext-link></contrib>
        <contrib contrib-type="author" corresp="no" rid="aff3">
          <name><surname>Legg</surname><given-names>Tim P.</given-names></name>
          
        </contrib>
        <contrib contrib-type="author" corresp="no" rid="aff2 aff1 aff4">
          <name><surname>Prudhomme</surname><given-names>Christel</given-names></name>
          
        <ext-link>https://orcid.org/0000-0003-1722-2497</ext-link></contrib>
        <contrib contrib-type="author" corresp="no" rid="aff1 aff5">
          <name><surname>Hannaford</surname><given-names>Jamie</given-names></name>
          
        </contrib>
        <aff id="aff1"><label>1</label><institution>Centre for Ecology &amp; Hydrology, Maclean Building, Benson Lane,
Crowmarsh Gifford, Wallingford,<?xmltex \hack{\break}?> Oxfordshire, OX10 8BB, UK</institution>
        </aff>
        <aff id="aff2"><label>2</label><institution>European Centre for Medium-Range Weather Forecasts, Shinfield Road,
Reading, RG2 9AX, UK</institution>
        </aff>
        <aff id="aff3"><label>3</label><institution>Met Office, FitzRoy Road, Exeter, Devon, EX1 3PB, UK</institution>
        </aff>
        <aff id="aff4"><label>4</label><institution>Department of Geography, Loughborough University, Loughborough,
LE11 3TU, UK</institution>
        </aff>
        <aff id="aff5"><label>5</label><institution>Irish Climate Analysis and Research UnitS, Department of Geography,
Maynooth, Ireland</institution>
        </aff>
      </contrib-group>
      <author-notes><corresp id="corr1">Katie A Smith (k.a.smith@ceh.ac.uk)</corresp></author-notes><pub-date><day>8</day><month>August</month><year>2019</year></pub-date>
      
      <volume>23</volume>
      <issue>8</issue>
      <fpage>3247</fpage><lpage>3268</lpage>
      <history>
        <date date-type="received"><day>2</day><month>January</month><year>2019</year></date>
           <date date-type="rev-request"><day>15</day><month>January</month><year>2019</year></date>
           <date date-type="rev-recd"><day>28</day><month>June</month><year>2019</year></date>
           <date date-type="accepted"><day>5</day><month>July</month><year>2019</year></date>
      </history>
      <permissions>
        <copyright-statement>Copyright: © 2019 Katie A. Smith et al.</copyright-statement>
        <copyright-year>2019</copyright-year>
      <license license-type="open-access"><license-p>This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this licence, visit <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</ext-link></license-p></license></permissions><self-uri xlink:href="https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019.html">This article is available from https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019.html</self-uri><self-uri xlink:href="https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019.pdf">The full text article is available as a PDF file from https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019.pdf</self-uri>
      <abstract><title>Abstract</title>
    <p id="d1e174">Hydrological models can provide estimates of streamflow pre- and
post-observations, which enable greater understanding of past hydrological
behaviour, and potential futures. In this paper, a new multi-objective
calibration method was derived and tested for 303 catchments in the UK, and
the calibrations were used to reconstruct river flows back to 1891, in order
to provide a much longer view of past hydrological variability, given the
brevity of most UK river flow records which began post-1960. A Latin
hypercube sample of 500 000 parameterisations for the GR4J model for each
catchment were evaluated against six evaluation metrics covering all aspects
of the flow regime from high, median, and low flows. The results of the top
ranking model parameterisation (LHS1), and also the top 500 (LHS500), for
each catchment were used to provide a deterministic result whilst also
accounting for parameter uncertainty. The calibrations are generally good at
capturing observed flows, with some exceptions in heavily groundwater-dominated catchments, and snowmelt and artificially influenced catchments
across the country. Reconstructed flows were appraised over 30-year moving
windows and were shown to provide good simulations of flow in the early
parts of the record, in cases where observations were available. To consider
the utility of the reconstructions for drought simulation, flow data for the
1975–1976 drought event were explored in detail in nine case study catchments.
The model's performance in reproducing the drought events was found to vary
by catchment, as did the level of uncertainty in the LHS500. The
Standardised Streamflow Index (SSI) was used to assess the model
simulations' ability to simulate extreme events. The peaks and troughs of
the SSI time series were well represented despite slight over- or
underestimations of past drought event magnitudes, while the accumulated
deficits of the drought events extracted from the SSI time series verified
that the model simulations were overall very good at simulating drought
events. This paper provides three key contributions: (1) a robust
multi-objective model calibration framework for calibrating catchment models
for use in both general and extreme hydrology; (2) model calibrations for the
303 UK catchments that could be used in further research, and operational
applications such as hydrological forecasting; and (3) <inline-formula><mml:math id="M1" display="inline"><mml:mrow><mml:mo>∼</mml:mo><mml:mspace width="0.125em" linebreak="nobreak"/><mml:mn mathvariant="normal">125</mml:mn></mml:mrow></mml:math></inline-formula> years of spatially and temporally consistent reconstructed flow data
that will allow comprehensive quantitative assessments of past UK drought
events, as well as long-term analyses of hydrological variability that have
not been previously possible, thus enabling water resource managers to
better plan for extreme events and build more resilient systems for the
future.</p>
  </abstract>
    </article-meta>
  </front>
<body>
      

      <?xmltex \hack{\newpage}?>
<?pagebreak page3248?><sec id="Ch1.S1" sec-type="intro">
  <label>1</label><title>Introduction</title>
      <p id="d1e199">Hydrological extremes and associated flood and drought events threaten
the security of water supply, food supply, livelihoods and welfare
(Kundzewicz and Matczak, 2015). Managing the impacts of both rainfall
excess and deficit on the hydrological system poses a significant challenge
for authorities and water resource managers across the globe. These
challenges are set to become more acute in future: the latest projections
for Europe suggest increasing hydrological variability with more severe
extremes (Collet et al., 2018; Guerreiro et al., 2018; Teuling, 2018) and
further reductions in low flows in many regions  (Wilby and Harris, 2006;
Christierson et al., 2012; Prudhomme et al., 2012; Kay et al., 2018; Marx et
al., 2018). Increasing demands due to a growing population and socio-economic
changes also imply growing pressures on water resources in the future,
necessitating considerable investment in long-term strategic water resources
planning and adaptation (HM Government, 2017).</p>
      <p id="d1e202">Understanding extremes of the past can help us prepare for future extreme
events. Drought characteristics of events in the recent past can be used to
stress test water supply systems  (Mens et al., 2015), a
practice that is commonly applied in UK water resource management and
drought plans (e.g. Southern Water, 2013; Northumbrian
Water, 2017). Similarly, drought severity estimates of past events
have been used to investigate the impacts of increased drought frequency on
water supply vulnerability (Herman et al., 2016). There is a growing
trend towards testing water supply systems against events worse than those
experienced, using either scenario-based methods  (e.g. Stoelzle
et al., 2014; Anderton et al., 2015) or stochastic approaches to generate
simulated droughts with credible characteristics  (e.g. Atkins, 2016).
In addition, short-term water management planning can benefit from seasonal
forecasting of reservoirs inflows and streamflow volumes
(Prudhomme et al., 2017), so that periods of water deficit can be
known in advance and appropriate measures put in place to manage resources
and mitigate impacts. However, these methods are all dependent on having a
good understanding of past variability and long hydrometric records which
are used to train and validate stochastic approaches, and to create tools
that enable the simulation of river flows as accurately as possible under a
range of varied climate conditions.</p>
      <p id="d1e205">Observations of global streamflow are sparse prior to the 1950s, with less
than 20 % of stations in the Global Runoff Data Centre  (GRDC,
2019) beginning pre-1950. Post-1960, the streamflow network expanded
rapidly, a pattern that is mimicked by the UK gauging network, where 100
gauging stations in 1950 have increased to over 1300 today. Qualitative data
sources and long rainfall records can identify significant drought events in
the pre-instrumentational period  (Pfister et al., 2006; Marsh et al.,
2007; Brázdil et al., 2016). However, these cannot be used to determine
whether these events were more or less severe in hydrological terms than
those on the observational record, and there is a need for temporally and
spatially coherent flow time series to allow systematic assessment of extreme
events.</p>
      <p id="d1e208">Meteorological records of rainfall and temperature generally extend further
back than hydrological data, often providing data from the turn of the
21st century (New et al., 2000), and occasionally as far
back as the mid-20th century. Modelled climate reanalysis data
(e.g. Compo et al., 2011) and long-term reconstructed climate datasets (e.g. Casty et al., 2007) have been developed for use in scientific research and
can be fed into hydrological models to quantitatively reconstruct river
flows beyond the limits of the observational period. In the UK, quantitative
reconstructions of river flows using simple hydrological models have
previously been conducted, but only for a handful of catchments (e.g.
Jones and Lister, 1998; Jones et al., 2006). Regional flow reconstructions
have been used to explore the implications of drought events on water
resources  (e.g. Spraggs et al., 2015). Drought
reconstruction has also been conducted in other countries using proxy data
(Jones et al., 1984; Cook et al., 2015), precipitation data
(Noone et al., 2017, Ireland), soil moisture models
(Wu et al., 2011, China), and hydrological models
(Caillouet et al., 2017, France). Generally, however,
there are few extant studies that use hydrological models to derive
plausible historical sequences.</p>
      <p id="d1e212">Catchment hydrological models are tools that can generate streamflow time
series from meteorological time series data, to provide continuous proxy
river flow data that are otherwise not directly available. They can be used
to extend flow records, creating very long sequences that extend back beyond
the initiation of the observational network. Such long time series can enable
thorough analysis of past variability and frequency of severe events
(e.g. Caillouet et al., 2017); as vital
input to short range and seasonal forecasting
(Day, 1985; Harrigan et al., 2018), providing
valuable early warnings and help preparedness; or for future projections for
long-term planning accounting for possible future non-stationarity, for
example due to global warming  (e.g. Collet et
al., 2018).</p>
      <?pagebreak page3249?><p id="d1e215">Calibrating a hydrological model for multiple purposes, e.g. flow
reconstruction and forecasting, for high, low, and average flows, requires
careful consideration. Currently, models are typically calibrated to
minimise a specific type of error against observations, measured by an
“evaluation metric” also known as an “objective function”. Commonly used
metrics, such as the Nash–Sutcliffe efficiency  (Nash and
Sutcliffe, 1970) or root mean squared error, tend to focus on the correct
estimation of high flows (Krause et al., 2005;
Dawson et al., 2007), whilst more general metrics, such as mean absolute
percent error and percent bias are also used to more systematically optimise
the flows and the water balance respectively. There are few examples
focusing on optimising low flow simulation. Most commonly, a single
objective function is used, implemented using automatic algorithms to find a
deterministic parameterisation of the model. Such algorithms are commonly
categorised as “local”  (e.g. PEST, Kim et al., 2007) or
“global” (e.g. SCE, Duan et al., 1993), some examples of which
have been compared by  Wallner et al. (2012). However,
seeking a single “optimum” parameter set to describe the observations has
been argued to be a misconception with theoretical catchment models
(Beven, 2012). The need for calibration techniques to maximise
hydrological model performance against multiple elements of the flow regime
has, however, been recognised, and multi-objective optimisation methods have
been advancing since the turn of the century, though few studies explore
more than three objectives  (Efstratiadis and Koutsoyiannis, 2010).
Multi-objective optimisation commonly involves seeking Pareto-optimal
solutions that find a compromise between objective functions  (e.g. Shafii
and De Smedt, 2009; Kamali et al., 2013; Jung et al., 2017). Multi-objective
methods may also be used to optimise more than one hydrological variable
(e.g. Mostafaie et al., 2018). In addition, utilising multiple model
parameterisations have been advocated to account for “equifinality” –
that many different parameterisations may produce equally adequate
simulations of past observations (see, for example, Beven and Binley,
1992; Beven, 2006).</p>
      <p id="d1e218">Here, we develop a framework to establish a national network of catchment
hydrological models and evaluate their application to the reconstruction of
hydrological time series, with application to the UK over the period 1891 to
2015. The aims of this research are to
<list list-type="bullet"><list-item>
      <p id="d1e223">develop a robust method for multi-objective model calibration suitable for
use in simulating streamflow with associated uncertainty,</p></list-item><list-item>
      <p id="d1e227">apply that method to reconstruct historic streamflow time series from the
1890s across the UK,</p></list-item><list-item>
      <p id="d1e231">examine the performance of these time series where observations are
available, and</p></list-item><list-item>
      <p id="d1e235">explore the potential for application of these time series in evaluating
drought events.</p></list-item></list>
This paper first outlines the datasets in Sect. 2, before detailing the
modelling methods in Sect. 3. Section 4 provides the results of the
performance of the model reconstructions compared with streamflow
observations, both generally and during drought events. Section 5 discusses
the potential limitations of this work, and suggests directions for further
research, before the paper is concluded in Sect. 6.</p>
</sec>
<sec id="Ch1.S2">
  <label>2</label><title>Data</title>
      <p id="d1e247">The hydrological model employed in this study (see Sect. 3.1) requires rainfall and potential
evapotranspiration data to run, and observed flow data for calibration and
validation. Means of access to the datasets used in this study are described
in the Data availability section at the end of the paper.</p>
<sec id="Ch1.S2.SS1">
  <label>2.1</label><title>Catchment selection and flow data</title>
      <p id="d1e257">A diverse set of 303 UK catchments were selected for model calibration.
Initially, 395 stations were considered, from the near-natural catchments
suitable for low flow analysis from the UK Benchmark Network
(Harrigan et al., 2017), and those which are part of the National
Hydrological Monitoring Programme (<uri>https://nrfa.ceh.ac.uk/nhmp</uri>, last access: 23 July 2019), which are of particular interest for
operational water situation monitoring. Catchments were required to have a
minimum of 32 years of observational daily data from the National River Flow
Archive (<uri>https://nrfa.ceh.ac.uk/</uri>, last access: 23 July 2019), from 1984 to 2015 for model
calibration. Some catchments that suffered repeated or prolonged periods of
missing data, truncation of flow measurements, step changes, and artificial
influences resulting in unrealistic flow patterns were removed from the
catchment selection, resulting in 303 catchments. These catchments had
records ranging from 32 to 135 years in length, with an average length of 49
years. The average completeness in the gauged daily flows was 99.2 % (with a minimum of 90 %, and a maximum of 100 %). An additional two flow
records were included, the naturalised daily flows for the River Thames at
Kingston and the River Lee at Feildes Weir, making 305 flow records from 303
catchments. Throughout this paper, the observed calibrations for these two
catchments are presented (rather than the naturalised series), for
consistency with the other catchments across the UK. While this paper
presents summary results from the whole network, we also selected a set of
nine case study catchments to present results in more detail. The nine
catchments (shown in Fig. 1) were selected from
each of the nine hydro-climatic regions defined in Harrigan et al. (2017) in order to represent the range of hydro-climatology, hydro-geology,
and artificial influence across the country, as well as to explore some of
the better and some of the poorer model performances among the 303
catchments used in this study.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F1"><?xmltex \currentcnt{1}?><label>Figure 1</label><caption><p id="d1e268">Map of 303 catchments calibrated. Nine reconstruction case study
catchments (one per region) are shown with black hatching.</p></caption>
          <?xmltex \igopts{width=241.848425pt}?><graphic xlink:href="https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019-f01.png"/>

        </fig>

</sec>
<sec id="Ch1.S2.SS2">
  <label>2.2</label><title>Rainfall data</title>
      <p id="d1e285">The daily rainfall dataset used in this study was derived by the UK Met
Office as a result of a large data rescue and digitisation programme. The
5 km gridded dataset, which covers the period 1891 to 2015, was derived using
the same methodology as the UKCP09 data  (Met Office, 2017), with
interpolation carried out using inverse distance weighting  (Perry
and Hollis, 2005). The data rescue and digitisation programme added over 200
monthly and 38 daily gauges to the network during the period 1890 to 1910.
Catchment averages were derived from the 5 km grids, using the catchment
boundaries provided from the National River Flow Archive, for use in the
hydrological model.</p><?xmltex \hack{\newpage}?>
</sec>
<?pagebreak page3250?><sec id="Ch1.S2.SS3">
  <label>2.3</label><title>Potential evapotranspiration data</title>
      <p id="d1e297">As the meteorological variables needed to derive potential
evapotranspiration (PET) data using the Penman–Monteith equation
(Monteith, 1965) are not available prior to 1961, the PET data used for
the reconstructions was derived using the McGuinness–Bordne
temperature-based PET equation  (McGuinness and Bordne, 1972),
calibrated for the UK. The temperature data for 1891–2015 were again
provided by the UK Met Office following their data rescue programme. A
detailed description of the generation of the PET dataset used in this
study, following a rigorous analysis of seven temperature-based PET
equations, four calibration techniques, and seven input temperature data
sources or formats, can be found in  Tanguy et al. (2018).</p>
</sec>
</sec>
<sec id="Ch1.S3">
  <label>3</label><title>Methods</title>
<sec id="Ch1.S3.SS1">
  <label>3.1</label><title>The GR4J hydrological model</title>
      <p id="d1e316">The GR4J (Génie Rural à 4 paramètres Journalier) daily lumped
rainfall-runoff model (Perrin et al., 2003) was used in this study
via the “airGR” R package version 1.0.2   (Coron et al.,
2017). The suite of daily GR models (GR4J, GR5J, and GR6J) is being
increasingly applied around the world, and GR4J was chosen for several
reasons:
<list list-type="order"><list-item>
      <p id="d1e321">GR models have been used for streamflow reconstructions previously
(Brigode et al., 2016; Caillouet et al., 2017).</p></list-item><list-item>
      <p id="d1e325">The GR4J model has demonstrated good performance in a diverse set of
catchments in the UK  (Harrigan et al., 2018), as well
as good performance at simulating temporal transitions between wet and dry
periods  (Broderick et al., 2016).</p></list-item><list-item>
      <p id="d1e329">The GR models are openly accessible.</p></list-item><list-item>
      <p id="d1e333">The model has a low computational demand, and can be run in parallel without
manual input requirement.</p></list-item></list>
The model has four free parameters (X1–X4), requires daily precipitation
and potential evapotranspiration data as input, and routes water into two
stores: the production store and the routing store. The production store
(capacity X1) gains water from effective rainfall and loses water through
evaporation and percolation. Percolated water joins that which has bypassed
the production store and is routed with a fixed split, in which 90%
is routed via a unit hydrograph (time lag X4), followed by the non-linear
routing store (capacity X3); the remaining 10 % is routed by a
single unit hydrograph (time lag <inline-formula><mml:math id="M2" display="inline"><mml:mrow><mml:mn mathvariant="normal">2</mml:mn><mml:mo>×</mml:mo></mml:mrow></mml:math></inline-formula> X4). Groundwater or inter-catchment
exchange (controlled by X2) is effective on both the routing store and the
flow routed by the single unit hydrograph and can be positive, negative, or
zero.</p>
      <p id="d1e347">The GR models include an optional snowmelt module, CemaNeige
(Valéry et al., 2014). Due to the high computational demand of
the snowmelt module, it was decided to calibrate the GR4J model without
snowmelt, as only 15 (5 %) of the 303 catchments experience a significant
fraction of precipitation falling as snow (<inline-formula><mml:math id="M3" display="inline"><mml:mrow><mml:mi mathvariant="italic">&gt;</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:mn mathvariant="normal">15</mml:mn></mml:mrow></mml:math></inline-formula> %) over the
calibration period (Harrigan et al., 2018).</p>
</sec>
<sec id="Ch1.S3.SS2">
  <label>3.2</label><title>Calibration strategy</title>
      <p id="d1e369">The GR4J model was calibrated for this study incorporating concepts from
GLUE-type Bayesian approaches  (Beven and Freer, 2001), and
multi-objective Pareto-optimal solutions  (Yapo et al., 1998). The
approach consisted of three stages, the details of which are further
elaborated in this sub-section: firstly the feasible parameter space was
determined, and sampled using Latin hypercube sampling (LHS) (McKay et
al., 1979); secondly the model was run, and six evaluation metrics were
calculated for each parameter set; and thirdly the top 500 parameter sets
for each catchment were selected using a very simple Pareto-optimising
ranking approach, accounting for non-acceptable trade-offs
(Efstratiadis and Koutsoyiannis, 2010). This method was formalised
for several reasons:
<list list-type="order"><list-item>
      <p id="d1e374">Latin hypercube sampling allowed the systematic sampling of the model
parameter space.</p></list-item><list-item>
      <p id="d1e378">Multiple evaluation metrics enabled the simultaneous optimisation of several
aspects of the flow regime, including general water balance and low flows.</p></list-item><list-item>
      <p id="d1e382">Model equifinality (Beven, 2006) could be addressed by accepting
multiple “behavioural” parameter sets.</p></list-item><list-item>
      <p id="d1e386">A deterministic “best” parameter set could also be selected.</p></list-item></list></p>
<?pagebreak page3251?><sec id="Ch1.S3.SS2.SSS1">
  <label>3.2.1</label><title>Latin hypercube sampling</title>
      <p id="d1e396">LHS uses Latin square theory to ensure that the full range of each parameter
is represented regardless of its resultant importance  (Cheng and
Druzdzel, 2000), whilst maximising efficiency in comparison to a simple random
sampling approach. An LHS set of 500 000 model parameter sets
(parameterisations) for the four model parameters was derived using the
MATLAB package “lhsdesign”  (The MathWorks Inc, 2016), using the
“maximin” criterion to maximise the minimum distance between each point. In
order to determine what values to ascribe to the upper and lower bounds of
the parameters, a smaller experiment using 100 000 model parameterisations
was run over 45 catchments as a “first pass”. This experiment used
parameter limits that could be found in previous literature on the GR4J
model (Pushpalatha et al., 2011; Perrin et al., 2003). It was found that
good parameter sets for this first pass had storage values (X1 and X3) close
to the limits that had been set from the literature. Therefore, in
consultation with the developers of the airGR model package, it was decided
to widen the ranges of parameter values, and then to increase the number of
model parameterisations that were run to account for this increase in the
parameter space. The parameter values were sampled from a uniform
distribution, using the upper and lower limits given in
Table 1. Lower bounds of 0.0001 were ascribed to
the two storage parameters to represent a value of 0, without causing
division errors.</p>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T1" specific-use="star"><?xmltex \currentcnt{1}?><label>Table 1</label><caption><p id="d1e402">Sampled parameter ranges.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="4">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="left"/>
     <oasis:colspec colnum="3" colname="col3" align="right"/>
     <oasis:colspec colnum="4" colname="col4" align="right"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Model parameter</oasis:entry>
         <oasis:entry colname="col2">Units</oasis:entry>
         <oasis:entry colname="col3">Lower bound</oasis:entry>
         <oasis:entry colname="col4">Upper bound</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1">X1 production store capacity</oasis:entry>
         <oasis:entry colname="col2">mm</oasis:entry>
         <oasis:entry colname="col3">0.0001</oasis:entry>
         <oasis:entry colname="col4">3000</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">X2 inter-catchment exchange coefficient</oasis:entry>
         <oasis:entry colname="col2">mm d<inline-formula><mml:math id="M4" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3"><inline-formula><mml:math id="M5" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">20</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col4">20</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">X3 routing store capacity</oasis:entry>
         <oasis:entry colname="col2">mm</oasis:entry>
         <oasis:entry colname="col3">0.0001</oasis:entry>
         <oasis:entry colname="col4">2000</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">X4 unit hydrograph time constant</oasis:entry>
         <oasis:entry colname="col2">d</oasis:entry>
         <oasis:entry colname="col3">0.5</oasis:entry>
         <oasis:entry colname="col4">15</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table></table-wrap>

</sec>
<sec id="Ch1.S3.SS2.SSS2">
  <label>3.2.2</label><title>Evaluation metrics</title>
      <p id="d1e527">For each of the 500 000 model parameterisations, six evaluation metrics were
calculated in order to employ a “multi-objective” approach to cover the
full range of the flow duration curve (see Table 2): the Nash–Sutcliffe efficiency (NSE) focusses on optimising high flows,
absolute percent bias (absPBIAS) maintains the water balance, mean absolute
percent error (MAPE) and NSE on logarithmic flows (logNSE) measure overall
agreement on the full range of flows, and absolute percent error in <inline-formula><mml:math id="M6" display="inline"><mml:mrow><mml:mi>Q</mml:mi><mml:mn mathvariant="normal">95</mml:mn></mml:mrow></mml:math></inline-formula>
(<inline-formula><mml:math id="M7" display="inline"><mml:mrow><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>) and absolute percent error in mean annual minimum on a 30 d
accumulation period (MAM30<inline-formula><mml:math id="M8" display="inline"><mml:msub><mml:mi/><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:math></inline-formula>) focus on low flows. These metrics were
calculated over 32 water years 1 October 1982 to 30 September 2014.</p>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T2" specific-use="star"><?xmltex \currentcnt{2}?><label>Table 2</label><caption><p id="d1e565">Evaluation metrics used for model calibration, where <inline-formula><mml:math id="M9" display="inline"><mml:mi>i</mml:mi></mml:math></inline-formula> is the daily flow value, <inline-formula><mml:math id="M10" display="inline"><mml:mi>n</mml:mi></mml:math></inline-formula> is the number of days in calibration period, <inline-formula><mml:math id="M11" display="inline"><mml:mrow><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">o</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> is the observed value, <inline-formula><mml:math id="M12" display="inline"><mml:mrow><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">s</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> is the simulated values, and <inline-formula><mml:math id="M13" display="inline"><mml:mrow><mml:msub><mml:mover accent="true"><mml:mi>Q</mml:mi><mml:mo mathvariant="normal">‾</mml:mo></mml:mover><mml:mi mathvariant="normal">o</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> is the mean of the observed values.</p></caption><oasis:table frame="topbot"><?xmltex \begin{scaleboxenv}{.89}[.89]?><oasis:tgroup cols="4">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="left"/>
     <oasis:colspec colnum="3" colname="col3" align="left"/>
     <oasis:colspec colnum="4" colname="col4" align="left"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Evaluation metric</oasis:entry>
         <oasis:entry colname="col2">Equation</oasis:entry>
         <oasis:entry colname="col3">Range</oasis:entry>
         <oasis:entry colname="col4">Focus</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Nash–Sutcliffe efficiency</oasis:entry>
         <oasis:entry colname="col2"><inline-formula><mml:math id="M14" display="inline"><mml:mrow><mml:mi mathvariant="normal">NSE</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>-</mml:mo><mml:mstyle displaystyle="false"><mml:mfrac style="text"><mml:mrow><mml:munderover><mml:mo movablelimits="false">∑</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:munderover><mml:mo>(</mml:mo><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">o</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">s</mml:mi></mml:msub><mml:msup><mml:mo>)</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:msup></mml:mrow><mml:mrow><mml:munderover><mml:mo movablelimits="false">∑</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:munderover><mml:mo>(</mml:mo><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">o</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mover accent="true"><mml:mi>Q</mml:mi><mml:mo mathvariant="normal">‾</mml:mo></mml:mover><mml:mi mathvariant="normal">o</mml:mi></mml:msub><mml:msup><mml:mo>)</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:msup></mml:mrow></mml:mfrac></mml:mstyle></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3">1 (Perfect) to – <inline-formula><mml:math id="M15" display="inline"><mml:mi mathvariant="normal">∞</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col4">High flows</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Absolute percent bias</oasis:entry>
         <oasis:entry colname="col2">absPBIAS <inline-formula><mml:math id="M16" display="inline"><mml:mrow><mml:mo>=</mml:mo><mml:mfenced close="|" open="|"><mml:mstyle displaystyle="false"><mml:mfrac style="text"><mml:mrow><mml:mo>∑</mml:mo><mml:mo>(</mml:mo><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">s</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">o</mml:mi></mml:msub><mml:mo>)</mml:mo></mml:mrow><mml:mrow><mml:mo>∑</mml:mo><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">o</mml:mi></mml:msub></mml:mrow></mml:mfrac></mml:mstyle></mml:mfenced><mml:mo>⋅</mml:mo><mml:mn mathvariant="normal">100</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3">0 (optimum) to <inline-formula><mml:math id="M17" display="inline"><mml:mi mathvariant="normal">∞</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col4">Water balance</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Mean absolute percent error</oasis:entry>
         <oasis:entry colname="col2">MAPE <inline-formula><mml:math id="M18" display="inline"><mml:mrow><mml:mo>=</mml:mo><mml:mfenced close=")" open="("><mml:mrow><mml:mstyle displaystyle="false"><mml:mfrac style="text"><mml:mn mathvariant="normal">1</mml:mn><mml:mi>n</mml:mi></mml:mfrac></mml:mstyle><mml:munderover><mml:mo movablelimits="false">∑</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:munderover><mml:mfenced close="|" open="|"><mml:mstyle displaystyle="false"><mml:mfrac style="text"><mml:mrow><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">o</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">s</mml:mi></mml:msub></mml:mrow><mml:mrow><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">o</mml:mi></mml:msub></mml:mrow></mml:mfrac></mml:mstyle></mml:mfenced></mml:mrow></mml:mfenced><mml:mo>⋅</mml:mo><mml:mn mathvariant="normal">100</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3">0 (optimum) to <inline-formula><mml:math id="M19" display="inline"><mml:mi mathvariant="normal">∞</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col4">Full range</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Nash–Sutcliffe efficiency on log flows</oasis:entry>
         <oasis:entry colname="col2">logNSE <inline-formula><mml:math id="M20" display="inline"><mml:mrow><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>-</mml:mo><mml:mstyle displaystyle="false"><mml:mfrac style="text"><mml:mrow><mml:munderover><mml:mo movablelimits="false">∑</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:munderover><mml:mo>(</mml:mo><mml:mi>log⁡</mml:mi><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">o</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:mi>log⁡</mml:mi><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">s</mml:mi></mml:msub><mml:msup><mml:mo>)</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:msup></mml:mrow><mml:mrow><mml:munderover><mml:mo movablelimits="false">∑</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:munderover><mml:mo>(</mml:mo><mml:mi>log⁡</mml:mi><mml:msub><mml:mi>Q</mml:mi><mml:mi mathvariant="normal">o</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mover accent="true"><mml:mrow><mml:mi mathvariant="normal">log</mml:mi><mml:mi>Q</mml:mi></mml:mrow><mml:mo mathvariant="normal">‾</mml:mo></mml:mover><mml:mi mathvariant="normal">o</mml:mi></mml:msub><mml:msup><mml:mo>)</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:msup></mml:mrow></mml:mfrac></mml:mstyle></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3">1 (Perfect) to – <inline-formula><mml:math id="M21" display="inline"><mml:mi mathvariant="normal">∞</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col4">Full range</oasis:entry>
       </oasis:row>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">Absolute percent error in <inline-formula><mml:math id="M22" display="inline"><mml:mrow><mml:mi>Q</mml:mi><mml:mn mathvariant="normal">95</mml:mn></mml:mrow></mml:math></inline-formula> (flow exceeded 95 % of the time)</oasis:entry>
         <oasis:entry colname="col2"><inline-formula><mml:math id="M23" display="inline"><mml:mrow><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">APE</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mfenced close="|" open="|"><mml:mstyle displaystyle="false"><mml:mfrac style="text"><mml:mrow><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">o</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">s</mml:mi></mml:msub></mml:mrow><mml:mrow><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">o</mml:mi></mml:msub></mml:mrow></mml:mfrac></mml:mstyle></mml:mfenced><mml:mo>⋅</mml:mo><mml:mn mathvariant="normal">100</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3">0 (optimum) to <inline-formula><mml:math id="M24" display="inline"><mml:mi mathvariant="normal">∞</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col4">Low flows</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Absolute percent error in the mean annual minimum on a</oasis:entry>
         <oasis:entry colname="col2"><inline-formula><mml:math id="M25" display="inline"><mml:mrow><mml:mi mathvariant="normal">MAM</mml:mi><mml:msub><mml:mn mathvariant="normal">30</mml:mn><mml:mi mathvariant="normal">APE</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mfenced close="|" open="|"><mml:mstyle displaystyle="false"><mml:mfrac style="text"><mml:mrow><mml:mi mathvariant="normal">MAM</mml:mi><mml:msub><mml:mn mathvariant="normal">30</mml:mn><mml:mi mathvariant="normal">o</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:mi mathvariant="normal">MAM</mml:mi><mml:msub><mml:mn mathvariant="normal">30</mml:mn><mml:mi mathvariant="normal">s</mml:mi></mml:msub></mml:mrow><mml:mrow><mml:mi mathvariant="normal">MAM</mml:mi><mml:msub><mml:mn mathvariant="normal">30</mml:mn><mml:mi mathvariant="normal">o</mml:mi></mml:msub></mml:mrow></mml:mfrac></mml:mstyle></mml:mfenced><mml:mo>⋅</mml:mo><mml:mn mathvariant="normal">100</mml:mn></mml:mrow></mml:math></inline-formula>,</oasis:entry>
         <oasis:entry colname="col3">0 (optimum) to <inline-formula><mml:math id="M26" display="inline"><mml:mi mathvariant="normal">∞</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col4">Low flows</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">30 d accumulation period (30 d moving average)</oasis:entry>
         <oasis:entry colname="col2">where MAM<inline-formula><mml:math id="M27" display="inline"><mml:mrow><mml:msub><mml:mi/><mml:mn mathvariant="normal">30</mml:mn></mml:msub><mml:mo>=</mml:mo><mml:mstyle displaystyle="false"><mml:mfrac style="text"><mml:mn mathvariant="normal">1</mml:mn><mml:mi>m</mml:mi></mml:mfrac></mml:mstyle><mml:munderover><mml:mo movablelimits="false">∑</mml:mo><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mi>m</mml:mi></mml:munderover><mml:msub><mml:mo>min⁡</mml:mo><mml:mi>j</mml:mi></mml:msub><mml:mfenced open="(" close=")"><mml:mrow><mml:msub><mml:mi mathvariant="normal">MovAve</mml:mi><mml:mn mathvariant="normal">30</mml:mn></mml:msub></mml:mrow></mml:mfenced></mml:mrow></mml:math></inline-formula>,</oasis:entry>
         <oasis:entry colname="col3"/>
         <oasis:entry colname="col4"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2">where MovAve<inline-formula><mml:math id="M28" display="inline"><mml:mrow><mml:msub><mml:mi/><mml:mn mathvariant="normal">30</mml:mn></mml:msub><mml:mo>=</mml:mo><mml:mn mathvariant="normal">30</mml:mn></mml:mrow></mml:math></inline-formula> d moving average</oasis:entry>
         <oasis:entry colname="col3"/>
         <oasis:entry colname="col4"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2"><inline-formula><mml:math id="M29" display="inline"><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo></mml:mrow></mml:math></inline-formula> water year in calibration period,</oasis:entry>
         <oasis:entry colname="col3"/>
         <oasis:entry colname="col4"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2"><inline-formula><mml:math id="M30" display="inline"><mml:mi>m</mml:mi></mml:math></inline-formula> years in length.</oasis:entry>
         <oasis:entry colname="col3"/>
         <oasis:entry colname="col4"/>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup><?xmltex \end{scaleboxenv}?></oasis:table></table-wrap>

      <p id="d1e1265">Post-calibration, the upper and lower daily limits of the 500 top ranking
parameterisations (see Sect. 3.2.3 for details on
the ranking process) were used to calculate two further model performance
metrics over the full observational record available for each catchment (a
maximum of 1891–2014):
<list list-type="bullet"><list-item>
      <p id="d1e1270">The uncertainty width (UncW) – calculated by taking range of the minimum and
maximum LHS500 members each day and dividing it by the midpoint of the
LHS500 for that day. The mean of these values was then calculated over the
duration of the time series, as per<disp-formula id="Ch1.Ex1"><mml:math id="M31" display="block"><mml:mrow><mml:mstyle displaystyle="true"><mml:mfrac style="display"><mml:mn mathvariant="normal">1</mml:mn><mml:mi>n</mml:mi></mml:mfrac></mml:mstyle><mml:munderover><mml:mo movablelimits="false">∑</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:munderover><mml:mfenced close=")" open="("><mml:mstyle displaystyle="true"><mml:mfrac style="display"><mml:mrow><mml:msub><mml:mi mathvariant="normal">ens</mml:mi><mml:mi mathvariant="normal">max</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:msub><mml:mi mathvariant="normal">ens</mml:mi><mml:mi mathvariant="normal">min</mml:mi></mml:msub></mml:mrow><mml:mrow><mml:msub><mml:mi mathvariant="normal">ens</mml:mi><mml:mi mathvariant="normal">max</mml:mi></mml:msub><mml:mo>+</mml:mo><mml:msub><mml:mi mathvariant="normal">ens</mml:mi><mml:mi mathvariant="normal">min</mml:mi></mml:msub><mml:mo>/</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:mfrac></mml:mstyle></mml:mfenced><mml:mo>.</mml:mo></mml:mrow></mml:math></disp-formula></p></list-item><list-item>
      <p id="d1e1332">The containment ratio (ContR) – calculated as the percentage of days that
the observations fell within the envelope of the minimum and maximum of the
LHS500 ensemble members for that day.</p></list-item></list></p>
</sec>
<sec id="Ch1.S3.SS2.SSS3">
  <label>3.2.3</label><title>Ranking and selecting model parameterisations</title>
      <p id="d1e1343">In order to optimise six evaluation metrics, the 500 000 model
parameterisations were ranked from best to worst by their scores for each
metric in turn, and these ranks were then summed to create a total rank.
This total, or “basic”, rank was used to reorder the parameterisations for
each catchment from best to worst, accounting for all metrics. However, the
scores of the 500 000 model parameterisations were not normally distributed,
and it was found that unacceptable trade-offs between metrics were
occurring, whereby nominal increases in one metric were taking preference
over quite significant decreases in other metrics. Therefore, a series of
thresholds of acceptability were set, as shown in
Table 3. A simple iterative search algorithm was
then used to re-rank the list according to these thresholds, whilst
retaining their original ranks within each threshold group. For example, if
the first, third, and fourth parameterisations in the basic rank met the
hardest threshold for all six metrics, but the second ranked
parameterisation did not, the third and fourth would be bumped up the
rankings, above the second, resulting in a list of [1, 3, 4, 2 …]. All parameterisations meeting the hardest thresholds were prioritised
before the algorithm switched to search for those in meeting the middle
thresholds, and so on. From this final list, the top ranking optimum
parameter set was extracted for deterministic model applications, herein
referred to as LHS1. Due to the variability of the performance across
catchments, where hundreds of thousands of parameter sets met the hardest
threshold in some catchments, whilst none met even the softest threshold in
other catchments, it was decided that extracting behavioural parameter sets
using a “limit of acceptability” approach after Beven (2006)<?pagebreak page3252?> would
not be appropriate. Therefore, a proportion of the sampled model
parameterisations, the top 500 (herein referred to as LHS500), were taken
forward to provide an indication of parameter uncertainty within the flow
simulations. The extent to which the threshold re-ranking influenced the
rankings varied by catchment due to the differences in mode performance.
Figure 2 shows the NSE and logNSE scores of the
500 000 model parameterisations (though this graph has been limited to show
only those with positive scores for both metrics) for the River Greet in
the Severn Trent region. This figure demonstrates how the basic ranking system
identified 500 parameterisations close to the Pareto front of NSE vs. logNSE;
however; parameterisations with scores that were lower for NSE than logNSE
were selected. By applying the thresholds, parameterisations with an NSE
lower than 0.4 were rejected and replaced with others within the acceptable
range for all metrics.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F2"><?xmltex \currentcnt{2}?><label>Figure 2</label><caption><p id="d1e1348">Nash–Sutcliffe efficiency and log Nash–Sutcliffe efficiency
calibration scores for all sampled model parameterisations (grey), the top
500 from the basic ranking process (blue), and the top 500 after the
thresholds were applied to negate non-acceptable trade-offs (red). The <inline-formula><mml:math id="M32" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula> and <inline-formula><mml:math id="M33" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula> axes have been reversed and limited to show only parameterisations that
achieved positive scores. Scores of 1 would indicate perfect simulation of
the observations; optimal performance is in the bottom left of the graph.</p></caption>
            <?xmltex \igopts{width=236.157874pt}?><graphic xlink:href="https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019-f02.png"/>

          </fig>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T3" specific-use="star"><?xmltex \currentcnt{3}?><label>Table 3</label><caption><p id="d1e1374">Thresholds for selecting acceptable model parameterisations.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="7">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="right"/>
     <oasis:colspec colnum="3" colname="col3" align="right"/>
     <oasis:colspec colnum="4" colname="col4" align="right"/>
     <oasis:colspec colnum="5" colname="col5" align="right"/>
     <oasis:colspec colnum="6" colname="col6" align="right"/>
     <oasis:colspec colnum="7" colname="col7" align="right"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1"/>
         <oasis:entry colname="col2">NSE</oasis:entry>
         <oasis:entry colname="col3">absPBIAS</oasis:entry>
         <oasis:entry colname="col4">MAPE</oasis:entry>
         <oasis:entry colname="col5">logNSE</oasis:entry>
         <oasis:entry colname="col6"><inline-formula><mml:math id="M34" display="inline"><mml:mrow><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col7">MAM30<inline-formula><mml:math id="M35" display="inline"><mml:msub><mml:mi/><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:math></inline-formula></oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1">Optimum value</oasis:entry>
         <oasis:entry colname="col2">1</oasis:entry>
         <oasis:entry colname="col3">0</oasis:entry>
         <oasis:entry colname="col4">0</oasis:entry>
         <oasis:entry colname="col5">1</oasis:entry>
         <oasis:entry colname="col6">0</oasis:entry>
         <oasis:entry colname="col7">0</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Hardest</oasis:entry>
         <oasis:entry colname="col2">0.5</oasis:entry>
         <oasis:entry colname="col3">10</oasis:entry>
         <oasis:entry colname="col4">50</oasis:entry>
         <oasis:entry colname="col5">0.5</oasis:entry>
         <oasis:entry colname="col6">50</oasis:entry>
         <oasis:entry colname="col7">50</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Middle</oasis:entry>
         <oasis:entry colname="col2">0.4</oasis:entry>
         <oasis:entry colname="col3">15</oasis:entry>
         <oasis:entry colname="col4">75</oasis:entry>
         <oasis:entry colname="col5">0.4</oasis:entry>
         <oasis:entry colname="col6">75</oasis:entry>
         <oasis:entry colname="col7">75</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Softest</oasis:entry>
         <oasis:entry colname="col2">0.3</oasis:entry>
         <oasis:entry colname="col3">20</oasis:entry>
         <oasis:entry colname="col4">100</oasis:entry>
         <oasis:entry colname="col5">0.3</oasis:entry>
         <oasis:entry colname="col6">100</oasis:entry>
         <oasis:entry colname="col7">100</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Remainder</oasis:entry>
         <oasis:entry colname="col2"><inline-formula><mml:math id="M36" display="inline"><mml:mrow><mml:mi mathvariant="italic">&lt;</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:mn mathvariant="normal">0.3</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3"><inline-formula><mml:math id="M37" display="inline"><mml:mrow><mml:mi mathvariant="italic">&gt;</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:mn mathvariant="normal">20</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col4"><inline-formula><mml:math id="M38" display="inline"><mml:mrow><mml:mi mathvariant="italic">&gt;</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:mn mathvariant="normal">100</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col5"><inline-formula><mml:math id="M39" display="inline"><mml:mrow><mml:mi mathvariant="italic">&lt;</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:mn mathvariant="normal">0.3</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col6"><inline-formula><mml:math id="M40" display="inline"><mml:mrow><mml:mi mathvariant="italic">&gt;</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:mn mathvariant="normal">100</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col7"><inline-formula><mml:math id="M41" display="inline"><mml:mrow><mml:mi mathvariant="italic">&gt;</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:mn mathvariant="normal">100</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table></table-wrap>

</sec>
</sec>
<sec id="Ch1.S3.SS3">
  <label>3.3</label><title>Flow reconstructions</title>
      <p id="d1e1634">Using these 500 model parameterisations per catchment, and the rainfall and
potential evapotranspiration data described in Sect. 2, daily flow reconstructions were produced from
January 1891 to November 2015 for the 303 catchments. Details on accessing
this data are provided in the Data Availability section at the end of this
paper.</p>
</sec>
<sec id="Ch1.S3.SS4">
  <label>3.4</label><title>Standardised Streamflow Index (SSI)</title>
      <p id="d1e1645">The application of model results to drought analysis are conducted here
using the “Standardised Streamflow Index” (SSI). The SSI has for some
years been advocated as an equivalent to the Standardized Precipitation
Index (e.g. Vicente-Serrano et al., 2012), being based on
the cumulative probability of a given monthly mean streamflow occurring in a
given catchment. The procedure involves fitting a statistical distribution
to time series of accumulated streamflow over a baseline period, then
transforming the data to a normal distribution to produce a dimensionless
time series of the deviation of flow about the catchment mean. In this study,
SSI was calculated using the 12-month accumulation period (SSI-12) and the
Tweedie distribution (Svensson et al., 2017), over the baseline
period 1961–2010. A 12-month accumulation period was chosen to provide
summaries of<?pagebreak page3253?> long-term deficits that were likely to have significant impacts
on water resources. The Tweedie distribution, which is a flexible
three-parameter distribution that has a lower bound at zero, has been shown
to perform effectively for UK river flows, across a wide range of
near-natural Benchmark catchments  (Svensson et al., 2017).</p>
</sec>
<sec id="Ch1.S3.SS5">
  <label>3.5</label><title>Drought accumulated deficit</title>
      <p id="d1e1657">Using the SSI, accumulated over a 12-month
period, drought events were identified as periods where the SSI was
consecutively negative (i.e. below normal) with at least one month reaching
an SSI of <inline-formula><mml:math id="M42" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1.5</mml:mn></mml:mrow></mml:math></inline-formula>  (Barker et al., 2016). The sum of
monthly SSIs during these events was calculated to derive the accumulated
deficit  (e.g. Noone et al., 2017; Barker et al., 2019).</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F3"><?xmltex \currentcnt{3}?><label>Figure 3</label><caption><p id="d1e1672">The threshold met by the LHS1 model parameterisation (shape), and
the percentage of the LHS500 that met that threshold (colour), for the 303
study catchments. See Table 3 for the definition of
the thresholds.</p></caption>
          <?xmltex \igopts{width=236.157874pt}?><graphic xlink:href="https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019-f03.png"/>

        </fig>

<?xmltex \hack{\newpage}?>
</sec>
</sec>
<?pagebreak page3254?><sec id="Ch1.S4">
  <label>4</label><title>Results of model calibrations</title>
<sec id="Ch1.S4.SS1">
  <label>4.1</label><title>Model calibration statistics</title>
      <p id="d1e1700">The map in Fig. 3 shows the threshold (as set out
in Table 3) met by the LHS1 runs and the percentage
of the LHS500 members that met that threshold. The map shows that the LHS1
runs for 272 of the 303 catchments met the hardest threshold set (shown as
triangles). However, there is a lot of variability within these catchments,
with 82 demonstrating all of the LHS500 met the hardest threshold (black
triangles), whilst 108 have less than 10 % of the LHS500 above the hardest
threshold (yellow triangles). The LHS1 run for 20 of the catchments met the
“middle” threshold, and very few catchments performed worse than this,
having <inline-formula><mml:math id="M43" display="inline"><mml:mrow><mml:mi mathvariant="italic">&lt;</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:mn mathvariant="normal">0.4</mml:mn></mml:mrow></mml:math></inline-formula> for NSE and logNSE; <inline-formula><mml:math id="M44" display="inline"><mml:mrow><mml:mi mathvariant="italic">&gt;</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:mn mathvariant="normal">75</mml:mn></mml:mrow></mml:math></inline-formula> % for MAPE,
MAM30<inline-formula><mml:math id="M45" display="inline"><mml:msub><mml:mi/><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:math></inline-formula>, and <inline-formula><mml:math id="M46" display="inline"><mml:mrow><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>; and <inline-formula><mml:math id="M47" display="inline"><mml:mrow><mml:mi mathvariant="italic">&gt;</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:mn mathvariant="normal">15</mml:mn></mml:mrow></mml:math></inline-formula> % for absPBIAS (five catchments in the “softest” threshold, shown as circles, and six catchments
that failed to meet even the “softest” threshold, shown as crossed
circles). These localised examples of poor model performance (shown as
circles and crossed circles) may be due to the lack of snowmelt processes in
the model (in Scotland and north-eastern England), human influences such as
abstractions and water transfers or significant groundwater interactions (in
Anglian and southern England). For the Warleggan in Cornwall, poor
performance is due to underestimation of peak flows, which may be attributed
to an issue in simulating the localised geological outcrops.</p>

      <?xmltex \floatpos{p}?><fig id="Ch1.F4" specific-use="star"><?xmltex \currentcnt{4}?><label>Figure 4</label><caption><p id="d1e1760">Polar plots of the scores for six evaluation metrics over the
calibration period 1982–2014. Each blue bar and associated dot represents
one of the 303 catchments, plotted around the perimeter of the circle,
grouped by hydrometric region; see Fig. 1 for
region abbreviations. Dark blue dots represent the LHS1 run, and blue shaded
bars represent the range of the LHS500. The score is shown on the radial
axis, with the outside of the circle representing best model performance.</p></caption>
          <?xmltex \igopts{width=369.885827pt}?><graphic xlink:href="https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019-f04.png"/>

        </fig>

      <p id="d1e1769">Figure 4 shows the results of the six evaluation
metrics for each of the 305 flow reconstructions over the calibration period
(1982–2014), for both the LHS1 runs and the range of the LHS500. These polar
plots confirm the findings of Fig. 3, showing
that the model performance is generally very good, with most of the LHS1
runs for the 305 catchments satisfying the thresholds defined in
Table 3 with ease. This plot allows the assessment
of each performance metric individually and shows that performance varies
both between metrics and across catchments. The poorest scores, where the
LHS1 did not meet the softest threshold, can be mostly attributed to NSE, but
MAPE and MAM30<inline-formula><mml:math id="M48" display="inline"><mml:msub><mml:mi/><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:math></inline-formula> each also account for one failed catchment.
MAM30<inline-formula><mml:math id="M49" display="inline"><mml:msub><mml:mi/><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:math></inline-formula> shows the fewest LHS1 scores below the hardest threshold, and
NSE the most. LHS1 points are mostly on the extreme periphery of the
absPBIAS and MAM30<inline-formula><mml:math id="M50" display="inline"><mml:msub><mml:mi/><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:math></inline-formula> plots, demonstrating very good results, but
several catchments deviate quite substantially from this. <inline-formula><mml:math id="M51" display="inline"><mml:mrow><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>
exhibits a similar but not so strong pattern, whilst the LHS1 points for
NSE, logNSE, and MAPE are far more scattered. The ranges of the LHS500 scores
are also varied, with some very narrow ranges, particularly in the SE region
across all metrics. These narrow ranges show that the 500 ensemble members
are very similar in performance. Beyond the SE region, the ranges of model
performance among the LHS500 do not appear to show any regional pattern, but
are generally narrower for the NSE, logNSE, and MAPE metrics than absPBIAS,
MAM30<inline-formula><mml:math id="M52" display="inline"><mml:msub><mml:mi/><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:math></inline-formula>, and <inline-formula><mml:math id="M53" display="inline"><mml:mrow><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>. These results show that using this
multi-objective calibration procedure, all six of the evaluation metrics
were well optimised for the majority of catchments, providing confidence in
the application of the flows derived from these model calibrations across
the range of flow values.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F5" specific-use="star"><?xmltex \currentcnt{5}?><label>Figure 5</label><caption><p id="d1e1838"><bold>(a)</bold> Uncertainty width and <bold>(b)</bold> containment ratio over the
calibration period (water years 1982–2014) for all 303 study catchments. In
these maps, darker blue colours represent better scores.</p></caption>
          <?xmltex \igopts{width=398.338583pt}?><graphic xlink:href="https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019-f05.png"/>

        </fig>

      <p id="d1e1852">Figure 5 shows the scores of the uncertainty width
(UncW) and the containment ratio (ContR) for each of the 303 catchments. The
lower the UncW (a narrow range of model results among the 500 ensemble
members), and the higher the ContR (a high proportion of the observations
fitting within the band of model runs), the more accurate and reliable the
simulation. In these results, there appears to be a correlation between
UncW and ContR (Pearson correlation 0.52, with significance, <inline-formula><mml:math id="M54" display="inline"><mml:mi>p</mml:mi></mml:math></inline-formula> value
<inline-formula><mml:math id="M55" display="inline"><mml:mrow><mml:mn mathvariant="normal">2.2</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mn mathvariant="normal">10</mml:mn><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">16</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>): where UncW is high (which can be seen as poor), the ContR is also
high (seen as good), and vice versa. This highlights the need to consider
both of these elements when assessing the confidence in the model, as a low
UncW with a low ContR would suggest a biased and under-sensitive model.
Catchments with the smallest UncW associated with low ContR are located in
central southern England, parts of north-eastern England, and eastern Scotland.
Whilst attribution of the cause of this modelling deficiency is difficult
and out of scope here, it is possibly linked with the “flashiness” of the
catchment, which can be due to groundwater and human influences (southern
England and parts of north-eastern England), and snowmelt (eastern Scotland).
In the majority of the catchments (250 of 303), the ContR is greater than
80 %, but the UncW is also greater than the mean flow in 189 of those
catchments.</p>
      <p id="d1e1880">These graphs represent an overview of the performance of the model
calibrations across the UK. The model performance for individual catchments,
as well as time series of the reconstructed flow data from 1891–2015, can be
explored in more detail using the interactive web application at <uri>https://shiny-apps.ceh.ac.uk/reconstruction_explorer/</uri> (Centre for Ecology &amp; Hydrology, 2018a).</p>

      <?xmltex \floatpos{p}?><fig id="Ch1.F6"><?xmltex \currentcnt{6}?><label>Figure 6</label><caption><p id="d1e1888">Polar heat map showing <inline-formula><mml:math id="M56" display="inline"><mml:mrow><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> scores calculated over 30-year
moving windows for all available water years of observed flow data. Each bar
represents one of the 303 catchments, plotted around the perimeter of the
circle and grouped by hydrometric region; see
Figure 1 for region abbreviations. The starting
year of the 30-year window is represented on the radial axis with 1891
plotted towards the centre of the circle. Catchments with longer
observational records have longer bars. The shading of the bars represent
the <inline-formula><mml:math id="M57" display="inline"><mml:mrow><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> scores, with darker colours being optimum. The hardest
(H), middle (M), and softest (S) thresholds are labelled on the legend.</p></caption>
          <?xmltex \igopts{width=236.157874pt}?><graphic xlink:href="https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019-f06.png"/>

        </fig>

</sec>
<sec id="Ch1.S4.SS2">
  <label>4.2</label><title>30-year model validation statistics</title>
      <?pagebreak page3256?><p id="d1e1931">In order to evaluate the integrity of the reconstructed flow series, in the
earlier pre-calibration parts of the record, the six evaluation metrics for
the LHS1 runs specified in Table 2, as well as the
uncertainty width and the containment ratio for the LHS500, were calculated
over 30-year moving windows for all water years where flow observations
were available. These results have been plotted as polar heat maps in a
similar way to the polar plots showing the evaluation metrics over the
calibration period. Figure 6 shows the heat map for
<inline-formula><mml:math id="M58" display="inline"><mml:mrow><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>, whilst all eight heat maps are provided in Supplement Fig. S1. In these figures, the catchments with longer observational time series
are shown as longer bars that originate nearer the centre of the circles.
Here it can be seen that observations for most catchments began after the
1960s, and only 12 catchments have observations prior to the 1940s. The two
longest series in the SE region are the Lee at Feildes Weir
(plotted at the boundary with the Anglian region) and the Thames at Kingston
(plotted three catchments further clockwise). Long records can also be seen
in the Dee in eastern Scotland (ES) and the Severn in the Severn Trent (ST)
region.</p>
      <p id="d1e1947">In general, across all metrics and catchments, the scores are very stable:
where bars are dark or pale, showing good and poorer model performance
respectively, they remain similar colours throughout their length. There are
some exceptions, which are most notable in the catchments with longer
observational records. The Avon at Evesham in the ST region, the Dee at Manley
Hall in the north-western England and northern Wales (NWENW) region, and the Bedford Ouse
catchment in the Anglian (ANG) region show reduced model performance earlier in
the record, with the bars moving through orange and yellow shades as they
stretch towards the centre of the circle. It is worth noting, though, that
these catchments are not part of the near-natural Benchmark Network
(Harrigan et al., 2017) and have had reported issues with
inhomogeneity in their observed records as a result of human influences. The
Lee at Feildes Weir in the SE region (plotted at the boundary with the ANG region)
also shows variation in performance across most metrics, although in this
catchment, the performance is good (plotted in black) at the start and end
of the record, with poorer performance (shown in yellow) around the start years of 1920–1940 (evaluation years of 1920 to 1970). In contrast to this,
the Dee at Woodend in eastern Scotland and the Severn at Bewdley in Severn
Trent region, which have the longest records in their regions, show more
temporal stability in the model performances (with black colouring for the
whole bar). This,<?pagebreak page3257?> coupled with the generally very stable results over the
20–30 years prior to the calibration period among with the catchments with
shorter records, demonstrates that the flow series produced for this study
are suitable for use in longer temporal studies, outside of the period of
calibration (1982–2014).</p>
</sec>
</sec>
<sec id="Ch1.S5">
  <label>5</label><title>Reconstructions of drought events</title>
      <p id="d1e1959">In this section, the nine case study catchments (shown in
Fig. 1) are used to examine the performance of
both the LHS1 and the LHS500 modelled flows at simulating drought events.</p><?xmltex \hack{\newpage}?>
<sec id="Ch1.S5.SS1">
  <label>5.1</label><title>The 1975–1976 drought event</title>
      <p id="d1e1970">The 1975–1976 event was chosen as a case study period to test the model's
capability to reconstruct drought events. This event occurs before the model
calibration period of 1982–2014 and was one of the most severe and
widespread droughts of the 20th century in the UK  (Marsh et
al., 2007). Summary statistics showing the model performance for these
catchments during both the calibration period (1982–2014) and the 10-year
period surrounding this significant drought event (1971–1980) are provided
in the Supplement  Table S1. It is worth noting that the
observational records in the Bush and Crimple did not begin until 1972, nor
the Greet until 1974.</p>

      <?xmltex \floatpos{p}?><fig id="Ch1.F7" specific-use="star"><?xmltex \currentcnt{7}?><label>Figure 7</label><caption><p id="d1e1975">Monthly mean flows for 1970–1980. Each of the LHS500 ensemble members are shown in grey, with the LHS1 run shown in black, and the observations shown in red. The <inline-formula><mml:math id="M59" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula> axis is presented on a log scale in order to allow better visualisation of low flows.</p></caption>
          <?xmltex \igopts{width=611.734252pt, angle=90}?><graphic xlink:href="https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019-f07.png"/>

        </fig>

<sec id="Ch1.S5.SS1.SSS1">
  <label>5.1.1</label><title>Flow time series</title>
      <p id="d1e1998">SSI data for the LHS1 runs have been calculated for all 303 catchments and are freely available (Barker et al., 2018; see Data availability). These data, along with summaries of extracted drought events over space and time, can also be explored using an interactive web application at <uri>https://shiny-apps.ceh.ac.uk/hydro_drought_explorer/</uri> (Centre for Ecology &amp; Hydrology, 2018b). For this paper, the SSI has been calculated for the LHS500 for the nine case study catchments in order to evaluate how well the ensemble simulations reproduce the drought event accumulated deficit. The plots in Fig. 7 show observed and simulated
monthly flow for the years 1971 to 1980. Here, the simulations in each
catchment capture the variability of the observational record well; however,
the model results show differing ensemble ranges between catchments. The
range of the LHS500 members (referred to as the uncertainty width in Table S1) appears in the graphs to be much wider in the Avon, Greet, and Tove than
in the Dee, Cree, and Lambourn, but this is not reflected in the statistics.
This is likely due to the higher inherent variability or “flashiness” in
the Dee and Cree over the Avon that is affecting the visualisation of the
uncertainty width (UncW) in the graphs. The Lambourn does have a
particularly narrow UncW (0.23 over the 10-year period), but the Dee and
the Cree have some of the largest UncW values (1.44 and 1.46 respectively), with
the Crimple showing the highest (1.52). It is evident that where the UncW is
low, the observations are more likely to fall outside of this range; with
the exception of the Lambourn at 52 %, the ContR across the catchments for
this period is very high (exceeding 73 %), and there are very few
instances where the observations fall outside of the range of the model
ensemble members.</p>
      <?pagebreak page3259?><p id="d1e2004">In the Crimple, the UncW is especially wide during low flow events, and the
observations lie very close to the lowest of these model runs; however, the
LHS1 run lies close to the observational flow values. In other catchments,
such as the Otter, the observed and LHS1 flows sit more centrally within the
range of the LHS500. In the Avon, the observations sit centrally within the
uncertainty range, but the LHS1 run overestimates low flows. The LHS1
flows for the Cree tend to underestimate the low flows. The Avon and the
Bush display poor scores in the low flows metrics MAM30<inline-formula><mml:math id="M60" display="inline"><mml:msub><mml:mi/><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:math></inline-formula> and
<inline-formula><mml:math id="M61" display="inline"><mml:mrow><mml:mi>Q</mml:mi><mml:msub><mml:mn mathvariant="normal">95</mml:mn><mml:mi mathvariant="normal">APE</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> compared with other catchments during the 1971–1980 period. The
inclusion of low flow evaluation metrics in the LHS calibration procedure
does not appear to have heavily impacted the performance of the model during
high flows. The high flows that followed the 1975–1976 drought event are very
well simulated, with the exception of the Lambourn and the Greet where there
are slight discrepancies in the monthly peak flows.</p>

      <?xmltex \floatpos{p}?><fig id="Ch1.F8" specific-use="star"><?xmltex \currentcnt{8}?><label>Figure 8</label><caption><p id="d1e2031">Daily flow time series for the 1975–1976 drought event in each of the nine case study catchments. The <inline-formula><mml:math id="M62" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula> axis is presented on a log scale in order to allow better visualisation of low flows.</p></caption>
            <?xmltex \igopts{width=611.734252pt, angle=90}?><graphic xlink:href="https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019-f08.png"/>

          </fig>

      <p id="d1e2048">Daily flows for January 1975–December 1976 (shown in
Fig. 8) highlight the difference in variability
between the catchments in the northern and southern parts of the UK. The
variability is generally well simulated, though the GR4J model exhibits some
difficulty in simulating the low flow variability in the southern
catchments, with very little inter-monthly variability in the simulated
discharge, although significant peaks are identified among the ensemble
members. Note that the abnormal peaks of the observational record on the
Lambourn in September–December of both 1975 and 1976 are the result of the West
Berkshire Groundwater Scheme (WBGS) that was implemented during the drought
to alleviate the extreme low flows, and these are not accounted for in the model,
which has no human influence representation. Generally, LHS1 simulations are
low among the LHS500 runs in the Cree, Bush, and the Crimple (as seen in the
monthly plots) but are close to the observations. This indicates that
selecting the “best” simulation where a deterministic result is needed is
more appropriate, in these cases, than extracting a mean or median from the
ensemble.</p>
      <p id="d1e2051">As with the monthly flows, the Avon and the Bush show systematic
overestimation of the low flows by the LHS1 run, whilst the Cree shows
underestimation of low flows, with the exception of the most extreme low
flows in July–September 1976. These mixed results that can be seen for the nine
case study catchments highlight the variation in model performance among the
303 modelled catchments and emphasise the need for users to carefully
appraise the evaluation metrics of the flow simulations for the catchments
they are investigating. However, these catchments were deliberately selected
to explore these variations, and the results shown in Sect. 4 demonstrate that the model performs well across a
wide range of different catchment types at the national scale.</p>
</sec>
<sec id="Ch1.S5.SS1.SSS2">
  <label>5.1.2</label><title>Standardised Streamflow Index (SSI)</title>
      <p id="d1e2063">SSI data for the LHS1 runs have been calculated for all 303 catchments and
are freely available  (Barker et al. 2018; see
Data availability) but have also been calculated
here for the LHS500 for the nine case study catchments. These data are used
to evaluate how well the ensemble simulations reproduce the drought event
accumulated deficit. For low flows, we consider SSI values of <inline-formula><mml:math id="M63" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:math></inline-formula> to <inline-formula><mml:math id="M64" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1.5</mml:mn></mml:mrow></mml:math></inline-formula> to
indicate a moderate hydrological drought, <inline-formula><mml:math id="M65" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1.5</mml:mn></mml:mrow></mml:math></inline-formula> to <inline-formula><mml:math id="M66" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:math></inline-formula> a severe drought, and
SSI values below <inline-formula><mml:math id="M67" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:math></inline-formula> an extreme drought  (after Barker et al., 2016; McKee
et al., 1993).</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F9" specific-use="star"><?xmltex \currentcnt{9}?><label>Figure 9</label><caption><p id="d1e2118">Standardised Streamflow Index (SSI) using a 12-month accumulation period for nine case study catchments over the years 1971–1980. SSI values of 0, as well as those representing moderate (<inline-formula><mml:math id="M68" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:math></inline-formula>), severe (<inline-formula><mml:math id="M69" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1.5</mml:mn></mml:mrow></mml:math></inline-formula>), and extreme (<inline-formula><mml:math id="M70" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:math></inline-formula>) drought are shown as dashed horizontal lines on the <inline-formula><mml:math id="M71" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula> axis.</p></caption>
            <?xmltex \igopts{width=611.734252pt, angle=90}?><graphic xlink:href="https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019-f09.png"/>

          </fig>

      <p id="d1e2164">Here, the SSI time series for the same 10-year period (1971 to 1980) are
appraised and shown in Fig. 9. The uncertainty
widths in the SSI plots shown vary substantially between catchments
and directly reflect the ranges seen in the flow time series: with the
Lambourn showing a very low UncW from the LHS500, whilst the Greet, Tove, and
Otter show a wider range. In the Lambourn, Dee, and Bush catchments, the SSI
derived from the observations frequently falls outside of the range of the
LHS500, showing a low containment ratio (ContR). This behaviour is more
pronounced in the SSI time series than the flow time series. The Dee
catchment, for example, produced a ContR of 92.6 % for the daily flow data
over 1971–1980, but the SSI-12 ContR is just 30 %. It is noticeable that
the UncW values of the SSI data are fairly even throughout the time series, whilst
in the flow data, they appear to be wider during the more extreme high and
low flow periods. There are two factors which may have contributed to these
differences: firstly that the smoothed nature of the SSI-12 reduces the
short-term variability of the data (the ContR of the SSI-1 are closer to
those of the flow data), and secondly, when deriving the SSI, the tails of
the fitted distribution are more uncertain than for the average flows, which
may result in convergence of the SSI values for the more extreme members of
the LHS500 during periods of high and low flows.</p>
      <p id="d1e2168">For the Lambourn, the negative SSI values (below normal flows) are
underestimated and the positive SSI values (above normal flows) are
overestimated showing the model is overemphasising the extreme events. In
the Avon catchment the most extreme SSI deficit occurs in 1973, and the 1976
event is classed as “severe” but not “extreme” for the observations and
all but a few of the LHS500. The deficit in 1973 is simulated as being more
extreme than the observations, but the 1976 event is better captured. The
uncertainty range in the Greet catchment is very wide, particularly for the
SSI peak (drought termination) in 1977; however, the 1976 SSI deficit has a
lower range among the LHS500. For the Tove, the SSI of the 1976 drought
event is well simulated, as are those for the Crimple, despite some
underestimation of SSI at other times in the 1970s. The Otter shows very
good simulation of SSI-12 during this 10-year period.</p>
      <p id="d1e2171">SSI time series plots over the longer period 1975 to 2015 are provided in
Fig. S2. These plots show that although
the exact magnitudes of the SSI deficits and excesses are not always
captured by the model in some of the poorer performing catchments, the
pattern of the SSI-12, the shape of the peaks and the troughs are very well
represented.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F10" specific-use="star"><?xmltex \currentcnt{10}?><label>Figure 10</label><caption><p id="d1e2176">Accumulated deficits of extracted drought events (using a
threshold of SSI <inline-formula><mml:math id="M72" display="inline"><mml:mrow><mml:mi mathvariant="italic">&lt;</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1.5</mml:mn></mml:mrow></mml:math></inline-formula>) for nine case study catchments over the
years 1975 to 2015. Circles are plotted along the <inline-formula><mml:math id="M73" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula> axis according to the
date of the mid-point of the extracted drought event. The circle size
represents the magnitude of the accumulated deficit. Drought events
extracted from the observed data are shown in red (with a thick circle for
visibility). Events extracted from the 500 ensemble members are shown with
thinner black circles (these circles are semi-transparent; where these
circles appear black, multiple ensemble members are simulating the event,
and where they are thick, the ensemble members show different accumulated
deficit values). Multiple, overlapping black circles suggest discrepancies
in the timing of the drought event among the ensemble members.</p></caption>
            <?xmltex \igopts{width=398.338583pt}?><graphic xlink:href="https://hess.copernicus.org/articles/23/3247/2019/hess-23-3247-2019-f10.png"/>

          </fig>

</sec>
</sec>
<sec id="Ch1.S5.SS2">
  <label>5.2</label><title>Drought event accumulated deficits</title>
      <?pagebreak page3262?><p id="d1e2214">This section explores the accumulated deficits of extracted drought events
between 1975 and 2015 (the common observed period for all nine catchments),
which are presented in Fig. 10.</p>
      <p id="d1e2217">This plot shows that drought events are generally in good synchrony across
the country. For these nine catchments, four major nationwide drought events
using SSI-12 are evident: 1975–1978, 1989–1993, 1997–1998, and 2004–2006.
Regional droughts include 1984 in the northern catchments and 2010–2012,
which affected England and Wales, but not Scotland and Northern Ireland.
There appears to be a relatively “drought-poor” period in the south
between 1977 and 1988, whilst the north shows a lack of droughts in the more
recent period of 2006–2015.</p>
      <p id="d1e2220">The observed events are very well captured by the model simulations. There
are only four out of a total of 40 observed drought events across all nine
catchments that are not detected by the simulated drought events: an event
in 1992 in the Crimple, 1994 and 2004 in the Dee, and 2006 in the Cree. In
each of these cases, the SSI of the model simulations fall below <inline-formula><mml:math id="M74" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:math></inline-formula>, but do
not reach <inline-formula><mml:math id="M75" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1.5</mml:mn></mml:mrow></mml:math></inline-formula> (see Fig. S2), suggesting an overestimation of low flows,
and therefore a slight underestimation of the drought deficit for this
event. In contrast, there are some drought events that are identified from
the model simulations that are not evident in the observed record, for
example 1998 in the Avon and the Bush. In these events the model
underestimates the flow and therefore overestimates the drought deficit. In
the Bush, this underestimation of flow continues during the low flow periods
of 2002 and 2003–2006.</p>
      <p id="d1e2243">In terms of timing and deficit, the 1995–1998 drought event demonstrates the
most confidence among the simulations. The Crimple catchment shows some
uncertainty about the timing of each of the events, and the majority of the
LHS500 model simulations place the 2004–2006 event later than the
observation. In Fig. S2, it can be see that this is due to the fact that
the intensity of the 2005 deficit was overemphasised by the model.
Similarly, in Fig. 10, the 1975–1978 event in the
Bush shows a wide range of mid-point dates (centre of the circles), and the
deficit also varies. Overall, the deficits of the events are well captured
by the modelled data: for example, the 2004–2006 event in the north showed
smaller deficits than the 1975–1978 event, and the modelled deficits reflect
these differences. The modelled results for the 1997–1998 event in the Greet
show two possible event timings, and the thickness of the circles indicates
some<?pagebreak page3263?> differences in the simulated accumulated deficit among the model
parameterisations, though these differences are relatively small.</p>
      <p id="d1e2247">On balance, the pattern of drought events is well simulated by the GR4J
model, despite some small differences in magnitude and timing, with
magnitude being better estimated than the timing. These results demonstrate
that, despite the issues seen in the SSI time series plots, the dataset can
provide good estimates of drought events and their characteristics. This
highlights the potential of the model to reproduce hydrological drought
events using just precipitation and evapotranspiration data and shows that
the reconstructed flow time series will be valuable in appraising historic
hydrological droughts over a longer period and wider spatial domain than the
observations that are available.</p>
</sec>
</sec>
<sec id="Ch1.S6">
  <label>6</label><title>Discussion</title>
      <p id="d1e2259">The multi-objective calibration framework presented in this paper has
produced modelled flow data with demonstrable high performance across a wide
range of available observed records. This framework has been developed to
enable nationally and temporally coherent flow simulation that can be
applied to a wealth of applications, past, present, and future. In this
paper, the calibration framework has been applied to a wide range of
catchments across the UK, allowing for a detailed exploration of model
performance across different hydrological regimes. Two potentially limiting
factors in model performance were highlighted in this study: snowmelt and
human influences.</p>
      <p id="d1e2262">The airGR snowmelt module was not employed in this study as only 15 of the
303 catchments showed snowmelt fractions greater than 0.15 (15 %). These
catchments were located along 10 rivers, all in Scotland. Despite the lack
of snowmelt processes here, all of the catchments met at least the
“softest” evaluation thresholds set out in Sect. 3.2.3, with six, eight, and one catchment meeting the
hardest, middle, and softest thresholds respectively. This implies that
snowmelt only causes modelling issues for high-altitude Scottish catchments.</p>
      <p id="d1e2265">Human interactions are a common problem in hydrological modelling that
remain largely understudied  (Calvin and Bond-Lamberty, 2018). Whilst
global scale models have been advancing in socio-hydrology, making use of
satellite information and governmental estimates of total water consumption,
the data to support such endeavours is lacking (Bierkens, 2015).
Small-scale catchment models would need to rely on significant amounts of
abstraction and licencing data as well as reservoir operation procedures,
the details of which are often sensitive and/or unavailable. The lack of
abstraction processes in GR4J is likely to be responsible for some reduced
model performance, particularly in the regions of Anglian and southern
England. The loss function (parameter X2 “inter-catchment exchange
coefficient”) of the GR4J model can account for some systematic losses or
gains; however, human influence is often non-stationary (e.g. construction
and operation of reservoirs, irrigation, and water transfer schemes). For the
Lee at Fieldes Weir and the Thames at Kingston naturalised river flow data,
which attempt to remove the impact of human activity on the observed flow,
were available. Whilst not included in this paper for consistency with the
other 301 catchments, calibration scores were slightly better for the
naturalised flow data in these catchments, though both naturalised and
observed calibrations easily met the hardest thresholds. An alternative
approach is to focus studies on the “near-natural” catchments, which are
deemed to have minimal human influence. Of the 303 catchments included in
this study, 115 are classified as near-natural and are part of the Low Flows
Benchmark Network (Harrigan et al., 2017). Since many of the UK's
most significant catchments are heavily influenced, they were not excluded
from this study, and the model does successfully manage to implicitly
account for human influences in these large rivers. Localised issues in the
model's performance, and therefore the quality of the reconstructed flow
data, highlight the need for users to take caution when choosing a
catchment from this set of 303. Depending on their needs, an alternative
nearby catchment where model performance is better may be more suitable if
model performance is poor in the initially selected catchment.</p>
      <p id="d1e2268">The modelling framework developed in this study has explored model parameter
uncertainty in order to account for equifinality  (Beven, 2006).
A total of 500 000 parameter realisations were run, and the best 500 of these were
selected for each catchment to allow for uncertainty quantification in
applications of these flow data. Here, the uncertainty in the model runs was
shown to vary more between catchments than over time (from 1890 to 2015, where
long observational records were available). Whilst model parameter
uncertainty was considered in this study, further sources of uncertainty can
contribute to variations in model performance, including model input data
(precipitation and PET), flow data used for model calibration, and the
choice of hydrological model  (Smith et al., 2018b).</p>
      <p id="d1e2272">The impact of precipitation uncertainty has been shown to be more
significant than PET in hydrological modelling  (Paturel et al., 1995;
Bastola et al., 2011; Guo et al., 2017).  Perry and Hollis (2005)
and  Legg (2015) state that the accuracy of gridded data is
dependent on the density of the rain gauge network, with greater errors
associated with sparse coverage. Therefore errors in the reconstructed
precipitation data applied in this study will be higher in the early part of
the record when the station density was lower. Since the model is calibrated
to the more recent period 1982–2014, uncertainty from the rainfall data may
propagate through to the flow reconstructions in the early part of the
record. However, from the moving window analysis of model performance (see
Fig. 6), there does not appear to be significant
degradation in the quality of flow simulations in the early part of the
record.<?pagebreak page3264?> Tanguy et al. (2018) considered the impact of
poorer quality and lower density of temperature data on the derivation of
the PET dataset that was employed in this study and concluded that, whilst
PET is an important variable for predicting runoff, the influence of
degraded PET input that results from low quality temperature data on runoff
simulation can be limited by the adequate calibration of hydrological models
(Bai et al., 2016; Seiller and Anctil, 2016). Thus, the
Tanguy et al. (2018) PET dataset is considered suitable
for use in hydrological models, especially if they are calibrated to this
dataset.</p>
      <p id="d1e2275">Uncertainties may also arise from the observational flow data used to
calibrate models. Uncertainties from the precision of the instruments that
measure the water level (stage) and uncertainties from the derivation of
the stage-discharge relationship are both particularly sensitive in the
extreme flow ranges. For example, a 10 mm error in stage measurement at the
Q95 flow can result in a 20 % error in flow for around a third of the UK's
gauging stations  (National River Flow Archive, 2019). The dataset used
in this study was taken from a reputable source (the NRFA) who, in order to
minimise such errors, conduct rigorous quality control procedures using both
automatic and manual validation procedures annually  (Dixon et
al., 2013). Nevertheless, hydrometric data quality does vary across the
network and errors tend to cluster in the extreme flow ranges, so
hydrometric uncertainty could be influential in some periods in catchments
used herein – we recommend users consult the NRFA's extensive station and
catchment metadata (available at <uri>https://nrfa.ceh.ac.uk/</uri>) in
conjunction with model performance information  (Smith et al.,
2018a) when using the flow reconstructions.</p>
      <p id="d1e2281">Whilst the parameter uncertainty in the model was evaluated here, applying
different model types and model structures can also yield dramatically
different results. Many multi-model experiments have been conducted to
assess the differences between hydrological models  (e.g. Warszawski et
al., 2014; Vansteenkiste et al., 2014). Similarly, different structures of
the same model (e.g. GR4J, GR5J, and GR6J) can influence the results.
However,  Smith (2016) found that model parameter uncertainty can be
as wide as that from using different hydrological models, and initial
testing of the GR5J and GR6J models showed significant parameter
interactions that resulted in poor simulations in many UK catchments. It was
therefore decided that considering the parameter uncertainty of the GR4J
model would be sufficient to devise an ensemble of flow reconstructions for
this dataset and study. Future work will investigate these simulations
against a wider set of model runs using other model structures as part of a
follow-up study.</p>
      <p id="d1e2284">The modelling framework developed here has been shown to be fit-for-purpose
for drought reconstruction, across a very wide range of catchment
behaviours. The reconstructed series can be used to shed light on historical
drought occurrence, characteristics (severity, duration, termination,
seasonality), and variability. A first exploration of hydrological drought
using the reconstructions is presented in a companion paper by
Barker et al. (2019). The data can also be used to support
drought and water resources planning activities, whether directly or to
provide context for stochastic approaches to drought generation. Ensembles
of historical drought events can be used to provide insight into the
probabilities of the termination of a current event over a certain time
period  (e.g. Parry et al., 2018). Knowledge of historic events
can also be used to explore statistical correlations with atmospheric
drivers of droughts that may help predict the onset of events
(e.g. Lavers et al., 2015). In these approaches, extending
the hydrological record by <inline-formula><mml:math id="M76" display="inline"><mml:mrow><mml:mo>∼</mml:mo><mml:mn mathvariant="normal">70</mml:mn></mml:mrow></mml:math></inline-formula> years significantly increases
the sample of historic drought events from which to conduct such research.
Furthermore, the modelled data may be used to extend streamflow records used
in seasonal hydrological forecasting with a hydrological analogue method
(e.g. Svensson, 2016). The model calibrations may be applied
to studies of the impacts of climate change on future hydrological extremes
in the UK, such as in the Future Flows Hydrology project
(Haxton et al., 2012), the outputs of which have been
widely applied by water resources managers. The modelling framework
developed in this study could extend the Future Flows Hydrology research
using the more recent UKCP18 data (Met Office Hadley Centre, 2018).
However, as with the Future Flows Hydrology project, users will need to be
aware of the implications of the lack of artificial influence processes in
the model.</p>
</sec>
<sec id="Ch1.S7" sec-type="conclusions">
  <label>7</label><title>Conclusions</title>
      <p id="d1e2305">In this paper, a novel multi-objective calibration method was derived and
tested for 303 catchments in the UK, and the calibrations were used to
reconstruct river flows back to 1891. The GR4J model was applied and
calibrated using Latin hypercube sampling (LHS) and six evaluation metrics
simultaneously to allow for the evaluation of high, median, and low flows,
thus optimising the calibrations for a wide range of potential applications.
A best run (LHS1) and 500 model parameterisations (LHS500) were used to
assess model uncertainty. Overall, the multi-objective calibration procedure
has yielded excellent model results when compared to the observations, with
the exception of only a few catchments. The reconstructed flows were
appraised over 30-year moving windows, and were shown to provide good
simulations of flow in the early parts of the record, where observations
were available. Model performance and uncertainty during drought events was
explored in nine case study catchments, and varied by catchment. The model
simulations were used to derive the Standardised Streamflow Index, which
allowed for an assessment of the model's ability to simulate significant
deviations from a catchment's “norm”. The results showed that, despite
observations regularly sitting outside the range of the LHS500, the peaks
and troughs of the time series<?pagebreak page3265?> were well represented. Drought event
accumulated deficits were extracted from the SSI data and the results were
overall very good, demonstrating that the data from these model calibrations
are suitable for the identification and characterisation of hydrological
drought events in the UK.</p>
      <p id="d1e2308">The contributions of this paper are threefold: firstly, the multi-objective
model calibration framework applied here has been shown to provide robust
model calibrations that can be applied in studies of both general and
extreme hydrology. This framework could be applied elsewhere across Europe,
and indeed globally, to allow for spatially and temporally consistent
simulations of hydrology with far reaching potential applications. Secondly,
the model calibrations that have been derived for these 303 catchments in
the UK can be used in further research and operational applications, such as
for seasonal hydrological forecasting, or for assessing changes in river
flows under climate change. Finally, this study has produced a crucial
dataset of <inline-formula><mml:math id="M77" display="inline"><mml:mrow><mml:mo>∼</mml:mo><mml:mn mathvariant="normal">125</mml:mn></mml:mrow></mml:math></inline-formula> years of seamless flow reconstructions across
the UK that will allow for the spatial and temporal investigation and
quantification of past drought events, as well as long-term trends in flows,
that have never before been possible. These methods and results can provide
a valuable step forward in our ability to plan for and forecast the onset,
duration, and termination of drought events in the UK, and overseas.</p>
</sec>

      
      </body>
    <back><notes notes-type="dataavailability"><title>Data availability</title>

      <p id="d1e2325">The potential evapotranspiration dataset used in this study is
freely available from the Environmental Information Data Centre
(Tanguy et al., 2017, <ext-link xlink:href="https://doi.org/10.5285/17b9c4f7-1c30-4b6f-b2fe-f7780159939c" ext-link-type="DOI">10.5285/17b9c4f7-1c30-4b6f-b2fe-f7780159939c</ext-link>).</p>

      <p id="d1e2331">Observed river flow data was accessed via the National
River Flow Archive, which provides daily and peak river flows for the UK for
over 1500 gauging stations (<uri>https://nrfa.ceh.ac.uk/</uri>)</p>

      <p id="d1e2337">The flow reconstructions produced in this study are
freely available on the Environmental Information Data Centre
(EIDC, <ext-link xlink:href="https://doi.org/10.5285/f710bed1-e564-47bf-b82c-4c2a2fe2810e" ext-link-type="DOI">10.5285/f710bed1-e564-47bf-b82c-4c2a2fe2810e</ext-link>, Smith et al., 2018a) along with associated metadata on
the model performance. The LHS1 and LHS500 model runs are provided
separately within the EIDC dataset. The LHS1 files includes the
deterministic simulation based on the LHS1 parameter set, plus the upper and
lower daily limits from the LHS500 to allow for the interpretation of the
parameter uncertainty without the need to assess the full ensemble. It
should be noted, however, that these upper and lower bounds cannot be
implemented as time series in their own right as they do not represent
individual ensemble members, and are instead comprised of multiple runs. The
LHS500 files contain all 500 time series, and each catchment has a metadata
file providing performance of each of the 500 runs for that catchment. The
performance of the model in each catchment, as well as the reconstructed
flow time series, can be explored using an interactive web application at
<uri>https://shiny-apps.ceh.ac.uk/reconstruction_explorer/</uri> (Centre for Ecology &amp; Hydrology, 2018a).</p>

      <p id="d1e2346">The Standardised Streamflow Index data derived from the LHS1 runs
are also freely available from the Environmental Information Data Centre
(Barker et al., 2018, <ext-link xlink:href="https://doi.org/10.5285/58ef13a9-539f-46e5-88ad-c89274191ff9" ext-link-type="DOI">10.5285/58ef13a9-539f-46e5-88ad-c89274191ff9</ext-link>). This SSI data, along with further
event analyses, can be explored using an interactive web application at
<uri>https://shiny-apps.ceh.ac.uk/hydro_drought_explorer/</uri> (Centre for Ecology &amp; Hydrology, 2018b).</p>
  </notes><app-group>
        <supplementary-material position="anchor"><p id="d1e2355">The supplement related to this article is available online at: <inline-supplementary-material xlink:href="https://doi.org/10.5194/hess-23-3247-2019-supplement" xlink:title="pdf">https://doi.org/10.5194/hess-23-3247-2019-supplement</inline-supplementary-material>.</p></supplementary-material>
        </app-group><notes notes-type="authorcontribution"><title>Author contributions</title>

      <p id="d1e2364">TPL and MT provided input data for the modelling. CP, SP, JH, and SH assisted
KAS in designing the modelling framework. KAS calibrated the model, ran the
reconstructions, and produced the plots. LJB calculated the SSI data and
extracted drought events from the reconstructions. All authors contributed
to the production of the manuscript, and its revisions.</p>
  </notes><notes notes-type="competinginterests"><title>Competing interests</title>

      <p id="d1e2371">The authors declare that they have no conflict of interest.</p>
  </notes><ack><title>Acknowledgements</title><p id="d1e2377">This research is an outcome of two projects, funded by the Natural
Environment Research Council Drought and Water Scarcity Programme: Analysis
of Historic Droughts and Water Scarcity in the UK (grant number NE/L01016X/1), and Improving Predictions of Drought for User Decision-Making
[IMPETUS, grant number NE/L010267/1]. The authors would also like to thank
the developers of the airGR model at IRSTEA for their guidance.</p></ack><notes notes-type="financialsupport"><title>Financial support</title>

      <p id="d1e2382">This research has been supported by the Natural Environment Research Council (grant nos. NE/L01016X/1 and NE/L010267/1).</p>
  </notes><notes notes-type="reviewstatement"><title>Review statement</title>

      <p id="d1e2388">This paper was edited by Nunzio Romano and reviewed by James Stagge and two anonymous referees.</p>
  </notes><ref-list>
    <title>References</title>

      <ref id="bib1.bib1"><label>1</label><?label 1?><mixed-citation>
Anderton, S., Ledbetter, R., and Prudhomme, C.: Understanding the
performance of water supply systems during mild to extreme droughts,
Environment Agency, Horizon House, Deanery Road, Bristol, BS1 5AH, 2015.</mixed-citation></ref>
      <ref id="bib1.bib2"><label>2</label><?label 1?><mixed-citation>
Atkins: Thames Water Stochastic Resource Modelling: Stage 2&amp;3 Report,
Atkins, 2016.</mixed-citation></ref>
      <ref id="bib1.bib3"><label>3</label><?label 1?><mixed-citation>Bai, P., Liu, X., Yang, T., Li, F., Liang, K., Hu, S., and Liu, C.:
Assessment of the Influences of Different Potential Evapotranspiration
Inputs on the Performance of Monthly Hydrological Models under Different
Climatic Conditions, J. Hydrometeorol., 17, 2259–2274,
<ext-link xlink:href="https://doi.org/10.1175/jhm-d-15-0202.1" ext-link-type="DOI">10.1175/jhm-d-15-0202.1</ext-link>, 2016.</mixed-citation></ref>
      <ref id="bib1.bib4"><label>4</label><?label 1?><mixed-citation>Barker, L. J., Hannaford, J., Chiverton, A., and Svensson, C.: From meteorological to hydrological drought using standardised indicators, Hydrol. Earth Syst. Sci., 20, 2483–2505, <ext-link xlink:href="https://doi.org/10.5194/hess-20-2483-2016" ext-link-type="DOI">10.5194/hess-20-2483-2016</ext-link>, 2016.</mixed-citation></ref>
      <ref id="bib1.bib5"><label>5</label><?label 1?><mixed-citation>Barker, L. J., Smith, K. A., Svensson, C., Tanguy, M., and Hannaford, J.:
Historic Standardised Streamflow Index (SSI) usin<?pagebreak page3266?>g Tweedie distribution with
standard period 1961–2010 for 303 UK catchments (1891–2015), NERC
Environmental Information Data Centre,
<ext-link xlink:href="https://doi.org/10.5285/58ef13a9-539f-46e5-88ad-c89274191ff9" ext-link-type="DOI">10.5285/58ef13a9-539f-46e5-88ad-c89274191ff9</ext-link>, 2018.</mixed-citation></ref>
      <ref id="bib1.bib6"><label>6</label><?label 1?><mixed-citation>Barker, L. J., Hannaford, J., Parry, S., Smith, K. A., Tanguy, M., and Prudhomme, C.: Historic hydrological droughts 1891–2015: systematic characterisation for a diverse set of catchments across the UK, Hydrol. Earth Syst. Sci. Discuss., <ext-link xlink:href="https://doi.org/10.5194/hess-2019-202" ext-link-type="DOI">10.5194/hess-2019-202</ext-link>, in review, 2019.</mixed-citation></ref>
      <ref id="bib1.bib7"><label>7</label><?label 1?><mixed-citation>Bastola, S., Murphy, C., and Sweeney, J.: The sensitivity of fluvial flood
risk in Irish catchments to the range of IPCC AR4 climate change scenarios,
Sci. Total Environ., 409, 5403–5415,
<ext-link xlink:href="https://doi.org/10.1016/j.scitotenv.2011.08.042" ext-link-type="DOI">10.1016/j.scitotenv.2011.08.042</ext-link>, 2011.</mixed-citation></ref>
      <ref id="bib1.bib8"><label>8</label><?label 1?><mixed-citation>Beven, K.: A manifesto for the equifinality thesis, J. Hydrol.,
320, 18–36, <ext-link xlink:href="https://doi.org/10.1016/j.jhydrol.2005.07.007" ext-link-type="DOI">10.1016/j.jhydrol.2005.07.007</ext-link>, 2006.</mixed-citation></ref>
      <ref id="bib1.bib9"><label>9</label><?label 1?><mixed-citation>
Beven, K.: Rainfall-Runoff Modelling: The Primer, Second Edition, Second
ed., Wiley-Blackwell, Chichester, 457 pp., 2012.</mixed-citation></ref>
      <ref id="bib1.bib10"><label>10</label><?label 1?><mixed-citation>
Beven, K. and Binley, A.: The Future of Distributed Models –  Model
Calibration and Uncertainty Prediction, Hydrol. Process., 6, 279–298,
1992.</mixed-citation></ref>
      <ref id="bib1.bib11"><label>11</label><?label 1?><mixed-citation>
Beven, K. and Freer, J.: Equifinality, data assimilation, and uncertainty
estimation in mechanistic modelling of complex environmental systems using
the GLUE methodology, J. Hydrol., 249, 11–29, 2001.</mixed-citation></ref>
      <ref id="bib1.bib12"><label>12</label><?label 1?><mixed-citation>Bierkens, M. F. P.: Global hydrology 2015: State, trends, and directions,
Water Resour. Res., 51, 4923–4947, <ext-link xlink:href="https://doi.org/10.1002/2015wr017173" ext-link-type="DOI">10.1002/2015wr017173</ext-link>, 2015.</mixed-citation></ref>
      <ref id="bib1.bib13"><label>13</label><?label 1?><mixed-citation>
Brázdil, R., Dobrovolný, P., Trnka, M., Büntgen, U.,
Řezníčková, L., Kotyza, O., Valášek, H., and
Štĕpánek, P.: Documentary and instrumental-based drought indices
for the Czech Lands back to AD 1501, Clim. Res., 70, 103–117, 2016.</mixed-citation></ref>
      <ref id="bib1.bib14"><label>14</label><?label 1?><mixed-citation>Brigode, P., Brissette, F., Nicault, A., Perreault, L., Kuentz, A., Mathevet, T., and Gailhard, J.: Streamflow variability over the 1881–2011 period in northern Québec: comparison of hydrological reconstructions based on tree rings and geopotential height field reanalysis, Clim. Past, 12, 1785–1804, <ext-link xlink:href="https://doi.org/10.5194/cp-12-1785-2016" ext-link-type="DOI">10.5194/cp-12-1785-2016</ext-link>, 2016.</mixed-citation></ref>
      <ref id="bib1.bib15"><label>15</label><?label 1?><mixed-citation>Broderick, C., Matthews, T., Wilby, R. L., Bastola, S., and Murphy, C.:
Transferability of hydrological models and ensemble averaging methods
between contrasting climatic periods, Water Resour. Res., 52,
8343–8373, <ext-link xlink:href="https://doi.org/10.1002/2016WR018850" ext-link-type="DOI">10.1002/2016WR018850</ext-link>, 2016.</mixed-citation></ref>
      <ref id="bib1.bib16"><label>16</label><?label 1?><mixed-citation>Caillouet, L., Vidal, J.-P., Sauquet, E., Devers, A., and Graff, B.: Ensemble reconstruction of spatio-temporal extreme low-flow events in France since 1871, Hydrol. Earth Syst. Sci., 21, 2923–2951, <ext-link xlink:href="https://doi.org/10.5194/hess-21-2923-2017" ext-link-type="DOI">10.5194/hess-21-2923-2017</ext-link>, 2017.</mixed-citation></ref>
      <ref id="bib1.bib17"><label>17</label><?label 1?><mixed-citation>Calvin, K. and Bond-Lamberty, B.: Integrated human-earth system
modeling–state of the science and future directions, Environ.
Res. Lett., 13, 063006, <ext-link xlink:href="https://doi.org/10.1088/1748-9326/aac642" ext-link-type="DOI">10.1088/1748-9326/aac642</ext-link>, 2018.</mixed-citation></ref>
      <ref id="bib1.bib18"><label>18</label><?label 1?><mixed-citation>Casty, C., Raible, C. C., Stocker, T. F., Wanner, H., and Luterbacher, J.: A
European pattern climatology 1766–2000, Clim. Dynam., 29, 791–805, <ext-link xlink:href="https://doi.org/10.1007/s00382-007-0257-6" ext-link-type="DOI">10.1007/s00382-007-0257-6</ext-link>, 2007.</mixed-citation></ref>
      <ref id="bib1.bib19"><label>19</label><?label 1?><mixed-citation>
Cheng, J. and Druzdzel, M. J.: Latin Hypercube Sampling in Bayesian
Networks, American Association for Artificial Intelligence, Pittsburgh,
2000.</mixed-citation></ref>
      <ref id="bib1.bib20"><label>20</label><?label 1?><mixed-citation>Centre for Ecology &amp; Hydrology:   UK Reconstructed Flow Data Explorer, available at:  <uri>https://shiny-apps.ceh.ac.uk/reconstruction_explorer/</uri> (last access: 23 July 2019), 2018a.</mixed-citation></ref>
      <ref id="bib1.bib21"><label>21</label><?label 1?><mixed-citation>Centre for Ecology &amp; Hydrology: UK Hydrological Drought Explorer, available at:  <uri>https://shiny-apps.ceh.ac.uk/hydro_drought_explorer/</uri> (last access: 23 July 2019), 2018b.</mixed-citation></ref>
      <ref id="bib1.bib22"><label>22</label><?label 1?><mixed-citation>Christierson, B. V., Vidal, J.-P., and Wade, S. D.: Using UKCP09
probabilistic climate information for UK water resource planning, J.
Hydrol., 424–425, 48–67,
<ext-link xlink:href="https://doi.org/10.1016/j.jhydrol.2011.12.020" ext-link-type="DOI">10.1016/j.jhydrol.2011.12.020</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bib23"><label>23</label><?label 1?><mixed-citation>Collet, L., Harrigan, S., Prudhomme, C., Formetta, G., and Beevers, L.: Future hot-spots for hydro-hazards in Great Britain: a probabilistic assessment, Hydrol. Earth Syst. Sci., 22, 5387–5401, <ext-link xlink:href="https://doi.org/10.5194/hess-22-5387-2018" ext-link-type="DOI">10.5194/hess-22-5387-2018</ext-link>, 2018.</mixed-citation></ref>
      <ref id="bib1.bib24"><label>24</label><?label 1?><mixed-citation>Compo, G. P., Whitaker, J. S., Sardeshmukh, P. D., Matsui, N., Allan, R. J.,
Yin, X., Gleason, B. E., Vose, R. S., Rutledge, G., Bessemoulin, P.,
Brönnimann, S., Brunet, M., Crouthamel, R. I., Grant, A. N., Groisman,
P. Y., Jones, P. D., Kruk, M. C., Kruger, A. C., Marshall, G. J., Maugeri,
M., Mok, H. Y., Nordli, Ø., Ross, T. F., Trigo, R. M., Wang, X. L.,
Woodruff, S. D., and Worley, S. J.: The Twentieth Century Reanalysis
Project, Q. J. Roy. Meteor. Soc., 137, 1–28,
<ext-link xlink:href="https://doi.org/10.1002/qj.776" ext-link-type="DOI">10.1002/qj.776</ext-link>, 2011.</mixed-citation></ref>
      <ref id="bib1.bib25"><label>25</label><?label 1?><mixed-citation>Cook, E. R., Seager, R., Kushnir, Y., Briffa, K. R., Büntgen, U., Frank,
D., Krusic, P. J., Tegel, W., van der Schrier, G., Andreu-Hayles, L.,
Baillie, M., Baittinger, C., Bleicher, N., Bonde, N., Brown, D., Carrer, M.,
Cooper, R., Čufar, K., Dittmar, C., Esper, J., Griggs, C., Gunnarson,
B., Günther, B., Gutierrez, E., Haneca, K., Helama, S., Herzig, F.,
Heussner, K.-U., Hofmann, J., Janda, P., Kontic, R., Köse, N., Kyncl,
T., Levanič, T., Linderholm, H., Manning, S., Melvin, T. M., Miles, D.,
Neuwirth, B., Nicolussi, K., Nola, P., Panayotov, M., Popa, I., Rothe, A.,
Seftigen, K., Seim, A., Svarva, H., Svoboda, M., Thun, T., Timonen, M.,
Touchan, R., Trotsiuk, V., Trouet, V., Walder, F., Ważny, T., Wilson,
R., and Zang, C.: Old World megadroughts and pluvials during the Common Era,
Science Advances, 1, e1500561, <ext-link xlink:href="https://doi.org/10.1126/sciadv.1500561" ext-link-type="DOI">10.1126/sciadv.1500561</ext-link>, 2015.</mixed-citation></ref>
      <ref id="bib1.bib26"><label>26</label><?label 1?><mixed-citation>Coron, L., Thirel, G., Delaigue, O., Perrin, C., and Andréassian, V.:
The Suite of Lumped GR Hydrological Models in an R package, Environ.
Modell. Softw., 94, 166–171, <ext-link xlink:href="https://doi.org/10.1016/j.envsoft.2017.05.002" ext-link-type="DOI">10.1016/j.envsoft.2017.05.002</ext-link>, 2017.</mixed-citation></ref>
      <ref id="bib1.bib27"><label>27</label><?label 1?><mixed-citation>Dawson, C. W., Abrahart, R. J., and See, L. M.: HydroTest: A web-based
toolbox of evaluation metrics for the standardised assessment of
hydrological forecasts, Environ. Modell. Softw., 22,
1034–1052, <ext-link xlink:href="https://doi.org/10.1016/j.envsoft.2006.06.008" ext-link-type="DOI">10.1016/j.envsoft.2006.06.008</ext-link>,
2007.</mixed-citation></ref>
      <ref id="bib1.bib28"><label>28</label><?label 1?><mixed-citation>
Day, G. N.: Extended Streamflow Forecasting using NWSRFS, J. Water Res.
Pl., 111, 642–654, 1985.</mixed-citation></ref>
      <ref id="bib1.bib29"><label>29</label><?label 1?><mixed-citation>Dixon, H., Hannaford, J., and Fry, M. J.: The effective management of
national hydrometric data: experiences from the United Kingdom, Hydrolog.
Sci. J., 58, 1383–1399, <ext-link xlink:href="https://doi.org/10.1080/02626667.2013.787486" ext-link-type="DOI">10.1080/02626667.2013.787486</ext-link>, 2013.</mixed-citation></ref>
      <ref id="bib1.bib30"><label>30</label><?label 1?><mixed-citation>
Duan, Q., Gupta, V. K., and Sorooshian, S.: Shuffled complex evolution
approach for effective and efficient global minimization, J.
Optimiz. Theory Appl., 76, 501–521, 1993.</mixed-citation></ref>
      <ref id="bib1.bib31"><label>31</label><?label 1?><mixed-citation>Efstratiadis, A. and Koutsoyiannis, D.: One decade of multi-objective
calibration approaches in hydrological modelling: a review, Hydrolog.
Sci. J., 55, 58–78, <ext-link xlink:href="https://doi.org/10.1080/02626660903526292" ext-link-type="DOI">10.1080/02626660903526292</ext-link>, 2010.</mixed-citation></ref>
      <ref id="bib1.bib32"><label>32</label><?label 1?><mixed-citation>GRDC: The Global Runoff Data Base,  D-56002
Koblenz, Germany, <uri>https://www.bafg.de/GRDC/EN/02_srvcs/21_tmsrs/riverdischarge_node.html</uri>,
2019.</mixed-citation></ref>
      <?pagebreak page3267?><ref id="bib1.bib33"><label>33</label><?label 1?><mixed-citation>Guerreiro, S. B., Dawson, R. J., Kilsby, C., Lewis, E., and Ford, A.: Future
heat-waves, droughts and floods in 571 European cities, Environ.
Res. Lett., 13, 034009, <ext-link xlink:href="https://doi.org/10.1088/1748-9326/aaaad3" ext-link-type="DOI">10.1088/1748-9326/aaaad3</ext-link>, 2018.</mixed-citation></ref>
      <ref id="bib1.bib34"><label>34</label><?label 1?><mixed-citation>Guo, D., Westra, S., and Maier, H. R.: Use of a scenario-neutral approach to
identify the key hydro-meteorological attributes that impact runoff from a
natural catchment, J. Hydrol., 554, 317–330,
<ext-link xlink:href="https://doi.org/10.1016/j.jhydrol.2017.09.021" ext-link-type="DOI">10.1016/j.jhydrol.2017.09.021</ext-link>, 2017.</mixed-citation></ref>
      <ref id="bib1.bib35"><label>35</label><?label 1?><mixed-citation>Harrigan, S., Hannaford, J., Muchan, K., and Marsh, T.: Designation and
trend analysis of the updated UK Benchmark Network of river flow stations:
The UKBN2 dataset, Hydrol. Res., 29, 552–567, <ext-link xlink:href="https://doi.org/10.2166/nh.2017.058" ext-link-type="DOI">10.2166/nh.2017.058</ext-link>, 2017.</mixed-citation></ref>
      <ref id="bib1.bib36"><label>36</label><?label 1?><mixed-citation>Harrigan, S., Prudhomme, C., Parry, S., Smith, K., and Tanguy, M.: Benchmarking ensemble streamflow prediction skill in the UK, Hydrol. Earth Syst. Sci., 22, 2023–2039, <ext-link xlink:href="https://doi.org/10.5194/hess-22-2023-2018" ext-link-type="DOI">10.5194/hess-22-2023-2018</ext-link>, 2018.</mixed-citation></ref>
      <ref id="bib1.bib37"><label>37</label><?label 1?><mixed-citation>Haxton, T., Crooks, S., Jackson, C. R., Barkwith, A. K. A. P., Kelvin, J.,
Williamson, J., Mackay, J. D., Wang, L., Davies, H., Young, A., and
Prudhomme, C.: Future flows hydrology data, NERC Environmental Information
Data Centre,
<ext-link xlink:href="https://doi.org/10.5285/f3723162-4fed-4d9d-92c6-dd17412fa37b" ext-link-type="DOI">10.5285/f3723162-4fed-4d9d-92c6-dd17412fa37b</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bib38"><label>38</label><?label 1?><mixed-citation>Herman, J. D., Zeff, H. B., Lamontagne, J. R., Reed, P. M., and Characklis,
G. W.: Synthetic Drought Scenario Generation to Support Bottom-Up Water
Supply Vulnerability Assessments, J. Water Res. Plan.
Man., 142, 04016050, <ext-link xlink:href="https://doi.org/10.1061/(ASCE)WR.1943-5452.0000701" ext-link-type="DOI">10.1061/(ASCE)WR.1943-5452.0000701</ext-link>, 2016.</mixed-citation></ref>
      <ref id="bib1.bib39"><label>39</label><?label 1?><mixed-citation>HM Government:  UK Climate Change Risk Assessment 2017: Presented to Parliament pursuant to Section 56 of the Climate Change Act 2008, available at: <uri>https://www.gov.uk/government/publications/uk-climate-change-risk-assessment-2017</uri> (last access: 23 July 2019), 2017.</mixed-citation></ref>
      <ref id="bib1.bib40"><label>40</label><?label 1?><mixed-citation>Jones, P. D. and Lister, D. H.: Riverflow reconstructions for 15 catchments
over England and Wales and an assessment of hydrologic drought since 1865,
Int. J. Climatol., 18, 999–1013, <ext-link xlink:href="https://doi.org/10.1002/(sici)1097-0088(199807)18:9&lt;999::aid-joc300&gt;3.0.co;2-8" ext-link-type="DOI">10.1002/(sici)1097-0088(199807)18:9&lt;999::aid-joc300&gt;3.0.co;2-8</ext-link>, 1998.</mixed-citation></ref>
      <ref id="bib1.bib41"><label>41</label><?label 1?><mixed-citation>Jones, P. D., Briffa, K. R., and Pilcher, J. R.: Riverflow reconstruction
from tree rings in southern Britain, J. Climatol., 4, 461–472, <ext-link xlink:href="https://doi.org/10.1002/joc.3370040502" ext-link-type="DOI">10.1002/joc.3370040502</ext-link>, 1984.</mixed-citation></ref>
      <ref id="bib1.bib42"><label>42</label><?label 1?><mixed-citation>Jones, P. D., Lister, D. H., Wilby, R. L., and Kostopoulou, E.: Extended
riverflow reconstructions for England and Wales, 1865–2002, International
J. Climatol., 26, 219–231, <ext-link xlink:href="https://doi.org/10.1002/joc.1252" ext-link-type="DOI">10.1002/joc.1252</ext-link>, 2006.</mixed-citation></ref>
      <ref id="bib1.bib43"><label>43</label><?label 1?><mixed-citation>Jung, D., Choi, Y. H., and Kim, J.: Multiobjective Automatic Parameter Calibration of a Hydrological Model, Water,  9,  187, <ext-link xlink:href="https://doi.org/10.3390/w9030187" ext-link-type="DOI">10.3390/w9030187</ext-link>, 2017.</mixed-citation></ref>
      <ref id="bib1.bib44"><label>44</label><?label 1?><mixed-citation>Kamali, B., Mousavi, S. J., and Abbaspour, K. C.: Automatic calibration of
HEC-HMS using single-objective and multi-objective PSO algorithms,
Hydrol. Process., 27, 4028–4042, <ext-link xlink:href="https://doi.org/10.1002/hyp.9510" ext-link-type="DOI">10.1002/hyp.9510</ext-link>, 2013.</mixed-citation></ref>
      <ref id="bib1.bib45"><label>45</label><?label 1?><mixed-citation>Kay, A. L., Bell, V. A., Guillod, B. P., Jones, R. G., and Rudd, A. C.:
National-scale analysis of low flow frequency: historical trends and
potential future changes, Climatic Change, 147, 585–599, <ext-link xlink:href="https://doi.org/10.1007/s10584-018-2145-y" ext-link-type="DOI">10.1007/s10584-018-2145-y</ext-link>, 2018.</mixed-citation></ref>
      <ref id="bib1.bib46"><label>46</label><?label 1?><mixed-citation>Kim, S. M., Benham, B. L., Brannan, K. M., Zeckoski, R. W., and Doherty, J.:
Comparison of hydrologic calibration of HSPF using automatic and manual
methods, Water Resour. Res., 43,  W01402, <ext-link xlink:href="https://doi.org/10.1029/2006wr004883" ext-link-type="DOI">10.1029/2006wr004883</ext-link>, 2007.</mixed-citation></ref>
      <ref id="bib1.bib47"><label>47</label><?label 1?><mixed-citation>
Krause, P., Boyle, D. P., and Bäse, F.: Comparison of differenct
efficiency criteria for hydrological model assessment, Adv.
Geosci., 5, 89–97, 2005.</mixed-citation></ref>
      <ref id="bib1.bib48"><label>48</label><?label 1?><mixed-citation>
Kundzewicz, Z. W. and Matczak, P.: Hydrological extremes and security,
P. Int. Ass. Hydrol. Sci., 366,
44–53, 2015.</mixed-citation></ref>
      <ref id="bib1.bib49"><label>49</label><?label 1?><mixed-citation>Lavers, D. A., Hannah, D. M., and Bradley, C.: Connecting large-scale
atmospheric circulation, river flow and groundwater levels in a chalk
catchment in southern England, J. Hydrol., 523, 179–189,
<ext-link xlink:href="https://doi.org/10.1016/j.jhydrol.2015.01.060" ext-link-type="DOI">10.1016/j.jhydrol.2015.01.060</ext-link>, 2015.</mixed-citation></ref>
      <ref id="bib1.bib50"><label>50</label><?label 1?><mixed-citation>Legg, T.: Uncertainties in gridded area-average monthly temperature,
precipitation and sunshine for the United Kingdom, Int. J.
Climatol., 35, 1367–1378, <ext-link xlink:href="https://doi.org/10.1002/joc.4062" ext-link-type="DOI">10.1002/joc.4062</ext-link>, 2015.</mixed-citation></ref>
      <ref id="bib1.bib51"><label>51</label><?label 1?><mixed-citation>Marsh, T., Cole, G., and Wilby, R.: Major droughts in England and Wales,
1800–2006, Weather, 62, 87–93, <ext-link xlink:href="https://doi.org/10.1002/wea.67" ext-link-type="DOI">10.1002/wea.67</ext-link>, 2007.</mixed-citation></ref>
      <ref id="bib1.bib52"><label>52</label><?label 1?><mixed-citation>Marx, A., Kumar, R., Thober, S., Rakovec, O., Wanders, N., Zink, M., Wood, E. F., Pan, M., Sheffield, J., and Samaniego, L.: Climate change alters low flows in Europe under global warming of 1.5, 2, and 3 <inline-formula><mml:math id="M78" display="inline"><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup></mml:math></inline-formula>C, Hydrol. Earth Syst. Sci., 22, 1017–1032, <ext-link xlink:href="https://doi.org/10.5194/hess-22-1017-2018" ext-link-type="DOI">10.5194/hess-22-1017-2018</ext-link>, 2018.</mixed-citation></ref>
      <ref id="bib1.bib53"><label>53</label><?label 1?><mixed-citation>
McGuinness, J. L. and Bordne, E. F.: A Comparison of Lysimeter-Derived
Potential Evapotranspiration With Computed Values, United States Department
of Agriculture, Economic Research Service, 1972.</mixed-citation></ref>
      <ref id="bib1.bib54"><label>54</label><?label 1?><mixed-citation>
McKay, M. D., Beckman, R. J., and Conover, W. J.: Comparison of three
methods for selecting values of input variables in the analysis of output
from a computer code, Technometrics, 21, 239–245, 1979.</mixed-citation></ref>
      <ref id="bib1.bib55"><label>55</label><?label 1?><mixed-citation>
McKee, T. B., Doeksen, N. J., and Kleist, J.: The relationship of drought
frequency and duration to time scales, Eighth Conference on Applied
Climatology, Anaheim, California, 1993.</mixed-citation></ref>
      <ref id="bib1.bib56"><label>56</label><?label 1?><mixed-citation>Mens, M. J. P., Gilroy, K., and Williams, D.: Developing system robustness analysis for drought risk management: an application on a water supply reservoir, Nat. Hazards Earth Syst. Sci., 15, 1933–1940, <ext-link xlink:href="https://doi.org/10.5194/nhess-15-1933-2015" ext-link-type="DOI">10.5194/nhess-15-1933-2015</ext-link>, 2015.</mixed-citation></ref>
      <ref id="bib1.bib57"><label>57</label><?label 1?><mixed-citation>Met Office: UKCP09: Met Office gridded land surface climate observations –
daily temperature and precipitation at 5km resolution, Centre for
Environmental Data Analysis, available at: <uri>http://catalogue.ceda.ac.uk/uuid/319b3f878c7d4cbfbdb356e19d8061d6</uri> (last access: 23 July 2019), 2017.</mixed-citation></ref>
      <ref id="bib1.bib58"><label>58</label><?label 1?><mixed-citation>Met Office Hadley Centre: UKCP18 Probabilistic Climate Projections, Centre
for Environmental Data Analysis, available at: <uri>http://catalogue.ceda.ac.uk/uuid/9842e395f2d04f48a177c3550756bf98</uri> (last access: 23 July 2019), 2018.</mixed-citation></ref>
      <ref id="bib1.bib59"><label>59</label><?label 1?><mixed-citation>
Monteith, J. L.: Evaporation and Environment, Symposium of the Society for
Experimental Biology, 19, 205–234, 1965.</mixed-citation></ref>
      <ref id="bib1.bib60"><label>60</label><?label 1?><mixed-citation>
Mostafaie, A., Forootan, E., Safari, A., and Schumacher, M.: Comparing
multi-objective optimization techniques to calibrate a conceptual
hydrological model using in situ runoff and daily GRACE data, Comput.
Geosci., 22, 789–814, 2018.</mixed-citation></ref>
      <ref id="bib1.bib61"><label>61</label><?label 1?><mixed-citation>
Nash, J. E. and Sutcliffe, J. V.: River flow forecasting through conceptual
models part I – A discussion of principles, J. Hydrol., 10,
282–290, 1970.</mixed-citation></ref>
      <ref id="bib1.bib62"><label>62</label><?label 1?><mixed-citation>National River Flow Archive: Accuracy and Fitness for Purpose, available at: <uri>https://nrfa.ceh.ac.uk/accuracy-fitness-for-purpose</uri>, last access: 23 July 2019.</mixed-citation></ref>
      <?pagebreak page3268?><ref id="bib1.bib63"><label>63</label><?label 1?><mixed-citation>New, M., Hulme, M., and Jones, P.: Representing Twentieth-Century
Space–Time Climate Variability. Part II: Development of 1901–96 Monthly
Grids of Terrestrial Surface Climate, Anglais, 13, 2217–2238, <ext-link xlink:href="https://doi.org/10.1175/1520-0442(2000)013&lt;2217:Rtcstc&gt;2.0.Co;2" ext-link-type="DOI">10.1175/1520-0442(2000)013&lt;2217:Rtcstc&gt;2.0.Co;2</ext-link>, 2000.</mixed-citation></ref>
      <ref id="bib1.bib64"><label>64</label><?label 1?><mixed-citation>Noone, S., Broderick, C., Duffy, C., Matthews, T., Wilby, R. L., and Murphy,
C.: A 250-year drought catalogue for the island of Ireland (1765–2015),
Int. J. Climatol., 37, 239–254, <ext-link xlink:href="https://doi.org/10.1002/joc.4999" ext-link-type="DOI">10.1002/joc.4999</ext-link>,
2017.</mixed-citation></ref>
      <ref id="bib1.bib65"><label>65</label><?label 1?><mixed-citation>
Northumbrian Water: Draft Drought Plan 2018, Northumbrian Water, Durham,
20–21, 2017.</mixed-citation></ref>
      <ref id="bib1.bib66"><label>66</label><?label 1?><mixed-citation>Parry, S., Wilby, R., Prudhomme, C., Wood, P., and McKenzie, A.:
Demonstrating the utility of a drought termination framework: prospects for
groundwater level recovery in England and Wales in 2018 or beyond,
Environ. Res. Lett., 13, 064040, <ext-link xlink:href="https://doi.org/10.1088/1748-9326/aac78c" ext-link-type="DOI">10.1088/1748-9326/aac78c</ext-link>, 2018.</mixed-citation></ref>
      <ref id="bib1.bib67"><label>67</label><?label 1?><mixed-citation>Paturel, J. E., Servat, E., and Vassiliadis, A.: Sensitivity of conceptual
rainfall-runoff algorithms to errors in input data – case of the GR2M
model, J. Hydrol., 168, 111–125,
<ext-link xlink:href="https://doi.org/10.1016/0022-1694(94)02654-T" ext-link-type="DOI">10.1016/0022-1694(94)02654-T</ext-link>, 1995.</mixed-citation></ref>
      <ref id="bib1.bib68"><label>68</label><?label 1?><mixed-citation>Perrin, C., Michel, C., and Andréassian, V.: Improvement of a
parsimonious model for streamflow simulation, J. Hydrol., 279,
275–289, <ext-link xlink:href="https://doi.org/10.1016/S0022-1694(03)00225-7" ext-link-type="DOI">10.1016/S0022-1694(03)00225-7</ext-link>, 2003.</mixed-citation></ref>
      <ref id="bib1.bib69"><label>69</label><?label 1?><mixed-citation>Perry, M. and Hollis, D.: The generation of monthly gridded datasets for a
range of climatic variables over the UK, Int. J.
Climatol., 25, 1041–1054, <ext-link xlink:href="https://doi.org/10.1002/joc.1161" ext-link-type="DOI">10.1002/joc.1161</ext-link>, 2005.</mixed-citation></ref>
      <ref id="bib1.bib70"><label>70</label><?label 1?><mixed-citation>Pfister, C., Weingartner, R., and Luterbacher, J.: Hydrological winter
droughts over the last 450 years in the Upper Rhine basin: a methodological
approach, Hydrolog. Sci. J., 51, 966–985, <ext-link xlink:href="https://doi.org/10.1623/hysj.51.5.966" ext-link-type="DOI">10.1623/hysj.51.5.966</ext-link>,
2006.</mixed-citation></ref>
      <ref id="bib1.bib71"><label>71</label><?label 1?><mixed-citation>Prudhomme, C., Young, A., Watts, G., Haxton, T., Crooks, S., Williamson, J.,
Davies, H., Dadson, S., and Allen, S.: The drying up of Britain? A national
estimate of changes in seasonal river flows from 11 Regional Climate Model
simulations, Hydrol. Process., 26, 1115–1118, <ext-link xlink:href="https://doi.org/10.1002/hyp.8434" ext-link-type="DOI">10.1002/hyp.8434</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bib72"><label>72</label><?label 1?><mixed-citation>Prudhomme, C., Hannaford, J., Harrigan, S., Boorman, D., Knight, J., Bell,
V., Jackson, C., Svensson, C., Parry, S., Bachiller-Jareno, N., Davies, H.,
Davis, R., Mackay, J., McKenzie, A., Rudd, A., Smith, K., Bloomfield, J.,
Ward, R., and Jenkins, A.: Hydrological Outlook UK: an operational
streamflow and groundwater level forecasting system at monthly to seasonal
time scales, Hydrolog. Sci. J., 62, 2753–2768, <ext-link xlink:href="https://doi.org/10.1080/02626667.2017.1395032" ext-link-type="DOI">10.1080/02626667.2017.1395032</ext-link>, 2017.</mixed-citation></ref>
      <ref id="bib1.bib73"><label>73</label><?label 1?><mixed-citation>Pushpalatha, R., Perrin, C., Le Moine, N., Mathevet, T., and
Andréassian, V.: A downward structural sensitivity analysis of
hydrological models to improve low-flow simulation, J. Hydrol.,
411, 66–76,  <ext-link xlink:href="https://doi.org/10.1016/j.jhydrol.2011.09.034" ext-link-type="DOI">10.1016/j.jhydrol.2011.09.034</ext-link>,
2011.</mixed-citation></ref>
      <ref id="bib1.bib74"><label>74</label><?label 1?><mixed-citation>Seiller, G. and Anctil, F.: How do potential evapotranspiration formulas
influence hydrological projections?, Hydrolog. Sci. J., 61,
2249–2266, <ext-link xlink:href="https://doi.org/10.1080/02626667.2015.1100302" ext-link-type="DOI">10.1080/02626667.2015.1100302</ext-link>, 2016.</mixed-citation></ref>
      <ref id="bib1.bib75"><label>75</label><?label 1?><mixed-citation>Shafii, M. and De Smedt, F.: Multi-objective calibration of a distributed hydrological model (WetSpa) using a genetic algorithm, Hydrol. Earth Syst. Sci., 13, 2137–2149, <ext-link xlink:href="https://doi.org/10.5194/hess-13-2137-2009" ext-link-type="DOI">10.5194/hess-13-2137-2009</ext-link>, 2009.</mixed-citation></ref>
      <ref id="bib1.bib76"><label>76</label><?label 1?><mixed-citation>
Smith, K.: Investigating Uncertainty in Global Hydrology Modelling, Doctor
of Philosophy, School of Geography, University of Nottingham, Nottingham,
338 pp., 2016.</mixed-citation></ref>
      <ref id="bib1.bib77"><label>77</label><?label 1?><mixed-citation>Smith, K. A., Tanguy, M., Hannaford, J., and Prudhomme, C.: Historic
reconstructions of daily river flow for 303 UK catchments (1891–2015), NERC
Environmental Information Data Centre,  <ext-link xlink:href="https://doi.org/10.5285/f710bed1-e564-47bf-b82c-4c2a2fe2810e" ext-link-type="DOI">10.5285/f710bed1-e564-47bf-b82c-4c2a2fe2810e</ext-link>, 2018a.</mixed-citation></ref>
      <ref id="bib1.bib78"><label>78</label><?label 1?><mixed-citation>Smith, K. A., Wilby, R. L., Broderick, C., Prudhomme, C., Matthews, T.,
Harrigan, S., and Murphy, C.: Navigating Cascades of Uncertainty – As Easy
as ABC? Not Quite …, J. Extreme Events, 05, 1850007, <ext-link xlink:href="https://doi.org/10.1142/s2345737618500070" ext-link-type="DOI">10.1142/s2345737618500070</ext-link>, 2018b.</mixed-citation></ref>
      <ref id="bib1.bib79"><label>79</label><?label 1?><mixed-citation>
Southern Water: Drought Plan, Southern Water, Worthing,  50–61, 2013.</mixed-citation></ref>
      <ref id="bib1.bib80"><label>80</label><?label 1?><mixed-citation>Spraggs, G., Peaver, L., Jones, P., and Ede, P.: Re-construction of historic
drought in the Anglian Region (UK) over the period 1798–2010 and the
implications for water resources and drought management, J.
Hydrol., 526, 231–252,
<ext-link xlink:href="https://doi.org/10.1016/j.jhydrol.2015.01.015" ext-link-type="DOI">10.1016/j.jhydrol.2015.01.015</ext-link>, 2015.</mixed-citation></ref>
      <ref id="bib1.bib81"><label>81</label><?label 1?><mixed-citation>
Stoelzle, M., Stahl, K., Morhard, A., and Weiler, M.: Streamflow sensitivity
to drought scenarios in catchments with different geology, Geophys.
Res. Lett., 41, 6174–6183, 2014.</mixed-citation></ref>
      <ref id="bib1.bib82"><label>82</label><?label 1?><mixed-citation>Svensson, C.: Seasonal river flow forecasts for the United Kingdom using
persistence and historical analogues, Hydrolog. Sci. J., 61,
19–35, <ext-link xlink:href="https://doi.org/10.1080/02626667.2014.992788" ext-link-type="DOI">10.1080/02626667.2014.992788</ext-link>, 2016.</mixed-citation></ref>
      <ref id="bib1.bib83"><label>83</label><?label 1?><mixed-citation>Svensson, C., Hannaford, J., and Prosdocimi, I.: Statistical distributions
for monthly aggregations of precipitation and streamflow in drought
indicator applications, Water Resour. Res., 53, 999–1018,
<ext-link xlink:href="https://doi.org/10.1002/2016WR019276" ext-link-type="DOI">10.1002/2016WR019276</ext-link>, 2017.</mixed-citation></ref>
      <ref id="bib1.bib84"><label>84</label><?label 1?><mixed-citation>Tanguy, M., Prudhomme, C., Smith, K., and Hannaford, J.: Historic Gridded
Potential Evapotranspiration (PET) based on temperature-based equation
McGuinness-Bordne calibrated for the UK (1891–2015), NERC Environmental
Information Data Centre,
<ext-link xlink:href="https://doi.org/10.5285/17b9c4f7-1c30-4b6f-b2fe-f7780159939c" ext-link-type="DOI">10.5285/17b9c4f7-1c30-4b6f-b2fe-f7780159939c</ext-link>, 2017.</mixed-citation></ref>
      <ref id="bib1.bib85"><label>85</label><?label 1?><mixed-citation>Tanguy, M., Prudhomme, C., Smith, K., and Hannaford, J.: Historical gridded reconstruction of potential evapotranspiration for the UK, Earth Syst. Sci. Data, 10, 951–968, <ext-link xlink:href="https://doi.org/10.5194/essd-10-951-2018" ext-link-type="DOI">10.5194/essd-10-951-2018</ext-link>, 2018.</mixed-citation></ref>
      <ref id="bib1.bib86"><label>86</label><?label 1?><mixed-citation>Teuling, A. J.: A hot future for European droughts, Nat. Clim. Change,
8, 364–365, <ext-link xlink:href="https://doi.org/10.1038/s41558-018-0154-5" ext-link-type="DOI">10.1038/s41558-018-0154-5</ext-link>, 2018.
</mixed-citation></ref><?xmltex \hack{\newpage}?>
      <ref id="bib1.bib87"><label>87</label><?label 1?><mixed-citation>Valéry, A., Andréassian, V., and Perrin, C.: As simple as possible
but not simpler': What is useful in a temperature-based snow-accounting
routine? Part 1 – Comparison of six snow accounting routines on 380
catchments, J. Hydrol., 517, 1166–1175,
<ext-link xlink:href="https://doi.org/10.1016/j.jhydrol.2014.04.059" ext-link-type="DOI">10.1016/j.jhydrol.2014.04.059</ext-link>, 2014.</mixed-citation></ref>
      <ref id="bib1.bib88"><label>88</label><?label 1?><mixed-citation>Vansteenkiste, T., Tavakoli, M., Van Steenbergen, N., De Smedt, F.,
Batelaan, O., Pereira, F., and Willems, P.: Intercomparison of five lumped
and distributed models for catchment runoff and extreme flow simulation,
J. Hydrol., 511, 335–349,
<ext-link xlink:href="https://doi.org/10.1016/j.jhydrol.2014.01.050" ext-link-type="DOI">10.1016/j.jhydrol.2014.01.050</ext-link>, 2014.</mixed-citation></ref>
      <ref id="bib1.bib89"><label>89</label><?label 1?><mixed-citation>Vicente-Serrano, S. M., Beguería, S., Lorenzo-Lacruz, J., Camarero, J.
J., López-Moreno, J. I., Azorin-Molina, C., Revuelto, J.,
Morán-Tejeda, E., and Sanchez-Lorenzo, A.: Performance of Drought
Indices for Ecological, Agricultural, and Hydrological Applications, Earth
Interact., 16, 1–27, <ext-link xlink:href="https://doi.org/10.1175/2012ei000434.1" ext-link-type="DOI">10.1175/2012ei000434.1</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bib90"><label>90</label><?label 1?><mixed-citation>Wallner, M., Haberlandt, U., and Dietrich, J.: Evaluation of different
calibration strategies for large scale continuous hydrological modelling,
Adv. Geosci., 31, 67–74, <ext-link xlink:href="https://doi.org/10.5194/adgeo-31-67-2012" ext-link-type="DOI">10.5194/adgeo-31-67-2012</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bib91"><label>91</label><?label 1?><mixed-citation>Warszawski, L., Frieler, K., Huber, V., Piontek, F., Serdeczny, O., and
Schewe, J.: The Inter-Sectoral Impact Model Intercomparison Project
(ISI–MIP): Project framework, P. Natl. Acad.
Sci. USA, 111, 3228–3232, <ext-link xlink:href="https://doi.org/10.1073/pnas.1312330110" ext-link-type="DOI">10.1073/pnas.1312330110</ext-link>, 2014.</mixed-citation></ref>
      <ref id="bib1.bib92"><label>92</label><?label 1?><mixed-citation>Wilby, R. L. and Harris, I.: A framework for assessing uncertainties in
climate change impacts: Low-flow scenarios for the River Thames, UK, Water
Resour. Res., 42, W02419, <ext-link xlink:href="https://doi.org/10.1029/2005wr004065" ext-link-type="DOI">10.1029/2005wr004065</ext-link>, 2006.</mixed-citation></ref>
      <ref id="bib1.bib93"><label>93</label><?label 1?><mixed-citation>Wu, Z. Y., Lu, G. H., Wen, L., and Lin, C. A.: Reconstructing and analyzing China's fifty-nine year (1951–2009) drought history using hydrological model simulation, Hydrol. Earth Syst. Sci., 15, 2881–2894, <ext-link xlink:href="https://doi.org/10.5194/hess-15-2881-2011" ext-link-type="DOI">10.5194/hess-15-2881-2011</ext-link>, 2011.</mixed-citation></ref>
      <ref id="bib1.bib94"><label>94</label><?label 1?><mixed-citation>Yapo, P. O., Gupta, H. V., and Sorooshian, S.: Multi-objective global
optimization for hydrologic models, J. Hydrol., 204, 83–97,
<ext-link xlink:href="https://doi.org/10.1016/S0022-1694(97)00107-8" ext-link-type="DOI">10.1016/S0022-1694(97)00107-8</ext-link>, 1998.</mixed-citation></ref>

  </ref-list></back>
    <!--<article-title-html>A multi-objective ensemble approach to hydrological modelling in the UK: an application to historic drought reconstruction</article-title-html>
<abstract-html><p>Hydrological models can provide estimates of streamflow pre- and
post-observations, which enable greater understanding of past hydrological
behaviour, and potential futures. In this paper, a new multi-objective
calibration method was derived and tested for 303 catchments in the UK, and
the calibrations were used to reconstruct river flows back to 1891, in order
to provide a much longer view of past hydrological variability, given the
brevity of most UK river flow records which began post-1960. A Latin
hypercube sample of 500&thinsp;000 parameterisations for the GR4J model for each
catchment were evaluated against six evaluation metrics covering all aspects
of the flow regime from high, median, and low flows. The results of the top
ranking model parameterisation (LHS1), and also the top 500 (LHS500), for
each catchment were used to provide a deterministic result whilst also
accounting for parameter uncertainty. The calibrations are generally good at
capturing observed flows, with some exceptions in heavily groundwater-dominated catchments, and snowmelt and artificially influenced catchments
across the country. Reconstructed flows were appraised over 30-year moving
windows and were shown to provide good simulations of flow in the early
parts of the record, in cases where observations were available. To consider
the utility of the reconstructions for drought simulation, flow data for the
1975–1976 drought event were explored in detail in nine case study catchments.
The model's performance in reproducing the drought events was found to vary
by catchment, as did the level of uncertainty in the LHS500. The
Standardised Streamflow Index (SSI) was used to assess the model
simulations' ability to simulate extreme events. The peaks and troughs of
the SSI time series were well represented despite slight over- or
underestimations of past drought event magnitudes, while the accumulated
deficits of the drought events extracted from the SSI time series verified
that the model simulations were overall very good at simulating drought
events. This paper provides three key contributions: (1) a robust
multi-objective model calibration framework for calibrating catchment models
for use in both general and extreme hydrology; (2) model calibrations for the
303 UK catchments that could be used in further research, and operational
applications such as hydrological forecasting; and (3)  ∼  125 years of spatially and temporally consistent reconstructed flow data
that will allow comprehensive quantitative assessments of past UK drought
events, as well as long-term analyses of hydrological variability that have
not been previously possible, thus enabling water resource managers to
better plan for extreme events and build more resilient systems for the
future.</p></abstract-html>
<ref-html id="bib1.bib1"><label>1</label><mixed-citation>
Anderton, S., Ledbetter, R., and Prudhomme, C.: Understanding the
performance of water supply systems during mild to extreme droughts,
Environment Agency, Horizon House, Deanery Road, Bristol, BS1 5AH, 2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib2"><label>2</label><mixed-citation>
Atkins: Thames Water Stochastic Resource Modelling: Stage 2&amp;3 Report,
Atkins, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib3"><label>3</label><mixed-citation>
Bai, P., Liu, X., Yang, T., Li, F., Liang, K., Hu, S., and Liu, C.:
Assessment of the Influences of Different Potential Evapotranspiration
Inputs on the Performance of Monthly Hydrological Models under Different
Climatic Conditions, J. Hydrometeorol., 17, 2259–2274,
<a href="https://doi.org/10.1175/jhm-d-15-0202.1" target="_blank">https://doi.org/10.1175/jhm-d-15-0202.1</a>, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib4"><label>4</label><mixed-citation>
Barker, L. J., Hannaford, J., Chiverton, A., and Svensson, C.: From meteorological to hydrological drought using standardised indicators, Hydrol. Earth Syst. Sci., 20, 2483–2505, <a href="https://doi.org/10.5194/hess-20-2483-2016" target="_blank">https://doi.org/10.5194/hess-20-2483-2016</a>, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib5"><label>5</label><mixed-citation>
Barker, L. J., Smith, K. A., Svensson, C., Tanguy, M., and Hannaford, J.:
Historic Standardised Streamflow Index (SSI) using Tweedie distribution with
standard period 1961–2010 for 303 UK catchments (1891–2015), NERC
Environmental Information Data Centre,
<a href="https://doi.org/10.5285/58ef13a9-539f-46e5-88ad-c89274191ff9" target="_blank">https://doi.org/10.5285/58ef13a9-539f-46e5-88ad-c89274191ff9</a>, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib6"><label>6</label><mixed-citation>
Barker, L. J., Hannaford, J., Parry, S., Smith, K. A., Tanguy, M., and Prudhomme, C.: Historic hydrological droughts 1891–2015: systematic characterisation for a diverse set of catchments across the UK, Hydrol. Earth Syst. Sci. Discuss., <a href="https://doi.org/10.5194/hess-2019-202" target="_blank">https://doi.org/10.5194/hess-2019-202</a>, in review, 2019.
</mixed-citation></ref-html>
<ref-html id="bib1.bib7"><label>7</label><mixed-citation>
Bastola, S., Murphy, C., and Sweeney, J.: The sensitivity of fluvial flood
risk in Irish catchments to the range of IPCC AR4 climate change scenarios,
Sci. Total Environ., 409, 5403–5415,
<a href="https://doi.org/10.1016/j.scitotenv.2011.08.042" target="_blank">https://doi.org/10.1016/j.scitotenv.2011.08.042</a>, 2011.
</mixed-citation></ref-html>
<ref-html id="bib1.bib8"><label>8</label><mixed-citation>
Beven, K.: A manifesto for the equifinality thesis, J. Hydrol.,
320, 18–36, <a href="https://doi.org/10.1016/j.jhydrol.2005.07.007" target="_blank">https://doi.org/10.1016/j.jhydrol.2005.07.007</a>, 2006.
</mixed-citation></ref-html>
<ref-html id="bib1.bib9"><label>9</label><mixed-citation>
Beven, K.: Rainfall-Runoff Modelling: The Primer, Second Edition, Second
ed., Wiley-Blackwell, Chichester, 457 pp., 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib10"><label>10</label><mixed-citation>
Beven, K. and Binley, A.: The Future of Distributed Models –  Model
Calibration and Uncertainty Prediction, Hydrol. Process., 6, 279–298,
1992.
</mixed-citation></ref-html>
<ref-html id="bib1.bib11"><label>11</label><mixed-citation>
Beven, K. and Freer, J.: Equifinality, data assimilation, and uncertainty
estimation in mechanistic modelling of complex environmental systems using
the GLUE methodology, J. Hydrol., 249, 11–29, 2001.
</mixed-citation></ref-html>
<ref-html id="bib1.bib12"><label>12</label><mixed-citation>
Bierkens, M. F. P.: Global hydrology 2015: State, trends, and directions,
Water Resour. Res., 51, 4923–4947, <a href="https://doi.org/10.1002/2015wr017173" target="_blank">https://doi.org/10.1002/2015wr017173</a>, 2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib13"><label>13</label><mixed-citation>
Brázdil, R., Dobrovolný, P., Trnka, M., Büntgen, U.,
Řezníčková, L., Kotyza, O., Valášek, H., and
Štĕpánek, P.: Documentary and instrumental-based drought indices
for the Czech Lands back to AD 1501, Clim. Res., 70, 103–117, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib14"><label>14</label><mixed-citation>
Brigode, P., Brissette, F., Nicault, A., Perreault, L., Kuentz, A., Mathevet, T., and Gailhard, J.: Streamflow variability over the 1881–2011 period in northern Québec: comparison of hydrological reconstructions based on tree rings and geopotential height field reanalysis, Clim. Past, 12, 1785–1804, <a href="https://doi.org/10.5194/cp-12-1785-2016" target="_blank">https://doi.org/10.5194/cp-12-1785-2016</a>, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib15"><label>15</label><mixed-citation>
Broderick, C., Matthews, T., Wilby, R. L., Bastola, S., and Murphy, C.:
Transferability of hydrological models and ensemble averaging methods
between contrasting climatic periods, Water Resour. Res., 52,
8343–8373, <a href="https://doi.org/10.1002/2016WR018850" target="_blank">https://doi.org/10.1002/2016WR018850</a>, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib16"><label>16</label><mixed-citation>
Caillouet, L., Vidal, J.-P., Sauquet, E., Devers, A., and Graff, B.: Ensemble reconstruction of spatio-temporal extreme low-flow events in France since 1871, Hydrol. Earth Syst. Sci., 21, 2923–2951, <a href="https://doi.org/10.5194/hess-21-2923-2017" target="_blank">https://doi.org/10.5194/hess-21-2923-2017</a>, 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib17"><label>17</label><mixed-citation>
Calvin, K. and Bond-Lamberty, B.: Integrated human-earth system
modeling–state of the science and future directions, Environ.
Res. Lett., 13, 063006, <a href="https://doi.org/10.1088/1748-9326/aac642" target="_blank">https://doi.org/10.1088/1748-9326/aac642</a>, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib18"><label>18</label><mixed-citation>
Casty, C., Raible, C. C., Stocker, T. F., Wanner, H., and Luterbacher, J.: A
European pattern climatology 1766–2000, Clim. Dynam., 29, 791–805, <a href="https://doi.org/10.1007/s00382-007-0257-6" target="_blank">https://doi.org/10.1007/s00382-007-0257-6</a>, 2007.
</mixed-citation></ref-html>
<ref-html id="bib1.bib19"><label>19</label><mixed-citation>
Cheng, J. and Druzdzel, M. J.: Latin Hypercube Sampling in Bayesian
Networks, American Association for Artificial Intelligence, Pittsburgh,
2000.
</mixed-citation></ref-html>
<ref-html id="bib1.bib20"><label>20</label><mixed-citation>
Centre for Ecology &amp; Hydrology:   UK Reconstructed Flow Data Explorer, available at:  <a href="https://shiny-apps.ceh.ac.uk/reconstruction_explorer/" target="_blank">https://shiny-apps.ceh.ac.uk/reconstruction_explorer/</a> (last access: 23 July 2019), 2018a.
</mixed-citation></ref-html>
<ref-html id="bib1.bib21"><label>21</label><mixed-citation>
Centre for Ecology &amp; Hydrology: UK Hydrological Drought Explorer, available at:  <a href="https://shiny-apps.ceh.ac.uk/hydro_drought_explorer/" target="_blank">https://shiny-apps.ceh.ac.uk/hydro_drought_explorer/</a> (last access: 23 July 2019), 2018b.
</mixed-citation></ref-html>
<ref-html id="bib1.bib22"><label>22</label><mixed-citation>
Christierson, B. V., Vidal, J.-P., and Wade, S. D.: Using UKCP09
probabilistic climate information for UK water resource planning, J.
Hydrol., 424–425, 48–67,
<a href="https://doi.org/10.1016/j.jhydrol.2011.12.020" target="_blank">https://doi.org/10.1016/j.jhydrol.2011.12.020</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib23"><label>23</label><mixed-citation>
Collet, L., Harrigan, S., Prudhomme, C., Formetta, G., and Beevers, L.: Future hot-spots for hydro-hazards in Great Britain: a probabilistic assessment, Hydrol. Earth Syst. Sci., 22, 5387–5401, <a href="https://doi.org/10.5194/hess-22-5387-2018" target="_blank">https://doi.org/10.5194/hess-22-5387-2018</a>, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib24"><label>24</label><mixed-citation>
Compo, G. P., Whitaker, J. S., Sardeshmukh, P. D., Matsui, N., Allan, R. J.,
Yin, X., Gleason, B. E., Vose, R. S., Rutledge, G., Bessemoulin, P.,
Brönnimann, S., Brunet, M., Crouthamel, R. I., Grant, A. N., Groisman,
P. Y., Jones, P. D., Kruk, M. C., Kruger, A. C., Marshall, G. J., Maugeri,
M., Mok, H. Y., Nordli, Ø., Ross, T. F., Trigo, R. M., Wang, X. L.,
Woodruff, S. D., and Worley, S. J.: The Twentieth Century Reanalysis
Project, Q. J. Roy. Meteor. Soc., 137, 1–28,
<a href="https://doi.org/10.1002/qj.776" target="_blank">https://doi.org/10.1002/qj.776</a>, 2011.
</mixed-citation></ref-html>
<ref-html id="bib1.bib25"><label>25</label><mixed-citation>
Cook, E. R., Seager, R., Kushnir, Y., Briffa, K. R., Büntgen, U., Frank,
D., Krusic, P. J., Tegel, W., van der Schrier, G., Andreu-Hayles, L.,
Baillie, M., Baittinger, C., Bleicher, N., Bonde, N., Brown, D., Carrer, M.,
Cooper, R., Čufar, K., Dittmar, C., Esper, J., Griggs, C., Gunnarson,
B., Günther, B., Gutierrez, E., Haneca, K., Helama, S., Herzig, F.,
Heussner, K.-U., Hofmann, J., Janda, P., Kontic, R., Köse, N., Kyncl,
T., Levanič, T., Linderholm, H., Manning, S., Melvin, T. M., Miles, D.,
Neuwirth, B., Nicolussi, K., Nola, P., Panayotov, M., Popa, I., Rothe, A.,
Seftigen, K., Seim, A., Svarva, H., Svoboda, M., Thun, T., Timonen, M.,
Touchan, R., Trotsiuk, V., Trouet, V., Walder, F., Ważny, T., Wilson,
R., and Zang, C.: Old World megadroughts and pluvials during the Common Era,
Science Advances, 1, e1500561, <a href="https://doi.org/10.1126/sciadv.1500561" target="_blank">https://doi.org/10.1126/sciadv.1500561</a>, 2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib26"><label>26</label><mixed-citation>
Coron, L., Thirel, G., Delaigue, O., Perrin, C., and Andréassian, V.:
The Suite of Lumped GR Hydrological Models in an R package, Environ.
Modell. Softw., 94, 166–171, <a href="https://doi.org/10.1016/j.envsoft.2017.05.002" target="_blank">https://doi.org/10.1016/j.envsoft.2017.05.002</a>, 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib27"><label>27</label><mixed-citation>
Dawson, C. W., Abrahart, R. J., and See, L. M.: HydroTest: A web-based
toolbox of evaluation metrics for the standardised assessment of
hydrological forecasts, Environ. Modell. Softw., 22,
1034–1052, <a href="https://doi.org/10.1016/j.envsoft.2006.06.008" target="_blank">https://doi.org/10.1016/j.envsoft.2006.06.008</a>,
2007.
</mixed-citation></ref-html>
<ref-html id="bib1.bib28"><label>28</label><mixed-citation>
Day, G. N.: Extended Streamflow Forecasting using NWSRFS, J. Water Res.
Pl., 111, 642–654, 1985.
</mixed-citation></ref-html>
<ref-html id="bib1.bib29"><label>29</label><mixed-citation>
Dixon, H., Hannaford, J., and Fry, M. J.: The effective management of
national hydrometric data: experiences from the United Kingdom, Hydrolog.
Sci. J., 58, 1383–1399, <a href="https://doi.org/10.1080/02626667.2013.787486" target="_blank">https://doi.org/10.1080/02626667.2013.787486</a>, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib30"><label>30</label><mixed-citation>
Duan, Q., Gupta, V. K., and Sorooshian, S.: Shuffled complex evolution
approach for effective and efficient global minimization, J.
Optimiz. Theory Appl., 76, 501–521, 1993.
</mixed-citation></ref-html>
<ref-html id="bib1.bib31"><label>31</label><mixed-citation>
Efstratiadis, A. and Koutsoyiannis, D.: One decade of multi-objective
calibration approaches in hydrological modelling: a review, Hydrolog.
Sci. J., 55, 58–78, <a href="https://doi.org/10.1080/02626660903526292" target="_blank">https://doi.org/10.1080/02626660903526292</a>, 2010.
</mixed-citation></ref-html>
<ref-html id="bib1.bib32"><label>32</label><mixed-citation>
GRDC: The Global Runoff Data Base,  D-56002
Koblenz, Germany, <a href="https://www.bafg.de/GRDC/EN/02_srvcs/21_tmsrs/riverdischarge_node.html" target="_blank">https://www.bafg.de/GRDC/EN/02_srvcs/21_tmsrs/riverdischarge_node.html</a>,
2019.
</mixed-citation></ref-html>
<ref-html id="bib1.bib33"><label>33</label><mixed-citation>
Guerreiro, S. B., Dawson, R. J., Kilsby, C., Lewis, E., and Ford, A.: Future
heat-waves, droughts and floods in 571 European cities, Environ.
Res. Lett., 13, 034009, <a href="https://doi.org/10.1088/1748-9326/aaaad3" target="_blank">https://doi.org/10.1088/1748-9326/aaaad3</a>, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib34"><label>34</label><mixed-citation>
Guo, D., Westra, S., and Maier, H. R.: Use of a scenario-neutral approach to
identify the key hydro-meteorological attributes that impact runoff from a
natural catchment, J. Hydrol., 554, 317–330,
<a href="https://doi.org/10.1016/j.jhydrol.2017.09.021" target="_blank">https://doi.org/10.1016/j.jhydrol.2017.09.021</a>, 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib35"><label>35</label><mixed-citation>
Harrigan, S., Hannaford, J., Muchan, K., and Marsh, T.: Designation and
trend analysis of the updated UK Benchmark Network of river flow stations:
The UKBN2 dataset, Hydrol. Res., 29, 552–567, <a href="https://doi.org/10.2166/nh.2017.058" target="_blank">https://doi.org/10.2166/nh.2017.058</a>, 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib36"><label>36</label><mixed-citation>
Harrigan, S., Prudhomme, C., Parry, S., Smith, K., and Tanguy, M.: Benchmarking ensemble streamflow prediction skill in the UK, Hydrol. Earth Syst. Sci., 22, 2023–2039, <a href="https://doi.org/10.5194/hess-22-2023-2018" target="_blank">https://doi.org/10.5194/hess-22-2023-2018</a>, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib37"><label>37</label><mixed-citation>
Haxton, T., Crooks, S., Jackson, C. R., Barkwith, A. K. A. P., Kelvin, J.,
Williamson, J., Mackay, J. D., Wang, L., Davies, H., Young, A., and
Prudhomme, C.: Future flows hydrology data, NERC Environmental Information
Data Centre,
<a href="https://doi.org/10.5285/f3723162-4fed-4d9d-92c6-dd17412fa37b" target="_blank">https://doi.org/10.5285/f3723162-4fed-4d9d-92c6-dd17412fa37b</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib38"><label>38</label><mixed-citation>
Herman, J. D., Zeff, H. B., Lamontagne, J. R., Reed, P. M., and Characklis,
G. W.: Synthetic Drought Scenario Generation to Support Bottom-Up Water
Supply Vulnerability Assessments, J. Water Res. Plan.
Man., 142, 04016050, <a href="https://doi.org/10.1061/(ASCE)WR.1943-5452.0000701" target="_blank">https://doi.org/10.1061/(ASCE)WR.1943-5452.0000701</a>, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib39"><label>39</label><mixed-citation>
HM Government:  UK Climate Change Risk Assessment 2017: Presented to Parliament pursuant to Section 56 of the Climate Change Act 2008, available at: <a href="https://www.gov.uk/government/publications/uk-climate-change-risk-assessment-2017" target="_blank">https://www.gov.uk/government/publications/uk-climate-change-risk-assessment-2017</a> (last access: 23 July 2019), 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib40"><label>40</label><mixed-citation>
Jones, P. D. and Lister, D. H.: Riverflow reconstructions for 15 catchments
over England and Wales and an assessment of hydrologic drought since 1865,
Int. J. Climatol., 18, 999–1013, <a href="https://doi.org/10.1002/(sici)1097-0088(199807)18:9&lt;999::aid-joc300&gt;3.0.co;2-8" target="_blank">https://doi.org/10.1002/(sici)1097-0088(199807)18:9&lt;999::aid-joc300&gt;3.0.co;2-8</a>, 1998.
</mixed-citation></ref-html>
<ref-html id="bib1.bib41"><label>41</label><mixed-citation>
Jones, P. D., Briffa, K. R., and Pilcher, J. R.: Riverflow reconstruction
from tree rings in southern Britain, J. Climatol., 4, 461–472, <a href="https://doi.org/10.1002/joc.3370040502" target="_blank">https://doi.org/10.1002/joc.3370040502</a>, 1984.
</mixed-citation></ref-html>
<ref-html id="bib1.bib42"><label>42</label><mixed-citation>
Jones, P. D., Lister, D. H., Wilby, R. L., and Kostopoulou, E.: Extended
riverflow reconstructions for England and Wales, 1865–2002, International
J. Climatol., 26, 219–231, <a href="https://doi.org/10.1002/joc.1252" target="_blank">https://doi.org/10.1002/joc.1252</a>, 2006.
</mixed-citation></ref-html>
<ref-html id="bib1.bib43"><label>43</label><mixed-citation>
Jung, D., Choi, Y. H., and Kim, J.: Multiobjective Automatic Parameter Calibration of a Hydrological Model, Water,  9,  187, <a href="https://doi.org/10.3390/w9030187" target="_blank">https://doi.org/10.3390/w9030187</a>, 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib44"><label>44</label><mixed-citation>
Kamali, B., Mousavi, S. J., and Abbaspour, K. C.: Automatic calibration of
HEC-HMS using single-objective and multi-objective PSO algorithms,
Hydrol. Process., 27, 4028–4042, <a href="https://doi.org/10.1002/hyp.9510" target="_blank">https://doi.org/10.1002/hyp.9510</a>, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib45"><label>45</label><mixed-citation>
Kay, A. L., Bell, V. A., Guillod, B. P., Jones, R. G., and Rudd, A. C.:
National-scale analysis of low flow frequency: historical trends and
potential future changes, Climatic Change, 147, 585–599, <a href="https://doi.org/10.1007/s10584-018-2145-y" target="_blank">https://doi.org/10.1007/s10584-018-2145-y</a>, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib46"><label>46</label><mixed-citation>
Kim, S. M., Benham, B. L., Brannan, K. M., Zeckoski, R. W., and Doherty, J.:
Comparison of hydrologic calibration of HSPF using automatic and manual
methods, Water Resour. Res., 43,  W01402, <a href="https://doi.org/10.1029/2006wr004883" target="_blank">https://doi.org/10.1029/2006wr004883</a>, 2007.
</mixed-citation></ref-html>
<ref-html id="bib1.bib47"><label>47</label><mixed-citation>
Krause, P., Boyle, D. P., and Bäse, F.: Comparison of differenct
efficiency criteria for hydrological model assessment, Adv.
Geosci., 5, 89–97, 2005.
</mixed-citation></ref-html>
<ref-html id="bib1.bib48"><label>48</label><mixed-citation>
Kundzewicz, Z. W. and Matczak, P.: Hydrological extremes and security,
P. Int. Ass. Hydrol. Sci., 366,
44–53, 2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib49"><label>49</label><mixed-citation>
Lavers, D. A., Hannah, D. M., and Bradley, C.: Connecting large-scale
atmospheric circulation, river flow and groundwater levels in a chalk
catchment in southern England, J. Hydrol., 523, 179–189,
<a href="https://doi.org/10.1016/j.jhydrol.2015.01.060" target="_blank">https://doi.org/10.1016/j.jhydrol.2015.01.060</a>, 2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib50"><label>50</label><mixed-citation>
Legg, T.: Uncertainties in gridded area-average monthly temperature,
precipitation and sunshine for the United Kingdom, Int. J.
Climatol., 35, 1367–1378, <a href="https://doi.org/10.1002/joc.4062" target="_blank">https://doi.org/10.1002/joc.4062</a>, 2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib51"><label>51</label><mixed-citation>
Marsh, T., Cole, G., and Wilby, R.: Major droughts in England and Wales,
1800–2006, Weather, 62, 87–93, <a href="https://doi.org/10.1002/wea.67" target="_blank">https://doi.org/10.1002/wea.67</a>, 2007.
</mixed-citation></ref-html>
<ref-html id="bib1.bib52"><label>52</label><mixed-citation>
Marx, A., Kumar, R., Thober, S., Rakovec, O., Wanders, N., Zink, M., Wood, E. F., Pan, M., Sheffield, J., and Samaniego, L.: Climate change alters low flows in Europe under global warming of 1.5, 2, and 3&thinsp;°C, Hydrol. Earth Syst. Sci., 22, 1017–1032, <a href="https://doi.org/10.5194/hess-22-1017-2018" target="_blank">https://doi.org/10.5194/hess-22-1017-2018</a>, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib53"><label>53</label><mixed-citation>
McGuinness, J. L. and Bordne, E. F.: A Comparison of Lysimeter-Derived
Potential Evapotranspiration With Computed Values, United States Department
of Agriculture, Economic Research Service, 1972.
</mixed-citation></ref-html>
<ref-html id="bib1.bib54"><label>54</label><mixed-citation>
McKay, M. D., Beckman, R. J., and Conover, W. J.: Comparison of three
methods for selecting values of input variables in the analysis of output
from a computer code, Technometrics, 21, 239–245, 1979.
</mixed-citation></ref-html>
<ref-html id="bib1.bib55"><label>55</label><mixed-citation>
McKee, T. B., Doeksen, N. J., and Kleist, J.: The relationship of drought
frequency and duration to time scales, Eighth Conference on Applied
Climatology, Anaheim, California, 1993.
</mixed-citation></ref-html>
<ref-html id="bib1.bib56"><label>56</label><mixed-citation>
Mens, M. J. P., Gilroy, K., and Williams, D.: Developing system robustness analysis for drought risk management: an application on a water supply reservoir, Nat. Hazards Earth Syst. Sci., 15, 1933–1940, <a href="https://doi.org/10.5194/nhess-15-1933-2015" target="_blank">https://doi.org/10.5194/nhess-15-1933-2015</a>, 2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib57"><label>57</label><mixed-citation>
Met Office: UKCP09: Met Office gridded land surface climate observations –
daily temperature and precipitation at 5km resolution, Centre for
Environmental Data Analysis, available at: <a href="http://catalogue.ceda.ac.uk/uuid/319b3f878c7d4cbfbdb356e19d8061d6" target="_blank">http://catalogue.ceda.ac.uk/uuid/319b3f878c7d4cbfbdb356e19d8061d6</a> (last access: 23 July 2019), 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib58"><label>58</label><mixed-citation>
Met Office Hadley Centre: UKCP18 Probabilistic Climate Projections, Centre
for Environmental Data Analysis, available at: <a href="http://catalogue.ceda.ac.uk/uuid/9842e395f2d04f48a177c3550756bf98" target="_blank">http://catalogue.ceda.ac.uk/uuid/9842e395f2d04f48a177c3550756bf98</a> (last access: 23 July 2019), 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib59"><label>59</label><mixed-citation>
Monteith, J. L.: Evaporation and Environment, Symposium of the Society for
Experimental Biology, 19, 205–234, 1965.
</mixed-citation></ref-html>
<ref-html id="bib1.bib60"><label>60</label><mixed-citation>
Mostafaie, A., Forootan, E., Safari, A., and Schumacher, M.: Comparing
multi-objective optimization techniques to calibrate a conceptual
hydrological model using in situ runoff and daily GRACE data, Comput.
Geosci., 22, 789–814, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib61"><label>61</label><mixed-citation>
Nash, J. E. and Sutcliffe, J. V.: River flow forecasting through conceptual
models part I – A discussion of principles, J. Hydrol., 10,
282–290, 1970.
</mixed-citation></ref-html>
<ref-html id="bib1.bib62"><label>62</label><mixed-citation>
National River Flow Archive: Accuracy and Fitness for Purpose, available at: <a href="https://nrfa.ceh.ac.uk/accuracy-fitness-for-purpose" target="_blank">https://nrfa.ceh.ac.uk/accuracy-fitness-for-purpose</a>, last access: 23 July 2019.
</mixed-citation></ref-html>
<ref-html id="bib1.bib63"><label>63</label><mixed-citation>
New, M., Hulme, M., and Jones, P.: Representing Twentieth-Century
Space–Time Climate Variability. Part II: Development of 1901–96 Monthly
Grids of Terrestrial Surface Climate, Anglais, 13, 2217–2238, <a href="https://doi.org/10.1175/1520-0442(2000)013&lt;2217:Rtcstc&gt;2.0.Co;2" target="_blank">https://doi.org/10.1175/1520-0442(2000)013&lt;2217:Rtcstc&gt;2.0.Co;2</a>, 2000.
</mixed-citation></ref-html>
<ref-html id="bib1.bib64"><label>64</label><mixed-citation>
Noone, S., Broderick, C., Duffy, C., Matthews, T., Wilby, R. L., and Murphy,
C.: A 250-year drought catalogue for the island of Ireland (1765–2015),
Int. J. Climatol., 37, 239–254, <a href="https://doi.org/10.1002/joc.4999" target="_blank">https://doi.org/10.1002/joc.4999</a>,
2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib65"><label>65</label><mixed-citation>
Northumbrian Water: Draft Drought Plan 2018, Northumbrian Water, Durham,
20–21, 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib66"><label>66</label><mixed-citation>
Parry, S., Wilby, R., Prudhomme, C., Wood, P., and McKenzie, A.:
Demonstrating the utility of a drought termination framework: prospects for
groundwater level recovery in England and Wales in 2018 or beyond,
Environ. Res. Lett., 13, 064040, <a href="https://doi.org/10.1088/1748-9326/aac78c" target="_blank">https://doi.org/10.1088/1748-9326/aac78c</a>, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib67"><label>67</label><mixed-citation>
Paturel, J. E., Servat, E., and Vassiliadis, A.: Sensitivity of conceptual
rainfall-runoff algorithms to errors in input data – case of the GR2M
model, J. Hydrol., 168, 111–125,
<a href="https://doi.org/10.1016/0022-1694(94)02654-T" target="_blank">https://doi.org/10.1016/0022-1694(94)02654-T</a>, 1995.
</mixed-citation></ref-html>
<ref-html id="bib1.bib68"><label>68</label><mixed-citation>
Perrin, C., Michel, C., and Andréassian, V.: Improvement of a
parsimonious model for streamflow simulation, J. Hydrol., 279,
275–289, <a href="https://doi.org/10.1016/S0022-1694(03)00225-7" target="_blank">https://doi.org/10.1016/S0022-1694(03)00225-7</a>, 2003.
</mixed-citation></ref-html>
<ref-html id="bib1.bib69"><label>69</label><mixed-citation>
Perry, M. and Hollis, D.: The generation of monthly gridded datasets for a
range of climatic variables over the UK, Int. J.
Climatol., 25, 1041–1054, <a href="https://doi.org/10.1002/joc.1161" target="_blank">https://doi.org/10.1002/joc.1161</a>, 2005.
</mixed-citation></ref-html>
<ref-html id="bib1.bib70"><label>70</label><mixed-citation>
Pfister, C., Weingartner, R., and Luterbacher, J.: Hydrological winter
droughts over the last 450 years in the Upper Rhine basin: a methodological
approach, Hydrolog. Sci. J., 51, 966–985, <a href="https://doi.org/10.1623/hysj.51.5.966" target="_blank">https://doi.org/10.1623/hysj.51.5.966</a>,
2006.
</mixed-citation></ref-html>
<ref-html id="bib1.bib71"><label>71</label><mixed-citation>
Prudhomme, C., Young, A., Watts, G., Haxton, T., Crooks, S., Williamson, J.,
Davies, H., Dadson, S., and Allen, S.: The drying up of Britain? A national
estimate of changes in seasonal river flows from 11 Regional Climate Model
simulations, Hydrol. Process., 26, 1115–1118, <a href="https://doi.org/10.1002/hyp.8434" target="_blank">https://doi.org/10.1002/hyp.8434</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib72"><label>72</label><mixed-citation>
Prudhomme, C., Hannaford, J., Harrigan, S., Boorman, D., Knight, J., Bell,
V., Jackson, C., Svensson, C., Parry, S., Bachiller-Jareno, N., Davies, H.,
Davis, R., Mackay, J., McKenzie, A., Rudd, A., Smith, K., Bloomfield, J.,
Ward, R., and Jenkins, A.: Hydrological Outlook UK: an operational
streamflow and groundwater level forecasting system at monthly to seasonal
time scales, Hydrolog. Sci. J., 62, 2753–2768, <a href="https://doi.org/10.1080/02626667.2017.1395032" target="_blank">https://doi.org/10.1080/02626667.2017.1395032</a>, 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib73"><label>73</label><mixed-citation>
Pushpalatha, R., Perrin, C., Le Moine, N., Mathevet, T., and
Andréassian, V.: A downward structural sensitivity analysis of
hydrological models to improve low-flow simulation, J. Hydrol.,
411, 66–76,  <a href="https://doi.org/10.1016/j.jhydrol.2011.09.034" target="_blank">https://doi.org/10.1016/j.jhydrol.2011.09.034</a>,
2011.
</mixed-citation></ref-html>
<ref-html id="bib1.bib74"><label>74</label><mixed-citation>
Seiller, G. and Anctil, F.: How do potential evapotranspiration formulas
influence hydrological projections?, Hydrolog. Sci. J., 61,
2249–2266, <a href="https://doi.org/10.1080/02626667.2015.1100302" target="_blank">https://doi.org/10.1080/02626667.2015.1100302</a>, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib75"><label>75</label><mixed-citation>
Shafii, M. and De Smedt, F.: Multi-objective calibration of a distributed hydrological model (WetSpa) using a genetic algorithm, Hydrol. Earth Syst. Sci., 13, 2137–2149, <a href="https://doi.org/10.5194/hess-13-2137-2009" target="_blank">https://doi.org/10.5194/hess-13-2137-2009</a>, 2009.
</mixed-citation></ref-html>
<ref-html id="bib1.bib76"><label>76</label><mixed-citation>
Smith, K.: Investigating Uncertainty in Global Hydrology Modelling, Doctor
of Philosophy, School of Geography, University of Nottingham, Nottingham,
338 pp., 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib77"><label>77</label><mixed-citation>
Smith, K. A., Tanguy, M., Hannaford, J., and Prudhomme, C.: Historic
reconstructions of daily river flow for 303 UK catchments (1891–2015), NERC
Environmental Information Data Centre,  <a href="https://doi.org/10.5285/f710bed1-e564-47bf-b82c-4c2a2fe2810e" target="_blank">https://doi.org/10.5285/f710bed1-e564-47bf-b82c-4c2a2fe2810e</a>, 2018a.
</mixed-citation></ref-html>
<ref-html id="bib1.bib78"><label>78</label><mixed-citation>
Smith, K. A., Wilby, R. L., Broderick, C., Prudhomme, C., Matthews, T.,
Harrigan, S., and Murphy, C.: Navigating Cascades of Uncertainty – As Easy
as ABC? Not Quite …, J. Extreme Events, 05, 1850007, <a href="https://doi.org/10.1142/s2345737618500070" target="_blank">https://doi.org/10.1142/s2345737618500070</a>, 2018b.
</mixed-citation></ref-html>
<ref-html id="bib1.bib79"><label>79</label><mixed-citation>
Southern Water: Drought Plan, Southern Water, Worthing,  50–61, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib80"><label>80</label><mixed-citation>
Spraggs, G., Peaver, L., Jones, P., and Ede, P.: Re-construction of historic
drought in the Anglian Region (UK) over the period 1798–2010 and the
implications for water resources and drought management, J.
Hydrol., 526, 231–252,
<a href="https://doi.org/10.1016/j.jhydrol.2015.01.015" target="_blank">https://doi.org/10.1016/j.jhydrol.2015.01.015</a>, 2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib81"><label>81</label><mixed-citation>
Stoelzle, M., Stahl, K., Morhard, A., and Weiler, M.: Streamflow sensitivity
to drought scenarios in catchments with different geology, Geophys.
Res. Lett., 41, 6174–6183, 2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib82"><label>82</label><mixed-citation>
Svensson, C.: Seasonal river flow forecasts for the United Kingdom using
persistence and historical analogues, Hydrolog. Sci. J., 61,
19–35, <a href="https://doi.org/10.1080/02626667.2014.992788" target="_blank">https://doi.org/10.1080/02626667.2014.992788</a>, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib83"><label>83</label><mixed-citation>
Svensson, C., Hannaford, J., and Prosdocimi, I.: Statistical distributions
for monthly aggregations of precipitation and streamflow in drought
indicator applications, Water Resour. Res., 53, 999–1018,
<a href="https://doi.org/10.1002/2016WR019276" target="_blank">https://doi.org/10.1002/2016WR019276</a>, 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib84"><label>84</label><mixed-citation>
Tanguy, M., Prudhomme, C., Smith, K., and Hannaford, J.: Historic Gridded
Potential Evapotranspiration (PET) based on temperature-based equation
McGuinness-Bordne calibrated for the UK (1891–2015), NERC Environmental
Information Data Centre,
<a href="https://doi.org/10.5285/17b9c4f7-1c30-4b6f-b2fe-f7780159939c" target="_blank">https://doi.org/10.5285/17b9c4f7-1c30-4b6f-b2fe-f7780159939c</a>, 2017.
</mixed-citation></ref-html>
<ref-html id="bib1.bib85"><label>85</label><mixed-citation>
Tanguy, M., Prudhomme, C., Smith, K., and Hannaford, J.: Historical gridded reconstruction of potential evapotranspiration for the UK, Earth Syst. Sci. Data, 10, 951–968, <a href="https://doi.org/10.5194/essd-10-951-2018" target="_blank">https://doi.org/10.5194/essd-10-951-2018</a>, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib86"><label>86</label><mixed-citation>
Teuling, A. J.: A hot future for European droughts, Nat. Clim. Change,
8, 364–365, <a href="https://doi.org/10.1038/s41558-018-0154-5" target="_blank">https://doi.org/10.1038/s41558-018-0154-5</a>, 2018.

</mixed-citation></ref-html>
<ref-html id="bib1.bib87"><label>87</label><mixed-citation>
Valéry, A., Andréassian, V., and Perrin, C.: As simple as possible
but not simpler': What is useful in a temperature-based snow-accounting
routine? Part 1 – Comparison of six snow accounting routines on 380
catchments, J. Hydrol., 517, 1166–1175,
<a href="https://doi.org/10.1016/j.jhydrol.2014.04.059" target="_blank">https://doi.org/10.1016/j.jhydrol.2014.04.059</a>, 2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib88"><label>88</label><mixed-citation>
Vansteenkiste, T., Tavakoli, M., Van Steenbergen, N., De Smedt, F.,
Batelaan, O., Pereira, F., and Willems, P.: Intercomparison of five lumped
and distributed models for catchment runoff and extreme flow simulation,
J. Hydrol., 511, 335–349,
<a href="https://doi.org/10.1016/j.jhydrol.2014.01.050" target="_blank">https://doi.org/10.1016/j.jhydrol.2014.01.050</a>, 2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib89"><label>89</label><mixed-citation>
Vicente-Serrano, S. M., Beguería, S., Lorenzo-Lacruz, J., Camarero, J.
J., López-Moreno, J. I., Azorin-Molina, C., Revuelto, J.,
Morán-Tejeda, E., and Sanchez-Lorenzo, A.: Performance of Drought
Indices for Ecological, Agricultural, and Hydrological Applications, Earth
Interact., 16, 1–27, <a href="https://doi.org/10.1175/2012ei000434.1" target="_blank">https://doi.org/10.1175/2012ei000434.1</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib90"><label>90</label><mixed-citation>
Wallner, M., Haberlandt, U., and Dietrich, J.: Evaluation of different
calibration strategies for large scale continuous hydrological modelling,
Adv. Geosci., 31, 67–74, <a href="https://doi.org/10.5194/adgeo-31-67-2012" target="_blank">https://doi.org/10.5194/adgeo-31-67-2012</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib91"><label>91</label><mixed-citation>
Warszawski, L., Frieler, K., Huber, V., Piontek, F., Serdeczny, O., and
Schewe, J.: The Inter-Sectoral Impact Model Intercomparison Project
(ISI–MIP): Project framework, P. Natl. Acad.
Sci. USA, 111, 3228–3232, <a href="https://doi.org/10.1073/pnas.1312330110" target="_blank">https://doi.org/10.1073/pnas.1312330110</a>, 2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib92"><label>92</label><mixed-citation>
Wilby, R. L. and Harris, I.: A framework for assessing uncertainties in
climate change impacts: Low-flow scenarios for the River Thames, UK, Water
Resour. Res., 42, W02419, <a href="https://doi.org/10.1029/2005wr004065" target="_blank">https://doi.org/10.1029/2005wr004065</a>, 2006.
</mixed-citation></ref-html>
<ref-html id="bib1.bib93"><label>93</label><mixed-citation>
Wu, Z. Y., Lu, G. H., Wen, L., and Lin, C. A.: Reconstructing and analyzing China's fifty-nine year (1951–2009) drought history using hydrological model simulation, Hydrol. Earth Syst. Sci., 15, 2881–2894, <a href="https://doi.org/10.5194/hess-15-2881-2011" target="_blank">https://doi.org/10.5194/hess-15-2881-2011</a>, 2011.
</mixed-citation></ref-html>
<ref-html id="bib1.bib94"><label>94</label><mixed-citation>
Yapo, P. O., Gupta, H. V., and Sorooshian, S.: Multi-objective global
optimization for hydrologic models, J. Hydrol., 204, 83–97,
<a href="https://doi.org/10.1016/S0022-1694(97)00107-8" target="_blank">https://doi.org/10.1016/S0022-1694(97)00107-8</a>, 1998.
</mixed-citation></ref-html>--></article>
