Preprints
https://doi.org/10.5194/hess-2023-58
https://doi.org/10.5194/hess-2023-58
12 Apr 2023
 | 12 Apr 2023
Status: this preprint is currently under review for the journal HESS.

On the visual detection of non-natural records in streamflow time series: challenges and impacts

Laurent Strohmenger, Eric Sauquet, Claire Bernard, Jérémie Bonneau, Flora Branger, Amélie Bresson, Pierre Brigode, Rémy Buzier, Alban de Lavenne, Olivier Delaigue, Alexandre Devers, Guillaume Evin, Maïté Fournier, Shu-Chen Hsu, Sandra Lanini, Thibault Lemaitre-Basset, Claire Magand, Guilherme Mendoza Guimarães, Max Mentha, Simon Munier, Charles Perrin, Tristan Podechard, Léo Rouchy, Malak Sadki, Myriam Soutif-Bellenger, François Tilmant, Yves Tramblay, Anne-Lise Véron, Jean-Philippe Vidal, and Guillaume Thirel

Abstract. Large datasets of long-term streamflow measurements are widely used to infer and model hydrological processes. However, streamflow measurements may suffer from what users can consider as anomalies, i.e., non-natural records that may be erroneous streamflow values or anthropogenic influences that can lead to misinterpretation of actual hydrological processes. Since identifying anomalies is time consuming for humans, no study has investigated their proportion, temporal distribution, and influence on hydrological indicators over large datasets. This study summarizes the results of a large visual inspection campaign of 674 streamflow time series in France made by 43 evaluators, who were asked to identify anomalies falling under five categories, namely, linear interpolation, drops, noise, point anomaly, and other. We examined the evaluators’ individual behavior in terms of severity and agreement with other evaluators, as well as the temporal distributions of the anomalies and their influence on commonly used hydrological indicators. We found that inter-evaluator agreement was surprisingly low, with an average of 12 % of overlapping periods reported as anomalies. These anomalies were mostly identified as linear interpolation and noise, and they were more frequently reported during the low-flow periods in summer. The impact of cleaning data from the identified anomaly values was higher on low-flow indicators than on high-flow indicators, with change rates lower than 5 % most of the time.

We conclude that the identification of anomalies in streamflow time series is highly dependent on the aims and skills of each evaluator, which raises questions about the best practices to adopt for data cleaning.

Laurent Strohmenger et al.

Status: final response (author comments only)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on hess-2023-58', Martin Gauch, 16 May 2023
  • RC2: 'Comment on hess-2023-58', Frederik Kratzert, 25 May 2023
  • CC1: 'Referee Comment on hess-2023-58', Alexander Gelfan, 03 Jun 2023
  • RC3: 'Comment on hess-2023-58', Alexander Gelfan, 03 Jun 2023

Laurent Strohmenger et al.

Laurent Strohmenger et al.

Viewed

Total article views: 679 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
510 157 12 679 5 3
  • HTML: 510
  • PDF: 157
  • XML: 12
  • Total: 679
  • BibTeX: 5
  • EndNote: 3
Views and downloads (calculated since 12 Apr 2023)
Cumulative views and downloads (calculated since 12 Apr 2023)

Viewed (geographical distribution)

Total article views: 669 (including HTML, PDF, and XML) Thereof 669 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 08 Jun 2023
Download
Short summary
We present the results of a large visual inspection campaign of 674 streamflow time series in France. The objective was to detect non-natural records resulting from instrument failure or anthropogenic influences, such as hydroelectric power generation or reservoir management. We conclude that the identification of flaws in flow time series is highly dependent on the objectives and skills of individual evaluators, and we raise the need for better practices for data cleaning.