Preprints
https://doi.org/10.5194/hess-2024-284
https://doi.org/10.5194/hess-2024-284
07 Oct 2024
 | 07 Oct 2024
Status: this preprint is currently under review for the journal HESS.

Sensitivity of hydrological machine learning prediction accuracy to information quantity and quality

Minhyuk Jeung, Younggu Her, Sang-Soo Baek, and Kwangsik Yoon

Abstract. Machine learning (ML) is now commonly employed as a tool for hydrological prediction due to recent advances in computing resources and increases in data volume. The prediction accuracy of ML (or data-driven) modeling is known to be improved through training with additional data; however, the improvement mechanism needs to be better understood and documented. This study explores the connection between the amount of information contained in the data used to train an ML model and the model’s prediction accuracy. The amount of information was quantified using Shannon’s information theory, including marginal and transfer entropy. Three ML models were trained to predict the flow discharge, sediment, total nitrogen, and total phosphorus loads of four watersheds. The amount of information contained in the training data was increased by sequentially adding weather data and the simulation outputs of uncalibrated and/or calibrated mechanistic (or theory-driven) models. The reliability of training data was considered a surrogate of information quality, and accuracy statistics were used to measure the quality (or reliability) of the uncalibrated and calibrated theory-driven modeling outputs to be provided as training data for ML modeling. The results demonstrated that the prediction accuracy of hydrological ML modeling depends on the quality and quantity of information contained in the training data. The use of all types of training data provided the best hydrological ML prediction accuracy. ML models trained only with weather data and calibrated theory-driven modeling outputs could most efficiently improve accuracy in terms of information use. This study thus illustrates how a theory-driven approach can help improve the accuracy of data-driven modeling by providing quality information about a system of interest.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this preprint. The responsibility to include appropriate place names lies with the authors.
Minhyuk Jeung, Younggu Her, Sang-Soo Baek, and Kwangsik Yoon

Status: final response (author comments only)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on hess-2024-284', Anonymous Referee #1, 03 Nov 2024
  • RC2: 'Comment on hess-2024-284', Anonymous Referee #2, 24 Nov 2024
Minhyuk Jeung, Younggu Her, Sang-Soo Baek, and Kwangsik Yoon
Minhyuk Jeung, Younggu Her, Sang-Soo Baek, and Kwangsik Yoon

Viewed

Total article views: 288 (including HTML, PDF, and XML)
HTML PDF XML Total Supplement BibTeX EndNote
198 40 50 288 19 5 3
  • HTML: 198
  • PDF: 40
  • XML: 50
  • Total: 288
  • Supplement: 19
  • BibTeX: 5
  • EndNote: 3
Views and downloads (calculated since 07 Oct 2024)
Cumulative views and downloads (calculated since 07 Oct 2024)

Viewed (geographical distribution)

Total article views: 283 (including HTML, PDF, and XML) Thereof 283 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 09 Dec 2024
Download
Short summary
Machine learning (ML) techniques have become widely used due to the availability of large data repositories and advancements in computing resources and methods. Our study explored the connection between a model’s accuracy and the information content of input data. Results showed that the accuracy of three ML models significantly improved when high-quality input data were included. These findings highlight the importance of data quality in ML model training.