An increasing number of flood forecasting services assess and communicate the uncertainty associated with their forecasts. We present a crash-testing framework that evaluates the quality of hydrological forecasts in an extrapolation context. Overall, the results highlight the challenge of uncertainty quantification when forecasting high flows. They show a significant drop in reliability when forecasting high flows and considerable variability among catchments and across lead times.