Skip to main content
Article
Evaluating uncertainty estimates in hydrologic models: borrowing measures from the forecast verification community
Hydrology and Earth System Sciences
  • Kristie J. Franz, Iowa State University
  • T. S. Hogue, University of California, Los Angeles
Document Type
Article
Publication Version
Published Version
Publication Date
11-1-2011
DOI
10.5194/hess-15-3367-2011
Abstract

The hydrologic community is generally moving towards the use of probabilistic estimates of streamflow, primarily through the implementation of Ensemble Streamflow Prediction (ESP) systems, ensemble data assimilation methods, or multi-modeling platforms. However, evaluation of probabilistic outputs has not necessarily kept pace with ensemble generation. Much of the modeling community is still performing model evaluation using standard deterministic measures, such as error, correlation, or bias, typically applied to the ensemble mean or median. Probabilistic forecast verification methods have been well developed, particularly in the atmospheric sciences, yet few have been adopted for evaluating uncertainty estimates in hydrologic model simulations. In the current paper, we overview existing probabilistic forecast verification methods and apply the methods to evaluate and compare model ensembles produced from two different parameter uncertainty estimation methods: the Generalized Uncertainty Likelihood Estimator (GLUE), and the Shuffle Complex Evolution Metropolis (SCEM). Model ensembles are generated for the National Weather Service SACramento Soil Moisture Accounting (SAC-SMA) model for 12 forecast basins located in the Southeastern United States. We evaluate the model ensembles using relevant metrics in the following categories: distribution, correlation, accuracy, conditional statistics, and categorical statistics. We show that the presented probabilistic metrics are easily adapted to model simulation ensembles and provide a robust analysis of model performance associated with parameter uncertainty. Application of these methods requires no information in addition to what is already available as part of traditional model validation methodology and considers the entire ensemble or uncertainty range in the approach.

Comments

This article is from Hydrology and Earth System Sciences 15 (2011): 3367, doi: 10.5194/hess-15-3367-2011. Posted with permission.

Rights
This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright Owner
authors
Language
en
File Format
application/pdf
Citation Information
Kristie J. Franz and T. S. Hogue. "Evaluating uncertainty estimates in hydrologic models: borrowing measures from the forecast verification community" Hydrology and Earth System Sciences Vol. 15 Iss. 11 (2011) p. 3367 - 3382
Available at: http://works.bepress.com/kristie-franz/5/