Model performance analysis for Bayesian biomass dynamics models using bias, precision and reliability metrics

Abstract : Bayesian observation error (OEM), process error (PEM) and state-space (SSM) implementations of a Fox biomass dynamics model are compared using a simulation-estimation approach and by applying them to data for the octopus fishery off Mauritania. Estimation performance is evaluated in terms of bias, precision, and reliability measured by the extreme tail-area probability and the mean highest posterior density interval. The PEM generally performs poorest of the three methods in terms of the these performance metrics. In contrast, the OEM is precise, but under-represents uncertainty. The OEM is outperformed by the SSM in terms of its ability to provide posterior distributions which adequately capture parameter uncertainty. It is key to consider the above four metrics when comparing estimation performance in a Bayesian context. Finally, although model performance measures are useful, there is still a need to examine goodness of fit statistics in actual applications.
Document type :
Journal articles
Complete list of metadatas

https://hal-agrocampus-ouest.archives-ouvertes.fr/hal-00840507
Contributor : Céline Martel <>
Submitted on : Tuesday, July 2, 2013 - 3:46:04 PM
Last modification on : Tuesday, June 4, 2019 - 5:03:52 PM

Identifiers

Citation

K. Ono, Ae. Punt, Etienne Rivot. Model performance analysis for Bayesian biomass dynamics models using bias, precision and reliability metrics. Fisheries Research, Elsevier, 2012, pp.173-183. ⟨10.1016/j.fishres.2012.02.022⟩. ⟨hal-00840507⟩

Share

Metrics

Record views

208