Answers are grounded in this paper and cite their sources.
Summary Integrated population modelling is proving to be an important and useful technique in statistical ecology. However, there is currently no simple formal method for judging how well models fit data, when potentially several different data sets described by different structured models are being analysed in combination. We propose and evaluate a new approach, of calibrated simulation. Here, comparative data sets are obtained from simulating data when model parameter values are obtained from the assumed asymptotic normal distribution of the maximum‐likelihood estimators from the real data. The approach is motivated and justified byBayesianP‐values. Calibration of the resulting statistics is achieved as repeated data sets are easily simulated from the fitted model. The method requires the specification of model discrepancy measures, and we show how different measures can highlight different aspects of fit. Calibration is only strictly necessary if the statistics proposed may appear to be extreme. The approach of using calibrated simulation to check the goodness‐of‐fit of integrated population models is demonstrated by application to data sets on lapwings and herons. In each case, there are two data sets involved in the integrated analysis, and for each component data set, discrepancy measures of goodness‐of‐fit are obtained. For the lapwing application, as replication is efficient, it is possible to calibrate the procedure simply by using additional simulations. The heron application is shown to be feasible, but is substantially harder to calibrate, due to the presence of productivity thresholds that need to be estimated using profile likelihood methods. We demonstrate the importance of taking more than one discrepancy measure for time‐series data. Avenues for future research are outlined. This article has supplementary materials on line.
No takes yet. Share an insight, caveat, or question.
Besbeas et al. (2014) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: