.. _val_uncert: Model validation and uncertainty ================================ Uncertainty *************** Simulation uncertainty ---------------------- The main purpose of the model is to assess the impact of an intervention, or alternative scenarios. In order to do this, the model is run twice and outcomes are compared (e.g. obesity vs. no obesity). To estimate simulation uncertainty, the simulation is distributed into subsamples which allows us to compute the mean and standard deviation of all outcomes. Baseline uncertainty -------------------- For baseline projections, one source of uncertainty is the input parameters used. Due to computing time constraints, this uncertainty is not included in the model. Instead the model is run with mid-parameter estimates. The underlying approach to this assumption is that most of the uncertainty at baseline 'disappears' when computing differences in impact. Therefore, the difference between mean and standard deviation represents the true uncertainty across scenarios. Intervention uncertainty ----------------------------------- The majority of intervention uncertainty comes from uncertainty surrounding the intervention's parameters. The model can estimate this uncertainty by running the intervention with different sets of parameters which provide different estimate outcomes. .. todo:: * Michele comment: Include information from ISPOR guidelines on modelling and graphs validating model (ask Alienor) Validation Results ******************** Demography ------------ .. figure:: image/population_yearly/population_yearly_0.png :width: 600px :align: center :figclass: align-center Total Population, input and simulated output .. figure:: image/population_AG/population_AG_0.png :width: 600px :align: center :figclass: align-center Population by age-group (averages over 2005-2015), input and simulated output Risk Factors ------------ BMI ```` .. figure:: image/BMI/BMI_0.png :width: 600px :align: center :figclass: align-center Overweight and obesity prevalence by age-group (averages over 2005-2015), input and simulated output Diseases ------------ Diabetes `````````` .. figure:: image/Diabetes_M/Diabetes_M_0.png :width: 600px :align: center :figclass: align-center 2015 Diabetes prevalence for men (input and simulated output) .. figure:: image/Diabetes_F/Diabetes_f_0.png :width: 600px :align: center :figclass: align-center 2015 Diabetes prevalence for women (input and simulated output) Cancers ```````` .. figure:: image/cancer_incidence/cancer_incidence_0.png :width: 600px :align: center :figclass: align-center Cancer incidence cases (averages over 2005_2015) inputs and outputs