Expert judgement for dependence in probabilistic modelling

a systematic literature review and future research directions

Christoph Werner, Tim Bedford, Roger M. Cooke, Anca M. Hanea, Oswaldo Morales-Napoles

Research output: Contribution to journalArticle

20 Citations (Scopus)
18 Downloads (Pure)

Abstract

Many applications in decision making under uncertainty and probabilistic risk assessment require the assessment of mul- tiple, dependent uncertain quantities, so that in addition to marginal distributions, interdependence needs to be modelled in order to properly understand the overall risk. Nevertheless, relevant historical data on dependence information are often not available or simply too costly to obtain. In this case, the only sensible option is to elicit this uncertainty through the use of expert judgements. In expert judgement studies, a structured approach to eliciting variables of interest is desirable so that their assessment is methodologically robust. One of the key decisions during the elicitation process is the form in which the uncertainties are elicited. This choice is subject to various, potentially con icting, desiderata related to e.g. modelling convenience, coherence between elicitation parameters and the model, combining judgements, and the assessment burden for the experts. While extensive and systematic guidance to address these considerations exists for single variable uncertainty elicitation, for higher dimensions very little such guidance is available. Therefore this paper o ers a systematic review of the current literature on eliciting dependence. The literature on the elicitation of dependence parameters such as correlations is presented alongside commonly used dependence models and experience from case studies. From this, guidance about the strategy for dependence assessment is given and gaps in the existing research are identi ed to determine future directions for structured methods to elicit dependence.
Original languageEnglish
Pages (from-to)801-819
Number of pages19
JournalEuropean Journal of Operational Research
Volume258
Issue number3
DOIs
Publication statusPublished - 22 Oct 2016

Fingerprint

Expert Judgment
Probabilistic Modeling
Literature Review
Elicitation
Guidance
Uncertainty
Risk assessment
Decision making
Historical Data
Marginal Distribution
Risk Assessment
Higher Dimensions
Literature review
Modeling
Expert judgment
Research directions
Decision Making
Dependent
Model

Keywords

  • risk analysis
  • uncertainty modelling
  • dependence elicitation
  • structured expert judgement
  • dependence modelling

Cite this

Werner, Christoph ; Bedford, Tim ; Cooke, Roger M. ; Hanea, Anca M. ; Morales-Napoles, Oswaldo. / Expert judgement for dependence in probabilistic modelling : a systematic literature review and future research directions. In: European Journal of Operational Research. 2016 ; Vol. 258, No. 3. pp. 801-819.
@article{21fb1ab735a24be39f2699ee2fa057f1,
title = "Expert judgement for dependence in probabilistic modelling: a systematic literature review and future research directions",
abstract = "Many applications in decision making under uncertainty and probabilistic risk assessment require the assessment of mul- tiple, dependent uncertain quantities, so that in addition to marginal distributions, interdependence needs to be modelled in order to properly understand the overall risk. Nevertheless, relevant historical data on dependence information are often not available or simply too costly to obtain. In this case, the only sensible option is to elicit this uncertainty through the use of expert judgements. In expert judgement studies, a structured approach to eliciting variables of interest is desirable so that their assessment is methodologically robust. One of the key decisions during the elicitation process is the form in which the uncertainties are elicited. This choice is subject to various, potentially con icting, desiderata related to e.g. modelling convenience, coherence between elicitation parameters and the model, combining judgements, and the assessment burden for the experts. While extensive and systematic guidance to address these considerations exists for single variable uncertainty elicitation, for higher dimensions very little such guidance is available. Therefore this paper o ers a systematic review of the current literature on eliciting dependence. The literature on the elicitation of dependence parameters such as correlations is presented alongside commonly used dependence models and experience from case studies. From this, guidance about the strategy for dependence assessment is given and gaps in the existing research are identi ed to determine future directions for structured methods to elicit dependence.",
keywords = "risk analysis, uncertainty modelling, dependence elicitation, structured expert judgement, dependence modelling",
author = "Christoph Werner and Tim Bedford and Cooke, {Roger M.} and Hanea, {Anca M.} and Oswaldo Morales-Napoles",
year = "2016",
month = "10",
day = "22",
doi = "10.1016/j.ejor.2016.10.018",
language = "English",
volume = "258",
pages = "801--819",
journal = "European Journal of Operational Research",
issn = "0377-2217",
number = "3",

}

Expert judgement for dependence in probabilistic modelling : a systematic literature review and future research directions. / Werner, Christoph; Bedford, Tim; Cooke, Roger M.; Hanea, Anca M.; Morales-Napoles, Oswaldo.

In: European Journal of Operational Research, Vol. 258, No. 3, 22.10.2016, p. 801-819.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Expert judgement for dependence in probabilistic modelling

T2 - a systematic literature review and future research directions

AU - Werner, Christoph

AU - Bedford, Tim

AU - Cooke, Roger M.

AU - Hanea, Anca M.

AU - Morales-Napoles, Oswaldo

PY - 2016/10/22

Y1 - 2016/10/22

N2 - Many applications in decision making under uncertainty and probabilistic risk assessment require the assessment of mul- tiple, dependent uncertain quantities, so that in addition to marginal distributions, interdependence needs to be modelled in order to properly understand the overall risk. Nevertheless, relevant historical data on dependence information are often not available or simply too costly to obtain. In this case, the only sensible option is to elicit this uncertainty through the use of expert judgements. In expert judgement studies, a structured approach to eliciting variables of interest is desirable so that their assessment is methodologically robust. One of the key decisions during the elicitation process is the form in which the uncertainties are elicited. This choice is subject to various, potentially con icting, desiderata related to e.g. modelling convenience, coherence between elicitation parameters and the model, combining judgements, and the assessment burden for the experts. While extensive and systematic guidance to address these considerations exists for single variable uncertainty elicitation, for higher dimensions very little such guidance is available. Therefore this paper o ers a systematic review of the current literature on eliciting dependence. The literature on the elicitation of dependence parameters such as correlations is presented alongside commonly used dependence models and experience from case studies. From this, guidance about the strategy for dependence assessment is given and gaps in the existing research are identi ed to determine future directions for structured methods to elicit dependence.

AB - Many applications in decision making under uncertainty and probabilistic risk assessment require the assessment of mul- tiple, dependent uncertain quantities, so that in addition to marginal distributions, interdependence needs to be modelled in order to properly understand the overall risk. Nevertheless, relevant historical data on dependence information are often not available or simply too costly to obtain. In this case, the only sensible option is to elicit this uncertainty through the use of expert judgements. In expert judgement studies, a structured approach to eliciting variables of interest is desirable so that their assessment is methodologically robust. One of the key decisions during the elicitation process is the form in which the uncertainties are elicited. This choice is subject to various, potentially con icting, desiderata related to e.g. modelling convenience, coherence between elicitation parameters and the model, combining judgements, and the assessment burden for the experts. While extensive and systematic guidance to address these considerations exists for single variable uncertainty elicitation, for higher dimensions very little such guidance is available. Therefore this paper o ers a systematic review of the current literature on eliciting dependence. The literature on the elicitation of dependence parameters such as correlations is presented alongside commonly used dependence models and experience from case studies. From this, guidance about the strategy for dependence assessment is given and gaps in the existing research are identi ed to determine future directions for structured methods to elicit dependence.

KW - risk analysis

KW - uncertainty modelling

KW - dependence elicitation

KW - structured expert judgement

KW - dependence modelling

UR - http://www.sciencedirect.com/science/journal/03772217

U2 - 10.1016/j.ejor.2016.10.018

DO - 10.1016/j.ejor.2016.10.018

M3 - Article

VL - 258

SP - 801

EP - 819

JO - European Journal of Operational Research

JF - European Journal of Operational Research

SN - 0377-2217

IS - 3

ER -