Improving the practical application of the Delphi method in group-based judgment: a six-step prescription for a well-founded and defensible process

Ian Belton, Alice MacDonald, George Wright, Iain Hamlin

Research output: Contribution to journalArticle

Abstract

This paper provides a practical, systematic approach to the design and delivery of a Delphi survey. We prescribe a sequence of six steps to do with (i) setting up the Delphi process – including selecting respondents and generating a requisite number of focal issues, (ii) software/delivery choice, (iii) developing question items and response scales, (iv) providing feedback between a requisite number of Delphi rounds, (v) preventing and dealing with panellist drop out, and (vi) analysing and presenting the Delphi yield. At each step, the Delphi administrator has a range of choice options and we provide discussion of the pros and cons of each option - in order that the overall design and delivery of a particular Delphi survey is both well-founded and defensible.
LanguageEnglish
Pages72-82
Number of pages11
JournalTechnological Forecasting and Social Change
Volume147
Early online date19 Jul 2019
DOIs
Publication statusPublished - 31 Oct 2019

Fingerprint

Prescriptions
Administrative Personnel
Feedback
Software
Surveys and Questionnaires
Prescription
Delphi method
Delphi
Delphi survey

Keywords

  • Delphi
  • review
  • methodology
  • judgement
  • expert
  • consensus

Cite this

@article{30949d3a950e49f19be005da865d8e9f,
title = "Improving the practical application of the Delphi method in group-based judgment: a six-step prescription for a well-founded and defensible process",
abstract = "This paper provides a practical, systematic approach to the design and delivery of a Delphi survey. We prescribe a sequence of six steps to do with (i) setting up the Delphi process – including selecting respondents and generating a requisite number of focal issues, (ii) software/delivery choice, (iii) developing question items and response scales, (iv) providing feedback between a requisite number of Delphi rounds, (v) preventing and dealing with panellist drop out, and (vi) analysing and presenting the Delphi yield. At each step, the Delphi administrator has a range of choice options and we provide discussion of the pros and cons of each option - in order that the overall design and delivery of a particular Delphi survey is both well-founded and defensible.",
keywords = "Delphi, review, methodology, judgement, expert, consensus",
author = "Ian Belton and Alice MacDonald and George Wright and Iain Hamlin",
year = "2019",
month = "10",
day = "31",
doi = "10.1016/j.techfore.2019.07.002",
language = "English",
volume = "147",
pages = "72--82",
journal = "Technological Forecasting and Social Change",
issn = "0040-1625",

}

TY - JOUR

T1 - Improving the practical application of the Delphi method in group-based judgment

T2 - Technological Forecasting and Social Change

AU - Belton, Ian

AU - MacDonald, Alice

AU - Wright, George

AU - Hamlin, Iain

PY - 2019/10/31

Y1 - 2019/10/31

N2 - This paper provides a practical, systematic approach to the design and delivery of a Delphi survey. We prescribe a sequence of six steps to do with (i) setting up the Delphi process – including selecting respondents and generating a requisite number of focal issues, (ii) software/delivery choice, (iii) developing question items and response scales, (iv) providing feedback between a requisite number of Delphi rounds, (v) preventing and dealing with panellist drop out, and (vi) analysing and presenting the Delphi yield. At each step, the Delphi administrator has a range of choice options and we provide discussion of the pros and cons of each option - in order that the overall design and delivery of a particular Delphi survey is both well-founded and defensible.

AB - This paper provides a practical, systematic approach to the design and delivery of a Delphi survey. We prescribe a sequence of six steps to do with (i) setting up the Delphi process – including selecting respondents and generating a requisite number of focal issues, (ii) software/delivery choice, (iii) developing question items and response scales, (iv) providing feedback between a requisite number of Delphi rounds, (v) preventing and dealing with panellist drop out, and (vi) analysing and presenting the Delphi yield. At each step, the Delphi administrator has a range of choice options and we provide discussion of the pros and cons of each option - in order that the overall design and delivery of a particular Delphi survey is both well-founded and defensible.

KW - Delphi

KW - review

KW - methodology

KW - judgement

KW - expert

KW - consensus

U2 - 10.1016/j.techfore.2019.07.002

DO - 10.1016/j.techfore.2019.07.002

M3 - Article

VL - 147

SP - 72

EP - 82

JO - Technological Forecasting and Social Change

JF - Technological Forecasting and Social Change

SN - 0040-1625

ER -