Quantifying intra-organisational risks: an analysis of practice-theory tensions in probability elicitation to improve technical risk management in an energy utility

Research output: Contribution to journalArticle

Abstract

Assessing the likelihood of future events is core to technical risk management at Scottish Power Generation (SPG). Events can include failures resulting in unavailability of key assets, or incidents impacting staff safety or the environment. Eliciting probabilities from engineers to quantify the likelihood of future, uncertain events is challenging given the diversity of assets across the multiple, heterogeneous power plants operated by SPG. Such probability assessments inform investment decisions intended to manage technical risks and support regulatory compliance. Through interviews with engineers we reveal the opportunities for heuristics and bias that explain some of the historical disparities in assessments intuitively evident to risk managers. We propose better ways of obtaining judgemental probability assessments based on a study involving engineers and a control group of post-experience students. We find that the choice of scale descriptors impacts the probability values of defined events as judged by engineers. Consequently we suggest changes to the risk management system, including new design features to better frame and capture probability assessments. As a consequence of our study, the technical risk management process is being enhanced in a number of ways including the creation of a single organisational-wide framework, clearer guidelines, and better knowledge management.
LanguageEnglish
JournalProceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability
Early online date21 Jan 2015
DOIs
Publication statusPublished - 2015

Fingerprint

Risk analysis
Risk management
Engineers
Power generation
Knowledge management
Power plants
Managers
Students

Keywords

  • energy
  • engineering
  • judgemental probability
  • uncertainty
  • risk management

Cite this

@article{ae9acbe4bcc44ae0b4f88fc7d9debffc,
title = "Quantifying intra-organisational risks: an analysis of practice-theory tensions in probability elicitation to improve technical risk management in an energy utility",
abstract = "Assessing the likelihood of future events is core to technical risk management at Scottish Power Generation (SPG). Events can include failures resulting in unavailability of key assets, or incidents impacting staff safety or the environment. Eliciting probabilities from engineers to quantify the likelihood of future, uncertain events is challenging given the diversity of assets across the multiple, heterogeneous power plants operated by SPG. Such probability assessments inform investment decisions intended to manage technical risks and support regulatory compliance. Through interviews with engineers we reveal the opportunities for heuristics and bias that explain some of the historical disparities in assessments intuitively evident to risk managers. We propose better ways of obtaining judgemental probability assessments based on a study involving engineers and a control group of post-experience students. We find that the choice of scale descriptors impacts the probability values of defined events as judged by engineers. Consequently we suggest changes to the risk management system, including new design features to better frame and capture probability assessments. As a consequence of our study, the technical risk management process is being enhanced in a number of ways including the creation of a single organisational-wide framework, clearer guidelines, and better knowledge management.",
keywords = "energy, engineering, judgemental probability , uncertainty, risk management",
author = "Anderson, {Gillian Hopkins} and Lesley Walls and Matthew Revie and Euan Fenelon and Calum Storie",
note = "Copyright {\circledC} 2015 by Institution of Mechanical Engineers",
year = "2015",
doi = "10.1177/1748006X14566222",
language = "English",
journal = "Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability",
issn = "1748-006X",

}

TY - JOUR

T1 - Quantifying intra-organisational risks

T2 - Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability

AU - Anderson, Gillian Hopkins

AU - Walls, Lesley

AU - Revie, Matthew

AU - Fenelon, Euan

AU - Storie, Calum

N1 - Copyright © 2015 by Institution of Mechanical Engineers

PY - 2015

Y1 - 2015

N2 - Assessing the likelihood of future events is core to technical risk management at Scottish Power Generation (SPG). Events can include failures resulting in unavailability of key assets, or incidents impacting staff safety or the environment. Eliciting probabilities from engineers to quantify the likelihood of future, uncertain events is challenging given the diversity of assets across the multiple, heterogeneous power plants operated by SPG. Such probability assessments inform investment decisions intended to manage technical risks and support regulatory compliance. Through interviews with engineers we reveal the opportunities for heuristics and bias that explain some of the historical disparities in assessments intuitively evident to risk managers. We propose better ways of obtaining judgemental probability assessments based on a study involving engineers and a control group of post-experience students. We find that the choice of scale descriptors impacts the probability values of defined events as judged by engineers. Consequently we suggest changes to the risk management system, including new design features to better frame and capture probability assessments. As a consequence of our study, the technical risk management process is being enhanced in a number of ways including the creation of a single organisational-wide framework, clearer guidelines, and better knowledge management.

AB - Assessing the likelihood of future events is core to technical risk management at Scottish Power Generation (SPG). Events can include failures resulting in unavailability of key assets, or incidents impacting staff safety or the environment. Eliciting probabilities from engineers to quantify the likelihood of future, uncertain events is challenging given the diversity of assets across the multiple, heterogeneous power plants operated by SPG. Such probability assessments inform investment decisions intended to manage technical risks and support regulatory compliance. Through interviews with engineers we reveal the opportunities for heuristics and bias that explain some of the historical disparities in assessments intuitively evident to risk managers. We propose better ways of obtaining judgemental probability assessments based on a study involving engineers and a control group of post-experience students. We find that the choice of scale descriptors impacts the probability values of defined events as judged by engineers. Consequently we suggest changes to the risk management system, including new design features to better frame and capture probability assessments. As a consequence of our study, the technical risk management process is being enhanced in a number of ways including the creation of a single organisational-wide framework, clearer guidelines, and better knowledge management.

KW - energy

KW - engineering

KW - judgemental probability

KW - uncertainty

KW - risk management

UR - http://pio.sagepub.com/content/by/year

U2 - 10.1177/1748006X14566222

DO - 10.1177/1748006X14566222

M3 - Article

JO - Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability

JF - Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability

SN - 1748-006X

ER -