Developing robust composite measures of healthcare quality: ranking intervals and dominance relations for Scottish Health Boards

Laura Schang, Yrjänä Hynninen, Alec Morton, Ahti Salo

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Although composite indicators are widely used to inform health system performance comparisons, such measures typically embed contentious assumptions, for instance about the weights assigned to constituent indicators. Moreover, although many comparative measures are constructed as ratios, the choice of denominator is not always straightforward. The conventional approach is to determine a single set of weights and to choose a single denominator, even though this involves considerable methodological difficulties.
This study proposes an alternative approach to handle the lack of information about an appropriate set of weights and about a defensible denominator in composite indicators which considers all feasible weights and can incorporate multiple denominators. We illustrate this approach for comparative quality assessments of Scottish Health Boards. The results (displayed as ranking intervals and dominance relations) help identify Boards which cannot be ranked, say, worse than 4th or better than 7th. Such rankings give policy-makers a sense of the uncertainty around ranks, indicating the extent to which action is warranted. By identifying the full range of rankings that the organizations under comparison may attain, the approach proposed here acknowledges imperfect information about the “correct” set of weights and the appropriate denominator and may thus help to increase transparency of and confidence in health system
performance comparisons.
LanguageEnglish
Pages59-67
Number of pages9
JournalSocial Science and Medicine
Volume162
Early online date16 Jun 2016
DOIs
Publication statusPublished - 31 Aug 2016

Fingerprint

Quality of Health Care
ranking
Weights and Measures
Health
system comparison
health
performance comparison
transparency
confidence
uncertainty
Administrative Personnel
lack
Uncertainty
Healthcare
Ranking

Keywords

  • performance comparison
  • composite indicator
  • weight denominator
  • ranking interval
  • dominance relation

Cite this

@article{5cf0f1e4969f4c30bc6868967266d203,
title = "Developing robust composite measures of healthcare quality: ranking intervals and dominance relations for Scottish Health Boards",
abstract = "Although composite indicators are widely used to inform health system performance comparisons, such measures typically embed contentious assumptions, for instance about the weights assigned to constituent indicators. Moreover, although many comparative measures are constructed as ratios, the choice of denominator is not always straightforward. The conventional approach is to determine a single set of weights and to choose a single denominator, even though this involves considerable methodological difficulties.This study proposes an alternative approach to handle the lack of information about an appropriate set of weights and about a defensible denominator in composite indicators which considers all feasible weights and can incorporate multiple denominators. We illustrate this approach for comparative quality assessments of Scottish Health Boards. The results (displayed as ranking intervals and dominance relations) help identify Boards which cannot be ranked, say, worse than 4th or better than 7th. Such rankings give policy-makers a sense of the uncertainty around ranks, indicating the extent to which action is warranted. By identifying the full range of rankings that the organizations under comparison may attain, the approach proposed here acknowledges imperfect information about the “correct” set of weights and the appropriate denominator and may thus help to increase transparency of and confidence in health systemperformance comparisons.",
keywords = "performance comparison, composite indicator, weight denominator, ranking interval, dominance relation",
author = "Laura Schang and Yrj{\"a}n{\"a} Hynninen and Alec Morton and Ahti Salo",
year = "2016",
month = "8",
day = "31",
doi = "10.1016/j.socscimed.2016.06.026",
language = "English",
volume = "162",
pages = "59--67",
journal = "Social Science and Medicine",
issn = "0277-9536",

}

Developing robust composite measures of healthcare quality : ranking intervals and dominance relations for Scottish Health Boards. / Schang, Laura; Hynninen, Yrjänä; Morton, Alec; Salo, Ahti.

In: Social Science and Medicine, Vol. 162, 31.08.2016, p. 59-67.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Developing robust composite measures of healthcare quality

T2 - Social Science and Medicine

AU - Schang, Laura

AU - Hynninen, Yrjänä

AU - Morton, Alec

AU - Salo, Ahti

PY - 2016/8/31

Y1 - 2016/8/31

N2 - Although composite indicators are widely used to inform health system performance comparisons, such measures typically embed contentious assumptions, for instance about the weights assigned to constituent indicators. Moreover, although many comparative measures are constructed as ratios, the choice of denominator is not always straightforward. The conventional approach is to determine a single set of weights and to choose a single denominator, even though this involves considerable methodological difficulties.This study proposes an alternative approach to handle the lack of information about an appropriate set of weights and about a defensible denominator in composite indicators which considers all feasible weights and can incorporate multiple denominators. We illustrate this approach for comparative quality assessments of Scottish Health Boards. The results (displayed as ranking intervals and dominance relations) help identify Boards which cannot be ranked, say, worse than 4th or better than 7th. Such rankings give policy-makers a sense of the uncertainty around ranks, indicating the extent to which action is warranted. By identifying the full range of rankings that the organizations under comparison may attain, the approach proposed here acknowledges imperfect information about the “correct” set of weights and the appropriate denominator and may thus help to increase transparency of and confidence in health systemperformance comparisons.

AB - Although composite indicators are widely used to inform health system performance comparisons, such measures typically embed contentious assumptions, for instance about the weights assigned to constituent indicators. Moreover, although many comparative measures are constructed as ratios, the choice of denominator is not always straightforward. The conventional approach is to determine a single set of weights and to choose a single denominator, even though this involves considerable methodological difficulties.This study proposes an alternative approach to handle the lack of information about an appropriate set of weights and about a defensible denominator in composite indicators which considers all feasible weights and can incorporate multiple denominators. We illustrate this approach for comparative quality assessments of Scottish Health Boards. The results (displayed as ranking intervals and dominance relations) help identify Boards which cannot be ranked, say, worse than 4th or better than 7th. Such rankings give policy-makers a sense of the uncertainty around ranks, indicating the extent to which action is warranted. By identifying the full range of rankings that the organizations under comparison may attain, the approach proposed here acknowledges imperfect information about the “correct” set of weights and the appropriate denominator and may thus help to increase transparency of and confidence in health systemperformance comparisons.

KW - performance comparison

KW - composite indicator

KW - weight denominator

KW - ranking interval

KW - dominance relation

UR - http://www.sciencedirect.com/science/article/pii/S0277953616303100

U2 - 10.1016/j.socscimed.2016.06.026

DO - 10.1016/j.socscimed.2016.06.026

M3 - Article

VL - 162

SP - 59

EP - 67

JO - Social Science and Medicine

JF - Social Science and Medicine

SN - 0277-9536

ER -