Technical note: measurement issues in taxonomic reliability

John B. Davies, Alastair Ross, B. Wallace

Research output: Contribution to journalArticle

26 Citations (Scopus)

Abstract

Work in safety management often involves classification of events using coding schemes or 'taxonomies'. Such schemes contain separate categories, and users have to reliably choose which codes apply to the events in question. The usefulness of any system is limited by the reliability with which it can be employed, that is the consensus that can be reached on application of codes. This technical note is concerned with practical and theoretical issues in defining and measuring such reliability. Three problem areas are covered: the use of correlational measures, the reporting and calculating of indices of concordance and the use of correction coefficients.
Original languageEnglish
Pages (from-to)771-778
Number of pages7
JournalSafety Science
Volume42
Issue number8
DOIs
Publication statusPublished - Oct 2004

Fingerprint

Safety Management
event
Taxonomies
taxonomy
coding
management

Keywords

  • taxonomies
  • classification
  • reliability
  • inter-rater consensus

Cite this

Davies, John B. ; Ross, Alastair ; Wallace, B. / Technical note: measurement issues in taxonomic reliability. In: Safety Science. 2004 ; Vol. 42, No. 8. pp. 771-778.
@article{1487113002594479abd857f4cc7d6e58,
title = "Technical note: measurement issues in taxonomic reliability",
abstract = "Work in safety management often involves classification of events using coding schemes or 'taxonomies'. Such schemes contain separate categories, and users have to reliably choose which codes apply to the events in question. The usefulness of any system is limited by the reliability with which it can be employed, that is the consensus that can be reached on application of codes. This technical note is concerned with practical and theoretical issues in defining and measuring such reliability. Three problem areas are covered: the use of correlational measures, the reporting and calculating of indices of concordance and the use of correction coefficients.",
keywords = "taxonomies, classification, reliability, inter-rater consensus",
author = "Davies, {John B.} and Alastair Ross and B. Wallace",
year = "2004",
month = "10",
doi = "10.1016/j.ssci.2003.10.004",
language = "English",
volume = "42",
pages = "771--778",
journal = "Safety Science",
issn = "0925-7535",
number = "8",

}

Technical note: measurement issues in taxonomic reliability. / Davies, John B.; Ross, Alastair; Wallace, B.

In: Safety Science, Vol. 42, No. 8, 10.2004, p. 771-778.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Technical note: measurement issues in taxonomic reliability

AU - Davies, John B.

AU - Ross, Alastair

AU - Wallace, B.

PY - 2004/10

Y1 - 2004/10

N2 - Work in safety management often involves classification of events using coding schemes or 'taxonomies'. Such schemes contain separate categories, and users have to reliably choose which codes apply to the events in question. The usefulness of any system is limited by the reliability with which it can be employed, that is the consensus that can be reached on application of codes. This technical note is concerned with practical and theoretical issues in defining and measuring such reliability. Three problem areas are covered: the use of correlational measures, the reporting and calculating of indices of concordance and the use of correction coefficients.

AB - Work in safety management often involves classification of events using coding schemes or 'taxonomies'. Such schemes contain separate categories, and users have to reliably choose which codes apply to the events in question. The usefulness of any system is limited by the reliability with which it can be employed, that is the consensus that can be reached on application of codes. This technical note is concerned with practical and theoretical issues in defining and measuring such reliability. Three problem areas are covered: the use of correlational measures, the reporting and calculating of indices of concordance and the use of correction coefficients.

KW - taxonomies

KW - classification

KW - reliability

KW - inter-rater consensus

UR - http://dx.doi.org/10.1016/j.ssci.2003.10.004

U2 - 10.1016/j.ssci.2003.10.004

DO - 10.1016/j.ssci.2003.10.004

M3 - Article

VL - 42

SP - 771

EP - 778

JO - Safety Science

JF - Safety Science

SN - 0925-7535

IS - 8

ER -