Safety in numbers 5: evaluation of computer-based authentic assessment and high fidelity simulated OSCE environments as a framework for articulating a point of registration medication dosage calculation benchmark

M. Sabin, K. Weeks, David Rowe, M. Hutton, D. Coben, C. Hall, Norman Woolley

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

This paper reports a key educational initiative undertaken by NHS Education for Scotland (NES), based upon recommendations from a ‘Numeracy in Healthcare’ consultation. We report here the design of a web-based technical measurement authentic assessment environment evolved from the safeMedicate suite of programs that provided a model for an environment within which a medication dosage calculation problem-solving (MDC-PS) benchmark could be articulated. A sample of 63 third-year pre-registration nursing students was recruited from four participating universities in the UK. A counterbalanced design was employed where the virtual authentic assessment environment was evaluated for internal consistency reliability and criterion-related validity against an objective structured clinical assessment (OSCE) undertaken in high-fidelity simulated clinical environments. Outcome measures indicated an extremely high internal consistency of the web-based environment. It was concluded that the combination of a web-based authentic assessment environment and further assessment of safe technical measurement interpretation and dexterity in a practice/practice simulation setting, populated with a benchmark and a criterion referenced rubric validated by the profession, is an innovative, viable, valid and reliable assessment method for the safe administration of medicines. As a result, the rubric for assessment of the appropriate range of calculation type and complexity informed the NMC’s revised Essential Skills Clusters for Medicines Management (NMC, 2010a; NMC, 2010b). This inclusion provides a particularly strong example of both research directly influencing policy and of evidence-based regulation.
LanguageEnglish
Pagese55-e65
Number of pages11
JournalNurse Education in Practice
Volume13
Issue number2
DOIs
Publication statusPublished - Mar 2013

Fingerprint

Benchmarking
medication
Safety
evaluation
medicine
Nursing Students
Scotland
Referral and Consultation
Outcome Assessment (Health Care)
nursing
Delivery of Health Care
Education
profession
inclusion
regulation
simulation
interpretation
university
Research
management

Keywords

  • measurement
  • nursing practice
  • patient safety

Cite this

@article{a424cbb4d44e4a498402bbd890a042df,
title = "Safety in numbers 5: evaluation of computer-based authentic assessment and high fidelity simulated OSCE environments as a framework for articulating a point of registration medication dosage calculation benchmark",
abstract = "This paper reports a key educational initiative undertaken by NHS Education for Scotland (NES), based upon recommendations from a ‘Numeracy in Healthcare’ consultation. We report here the design of a web-based technical measurement authentic assessment environment evolved from the safeMedicate suite of programs that provided a model for an environment within which a medication dosage calculation problem-solving (MDC-PS) benchmark could be articulated. A sample of 63 third-year pre-registration nursing students was recruited from four participating universities in the UK. A counterbalanced design was employed where the virtual authentic assessment environment was evaluated for internal consistency reliability and criterion-related validity against an objective structured clinical assessment (OSCE) undertaken in high-fidelity simulated clinical environments. Outcome measures indicated an extremely high internal consistency of the web-based environment. It was concluded that the combination of a web-based authentic assessment environment and further assessment of safe technical measurement interpretation and dexterity in a practice/practice simulation setting, populated with a benchmark and a criterion referenced rubric validated by the profession, is an innovative, viable, valid and reliable assessment method for the safe administration of medicines. As a result, the rubric for assessment of the appropriate range of calculation type and complexity informed the NMC’s revised Essential Skills Clusters for Medicines Management (NMC, 2010a; NMC, 2010b). This inclusion provides a particularly strong example of both research directly influencing policy and of evidence-based regulation.",
keywords = "measurement, nursing practice, patient safety",
author = "M. Sabin and K. Weeks and David Rowe and M. Hutton and D. Coben and C. Hall and Norman Woolley",
year = "2013",
month = "3",
doi = "10.1016/j.nepr.2012.10.009",
language = "English",
volume = "13",
pages = "e55--e65",
journal = "Nurse Education in Practice",
issn = "1471-5953",
number = "2",

}

Safety in numbers 5 : evaluation of computer-based authentic assessment and high fidelity simulated OSCE environments as a framework for articulating a point of registration medication dosage calculation benchmark. / Sabin, M.; Weeks, K.; Rowe, David; Hutton, M.; Coben, D.; Hall, C.; Woolley, Norman.

In: Nurse Education in Practice, Vol. 13, No. 2, 03.2013, p. e55-e65.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Safety in numbers 5

T2 - Nurse Education in Practice

AU - Sabin, M.

AU - Weeks, K.

AU - Rowe, David

AU - Hutton, M.

AU - Coben, D.

AU - Hall, C.

AU - Woolley, Norman

PY - 2013/3

Y1 - 2013/3

N2 - This paper reports a key educational initiative undertaken by NHS Education for Scotland (NES), based upon recommendations from a ‘Numeracy in Healthcare’ consultation. We report here the design of a web-based technical measurement authentic assessment environment evolved from the safeMedicate suite of programs that provided a model for an environment within which a medication dosage calculation problem-solving (MDC-PS) benchmark could be articulated. A sample of 63 third-year pre-registration nursing students was recruited from four participating universities in the UK. A counterbalanced design was employed where the virtual authentic assessment environment was evaluated for internal consistency reliability and criterion-related validity against an objective structured clinical assessment (OSCE) undertaken in high-fidelity simulated clinical environments. Outcome measures indicated an extremely high internal consistency of the web-based environment. It was concluded that the combination of a web-based authentic assessment environment and further assessment of safe technical measurement interpretation and dexterity in a practice/practice simulation setting, populated with a benchmark and a criterion referenced rubric validated by the profession, is an innovative, viable, valid and reliable assessment method for the safe administration of medicines. As a result, the rubric for assessment of the appropriate range of calculation type and complexity informed the NMC’s revised Essential Skills Clusters for Medicines Management (NMC, 2010a; NMC, 2010b). This inclusion provides a particularly strong example of both research directly influencing policy and of evidence-based regulation.

AB - This paper reports a key educational initiative undertaken by NHS Education for Scotland (NES), based upon recommendations from a ‘Numeracy in Healthcare’ consultation. We report here the design of a web-based technical measurement authentic assessment environment evolved from the safeMedicate suite of programs that provided a model for an environment within which a medication dosage calculation problem-solving (MDC-PS) benchmark could be articulated. A sample of 63 third-year pre-registration nursing students was recruited from four participating universities in the UK. A counterbalanced design was employed where the virtual authentic assessment environment was evaluated for internal consistency reliability and criterion-related validity against an objective structured clinical assessment (OSCE) undertaken in high-fidelity simulated clinical environments. Outcome measures indicated an extremely high internal consistency of the web-based environment. It was concluded that the combination of a web-based authentic assessment environment and further assessment of safe technical measurement interpretation and dexterity in a practice/practice simulation setting, populated with a benchmark and a criterion referenced rubric validated by the profession, is an innovative, viable, valid and reliable assessment method for the safe administration of medicines. As a result, the rubric for assessment of the appropriate range of calculation type and complexity informed the NMC’s revised Essential Skills Clusters for Medicines Management (NMC, 2010a; NMC, 2010b). This inclusion provides a particularly strong example of both research directly influencing policy and of evidence-based regulation.

KW - measurement

KW - nursing practice

KW - patient safety

U2 - 10.1016/j.nepr.2012.10.009

DO - 10.1016/j.nepr.2012.10.009

M3 - Article

VL - 13

SP - e55-e65

JO - Nurse Education in Practice

JF - Nurse Education in Practice

SN - 1471-5953

IS - 2

ER -