Measuring the effectiveness of reliability growth testing

Research output: Contribution to journalArticle

17 Citations (Scopus)

Abstract

Assessing the effectiveness of reliability growth testing allows decisions to be made about the management of the programme; for example, decisions to allocate resources in an attempt to realize improvements in system reliability, or decisions to terminate testing when there is evidence that reliability has matured. However, such assessments are commonly based on measures of change in the average time between failures, which do not always provide informative measures of effectiveness. We argue that a more appropriate approach is to focus on the identification and realization of faults, which if removed are likely to lead to the improvement in system reliability. Therefore we introduce a model that incorporates the concerns of engineering experts about the likely faults in the initial system design with the information about faults that are realized on test. This model distinguishes between the processes of detecting and removing faults and so captures the effectiveness of test as well as the development of the system design. Using this model, the likely number of faults remaining in the system and the additional test time required to realize them can be estimated. This model was motivated by and assessed by engineers conducting growth tests for complex electronic systems. They consider our measures useful for supporting assessment of test effectiveness.
LanguageEnglish
Pages87-93
Number of pages6
JournalQuality and Reliability Engineering International
Volume15
Issue number2
DOIs
Publication statusPublished - Mar 1999

Fingerprint

Testing
Systems analysis
Engineers
Fault
System reliability
System design
Resources
Change of measure
Measures of effectiveness

Keywords

  • reliability growth
  • Bayesian statistics
  • order statistics
  • NHPP

Cite this

@article{b7874f879b8444ef9652ddbbd17c7f16,
title = "Measuring the effectiveness of reliability growth testing",
abstract = "Assessing the effectiveness of reliability growth testing allows decisions to be made about the management of the programme; for example, decisions to allocate resources in an attempt to realize improvements in system reliability, or decisions to terminate testing when there is evidence that reliability has matured. However, such assessments are commonly based on measures of change in the average time between failures, which do not always provide informative measures of effectiveness. We argue that a more appropriate approach is to focus on the identification and realization of faults, which if removed are likely to lead to the improvement in system reliability. Therefore we introduce a model that incorporates the concerns of engineering experts about the likely faults in the initial system design with the information about faults that are realized on test. This model distinguishes between the processes of detecting and removing faults and so captures the effectiveness of test as well as the development of the system design. Using this model, the likely number of faults remaining in the system and the additional test time required to realize them can be estimated. This model was motivated by and assessed by engineers conducting growth tests for complex electronic systems. They consider our measures useful for supporting assessment of test effectiveness.",
keywords = "reliability growth, Bayesian statistics, order statistics, NHPP",
author = "J.L. Quigley and L.A. Walls",
year = "1999",
month = "3",
doi = "10.1002/(SICI)1099-1638(199903/04)15:2<87::AID-QRE234>3.0.CO;2-Y",
language = "English",
volume = "15",
pages = "87--93",
journal = "Quality and Reliability Engineering International",
issn = "0748-8017",
number = "2",

}

Measuring the effectiveness of reliability growth testing. / Quigley, J.L.; Walls, L.A.

In: Quality and Reliability Engineering International, Vol. 15, No. 2, 03.1999, p. 87-93.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Measuring the effectiveness of reliability growth testing

AU - Quigley, J.L.

AU - Walls, L.A.

PY - 1999/3

Y1 - 1999/3

N2 - Assessing the effectiveness of reliability growth testing allows decisions to be made about the management of the programme; for example, decisions to allocate resources in an attempt to realize improvements in system reliability, or decisions to terminate testing when there is evidence that reliability has matured. However, such assessments are commonly based on measures of change in the average time between failures, which do not always provide informative measures of effectiveness. We argue that a more appropriate approach is to focus on the identification and realization of faults, which if removed are likely to lead to the improvement in system reliability. Therefore we introduce a model that incorporates the concerns of engineering experts about the likely faults in the initial system design with the information about faults that are realized on test. This model distinguishes between the processes of detecting and removing faults and so captures the effectiveness of test as well as the development of the system design. Using this model, the likely number of faults remaining in the system and the additional test time required to realize them can be estimated. This model was motivated by and assessed by engineers conducting growth tests for complex electronic systems. They consider our measures useful for supporting assessment of test effectiveness.

AB - Assessing the effectiveness of reliability growth testing allows decisions to be made about the management of the programme; for example, decisions to allocate resources in an attempt to realize improvements in system reliability, or decisions to terminate testing when there is evidence that reliability has matured. However, such assessments are commonly based on measures of change in the average time between failures, which do not always provide informative measures of effectiveness. We argue that a more appropriate approach is to focus on the identification and realization of faults, which if removed are likely to lead to the improvement in system reliability. Therefore we introduce a model that incorporates the concerns of engineering experts about the likely faults in the initial system design with the information about faults that are realized on test. This model distinguishes between the processes of detecting and removing faults and so captures the effectiveness of test as well as the development of the system design. Using this model, the likely number of faults remaining in the system and the additional test time required to realize them can be estimated. This model was motivated by and assessed by engineers conducting growth tests for complex electronic systems. They consider our measures useful for supporting assessment of test effectiveness.

KW - reliability growth

KW - Bayesian statistics

KW - order statistics

KW - NHPP

UR - http://dx.doi.org/10.1002/(SICI)1099-1638(199903/04)15:2<87::AID-QRE234>3.0.CO;2-Y

U2 - 10.1002/(SICI)1099-1638(199903/04)15:2<87::AID-QRE234>3.0.CO;2-Y

DO - 10.1002/(SICI)1099-1638(199903/04)15:2<87::AID-QRE234>3.0.CO;2-Y

M3 - Article

VL - 15

SP - 87

EP - 93

JO - Quality and Reliability Engineering International

T2 - Quality and Reliability Engineering International

JF - Quality and Reliability Engineering International

SN - 0748-8017

IS - 2

ER -