Towards a benchmark for the evaluation of software testing techniques

J. Miller, M. Roper, A. Brooks, M. Wood

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Despite the existence of a great number of software testing techniques we are largely ignorant of their respective powers as software engineering methods. It is argued that more experimental work in software testing is necessary in order to place testing techniques onto a scale of measurement, or classify them in such a way that is useful to the software engineer. Current experimental practices are examined using a parametric framework and are shown to contribute little towards a cohesive and useful body of knowledge. The idea of a benchmark repository of faulty and correct software is explored enabling unification of diverse experimental results. Such a unification should start the process of moving towards an evaluation taxonomy of testing methods.
LanguageEnglish
Pages5-13
Number of pages8
JournalInformation and Software Technology
Volume37
Issue number1
DOIs
Publication statusPublished - 1995

Fingerprint

Software testing
Testing
Taxonomies
Software engineering
Engineers

Keywords

  • testing
  • software quality
  • experimentation
  • benchmark repository
  • software testing

Cite this

@article{73d164d119294221b04738347beddf64,
title = "Towards a benchmark for the evaluation of software testing techniques",
abstract = "Despite the existence of a great number of software testing techniques we are largely ignorant of their respective powers as software engineering methods. It is argued that more experimental work in software testing is necessary in order to place testing techniques onto a scale of measurement, or classify them in such a way that is useful to the software engineer. Current experimental practices are examined using a parametric framework and are shown to contribute little towards a cohesive and useful body of knowledge. The idea of a benchmark repository of faulty and correct software is explored enabling unification of diverse experimental results. Such a unification should start the process of moving towards an evaluation taxonomy of testing methods.",
keywords = "testing, software quality, experimentation, benchmark repository, software testing",
author = "J. Miller and M. Roper and A. Brooks and M. Wood",
year = "1995",
doi = "10.1016/0950-5849(94)00456-3",
language = "English",
volume = "37",
pages = "5--13",
journal = "Information and Software Technology",
issn = "0950-5849",
number = "1",

}

Towards a benchmark for the evaluation of software testing techniques. / Miller, J.; Roper, M.; Brooks, A.; Wood, M.

In: Information and Software Technology, Vol. 37, No. 1, 1995, p. 5-13.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Towards a benchmark for the evaluation of software testing techniques

AU - Miller, J.

AU - Roper, M.

AU - Brooks, A.

AU - Wood, M.

PY - 1995

Y1 - 1995

N2 - Despite the existence of a great number of software testing techniques we are largely ignorant of their respective powers as software engineering methods. It is argued that more experimental work in software testing is necessary in order to place testing techniques onto a scale of measurement, or classify them in such a way that is useful to the software engineer. Current experimental practices are examined using a parametric framework and are shown to contribute little towards a cohesive and useful body of knowledge. The idea of a benchmark repository of faulty and correct software is explored enabling unification of diverse experimental results. Such a unification should start the process of moving towards an evaluation taxonomy of testing methods.

AB - Despite the existence of a great number of software testing techniques we are largely ignorant of their respective powers as software engineering methods. It is argued that more experimental work in software testing is necessary in order to place testing techniques onto a scale of measurement, or classify them in such a way that is useful to the software engineer. Current experimental practices are examined using a parametric framework and are shown to contribute little towards a cohesive and useful body of knowledge. The idea of a benchmark repository of faulty and correct software is explored enabling unification of diverse experimental results. Such a unification should start the process of moving towards an evaluation taxonomy of testing methods.

KW - testing

KW - software quality

KW - experimentation

KW - benchmark repository

KW - software testing

UR - http://dx.doi.org/10.1016/0950-5849(94)00456-3

U2 - 10.1016/0950-5849(94)00456-3

DO - 10.1016/0950-5849(94)00456-3

M3 - Article

VL - 37

SP - 5

EP - 13

JO - Information and Software Technology

T2 - Information and Software Technology

JF - Information and Software Technology

SN - 0950-5849

IS - 1

ER -