Multi-Method Research: An Empirical Investigation of Object-Oriented Technology

Murray Wood, John Daly, James Miller, Marc Roper

Research output: Contribution to journalArticle

47 Citations (Scopus)

Abstract

There is a general acceptance that software engineering research should be supported by empirical evaluation. To make real progress researchers must address the difficulties caused by the human-intensive nature of software development as well as experimental validity. This paper proposes the use of multi-method empirical research programs, as an alternative to 'single-shot' empirical studies, to help address these problems. The multi-method approach is based on the combination of complementary empirical research methods. The intention is that the complementary nature of the research methods compensate for weaknesses inherent in individual methods. It is argued that the multi-method approach potentially provides benefits in terms of more robust conclusions, development and investigation of research hypotheses in an evolutionary manner, and increased understanding of research results. This paper demonstrates an application of the multi-method approach in an empirical investigation of object-oriented technology. This research program consists of a set of structured interviews with practitioners of object-oriented technology, followed by a wide-scale questionnaire survey, and concludes with a set of three controlled laboratory experiments which investigated one of the key findings from the exploratory interview and questionnaire phases. This application finds evidence that unconstrained inheritance usage in object-oriented software may inhibit software maintenance. The paper concludes that the multi-method approach offers the possibility of more reliable and generalizable results from empirical software engineering research.
LanguageEnglish
Pages13-26
Number of pages13
JournalJournal of Systems and Software
Volume48
Issue number1
Publication statusPublished - 1999

Fingerprint

Software engineering
Engineering research
Computer software maintenance
Experiments

Cite this

@article{8b12e9eab2014e489eb2e7cdb556b5a2,
title = "Multi-Method Research: An Empirical Investigation of Object-Oriented Technology",
abstract = "There is a general acceptance that software engineering research should be supported by empirical evaluation. To make real progress researchers must address the difficulties caused by the human-intensive nature of software development as well as experimental validity. This paper proposes the use of multi-method empirical research programs, as an alternative to 'single-shot' empirical studies, to help address these problems. The multi-method approach is based on the combination of complementary empirical research methods. The intention is that the complementary nature of the research methods compensate for weaknesses inherent in individual methods. It is argued that the multi-method approach potentially provides benefits in terms of more robust conclusions, development and investigation of research hypotheses in an evolutionary manner, and increased understanding of research results. This paper demonstrates an application of the multi-method approach in an empirical investigation of object-oriented technology. This research program consists of a set of structured interviews with practitioners of object-oriented technology, followed by a wide-scale questionnaire survey, and concludes with a set of three controlled laboratory experiments which investigated one of the key findings from the exploratory interview and questionnaire phases. This application finds evidence that unconstrained inheritance usage in object-oriented software may inhibit software maintenance. The paper concludes that the multi-method approach offers the possibility of more reliable and generalizable results from empirical software engineering research.",
author = "Murray Wood and John Daly and James Miller and Marc Roper",
year = "1999",
language = "English",
volume = "48",
pages = "13--26",
journal = "Journal of Systems and Software",
issn = "0164-1212",
number = "1",

}

Multi-Method Research: An Empirical Investigation of Object-Oriented Technology. / Wood, Murray; Daly, John; Miller, James; Roper, Marc.

In: Journal of Systems and Software, Vol. 48, No. 1, 1999, p. 13-26.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Multi-Method Research: An Empirical Investigation of Object-Oriented Technology

AU - Wood, Murray

AU - Daly, John

AU - Miller, James

AU - Roper, Marc

PY - 1999

Y1 - 1999

N2 - There is a general acceptance that software engineering research should be supported by empirical evaluation. To make real progress researchers must address the difficulties caused by the human-intensive nature of software development as well as experimental validity. This paper proposes the use of multi-method empirical research programs, as an alternative to 'single-shot' empirical studies, to help address these problems. The multi-method approach is based on the combination of complementary empirical research methods. The intention is that the complementary nature of the research methods compensate for weaknesses inherent in individual methods. It is argued that the multi-method approach potentially provides benefits in terms of more robust conclusions, development and investigation of research hypotheses in an evolutionary manner, and increased understanding of research results. This paper demonstrates an application of the multi-method approach in an empirical investigation of object-oriented technology. This research program consists of a set of structured interviews with practitioners of object-oriented technology, followed by a wide-scale questionnaire survey, and concludes with a set of three controlled laboratory experiments which investigated one of the key findings from the exploratory interview and questionnaire phases. This application finds evidence that unconstrained inheritance usage in object-oriented software may inhibit software maintenance. The paper concludes that the multi-method approach offers the possibility of more reliable and generalizable results from empirical software engineering research.

AB - There is a general acceptance that software engineering research should be supported by empirical evaluation. To make real progress researchers must address the difficulties caused by the human-intensive nature of software development as well as experimental validity. This paper proposes the use of multi-method empirical research programs, as an alternative to 'single-shot' empirical studies, to help address these problems. The multi-method approach is based on the combination of complementary empirical research methods. The intention is that the complementary nature of the research methods compensate for weaknesses inherent in individual methods. It is argued that the multi-method approach potentially provides benefits in terms of more robust conclusions, development and investigation of research hypotheses in an evolutionary manner, and increased understanding of research results. This paper demonstrates an application of the multi-method approach in an empirical investigation of object-oriented technology. This research program consists of a set of structured interviews with practitioners of object-oriented technology, followed by a wide-scale questionnaire survey, and concludes with a set of three controlled laboratory experiments which investigated one of the key findings from the exploratory interview and questionnaire phases. This application finds evidence that unconstrained inheritance usage in object-oriented software may inhibit software maintenance. The paper concludes that the multi-method approach offers the possibility of more reliable and generalizable results from empirical software engineering research.

UR - http://dx.doi.org/10.1016/S0164-1212(99)00042-4

M3 - Article

VL - 48

SP - 13

EP - 26

JO - Journal of Systems and Software

T2 - Journal of Systems and Software

JF - Journal of Systems and Software

SN - 0164-1212

IS - 1

ER -