Psychometrics of the personal questionnaire: a client-generated outcome measure

Robert Elliott, John Wagner, Celia M. D. Sales, Brian Rodgers, Paula Alves, Maria J. Cafe

Research output: Contribution to journalArticle

24 Citations (Scopus)

Abstract

We present a range of evidence for the reliability and validity of data generated by the Personal Questionnaire (PQ), a client-generated individualized outcome measure, using five data sets from three countries. Overall pre-therapy mean internal consistency (alpha) across clients was .80; within-client alphas averaged .77; clients typically had one or two items that did not vary with the other items. Analyses of temporal structure indicated high levels of between client variance (58%), moderate pre-therapy test-retest correlations (r =.57), and high session-to-session lag-1 autocorrelations (.82). Scores on the PQ provided clear evidence of convergence with a range of outcome measures (within-client r = .41). Mean pre-post effects were large (d = 1.25). The results support a revised caseness cut-off of 3.25 and a reliable change interval of 1.67. We conclude that PQ data meet criteria for evidence-based, norm-referenced measurement of client psychological distress for supporting psychotherapy practice and research.
LanguageEnglish
Pages263-278
Number of pages16
JournalPsychological Assessment
Volume28
Issue number3
Early online date15 Jun 2015
DOIs
Publication statusPublished - 1 Mar 2016

Fingerprint

Psychometrics
Outcome Assessment (Health Care)
Reproducibility of Results
Psychotherapy
Psychology
Therapeutics
Research
Surveys and Questionnaires

Keywords

  • outcome
  • measurement
  • individualized
  • psychometrics
  • psychotherapy

Cite this

Elliott, Robert ; Wagner, John ; Sales, Celia M. D. ; Rodgers, Brian ; Alves, Paula ; Cafe, Maria J. / Psychometrics of the personal questionnaire : a client-generated outcome measure. In: Psychological Assessment. 2016 ; Vol. 28, No. 3. pp. 263-278.
@article{672aafd191864c548b8322e489298ad6,
title = "Psychometrics of the personal questionnaire: a client-generated outcome measure",
abstract = "We present a range of evidence for the reliability and validity of data generated by the Personal Questionnaire (PQ), a client-generated individualized outcome measure, using five data sets from three countries. Overall pre-therapy mean internal consistency (alpha) across clients was .80; within-client alphas averaged .77; clients typically had one or two items that did not vary with the other items. Analyses of temporal structure indicated high levels of between client variance (58{\%}), moderate pre-therapy test-retest correlations (r =.57), and high session-to-session lag-1 autocorrelations (.82). Scores on the PQ provided clear evidence of convergence with a range of outcome measures (within-client r = .41). Mean pre-post effects were large (d = 1.25). The results support a revised caseness cut-off of 3.25 and a reliable change interval of 1.67. We conclude that PQ data meet criteria for evidence-based, norm-referenced measurement of client psychological distress for supporting psychotherapy practice and research.",
keywords = "outcome, measurement, individualized, psychometrics, psychotherapy",
author = "Robert Elliott and John Wagner and Sales, {Celia M. D.} and Brian Rodgers and Paula Alves and Cafe, {Maria J.}",
note = "This research was supported in part by funding from the University of Strathclyde and the Portuguese Foundation for Science and Technology (FCT grants PTDC/PSI-PCL/098952/2008 to Celia Sales and SFRH/BD/87308/2012 to Paula Alves). We thank Micaela Jim{\'e}nez and Carlos Jim{\'e}nez for statistical assistance.",
year = "2016",
month = "3",
day = "1",
doi = "10.1037/pas0000174",
language = "English",
volume = "28",
pages = "263--278",
journal = "Psychological Assessment",
issn = "1040-3590",
number = "3",

}

Psychometrics of the personal questionnaire : a client-generated outcome measure. / Elliott, Robert; Wagner, John; Sales, Celia M. D.; Rodgers, Brian; Alves, Paula; Cafe, Maria J.

In: Psychological Assessment, Vol. 28, No. 3, 01.03.2016, p. 263-278.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Psychometrics of the personal questionnaire

T2 - Psychological Assessment

AU - Elliott, Robert

AU - Wagner, John

AU - Sales, Celia M. D.

AU - Rodgers, Brian

AU - Alves, Paula

AU - Cafe, Maria J.

N1 - This research was supported in part by funding from the University of Strathclyde and the Portuguese Foundation for Science and Technology (FCT grants PTDC/PSI-PCL/098952/2008 to Celia Sales and SFRH/BD/87308/2012 to Paula Alves). We thank Micaela Jiménez and Carlos Jiménez for statistical assistance.

PY - 2016/3/1

Y1 - 2016/3/1

N2 - We present a range of evidence for the reliability and validity of data generated by the Personal Questionnaire (PQ), a client-generated individualized outcome measure, using five data sets from three countries. Overall pre-therapy mean internal consistency (alpha) across clients was .80; within-client alphas averaged .77; clients typically had one or two items that did not vary with the other items. Analyses of temporal structure indicated high levels of between client variance (58%), moderate pre-therapy test-retest correlations (r =.57), and high session-to-session lag-1 autocorrelations (.82). Scores on the PQ provided clear evidence of convergence with a range of outcome measures (within-client r = .41). Mean pre-post effects were large (d = 1.25). The results support a revised caseness cut-off of 3.25 and a reliable change interval of 1.67. We conclude that PQ data meet criteria for evidence-based, norm-referenced measurement of client psychological distress for supporting psychotherapy practice and research.

AB - We present a range of evidence for the reliability and validity of data generated by the Personal Questionnaire (PQ), a client-generated individualized outcome measure, using five data sets from three countries. Overall pre-therapy mean internal consistency (alpha) across clients was .80; within-client alphas averaged .77; clients typically had one or two items that did not vary with the other items. Analyses of temporal structure indicated high levels of between client variance (58%), moderate pre-therapy test-retest correlations (r =.57), and high session-to-session lag-1 autocorrelations (.82). Scores on the PQ provided clear evidence of convergence with a range of outcome measures (within-client r = .41). Mean pre-post effects were large (d = 1.25). The results support a revised caseness cut-off of 3.25 and a reliable change interval of 1.67. We conclude that PQ data meet criteria for evidence-based, norm-referenced measurement of client psychological distress for supporting psychotherapy practice and research.

KW - outcome

KW - measurement

KW - individualized

KW - psychometrics

KW - psychotherapy

U2 - 10.1037/pas0000174

DO - 10.1037/pas0000174

M3 - Article

VL - 28

SP - 263

EP - 278

JO - Psychological Assessment

JF - Psychological Assessment

SN - 1040-3590

IS - 3

ER -