Interaction effects on common measures of sensitivity: choice of measure, type I error, and power

Stephen Rhodes, Nelson Cowan, Mario A. Parra, Robert H. Logie

Research output: Contribution to journalArticlepeer-review

9 Citations (Scopus)
4 Downloads (Pure)

Abstract

Here we use simulation to assess previously unaddressed problems in the assessment of statistical interactions in detection and recognition tasks. The proportion of hits and false-alarms made by an observer on such tasks is affected by both their sensitivity and bias, and numerous measures have been developed to separate out these two factors. Each of these measures makes different assumptions regarding the underlying process and different predictions as to how false-alarm and hit rates should covary. Previous simulations have shown that choice of an inappropriate measure can lead to inflated type I error rates, or reduced power, for main effects, provided there are differences in response bias between the conditions being compared. Interaction effects pose a particular problem in this context. We show that spurious interaction effects in analysis of variance can be produced, or true interactions missed, even in the absence of variation in bias. Additional simulations show that variation in bias complicates patterns of type I error and power further. This under-appreciated fact has the potential to greatly distort the assessment of interactions in detection and recognition experiments. We discuss steps researchers can take to mitigate their chances of making an error.
Original languageEnglish
Number of pages19
JournalBehavior Research Methods
Early online date18 Jul 2018
DOIs
Publication statusE-pub ahead of print - 18 Jul 2018

Keywords

  • recognition
  • detection
  • interactions
  • type I error
  • type II error
  • power
  • sensitivity
  • bias

Fingerprint

Dive into the research topics of 'Interaction effects on common measures of sensitivity: choice of measure, type I error, and power'. Together they form a unique fingerprint.

Cite this