Trust in automation is often strongly tied to an agent’s performance. However, our understanding of imperfect agents’ behaviours and its impact on trust is limited. In this paper, we study the relationship between performance, reliance and trust in a set of human-agent collaborative tasks. Participants collaborated with different automated agents that performed similarly but made errors in different ways; namely mistakes (error of prioritization), lapses (error of omission) and slips (lowered accuracy). We conducted a 4x2 within-subjects experiment (n=24) varying the agent behaviours (no error, slips, mistakes and lapses) and task difficulty (easy/hard) during a real-time collaborative game. Our results show that, at the same level of agent performance, agents’ errors are perceived differently and change the way participants interact with agents. For instance, slips and mistakes are more harmful to performance than lapses while slips are more harmful to reliance than mistakes.
|Number of pages||5|
|Publication status||Accepted/In press - 14 Jun 2020|
|Event||Human Factors and Ergonomics Society Annual Meeting - Virtual Conference, Chicago, United States|
Duration: 5 Oct 2020 → 9 Oct 2020
Conference number: 64
|Conference||Human Factors and Ergonomics Society Annual Meeting|
|Period||5/10/20 → 9/10/20|
- human factors
- human-agent collaboration
- cognitive load
Daronnat, S., Azzopardi, L., & Halvey, M. (Accepted/In press). Impact of agents' errors on performance, reliance and trust in human-agent collaboration. Paper presented at Human Factors and Ergonomics Society Annual Meeting , Chicago, United States.