Contextual information and assessor characteristics in complex question answering

C. Azzopardi, L. Azzopardi, M. Baillie, R. Bierig, E. Nicol, I. Ruthven, S. Sweeney, E.M. Voorhees (Editor), L.P. Buckland (Editor)

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

The ciqa track investigates the role of interaction in answering complex questions: questions that relate two or more entities by some specified relationship. In our submission to the first ciqa track we were interested in the interplay between groups of variables: variables describing the question creators, the questions asked and the presentation of answers to the questions. We used two interaction forms - html questionnaires completed before answer assessment - to gain contextual information from the answer assessors to better understand what factors influence assessors when judging retrieved answers to complex questions. Our results indicate the importance of understanding the assessor's personal relationship to the question - their existing topical knowledge for example - and also the presentation of the answers - contextual information about the answer to aid in the assessment of the answer.
LanguageEnglish
Title of host publicationThe Fifteenth Text REtrieval Conference (TREC 2006) Proceedings
Number of pages10
Publication statusPublished - 2006

Fingerprint

interaction
questionnaire

Keywords

  • complex questions
  • searching
  • user interface
  • information retrieval

Cite this

Azzopardi, C., Azzopardi, L., Baillie, M., Bierig, R., Nicol, E., Ruthven, I., ... Buckland, L. P. (Ed.) (2006). Contextual information and assessor characteristics in complex question answering. In The Fifteenth Text REtrieval Conference (TREC 2006) Proceedings
Azzopardi, C. ; Azzopardi, L. ; Baillie, M. ; Bierig, R. ; Nicol, E. ; Ruthven, I. ; Sweeney, S. ; Voorhees, E.M. (Editor) ; Buckland, L.P. (Editor). / Contextual information and assessor characteristics in complex question answering. The Fifteenth Text REtrieval Conference (TREC 2006) Proceedings. 2006.
@inbook{0d10a6f322664c09a26036a9ee3289fa,
title = "Contextual information and assessor characteristics in complex question answering",
abstract = "The ciqa track investigates the role of interaction in answering complex questions: questions that relate two or more entities by some specified relationship. In our submission to the first ciqa track we were interested in the interplay between groups of variables: variables describing the question creators, the questions asked and the presentation of answers to the questions. We used two interaction forms - html questionnaires completed before answer assessment - to gain contextual information from the answer assessors to better understand what factors influence assessors when judging retrieved answers to complex questions. Our results indicate the importance of understanding the assessor's personal relationship to the question - their existing topical knowledge for example - and also the presentation of the answers - contextual information about the answer to aid in the assessment of the answer.",
keywords = "complex questions, searching, user interface, information retrieval",
author = "C. Azzopardi and L. Azzopardi and M. Baillie and R. Bierig and E. Nicol and I. Ruthven and S. Sweeney and E.M. Voorhees and L.P. Buckland",
year = "2006",
language = "English",
booktitle = "The Fifteenth Text REtrieval Conference (TREC 2006) Proceedings",

}

Azzopardi, C, Azzopardi, L, Baillie, M, Bierig, R, Nicol, E, Ruthven, I, Sweeney, S, Voorhees, EM (ed.) & Buckland, LP (ed.) 2006, Contextual information and assessor characteristics in complex question answering. in The Fifteenth Text REtrieval Conference (TREC 2006) Proceedings.

Contextual information and assessor characteristics in complex question answering. / Azzopardi, C.; Azzopardi, L.; Baillie, M.; Bierig, R.; Nicol, E.; Ruthven, I.; Sweeney, S.; Voorhees, E.M. (Editor); Buckland, L.P. (Editor).

The Fifteenth Text REtrieval Conference (TREC 2006) Proceedings. 2006.

Research output: Chapter in Book/Report/Conference proceedingChapter

TY - CHAP

T1 - Contextual information and assessor characteristics in complex question answering

AU - Azzopardi, C.

AU - Azzopardi, L.

AU - Baillie, M.

AU - Bierig, R.

AU - Nicol, E.

AU - Ruthven, I.

AU - Sweeney, S.

A2 - Voorhees, E.M.

A2 - Buckland, L.P.

PY - 2006

Y1 - 2006

N2 - The ciqa track investigates the role of interaction in answering complex questions: questions that relate two or more entities by some specified relationship. In our submission to the first ciqa track we were interested in the interplay between groups of variables: variables describing the question creators, the questions asked and the presentation of answers to the questions. We used two interaction forms - html questionnaires completed before answer assessment - to gain contextual information from the answer assessors to better understand what factors influence assessors when judging retrieved answers to complex questions. Our results indicate the importance of understanding the assessor's personal relationship to the question - their existing topical knowledge for example - and also the presentation of the answers - contextual information about the answer to aid in the assessment of the answer.

AB - The ciqa track investigates the role of interaction in answering complex questions: questions that relate two or more entities by some specified relationship. In our submission to the first ciqa track we were interested in the interplay between groups of variables: variables describing the question creators, the questions asked and the presentation of answers to the questions. We used two interaction forms - html questionnaires completed before answer assessment - to gain contextual information from the answer assessors to better understand what factors influence assessors when judging retrieved answers to complex questions. Our results indicate the importance of understanding the assessor's personal relationship to the question - their existing topical knowledge for example - and also the presentation of the answers - contextual information about the answer to aid in the assessment of the answer.

KW - complex questions

KW - searching

KW - user interface

KW - information retrieval

UR - http://trec.nist.gov/pubs/trec15/papers/ustrathclyde.qa.final.pdf

M3 - Chapter

BT - The Fifteenth Text REtrieval Conference (TREC 2006) Proceedings

ER -

Azzopardi C, Azzopardi L, Baillie M, Bierig R, Nicol E, Ruthven I et al. Contextual information and assessor characteristics in complex question answering. In The Fifteenth Text REtrieval Conference (TREC 2006) Proceedings. 2006