Beyond traditional collaborative search: understanding the effect of awareness on multi-level collaborative information retrieval

Nyi Nyi Htun, Martin Halvey, Lynne Baillie

Research output: Contribution to journalArticle

Abstract

Although there has been a great deal of research into Collaborative Information Retrieval (CIR) and Collaborative Information Seeking (CIS), the majority has assumed that team members have the same level of unrestricted access to underlying information. However, observations from different domains (e.g. healthcare, business, etc.) have suggested that collaboration sometimes involves people with differing levels of access to underlying information. This type of scenario has been referred to as Multi-Level Collaborative Information Retrieval (MLCIR). To the best of our knowledge, no studies have been conducted to investigate the effect of awareness, an existing CIR/CIS concept, on MLCIR. To address this gap in current knowledge, we conducted two separate user studies using a total of 5 different collaborative search interfaces and 3 information access scenarios. A number of Information Retrieval (IR), CIS and CIR evaluation metrics, as well as questionnaires were used to compare the interfaces. Design interviews were also conducted after evaluations to obtain qualitative feedback from participants. Results suggested that query properties such as time spent on query, query popularity and query effectiveness could allow users to obtain information about team’s search performance and implicitly suggest better queries without disclosing sensitive data. Besides, having access to a history of intersecting viewed, relevant and bookmarked documents could provide similar positive effect as query properties. Also, it was found that being able to easily identify different team members and their actions is important for users in MLCIR. Based on our findings, we provide important design recommendations to help develop new CIR and MLCIR interfaces.
LanguageEnglish
Pages60-87
Number of pages28
JournalInformation Processing and Management
Volume54
Issue number1
Early online date30 Sep 2017
DOIs
Publication statusPublished - 30 Jan 2018

Fingerprint

Information retrieval
information retrieval
scenario
evaluation
popularity
Query
Feedback
questionnaire
history
interview

Keywords

  • collaborative search
  • information retrieval
  • information access
  • multi-level collaboration
  • non-uniform access
  • query formulation

Cite this

@article{7efe35e67c35422498297b5edbe6e837,
title = "Beyond traditional collaborative search: understanding the effect of awareness on multi-level collaborative information retrieval",
abstract = "Although there has been a great deal of research into Collaborative Information Retrieval (CIR) and Collaborative Information Seeking (CIS), the majority has assumed that team members have the same level of unrestricted access to underlying information. However, observations from different domains (e.g. healthcare, business, etc.) have suggested that collaboration sometimes involves people with differing levels of access to underlying information. This type of scenario has been referred to as Multi-Level Collaborative Information Retrieval (MLCIR). To the best of our knowledge, no studies have been conducted to investigate the effect of awareness, an existing CIR/CIS concept, on MLCIR. To address this gap in current knowledge, we conducted two separate user studies using a total of 5 different collaborative search interfaces and 3 information access scenarios. A number of Information Retrieval (IR), CIS and CIR evaluation metrics, as well as questionnaires were used to compare the interfaces. Design interviews were also conducted after evaluations to obtain qualitative feedback from participants. Results suggested that query properties such as time spent on query, query popularity and query effectiveness could allow users to obtain information about team’s search performance and implicitly suggest better queries without disclosing sensitive data. Besides, having access to a history of intersecting viewed, relevant and bookmarked documents could provide similar positive effect as query properties. Also, it was found that being able to easily identify different team members and their actions is important for users in MLCIR. Based on our findings, we provide important design recommendations to help develop new CIR and MLCIR interfaces.",
keywords = "collaborative search, information retrieval, information access, multi-level collaboration, non-uniform access, query formulation",
author = "Htun, {Nyi Nyi} and Martin Halvey and Lynne Baillie",
year = "2018",
month = "1",
day = "30",
doi = "10.1016/j.ipm.2017.09.003",
language = "English",
volume = "54",
pages = "60--87",
journal = "Information Processing and Management",
issn = "0306-4573",
number = "1",

}

Beyond traditional collaborative search : understanding the effect of awareness on multi-level collaborative information retrieval. / Htun, Nyi Nyi; Halvey, Martin; Baillie, Lynne.

In: Information Processing and Management, Vol. 54, No. 1, 30.01.2018, p. 60-87.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Beyond traditional collaborative search

T2 - Information Processing and Management

AU - Htun, Nyi Nyi

AU - Halvey, Martin

AU - Baillie, Lynne

PY - 2018/1/30

Y1 - 2018/1/30

N2 - Although there has been a great deal of research into Collaborative Information Retrieval (CIR) and Collaborative Information Seeking (CIS), the majority has assumed that team members have the same level of unrestricted access to underlying information. However, observations from different domains (e.g. healthcare, business, etc.) have suggested that collaboration sometimes involves people with differing levels of access to underlying information. This type of scenario has been referred to as Multi-Level Collaborative Information Retrieval (MLCIR). To the best of our knowledge, no studies have been conducted to investigate the effect of awareness, an existing CIR/CIS concept, on MLCIR. To address this gap in current knowledge, we conducted two separate user studies using a total of 5 different collaborative search interfaces and 3 information access scenarios. A number of Information Retrieval (IR), CIS and CIR evaluation metrics, as well as questionnaires were used to compare the interfaces. Design interviews were also conducted after evaluations to obtain qualitative feedback from participants. Results suggested that query properties such as time spent on query, query popularity and query effectiveness could allow users to obtain information about team’s search performance and implicitly suggest better queries without disclosing sensitive data. Besides, having access to a history of intersecting viewed, relevant and bookmarked documents could provide similar positive effect as query properties. Also, it was found that being able to easily identify different team members and their actions is important for users in MLCIR. Based on our findings, we provide important design recommendations to help develop new CIR and MLCIR interfaces.

AB - Although there has been a great deal of research into Collaborative Information Retrieval (CIR) and Collaborative Information Seeking (CIS), the majority has assumed that team members have the same level of unrestricted access to underlying information. However, observations from different domains (e.g. healthcare, business, etc.) have suggested that collaboration sometimes involves people with differing levels of access to underlying information. This type of scenario has been referred to as Multi-Level Collaborative Information Retrieval (MLCIR). To the best of our knowledge, no studies have been conducted to investigate the effect of awareness, an existing CIR/CIS concept, on MLCIR. To address this gap in current knowledge, we conducted two separate user studies using a total of 5 different collaborative search interfaces and 3 information access scenarios. A number of Information Retrieval (IR), CIS and CIR evaluation metrics, as well as questionnaires were used to compare the interfaces. Design interviews were also conducted after evaluations to obtain qualitative feedback from participants. Results suggested that query properties such as time spent on query, query popularity and query effectiveness could allow users to obtain information about team’s search performance and implicitly suggest better queries without disclosing sensitive data. Besides, having access to a history of intersecting viewed, relevant and bookmarked documents could provide similar positive effect as query properties. Also, it was found that being able to easily identify different team members and their actions is important for users in MLCIR. Based on our findings, we provide important design recommendations to help develop new CIR and MLCIR interfaces.

KW - collaborative search

KW - information retrieval

KW - information access

KW - multi-level collaboration

KW - non-uniform access

KW - query formulation

UR - http://www.sciencedirect.com/science/journal/03064573

U2 - 10.1016/j.ipm.2017.09.003

DO - 10.1016/j.ipm.2017.09.003

M3 - Article

VL - 54

SP - 60

EP - 87

JO - Information Processing and Management

JF - Information Processing and Management

SN - 0306-4573

IS - 1

ER -