CLEF 2014: information access evaluation meets multilinguality, multimodality, and interaction

Linda Cappellato, Paul Clough, Nicola Ferro, Mark Hall, Martin Halvey, Allan Hanbury, Evangelos Kanoulas, Wessel Kraaij, Mihai Lupu, Mark Sanderson, Elaine Toms, Robert Villa

Research output: Contribution to journalArticle

Abstract

The 2014 Conference and Labs of the Evaluation Forum (CLEF) event was held at the University of Sheffield, UK, on September 15–18, 2014. The conference was entitled “Information Access Evaluation meets Multilinguality, Multimodality and Interaction” and addressed issues around multilingual and multimodal information access, information interaction, as well as the evaluation of search systems. CLEF celebrated its 15th anniversary this year having been conceived in 2000 as the Cross-Language Evaluation Forum aimed at stimulating research and innovation in multimodal and multilingual information access and retrieval. Over the years, it has actively nurtured and engaged a vibrant, multidisciplinary research community in the study, design, and implementation of evaluation methods for multiple tasks using diverse data sets and in many languages. In the first 10 years, CLEF conducted a series of experimental labs that were reported annually at workshops held in conjunction with the European Conference on Digital Libraries (ECDL). In 2010, now a mature and well-respected evaluation forum, it expanded to include a complementary peer-reviewed conference for reporting the evaluation of information access and retrieval systems regardless of data type, format, language, etc. Since then CLEF has continued that format with keynotes, contributed papers, lab sessions, and poster sessions, including reports from other benchmarking initiatives from around the world. The CLEF 2014 conference had more than 150 participants from different academic institutions and industrial organisations. Though the majority (114) of participants come from Europe, there was also considerable interest in CLEF worldwide, with 20 participants from the Americas, 16 from Asia, 1 from Australia, and 2 from the Middle East.
LanguageEnglish
Pages56-62
Number of pages7
JournalACM SIGIR Forum
Volume48
Issue number2
DOIs
Publication statusPublished - Dec 2014

Fingerprint

Digital libraries
Benchmarking
Innovation

Keywords

  • multilinguality
  • multimodal information access
  • information interaction
  • information access

Cite this

Cappellato, Linda ; Clough, Paul ; Ferro, Nicola ; Hall, Mark ; Halvey, Martin ; Hanbury, Allan ; Kanoulas, Evangelos ; Kraaij, Wessel ; Lupu, Mihai ; Sanderson, Mark ; Toms, Elaine ; Villa, Robert. / CLEF 2014 : information access evaluation meets multilinguality, multimodality, and interaction. In: ACM SIGIR Forum. 2014 ; Vol. 48, No. 2. pp. 56-62.
@article{cf89749d46ec407b8dcfcdef131f3852,
title = "CLEF 2014: information access evaluation meets multilinguality, multimodality, and interaction",
abstract = "The 2014 Conference and Labs of the Evaluation Forum (CLEF) event was held at the University of Sheffield, UK, on September 15–18, 2014. The conference was entitled “Information Access Evaluation meets Multilinguality, Multimodality and Interaction” and addressed issues around multilingual and multimodal information access, information interaction, as well as the evaluation of search systems. CLEF celebrated its 15th anniversary this year having been conceived in 2000 as the Cross-Language Evaluation Forum aimed at stimulating research and innovation in multimodal and multilingual information access and retrieval. Over the years, it has actively nurtured and engaged a vibrant, multidisciplinary research community in the study, design, and implementation of evaluation methods for multiple tasks using diverse data sets and in many languages. In the first 10 years, CLEF conducted a series of experimental labs that were reported annually at workshops held in conjunction with the European Conference on Digital Libraries (ECDL). In 2010, now a mature and well-respected evaluation forum, it expanded to include a complementary peer-reviewed conference for reporting the evaluation of information access and retrieval systems regardless of data type, format, language, etc. Since then CLEF has continued that format with keynotes, contributed papers, lab sessions, and poster sessions, including reports from other benchmarking initiatives from around the world. The CLEF 2014 conference had more than 150 participants from different academic institutions and industrial organisations. Though the majority (114) of participants come from Europe, there was also considerable interest in CLEF worldwide, with 20 participants from the Americas, 16 from Asia, 1 from Australia, and 2 from the Middle East.",
keywords = "multilinguality, multimodal information access, information interaction, information access",
author = "Linda Cappellato and Paul Clough and Nicola Ferro and Mark Hall and Martin Halvey and Allan Hanbury and Evangelos Kanoulas and Wessel Kraaij and Mihai Lupu and Mark Sanderson and Elaine Toms and Robert Villa",
note = "{\circledC} ACM, 2014. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in ACM SIGIR Forum, {48, 2, (2014)} http://doi.acm.org/10.1145/2701583.2701589",
year = "2014",
month = "12",
doi = "10.1145/2701583.2701589",
language = "English",
volume = "48",
pages = "56--62",
journal = "ACM SIGIR Forum",
issn = "1558-0229",
number = "2",

}

Cappellato, L, Clough, P, Ferro, N, Hall, M, Halvey, M, Hanbury, A, Kanoulas, E, Kraaij, W, Lupu, M, Sanderson, M, Toms, E & Villa, R 2014, 'CLEF 2014: information access evaluation meets multilinguality, multimodality, and interaction' ACM SIGIR Forum, vol. 48, no. 2, pp. 56-62. https://doi.org/10.1145/2701583.2701589

CLEF 2014 : information access evaluation meets multilinguality, multimodality, and interaction. / Cappellato, Linda; Clough, Paul; Ferro, Nicola; Hall, Mark; Halvey, Martin; Hanbury, Allan; Kanoulas, Evangelos; Kraaij, Wessel; Lupu, Mihai; Sanderson, Mark; Toms, Elaine; Villa, Robert.

In: ACM SIGIR Forum, Vol. 48, No. 2, 12.2014, p. 56-62.

Research output: Contribution to journalArticle

TY - JOUR

T1 - CLEF 2014

T2 - ACM SIGIR Forum

AU - Cappellato, Linda

AU - Clough, Paul

AU - Ferro, Nicola

AU - Hall, Mark

AU - Halvey, Martin

AU - Hanbury, Allan

AU - Kanoulas, Evangelos

AU - Kraaij, Wessel

AU - Lupu, Mihai

AU - Sanderson, Mark

AU - Toms, Elaine

AU - Villa, Robert

N1 - © ACM, 2014. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in ACM SIGIR Forum, {48, 2, (2014)} http://doi.acm.org/10.1145/2701583.2701589

PY - 2014/12

Y1 - 2014/12

N2 - The 2014 Conference and Labs of the Evaluation Forum (CLEF) event was held at the University of Sheffield, UK, on September 15–18, 2014. The conference was entitled “Information Access Evaluation meets Multilinguality, Multimodality and Interaction” and addressed issues around multilingual and multimodal information access, information interaction, as well as the evaluation of search systems. CLEF celebrated its 15th anniversary this year having been conceived in 2000 as the Cross-Language Evaluation Forum aimed at stimulating research and innovation in multimodal and multilingual information access and retrieval. Over the years, it has actively nurtured and engaged a vibrant, multidisciplinary research community in the study, design, and implementation of evaluation methods for multiple tasks using diverse data sets and in many languages. In the first 10 years, CLEF conducted a series of experimental labs that were reported annually at workshops held in conjunction with the European Conference on Digital Libraries (ECDL). In 2010, now a mature and well-respected evaluation forum, it expanded to include a complementary peer-reviewed conference for reporting the evaluation of information access and retrieval systems regardless of data type, format, language, etc. Since then CLEF has continued that format with keynotes, contributed papers, lab sessions, and poster sessions, including reports from other benchmarking initiatives from around the world. The CLEF 2014 conference had more than 150 participants from different academic institutions and industrial organisations. Though the majority (114) of participants come from Europe, there was also considerable interest in CLEF worldwide, with 20 participants from the Americas, 16 from Asia, 1 from Australia, and 2 from the Middle East.

AB - The 2014 Conference and Labs of the Evaluation Forum (CLEF) event was held at the University of Sheffield, UK, on September 15–18, 2014. The conference was entitled “Information Access Evaluation meets Multilinguality, Multimodality and Interaction” and addressed issues around multilingual and multimodal information access, information interaction, as well as the evaluation of search systems. CLEF celebrated its 15th anniversary this year having been conceived in 2000 as the Cross-Language Evaluation Forum aimed at stimulating research and innovation in multimodal and multilingual information access and retrieval. Over the years, it has actively nurtured and engaged a vibrant, multidisciplinary research community in the study, design, and implementation of evaluation methods for multiple tasks using diverse data sets and in many languages. In the first 10 years, CLEF conducted a series of experimental labs that were reported annually at workshops held in conjunction with the European Conference on Digital Libraries (ECDL). In 2010, now a mature and well-respected evaluation forum, it expanded to include a complementary peer-reviewed conference for reporting the evaluation of information access and retrieval systems regardless of data type, format, language, etc. Since then CLEF has continued that format with keynotes, contributed papers, lab sessions, and poster sessions, including reports from other benchmarking initiatives from around the world. The CLEF 2014 conference had more than 150 participants from different academic institutions and industrial organisations. Though the majority (114) of participants come from Europe, there was also considerable interest in CLEF worldwide, with 20 participants from the Americas, 16 from Asia, 1 from Australia, and 2 from the Middle East.

KW - multilinguality

KW - multimodal information access

KW - information interaction

KW - information access

UR - http://dl.acm.org/citation.cfm?doid=2701583.2701589

U2 - 10.1145/2701583.2701589

DO - 10.1145/2701583.2701589

M3 - Article

VL - 48

SP - 56

EP - 62

JO - ACM SIGIR Forum

JF - ACM SIGIR Forum

SN - 1558-0229

IS - 2

ER -