Lucene4IR: developing information retrieval evaluation resources using Lucene

Leif Azzopardi, Yashar Moshfeghi, Martin Halvey, Rami S. Alkhawaldeh, Krisztian Balog, Emanuele Di Buccio, Diego Ceccarelli, Juan M. Fernández-Luna, Charlie Hull, Jake Mannix, Sauparna Palchowdhury

Research output: Contribution to journalArticle

Abstract

The workshop and hackathon on developing Information Retrieval Evaluation Resources using Lucene (L4IR) was held on the 8th and 9th of September, 2016 at the University of Strathclyde in Glasgow, UK and funded by the ESF Elias Network. The event featured three main elements: (i) a series of keynote and invited talks on industry, teaching and evaluation; (ii) planning, coding and hacking where a number of groups created modules and infrastructure to use Lucene to undertake TREC based evaluations; and (iii) a number of breakout groups discussing challenges, opportunities and problems in bridging the divide between academia and industry, and how we can use Lucene for teaching and learning Information Retrieval (IR). The event was composed of a mix and blend of academics, experts and students wanting to learn, share and create evaluation resources for the community. The hacking was intense and the discussions lively creating the basis of many useful tools but also raising numerous issues. It was clear that by adopting and contributing to most widely used and supported Open Source IR toolkit, there were many benefits for academics, students, researchers, developers and practitioners - providing a basis for stronger evaluation practices, increased reproducibility, more efficient knowledge transfer, greater collaboration between academia and industry, and shared teaching and training resources.
LanguageEnglish
Pages58-75
Number of pages18
JournalACM SIGIR Forum
Volume50
Issue number2
Early online date4 Jan 2017
DOIs
Publication statusPublished - 14 Feb 2017

Fingerprint

information retrieval
evaluation
resources
industry
Teaching
event
knowledge transfer
coding
Group
student
expert
infrastructure
planning
learning
community

Keywords

  • information retrieval
  • Lucene
  • coding
  • tokenisation
  • Open Source IR toolkit
  • indexing
  • query expansion

Cite this

Azzopardi, L., Moshfeghi, Y., Halvey, M., Alkhawaldeh, R. S., Balog, K., Di Buccio, E., ... Palchowdhury, S. (2017). Lucene4IR: developing information retrieval evaluation resources using Lucene. ACM SIGIR Forum, 50(2), 58-75. https://doi.org/10.1145/3053408.3053421
Azzopardi, Leif ; Moshfeghi, Yashar ; Halvey, Martin ; Alkhawaldeh, Rami S. ; Balog, Krisztian ; Di Buccio, Emanuele ; Ceccarelli, Diego ; Fernández-Luna, Juan M. ; Hull, Charlie ; Mannix, Jake ; Palchowdhury, Sauparna. / Lucene4IR : developing information retrieval evaluation resources using Lucene. In: ACM SIGIR Forum. 2017 ; Vol. 50, No. 2. pp. 58-75.
@article{c70f8f528e144691b8ea5ee9ca042389,
title = "Lucene4IR: developing information retrieval evaluation resources using Lucene",
abstract = "The workshop and hackathon on developing Information Retrieval Evaluation Resources using Lucene (L4IR) was held on the 8th and 9th of September, 2016 at the University of Strathclyde in Glasgow, UK and funded by the ESF Elias Network. The event featured three main elements: (i) a series of keynote and invited talks on industry, teaching and evaluation; (ii) planning, coding and hacking where a number of groups created modules and infrastructure to use Lucene to undertake TREC based evaluations; and (iii) a number of breakout groups discussing challenges, opportunities and problems in bridging the divide between academia and industry, and how we can use Lucene for teaching and learning Information Retrieval (IR). The event was composed of a mix and blend of academics, experts and students wanting to learn, share and create evaluation resources for the community. The hacking was intense and the discussions lively creating the basis of many useful tools but also raising numerous issues. It was clear that by adopting and contributing to most widely used and supported Open Source IR toolkit, there were many benefits for academics, students, researchers, developers and practitioners - providing a basis for stronger evaluation practices, increased reproducibility, more efficient knowledge transfer, greater collaboration between academia and industry, and shared teaching and training resources.",
keywords = "information retrieval, Lucene , coding, tokenisation, Open Source IR toolkit, indexing, query expansion",
author = "Leif Azzopardi and Yashar Moshfeghi and Martin Halvey and Alkhawaldeh, {Rami S.} and Krisztian Balog and {Di Buccio}, Emanuele and Diego Ceccarelli and Fern{\'a}ndez-Luna, {Juan M.} and Charlie Hull and Jake Mannix and Sauparna Palchowdhury",
year = "2017",
month = "2",
day = "14",
doi = "10.1145/3053408.3053421",
language = "English",
volume = "50",
pages = "58--75",
journal = "ACM SIGIR Forum",
issn = "1558-0229",
number = "2",

}

Azzopardi, L, Moshfeghi, Y, Halvey, M, Alkhawaldeh, RS, Balog, K, Di Buccio, E, Ceccarelli, D, Fernández-Luna, JM, Hull, C, Mannix, J & Palchowdhury, S 2017, 'Lucene4IR: developing information retrieval evaluation resources using Lucene' ACM SIGIR Forum, vol. 50, no. 2, pp. 58-75. https://doi.org/10.1145/3053408.3053421

Lucene4IR : developing information retrieval evaluation resources using Lucene. / Azzopardi, Leif; Moshfeghi, Yashar; Halvey, Martin; Alkhawaldeh, Rami S.; Balog, Krisztian; Di Buccio, Emanuele; Ceccarelli, Diego; Fernández-Luna, Juan M.; Hull, Charlie; Mannix, Jake; Palchowdhury, Sauparna.

In: ACM SIGIR Forum, Vol. 50, No. 2, 14.02.2017, p. 58-75.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Lucene4IR

T2 - ACM SIGIR Forum

AU - Azzopardi, Leif

AU - Moshfeghi, Yashar

AU - Halvey, Martin

AU - Alkhawaldeh, Rami S.

AU - Balog, Krisztian

AU - Di Buccio, Emanuele

AU - Ceccarelli, Diego

AU - Fernández-Luna, Juan M.

AU - Hull, Charlie

AU - Mannix, Jake

AU - Palchowdhury, Sauparna

PY - 2017/2/14

Y1 - 2017/2/14

N2 - The workshop and hackathon on developing Information Retrieval Evaluation Resources using Lucene (L4IR) was held on the 8th and 9th of September, 2016 at the University of Strathclyde in Glasgow, UK and funded by the ESF Elias Network. The event featured three main elements: (i) a series of keynote and invited talks on industry, teaching and evaluation; (ii) planning, coding and hacking where a number of groups created modules and infrastructure to use Lucene to undertake TREC based evaluations; and (iii) a number of breakout groups discussing challenges, opportunities and problems in bridging the divide between academia and industry, and how we can use Lucene for teaching and learning Information Retrieval (IR). The event was composed of a mix and blend of academics, experts and students wanting to learn, share and create evaluation resources for the community. The hacking was intense and the discussions lively creating the basis of many useful tools but also raising numerous issues. It was clear that by adopting and contributing to most widely used and supported Open Source IR toolkit, there were many benefits for academics, students, researchers, developers and practitioners - providing a basis for stronger evaluation practices, increased reproducibility, more efficient knowledge transfer, greater collaboration between academia and industry, and shared teaching and training resources.

AB - The workshop and hackathon on developing Information Retrieval Evaluation Resources using Lucene (L4IR) was held on the 8th and 9th of September, 2016 at the University of Strathclyde in Glasgow, UK and funded by the ESF Elias Network. The event featured three main elements: (i) a series of keynote and invited talks on industry, teaching and evaluation; (ii) planning, coding and hacking where a number of groups created modules and infrastructure to use Lucene to undertake TREC based evaluations; and (iii) a number of breakout groups discussing challenges, opportunities and problems in bridging the divide between academia and industry, and how we can use Lucene for teaching and learning Information Retrieval (IR). The event was composed of a mix and blend of academics, experts and students wanting to learn, share and create evaluation resources for the community. The hacking was intense and the discussions lively creating the basis of many useful tools but also raising numerous issues. It was clear that by adopting and contributing to most widely used and supported Open Source IR toolkit, there were many benefits for academics, students, researchers, developers and practitioners - providing a basis for stronger evaluation practices, increased reproducibility, more efficient knowledge transfer, greater collaboration between academia and industry, and shared teaching and training resources.

KW - information retrieval

KW - Lucene

KW - coding

KW - tokenisation

KW - Open Source IR toolkit

KW - indexing

KW - query expansion

UR - http://sigir.org/forum/issues/december-2016/

U2 - 10.1145/3053408.3053421

DO - 10.1145/3053408.3053421

M3 - Article

VL - 50

SP - 58

EP - 75

JO - ACM SIGIR Forum

JF - ACM SIGIR Forum

SN - 1558-0229

IS - 2

ER -