Lucene4IR: developing information retrieval evaluation resources using Lucene

Leif Azzopardi, Yashar Moshfeghi, Martin Halvey, Rami S. Alkhawaldeh, Krisztian Balog, Emanuele Di Buccio, Diego Ceccarelli, Juan M. Fernández-Luna, Charlie Hull, Jake Mannix, Sauparna Palchowdhury

Research output: Contribution to journalArticle

159 Downloads (Pure)

Abstract

The workshop and hackathon on developing Information Retrieval Evaluation Resources using Lucene (L4IR) was held on the 8th and 9th of September, 2016 at the University of Strathclyde in Glasgow, UK and funded by the ESF Elias Network. The event featured three main elements: (i) a series of keynote and invited talks on industry, teaching and evaluation; (ii) planning, coding and hacking where a number of groups created modules and infrastructure to use Lucene to undertake TREC based evaluations; and (iii) a number of breakout groups discussing challenges, opportunities and problems in bridging the divide between academia and industry, and how we can use Lucene for teaching and learning Information Retrieval (IR). The event was composed of a mix and blend of academics, experts and students wanting to learn, share and create evaluation resources for the community. The hacking was intense and the discussions lively creating the basis of many useful tools but also raising numerous issues. It was clear that by adopting and contributing to most widely used and supported Open Source IR toolkit, there were many benefits for academics, students, researchers, developers and practitioners - providing a basis for stronger evaluation practices, increased reproducibility, more efficient knowledge transfer, greater collaboration between academia and industry, and shared teaching and training resources.
Original languageEnglish
Pages (from-to)58-75
Number of pages18
JournalACM SIGIR Forum
Volume50
Issue number2
Early online date4 Jan 2017
DOIs
Publication statusPublished - 14 Feb 2017

    Fingerprint

Keywords

  • information retrieval
  • Lucene
  • coding
  • tokenisation
  • Open Source IR toolkit
  • indexing
  • query expansion

Cite this

Azzopardi, L., Moshfeghi, Y., Halvey, M., Alkhawaldeh, R. S., Balog, K., Di Buccio, E., ... Palchowdhury, S. (2017). Lucene4IR: developing information retrieval evaluation resources using Lucene. ACM SIGIR Forum, 50(2), 58-75. https://doi.org/10.1145/3053408.3053421