Lucene4IR: developing information retrieval evaluation resources using Lucene

Leif Azzopardi, Yashar Moshfeghi, Martin Halvey, Rami S. Alkhawaldeh, Krisztian Balog, Emanuele Di Buccio, Diego Ceccarelli, Juan M. Fernández-Luna, Charlie Hull, Jake Mannix, Sauparna Palchowdhury

Research output: Contribution to journalArticlepeer-review

234 Downloads (Pure)


The workshop and hackathon on developing Information Retrieval Evaluation Resources using Lucene (L4IR) was held on the 8th and 9th of September, 2016 at the University of Strathclyde in Glasgow, UK and funded by the ESF Elias Network. The event featured three main elements: (i) a series of keynote and invited talks on industry, teaching and evaluation; (ii) planning, coding and hacking where a number of groups created modules and infrastructure to use Lucene to undertake TREC based evaluations; and (iii) a number of breakout groups discussing challenges, opportunities and problems in bridging the divide between academia and industry, and how we can use Lucene for teaching and learning Information Retrieval (IR). The event was composed of a mix and blend of academics, experts and students wanting to learn, share and create evaluation resources for the community. The hacking was intense and the discussions lively creating the basis of many useful tools but also raising numerous issues. It was clear that by adopting and contributing to most widely used and supported Open Source IR toolkit, there were many benefits for academics, students, researchers, developers and practitioners - providing a basis for stronger evaluation practices, increased reproducibility, more efficient knowledge transfer, greater collaboration between academia and industry, and shared teaching and training resources.
Original languageEnglish
Pages (from-to)58-75
Number of pages18
JournalACM SIGIR Forum
Issue number2
Early online date4 Jan 2017
Publication statusPublished - 14 Feb 2017


  • information retrieval
  • Lucene
  • coding
  • tokenisation
  • Open Source IR toolkit
  • indexing
  • query expansion


Dive into the research topics of 'Lucene4IR: developing information retrieval evaluation resources using Lucene'. Together they form a unique fingerprint.

Cite this