CENTRE@CLEF2018: Overview of the replicability task

Publikation: Bidrag til tidsskriftKonferenceartikelForskningfagfællebedømt

Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

OriginalsprogEngelsk
TidsskriftCEUR Workshop Proceedings
Vol/bind2125
ISSN1613-0073
StatusUdgivet - 1 jan. 2018
Eksternt udgivetJa
Begivenhed19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018 - Avignon, Frankrig
Varighed: 10 sep. 201814 sep. 2018

Konference

Konference19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018
LandFrankrig
ByAvignon
Periode10/09/201814/09/2018

ID: 216516886