Overview of INEX 2014

Bellot, Patrice, Bogers, Toine, Geva, Shlomo, Hall, Mark, Huurdeman, Hugo, Kamps, Jaap, Kazai, Gabriella, Koolen, Marijn, Moriceau, Véronique, Mothe, Josiane, Preminger, Michael, SanJuan, Eric, Schenkel, Ralf, Skov, Mette, Tannier, Xavier and Walsh, David (2014) Overview of INEX 2014. In: UNSPECIFIED (ed). Information Access Evaluation. Multilinguality, Multimodality, and Interaction. Lecture Notes in Computer Science, 8685. Springer International Publishing, pp. 212-228. ISBN 9783319113814

[img]
Preview
PDF
inex_overview.pdf

Download (2MB)

Abstract

INEX investigates focused retrieval from structured docu- ments by providing large test collections of structured documents, uni- form evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2014 evaluation campaign, which consisted of three tracks: The Interactive Social Book Search Track inves- tigated user information seeking behavior when interacting with various sources of information, for realistic task scenarios, and how the user in- terface impacts search and the search experience. The Social Book Search Track investigated the relative value of authoritative metadata and user- generated content for search and recommendation using a test collection with data from Amazon and LibraryThing, and user profiles and personal catalogues. The Tweet Contextualization Track investigated tweet con- textualization, helping a user to understand a tweet by providing him with a short background summary generated from relevant Wikipedia passages aggregated into a coherent summary. INEX 2014 was an excit- ing year for INEX in which we for the third time ran our workshop as part of the CLEF labs in order to facilitate knowledge transfer between the evaluation forums. This paper gives an overview of all the INEX 2014 tracks, their aims and task, the built test-collections, the participants, and gives an initial analysis of the results.

Item Type: Book Section
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Z Bibliography. Library Science. Information Resources > Z665 Library Science. Information Science
Divisions: Computing and Information Systems
Date Deposited: 21 Aug 2014 11:29
URI: http://repository.edgehill.ac.uk/id/eprint/6126

Archive staff only

Item control page Item control page