FYI
-------- Original Message --------
Subject: INEX 2006 - Call for participation
Date: Tue, 21 Feb 2006 13:42:47 +0000
From: Mounia Lalmas <mounia@dcs.qmul.ac.uk>
Organization: Queen Mary University of London
To: Mounia Lalmas <mounia@dcs.qmul.ac.uk>
INEX 2006 - Call for participation
http://inex.is.informatik.uni-duisburg.de/2006/index.html
Content-oriented XML retrieval has been receiving increasing interest
fuelled by the widespread use of the eXtensible Markup Language
(XML), as a standard document format. The continuous growth in XML
data sources is matched by increasing efforts in the development of
XML retrieval systems, which aim at exploiting the available
structural information in documents to implement a more focused
retrieval strategy and return document components, the so-called XML
elements - instead of complete documents - in response to a user
query. Implementing this, more focused, retrieval paradigm means that
an XML retrieval system needs not only to find relevant information
in the XML documents, but also determine the appropriate level of
granularity to be returned to the user. In addition, the relevance of
a retrieved component is dependent on meeting both content and
structural conditions.
Evaluating the effectiveness of XML retrieval systems, hence,
requires a test collection where the relevance assessments are
provided according to a relevance criterion, which takes into account
the imposed structural aspects. In 2002, the Initiative for the
Evaluation of XML Retrieval (INEX) started to address these issues.
The aim of the INEX initiative is to establish an infrastructure and
provide means, in the form of a large XML test collection and
appropriate scoring methods, for the evaluation of content-oriented
XML retrieval systems.
Evaluating retrieval effectiveness is typically done by using test
collections assembled specifically for evaluating particular
retrieval tasks. A test collection as such has been built as a result
of four rounds of INEX (2002 to 2005).
In INEX 2006, participating organisations will be able to compare the
retrieval effectiveness of their XML retrieval systems and will
contribute to the construction of a new XML test collection based on
Wikipedia. The test collection will also provide participants a means
for future comparative and quantitative experiments.
Tasks and tracks
In addition to the main general ad-hoc retrieval task, INEX 2006 will
have the following two specific tasks:
1. Relevance feedback task
2. Natural query language task
INEX 2006 will continue with the following four tracks that started
in previous years:
1. Heterogeneous collection track
2. Interactive track
3. Document mining track
4. Multimedia track
Two additional tracks are planned for INEX 2006:
1. Use case studies track
2. XML Entity Search track
Relevance assessments
Relevance assessments will be provided by the participating groups
using INEX's on-line assessment system. Each participating
organisation will judge around 2 topics. Please note that assessments
take about one-person week per topic! Participating groups will gain
access to the completed INEX test collection only after they have
completed their assessment task. Upon completion of the relevance
assessments, participants new to INEX can have access to the previous
years test collections.
Workshop and proceedings
Participants will be able to present their approaches and final
results at the INEX 2006 workshop to be held in December in Dagstuhl.
Revised papers will be published in the INEX post-workshop final
proceedings. As for INEX 2004 and 2005, we expect the INEX final
proceedings to be published in the Springer's Lecture Notes in
Computer Science (LNCS) series.
Organisers
Project Leaders
Norbert Fuhr
Mounia Lalmas
Contact persons
Saadia Malik
Zoltán Szlávik
Wikipedia document collection and exploration
Ludovic Denoyer
Martin Theobald
Use case studies
Andrew Trotman
Nils Pharo
Topic format specification
Andrew Trotman
Birger Larsen
Task description
Jaap Kamps
Charlie Clarkes
Online relevance assessment tool
Benjamin Piwowarski
Metrics
Gabriella Kazai
Stephen Robertson
Paul Ogilvie
Relevance feedback task
Yosi Mass
Ralf Schenkel
Natural query language task
Shlomo Geva
Xavier Tannier
Heterogeneous collection track
Ingo Frommholz
Ray Larson
Interactive track
Birger Larsen
Anastasios Tombros
Saadia Malik
Document mining track
Ludovic Denoyer
Anne-Marie Vercoustre
Patrick Gallinari
XML multimedia track
Roelof van Zwol
Thijs Westerveld
XML entity search track
Arjen de Vries
Nick Craswell
--- Christof Monz Department of Computer Science Queen Mary, University of London London E1 4NS, UKPhone: +44 (0)20 7882-7978 Fax: +44 (0) 20 8980 6533 E-mail: christof@dcs.qmul.ac.uk Web: http://www.dcs.qmul.ac.uk/~christof PGP: http://www.dcs.qmul.ac.uk/~christof/pubkey.asc
This archive was generated by hypermail 2b29 : Tue Feb 21 2006 - 15:21:00 MET