The contribution of evaluation: the CLEF experience

The aim of this position paper is to review the current state-of-the-art in evaluation for crosslanguage systems on the basis of the CLEF experience - and to propose actions for the future. The goal is to stimulate discussion at the Workshop on the role of evaluation campaigns in assisting the development of CLIR systems and to identify what steps need to be taken in order to strengthen the contribution that such campaigns can provide.