Cross-Language Evaluation Forum

Cross-Language Evaluation Forum

The Cross-Language Evaluation Forum, or CLEF, is an organization promoting research in multilingual information access (currently focusing on European languages). Its specific functions are to maintain an underlying framework for testing information retrieval systems, and creating repositories of data for researchers to use in developing comparable standards.[1] The organization holds a forum meeting every September in Europe. Prior to each forum, participants receive a set of challenge tasks. The tasks are designed to test various aspects of information retrieval systems and encourage their development. Groups of researchers propose and organize campaigns to satisfy those tasks. The results are used as benchmarks for the state of the art in the specific areas. [2] , [3]

For example, the 2010 medical retrieval tasks focuses on retrival of computed tomography, MRI, and radiographic images.[4]

References

  1. ^ Carol Peters, Martin Braschler, Khalid Choukri, Julio Gonzalo, Michael Kluck, "The Future of Evaluation for Cross-Language Information Retrieval Systems" in Second Workshop of the Cross-Language Evaluation Forum, CLEF 2001 pdf
  2. ^ "Special Issue on CLEF" Information Retrieval vol.7,no.1–2, 2004 [1]
  3. ^ Fredric C. Gey, Noriko Kando, and Carol Peters "Cross-Language Information Retrieval: the way ahead" in Information Processing & Management vol. 41, no. 3, p.415-431 May 2005, doi:10.1016/j.ipm.2004.06.006
  4. ^ Mueller, Henning (20 May 2010). "Medical Retrieval Task". ImageCLEF - Cross-language image retrieval evaluations. http://www.imageclef.org/2010/medical. Retrieved 27 May 2010. 

External links


This article about a computer conference is a stub. You can help Wikipedia by expanding it.