Paris time: 13h02

Evaluation in Language and Speech Engineering

FP4 Preparatory Action

---

• A Blueprint for a General Infrastructure for Natural Language Processing Systems Evaluation Using Semi-Automatic Quantitative Black Box Approach in a Multilingual Environment.
  short version (7 pages)
  long version (44 pages)

• D1.1 A Blueprint for a General Infrastructure for Natural Language Processing Systems Evaluation Using Semi-Automatic Quantitative Black Box Approach in a Multilingual Environment. (62 pages)
• D1.2 Follow-up Evaluation Proposal. (18 pages)
• D2 Evaluation in the Field of Linguistic Engineering, a Legal Approach. (21 pages)
• D3 Data Formats for Evaluation.
• D4 Lexicons for Evaluation.
  • PostScript version
  • rtf version
• D5 Corpora for Evaluation.
  1. PostScript version
  2. rtf version
• D6 Evaluation Workbench for POS Taggers:
  • tar file
  • source code
  • documentation
  • User Manual
• D7 POS Tagger Evaluation Protocol and Evaluation Workbench Demonstration.

• The CLEF project (FP5), in which Information Retrieval System Evaluation for European Languages (CLIR track of TREC) moves to Europe. It will be sponsored by the DELOS Network of Excellence for Digital Libraries.
• The 1999 DARPA Broadcast News Workshop Proceedings.
• The MUC Conferences and Evaluations.
• The TREC home page.
• The MULTEXT project.
• The EAGLES project.
• The DIET project.
• The GATE project.
• The DISC project.
• The MATE project.
• The GRACE project.

• ELSE power point presentation at the EELS workshop.
• ELSE questionnaire on the future of evaluation for L.E. in FP5