|
|
 |
Speech and Language Technology Evaluation |
Collaboration in LAnguage and Speech Science and technology for the development and promotion of technologies for multimedia access, language resources and speech processing applications in application areas such as Natural interaction, Cross-lingual knowledge management or Interactive information presentation.
|
The CLASS Evaluation Workpackage objective is to coordinate project cluster and cross project cluster activities in speech and language technology evaluation in order to create increased project collaboration, efficiency and effectiveness, economy of scale, visibility through dissemination and impact including results take-up.
More in details, the evaluation workpackage coordination tasks are organized around project clusters, as defined by CLASS; and include inter-cluster communication and collaboration, as well as external communication and collaboration; all these activities focusing on evaluation related issues.
Internal collaboration includes the regular report on the communications with the other clusters. External communication includes set-up and maintenance of communication with other clusters and the creation of global awareness of cluster R&D. External
collaboration includes cross-cluster and extra-CLASS communication (ranging as widely as possible, even including collaboration with non EU-projects) , exchange on evaluation and information on language resources for evaluation.
Intra and inter project cluster collaboration and external communication:
- Carry out initial analysis of cluster projects in Human Language Technology for the three CLASS clusters and identify potential for common ground and interest.
- Identify the language technologies and the language ressources used in these projects.
- Identify the projects in which similar technologies are used.
- Identify and synthesize the needs for Language Technology Evaluation
- Report to cluster coordinators the result of the analysis of evaluation activities
- Improve awareness of the state-of-the-art methodology available for comparative evaluation and also collect and disseminate information on the way evaluation is deployed.
- Prepare and send a questionnaire to the persons in charge of the "Assessment and Evaluation" work package in each project. This questionnaire will include questions like:
- What are the technologies they plan to use?
- Which evaluation of these technologies they plan to conduct?
- Which is the evaluation of these technologies in the application framework they plan to conduct?
- Which are the language resources they plan to produce and use for the evaluation?
The questionnaire answers will be used to refine the prior analysis of evaluation needs for Language Technology.
[CLASS main site home page]
[CLASS Evaluation subsite home page]
[LIMSI home page]
[Last updated: Mon Jan 29th 2001]
|
