What is EVALITA?
EVALITA is an initiative devoted to the evaluation of Natural Language Processing and Speech tools for Italian.
The general objective of Evalita is to promote the development of language and speech technologies for the Italian language, providing a shared framework where different systems and approaches can be evaluated in a consistent manner.
The diffusion of shared tasks and shared evaluation practices is a crucial step towards the development of resources and tools for NLP and speech sciences. The good response obtained by EVALITA, both in the number of participants and in the quality of results, showed that it is worth pursuing such goals for the Italian language.
As a side effect of the evaluation campaign, both training and test data are available to the scientific community as benchmarks for future improvements.
As EVALITA will not take place in 2015, we are organizing the track “Towards EVALITA 2016: challenges, methodologies and tasks” within the CLiC-it 2015 conference. The track is devoted to creating a forum for discussion on the future of EVALITA in terms of tasks, collaborations with enterprises, and evaluation methodologies.