The Best System Award has been established with the twofold aim of enhancing the participation of young researchers and supporting open science.
A jury composed of Andrea Bolioli (CELI), Khalid Choukri (ELRA), Bernardo Magnini (FBK), Nicole Novielli (University of Bari) and Silvia Pareti (Google) assigned the Best System Award across tasks to:
- Lorenzo De Mattei, Andrea Cimino and Felice Dell’Orletta: Multi-task learning in Deep Neural Networks at EVALITA 2018 (they participated in four tasks, namely HaSpeeDe, IronITA, ABSITA, and GxG).
A special mention was assigned to the following papers, included in the final shortlist of the three best systems candidate for the award:
- Endang Wahyu Pamungkas, Alessandra Teresa Cignarella, Valerio Basile and Viviana Patti: Automatic Identification of Misogyny in English and Italian Tweets at EVALITA 2018 with a Multilingual Hate Lexicon, for the best discussion and critical insights (they participated in the AMI task);
- Giancarlo Nicola: Bidirectional Attentional LSTM for Aspect Based Sentiment Analysis on Italian, as best single-author student contribution (Giancarlo participated in the ABSITA task).
Eligible systems had to have at least one young researcher (Ph.D. or undergraduate student) as a co-author, and the authors must have open-sourced their software.
Eligible systems were evaluated according to the following criteria:
- Novelty with respect to the state of the art;
- Originality (in terms of identification of new linguistic resources, identification of linguistically motivated features, and implementation of a theoretical framework grounded in linguistics);
- Critical insight, paving the way to future challenges (deep error analysis, discussion on the limits of the proposed system, discussion of the inherent challenges of the task);
- Technical soundness and methodological rigor.