Best System Award across Tasks

The Best System Award has been established with the twofold aim of enhancing the participation of young researchers and supporting open science.

A jury composed of Andrea Bolioli (CELI), Khalid Choukri (ELRA), Bernardo Magnini (FBK), Nicole Novielli (University of Bari) and Silvia Pareti (Google) assigned the Best System Award across tasks to:

  • Lorenzo De Mattei, Andrea Cimino and Felice Dell'Orletta: Multi-task learning in Deep Neural Networks at EVALITA 2018 (they participated in four tasks, namely HaSpeeDe, IronITA, ABSITA, and GxG).

A special mention was assigned to the following papers, included in the final shortlist of the three best systems candidate for the award:

  • Endang Wahyu Pamungkas, Alessandra Teresa Cignarella, Valerio Basile and Viviana Patti: Automatic Identification of Misogyny in English and Italian Tweets at EVALITA 2018 with a Multilingual Hate Lexicon, for the best discussion and critical insights (they participated in the AMI task);
  • Giancarlo Nicola: Bidirectional Attentional LSTM for Aspect Based Sentiment Analysis on Italian, as best single-author student contribution (Giancarlo participated in the ABSITA task).

Eligible systems had to have at least one young researcher (Ph.D. or undergraduate student) as a co-author, and the authors must have open-sourced their software.

Eligible systems were evaluated according to the following criteria:

  • Novelty with respect to the state of the art;
  • Originality (in terms of identification of new linguistic resources, identification of linguistically motivated features, and implementation of a theoretical framework grounded in linguistics);
  • Critical insight, paving the way to future challenges (deep error analysis, discussion on the limits of the proposed system, discussion of the inherent challenges of the task);
  • Technical soundness and methodological rigor.

Read more