Skip to main content

Results of EVALITA 2007

PoS-Tagging: Official Ranking

Participants' results with respect to Tagging Accuracy (TA) and Unknown Words Tagging Accuracy (UWTA).

ParticipantsEAGLES-likeDistribPDF
TAUWTATAUWTA
FBKirst_Zanoli_POS98.0495.0297.6894.65report
ILCcnrUniPi_Lenci_POS97.6594.1296.7093.14report
UniBoCilta_Romagnoli_POS96.7991.4894.8090.72report
UniBoDslo_Tamburini_POS97.5992.1697.3192.99report
UniRoma1_Bos_POS96.7687.4196.2188.69report
UniStuttIMS_Schiehlen_POS97.1589.2997.0792.23report
UniTn_Baroni_POS97.8994.3497.3794.12report
UniVe_Delmonte_POS91.8584.4691.4286.80report
Yahoo_Ciaramita_POS_s196.7887.7896.6188.24report
Yahoo_Ciaramita-POS_s295.2781.8395.1184.16
UniPiSynthema_Deha_POS88.7179.49--report
UniTo_Lesmo_POS94.6987.33--report

Parsing: Official Ranking for the Dependency Parsing Subtask

Participants' results with respect to the CoNLL standard metrics: Labeled Attachment Score (LAS), Unlabeled Attachment Score (UAS) and Label Accuracy (LAS2).

ParticipantsLASUASLAS2TotalPDF
UniTo_Lesmo_PAR86.9490.9091.591-1-1report
UniPi_Attardi_PAR77.8888.4383.002-2-2report
IIIT_Mannem_PAR75.1285.8182.053-4-3report
UniStuttIMS_Schiehlen_PAR74.8585.8881.594-3-4report
UPenn_Champollion_PAR*85.46**-5-*report
UniRoma2_Zanzotto_PAR47.6262.1154.905-6-5report

Parsing: Official Ranking for the Constituency Parsing Subtask

Participants' results with respect to the standard brackets precision-recall-F_score metrics.

ParticipantsBr-RBR-PBR-FErrorsPDF
UniNa_Corazza_PAR70.8165.3667.9726report
FBKirst_Pianta_PAR38.9245.4941.9448report

Word Sense Disambiguation: Official Ranking

Participants' results with respect to Precision, Recall and F-measure.

ParticipantsRunPrec.Rec.FPDF
UniBa_Basile_WSDr10.5600.4140.470report
r20.5030.3720.427

Temporal Expressions: Official Ranking for the Recognition only Subtask

Participants' results with respect to Value, Precision, Recall and F-measure.

ParticipantsValuePrec.Rec.F.PDF
FBKirst_Negri_TIME85.795.789.892.6report
UniPg_Faina_TIME50.177.770.373.8report
UniAli_Puchol_TIME48.878.467.472.5report
UniAli_Saquete_TIME41.982.553.264.7report

Temporal Expressions: Official Ranking for the Recognition + Normalization Subtask

Participants' results with respect to Value, Precision, Recall and F-measure.

ParticipantsValuePrec.Rec.F.PDF
FBKirst_Negri_TIME61.968.563.367.4report
UniAli_Saquete_TIME22.151.535.642.1report
UniPg_Faina_TIME11.924.919.621.9report

Named Entity Recognition: Official Ranking

Participants' results with respect to F-measure, Precision and Recall.

ParticipantsRunFPrec.Rec.PDF
FBKirst_Zanoli_NERr282.1483.4180.91report
r181.2882.9779.65
UniDuE_Roessler_NERr172.2771.6272.94report
r271.9373.2870.62
Yahoo_Ciaramita_NERr168.9971.2866.85report
r268.1570.4466.00
UniDo_Jungermann_NERr267.9070.9365.12report
r167.7970.9364.91
UniAli_Kozareva_NER-66.5962.7370.95report
LDC_Walker_NERr163.1083.0550.88report
r262.7082.1250.70