Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | |||||||||||||||
Bulgarian | 99.93 | 99.93 | 97.49 | 98.81 | 0.00 | 35.97 | 0.00 | 97.40 | 93.37 | 90.03 | 86.51 | 1.63 | 83.60 | 80.21 | 78.45 |
Czech | |||||||||||||||
Dutch | |||||||||||||||
English | 98.36 | 98.91 | 91.34 | 95.17 | 0.00 | 32.77 | 0.00 | 95.76 | 87.07 | 84.46 | 81.78 | 6.21 | 78.31 | 67.58 | 65.40 |
Estonian | 99.62 | 99.62 | 87.44 | 96.49 | 0.01 | 35.04 | 0.00 | 95.55 | 85.41 | 82.46 | 81.01 | 11.67 | 77.03 | 57.40 | 54.03 |
Finnish | |||||||||||||||
French | |||||||||||||||
Italian | |||||||||||||||
Latvian | 99.82 | 99.82 | 99.07 | 96.12 | 0.00 | 35.61 | 0.00 | 95.45 | 88.51 | 85.19 | 82.80 | 6.59 | 78.86 | 59.00 | 56.67 |
Lithuanian | 99.84 | 99.84 | 88.11 | 93.40 | 0.00 | 30.09 | 0.00 | 92.66 | 78.25 | 73.52 | 71.24 | 3.69 | 66.06 | 61.54 | 59.13 |
Polish | |||||||||||||||
Russian | 99.59 | 99.59 | 99.03 | 98.25 | 99.59 | 36.32 | 36.05 | 97.49 | 92.67 | 91.01 | 89.46 | 4.63 | 87.12 | 72.66 | 66.33 |
Slovak | 99.96 | 99.95 | 86.00 | 96.62 | 0.00 | 22.68 | 0.00 | 94.61 | 90.09 | 87.49 | 85.44 | 4.93 | 80.13 | 73.47 | 67.45 |
Swedish | 99.43 | 99.43 | 93.36 | 96.05 | 0.00 | 33.56 | 0.00 | 92.46 | 85.64 | 82.18 | 79.81 | 6.39 | 73.05 | 65.82 | 63.12 |
Tamil | |||||||||||||||
Ukrainian | |||||||||||||||
Average | 46.86 | 46.89 | 43.64 | 45.35 | 5.86 | 15.41 | 2.12 | 44.79 | 41.24 | 39.78 | 38.71 | 2.69 | 36.72 | 31.63 | 30.03 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | (no xsubj) | 0 | ||||||||||||||||
Bulgarian-BTB | 99.93 | 99.93 | 97.49 | 98.81 | 0.00 | 35.97 | 0.00 | 97.40 | 93.37 | 90.03 | 86.51 | 1.63 | 83.60 | 80.21 | 78.45 | (no gapping) | 78.45 | 78.45 |
Czech-FicTree | 0 | |||||||||||||||||
Czech-CAC | 0.00 | |||||||||||||||||
Czech-PDT | 0.00 | |||||||||||||||||
Czech-PUD | (no codepend) | 0.00 | ||||||||||||||||
Dutch-Alpino | 0 | |||||||||||||||||
Dutch-LassySmall | 0.00 | |||||||||||||||||
English-EWT | 97.25 | 98.63 | 88.49 | 95.02 | 0.00 | 33.14 | 0.00 | 96.76 | 86.94 | 84.48 | 81.51 | 8.57 | 79.73 | 66.38 | 64.50 | 65.33 | 65.40 | |
English-GUM | 98.44 | 98.44 | 88.29 | 94.73 | 0.00 | 32.04 | 0.00 | 94.47 | 85.15 | 82.22 | 79.15 | 2.95 | 74.41 | 65.90 | 63.78 | 65.33 | 65.40 | |
English-PUD | 99.60 | 99.60 | 99.70 | 95.67 | 0.00 | 32.88 | 0.00 | 95.55 | 88.70 | 86.13 | 84.16 | 5.78 | 79.57 | 70.29 | 67.71 | 65.33 | 65.40 | |
Estonian-EDT | 99.95 | 99.95 | 92.98 | 97.32 | 0.00 | 34.41 | 0.00 | 96.04 | 87.33 | 84.57 | 83.09 | 11.22 | 79.01 | 59.42 | 55.87 | (no xsubj) | 51.73 | 54.03 |
Estonian-EWT | 98.37 | 98.37 | 67.61 | 93.48 | 0.03 | 37.33 | 0.00 | 93.77 | 78.32 | 74.73 | 73.10 | 13.39 | 69.46 | 50.34 | 47.59 | (no codepend, no xsubj) | 51.73 | 54.03 |
Finnish-TDT | 0 | |||||||||||||||||
Finnish-PUD | (no codepend, no xsubj) | 0.00 | ||||||||||||||||
French-Sequoia | (no gapping, relcl, case) | 0 | ||||||||||||||||
French-FQB | (no gapping, relcl, case) | 0.00 | ||||||||||||||||
Italian-ISDT | 0 | |||||||||||||||||
Latvian-LVTB | 99.82 | 99.82 | 99.07 | 96.12 | 0.00 | 35.61 | 0.00 | 95.45 | 88.51 | 85.19 | 82.80 | 6.59 | 78.86 | 59.00 | 56.67 | 56.67 | 56.67 | |
Lithuanian-ALKSNIS | 99.84 | 99.84 | 88.11 | 93.40 | 0.00 | 30.09 | 0.00 | 92.66 | 78.25 | 73.52 | 71.24 | 3.69 | 66.06 | 61.54 | 59.13 | 59.13 | 59.13 | |
Polish-LFG | (no gapping) | 0 | ||||||||||||||||
Polish-PDB | 0.00 | |||||||||||||||||
Polish-PUD | 0.00 | |||||||||||||||||
Russian-SynTagRus | 99.59 | 99.59 | 99.03 | 98.25 | 99.59 | 36.32 | 36.05 | 97.49 | 92.67 | 91.01 | 89.46 | 4.63 | 87.12 | 72.66 | 66.33 | (no codepend) | 66.33 | 66.33 |
Slovak-SNK | 99.96 | 99.95 | 86.00 | 96.62 | 0.00 | 22.68 | 0.00 | 94.61 | 90.09 | 87.49 | 85.44 | 4.93 | 80.13 | 73.47 | 67.45 | 67.45 | 67.45 | |
Swedish-Talbanken | 99.97 | 99.97 | 98.52 | 97.72 | 0.00 | 34.22 | 0.00 | 97.64 | 89.21 | 86.20 | 83.92 | 7.74 | 81.33 | 68.51 | 65.87 | 63.02 | 63.12 | |
Swedish-PUD | 98.85 | 98.85 | 87.31 | 94.26 | 0.00 | 32.85 | 0.00 | 86.91 | 81.82 | 77.87 | 75.42 | 4.94 | 64.22 | 62.93 | 60.17 | 63.02 | 63.12 | |
Tamil-TTB | (no gapping, xsubj) | 0 | ||||||||||||||||
Ukrainian-IU | 0 | |||||||||||||||||
Average | 41.09 | 41.14 | 37.68 | 39.70 | 3.44 | 13.71 | 1.24 | 39.27 | 35.87 | 34.60 | 33.65 | 2.62 | 31.84 | 27.26 | 25.98 | 29.89 |