Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | 99.99 | 98.70 | 96.87 | 4.81 | 0.00 | 37.89 | 0.00 | 0.00 | 32.90 | 2.09 | 2.49 | 0.03 | 0.00 | 83.17 | 81.23 |
Bulgarian | 99.95 | 99.95 | 99.06 | 0.00 | 0.00 | 35.98 | 0.00 | 0.01 | 10.58 | 1.13 | 1.41 | 0.00 | 0.00 | 94.56 | 93.63 |
Czech | 99.94 | 99.94 | 98.27 | 0.01 | 0.00 | 24.24 | 0.00 | 0.00 | 13.25 | 1.42 | 1.72 | 0.00 | 0.00 | 93.33 | 92.24 |
Dutch | 99.90 | 99.90 | 94.32 | 0.38 | 0.00 | 43.96 | 0.00 | 0.00 | 10.24 | 1.46 | 1.86 | 0.00 | 0.00 | 92.45 | 91.78 |
English | 98.80 | 99.00 | 94.90 | 0.28 | 0.00 | 32.76 | 0.00 | 0.00 | 7.86 | 1.08 | 1.37 | 0.04 | 0.00 | 88.81 | 88.19 |
Estonian | 99.69 | 99.69 | 95.00 | 0.12 | 0.01 | 35.08 | 0.01 | 0.01 | 11.86 | 0.82 | 0.97 | 0.00 | 0.00 | 88.99 | 88.38 |
Finnish | 99.72 | 99.70 | 97.08 | 0.09 | 42.71 | 30.08 | 0.00 | 0.00 | 13.15 | 0.67 | 0.79 | 0.00 | 0.00 | 92.32 | 91.75 |
French | 99.80 | 99.78 | 99.47 | 0.80 | 99.78 | 34.50 | 0.80 | 0.35 | 13.93 | 2.45 | 3.22 | 0.08 | 0.00 | 92.31 | 91.63 |
Italian | 99.90 | 99.83 | 99.07 | 0.12 | 0.00 | 38.86 | 0.00 | 0.00 | 10.22 | 0.58 | 0.77 | 0.00 | 0.00 | 93.98 | 93.31 |
Latvian | 99.80 | 99.80 | 99.26 | 0.56 | 0.00 | 35.62 | 0.00 | 0.03 | 10.37 | 0.97 | 1.18 | 0.00 | 0.00 | 90.72 | 90.23 |
Lithuanian | 99.99 | 99.99 | 96.22 | 1.51 | 0.00 | 30.20 | 0.00 | 0.00 | 10.89 | 1.24 | 1.49 | 0.00 | 0.00 | 87.49 | 86.06 |
Polish | 99.63 | 99.82 | 99.75 | 0.79 | 0.00 | 34.81 | 0.00 | 0.00 | 18.45 | 1.41 | 1.72 | 0.00 | 0.00 | 93.53 | 91.46 |
Russian | 99.73 | 99.73 | 99.54 | 0.02 | 99.73 | 36.37 | 0.00 | 0.00 | 13.81 | 0.51 | 0.63 | 0.00 | 0.00 | 94.55 | 94.01 |
Slovak | 99.95 | 99.94 | 96.72 | 1.17 | 0.00 | 22.69 | 0.00 | 0.00 | 13.67 | 1.60 | 1.91 | 0.00 | 0.00 | 95.90 | 94.96 |
Swedish | 99.86 | 99.86 | 99.03 | 0.00 | 0.00 | 33.79 | 0.00 | 0.00 | 8.42 | 0.20 | 0.24 | 0.00 | 0.00 | 90.62 | 89.90 |
Tamil | 99.63 | 95.34 | 100.00 | 0.05 | 0.00 | 25.53 | 0.00 | 0.00 | 13.79 | 0.00 | 0.00 | 0.00 | 0.00 | 66.89 | 65.58 |
Ukrainian | 99.86 | 99.84 | 98.38 | 0.71 | 0.00 | 26.83 | 0.00 | 0.00 | 14.01 | 0.95 | 1.15 | 0.00 | 0.00 | 93.18 | 92.78 |
Average | 99.77 | 99.46 | 97.82 | 0.67 | 14.25 | 32.89 | 0.05 | 0.02 | 13.38 | 1.09 | 1.35 | 0.01 | 0.00 | 90.16 | 89.24 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | 99.99 | 98.70 | 96.87 | 4.81 | 0.00 | 37.89 | 0.00 | 0.00 | 32.90 | 2.09 | 2.49 | 0.03 | 0.00 | 83.17 | 81.23 | (no xsubj) | 81.23 | 81.23 |
Bulgarian-BTB | 99.95 | 99.95 | 99.06 | 0.00 | 0.00 | 35.98 | 0.00 | 0.01 | 10.58 | 1.13 | 1.41 | 0.00 | 0.00 | 94.56 | 93.63 | (no gapping) | 93.63 | 93.63 |
Czech-FicTree | 99.97 | 99.96 | 99.54 | 0.02 | 0.00 | 32.17 | 0.00 | 0.00 | 12.41 | 2.33 | 2.93 | 0.00 | 0.00 | 94.96 | 93.98 | 91.46 | 92.24 | |
Czech-CAC | 99.99 | 99.99 | 100.00 | 0.00 | 0.00 | 22.84 | 0.00 | 0.00 | 11.25 | 1.18 | 1.43 | 0.00 | 0.00 | 93.74 | 92.69 | 91.46 | 92.24 | |
Czech-PDT | 99.97 | 99.97 | 98.14 | 0.01 | 0.00 | 23.75 | 0.00 | 0.00 | 13.55 | 1.44 | 1.75 | 0.00 | 0.00 | 93.68 | 92.66 | 91.46 | 92.24 | |
Czech-PUD | 99.66 | 99.66 | 96.88 | 0.00 | 0.00 | 22.49 | 0.00 | 0.00 | 12.41 | 0.49 | 0.60 | 0.00 | 0.00 | 88.33 | 86.50 | (no codepend) | 91.46 | 92.24 |
Dutch-Alpino | 99.86 | 99.86 | 94.45 | 0.39 | 0.00 | 40.66 | 0.00 | 0.00 | 8.09 | 0.14 | 0.17 | 0.00 | 0.00 | 93.60 | 93.00 | 91.81 | 91.78 | |
Dutch-LassySmall | 99.94 | 99.94 | 94.23 | 0.36 | 0.00 | 47.12 | 0.00 | 0.00 | 12.29 | 2.72 | 3.45 | 0.00 | 0.00 | 91.34 | 90.61 | 91.81 | 91.78 | |
English-EWT | 98.79 | 98.79 | 92.70 | 0.51 | 0.00 | 33.11 | 0.00 | 0.00 | 9.48 | 2.07 | 2.59 | 0.10 | 0.00 | 89.40 | 88.90 | 88.06 | 88.19 | |
English-GUM | 98.88 | 99.18 | 95.11 | 0.19 | 0.00 | 32.27 | 0.00 | 0.00 | 7.84 | 0.91 | 1.15 | 0.01 | 0.00 | 87.87 | 87.06 | 88.06 | 88.19 | |
English-PUD | 98.75 | 99.12 | 99.25 | 0.08 | 0.00 | 32.72 | 0.00 | 0.00 | 5.94 | 0.04 | 0.05 | 0.00 | 0.00 | 88.84 | 88.22 | 88.06 | 88.19 | |
Estonian-EDT | 99.95 | 99.95 | 96.60 | 0.14 | 0.00 | 34.41 | 0.00 | 0.00 | 11.57 | 0.79 | 0.93 | 0.00 | 0.00 | 90.39 | 89.83 | (no xsubj) | 86.53 | 88.38 |
Estonian-EWT | 98.72 | 98.72 | 89.37 | 0.05 | 0.03 | 37.53 | 0.03 | 0.03 | 12.96 | 0.92 | 1.11 | 0.00 | 0.00 | 84.02 | 83.22 | (no codepend, no xsubj) | 86.53 | 88.38 |
Finnish-TDT | 99.76 | 99.73 | 98.26 | 0.10 | 0.00 | 31.03 | 0.00 | 0.00 | 12.90 | 0.95 | 1.12 | 0.00 | 0.00 | 93.64 | 93.14 | 91.43 | 91.75 | |
Finnish-PUD | 99.66 | 99.66 | 95.28 | 0.08 | 99.66 | 28.80 | 0.00 | 0.00 | 13.47 | 0.29 | 0.34 | 0.00 | 0.00 | 90.40 | 89.72 | (no codepend, no xsubj) | 91.43 | 91.75 |
French-Sequoia | 99.88 | 99.84 | 96.82 | 0.33 | 99.84 | 36.94 | 0.33 | 0.00 | 10.80 | 0.88 | 1.15 | 0.07 | 0.00 | 95.35 | 95.22 | (no gapping, relcl, case) | 92.73 | 91.63 |
French-FQB | 99.76 | 99.76 | 100.00 | 1.00 | 99.76 | 33.48 | 1.00 | 0.50 | 15.23 | 3.11 | 4.07 | 0.09 | 0.00 | 90.74 | 90.24 | (no gapping, relcl, case) | 92.73 | 91.63 |
Italian-ISDT | 99.90 | 99.83 | 99.07 | 0.12 | 0.00 | 38.86 | 0.00 | 0.00 | 10.22 | 0.58 | 0.77 | 0.00 | 0.00 | 93.98 | 93.31 | 93.31 | 93.31 | |
Latvian-LVTB | 99.80 | 99.80 | 99.26 | 0.56 | 0.00 | 35.62 | 0.00 | 0.03 | 10.37 | 0.97 | 1.18 | 0.00 | 0.00 | 90.72 | 90.23 | 90.23 | 90.23 | |
Lithuanian-ALKSNIS | 99.99 | 99.99 | 96.22 | 1.51 | 0.00 | 30.20 | 0.00 | 0.00 | 10.89 | 1.24 | 1.49 | 0.00 | 0.00 | 87.49 | 86.06 | 86.06 | 86.06 | |
Polish-LFG | 99.84 | 99.89 | 99.88 | 0.00 | 0.00 | 35.45 | 0.00 | 0.00 | 18.03 | 3.02 | 3.71 | 0.00 | 0.00 | 95.08 | 92.30 | (no gapping) | 91.62 | 91.46 |
Polish-PDB | 99.49 | 99.84 | 99.66 | 0.90 | 0.00 | 35.66 | 0.00 | 0.00 | 18.05 | 1.23 | 1.51 | 0.00 | 0.00 | 93.27 | 91.17 | 91.62 | 91.46 | |
Polish-PUD | 99.73 | 99.72 | 99.70 | 1.15 | 0.00 | 32.79 | 0.00 | 0.00 | 19.48 | 0.59 | 0.72 | 0.00 | 0.00 | 92.94 | 91.40 | 91.62 | 91.46 | |
Russian-SynTagRus | 99.73 | 99.73 | 99.54 | 0.02 | 99.73 | 36.37 | 0.00 | 0.00 | 13.81 | 0.51 | 0.63 | 0.00 | 0.00 | 94.55 | 94.01 | (no codepend) | 94.01 | 94.01 |
Slovak-SNK | 99.95 | 99.94 | 96.72 | 1.17 | 0.00 | 22.69 | 0.00 | 0.00 | 13.67 | 1.60 | 1.91 | 0.00 | 0.00 | 95.90 | 94.96 | 94.96 | 94.96 | |
Swedish-Talbanken | 99.97 | 99.97 | 99.34 | 0.00 | 0.00 | 34.22 | 0.00 | 0.00 | 8.72 | 0.34 | 0.42 | 0.00 | 0.00 | 93.71 | 93.17 | 89.78 | 89.90 | |
Swedish-PUD | 99.74 | 99.74 | 98.66 | 0.00 | 0.00 | 33.34 | 0.00 | 0.00 | 8.11 | 0.04 | 0.05 | 0.00 | 0.00 | 87.30 | 86.39 | 89.78 | 89.90 | |
Tamil-TTB | 99.63 | 95.34 | 100.00 | 0.05 | 0.00 | 25.53 | 0.00 | 0.00 | 13.79 | 0.00 | 0.00 | 0.00 | 0.00 | 66.89 | 65.58 | (no gapping, xsubj) | 65.58 | 65.58 |
Ukrainian-IU | 99.86 | 99.84 | 98.38 | 0.71 | 0.00 | 26.83 | 0.00 | 0.00 | 14.01 | 0.95 | 1.15 | 0.00 | 0.00 | 93.18 | 92.78 | 92.78 | 92.78 | |
Average | 99.69 | 99.53 | 97.55 | 0.49 | 13.76 | 32.78 | 0.05 | 0.02 | 12.86 | 1.12 | 1.39 | 0.01 | 0.00 | 90.66 | 89.70 | 89.13 |