Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | 99.95 | 99.39 | 96.79 | 4.80 | 0.00 | 37.91 | 0.00 | 0.00 | 8.09 | 2.12 | 2.51 | 0.03 | 0.00 | 84.45 | 82.26 |
Bulgarian | 99.78 | 99.78 | 98.79 | 0.00 | 0.00 | 35.92 | 0.00 | 0.01 | 5.80 | 1.54 | 1.93 | 0.00 | 0.00 | 93.47 | 92.52 |
Czech | 99.93 | 99.92 | 97.56 | 0.01 | 0.00 | 24.23 | 0.00 | 0.00 | 5.84 | 1.63 | 1.97 | 0.00 | 0.00 | 92.87 | 91.78 |
Dutch | 99.00 | 99.00 | 83.48 | 0.35 | 0.00 | 43.34 | 0.00 | 0.00 | 3.71 | 1.42 | 1.82 | 0.00 | 0.00 | 89.41 | 88.64 |
English | 98.63 | 98.87 | 94.29 | 0.28 | 0.00 | 32.80 | 0.00 | 0.00 | 3.71 | 1.24 | 1.57 | 0.04 | 0.00 | 88.13 | 87.27 |
Estonian | 99.39 | 99.39 | 94.85 | 0.12 | 0.00 | 34.99 | 0.00 | 0.00 | 3.67 | 1.16 | 1.38 | 0.00 | 0.00 | 87.50 | 86.66 |
Finnish | 99.63 | 99.63 | 96.39 | 0.09 | 42.65 | 30.08 | 0.00 | 0.00 | 3.87 | 0.96 | 1.13 | 0.00 | 0.00 | 91.88 | 90.81 |
French | 99.76 | 99.75 | 97.23 | 0.77 | 99.75 | 34.42 | 0.77 | 0.34 | 10.09 | 2.36 | 3.09 | 0.00 | 0.00 | 89.20 | 88.40 |
Italian | 99.88 | 99.86 | 99.07 | 0.11 | 0.00 | 38.82 | 0.00 | 0.00 | 2.78 | 0.72 | 0.97 | 0.00 | 0.00 | 93.59 | 92.88 |
Latvian | 99.74 | 99.74 | 98.69 | 0.58 | 0.00 | 35.57 | 0.00 | 0.03 | 4.22 | 1.42 | 1.71 | 0.00 | 0.00 | 89.77 | 89.17 |
Lithuanian | 99.84 | 99.84 | 95.72 | 1.51 | 0.00 | 30.12 | 0.00 | 0.00 | 5.12 | 1.77 | 2.11 | 0.00 | 0.00 | 83.76 | 80.87 |
Polish | 99.47 | 99.92 | 99.05 | 0.82 | 0.00 | 34.84 | 0.00 | 0.00 | 7.13 | 1.84 | 2.24 | 0.00 | 0.00 | 93.04 | 90.66 |
Russian | 99.70 | 99.70 | 99.45 | 0.02 | 99.70 | 36.35 | 0.00 | 0.00 | 3.35 | 0.73 | 0.89 | 0.00 | 0.00 | 94.00 | 93.59 |
Slovak | 99.95 | 99.94 | 95.31 | 1.19 | 0.00 | 22.69 | 0.00 | 0.00 | 6.06 | 1.96 | 2.34 | 0.00 | 0.00 | 92.84 | 90.25 |
Swedish | 99.78 | 99.78 | 98.25 | 0.00 | 0.00 | 33.79 | 0.00 | 0.00 | 1.55 | 0.34 | 0.42 | 0.00 | 0.00 | 88.63 | 86.62 |
Tamil | 98.33 | 94.19 | 100.00 | 0.05 | 0.00 | 25.22 | 0.00 | 0.00 | 0.65 | 0.20 | 0.23 | 0.00 | 0.00 | 61.65 | 58.94 |
Ukrainian | 99.77 | 99.76 | 97.55 | 0.68 | 0.00 | 26.82 | 0.00 | 0.00 | 4.07 | 1.10 | 1.34 | 0.00 | 0.00 | 90.21 | 88.94 |
Average | 99.56 | 99.32 | 96.62 | 0.67 | 14.24 | 32.82 | 0.05 | 0.02 | 4.69 | 1.32 | 1.63 | 0.00 | 0.00 | 88.49 | 87.07 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | 99.95 | 99.39 | 96.79 | 4.80 | 0.00 | 37.91 | 0.00 | 0.00 | 8.09 | 2.12 | 2.51 | 0.03 | 0.00 | 84.44 | 82.25 | (no xsubj) | 82.25 | 82.26 |
Bulgarian-BTB | 99.78 | 99.78 | 98.79 | 0.00 | 0.00 | 35.92 | 0.00 | 0.01 | 5.80 | 1.54 | 1.93 | 0.00 | 0.00 | 93.47 | 92.52 | (no gapping) | 92.52 | 92.52 |
Czech-FicTree | 99.95 | 99.88 | 94.84 | 0.02 | 0.00 | 32.16 | 0.00 | 0.00 | 9.12 | 3.16 | 3.96 | 0.00 | 0.00 | 93.63 | 92.68 | 90.86 | 91.78 | |
Czech-CAC | 99.99 | 99.97 | 99.04 | 0.00 | 0.00 | 22.83 | 0.00 | 0.00 | 5.90 | 1.61 | 1.95 | 0.00 | 0.00 | 93.31 | 92.26 | 90.86 | 91.78 | |
Czech-PDT | 99.95 | 99.95 | 97.87 | 0.01 | 0.00 | 23.74 | 0.00 | 0.00 | 5.82 | 1.58 | 1.91 | 0.00 | 0.00 | 93.27 | 92.25 | 90.86 | 91.78 | |
Czech-PUD | 99.65 | 99.65 | 96.88 | 0.00 | 0.00 | 22.49 | 0.00 | 0.00 | 3.15 | 0.69 | 0.84 | 0.00 | 0.00 | 88.13 | 86.25 | (no codepend) | 90.86 | 91.78 |
Dutch-Alpino | 99.43 | 99.43 | 90.65 | 0.34 | 0.00 | 40.29 | 0.00 | 0.00 | 1.59 | 0.44 | 0.56 | 0.00 | 0.00 | 92.17 | 91.25 | 88.70 | 88.64 | |
Dutch-LassySmall | 98.59 | 98.59 | 78.35 | 0.36 | 0.00 | 46.23 | 0.00 | 0.00 | 5.73 | 2.36 | 3.00 | 0.00 | 0.00 | 86.78 | 86.15 | 88.70 | 88.64 | |
English-EWT | 97.96 | 98.56 | 94.02 | 0.52 | 0.00 | 33.03 | 0.00 | 0.00 | 6.60 | 2.44 | 3.05 | 0.10 | 0.00 | 89.02 | 88.33 | 87.01 | 87.27 | |
English-GUM | 98.21 | 98.21 | 89.14 | 0.19 | 0.00 | 32.12 | 0.00 | 0.00 | 2.97 | 0.87 | 1.10 | 0.01 | 0.00 | 85.75 | 84.75 | 87.01 | 87.27 | |
English-PUD | 99.74 | 99.74 | 99.40 | 0.08 | 0.00 | 33.05 | 0.00 | 0.00 | 0.87 | 0.11 | 0.14 | 0.00 | 0.00 | 88.91 | 87.96 | 87.01 | 87.27 | |
Estonian-EDT | 99.75 | 99.75 | 96.53 | 0.14 | 0.00 | 34.38 | 0.00 | 0.00 | 3.32 | 1.12 | 1.33 | 0.00 | 0.00 | 89.07 | 88.26 | (no xsubj) | 84.62 | 86.66 |
Estonian-EWT | 98.08 | 98.08 | 88.97 | 0.04 | 0.02 | 37.21 | 0.02 | 0.02 | 4.96 | 1.30 | 1.56 | 0.00 | 0.00 | 81.95 | 80.99 | (no codepend, no xsubj) | 84.62 | 86.66 |
Finnish-TDT | 99.71 | 99.72 | 97.22 | 0.10 | 0.00 | 31.04 | 0.00 | 0.00 | 4.59 | 1.29 | 1.52 | 0.00 | 0.00 | 92.93 | 92.04 | 90.52 | 90.81 | |
Finnish-PUD | 99.52 | 99.53 | 95.13 | 0.08 | 99.53 | 28.80 | 0.00 | 0.00 | 2.91 | 0.52 | 0.61 | 0.00 | 0.00 | 90.31 | 88.99 | (no codepend, no xsubj) | 90.52 | 90.81 |
French-Sequoia | 99.61 | 99.61 | 85.71 | 0.31 | 99.61 | 36.76 | 0.31 | 0.00 | 1.99 | 0.64 | 0.84 | 0.00 | 0.00 | 91.85 | 91.71 | (no gapping, relcl, case) | 89.57 | 88.40 |
French-FQB | 99.82 | 99.81 | 99.41 | 0.96 | 99.81 | 33.45 | 0.96 | 0.48 | 13.46 | 3.08 | 4.03 | 0.00 | 0.00 | 87.78 | 87.43 | (no gapping, relcl, case) | 89.57 | 88.40 |
Italian-ISDT | 99.88 | 99.86 | 99.07 | 0.11 | 0.00 | 38.82 | 0.00 | 0.00 | 2.78 | 0.72 | 0.97 | 0.00 | 0.00 | 93.59 | 92.88 | 92.88 | 92.88 | |
Latvian-LVTB | 99.74 | 99.74 | 98.69 | 0.58 | 0.00 | 35.57 | 0.00 | 0.03 | 4.22 | 1.42 | 1.71 | 0.00 | 0.00 | 89.77 | 89.17 | 89.17 | 89.17 | |
Lithuanian-ALKSNIS | 99.84 | 99.84 | 95.72 | 1.51 | 0.00 | 30.12 | 0.00 | 0.00 | 5.12 | 1.77 | 2.11 | 0.00 | 0.00 | 83.76 | 80.87 | 80.87 | 80.87 | |
Polish-LFG | 97.66 | 99.90 | 99.28 | 0.00 | 0.00 | 35.45 | 0.00 | 0.00 | 12.89 | 3.55 | 4.36 | 0.00 | 0.00 | 94.45 | 91.70 | (no gapping) | 90.89 | 90.66 |
Polish-PDB | 99.93 | 99.92 | 98.71 | 0.92 | 0.00 | 35.69 | 0.00 | 0.00 | 6.59 | 1.76 | 2.15 | 0.00 | 0.00 | 92.71 | 90.22 | 90.89 | 90.66 | |
Polish-PUD | 99.94 | 99.92 | 99.40 | 1.22 | 0.00 | 32.83 | 0.00 | 0.00 | 4.00 | 0.77 | 0.93 | 0.00 | 0.00 | 92.69 | 90.76 | 90.89 | 90.66 | |
Russian-SynTagRus | 99.70 | 99.70 | 99.45 | 0.02 | 99.70 | 36.35 | 0.00 | 0.00 | 3.35 | 0.73 | 0.89 | 0.00 | 0.00 | 94.00 | 93.59 | (no codepend) | 93.59 | 93.59 |
Slovak-SNK | 99.95 | 99.94 | 95.31 | 1.19 | 0.00 | 22.69 | 0.00 | 0.00 | 6.06 | 1.96 | 2.34 | 0.00 | 0.00 | 92.84 | 90.25 | 90.25 | 90.25 | |
Swedish-Talbanken | 99.91 | 99.91 | 99.26 | 0.00 | 0.00 | 34.21 | 0.00 | 0.00 | 1.86 | 0.51 | 0.63 | 0.00 | 0.00 | 91.51 | 89.57 | 86.51 | 86.62 | |
Swedish-PUD | 99.65 | 99.65 | 97.02 | 0.00 | 0.00 | 33.34 | 0.00 | 0.00 | 1.22 | 0.15 | 0.19 | 0.00 | 0.00 | 85.53 | 83.45 | 86.51 | 86.62 | |
Tamil-TTB | 98.33 | 94.19 | 100.00 | 0.05 | 0.00 | 25.22 | 0.00 | 0.00 | 0.65 | 0.20 | 0.23 | 0.00 | 0.00 | 61.65 | 58.93 | (no gapping, xsubj) | 58.93 | 58.94 |
Ukrainian-IU | 99.77 | 99.76 | 97.55 | 0.68 | 0.00 | 26.82 | 0.00 | 0.00 | 4.07 | 1.10 | 1.34 | 0.00 | 0.00 | 90.21 | 88.94 | 88.94 | 88.94 | |
Average | 99.45 | 99.38 | 95.80 | 0.49 | 13.75 | 32.71 | 0.04 | 0.02 | 4.82 | 1.36 | 1.68 | 0.00 | 0.00 | 89.15 | 87.81 | 86.95 |