Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | 99.97 | 97.92 | 79.92 | 95.08 | 92.86 | 92.97 | 92.52 | 92.35 | 85.38 | 81.04 | 78.52 | 72.85 | 73.32 | 78.35 | 76.39 |
Bulgarian | 99.93 | 99.93 | 97.00 | 98.72 | 95.55 | 97.23 | 95.02 | 97.25 | 92.98 | 89.52 | 85.88 | 81.94 | 82.47 | 87.41 | 86.67 |
Czech | 99.91 | 99.91 | 94.66 | 99.04 | 96.67 | 97.20 | 95.86 | 98.56 | 94.88 | 93.30 | 92.43 | 88.43 | 90.92 | 90.57 | 89.08 |
Dutch | 99.89 | 99.89 | 83.82 | 97.16 | 95.81 | 96.88 | 95.15 | 97.14 | 93.24 | 90.93 | 87.16 | 82.43 | 83.82 | 88.90 | 87.07 |
English | 98.87 | 98.90 | 91.06 | 95.74 | 95.33 | 93.54 | 91.03 | 95.26 | 89.61 | 87.22 | 85.42 | 76.21 | 80.94 | 85.27 | 84.09 |
Estonian | 99.67 | 99.67 | 90.35 | 97.42 | 98.06 | 96.57 | 95.30 | 86.09 | 90.00 | 87.53 | 86.42 | 81.95 | 69.42 | 85.56 | 84.02 |
Finnish | 99.59 | 99.57 | 91.45 | 98.15 | 56.44 | 97.34 | 55.27 | 89.17 | 93.76 | 92.28 | 91.33 | 88.01 | 78.18 | 88.79 | 87.28 |
French | 99.60 | 99.39 | 95.61 | 97.67 | 99.39 | 93.47 | 92.53 | 97.41 | 92.21 | 89.29 | 85.37 | 75.77 | 82.62 | 88.10 | 87.32 |
Italian | 99.95 | 99.59 | 98.76 | 98.39 | 98.23 | 97.99 | 97.43 | 98.32 | 94.69 | 93.27 | 90.06 | 87.44 | 88.18 | 91.16 | 90.40 |
Latvian | 99.81 | 99.81 | 98.74 | 97.35 | 90.24 | 94.97 | 89.54 | 96.53 | 92.91 | 90.25 | 88.63 | 81.06 | 84.78 | 86.22 | 84.57 |
Lithuanian | 99.81 | 99.81 | 87.74 | 97.26 | 93.90 | 95.05 | 93.11 | 93.76 | 88.03 | 84.75 | 83.25 | 77.22 | 76.50 | 81.28 | 79.75 |
Polish | 99.49 | 99.65 | 98.51 | 98.52 | 94.58 | 93.21 | 90.66 | 97.81 | 94.79 | 92.75 | 91.50 | 82.58 | 89.18 | 90.22 | 87.65 |
Russian | 99.67 | 99.67 | 99.15 | 98.94 | 99.67 | 98.04 | 97.82 | 98.16 | 95.37 | 94.29 | 93.34 | 91.02 | 91.39 | 91.76 | 90.73 |
Slovak | 99.97 | 99.97 | 84.61 | 97.88 | 91.58 | 95.03 | 90.90 | 95.61 | 93.19 | 91.72 | 90.65 | 84.30 | 85.73 | 88.53 | 87.04 |
Swedish | 99.44 | 99.44 | 93.64 | 97.67 | 96.03 | 89.19 | 88.03 | 92.45 | 90.31 | 87.82 | 86.77 | 72.09 | 79.34 | 85.26 | 83.20 |
Tamil | 99.92 | 91.28 | 98.76 | 81.06 | 80.51 | 83.39 | 75.50 | 86.42 | 63.62 | 56.28 | 54.17 | 47.67 | 50.62 | 53.49 | 52.27 |
Ukrainian | 99.78 | 99.76 | 96.36 | 98.21 | 95.76 | 95.91 | 94.79 | 97.81 | 92.85 | 90.96 | 88.95 | 83.52 | 86.68 | 87.60 | 86.92 |
Average | 99.72 | 99.07 | 92.95 | 96.72 | 92.39 | 94.59 | 90.03 | 94.71 | 90.46 | 87.84 | 85.87 | 79.68 | 80.83 | 85.20 | 83.79 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | 99.97 | 97.92 | 79.92 | 95.08 | 92.86 | 92.97 | 92.52 | 92.35 | 85.38 | 81.04 | 78.52 | 72.85 | 73.32 | 78.35 | 76.40 | (no xsubj) | 76.40 | 76.39 |
Bulgarian-BTB | 99.93 | 99.93 | 97.00 | 98.72 | 95.55 | 97.23 | 95.02 | 97.25 | 92.98 | 89.52 | 85.88 | 81.94 | 82.47 | 87.41 | 86.67 | (no gapping) | 86.67 | 86.67 |
Czech-FicTree | 99.98 | 99.97 | 97.70 | 98.27 | 91.92 | 95.15 | 90.53 | 98.79 | 96.30 | 94.87 | 93.75 | 84.95 | 91.97 | 92.01 | 90.71 | 88.27 | 89.08 | |
Czech-CAC | 99.99 | 99.99 | 99.76 | 99.55 | 96.69 | 96.98 | 95.79 | 98.27 | 96.02 | 94.67 | 93.72 | 89.34 | 91.52 | 90.53 | 89.07 | 88.27 | 89.08 | |
Czech-PDT | 99.97 | 99.97 | 93.79 | 99.28 | 97.41 | 97.76 | 96.76 | 98.76 | 95.05 | 93.63 | 92.91 | 89.67 | 91.50 | 90.91 | 89.49 | 88.27 | 89.08 | |
Czech-PUD | 99.20 | 99.20 | 96.29 | 97.21 | 93.99 | 93.95 | 92.22 | 96.67 | 91.34 | 87.96 | 85.95 | 79.07 | 84.21 | 86.09 | 83.81 | (no codepend) | 88.27 | 89.08 |
Dutch-Alpino | 99.81 | 99.81 | 90.56 | 97.74 | 96.29 | 97.43 | 95.79 | 96.86 | 94.60 | 92.54 | 89.47 | 85.09 | 85.50 | 90.67 | 89.00 | 87.11 | 87.07 | |
Dutch-LassySmall | 99.97 | 99.97 | 78.98 | 96.60 | 95.35 | 96.35 | 94.54 | 97.40 | 91.93 | 89.38 | 85.02 | 79.97 | 82.26 | 87.21 | 85.22 | 87.11 | 87.07 | |
English-EWT | 99.13 | 98.78 | 87.70 | 95.68 | 95.38 | 95.49 | 93.38 | 96.42 | 89.36 | 87.11 | 84.79 | 79.39 | 82.22 | 85.28 | 84.34 | 83.98 | 84.09 | |
English-GUM | 98.71 | 98.83 | 89.73 | 96.04 | 95.99 | 93.04 | 91.25 | 95.57 | 89.15 | 86.62 | 84.13 | 74.49 | 79.80 | 84.25 | 82.89 | 83.98 | 84.09 | |
English-PUD | 98.69 | 99.09 | 98.95 | 95.57 | 94.77 | 91.62 | 88.09 | 93.66 | 90.27 | 87.80 | 87.22 | 73.53 | 80.21 | 86.06 | 84.70 | 83.98 | 84.09 | |
Estonian-EDT | 99.94 | 99.94 | 92.43 | 97.92 | 98.50 | 96.97 | 95.89 | 85.69 | 91.05 | 88.73 | 87.64 | 83.42 | 69.70 | 87.45 | 85.92 | (no xsubj) | 81.62 | 84.02 |
Estonian-EWT | 98.69 | 98.69 | 83.02 | 95.60 | 96.46 | 95.11 | 93.12 | 87.54 | 86.13 | 83.12 | 81.77 | 76.33 | 68.35 | 78.86 | 77.32 | (no codepend, no xsubj) | 81.62 | 84.02 |
Finnish-TDT | 99.72 | 99.68 | 92.27 | 98.28 | 98.76 | 97.34 | 96.71 | 89.51 | 93.73 | 92.33 | 91.51 | 88.08 | 78.65 | 88.87 | 87.35 | 87.34 | 87.28 | |
Finnish-PUD | 99.42 | 99.42 | 90.22 | 97.99 | 0.00 | 97.33 | 0.00 | 88.70 | 93.79 | 92.21 | 91.09 | 87.91 | 77.56 | 88.84 | 87.33 | (no codepend, no xsubj) | 87.34 | 87.28 |
French-Sequoia | 99.89 | 99.58 | 91.41 | 98.99 | 99.58 | 98.15 | 97.82 | 98.69 | 94.70 | 93.52 | 91.62 | 88.55 | 90.30 | 91.13 | 91.00 | (no gapping, relcl, case) | 88.70 | 87.32 |
French-FQB | 99.48 | 99.31 | 96.44 | 97.13 | 99.31 | 91.51 | 90.33 | 96.88 | 91.17 | 87.53 | 82.79 | 70.51 | 79.46 | 86.70 | 86.40 | (no gapping, relcl, case) | 88.70 | 87.32 |
Italian-ISDT | 99.95 | 99.59 | 98.76 | 98.39 | 98.23 | 97.99 | 97.43 | 98.32 | 94.69 | 93.27 | 90.06 | 87.44 | 88.18 | 91.16 | 90.40 | 90.40 | 90.40 | |
Latvian-LVTB | 99.81 | 99.81 | 98.74 | 97.35 | 90.24 | 94.97 | 89.54 | 96.53 | 92.91 | 90.25 | 88.63 | 81.06 | 84.78 | 86.22 | 84.57 | 84.57 | 84.57 | |
Lithuanian-ALKSNIS | 99.81 | 99.81 | 87.74 | 97.26 | 93.90 | 95.05 | 93.11 | 93.76 | 88.03 | 84.75 | 83.25 | 77.22 | 76.50 | 81.28 | 79.75 | 79.75 | 79.75 | |
Polish-LFG | 99.68 | 99.79 | 99.74 | 98.80 | 93.91 | 90.55 | 86.71 | 98.39 | 95.94 | 94.09 | 93.12 | 80.37 | 91.33 | 92.41 | 83.96 | (no gapping) | 87.02 | 87.65 |
Polish-PDB | 99.36 | 99.63 | 97.92 | 98.66 | 95.02 | 93.72 | 91.40 | 97.92 | 94.45 | 92.49 | 91.30 | 82.92 | 89.09 | 89.63 | 88.55 | 87.02 | 87.65 | |
Polish-PUD | 99.58 | 99.59 | 97.71 | 98.05 | 94.26 | 94.19 | 92.13 | 97.20 | 94.58 | 92.27 | 90.75 | 83.50 | 87.87 | 89.81 | 88.56 | 87.02 | 87.65 | |
Russian-SynTagRus | 99.67 | 99.67 | 99.15 | 98.94 | 99.67 | 98.04 | 97.82 | 98.16 | 95.37 | 94.29 | 93.34 | 91.02 | 91.39 | 91.76 | 90.73 | (no codepend) | 90.73 | 90.73 |
Slovak-SNK | 99.97 | 99.97 | 84.61 | 97.88 | 91.58 | 95.03 | 90.90 | 95.61 | 93.19 | 91.72 | 90.65 | 84.30 | 85.73 | 88.53 | 87.04 | 87.04 | 87.04 | |
Swedish-Talbanken | 99.95 | 99.95 | 98.48 | 98.80 | 97.71 | 97.72 | 96.91 | 97.74 | 93.37 | 91.38 | 90.08 | 85.93 | 87.17 | 88.60 | 86.71 | 83.07 | 83.20 | |
Swedish-PUD | 98.88 | 98.88 | 87.92 | 96.46 | 94.23 | 80.07 | 78.52 | 86.78 | 87.04 | 84.02 | 83.22 | 57.30 | 70.97 | 81.66 | 79.43 | 83.07 | 83.20 | |
Tamil-TTB | 99.92 | 91.28 | 98.76 | 81.06 | 80.51 | 83.39 | 75.50 | 86.42 | 63.62 | 56.28 | 54.17 | 47.67 | 50.62 | 53.47 | 52.25 | (no gapping, xsubj) | 52.25 | 52.27 |
Ukrainian-IU | 99.78 | 99.76 | 96.36 | 98.21 | 95.76 | 95.91 | 94.79 | 97.81 | 92.85 | 90.96 | 88.95 | 83.52 | 86.68 | 87.60 | 86.92 | 86.92 | 86.92 | |
Average | 99.62 | 99.23 | 93.17 | 97.09 | 91.86 | 94.52 | 89.12 | 94.95 | 91.34 | 88.91 | 87.08 | 80.25 | 82.05 | 86.30 | 84.71 | 83.64 |