Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | 99.98 | 94.58 | 81.10 | 88.87 | 82.42 | 82.60 | 82.23 | 87.30 | 71.98 | 66.37 | 61.07 | 53.65 | 57.64 | 72.59 | 71.01 |
Bulgarian | 99.92 | 99.92 | 97.26 | 98.89 | 96.37 | 97.57 | 95.88 | 97.30 | 93.25 | 90.19 | 86.78 | 83.29 | 83.72 | 93.08 | 92.44 |
Czech | 99.91 | 99.90 | 94.53 | 98.14 | 93.52 | 92.95 | 91.51 | 98.17 | 91.66 | 89.21 | 87.34 | 78.98 | 85.66 | 91.00 | 89.93 |
Dutch | 99.85 | 99.85 | 72.78 | 95.03 | 93.14 | 94.74 | 92.28 | 96.01 | 86.33 | 83.11 | 76.47 | 70.47 | 72.68 | 82.30 | 81.89 |
English | 98.36 | 98.98 | 90.27 | 94.96 | 94.42 | 93.53 | 90.54 | 95.66 | 86.45 | 83.64 | 80.94 | 72.53 | 77.53 | 86.22 | 85.70 |
Estonian | 99.65 | 99.65 | 87.88 | 96.46 | 97.49 | 95.30 | 93.71 | 95.58 | 85.31 | 82.35 | 80.97 | 75.71 | 76.96 | 84.82 | 84.35 |
Finnish | 99.60 | 99.57 | 91.67 | 97.08 | 55.75 | 95.74 | 53.92 | 94.60 | 89.29 | 87.03 | 85.39 | 80.84 | 80.43 | 89.66 | 89.02 |
French | 99.82 | 99.61 | 96.77 | 96.05 | 99.61 | 92.09 | 90.68 | 96.98 | 90.30 | 85.21 | 78.95 | 69.25 | 76.02 | 87.37 | 86.68 |
Italian | 99.96 | 99.90 | 99.07 | 97.93 | 97.84 | 97.79 | 97.08 | 98.11 | 93.01 | 91.12 | 86.75 | 83.71 | 84.49 | 92.94 | 92.41 |
Latvian | 99.84 | 99.84 | 98.91 | 95.95 | 88.25 | 93.59 | 87.69 | 95.34 | 88.47 | 85.10 | 82.78 | 74.56 | 78.81 | 87.45 | 86.96 |
Lithuanian | 99.92 | 99.92 | 88.94 | 93.47 | 85.82 | 87.74 | 85.00 | 92.71 | 78.36 | 73.25 | 70.64 | 60.28 | 65.64 | 79.79 | 78.04 |
Polish | 99.41 | 99.83 | 98.37 | 97.88 | 91.36 | 89.28 | 86.00 | 96.94 | 92.64 | 89.82 | 87.94 | 74.67 | 84.66 | 91.50 | 89.17 |
Russian | 99.55 | 99.55 | 98.94 | 98.19 | 99.55 | 87.67 | 87.34 | 97.39 | 92.61 | 90.97 | 89.39 | 73.49 | 86.98 | 93.14 | 92.83 |
Slovak | 99.96 | 99.95 | 84.93 | 96.55 | 88.46 | 91.15 | 87.62 | 94.72 | 89.27 | 86.60 | 84.70 | 75.09 | 79.56 | 90.87 | 89.59 |
Swedish | 99.44 | 99.44 | 94.87 | 96.12 | 94.33 | 87.92 | 86.49 | 92.47 | 85.83 | 82.30 | 79.95 | 65.82 | 73.11 | 86.02 | 85.20 |
Tamil | 99.75 | 92.18 | 98.76 | 80.16 | 79.61 | 80.11 | 73.04 | 85.66 | 62.70 | 54.72 | 51.72 | 42.17 | 47.77 | 40.65 | 39.32 |
Ukrainian | 99.74 | 99.72 | 96.98 | 96.71 | 92.30 | 92.24 | 91.12 | 96.40 | 87.24 | 84.05 | 80.68 | 73.21 | 77.40 | 86.64 | 86.09 |
Average | 99.69 | 98.96 | 92.47 | 95.20 | 90.01 | 91.29 | 86.60 | 94.78 | 86.16 | 82.65 | 79.56 | 71.04 | 75.83 | 84.47 | 83.57 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | 99.98 | 94.58 | 81.10 | 88.87 | 82.42 | 82.60 | 82.23 | 87.30 | 71.98 | 66.37 | 61.07 | 53.65 | 57.64 | 72.59 | 71.01 | (no xsubj) | 71.01 | 71.01 |
Bulgarian-BTB | 99.92 | 99.92 | 97.26 | 98.89 | 96.37 | 97.57 | 95.88 | 97.30 | 93.25 | 90.19 | 86.78 | 83.29 | 83.72 | 93.08 | 92.44 | (no gapping) | 92.44 | 92.44 |
Czech-FicTree | 99.98 | 99.93 | 92.33 | 96.28 | 76.03 | 78.78 | 72.00 | 97.53 | 90.57 | 87.50 | 85.31 | 55.53 | 82.77 | 90.48 | 89.14 | 88.20 | 89.93 | |
Czech-CAC | 99.96 | 99.95 | 98.08 | 97.50 | 92.76 | 92.01 | 90.56 | 96.84 | 91.42 | 88.40 | 86.10 | 78.08 | 83.82 | 89.32 | 88.06 | 88.20 | 89.93 | |
Czech-PDT | 99.98 | 99.98 | 94.44 | 98.55 | 95.35 | 94.52 | 93.60 | 98.54 | 92.04 | 89.87 | 88.12 | 81.62 | 86.60 | 91.62 | 90.66 | 88.20 | 89.93 | |
Czech-PUD | 99.15 | 99.15 | 95.94 | 96.34 | 92.56 | 91.53 | 90.07 | 96.06 | 89.26 | 85.05 | 82.37 | 73.94 | 80.23 | 86.69 | 84.93 | (no codepend) | 88.20 | 89.93 |
Dutch-Alpino | 99.96 | 99.96 | 90.62 | 96.04 | 94.43 | 95.94 | 93.66 | 96.74 | 90.18 | 87.21 | 82.06 | 76.04 | 78.23 | 90.33 | 89.82 | 82.44 | 81.89 | |
Dutch-LassySmall | 99.74 | 99.74 | 58.41 | 94.06 | 91.90 | 93.60 | 90.96 | 95.31 | 82.64 | 79.19 | 71.30 | 65.33 | 67.54 | 75.40 | 75.06 | 82.44 | 81.89 | |
English-EWT | 99.13 | 98.91 | 88.31 | 95.42 | 95.22 | 96.00 | 93.96 | 97.10 | 87.41 | 84.84 | 81.63 | 77.24 | 79.89 | 87.69 | 87.34 | 85.16 | 85.70 | |
English-GUM | 96.73 | 98.15 | 84.58 | 93.65 | 92.92 | 87.21 | 83.72 | 93.26 | 82.10 | 78.93 | 77.01 | 61.00 | 71.80 | 80.60 | 79.85 | 85.16 | 85.70 | |
English-PUD | 98.68 | 99.69 | 99.10 | 95.42 | 94.62 | 95.44 | 91.68 | 95.79 | 88.63 | 85.81 | 83.13 | 75.56 | 78.99 | 88.82 | 88.29 | 85.16 | 85.70 | |
Estonian-EDT | 99.97 | 99.97 | 93.54 | 97.23 | 98.06 | 95.84 | 94.52 | 96.07 | 87.25 | 84.44 | 82.98 | 77.82 | 78.89 | 87.69 | 87.30 | (no xsubj) | 80.67 | 84.35 |
Estonian-EWT | 98.49 | 98.49 | 67.68 | 93.64 | 95.42 | 93.32 | 90.74 | 93.79 | 78.19 | 74.70 | 73.31 | 67.68 | 69.59 | 74.74 | 74.04 | (no codepend, no xsubj) | 80.67 | 84.35 |
Finnish-TDT | 99.72 | 99.69 | 92.41 | 96.85 | 97.56 | 95.20 | 94.35 | 94.84 | 88.87 | 86.50 | 84.96 | 79.86 | 80.35 | 90.34 | 89.83 | 88.96 | 89.02 | |
Finnish-PUD | 99.42 | 99.42 | 90.57 | 97.40 | 0.00 | 96.47 | 0.00 | 94.28 | 89.86 | 87.73 | 85.96 | 82.12 | 80.53 | 88.92 | 88.09 | (no codepend, no xsubj) | 88.96 | 89.02 |
French-Sequoia | 99.89 | 99.58 | 91.23 | 98.29 | 99.58 | 96.97 | 96.39 | 98.31 | 91.19 | 89.02 | 85.33 | 81.68 | 83.92 | 89.33 | 89.18 | (no gapping, relcl, case) | 87.58 | 86.68 |
French-FQB | 99.79 | 99.63 | 97.85 | 95.12 | 99.63 | 90.06 | 88.30 | 96.43 | 89.92 | 83.62 | 76.31 | 64.09 | 72.74 | 86.39 | 85.97 | (no gapping, relcl, case) | 87.58 | 86.68 |
Italian-ISDT | 99.96 | 99.90 | 99.07 | 97.93 | 97.84 | 97.79 | 97.08 | 98.11 | 93.01 | 91.12 | 86.75 | 83.71 | 84.49 | 92.94 | 92.41 | 92.41 | 92.41 | |
Latvian-LVTB | 99.84 | 99.84 | 98.91 | 95.95 | 88.25 | 93.59 | 87.69 | 95.34 | 88.47 | 85.10 | 82.78 | 74.56 | 78.81 | 87.45 | 86.96 | 86.96 | 86.96 | |
Lithuanian-ALKSNIS | 99.92 | 99.92 | 88.94 | 93.47 | 85.82 | 87.74 | 85.00 | 92.71 | 78.36 | 73.25 | 70.64 | 60.28 | 65.64 | 79.79 | 78.04 | 78.04 | 78.04 | |
Polish-LFG | 97.66 | 99.87 | 98.60 | 97.75 | 83.34 | 73.04 | 61.60 | 97.40 | 91.66 | 86.94 | 85.80 | 51.75 | 83.23 | 87.37 | 77.34 | (no gapping) | 87.07 | 89.17 |
Polish-PDB | 99.87 | 99.83 | 98.32 | 98.17 | 94.01 | 93.89 | 92.82 | 97.22 | 92.75 | 90.58 | 88.68 | 81.14 | 85.62 | 92.62 | 92.24 | 87.07 | 89.17 | |
Polish-PUD | 99.83 | 99.79 | 98.06 | 97.46 | 92.24 | 92.42 | 90.92 | 96.11 | 93.12 | 90.49 | 88.11 | 78.92 | 83.93 | 92.25 | 91.63 | 87.07 | 89.17 | |
Russian-SynTagRus | 99.55 | 99.55 | 98.94 | 98.19 | 99.55 | 87.67 | 87.34 | 97.39 | 92.61 | 90.97 | 89.39 | 73.49 | 86.98 | 93.14 | 92.83 | (no codepend) | 92.83 | 92.83 |
Slovak-SNK | 99.96 | 99.95 | 84.93 | 96.55 | 88.46 | 91.15 | 87.62 | 94.72 | 89.27 | 86.60 | 84.70 | 75.09 | 79.56 | 90.87 | 89.59 | 89.59 | 89.59 | |
Swedish-Talbanken | 99.95 | 99.95 | 98.11 | 97.75 | 96.55 | 96.73 | 95.63 | 97.71 | 89.20 | 86.13 | 83.80 | 79.22 | 81.23 | 89.45 | 88.74 | 85.07 | 85.20 | |
Swedish-PUD | 98.89 | 98.89 | 91.02 | 94.37 | 91.95 | 78.49 | 76.71 | 86.86 | 82.23 | 78.21 | 75.83 | 51.52 | 64.45 | 82.33 | 81.40 | 85.07 | 85.20 | |
Tamil-TTB | 99.75 | 92.18 | 98.76 | 80.16 | 79.61 | 80.11 | 73.04 | 85.66 | 62.70 | 54.72 | 51.72 | 42.17 | 47.77 | 40.59 | 39.26 | (no gapping, xsubj) | 39.26 | 39.32 |
Ukrainian-IU | 99.74 | 99.72 | 96.98 | 96.71 | 92.30 | 92.24 | 91.12 | 96.40 | 87.24 | 84.05 | 80.68 | 73.21 | 77.40 | 86.64 | 86.09 | 86.09 | 86.09 | |
Average | 99.50 | 99.18 | 91.87 | 95.66 | 89.13 | 90.96 | 85.14 | 95.21 | 87.08 | 83.71 | 80.78 | 71.02 | 77.12 | 85.50 | 84.40 | 83.16 |