Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | 99.98 | 94.58 | 82.09 | 91.68 | 88.96 | 89.14 | 88.65 | 90.37 | 69.84 | 64.88 | 59.10 | 54.18 | 56.33 | 61.13 | 53.74 |
Bulgarian | 99.91 | 99.91 | 94.17 | 99.15 | 97.19 | 97.95 | 96.84 | 97.97 | 87.85 | 83.39 | 78.08 | 74.62 | 75.91 | 80.65 | 78.73 |
Czech | 99.88 | 99.88 | 93.18 | 98.86 | 95.83 | 96.01 | 94.98 | 98.77 | 83.75 | 79.16 | 74.58 | 69.89 | 73.73 | 76.15 | 72.85 |
Dutch | 99.74 | 99.74 | 69.26 | 96.79 | 95.29 | 96.44 | 94.61 | 97.06 | 79.85 | 74.37 | 65.23 | 60.10 | 63.06 | 70.49 | 68.89 |
English | 98.38 | 99.06 | 88.92 | 95.85 | 95.30 | 94.16 | 91.39 | 96.04 | 82.36 | 77.99 | 73.46 | 64.94 | 70.55 | 74.51 | 73.00 |
Estonian | 99.58 | 99.58 | 85.60 | 96.89 | 97.65 | 95.78 | 94.24 | 94.90 | 71.70 | 64.50 | 59.25 | 54.75 | 56.38 | 63.48 | 60.05 |
Finnish | 99.70 | 99.68 | 88.65 | 97.84 | 56.14 | 96.44 | 54.29 | 92.11 | 69.06 | 62.46 | 55.58 | 51.73 | 51.40 | 63.20 | 57.71 |
French | 99.65 | 99.23 | 94.35 | 97.05 | 99.23 | 91.11 | 90.28 | 97.45 | 84.03 | 77.14 | 67.40 | 57.56 | 65.57 | 74.65 | 73.18 |
Italian | 99.93 | 99.84 | 98.76 | 98.52 | 98.44 | 98.23 | 97.66 | 98.66 | 88.16 | 84.92 | 77.15 | 73.97 | 75.79 | 82.11 | 78.32 |
Latvian | 99.33 | 99.33 | 98.74 | 96.28 | 89.64 | 93.79 | 88.84 | 95.81 | 78.37 | 72.03 | 67.81 | 60.47 | 65.26 | 67.62 | 66.43 |
Lithuanian | 99.91 | 99.91 | 87.87 | 95.97 | 90.37 | 91.07 | 89.41 | 93.61 | 61.39 | 53.55 | 47.68 | 41.70 | 44.66 | 52.52 | 48.27 |
Polish | 99.40 | 99.83 | 97.52 | 98.50 | 93.04 | 90.80 | 87.70 | 97.87 | 84.32 | 78.28 | 73.23 | 63.04 | 71.69 | 74.62 | 71.52 |
Russian | 99.60 | 99.60 | 98.80 | 98.86 | 99.60 | 88.97 | 88.76 | 98.33 | 87.09 | 83.23 | 79.62 | 66.43 | 78.39 | 80.13 | 78.56 |
Slovak | 100.00 | 99.99 | 85.15 | 97.67 | 90.14 | 93.42 | 89.19 | 96.47 | 78.23 | 71.71 | 66.18 | 59.41 | 63.54 | 67.09 | 64.28 |
Swedish | 99.18 | 99.18 | 93.54 | 97.25 | 95.57 | 88.82 | 87.63 | 93.60 | 78.88 | 73.11 | 68.64 | 56.05 | 63.96 | 69.37 | 67.26 |
Tamil | 99.16 | 94.26 | 97.52 | 84.19 | 82.67 | 82.27 | 75.64 | 88.95 | 59.80 | 47.66 | 42.60 | 34.50 | 40.15 | 46.18 | 42.53 |
Ukrainian | 99.85 | 99.81 | 96.61 | 97.89 | 94.22 | 94.18 | 93.13 | 97.39 | 76.26 | 70.79 | 65.07 | 59.24 | 63.42 | 65.41 | 63.42 |
Average | 99.60 | 99.02 | 91.22 | 96.43 | 91.72 | 92.86 | 88.43 | 95.61 | 77.70 | 71.72 | 65.92 | 58.98 | 63.52 | 68.78 | 65.81 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | 99.98 | 94.58 | 82.09 | 91.68 | 88.96 | 89.14 | 88.65 | 90.37 | 69.84 | 64.88 | 59.10 | 54.18 | 56.33 | 61.13 | 53.75 | (no xsubj) | 53.75 | 53.74 |
Bulgarian-BTB | 99.91 | 99.91 | 94.17 | 99.15 | 97.19 | 97.95 | 96.84 | 97.97 | 87.85 | 83.39 | 78.08 | 74.62 | 75.91 | 80.65 | 78.73 | (no gapping) | 78.73 | 78.73 |
Czech-FicTree | 99.98 | 99.93 | 89.65 | 97.49 | 78.68 | 81.39 | 74.93 | 98.86 | 82.56 | 77.10 | 71.03 | 48.05 | 69.93 | 74.20 | 70.92 | 71.62 | 72.85 | |
Czech-CAC | 99.97 | 99.96 | 93.10 | 98.57 | 96.05 | 96.14 | 95.04 | 97.87 | 83.15 | 77.44 | 72.01 | 67.64 | 70.77 | 74.04 | 70.51 | 71.62 | 72.85 | |
Czech-PDT | 99.93 | 99.93 | 93.35 | 99.22 | 97.61 | 97.59 | 97.13 | 99.03 | 84.00 | 79.61 | 75.22 | 72.19 | 74.45 | 76.59 | 73.30 | 71.62 | 72.85 | |
Czech-PUD | 99.27 | 99.27 | 95.93 | 96.92 | 94.50 | 94.36 | 92.92 | 96.77 | 82.88 | 77.84 | 73.01 | 67.49 | 71.72 | 75.12 | 71.74 | (no codepend) | 71.62 | 72.85 |
Dutch-Alpino | 99.83 | 99.83 | 88.59 | 97.41 | 95.98 | 97.02 | 95.36 | 97.32 | 83.51 | 77.88 | 69.76 | 64.33 | 67.33 | 74.93 | 73.16 | 69.03 | 68.89 | |
Dutch-LassySmall | 99.65 | 99.65 | 53.62 | 96.18 | 94.63 | 95.90 | 93.90 | 96.82 | 76.37 | 71.01 | 61.06 | 56.20 | 59.12 | 66.34 | 64.90 | 69.03 | 68.89 | |
English-EWT | 97.26 | 98.95 | 86.60 | 96.13 | 96.06 | 96.56 | 94.65 | 97.46 | 83.44 | 79.46 | 74.80 | 69.92 | 73.48 | 76.16 | 74.85 | 72.47 | 73.00 | |
English-GUM | 98.31 | 98.31 | 85.05 | 94.41 | 93.97 | 87.79 | 84.34 | 93.47 | 77.66 | 72.95 | 68.87 | 53.86 | 64.13 | 68.99 | 67.24 | 72.47 | 73.00 | |
English-PUD | 99.76 | 99.76 | 96.88 | 96.62 | 95.43 | 96.17 | 92.91 | 96.34 | 84.68 | 80.10 | 75.34 | 67.28 | 71.87 | 76.87 | 75.32 | 72.47 | 73.00 | |
Estonian-EDT | 99.96 | 99.96 | 91.56 | 97.65 | 98.25 | 96.44 | 95.19 | 95.34 | 73.61 | 66.36 | 61.14 | 56.76 | 58.15 | 65.77 | 62.26 | (no xsubj) | 57.32 | 60.05 |
Estonian-EWT | 98.18 | 98.18 | 63.81 | 94.11 | 95.43 | 93.34 | 90.75 | 93.28 | 64.68 | 57.64 | 52.04 | 47.06 | 49.61 | 55.52 | 52.38 | (no codepend, no xsubj) | 57.32 | 60.05 |
Finnish-TDT | 99.71 | 99.70 | 88.64 | 97.63 | 98.25 | 95.95 | 95.01 | 92.06 | 70.14 | 63.44 | 56.76 | 52.42 | 52.53 | 63.65 | 58.36 | 57.60 | 57.71 | |
Finnish-PUD | 99.67 | 99.66 | 88.66 | 98.12 | 0.00 | 97.11 | 0.00 | 92.18 | 67.61 | 61.15 | 54.04 | 50.83 | 49.93 | 62.62 | 56.84 | (no codepend, no xsubj) | 57.60 | 57.71 |
French-Sequoia | 99.79 | 99.09 | 87.50 | 98.32 | 99.09 | 96.43 | 95.96 | 98.16 | 85.81 | 82.57 | 77.09 | 72.21 | 76.16 | 79.14 | 78.84 | (no gapping, relcl, case) | 75.27 | 73.18 |
French-FQB | 99.59 | 99.30 | 95.67 | 96.52 | 99.30 | 88.90 | 87.91 | 97.15 | 83.29 | 74.87 | 63.38 | 51.46 | 61.17 | 72.58 | 71.70 | (no gapping, relcl, case) | 75.27 | 73.18 |
Italian-ISDT | 99.93 | 99.84 | 98.76 | 98.52 | 98.44 | 98.23 | 97.66 | 98.66 | 88.16 | 84.92 | 77.15 | 73.97 | 75.79 | 82.11 | 78.32 | 78.32 | 78.32 | |
Latvian-LVTB | 99.33 | 99.33 | 98.74 | 96.28 | 89.64 | 93.79 | 88.84 | 95.81 | 78.37 | 72.03 | 67.81 | 60.47 | 65.26 | 67.62 | 66.43 | 66.43 | 66.43 | |
Lithuanian-ALKSNIS | 99.91 | 99.91 | 87.87 | 95.97 | 90.37 | 91.07 | 89.41 | 93.61 | 61.39 | 53.55 | 47.68 | 41.70 | 44.66 | 52.52 | 48.27 | 48.27 | 48.27 | |
Polish-LFG | 97.66 | 99.87 | 98.25 | 98.08 | 84.26 | 73.54 | 61.86 | 98.25 | 87.09 | 79.76 | 76.21 | 46.47 | 74.85 | 77.84 | 68.95 | (no gapping) | 70.92 | 71.52 |
Polish-PDB | 99.86 | 99.84 | 97.51 | 98.88 | 95.73 | 95.51 | 94.73 | 98.05 | 83.65 | 78.38 | 73.13 | 68.19 | 71.78 | 74.27 | 72.67 | 70.92 | 71.52 | |
Polish-PUD | 99.79 | 99.77 | 96.28 | 98.08 | 94.38 | 94.51 | 93.27 | 97.26 | 83.57 | 77.04 | 71.34 | 65.32 | 69.36 | 73.10 | 71.15 | 70.92 | 71.52 | |
Russian-SynTagRus | 99.60 | 99.60 | 98.80 | 98.86 | 99.60 | 88.97 | 88.76 | 98.33 | 87.09 | 83.23 | 79.62 | 66.43 | 78.39 | 80.13 | 78.56 | (no codepend) | 78.56 | 78.56 |
Slovak-SNK | 100.00 | 99.99 | 85.15 | 97.67 | 90.14 | 93.42 | 89.19 | 96.47 | 78.23 | 71.71 | 66.18 | 59.41 | 63.54 | 67.09 | 64.28 | 64.28 | 64.28 | |
Swedish-Talbanken | 99.89 | 99.89 | 96.13 | 98.41 | 97.26 | 97.33 | 96.46 | 98.19 | 82.32 | 76.84 | 72.53 | 67.51 | 70.95 | 73.27 | 71.14 | 67.14 | 67.26 | |
Swedish-PUD | 98.41 | 98.41 | 90.47 | 96.00 | 93.74 | 79.70 | 78.15 | 88.68 | 75.20 | 69.11 | 64.48 | 43.79 | 56.48 | 65.22 | 63.13 | 67.14 | 67.26 | |
Tamil-TTB | 99.16 | 94.26 | 97.52 | 84.19 | 82.67 | 82.27 | 75.64 | 88.95 | 59.80 | 47.66 | 42.60 | 34.50 | 40.15 | 46.13 | 42.47 | (no gapping, xsubj) | 42.47 | 42.53 |
Ukrainian-IU | 99.85 | 99.81 | 96.61 | 97.89 | 94.22 | 94.18 | 93.13 | 97.39 | 76.26 | 70.79 | 65.07 | 59.24 | 63.42 | 65.41 | 63.42 | 63.42 | 63.42 | |
Average | 99.45 | 99.19 | 90.24 | 96.72 | 90.68 | 92.44 | 86.85 | 95.87 | 78.70 | 72.85 | 67.12 | 59.09 | 64.73 | 69.97 | 67.02 | 65.62 |