Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | 99.98 | 94.58 | 82.09 | 88.53 | 84.00 | 84.16 | 81.97 | 88.46 | 72.71 | 67.77 | 63.00 | 54.60 | 58.70 | 64.84 | 45.16 |
Bulgarian | 99.91 | 99.91 | 94.17 | 97.62 | 94.34 | 95.39 | 93.78 | 94.60 | 89.10 | 85.07 | 80.39 | 75.36 | 74.01 | 82.72 | 79.90 |
Czech | 99.88 | 99.88 | 93.18 | 97.83 | 90.88 | 90.77 | 89.71 | 97.42 | 86.65 | 82.70 | 79.66 | 70.96 | 77.45 | 79.11 | 63.62 |
Dutch | 99.74 | 99.74 | 69.26 | 92.60 | 89.88 | 92.01 | 89.00 | 94.41 | 79.25 | 75.17 | 66.03 | 58.69 | 61.31 | 73.27 | 72.65 |
English | 99.22 | 99.22 | 83.87 | 93.63 | 92.77 | 94.09 | 90.70 | 95.41 | 81.33 | 77.93 | 73.54 | 67.37 | 69.91 | 76.93 | 76.16 |
Estonian | 99.70 | 99.70 | 89.98 | 94.99 | 96.23 | 92.80 | 90.97 | 90.37 | 78.12 | 74.13 | 71.92 | 66.36 | 63.23 | 71.68 | 54.34 |
Finnish | |||||||||||||||
French | 99.78 | 99.36 | 95.46 | 93.94 | 99.36 | 76.02 | 73.29 | 96.07 | 81.82 | 75.40 | 69.92 | 40.60 | 66.55 | 74.17 | 63.31 |
Italian | 99.93 | 99.84 | 98.76 | 97.18 | 97.04 | 97.10 | 96.17 | 97.37 | 88.78 | 86.21 | 79.81 | 76.82 | 76.71 | 84.85 | 83.03 |
Latvian | |||||||||||||||
Lithuanian | 99.91 | 99.91 | 87.87 | 90.33 | 80.69 | 81.20 | 79.33 | 88.75 | 68.95 | 60.58 | 56.59 | 45.16 | 49.49 | 57.66 | 44.84 |
Polish | 99.40 | 99.83 | 97.52 | 96.43 | 84.87 | 83.62 | 80.35 | 95.60 | 86.46 | 82.11 | 78.76 | 62.21 | 74.47 | 79.78 | 65.37 |
Russian | 99.60 | 99.60 | 98.80 | 97.78 | 99.60 | 85.34 | 84.97 | 96.55 | 87.62 | 85.01 | 82.66 | 66.09 | 79.39 | 82.46 | 67.80 |
Slovak | 100.00 | 100.00 | 85.28 | 92.93 | 77.06 | 80.34 | 76.71 | 86.56 | 80.95 | 75.97 | 71.87 | 55.66 | 60.25 | 73.26 | 58.05 |
Swedish | 99.18 | 99.18 | 93.54 | 93.34 | 90.95 | 84.87 | 83.15 | 89.98 | 79.28 | 74.96 | 71.13 | 57.26 | 62.86 | 73.44 | 71.53 |
Tamil | 99.16 | 94.51 | 97.52 | 81.31 | 76.35 | 80.45 | 75.59 | 84.14 | 58.94 | 51.96 | 48.70 | 42.32 | 43.42 | 52.02 | 40.25 |
Ukrainian | 99.85 | 99.81 | 96.61 | 94.91 | 84.03 | 84.28 | 83.32 | 93.56 | 79.43 | 74.83 | 69.80 | 57.58 | 64.18 | 71.46 | 56.92 |
Average | 87.96 | 87.36 | 80.23 | 82.55 | 78.71 | 76.61 | 74.65 | 81.72 | 70.55 | 66.46 | 62.58 | 52.77 | 57.76 | 64.57 | 55.47 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | 99.98 | 94.58 | 82.09 | 88.53 | 84.00 | 84.16 | 81.97 | 88.46 | 72.71 | 67.77 | 63.00 | 54.60 | 58.70 | 64.99 | 45.27 | (no xsubj) | 45.27 | 45.16 |
Bulgarian-BTB | 99.91 | 99.91 | 94.17 | 97.62 | 94.34 | 95.39 | 93.78 | 94.60 | 89.10 | 85.07 | 80.39 | 75.36 | 74.01 | 82.72 | 79.90 | 79.90 | 79.90 | |
Czech-FicTree | 99.98 | 99.93 | 89.65 | 95.71 | 73.59 | 76.55 | 69.91 | 96.34 | 85.51 | 79.54 | 74.69 | 47.64 | 71.14 | 75.63 | 64.46 | 62.37 | 63.62 | |
Czech-CAC | 99.97 | 99.96 | 93.10 | 96.98 | 89.05 | 88.63 | 87.59 | 96.27 | 85.56 | 81.41 | 78.21 | 67.81 | 75.25 | 77.11 | 59.50 | 62.37 | 63.62 | |
Czech-PDT | 99.93 | 99.93 | 93.35 | 98.22 | 92.74 | 92.42 | 91.89 | 97.83 | 87.03 | 83.37 | 80.52 | 73.64 | 78.54 | 79.84 | 64.02 | 62.37 | 63.62 | |
Czech-PUD | 99.27 | 99.27 | 95.93 | 96.51 | 90.04 | 89.39 | 88.40 | 95.32 | 84.79 | 79.97 | 76.41 | 66.65 | 73.61 | 76.63 | 61.49 | (no codepend) | 62.37 | 63.62 |
Dutch-Alpino | 99.83 | 99.83 | 88.59 | 94.11 | 91.47 | 93.31 | 90.70 | 95.11 | 82.37 | 78.16 | 69.83 | 62.30 | 65.14 | 76.43 | 75.79 | 72.72 | 72.65 | |
Dutch-LassySmall | 99.65 | 99.65 | 53.62 | 91.16 | 88.37 | 90.77 | 87.37 | 93.74 | 76.27 | 72.31 | 62.53 | 55.36 | 57.76 | 70.26 | 69.66 | 72.72 | 72.65 | |
English-EWT | 98.90 | 98.90 | 77.49 | 93.26 | 92.75 | 94.23 | 91.30 | 95.45 | 80.22 | 77.04 | 72.69 | 67.68 | 69.55 | 76.17 | 75.50 | 76.22 | 76.16 | |
English-PUD | 99.59 | 99.59 | 96.00 | 94.06 | 92.80 | 93.92 | 89.98 | 95.37 | 82.64 | 78.98 | 74.61 | 66.99 | 70.38 | 77.84 | 76.94 | 76.22 | 76.16 | |
Estonian-EDT | 99.96 | 99.96 | 91.56 | 95.61 | 96.76 | 93.41 | 91.75 | 90.58 | 79.55 | 75.78 | 73.66 | 68.30 | 64.66 | 73.91 | 55.85 | (no xsubj) | 52.39 | 54.34 |
Estonian-EWT | 98.48 | 98.48 | 80.46 | 92.03 | 93.72 | 89.88 | 87.21 | 89.34 | 71.31 | 66.26 | 63.49 | 56.91 | 56.27 | 63.36 | 48.93 | (no codepend, no xsubj) | 52.39 | 54.34 |
Finnish-TDT | 0 | |||||||||||||||||
Finnish-PUD | (no codepend, no xsubj) | 0.00 | ||||||||||||||||
French-Sequoia | 99.58 | 98.88 | 75.77 | 94.54 | 98.88 | 77.13 | 75.53 | 96.01 | 81.68 | 77.98 | 74.82 | 44.54 | 72.46 | 76.15 | 73.52 | (no gapping, relcl, case) | 72.27 | 63.31 |
French-FQB | 99.87 | 99.57 | 99.08 | 93.69 | 99.56 | 75.56 | 72.35 | 96.10 | 81.87 | 74.32 | 67.88 | 38.96 | 64.07 | 73.59 | 71.01 | (no gapping, relcl, case) | 72.27 | 63.31 |
Italian-ISDT | 99.93 | 99.84 | 98.76 | 97.18 | 97.04 | 97.10 | 96.17 | 97.37 | 88.78 | 86.21 | 79.81 | 76.82 | 76.71 | 84.85 | 83.03 | 83.03 | 83.03 | |
Latvian-LVTB | 0 | |||||||||||||||||
Lithuanian-ALKSNIS | 99.91 | 99.91 | 87.87 | 90.33 | 80.69 | 81.20 | 79.33 | 88.75 | 68.95 | 60.58 | 56.59 | 45.16 | 49.49 | 57.66 | 44.84 | 44.84 | 44.84 | |
Polish-LFG | 97.66 | 99.87 | 98.25 | 96.35 | 77.84 | 70.08 | 58.92 | 95.77 | 88.78 | 83.06 | 80.73 | 46.24 | 76.27 | 82.34 | 70.27 | (no gapping) | 65.95 | 65.37 |
Polish-PDB | 99.86 | 99.84 | 97.51 | 97.07 | 88.11 | 88.37 | 87.30 | 95.94 | 86.22 | 82.42 | 79.07 | 68.26 | 75.24 | 79.77 | 65.13 | 65.95 | 65.37 | |
Polish-PUD | 99.79 | 99.77 | 96.28 | 95.31 | 83.95 | 84.58 | 82.95 | 94.87 | 85.27 | 80.87 | 76.88 | 62.41 | 71.86 | 78.03 | 62.44 | 65.95 | 65.37 | |
Russian-SynTagRus | 99.60 | 99.60 | 98.80 | 97.78 | 99.60 | 85.34 | 84.97 | 96.55 | 87.62 | 85.01 | 82.66 | 66.09 | 79.39 | 82.46 | 67.80 | 67.80 | 67.80 | |
Slovak-SNK | 100.00 | 100.00 | 85.28 | 92.93 | 77.06 | 80.34 | 76.71 | 86.56 | 80.95 | 75.97 | 71.87 | 55.66 | 60.25 | 73.26 | 58.05 | 58.05 | 58.05 | |
Swedish-Talbanken | 99.89 | 99.89 | 96.13 | 95.59 | 93.90 | 94.46 | 92.87 | 95.38 | 82.49 | 78.56 | 74.98 | 70.00 | 70.37 | 77.00 | 75.11 | 71.38 | 71.53 | |
Swedish-PUD | 98.41 | 98.41 | 90.47 | 90.93 | 87.79 | 74.58 | 72.73 | 84.18 | 75.84 | 71.11 | 66.99 | 43.60 | 54.82 | 69.60 | 67.66 | 71.38 | 71.53 | |
Tamil-TTB | 99.16 | 94.51 | 97.52 | 81.31 | 76.35 | 80.45 | 75.59 | 84.14 | 58.94 | 51.96 | 48.70 | 42.32 | 43.42 | 52.01 | 40.23 | (no gapping, xsubj, relcl) | 40.23 | 40.25 |
Ukrainian-IU | 99.85 | 99.81 | 96.61 | 94.91 | 84.03 | 84.28 | 83.32 | 93.56 | 79.43 | 74.83 | 69.80 | 57.58 | 64.18 | 71.46 | 56.92 | 56.92 | 56.92 | |
Average | 88.89 | 88.57 | 80.51 | 83.99 | 79.44 | 76.98 | 74.66 | 83.34 | 72.28 | 68.16 | 64.31 | 52.89 | 59.77 | 66.18 | 57.62 | 55.84 |