All treebanks
1. UDPipe Future (Praha) software1-P 61.25 2. TurkuNLP (Turku) software1-P 60.99 3. Stanford (Stanford) software2 60.92 4. ICS PAS (Warszawa) software1-P 60.25 5. CEA LIST (Paris) software1-P 59.92 6. HIT-SCIR (Harbin) software1-P 59.78 7. Uppsala (Uppsala) software1-P 59.20 8. NLP-Cube (București) software1-P 57.32 9. LATTICE (Paris) software1-P 57.01 10. AntNLP (Shanghai) software1-P 55.92 11. ParisNLP (Paris) software1-P 55.74 12. SLT-Interactions (Bengaluru) software2-P 54.52 13. LeisureX (Shanghai) software1-P 53.70 14. UniMelb (Melbourne) software1-P 53.62 15. KParse (İstanbul) software1-P 53.25 16. Fudan (Shanghai) software5-P 52.69 17. BASELINE UDPipe 1.2 (Praha) software1-P 52.42 18. Phoenix (Shanghai) software1-P 52.26 19. BOUN (İstanbul) software2-P 50.40 20. CUNI x-ling (Praha) software1-P 50.35 21. ONLP lab (Ra'anana) software3-P 46.09 22. iParse (Pittsburgh) software1-P 45.65 23. HUJI (Yerushalayim) software1-P 44.60 24. IBM NY (Yorktown Heights) software1-P 40.61 25. ArmParser (Yerevan) software1-P 36.28 26. SParse (İstanbul) software1-P 1.68
Big treebanks only
Macro-average MLAS-F1 of the 61 big treebanks: af_afribooms, grc_perseus, grc_proiel, ar_padt, eu_bdt, bg_btb, ca_ancora, hr_set, cs_cac, cs_fictree, cs_pdt, da_ddt, nl_alpino, nl_lassysmall, en_ewt, en_gum, en_lines, et_edt, fi_ftb, fi_tdt, fr_gsd, fr_sequoia, fr_spoken, gl_ctg, de_gsd, got_proiel, el_gdt, he_htb, hi_hdtb, hu_szeged, zh_gsd, id_gsd, it_isdt, it_postwita, ja_gsd, ko_gsd, ko_kaist, la_ittb, la_proiel, lv_lvtb, no_bokmaal, no_nynorsk, fro_srcmf, cu_proiel, fa_seraji, pl_lfg, pl_sz, pt_bosque, ro_rrt, ru_syntagrus, sr_set, sk_snk, sl_ssj, es_ancora, sv_lines, sv_talbanken, tr_imst, uk_iu, ur_udtb, ug_udt, vi_vtb. These are the treebanks that have development data available, hence these results should be comparable to the performance of the systems on the development data.
1. Stanford (Stanford) software2 72.67 2. UDPipe Future (Praha) software1-P 71.71 3. TurkuNLP (Turku) software1-P 71.27 4. CEA LIST (Paris) software1-P 70.89 5. ICS PAS (Warszawa) software1-P 70.30 6. HIT-SCIR (Harbin) software1-P 70.12 7. Uppsala (Uppsala) software1-P 68.81 8. NLP-Cube (București) software1-P 67.79 9. LATTICE (Paris) software1-P 66.27 10. ParisNLP (Paris) software1-P 65.88 11. AntNLP (Shanghai) software1-P 65.43 12. SLT-Interactions (Bengaluru) software2-P 64.95 13. LeisureX (Shanghai) software1-P 63.79 14. UniMelb (Melbourne) software1-P 63.17 15. KParse (İstanbul) software1-P 62.40 16. Fudan (Shanghai) software5-P 62.28 17. BASELINE UDPipe 1.2 (Praha) software1-P 61.27 18. Phoenix (Shanghai) software1-P 61.12 19. BOUN (İstanbul) software2-P 60.00 20. CUNI x-ling (Praha) software1-P 58.33 21. iParse (Pittsburgh) software1-P 55.37 22. ONLP lab (Ra'anana) software3-P 55.20 23. HUJI (Yerushalayim) software1-P 53.20 24. IBM NY (Yorktown Heights) software1-P 47.34 25. ArmParser (Yerevan) software1-P 45.87 26. SParse (İstanbul) software1-P 2.26
PUD treebanks only
Macro-average MLAS-F1 of the 5 PUD treebanks (additional parallel test sets): cs_pud, en_pud, fi_pud, ja_modern, sv_pud. These are languages for which there exists at least one big training treebank. However, these test sets have been produced separately and their domain may differ.
1. Stanford (Stanford) software2 58.75
2. ICS PAS (Warszawa) software1-P 58.07
3. UDPipe Future (Praha) software1-P 57.93
4. Uppsala (Uppsala) software1-P 57.80
5. TurkuNLP (Turku) software1-P 57.54
6. LATTICE (Paris) software1-P 55.60
7. HIT-SCIR (Harbin) software1-P 55.52
8. NLP-Cube (București) software1-P 55.01
9. CEA LIST (Paris) software1-P 54.99
10. AntNLP (Shanghai) software1-P 53.47
11. Phoenix (Shanghai) software1-P 52.26
12. UniMelb (Melbourne) software1-P 52.05
13. BASELINE UDPipe 1.2 (Praha) software1-P 51.75
14. KParse (İstanbul) software1-P 51.29
15. CUNI x-ling (Praha) software1-P 49.71
16. ParisNLP (Paris) software1-P 48.79
17. SLT-Interactions (Bengaluru) software2-P 48.47
18. IBM NY (Yorktown Heights) software1-P 46.59
19. HUJI (Yerushalayim) software1-P 46.52
20. Fudan (Shanghai) software5-P 45.54
21. LeisureX (Shanghai) software1-P 41.95
22. BOUN (İstanbul) software2-P 41.91
23. iParse (Pittsburgh) software1-P 33.43
24. ONLP lab (Ra'anana) software3-P 30.20
25. ArmParser (Yerevan) software1-P 0.00
SParse (İstanbul) software1-P 0.00
Small treebanks only
Macro-average MLAS-F1 of the 7 small treebanks: gl_treegal, ga_idt, la_perseus, sme_giella, no_nynorsklia, ru_taiga, sl_sst. These treebanks lack development data but still have some reasonable training data.
1. ICS PAS (Warszawa) software1-P 49.24
2. TurkuNLP (Turku) software1-P 47.63
3. UDPipe Future (Praha) software1-P 47.53
4. Uppsala (Uppsala) software1-P 46.00
5. HIT-SCIR (Harbin) software1-P 45.94
6. LATTICE (Paris) software1-P 45.03
7. AntNLP (Shanghai) software1-P 42.24
8. ParisNLP (Paris) software1-P 40.71
9. CEA LIST (Paris) software1-P 39.97
10. KParse (İstanbul) software1-P 39.20
11. BASELINE UDPipe 1.2 (Praha) software1-P 38.80
LeisureX (Shanghai) software1-P 38.80
13. Phoenix (Shanghai) software1-P 38.38
14. Fudan (Shanghai) software5-P 38.15
15. CUNI x-ling (Praha) software1-P 38.10
16. NLP-Cube (București) software1-P 37.13
17. UniMelb (Melbourne) software1-P 36.09
18. SLT-Interactions (Bengaluru) software2-P 35.73
19. Stanford (Stanford) software2 34.86
20. BOUN (İstanbul) software2-P 34.29
21. ONLP lab (Ra'anana) software3-P 32.74
22. iParse (Pittsburgh) software1-P 28.03
23. IBM NY (Yorktown Heights) software1-P 26.51
24. HUJI (Yerushalayim) software1-P 24.47
25. ArmParser (Yerevan) software1-P 22.94
26. SParse (İstanbul) software1-P 0.00
Low-resource languages only
Macro-average MLAS-F1 of the 9 low-resource language treebanks: bxr_bdt, hsb_ufal, hy_armtdp, kk_ktb, kmr_mg, br_keb, fo_oft, pcm_nsc, th_pud. These languages have tiny sample data, or no training data at all.
1. CUNI x-ling (Praha) software1-P 6.13
2. Uppsala (Uppsala) software1-P 5.16
3. LATTICE (Paris) software1-P 4.38
4. CEA LIST (Paris) software1-P 3.75
5. TurkuNLP (Turku) software1-P 3.59
6. ONLP lab (Ra'anana) software3-P 3.58
7. BASELINE UDPipe 1.2 (Praha) software1-P 3.44
UniMelb (Melbourne) software1-P 3.44
9. AntNLP (Shanghai) software1-P 3.43
LeisureX (Shanghai) software1-P 3.43
11. NLP-Cube (București) software1-P 3.39
12. KParse (İstanbul) software1-P 3.32
13. Phoenix (Shanghai) software1-P 3.02
14. Fudan (Shanghai) software5-P 2.98
15. HIT-SCIR (Harbin) software1-P 2.88
16. UDPipe Future (Praha) software1-P 2.82
17. Stanford (Stanford) software2 2.76
18. IBM NY (Yorktown Heights) software1-P 2.62
19. BOUN (İstanbul) software2-P 2.59
20. ParisNLP (Paris) software1-P 2.53
21. ICS PAS (Warszawa) software1-P 1.89
22. ArmParser (Yerevan) software1-P 1.86
23. SLT-Interactions (Bengaluru) software2-P 1.79
24. HUJI (Yerushalayim) software1-P 0.92
25. iParse (Pittsburgh) software1-P 0.23
26. SParse (İstanbul) software1-P 0.00
Old treebanks only
Macro-average MLAS-F1 of the 61 old treebanks: grc_perseus, grc_proiel, ar_padt, eu_bdt, bg_btb, ca_ancora, hr_set, cs_cac, cs_pdt, da_ddt, nl_alpino, nl_lassysmall, en_ewt, en_lines, et_edt, fi_ftb, fi_tdt, fr_gsd, fr_sequoia, gl_ctg, de_gsd, got_proiel, el_gdt, he_htb, hi_hdtb, hu_szeged, zh_gsd, id_gsd, it_isdt, ja_gsd, ko_gsd, la_ittb, la_proiel, lv_lvtb, no_bokmaal, no_nynorsk, cu_proiel, fa_seraji, pl_sz, pt_bosque, ro_rrt, ru_syntagrus, sk_snk, sl_ssj, es_ancora, sv_lines, sv_talbanken, tr_imst, uk_iu, ur_udtb, ug_udt, vi_vtb, gl_treegal, ga_idt, la_perseus, sl_sst, cs_pud, en_pud, fi_pud, sv_pud, kk_ktb. These treebanks were used in both tasks (2017 and 2018) and were not surprise languages in 2017.
1. UDPipe Future (Praha) software1-P 68.48 2. Stanford (Stanford) software2 68.36 3. TurkuNLP (Turku) software1-P 68.10 4. ICS PAS (Warszawa) software1-P 67.11 5. CEA LIST (Paris) software1-P 66.95 6. HIT-SCIR (Harbin) software1-P 66.67 7. Uppsala (Uppsala) software1-P 65.74 8. NLP-Cube (București) software1-P 64.37 9. LATTICE (Paris) software1-P 63.10 10. ParisNLP (Paris) software1-P 62.32 11. AntNLP (Shanghai) software1-P 62.26 12. SLT-Interactions (Bengaluru) software2-P 61.69 13. UniMelb (Melbourne) software1-P 59.93 14. LeisureX (Shanghai) software1-P 59.74 15. KParse (İstanbul) software1-P 59.35 16. Fudan (Shanghai) software5-P 58.57 17. BASELINE UDPipe 1.2 (Praha) software1-P 58.47 18. Phoenix (Shanghai) software1-P 58.32 19. BOUN (İstanbul) software2-P 56.33 20. CUNI x-ling (Praha) software1-P 55.68 21. ONLP lab (Ra'anana) software3-P 51.12 22. HUJI (Yerushalayim) software1-P 50.99 23. iParse (Pittsburgh) software1-P 50.28 24. IBM NY (Yorktown Heights) software1-P 44.48 25. ArmParser (Yerevan) software1-P 40.25 26. SParse (İstanbul) software1-P 2.26
Per treebank MLAS-F1
af_afribooms
1. UDPipe Future (Praha) software1-P 75.67
2. Stanford (Stanford) software2 75.66
3. TurkuNLP (Turku) software1-P 74.68
4. CEA LIST (Paris) software1-P 73.15
5. ICS PAS (Warszawa) software1-P 72.91
6. HIT-SCIR (Harbin) software1-P 71.61
7. NLP-Cube (București) software1-P 71.47
8. ParisNLP (Paris) software1-P 69.59
9. AntNLP (Shanghai) software1-P 69.35
10. LATTICE (Paris) software1-P 69.08
11. SLT-Interactions (Bengaluru) software2-P 68.66
12. LeisureX (Shanghai) software1-P 66.96
13. iParse (Pittsburgh) software1-P 66.56
14. Uppsala (Uppsala) software1-P 66.35
15. KParse (İstanbul) software1-P 65.12
16. BASELINE UDPipe 1.2 (Praha) software1-P 64.48
Fudan (Shanghai) software5-P 64.48
18. Phoenix (Shanghai) software1-P 63.81
19. CUNI x-ling (Praha) software1-P 63.14
20. UniMelb (Melbourne) software1-P 62.95
21. IBM NY (Yorktown Heights) software1-P 61.60
22. ONLP lab (Ra'anana) software3-P 60.73
23. BOUN (İstanbul) software2-P 58.08
24. HUJI (Yerushalayim) software1-P 57.09
25. ArmParser (Yerevan) software1-P 44.69
26. SParse (İstanbul) software1-P 0.00
ar_padt
1. Stanford (Stanford) software2 68.54 2. UDPipe Future (Praha) software1-P 63.77 3. TurkuNLP (Turku) software1-P 63.48 4. ICS PAS (Warszawa) software1-P 62.75 5. CEA LIST (Paris) software1-P 62.17 6. Uppsala (Uppsala) software1-P 61.04 7. HIT-SCIR (Harbin) software1-P 59.73 8. ParisNLP (Paris) software1-P 58.95 9. NLP-Cube (București) software1-P 58.13 10. AntNLP (Shanghai) software1-P 58.10 11. KParse (İstanbul) software1-P 58.05 12. SLT-Interactions (Bengaluru) software2-P 58.00 13. iParse (Pittsburgh) software1-P 57.66 14. LeisureX (Shanghai) software1-P 57.21 15. UniMelb (Melbourne) software1-P 57.19 16. LATTICE (Paris) software1-P 56.95 17. Fudan (Shanghai) software5-P 55.78 18. BOUN (İstanbul) software2-P 55.68 19. Phoenix (Shanghai) software1-P 55.02 20. BASELINE UDPipe 1.2 (Praha) software1-P 55.01 21. ONLP lab (Ra'anana) software3-P 53.54 22. IBM NY (Yorktown Heights) software1-P 51.42 23. CUNI x-ling (Praha) software1-P 48.98 24. ArmParser (Yerevan) software1-P 48.04 25. HUJI (Yerushalayim) software1-P 0.00 26. SParse (İstanbul) software1-P 0.00
bg_btb
1. UDPipe Future (Praha) software1-P 83.12 2. Stanford (Stanford) software2 82.89 3. CEA LIST (Paris) software1-P 82.55 4. TurkuNLP (Turku) software1-P 82.37 5. HIT-SCIR (Harbin) software1-P 81.79 6. Uppsala (Uppsala) software1-P 81.20 7. ICS PAS (Warszawa) software1-P 81.10 8. NLP-Cube (București) software1-P 79.67 9. ParisNLP (Paris) software1-P 79.07 10. SLT-Interactions (Bengaluru) software2-P 78.63 11. iParse (Pittsburgh) software1-P 77.65 12. LeisureX (Shanghai) software1-P 77.56 13. AntNLP (Shanghai) software1-P 77.45 14. LATTICE (Paris) software1-P 77.04 15. UniMelb (Melbourne) software1-P 76.27 16. KParse (İstanbul) software1-P 75.58 17. Fudan (Shanghai) software5-P 75.42 18. BASELINE UDPipe 1.2 (Praha) software1-P 75.30 19. Phoenix (Shanghai) software1-P 75.28 20. HUJI (Yerushalayim) software1-P 74.52 21. BOUN (İstanbul) software2-P 72.76 22. CUNI x-ling (Praha) software1-P 71.72 23. ONLP lab (Ra'anana) software3-P 69.16 24. ArmParser (Yerevan) software1-P 60.85 25. IBM NY (Yorktown Heights) software1-P 53.66 26. SParse (İstanbul) software1-P 0.00
br_keb
1. Uppsala (Uppsala) software1-P 13.91
2. TurkuNLP (Turku) software1-P 11.47
3. CEA LIST (Paris) software1-P 4.15
4. CUNI x-ling (Praha) software1-P 3.00
5. UDPipe Future (Praha) software1-P 1.24
6. LATTICE (Paris) software1-P 0.70
7. Phoenix (Shanghai) software1-P 0.50
8. BOUN (İstanbul) software2-P 0.43
9. ONLP lab (Ra'anana) software3-P 0.42
10. AntNLP (Shanghai) software1-P 0.37
BASELINE UDPipe 1.2 (Praha) software1-P 0.37
Fudan (Shanghai) software5-P 0.37
LeisureX (Shanghai) software1-P 0.37
UniMelb (Melbourne) software1-P 0.37
15. KParse (İstanbul) software1-P 0.35
16. NLP-Cube (București) software1-P 0.34
ParisNLP (Paris) software1-P 0.34
18. iParse (Pittsburgh) software1-P 0.26
19. SLT-Interactions (Bengaluru) software2-P 0.17
20. HUJI (Yerushalayim) software1-P 0.15
21. IBM NY (Yorktown Heights) software1-P 0.08
22. ICS PAS (Warszawa) software1-P 0.05
Stanford (Stanford) software2 0.05
24. HIT-SCIR (Harbin) software1-P 0.02
25. ArmParser (Yerevan) software1-P 0.00
26. SParse (İstanbul) software1-P 0.00
bxr_bdt
1. AntNLP (Shanghai) software1-P 2.98
2. CUNI x-ling (Praha) software1-P 2.53
3. LATTICE (Paris) software1-P 2.18
4. BASELINE UDPipe 1.2 (Praha) software1-P 2.09
CEA LIST (Paris) software1-P 2.09
LeisureX (Shanghai) software1-P 2.09
UDPipe Future (Praha) software1-P 2.09
UniMelb (Melbourne) software1-P 2.09
9. Fudan (Shanghai) software5-P 1.97
10. ParisNLP (Paris) software1-P 1.78
11. ONLP lab (Ra'anana) software3-P 1.65
12. Phoenix (Shanghai) software1-P 1.44
13. Uppsala (Uppsala) software1-P 1.26
14. Stanford (Stanford) software2 1.12
15. IBM NY (Yorktown Heights) software1-P 1.10
16. ICS PAS (Warszawa) software1-P 1.09
17. BOUN (İstanbul) software2-P 1.01
18. TurkuNLP (Turku) software1-P 0.96
19. SLT-Interactions (Bengaluru) software2-P 0.86
20. HIT-SCIR (Harbin) software1-P 0.78
21. HUJI (Yerushalayim) software1-P 0.69
22. KParse (İstanbul) software1-P 0.49
23. iParse (Pittsburgh) software1-P 0.24
24. NLP-Cube (București) software1-P 0.06
25. ArmParser (Yerevan) software1-P 0.00
26. SParse (İstanbul) software1-P 0.00
ca_ancora
1. UDPipe Future (Praha) software1-P 84.07 2. HIT-SCIR (Harbin) software1-P 83.72 3. Stanford (Stanford) software2 83.67 4. ICS PAS (Warszawa) software1-P 83.11 5. NLP-Cube (București) software1-P 82.54 6. CEA LIST (Paris) software1-P 82.09 7. ParisNLP (Paris) software1-P 81.63 8. iParse (Pittsburgh) software1-P 81.55 9. Uppsala (Uppsala) software1-P 81.39 10. LeisureX (Shanghai) software1-P 80.87 11. TurkuNLP (Turku) software1-P 80.84 12. SLT-Interactions (Bengaluru) software2-P 80.79 13. LATTICE (Paris) software1-P 80.70 14. AntNLP (Shanghai) software1-P 80.67 15. UniMelb (Melbourne) software1-P 79.39 16. Fudan (Shanghai) software5-P 78.81 17. KParse (İstanbul) software1-P 77.22 18. BASELINE UDPipe 1.2 (Praha) software1-P 76.74 19. Phoenix (Shanghai) software1-P 76.70 20. BOUN (İstanbul) software2-P 75.73 21. HUJI (Yerushalayim) software1-P 73.98 22. CUNI x-ling (Praha) software1-P 70.97 23. ONLP lab (Ra'anana) software3-P 70.37 24. ArmParser (Yerevan) software1-P 56.94 25. IBM NY (Yorktown Heights) software1-P 55.69 26. SParse (İstanbul) software1-P 0.00
cs_cac
1. UDPipe Future (Praha) software1-P 83.42 2. ICS PAS (Warszawa) software1-P 83.27 3. TurkuNLP (Turku) software1-P 82.28 4. Uppsala (Uppsala) software1-P 82.25 5. NLP-Cube (București) software1-P 80.71 6. CEA LIST (Paris) software1-P 79.92 7. Stanford (Stanford) software2 79.65 8. HIT-SCIR (Harbin) software1-P 76.66 9. LATTICE (Paris) software1-P 76.06 10. AntNLP (Shanghai) software1-P 75.98 11. ParisNLP (Paris) software1-P 75.72 12. KParse (İstanbul) software1-P 75.30 13. iParse (Pittsburgh) software1-P 74.85 14. LeisureX (Shanghai) software1-P 74.28 15. SLT-Interactions (Bengaluru) software2-P 74.27 16. Fudan (Shanghai) software5-P 72.83 17. UniMelb (Melbourne) software1-P 72.48 18. BASELINE UDPipe 1.2 (Praha) software1-P 70.89 19. Phoenix (Shanghai) software1-P 70.72 20. BOUN (İstanbul) software2-P 70.50 21. HUJI (Yerushalayim) software1-P 68.79 22. CUNI x-ling (Praha) software1-P 68.08 23. IBM NY (Yorktown Heights) software1-P 67.64 24. ONLP lab (Ra'anana) software3-P 64.77 25. ArmParser (Yerevan) software1-P 54.93 26. SParse (İstanbul) software1-P 0.00
cs_fictree
1. ICS PAS (Warszawa) software1-P 84.23 2. Stanford (Stanford) software2 82.71 3. CEA LIST (Paris) software1-P 81.87 4. TurkuNLP (Turku) software1-P 81.44 5. UDPipe Future (Praha) software1-P 81.11 6. Uppsala (Uppsala) software1-P 80.63 7. NLP-Cube (București) software1-P 78.23 8. HIT-SCIR (Harbin) software1-P 76.79 9. LATTICE (Paris) software1-P 75.97 10. AntNLP (Shanghai) software1-P 74.96 11. ParisNLP (Paris) software1-P 74.18 12. iParse (Pittsburgh) software1-P 73.60 13. SLT-Interactions (Bengaluru) software2-P 72.82 14. LeisureX (Shanghai) software1-P 71.98 15. KParse (İstanbul) software1-P 71.93 16. Fudan (Shanghai) software5-P 70.95 17. UniMelb (Melbourne) software1-P 70.08 18. BASELINE UDPipe 1.2 (Praha) software1-P 69.26 19. BOUN (İstanbul) software2-P 68.75 20. Phoenix (Shanghai) software1-P 68.17 21. HUJI (Yerushalayim) software1-P 67.73 22. CUNI x-ling (Praha) software1-P 66.52 23. ONLP lab (Ra'anana) software3-P 59.28 24. IBM NY (Yorktown Heights) software1-P 57.97 25. ArmParser (Yerevan) software1-P 56.58 26. SParse (İstanbul) software1-P 0.00
cs_pdt
1. UDPipe Future (Praha) software1-P 85.10 2. ICS PAS (Warszawa) software1-P 84.04 3. TurkuNLP (Turku) software1-P 83.16 4. Uppsala (Uppsala) software1-P 82.39 5. NLP-Cube (București) software1-P 81.73 6. Stanford (Stanford) software2 81.72 7. HIT-SCIR (Harbin) software1-P 80.57 8. ParisNLP (Paris) software1-P 79.13 9. LATTICE (Paris) software1-P 78.81 10. CEA LIST (Paris) software1-P 78.63 11. AntNLP (Shanghai) software1-P 78.39 12. LeisureX (Shanghai) software1-P 78.20 13. SLT-Interactions (Bengaluru) software2-P 77.07 14. iParse (Pittsburgh) software1-P 76.79 15. IBM NY (Yorktown Heights) software1-P 76.72 16. Fudan (Shanghai) software5-P 75.34 17. UniMelb (Melbourne) software1-P 74.87 18. BASELINE UDPipe 1.2 (Praha) software1-P 74.32 19. BOUN (İstanbul) software2-P 74.04 20. Phoenix (Shanghai) software1-P 73.99 21. KParse (İstanbul) software1-P 73.77 22. HUJI (Yerushalayim) software1-P 70.91 23. CUNI x-ling (Praha) software1-P 68.85 24. ONLP lab (Ra'anana) software3-P 65.51 25. ArmParser (Yerevan) software1-P 59.82 26. SParse (İstanbul) software1-P 0.00
cs_pud
1. UDPipe Future (Praha) software1-P 75.81 2. ICS PAS (Warszawa) software1-P 75.23 3. Uppsala (Uppsala) software1-P 74.46 4. TurkuNLP (Turku) software1-P 73.93 5. NLP-Cube (București) software1-P 72.76 6. Stanford (Stanford) software2 72.42 7. CEA LIST (Paris) software1-P 71.65 8. HIT-SCIR (Harbin) software1-P 70.90 9. AntNLP (Shanghai) software1-P 69.75 10. LATTICE (Paris) software1-P 68.70 11. IBM NY (Yorktown Heights) software1-P 68.59 12. SLT-Interactions (Bengaluru) software2-P 68.39 13. ParisNLP (Paris) software1-P 67.87 14. iParse (Pittsburgh) software1-P 67.27 15. Phoenix (Shanghai) software1-P 67.10 16. BASELINE UDPipe 1.2 (Praha) software1-P 66.53 17. UniMelb (Melbourne) software1-P 65.85 18. HUJI (Yerushalayim) software1-P 64.16 19. KParse (İstanbul) software1-P 64.14 20. CUNI x-ling (Praha) software1-P 63.19 21. LeisureX (Shanghai) software1-P 59.57 22. BOUN (İstanbul) software2-P 56.86 23. Fudan (Shanghai) software5-P 35.49 24. ONLP lab (Ra'anana) software3-P 31.59 25. ArmParser (Yerevan) software1-P 0.00 26. SParse (İstanbul) software1-P 0.00
cu_proiel
1. Stanford (Stanford) software2 63.31
2. UDPipe Future (Praha) software1-P 62.60
3. TurkuNLP (Turku) software1-P 62.11
4. CEA LIST (Paris) software1-P 61.79
5. HIT-SCIR (Harbin) software1-P 59.46
6. Uppsala (Uppsala) software1-P 58.31
7. ParisNLP (Paris) software1-P 57.01
8. ICS PAS (Warszawa) software1-P 56.52
9. Fudan (Shanghai) software5-P 56.44
10. LATTICE (Paris) software1-P 55.89
11. iParse (Pittsburgh) software1-P 55.81
12. LeisureX (Shanghai) software1-P 55.36
13. SLT-Interactions (Bengaluru) software2-P 54.65
14. AntNLP (Shanghai) software1-P 54.30
15. BASELINE UDPipe 1.2 (Praha) software1-P 53.96
16. Phoenix (Shanghai) software1-P 53.77
17. NLP-Cube (București) software1-P 53.66
18. CUNI x-ling (Praha) software1-P 52.18
19. UniMelb (Melbourne) software1-P 50.26
20. BOUN (İstanbul) software2-P 47.99
21. HUJI (Yerushalayim) software1-P 47.74
22. KParse (İstanbul) software1-P 46.96
ONLP lab (Ra'anana) software3-P 46.96
24. IBM NY (Yorktown Heights) software1-P 40.22
25. ArmParser (Yerevan) software1-P 0.00
26. SParse (İstanbul) software1-P 0.00
da_ddt
1. Stanford (Stanford) software2 77.31 2. HIT-SCIR (Harbin) software1-P 75.58 3. UDPipe Future (Praha) software1-P 75.29 4. CEA LIST (Paris) software1-P 75.27 5. TurkuNLP (Turku) software1-P 75.00 6. ICS PAS (Warszawa) software1-P 74.22 7. NLP-Cube (București) software1-P 72.62 8. Uppsala (Uppsala) software1-P 71.19 9. ParisNLP (Paris) software1-P 70.47 10. SLT-Interactions (Bengaluru) software2-P 69.45 11. AntNLP (Shanghai) software1-P 69.21 12. iParse (Pittsburgh) software1-P 68.80 13. LATTICE (Paris) software1-P 67.64 14. LeisureX (Shanghai) software1-P 67.34 15. KParse (İstanbul) software1-P 67.05 16. Phoenix (Shanghai) software1-P 65.56 17. UniMelb (Melbourne) software1-P 65.46 18. BASELINE UDPipe 1.2 (Praha) software1-P 65.41 19. Fudan (Shanghai) software5-P 65.27 20. BOUN (İstanbul) software2-P 63.21 21. CUNI x-ling (Praha) software1-P 62.48 22. HUJI (Yerushalayim) software1-P 61.40 23. ONLP lab (Ra'anana) software3-P 60.70 24. IBM NY (Yorktown Heights) software1-P 52.32 25. ArmParser (Yerevan) software1-P 51.66 26. SParse (İstanbul) software1-P 0.00
de_gsd
1. TurkuNLP (Turku) software1-P 58.04
2. Stanford (Stanford) software2 57.54
3. UDPipe Future (Praha) software1-P 56.84
4. CEA LIST (Paris) software1-P 56.18
5. NLP-Cube (București) software1-P 54.79
6. ICS PAS (Warszawa) software1-P 54.28
7. Uppsala (Uppsala) software1-P 53.67
8. KParse (İstanbul) software1-P 46.87
9. HIT-SCIR (Harbin) software1-P 40.64
10. SLT-Interactions (Bengaluru) software2-P 38.50
11. LATTICE (Paris) software1-P 38.18
12. ParisNLP (Paris) software1-P 36.95
13. iParse (Pittsburgh) software1-P 36.81
14. UniMelb (Melbourne) software1-P 36.79
15. AntNLP (Shanghai) software1-P 36.68
16. LeisureX (Shanghai) software1-P 36.39
17. BASELINE UDPipe 1.2 (Praha) software1-P 34.09
Fudan (Shanghai) software5-P 34.09
19. Phoenix (Shanghai) software1-P 33.79
20. HUJI (Yerushalayim) software1-P 32.54
21. ONLP lab (Ra'anana) software3-P 30.98
22. CUNI x-ling (Praha) software1-P 30.76
23. IBM NY (Yorktown Heights) software1-P 30.70
24. BOUN (İstanbul) software2-P 27.51
25. ArmParser (Yerevan) software1-P 23.69
26. SParse (İstanbul) software1-P 0.00
el_gdt
1. Stanford (Stanford) software2 78.66
2. UDPipe Future (Praha) software1-P 77.43
3. CEA LIST (Paris) software1-P 76.44
4. ICS PAS (Warszawa) software1-P 76.15
5. TurkuNLP (Turku) software1-P 76.14
6. Uppsala (Uppsala) software1-P 72.29
7. HIT-SCIR (Harbin) software1-P 71.60
8. NLP-Cube (București) software1-P 71.28
9. AntNLP (Shanghai) software1-P 68.10
SLT-Interactions (Bengaluru) software2-P 68.10
11. ParisNLP (Paris) software1-P 67.92
12. iParse (Pittsburgh) software1-P 67.08
13. LATTICE (Paris) software1-P 66.07
14. KParse (İstanbul) software1-P 65.74
15. Fudan (Shanghai) software5-P 65.58
16. Phoenix (Shanghai) software1-P 65.55
17. BASELINE UDPipe 1.2 (Praha) software1-P 65.33
18. BOUN (İstanbul) software2-P 65.23
19. LeisureX (Shanghai) software1-P 65.02
20. UniMelb (Melbourne) software1-P 64.34
21. HUJI (Yerushalayim) software1-P 63.38
22. CUNI x-ling (Praha) software1-P 62.90
23. ONLP lab (Ra'anana) software3-P 60.25
24. ArmParser (Yerevan) software1-P 48.17
25. IBM NY (Yorktown Heights) software1-P 42.70
26. SParse (İstanbul) software1-P 0.00
en_ewt
1. Stanford (Stanford) software2 76.33 2. HIT-SCIR (Harbin) software1-P 74.79 3. UDPipe Future (Praha) software1-P 74.71 4. CEA LIST (Paris) software1-P 74.46 5. TurkuNLP (Turku) software1-P 74.42 6. LATTICE (Paris) software1-P 74.19 7. NLP-Cube (București) software1-P 73.75 8. ICS PAS (Warszawa) software1-P 73.33 9. Uppsala (Uppsala) software1-P 72.98 10. ParisNLP (Paris) software1-P 71.53 11. SLT-Interactions (Bengaluru) software2-P 71.37 12. iParse (Pittsburgh) software1-P 71.35 13. AntNLP (Shanghai) software1-P 70.74 14. LeisureX (Shanghai) software1-P 70.58 15. UniMelb (Melbourne) software1-P 70.30 16. BASELINE UDPipe 1.2 (Praha) software1-P 68.70 17. Phoenix (Shanghai) software1-P 68.60 18. HUJI (Yerushalayim) software1-P 67.23 19. Fudan (Shanghai) software5-P 67.13 20. KParse (İstanbul) software1-P 66.78 21. CUNI x-ling (Praha) software1-P 65.70 22. BOUN (İstanbul) software2-P 64.00 23. ONLP lab (Ra'anana) software3-P 63.06 24. ArmParser (Yerevan) software1-P 57.73 25. IBM NY (Yorktown Heights) software1-P 54.04 26. SParse (İstanbul) software1-P 0.00
en_gum
1. ICS PAS (Warszawa) software1-P 73.24 2. Stanford (Stanford) software2 72.20 3. LATTICE (Paris) software1-P 70.88 4. UDPipe Future (Praha) software1-P 70.74 5. CEA LIST (Paris) software1-P 70.59 6. HIT-SCIR (Harbin) software1-P 70.31 7. Uppsala (Uppsala) software1-P 69.62 8. AntNLP (Shanghai) software1-P 68.51 9. TurkuNLP (Turku) software1-P 67.98 10. SLT-Interactions (Bengaluru) software2-P 67.95 11. NLP-Cube (București) software1-P 67.42 12. KParse (İstanbul) software1-P 65.19 13. ParisNLP (Paris) software1-P 65.12 14. iParse (Pittsburgh) software1-P 64.75 15. UniMelb (Melbourne) software1-P 63.12 16. Phoenix (Shanghai) software1-P 63.09 17. LeisureX (Shanghai) software1-P 63.05 18. BASELINE UDPipe 1.2 (Praha) software1-P 62.66 19. CUNI x-ling (Praha) software1-P 61.43 20. HUJI (Yerushalayim) software1-P 61.16 21. Fudan (Shanghai) software5-P 60.51 22. BOUN (İstanbul) software2-P 60.46 23. ONLP lab (Ra'anana) software3-P 58.80 24. ArmParser (Yerevan) software1-P 44.73 25. IBM NY (Yorktown Heights) software1-P 41.26 26. SParse (İstanbul) software1-P 0.00
en_lines
1. ICS PAS (Warszawa) software1-P 72.25 2. HIT-SCIR (Harbin) software1-P 71.73 3. TurkuNLP (Turku) software1-P 71.62 4. Stanford (Stanford) software2 71.21 5. LATTICE (Paris) software1-P 71.17 6. UDPipe Future (Praha) software1-P 70.66 7. Uppsala (Uppsala) software1-P 70.18 8. CEA LIST (Paris) software1-P 70.05 9. AntNLP (Shanghai) software1-P 69.36 10. NLP-Cube (București) software1-P 69.28 11. SLT-Interactions (Bengaluru) software2-P 68.41 12. ParisNLP (Paris) software1-P 66.73 13. iParse (Pittsburgh) software1-P 66.15 14. LeisureX (Shanghai) software1-P 65.04 15. KParse (İstanbul) software1-P 64.91 16. BASELINE UDPipe 1.2 (Praha) software1-P 64.03 17. Phoenix (Shanghai) software1-P 63.76 18. UniMelb (Melbourne) software1-P 63.58 19. Fudan (Shanghai) software5-P 63.37 20. CUNI x-ling (Praha) software1-P 62.82 21. HUJI (Yerushalayim) software1-P 61.76 22. ONLP lab (Ra'anana) software3-P 60.28 23. BOUN (İstanbul) software2-P 59.03 24. ArmParser (Yerevan) software1-P 44.89 25. IBM NY (Yorktown Heights) software1-P 38.84 26. SParse (İstanbul) software1-P 0.00
en_pud
1. Stanford (Stanford) software2 74.86
2. LATTICE (Paris) software1-P 74.69
3. HIT-SCIR (Harbin) software1-P 74.68
4. ICS PAS (Warszawa) software1-P 74.65
5. UDPipe Future (Praha) software1-P 74.45
6. TurkuNLP (Turku) software1-P 73.41
7. NLP-Cube (București) software1-P 72.76
8. Uppsala (Uppsala) software1-P 72.49
9. AntNLP (Shanghai) software1-P 71.86
10. SLT-Interactions (Bengaluru) software2-P 71.41
11. UniMelb (Melbourne) software1-P 70.31
12. LeisureX (Shanghai) software1-P 70.23
13. CEA LIST (Paris) software1-P 69.97
14. Phoenix (Shanghai) software1-P 69.17
15. ParisNLP (Paris) software1-P 67.89
16. BASELINE UDPipe 1.2 (Praha) software1-P 67.59
Fudan (Shanghai) software5-P 67.59
18. HUJI (Yerushalayim) software1-P 66.60
19. KParse (İstanbul) software1-P 66.16
20. CUNI x-ling (Praha) software1-P 65.64
21. iParse (Pittsburgh) software1-P 57.75
22. BOUN (İstanbul) software2-P 56.99
23. IBM NY (Yorktown Heights) software1-P 54.51
24. ONLP lab (Ra'anana) software3-P 53.73
25. ArmParser (Yerevan) software1-P 0.00
26. SParse (İstanbul) software1-P 0.00
es_ancora
1. Stanford (Stanford) software2 83.93 2. HIT-SCIR (Harbin) software1-P 83.73 3. UDPipe Future (Praha) software1-P 83.16 4. ICS PAS (Warszawa) software1-P 82.60 5. CEA LIST (Paris) software1-P 82.33 6. Uppsala (Uppsala) software1-P 81.75 7. TurkuNLP (Turku) software1-P 81.66 8. iParse (Pittsburgh) software1-P 81.56 9. LATTICE (Paris) software1-P 81.20 10. ParisNLP (Paris) software1-P 81.18 11. NLP-Cube (București) software1-P 81.05 12. LeisureX (Shanghai) software1-P 81.01 13. AntNLP (Shanghai) software1-P 80.82 14. SLT-Interactions (Bengaluru) software2-P 80.77 15. UniMelb (Melbourne) software1-P 79.72 16. Fudan (Shanghai) software5-P 78.73 17. KParse (İstanbul) software1-P 76.71 18. Phoenix (Shanghai) software1-P 76.64 19. BASELINE UDPipe 1.2 (Praha) software1-P 76.01 20. BOUN (İstanbul) software2-P 73.95 21. HUJI (Yerushalayim) software1-P 73.68 22. ONLP lab (Ra'anana) software3-P 73.01 23. CUNI x-ling (Praha) software1-P 69.82 24. IBM NY (Yorktown Heights) software1-P 58.83 25. ArmParser (Yerevan) software1-P 56.00 26. SParse (İstanbul) software1-P 0.00
et_edt
1. TurkuNLP (Turku) software1-P 76.97 2. UDPipe Future (Praha) software1-P 76.62 3. Stanford (Stanford) software2 76.35 4. CEA LIST (Paris) software1-P 75.87 5. ICS PAS (Warszawa) software1-P 75.79 6. HIT-SCIR (Harbin) software1-P 74.92 7. Uppsala (Uppsala) software1-P 74.11 8. NLP-Cube (București) software1-P 71.94 9. LATTICE (Paris) software1-P 71.91 10. ParisNLP (Paris) software1-P 71.59 11. AntNLP (Shanghai) software1-P 71.29 12. SLT-Interactions (Bengaluru) software2-P 71.18 13. UniMelb (Melbourne) software1-P 70.88 14. LeisureX (Shanghai) software1-P 70.39 15. Fudan (Shanghai) software5-P 68.51 16. BOUN (İstanbul) software2-P 67.74 17. BASELINE UDPipe 1.2 (Praha) software1-P 67.12 18. Phoenix (Shanghai) software1-P 66.69 19. KParse (İstanbul) software1-P 65.70 20. CUNI x-ling (Praha) software1-P 64.57 21. HUJI (Yerushalayim) software1-P 58.35 22. ONLP lab (Ra'anana) software3-P 56.69 23. IBM NY (Yorktown Heights) software1-P 56.28 24. ArmParser (Yerevan) software1-P 51.80 25. SParse (İstanbul) software1-P 0.00 26. iParse (Pittsburgh) software1-P 0.00
eu_bdt
1. UDPipe Future (Praha) software1-P 71.73 2. CEA LIST (Paris) software1-P 71.70 3. TurkuNLP (Turku) software1-P 71.19 4. Stanford (Stanford) software2 70.38 5. ICS PAS (Warszawa) software1-P 68.82 6. Uppsala (Uppsala) software1-P 67.67 7. NLP-Cube (București) software1-P 67.31 8. HIT-SCIR (Harbin) software1-P 67.24 9. LATTICE (Paris) software1-P 64.06 10. SLT-Interactions (Bengaluru) software2-P 63.57 11. ParisNLP (Paris) software1-P 63.40 12. iParse (Pittsburgh) software1-P 63.25 13. KParse (İstanbul) software1-P 63.11 14. AntNLP (Shanghai) software1-P 62.43 15. LeisureX (Shanghai) software1-P 60.75 16. Fudan (Shanghai) software5-P 58.98 17. UniMelb (Melbourne) software1-P 58.54 18. BOUN (İstanbul) software2-P 57.83 19. BASELINE UDPipe 1.2 (Praha) software1-P 57.65 20. Phoenix (Shanghai) software1-P 57.56 21. CUNI x-ling (Praha) software1-P 54.85 22. HUJI (Yerushalayim) software1-P 46.84 23. ArmParser (Yerevan) software1-P 44.69 24. IBM NY (Yorktown Heights) software1-P 43.71 25. ONLP lab (Ra'anana) software3-P 43.35 26. SParse (İstanbul) software1-P 0.00
fa_seraji
1. UDPipe Future (Praha) software1-P 80.83
2. HIT-SCIR (Harbin) software1-P 80.48
3. Stanford (Stanford) software2 80.45
4. CEA LIST (Paris) software1-P 80.38
TurkuNLP (Turku) software1-P 80.38
6. ICS PAS (Warszawa) software1-P 80.30
7. NLP-Cube (București) software1-P 78.42
8. ParisNLP (Paris) software1-P 77.73
9. SLT-Interactions (Bengaluru) software2-P 77.32
10. Uppsala (Uppsala) software1-P 76.97
11. AntNLP (Shanghai) software1-P 76.66
12. iParse (Pittsburgh) software1-P 76.08
13. LeisureX (Shanghai) software1-P 75.38
14. UniMelb (Melbourne) software1-P 75.33
15. LATTICE (Paris) software1-P 75.26
16. KParse (İstanbul) software1-P 74.84
17. BOUN (İstanbul) software2-P 73.09
18. Phoenix (Shanghai) software1-P 72.90
19. BASELINE UDPipe 1.2 (Praha) software1-P 72.20
Fudan (Shanghai) software5-P 72.20
21. HUJI (Yerushalayim) software1-P 71.08
22. ONLP lab (Ra'anana) software3-P 70.75
23. CUNI x-ling (Praha) software1-P 69.17
24. ArmParser (Yerevan) software1-P 54.56
25. IBM NY (Yorktown Heights) software1-P 49.20
26. SParse (İstanbul) software1-P 0.00
fi_ftb
1. TurkuNLP (Turku) software1-P 79.65
2. CEA LIST (Paris) software1-P 79.09
3. UDPipe Future (Praha) software1-P 78.77
4. Stanford (Stanford) software2 78.75
5. ICS PAS (Warszawa) software1-P 78.42
6. HIT-SCIR (Harbin) software1-P 76.48
7. Uppsala (Uppsala) software1-P 76.40
8. LATTICE (Paris) software1-P 74.32
9. NLP-Cube (București) software1-P 71.89
10. ParisNLP (Paris) software1-P 71.43
11. AntNLP (Shanghai) software1-P 71.06
12. SLT-Interactions (Bengaluru) software2-P 70.66
13. iParse (Pittsburgh) software1-P 69.86
14. UniMelb (Melbourne) software1-P 67.60
15. LeisureX (Shanghai) software1-P 66.53
16. KParse (İstanbul) software1-P 65.53
17. BOUN (İstanbul) software2-P 65.24
18. BASELINE UDPipe 1.2 (Praha) software1-P 65.22
Fudan (Shanghai) software5-P 65.22
20. IBM NY (Yorktown Heights) software1-P 65.09
21. Phoenix (Shanghai) software1-P 64.48
22. HUJI (Yerushalayim) software1-P 62.47
23. CUNI x-ling (Praha) software1-P 61.62
24. ONLP lab (Ra'anana) software3-P 48.98
25. ArmParser (Yerevan) software1-P 44.15
26. SParse (İstanbul) software1-P 0.00
fi_pud
1. Stanford (Stanford) software2 83.78
2. TurkuNLP (Turku) software1-P 82.81
3. CEA LIST (Paris) software1-P 82.42
4. ICS PAS (Warszawa) software1-P 82.29
5. UDPipe Future (Praha) software1-P 82.17
6. HIT-SCIR (Harbin) software1-P 81.48
7. Uppsala (Uppsala) software1-P 80.52
8. LATTICE (Paris) software1-P 79.40
9. NLP-Cube (București) software1-P 78.41
10. AntNLP (Shanghai) software1-P 76.64
11. UniMelb (Melbourne) software1-P 75.20
12. KParse (İstanbul) software1-P 74.18
13. Phoenix (Shanghai) software1-P 73.49
14. BASELINE UDPipe 1.2 (Praha) software1-P 73.16
Fudan (Shanghai) software5-P 73.16
16. IBM NY (Yorktown Heights) software1-P 70.92
17. CUNI x-ling (Praha) software1-P 69.52
18. ParisNLP (Paris) software1-P 62.46
19. HUJI (Yerushalayim) software1-P 61.05
20. BOUN (İstanbul) software2-P 53.14
21. SLT-Interactions (Bengaluru) software2-P 48.74
22. ONLP lab (Ra'anana) software3-P 40.59
23. LeisureX (Shanghai) software1-P 36.39
24. ArmParser (Yerevan) software1-P 0.00
25. SParse (İstanbul) software1-P 0.00
26. iParse (Pittsburgh) software1-P 0.00
fi_tdt
1. Stanford (Stanford) software2 80.84 2. TurkuNLP (Turku) software1-P 80.06 3. UDPipe Future (Praha) software1-P 79.25 4. ICS PAS (Warszawa) software1-P 78.65 5. CEA LIST (Paris) software1-P 78.59 6. HIT-SCIR (Harbin) software1-P 77.75 7. Uppsala (Uppsala) software1-P 77.50 8. LATTICE (Paris) software1-P 74.88 9. ParisNLP (Paris) software1-P 73.16 10. NLP-Cube (București) software1-P 73.04 11. SLT-Interactions (Bengaluru) software2-P 72.84 12. AntNLP (Shanghai) software1-P 72.59 13. UniMelb (Melbourne) software1-P 70.61 14. LeisureX (Shanghai) software1-P 70.42 15. KParse (İstanbul) software1-P 70.40 16. Fudan (Shanghai) software5-P 69.70 17. Phoenix (Shanghai) software1-P 68.62 18. BASELINE UDPipe 1.2 (Praha) software1-P 68.58 19. BOUN (İstanbul) software2-P 67.56 20. IBM NY (Yorktown Heights) software1-P 66.11 21. CUNI x-ling (Praha) software1-P 64.39 22. HUJI (Yerushalayim) software1-P 56.83 23. ONLP lab (Ra'anana) software3-P 56.50 24. ArmParser (Yerevan) software1-P 48.24 25. SParse (İstanbul) software1-P 0.00 26. iParse (Pittsburgh) software1-P 0.00
fo_oft
1. CUNI x-ling (Praha) software1-P 1.07
2. CEA LIST (Paris) software1-P 0.80
3. UDPipe Future (Praha) software1-P 0.74
4. Uppsala (Uppsala) software1-P 0.70
5. SLT-Interactions (Bengaluru) software2-P 0.52
6. TurkuNLP (Turku) software1-P 0.50
7. AntNLP (Shanghai) software1-P 0.37
8. BASELINE UDPipe 1.2 (Praha) software1-P 0.36
Fudan (Shanghai) software5-P 0.36
HIT-SCIR (Harbin) software1-P 0.36
LeisureX (Shanghai) software1-P 0.36
ONLP lab (Ra'anana) software3-P 0.36
UniMelb (Melbourne) software1-P 0.36
14. BOUN (İstanbul) software2-P 0.34
ParisNLP (Paris) software1-P 0.34
16. ICS PAS (Warszawa) software1-P 0.33
NLP-Cube (București) software1-P 0.33
18. LATTICE (Paris) software1-P 0.30
19. KParse (İstanbul) software1-P 0.29
Phoenix (Shanghai) software1-P 0.29
21. Stanford (Stanford) software2 0.26
22. IBM NY (Yorktown Heights) software1-P 0.15
23. HUJI (Yerushalayim) software1-P 0.09
24. ArmParser (Yerevan) software1-P 0.00
25. SParse (İstanbul) software1-P 0.00
26. iParse (Pittsburgh) software1-P 0.00
fr_gsd
1. Stanford (Stanford) software2 78.44 2. HIT-SCIR (Harbin) software1-P 78.27 3. UDPipe Future (Praha) software1-P 77.29 4. ICS PAS (Warszawa) software1-P 77.08 5. Uppsala (Uppsala) software1-P 76.79 6. TurkuNLP (Turku) software1-P 76.78 7. LATTICE (Paris) software1-P 76.77 8. CEA LIST (Paris) software1-P 76.41 9. AntNLP (Shanghai) software1-P 75.69 10. ParisNLP (Paris) software1-P 75.38 11. SLT-Interactions (Bengaluru) software2-P 75.31 12. iParse (Pittsburgh) software1-P 74.95 13. LeisureX (Shanghai) software1-P 74.58 14. UniMelb (Melbourne) software1-P 74.37 15. NLP-Cube (București) software1-P 73.86 16. Fudan (Shanghai) software5-P 72.89 17. Phoenix (Shanghai) software1-P 72.30 18. BASELINE UDPipe 1.2 (Praha) software1-P 72.16 19. KParse (İstanbul) software1-P 72.07 20. BOUN (İstanbul) software2-P 71.01 21. ONLP lab (Ra'anana) software3-P 69.18 22. HUJI (Yerushalayim) software1-P 69.09 23. CUNI x-ling (Praha) software1-P 68.33 24. ArmParser (Yerevan) software1-P 55.26 25. IBM NY (Yorktown Heights) software1-P 38.38 26. SParse (İstanbul) software1-P 0.00
fr_sequoia
1. Stanford (Stanford) software2 82.55
2. ICS PAS (Warszawa) software1-P 81.48
3. UDPipe Future (Praha) software1-P 81.45
4. CEA LIST (Paris) software1-P 80.20
5. TurkuNLP (Turku) software1-P 80.18
6. Uppsala (Uppsala) software1-P 79.97
7. HIT-SCIR (Harbin) software1-P 79.40
LATTICE (Paris) software1-P 79.40
9. SLT-Interactions (Bengaluru) software2-P 77.90
10. KParse (İstanbul) software1-P 76.56
11. NLP-Cube (București) software1-P 75.50
12. ParisNLP (Paris) software1-P 74.70
13. UniMelb (Melbourne) software1-P 74.34
14. AntNLP (Shanghai) software1-P 74.13
15. iParse (Pittsburgh) software1-P 72.48
16. Fudan (Shanghai) software5-P 72.09
17. Phoenix (Shanghai) software1-P 71.58
18. BASELINE UDPipe 1.2 (Praha) software1-P 71.34
19. LeisureX (Shanghai) software1-P 71.23
20. HUJI (Yerushalayim) software1-P 70.06
21. BOUN (İstanbul) software2-P 70.04
22. ONLP lab (Ra'anana) software3-P 69.18
23. CUNI x-ling (Praha) software1-P 68.75
24. ArmParser (Yerevan) software1-P 55.68
25. IBM NY (Yorktown Heights) software1-P 40.61
26. SParse (İstanbul) software1-P 0.00
fr_spoken
1. HIT-SCIR (Harbin) software1-P 64.67 2. ICS PAS (Warszawa) software1-P 63.43 3. LATTICE (Paris) software1-P 62.95 4. SLT-Interactions (Bengaluru) software2-P 62.46 5. Stanford (Stanford) software2 61.64 6. UDPipe Future (Praha) software1-P 60.17 7. Uppsala (Uppsala) software1-P 60.12 8. CEA LIST (Paris) software1-P 57.88 9. AntNLP (Shanghai) software1-P 57.43 10. KParse (İstanbul) software1-P 57.32 11. TurkuNLP (Turku) software1-P 56.91 12. UniMelb (Melbourne) software1-P 55.41 13. Phoenix (Shanghai) software1-P 53.63 14. BASELINE UDPipe 1.2 (Praha) software1-P 53.46 15. NLP-Cube (București) software1-P 53.41 16. ParisNLP (Paris) software1-P 53.30 17. IBM NY (Yorktown Heights) software1-P 52.90 18. LeisureX (Shanghai) software1-P 52.73 19. CUNI x-ling (Praha) software1-P 51.92 20. ONLP lab (Ra'anana) software3-P 51.17 21. Fudan (Shanghai) software5-P 49.34 22. iParse (Pittsburgh) software1-P 49.18 23. HUJI (Yerushalayim) software1-P 48.46 24. ArmParser (Yerevan) software1-P 47.08 25. BOUN (İstanbul) software2-P 45.56 26. SParse (İstanbul) software1-P 0.00
fro_srcmf
1. UDPipe Future (Praha) software1-P 80.28 2. CEA LIST (Paris) software1-P 79.62 3. Stanford (Stanford) software2 79.45 4. TurkuNLP (Turku) software1-P 79.24 5. HIT-SCIR (Harbin) software1-P 77.75 6. ParisNLP (Paris) software1-P 76.96 7. ICS PAS (Warszawa) software1-P 76.75 8. iParse (Pittsburgh) software1-P 76.68 9. LATTICE (Paris) software1-P 76.01 10. LeisureX (Shanghai) software1-P 75.66 11. AntNLP (Shanghai) software1-P 74.80 12. Fudan (Shanghai) software5-P 73.48 13. UniMelb (Melbourne) software1-P 71.40 14. Phoenix (Shanghai) software1-P 70.71 15. BASELINE UDPipe 1.2 (Praha) software1-P 70.70 16. Uppsala (Uppsala) software1-P 69.82 17. ArmParser (Yerevan) software1-P 68.36 18. BOUN (İstanbul) software2-P 68.00 19. KParse (İstanbul) software1-P 67.85 20. CUNI x-ling (Praha) software1-P 67.74 21. NLP-Cube (București) software1-P 66.90 22. ONLP lab (Ra'anana) software3-P 62.02 23. IBM NY (Yorktown Heights) software1-P 47.69 24. SLT-Interactions (Bengaluru) software2-P 35.06 25. HUJI (Yerushalayim) software1-P 2.06 26. SParse (İstanbul) software1-P 0.00
ga_idt
1. TurkuNLP (Turku) software1-P 45.79
2. UDPipe Future (Praha) software1-P 45.53
3. Uppsala (Uppsala) software1-P 41.72
4. LATTICE (Paris) software1-P 39.69
5. ParisNLP (Paris) software1-P 39.68
6. HIT-SCIR (Harbin) software1-P 39.48
7. Phoenix (Shanghai) software1-P 38.09
8. BASELINE UDPipe 1.2 (Praha) software1-P 37.66
CEA LIST (Paris) software1-P 37.66
LeisureX (Shanghai) software1-P 37.66
11. ICS PAS (Warszawa) software1-P 37.31
12. AntNLP (Shanghai) software1-P 37.10
13. CUNI x-ling (Praha) software1-P 36.73
14. Fudan (Shanghai) software5-P 36.72
15. SLT-Interactions (Bengaluru) software2-P 36.66
16. UniMelb (Melbourne) software1-P 36.17
17. NLP-Cube (București) software1-P 35.54
18. ONLP lab (Ra'anana) software3-P 34.63
19. KParse (İstanbul) software1-P 34.36
20. HUJI (Yerushalayim) software1-P 32.84
21. ArmParser (Yerevan) software1-P 31.01
22. Stanford (Stanford) software2 29.64
23. BOUN (İstanbul) software2-P 28.92
24. IBM NY (Yorktown Heights) software1-P 25.63
25. SParse (İstanbul) software1-P 0.00
26. iParse (Pittsburgh) software1-P 0.00
gl_ctg
1. Stanford (Stanford) software2 70.92
2. HIT-SCIR (Harbin) software1-P 69.96
3. UDPipe Future (Praha) software1-P 69.75
4. TurkuNLP (Turku) software1-P 69.53
5. CEA LIST (Paris) software1-P 69.28
6. ParisNLP (Paris) software1-P 68.48
7. NLP-Cube (București) software1-P 68.20
8. ICS PAS (Warszawa) software1-P 68.15
9. AntNLP (Shanghai) software1-P 67.93
10. SLT-Interactions (Bengaluru) software2-P 67.90
11. LATTICE (Paris) software1-P 67.29
12. UniMelb (Melbourne) software1-P 67.08
13. iParse (Pittsburgh) software1-P 66.80
14. KParse (İstanbul) software1-P 66.13
15. Uppsala (Uppsala) software1-P 65.52
16. LeisureX (Shanghai) software1-P 65.00
17. ONLP lab (Ra'anana) software3-P 63.47
18. BOUN (İstanbul) software2-P 62.94
19. BASELINE UDPipe 1.2 (Praha) software1-P 62.11
Fudan (Shanghai) software5-P 62.11
21. Phoenix (Shanghai) software1-P 61.90
22. CUNI x-ling (Praha) software1-P 58.06
23. ArmParser (Yerevan) software1-P 46.63
24. IBM NY (Yorktown Heights) software1-P 0.72
25. HUJI (Yerushalayim) software1-P 0.00
26. SParse (İstanbul) software1-P 0.00
gl_treegal
1. UDPipe Future (Praha) software1-P 60.63
2. Uppsala (Uppsala) software1-P 58.22
3. TurkuNLP (Turku) software1-P 57.70
4. SLT-Interactions (Bengaluru) software2-P 53.42
5. LATTICE (Paris) software1-P 53.28
6. ICS PAS (Warszawa) software1-P 52.88
7. AntNLP (Shanghai) software1-P 52.82
8. HIT-SCIR (Harbin) software1-P 52.69
9. KParse (İstanbul) software1-P 52.15
10. ParisNLP (Paris) software1-P 51.10
11. BASELINE UDPipe 1.2 (Praha) software1-P 49.13
CEA LIST (Paris) software1-P 49.13
LeisureX (Shanghai) software1-P 49.13
14. UniMelb (Melbourne) software1-P 48.77
15. CUNI x-ling (Praha) software1-P 48.70
16. Phoenix (Shanghai) software1-P 48.60
17. ONLP lab (Ra'anana) software3-P 47.71
18. NLP-Cube (București) software1-P 47.68
19. Fudan (Shanghai) software5-P 47.04
20. iParse (Pittsburgh) software1-P 46.87
21. BOUN (İstanbul) software2-P 46.11
22. HUJI (Yerushalayim) software1-P 41.76
23. ArmParser (Yerevan) software1-P 40.90
24. Stanford (Stanford) software2 40.73
25. IBM NY (Yorktown Heights) software1-P 33.95
26. SParse (İstanbul) software1-P 0.00
got_proiel
1. UDPipe Future (Praha) software1-P 56.45 2. Stanford (Stanford) software2 56.01 3. CEA LIST (Paris) software1-P 54.80 4. TurkuNLP (Turku) software1-P 53.91 5. HIT-SCIR (Harbin) software1-P 53.65 6. ParisNLP (Paris) software1-P 51.20 7. ICS PAS (Warszawa) software1-P 50.81 8. iParse (Pittsburgh) software1-P 50.09 9. Fudan (Shanghai) software5-P 50.05 10. Uppsala (Uppsala) software1-P 49.79 11. LATTICE (Paris) software1-P 48.73 12. BASELINE UDPipe 1.2 (Praha) software1-P 48.57 13. Phoenix (Shanghai) software1-P 48.37 14. LeisureX (Shanghai) software1-P 48.19 15. AntNLP (Shanghai) software1-P 47.52 16. SLT-Interactions (Bengaluru) software2-P 47.31 17. UniMelb (Melbourne) software1-P 46.33 18. NLP-Cube (București) software1-P 46.32 19. CUNI x-ling (Praha) software1-P 46.21 20. BOUN (İstanbul) software2-P 44.69 21. ArmParser (Yerevan) software1-P 42.78 22. ONLP lab (Ra'anana) software3-P 42.68 23. HUJI (Yerushalayim) software1-P 42.51 24. KParse (İstanbul) software1-P 40.58 25. IBM NY (Yorktown Heights) software1-P 33.14 26. SParse (İstanbul) software1-P 0.00
grc_perseus
1. HIT-SCIR (Harbin) software1-P 54.98 2. ICS PAS (Warszawa) software1-P 53.30 3. TurkuNLP (Turku) software1-P 53.00 4. Stanford (Stanford) software2 52.50 5. CEA LIST (Paris) software1-P 52.14 6. UDPipe Future (Praha) software1-P 51.55 7. LATTICE (Paris) software1-P 47.20 8. Uppsala (Uppsala) software1-P 44.31 9. SLT-Interactions (Bengaluru) software2-P 39.96 10. ParisNLP (Paris) software1-P 39.22 11. NLP-Cube (București) software1-P 39.00 12. AntNLP (Shanghai) software1-P 38.84 13. iParse (Pittsburgh) software1-P 36.57 14. Fudan (Shanghai) software5-P 34.58 15. KParse (İstanbul) software1-P 34.19 16. UniMelb (Melbourne) software1-P 34.10 17. LeisureX (Shanghai) software1-P 33.28 18. BASELINE UDPipe 1.2 (Praha) software1-P 31.05 19. Phoenix (Shanghai) software1-P 29.57 20. BOUN (İstanbul) software2-P 28.46 21. CUNI x-ling (Praha) software1-P 27.95 22. IBM NY (Yorktown Heights) software1-P 27.59 23. ArmParser (Yerevan) software1-P 24.61 24. ONLP lab (Ra'anana) software3-P 17.91 25. HUJI (Yerushalayim) software1-P 1.01 26. SParse (İstanbul) software1-P 0.00
grc_proiel
1. Stanford (Stanford) software2 60.27 2. HIT-SCIR (Harbin) software1-P 60.23 3. ICS PAS (Warszawa) software1-P 59.95 4. TurkuNLP (Turku) software1-P 59.83 5. UDPipe Future (Praha) software1-P 59.82 6. CEA LIST (Paris) software1-P 58.36 7. LATTICE (Paris) software1-P 55.05 8. Uppsala (Uppsala) software1-P 54.98 9. ParisNLP (Paris) software1-P 54.87 10. AntNLP (Shanghai) software1-P 54.65 11. iParse (Pittsburgh) software1-P 54.37 12. NLP-Cube (București) software1-P 53.38 13. LeisureX (Shanghai) software1-P 52.44 14. SLT-Interactions (Bengaluru) software2-P 51.57 15. Fudan (Shanghai) software5-P 51.35 16. BASELINE UDPipe 1.2 (Praha) software1-P 49.51 17. Phoenix (Shanghai) software1-P 48.31 18. UniMelb (Melbourne) software1-P 47.07 19. BOUN (İstanbul) software2-P 46.68 20. CUNI x-ling (Praha) software1-P 44.32 21. KParse (İstanbul) software1-P 43.92 22. ArmParser (Yerevan) software1-P 40.07 23. ONLP lab (Ra'anana) software3-P 38.44 24. IBM NY (Yorktown Heights) software1-P 37.12 25. HUJI (Yerushalayim) software1-P 1.51 26. SParse (İstanbul) software1-P 0.00
he_htb
1. Stanford (Stanford) software2 63.38
2. TurkuNLP (Turku) software1-P 52.17
3. HIT-SCIR (Harbin) software1-P 51.95
4. UDPipe Future (Praha) software1-P 51.36
5. CEA LIST (Paris) software1-P 51.30
6. ICS PAS (Warszawa) software1-P 50.26
7. NLP-Cube (București) software1-P 49.77
8. ParisNLP (Paris) software1-P 47.82
9. SLT-Interactions (Bengaluru) software2-P 47.57
10. AntNLP (Shanghai) software1-P 46.92
11. LATTICE (Paris) software1-P 46.30
12. UniMelb (Melbourne) software1-P 46.15
13. IBM NY (Yorktown Heights) software1-P 46.08
14. LeisureX (Shanghai) software1-P 46.03
15. iParse (Pittsburgh) software1-P 45.86
16. KParse (İstanbul) software1-P 45.06
17. Phoenix (Shanghai) software1-P 44.67
18. Uppsala (Uppsala) software1-P 44.19
19. BASELINE UDPipe 1.2 (Praha) software1-P 44.09
Fudan (Shanghai) software5-P 44.09
21. HUJI (Yerushalayim) software1-P 43.55
22. BOUN (İstanbul) software2-P 43.42
23. ONLP lab (Ra'anana) software3-P 43.12
24. CUNI x-ling (Praha) software1-P 41.99
25. ArmParser (Yerevan) software1-P 38.49
26. SParse (İstanbul) software1-P 0.00
hi_hdtb
1. UDPipe Future (Praha) software1-P 78.30 2. TurkuNLP (Turku) software1-P 78.03 3. Stanford (Stanford) software2 77.86 4. CEA LIST (Paris) software1-P 77.59 5. ICS PAS (Warszawa) software1-P 76.23 6. NLP-Cube (București) software1-P 76.01 7. Uppsala (Uppsala) software1-P 74.62 8. HIT-SCIR (Harbin) software1-P 74.01 9. SLT-Interactions (Bengaluru) software2-P 72.79 10. ParisNLP (Paris) software1-P 72.25 11. AntNLP (Shanghai) software1-P 72.04 12. LeisureX (Shanghai) software1-P 72.03 13. iParse (Pittsburgh) software1-P 72.00 14. LATTICE (Paris) software1-P 71.32 15. UniMelb (Melbourne) software1-P 70.85 16. Fudan (Shanghai) software5-P 70.48 17. KParse (İstanbul) software1-P 70.44 18. Phoenix (Shanghai) software1-P 69.30 19. BASELINE UDPipe 1.2 (Praha) software1-P 69.09 20. BOUN (İstanbul) software2-P 67.93 21. CUNI x-ling (Praha) software1-P 67.70 22. HUJI (Yerushalayim) software1-P 66.10 23. ONLP lab (Ra'anana) software3-P 65.28 24. IBM NY (Yorktown Heights) software1-P 65.02 25. ArmParser (Yerevan) software1-P 53.17 26. SParse (İstanbul) software1-P 0.00
hr_set
1. Stanford (Stanford) software2 73.44
2. UDPipe Future (Praha) software1-P 72.85
3. TurkuNLP (Turku) software1-P 72.78
4. ICS PAS (Warszawa) software1-P 71.12
5. Uppsala (Uppsala) software1-P 70.53
6. CEA LIST (Paris) software1-P 70.11
7. NLP-Cube (București) software1-P 69.81
8. KParse (İstanbul) software1-P 65.23
9. HIT-SCIR (Harbin) software1-P 64.09
10. ParisNLP (Paris) software1-P 61.82
11. SLT-Interactions (Bengaluru) software2-P 61.70
12. iParse (Pittsburgh) software1-P 61.45
13. LATTICE (Paris) software1-P 61.11
14. AntNLP (Shanghai) software1-P 61.09
15. LeisureX (Shanghai) software1-P 60.93
16. UniMelb (Melbourne) software1-P 60.29
17. IBM NY (Yorktown Heights) software1-P 59.51
18. Phoenix (Shanghai) software1-P 58.76
19. BASELINE UDPipe 1.2 (Praha) software1-P 58.72
Fudan (Shanghai) software5-P 58.72
21. BOUN (İstanbul) software2-P 56.67
22. CUNI x-ling (Praha) software1-P 56.53
23. HUJI (Yerushalayim) software1-P 55.56
24. ONLP lab (Ra'anana) software3-P 54.40
25. ArmParser (Yerevan) software1-P 44.81
26. SParse (İstanbul) software1-P 0.00
hsb_ufal
1. LATTICE (Paris) software1-P 9.09
2. CUNI x-ling (Praha) software1-P 8.49
3. NLP-Cube (București) software1-P 8.13
4. IBM NY (Yorktown Heights) software1-P 7.94
5. SLT-Interactions (Bengaluru) software2-P 7.67
6. Fudan (Shanghai) software5-P 7.64
7. BOUN (İstanbul) software2-P 7.18
8. HIT-SCIR (Harbin) software1-P 7.09
9. KParse (İstanbul) software1-P 6.22
10. ParisNLP (Paris) software1-P 4.88
11. AntNLP (Shanghai) software1-P 4.85
12. ONLP lab (Ra'anana) software3-P 4.73
13. Phoenix (Shanghai) software1-P 3.83
14. BASELINE UDPipe 1.2 (Praha) software1-P 3.55
CEA LIST (Paris) software1-P 3.55
LeisureX (Shanghai) software1-P 3.55
UniMelb (Melbourne) software1-P 3.55
18. Uppsala (Uppsala) software1-P 3.43
19. UDPipe Future (Praha) software1-P 3.41
20. Stanford (Stanford) software2 3.39
21. ArmParser (Yerevan) software1-P 3.21
22. HUJI (Yerushalayim) software1-P 2.29
23. TurkuNLP (Turku) software1-P 1.88
24. ICS PAS (Warszawa) software1-P 1.45
25. iParse (Pittsburgh) software1-P 0.23
26. SParse (İstanbul) software1-P 0.00
hu_szeged
1. UDPipe Future (Praha) software1-P 67.13 2. TurkuNLP (Turku) software1-P 66.97 3. ICS PAS (Warszawa) software1-P 66.09 4. CEA LIST (Paris) software1-P 65.68 5. Stanford (Stanford) software2 65.63 6. HIT-SCIR (Harbin) software1-P 64.96 7. NLP-Cube (București) software1-P 59.93 8. SLT-Interactions (Bengaluru) software2-P 58.08 9. AntNLP (Shanghai) software1-P 56.60 10. Uppsala (Uppsala) software1-P 56.22 11. ParisNLP (Paris) software1-P 55.98 12. LATTICE (Paris) software1-P 55.49 13. iParse (Pittsburgh) software1-P 54.23 14. IBM NY (Yorktown Heights) software1-P 53.34 15. BASELINE UDPipe 1.2 (Praha) software1-P 52.82 16. Phoenix (Shanghai) software1-P 52.78 17. Fudan (Shanghai) software5-P 52.39 18. UniMelb (Melbourne) software1-P 52.11 19. CUNI x-ling (Praha) software1-P 51.67 20. KParse (İstanbul) software1-P 51.13 21. BOUN (İstanbul) software2-P 50.91 22. LeisureX (Shanghai) software1-P 50.36 23. ONLP lab (Ra'anana) software3-P 41.00 24. HUJI (Yerushalayim) software1-P 39.59 25. ArmParser (Yerevan) software1-P 39.09 26. SParse (İstanbul) software1-P 0.00
hy_armtdp
1. CUNI x-ling (Praha) software1-P 13.36
2. NLP-Cube (București) software1-P 10.44
3. LATTICE (Paris) software1-P 9.87
4. ONLP lab (Ra'anana) software3-P 8.42
5. Stanford (Stanford) software2 7.80
6. Fudan (Shanghai) software5-P 7.74
7. CEA LIST (Paris) software1-P 7.58
8. Phoenix (Shanghai) software1-P 7.37
9. KParse (İstanbul) software1-P 7.24
10. Uppsala (Uppsala) software1-P 6.97
11. BASELINE UDPipe 1.2 (Praha) software1-P 6.84
LeisureX (Shanghai) software1-P 6.84
UniMelb (Melbourne) software1-P 6.84
14. AntNLP (Shanghai) software1-P 6.72
15. HIT-SCIR (Harbin) software1-P 6.39
16. TurkuNLP (Turku) software1-P 6.09
17. ArmParser (Yerevan) software1-P 6.03
18. BOUN (İstanbul) software2-P 5.66
19. ICS PAS (Warszawa) software1-P 5.02
20. UDPipe Future (Praha) software1-P 4.14
21. IBM NY (Yorktown Heights) software1-P 2.32
22. ParisNLP (Paris) software1-P 1.98
23. SLT-Interactions (Bengaluru) software2-P 1.13
24. HUJI (Yerushalayim) software1-P 1.08
25. iParse (Pittsburgh) software1-P 0.69
26. SParse (İstanbul) software1-P 0.00
id_gsd
1. Stanford (Stanford) software2 68.36 2. Uppsala (Uppsala) software1-P 67.90 3. CEA LIST (Paris) software1-P 67.81 4. UDPipe Future (Praha) software1-P 67.58 5. HIT-SCIR (Harbin) software1-P 67.49 6. ICS PAS (Warszawa) software1-P 67.30 7. TurkuNLP (Turku) software1-P 66.29 8. NLP-Cube (București) software1-P 66.00 9. iParse (Pittsburgh) software1-P 65.80 10. SLT-Interactions (Bengaluru) software2-P 65.76 11. UniMelb (Melbourne) software1-P 65.43 12. ParisNLP (Paris) software1-P 65.06 13. KParse (İstanbul) software1-P 65.02 14. AntNLP (Shanghai) software1-P 64.71 15. LeisureX (Shanghai) software1-P 64.70 16. LATTICE (Paris) software1-P 64.31 17. Fudan (Shanghai) software5-P 63.54 18. Phoenix (Shanghai) software1-P 63.53 19. BASELINE UDPipe 1.2 (Praha) software1-P 63.42 20. BOUN (İstanbul) software2-P 63.22 21. CUNI x-ling (Praha) software1-P 62.03 22. ONLP lab (Ra'anana) software3-P 61.93 23. HUJI (Yerushalayim) software1-P 59.37 24. ArmParser (Yerevan) software1-P 52.51 25. IBM NY (Yorktown Heights) software1-P 37.84 26. SParse (İstanbul) software1-P 0.00
it_isdt
1. Stanford (Stanford) software2 83.89 2. HIT-SCIR (Harbin) software1-P 83.56 3. UDPipe Future (Praha) software1-P 83.46 4. ICS PAS (Warszawa) software1-P 83.18 5. CEA LIST (Paris) software1-P 82.44 6. TurkuNLP (Turku) software1-P 82.33 7. NLP-Cube (București) software1-P 81.57 8. Uppsala (Uppsala) software1-P 81.17 9. LATTICE (Paris) software1-P 80.58 10. iParse (Pittsburgh) software1-P 80.44 11. ParisNLP (Paris) software1-P 80.43 12. UniMelb (Melbourne) software1-P 80.04 13. AntNLP (Shanghai) software1-P 80.00 14. SLT-Interactions (Bengaluru) software2-P 79.79 15. LeisureX (Shanghai) software1-P 79.66 16. SParse (İstanbul) software1-P 78.63 17. Fudan (Shanghai) software5-P 78.54 18. BASELINE UDPipe 1.2 (Praha) software1-P 77.06 19. HUJI (Yerushalayim) software1-P 76.86 20. Phoenix (Shanghai) software1-P 76.61 21. KParse (İstanbul) software1-P 75.50 22. BOUN (İstanbul) software2-P 75.13 23. CUNI x-ling (Praha) software1-P 72.86 24. ONLP lab (Ra'anana) software3-P 72.45 25. ArmParser (Yerevan) software1-P 59.35 26. IBM NY (Yorktown Heights) software1-P 40.13
it_postwita
1. Stanford (Stanford) software2 68.50
2. HIT-SCIR (Harbin) software1-P 67.12
3. Uppsala (Uppsala) software1-P 66.46
4. UDPipe Future (Praha) software1-P 61.29
5. ICS PAS (Warszawa) software1-P 61.14
6. TurkuNLP (Turku) software1-P 59.71
7. CEA LIST (Paris) software1-P 59.12
8. AntNLP (Shanghai) software1-P 58.56
9. LATTICE (Paris) software1-P 58.35
10. SLT-Interactions (Bengaluru) software2-P 57.89
11. UniMelb (Melbourne) software1-P 57.67
12. KParse (İstanbul) software1-P 56.04
13. ParisNLP (Paris) software1-P 55.95
14. NLP-Cube (București) software1-P 55.41
15. Phoenix (Shanghai) software1-P 54.86
16. LeisureX (Shanghai) software1-P 54.38
17. BOUN (İstanbul) software2-P 54.15
18. ONLP lab (Ra'anana) software3-P 53.96
19. BASELINE UDPipe 1.2 (Praha) software1-P 53.64
Fudan (Shanghai) software5-P 53.64
21. CUNI x-ling (Praha) software1-P 53.50
22. HUJI (Yerushalayim) software1-P 52.79
23. ArmParser (Yerevan) software1-P 45.01
24. IBM NY (Yorktown Heights) software1-P 25.68
25. SParse (İstanbul) software1-P 0.00
26. iParse (Pittsburgh) software1-P 0.00
ja_gsd
1. HIT-SCIR (Harbin) software1-P 72.62
2. Stanford (Stanford) software2 67.41
3. Uppsala (Uppsala) software1-P 65.47
4. NLP-Cube (București) software1-P 64.81
5. SLT-Interactions (Bengaluru) software2-P 62.39
6. UDPipe Future (Praha) software1-P 61.99
7. TurkuNLP (Turku) software1-P 61.96
8. LATTICE (Paris) software1-P 61.75
9. CEA LIST (Paris) software1-P 61.74
10. UniMelb (Melbourne) software1-P 61.44
11. ParisNLP (Paris) software1-P 60.38
12. LeisureX (Shanghai) software1-P 60.32
13. IBM NY (Yorktown Heights) software1-P 59.85
14. KParse (İstanbul) software1-P 59.46
15. iParse (Pittsburgh) software1-P 59.41
16. SParse (İstanbul) software1-P 59.10
17. AntNLP (Shanghai) software1-P 58.38
18. BASELINE UDPipe 1.2 (Praha) software1-P 58.35
Fudan (Shanghai) software5-P 58.35
20. BOUN (İstanbul) software2-P 58.04
21. ICS PAS (Warszawa) software1-P 57.82
22. Phoenix (Shanghai) software1-P 57.77
23. CUNI x-ling (Praha) software1-P 56.02
24. ArmParser (Yerevan) software1-P 54.19
25. ONLP lab (Ra'anana) software3-P 52.96
26. HUJI (Yerushalayim) software1-P 35.60
ja_modern
1. Uppsala (Uppsala) software1-P 11.82
2. Stanford (Stanford) software2 11.35
3. SLT-Interactions (Bengaluru) software2-P 11.08
4. KParse (İstanbul) software1-P 8.94
5. HIT-SCIR (Harbin) software1-P 8.73
6. Phoenix (Shanghai) software1-P 8.40
7. ONLP lab (Ra'anana) software3-P 8.29
8. IBM NY (Yorktown Heights) software1-P 8.19
9. BASELINE UDPipe 1.2 (Praha) software1-P 8.10
CEA LIST (Paris) software1-P 8.10
Fudan (Shanghai) software5-P 8.10
LATTICE (Paris) software1-P 8.10
LeisureX (Shanghai) software1-P 8.10
14. CUNI x-ling (Praha) software1-P 8.05
15. UDPipe Future (Praha) software1-P 7.33
16. UniMelb (Melbourne) software1-P 7.09
17. ICS PAS (Warszawa) software1-P 6.53
18. TurkuNLP (Turku) software1-P 5.80
19. BOUN (İstanbul) software2-P 5.02
20. ParisNLP (Paris) software1-P 3.06
21. NLP-Cube (București) software1-P 2.76
22. AntNLP (Shanghai) software1-P 2.69
23. HUJI (Yerushalayim) software1-P 1.99
24. ArmParser (Yerevan) software1-P 0.00
25. SParse (İstanbul) software1-P 0.00
26. iParse (Pittsburgh) software1-P 0.00
kk_ktb
1. CUNI x-ling (Praha) software1-P 8.93
2. Uppsala (Uppsala) software1-P 8.62
3. LATTICE (Paris) software1-P 8.06
4. BASELINE UDPipe 1.2 (Praha) software1-P 7.62
CEA LIST (Paris) software1-P 7.62
LeisureX (Shanghai) software1-P 7.62
UDPipe Future (Praha) software1-P 7.62
UniMelb (Melbourne) software1-P 7.62
9. ArmParser (Yerevan) software1-P 7.54
10. Phoenix (Shanghai) software1-P 7.42
11. KParse (İstanbul) software1-P 5.98
12. ParisNLP (Paris) software1-P 5.88
13. HIT-SCIR (Harbin) software1-P 5.39
14. AntNLP (Shanghai) software1-P 5.07
15. Stanford (Stanford) software2 4.68
16. ICS PAS (Warszawa) software1-P 4.40
17. ONLP lab (Ra'anana) software3-P 4.33
18. IBM NY (Yorktown Heights) software1-P 3.87
19. TurkuNLP (Turku) software1-P 3.50
20. NLP-Cube (București) software1-P 2.69
21. BOUN (İstanbul) software2-P 2.22
22. HUJI (Yerushalayim) software1-P 1.84
23. Fudan (Shanghai) software5-P 1.48
24. SLT-Interactions (Bengaluru) software2-P 0.95
25. SParse (İstanbul) software1-P 0.00
26. iParse (Pittsburgh) software1-P 0.00
kmr_mg
1. IBM NY (Yorktown Heights) software1-P 7.98
2. ONLP lab (Ra'anana) software3-P 7.77
3. CUNI x-ling (Praha) software1-P 6.92
4. NLP-Cube (București) software1-P 5.87
5. Uppsala (Uppsala) software1-P 5.77
6. AntNLP (Shanghai) software1-P 5.69
7. BASELINE UDPipe 1.2 (Praha) software1-P 5.47
CEA LIST (Paris) software1-P 5.47
Fudan (Shanghai) software5-P 5.47
LeisureX (Shanghai) software1-P 5.47
UniMelb (Melbourne) software1-P 5.47
12. LATTICE (Paris) software1-P 5.32
13. Stanford (Stanford) software2 4.38
14. ParisNLP (Paris) software1-P 4.09
15. KParse (İstanbul) software1-P 3.97
16. TurkuNLP (Turku) software1-P 3.44
17. Phoenix (Shanghai) software1-P 2.94
18. BOUN (İstanbul) software2-P 2.59
19. HIT-SCIR (Harbin) software1-P 2.40
UDPipe Future (Praha) software1-P 2.40
21. ICS PAS (Warszawa) software1-P 2.26
22. HUJI (Yerushalayim) software1-P 1.91
23. iParse (Pittsburgh) software1-P 0.63
24. SLT-Interactions (Bengaluru) software2-P 0.55
25. ArmParser (Yerevan) software1-P 0.00
26. SParse (İstanbul) software1-P 0.00
ko_gsd
1. HIT-SCIR (Harbin) software1-P 80.85 2. LATTICE (Paris) software1-P 79.78 3. CEA LIST (Paris) software1-P 79.21 4. TurkuNLP (Turku) software1-P 78.98 5. Stanford (Stanford) software2 78.83 6. UDPipe Future (Praha) software1-P 78.56 7. Uppsala (Uppsala) software1-P 77.25 8. SLT-Interactions (Bengaluru) software2-P 76.51 9. NLP-Cube (București) software1-P 76.44 10. ParisNLP (Paris) software1-P 75.17 11. ICS PAS (Warszawa) software1-P 74.49 12. AntNLP (Shanghai) software1-P 72.65 13. iParse (Pittsburgh) software1-P 72.19 14. UniMelb (Melbourne) software1-P 69.11 15. BOUN (İstanbul) software2-P 69.00 16. LeisureX (Shanghai) software1-P 68.93 17. Fudan (Shanghai) software5-P 68.34 18. KParse (İstanbul) software1-P 67.31 19. HUJI (Yerushalayim) software1-P 55.83 20. BASELINE UDPipe 1.2 (Praha) software1-P 54.10 21. Phoenix (Shanghai) software1-P 51.44 22. ONLP lab (Ra'anana) software3-P 49.99 23. ArmParser (Yerevan) software1-P 49.27 24. CUNI x-ling (Praha) software1-P 44.92 25. IBM NY (Yorktown Heights) software1-P 7.88 26. SParse (İstanbul) software1-P 0.00
ko_kaist
1. HIT-SCIR (Harbin) software1-P 81.29 2. TurkuNLP (Turku) software1-P 81.16 3. CEA LIST (Paris) software1-P 80.48 4. UDPipe Future (Praha) software1-P 80.46 5. Stanford (Stanford) software2 80.40 6. LATTICE (Paris) software1-P 80.15 7. NLP-Cube (București) software1-P 79.50 8. SLT-Interactions (Bengaluru) software2-P 79.07 9. Uppsala (Uppsala) software1-P 78.90 10. ParisNLP (Paris) software1-P 77.49 11. iParse (Pittsburgh) software1-P 77.22 12. AntNLP (Shanghai) software1-P 77.16 13. IBM NY (Yorktown Heights) software1-P 76.99 14. ICS PAS (Warszawa) software1-P 76.92 15. LeisureX (Shanghai) software1-P 76.91 16. Fudan (Shanghai) software5-P 75.55 17. BOUN (İstanbul) software2-P 74.22 18. UniMelb (Melbourne) software1-P 73.13 19. KParse (İstanbul) software1-P 71.49 20. HUJI (Yerushalayim) software1-P 61.94 21. BASELINE UDPipe 1.2 (Praha) software1-P 61.49 22. Phoenix (Shanghai) software1-P 61.48 23. ArmParser (Yerevan) software1-P 55.17 24. CUNI x-ling (Praha) software1-P 53.46 25. ONLP lab (Ra'anana) software3-P 52.62 26. SParse (İstanbul) software1-P 0.00
la_ittb
1. ICS PAS (Warszawa) software1-P 79.84 2. UDPipe Future (Praha) software1-P 79.73 3. Stanford (Stanford) software2 79.39 4. TurkuNLP (Turku) software1-P 79.38 5. CEA LIST (Paris) software1-P 77.97 6. HIT-SCIR (Harbin) software1-P 77.25 7. NLP-Cube (București) software1-P 76.98 8. Uppsala (Uppsala) software1-P 75.38 9. LATTICE (Paris) software1-P 74.87 10. ParisNLP (Paris) software1-P 74.66 11. iParse (Pittsburgh) software1-P 74.29 12. SLT-Interactions (Bengaluru) software2-P 73.85 13. LeisureX (Shanghai) software1-P 73.55 14. AntNLP (Shanghai) software1-P 73.03 15. Fudan (Shanghai) software5-P 70.83 16. BOUN (İstanbul) software2-P 67.78 17. KParse (İstanbul) software1-P 67.49 18. UniMelb (Melbourne) software1-P 66.53 19. BASELINE UDPipe 1.2 (Praha) software1-P 66.08 20. Phoenix (Shanghai) software1-P 65.83 21. HUJI (Yerushalayim) software1-P 64.33 22. CUNI x-ling (Praha) software1-P 62.77 23. IBM NY (Yorktown Heights) software1-P 55.15 24. ONLP lab (Ra'anana) software3-P 54.81 25. ArmParser (Yerevan) software1-P 50.22 26. SParse (İstanbul) software1-P 0.00
la_perseus
1. ICS PAS (Warszawa) software1-P 49.77
2. HIT-SCIR (Harbin) software1-P 42.03
3. TurkuNLP (Turku) software1-P 42.01
4. UDPipe Future (Praha) software1-P 40.75
5. Uppsala (Uppsala) software1-P 37.57
6. LATTICE (Paris) software1-P 37.08
7. AntNLP (Shanghai) software1-P 35.74
8. KParse (İstanbul) software1-P 33.65
9. SLT-Interactions (Bengaluru) software2-P 33.23
10. ParisNLP (Paris) software1-P 32.08
11. BASELINE UDPipe 1.2 (Praha) software1-P 30.16
CEA LIST (Paris) software1-P 30.16
Fudan (Shanghai) software5-P 30.16
LeisureX (Shanghai) software1-P 30.16
15. Stanford (Stanford) software2 29.25
16. NLP-Cube (București) software1-P 29.01
17. Phoenix (Shanghai) software1-P 28.95
18. CUNI x-ling (Praha) software1-P 28.48
19. BOUN (İstanbul) software2-P 26.20
20. ArmParser (Yerevan) software1-P 24.21
21. UniMelb (Melbourne) software1-P 24.04
22. HUJI (Yerushalayim) software1-P 19.71
23. ONLP lab (Ra'anana) software3-P 16.31
24. IBM NY (Yorktown Heights) software1-P 14.68
25. SParse (İstanbul) software1-P 0.00
26. iParse (Pittsburgh) software1-P 0.00
la_proiel
1. Stanford (Stanford) software2 59.36 2. TurkuNLP (Turku) software1-P 59.24 3. CEA LIST (Paris) software1-P 58.79 4. UDPipe Future (Praha) software1-P 58.03 5. HIT-SCIR (Harbin) software1-P 57.64 6. ICS PAS (Warszawa) software1-P 56.82 7. iParse (Pittsburgh) software1-P 53.04 8. ParisNLP (Paris) software1-P 53.02 9. LATTICE (Paris) software1-P 52.24 10. NLP-Cube (București) software1-P 52.18 11. AntNLP (Shanghai) software1-P 51.50 12. Uppsala (Uppsala) software1-P 51.45 13. SLT-Interactions (Bengaluru) software2-P 51.41 14. Fudan (Shanghai) software5-P 50.14 15. LeisureX (Shanghai) software1-P 49.11 16. Phoenix (Shanghai) software1-P 47.79 17. BASELINE UDPipe 1.2 (Praha) software1-P 47.05 18. UniMelb (Melbourne) software1-P 46.77 19. KParse (İstanbul) software1-P 46.36 20. BOUN (İstanbul) software2-P 45.91 21. CUNI x-ling (Praha) software1-P 42.49 22. ArmParser (Yerevan) software1-P 39.71 23. HUJI (Yerushalayim) software1-P 39.56 24. ONLP lab (Ra'anana) software3-P 36.96 25. IBM NY (Yorktown Heights) software1-P 35.92 26. SParse (İstanbul) software1-P 0.00
lv_lvtb
1. Stanford (Stanford) software2 67.89 2. CEA LIST (Paris) software1-P 67.27 3. UDPipe Future (Praha) software1-P 67.24 4. TurkuNLP (Turku) software1-P 67.18 5. ICS PAS (Warszawa) software1-P 66.22 6. HIT-SCIR (Harbin) software1-P 63.95 7. Uppsala (Uppsala) software1-P 63.90 8. NLP-Cube (București) software1-P 61.31 9. ParisNLP (Paris) software1-P 60.19 10. SLT-Interactions (Bengaluru) software2-P 59.31 11. AntNLP (Shanghai) software1-P 58.79 12. LATTICE (Paris) software1-P 57.69 13. KParse (İstanbul) software1-P 57.08 14. UniMelb (Melbourne) software1-P 56.49 15. Fudan (Shanghai) software5-P 55.08 16. LeisureX (Shanghai) software1-P 55.05 17. BASELINE UDPipe 1.2 (Praha) software1-P 54.96 18. Phoenix (Shanghai) software1-P 54.85 19. BOUN (İstanbul) software2-P 54.24 20. CUNI x-ling (Praha) software1-P 52.68 21. HUJI (Yerushalayim) software1-P 49.40 22. ONLP lab (Ra'anana) software3-P 46.27 23. ArmParser (Yerevan) software1-P 46.19 24. IBM NY (Yorktown Heights) software1-P 42.80 25. SParse (İstanbul) software1-P 0.00 26. iParse (Pittsburgh) software1-P 0.00
nl_alpino
1. Stanford (Stanford) software2 76.52
2. UDPipe Future (Praha) software1-P 76.09
3. ICS PAS (Warszawa) software1-P 74.93
4. TurkuNLP (Turku) software1-P 74.45
5. HIT-SCIR (Harbin) software1-P 73.89
6. CEA LIST (Paris) software1-P 73.38
7. NLP-Cube (București) software1-P 72.73
8. Uppsala (Uppsala) software1-P 71.11
9. LATTICE (Paris) software1-P 69.58
10. ParisNLP (Paris) software1-P 69.52
11. AntNLP (Shanghai) software1-P 69.35
12. LeisureX (Shanghai) software1-P 68.47
13. SLT-Interactions (Bengaluru) software2-P 68.26
14. iParse (Pittsburgh) software1-P 67.77
15. UniMelb (Melbourne) software1-P 64.26
16. KParse (İstanbul) software1-P 64.22
17. BASELINE UDPipe 1.2 (Praha) software1-P 61.55
Fudan (Shanghai) software5-P 61.55
19. BOUN (İstanbul) software2-P 60.99
20. HUJI (Yerushalayim) software1-P 60.98
21. Phoenix (Shanghai) software1-P 60.90
22. CUNI x-ling (Praha) software1-P 57.89
23. ONLP lab (Ra'anana) software3-P 56.57
24. ArmParser (Yerevan) software1-P 43.13
25. IBM NY (Yorktown Heights) software1-P 35.11
26. SParse (İstanbul) software1-P 0.00
nl_lassysmall
1. Stanford (Stanford) software2 74.11 2. HIT-SCIR (Harbin) software1-P 73.13 3. ICS PAS (Warszawa) software1-P 72.65 4. UDPipe Future (Praha) software1-P 72.10 5. CEA LIST (Paris) software1-P 70.90 6. Uppsala (Uppsala) software1-P 70.88 7. TurkuNLP (Turku) software1-P 70.36 8. LATTICE (Paris) software1-P 69.83 9. NLP-Cube (București) software1-P 69.25 10. AntNLP (Shanghai) software1-P 68.99 11. ParisNLP (Paris) software1-P 67.44 12. iParse (Pittsburgh) software1-P 66.56 13. SLT-Interactions (Bengaluru) software2-P 66.51 14. LeisureX (Shanghai) software1-P 64.55 15. KParse (İstanbul) software1-P 63.97 16. UniMelb (Melbourne) software1-P 63.82 17. Phoenix (Shanghai) software1-P 61.98 18. BASELINE UDPipe 1.2 (Praha) software1-P 61.85 19. Fudan (Shanghai) software5-P 61.49 20. BOUN (İstanbul) software2-P 61.40 21. HUJI (Yerushalayim) software1-P 61.20 22. CUNI x-ling (Praha) software1-P 61.03 23. ONLP lab (Ra'anana) software3-P 58.26 24. ArmParser (Yerevan) software1-P 47.50 25. IBM NY (Yorktown Heights) software1-P 30.87 26. SParse (İstanbul) software1-P 0.00
no_bokmaal
1. UDPipe Future (Praha) software1-P 83.68 2. Stanford (Stanford) software2 83.56 3. HIT-SCIR (Harbin) software1-P 82.36 4. TurkuNLP (Turku) software1-P 82.10 5. CEA LIST (Paris) software1-P 81.96 6. Uppsala (Uppsala) software1-P 81.68 7. AntNLP (Shanghai) software1-P 80.07 8. ParisNLP (Paris) software1-P 79.58 9. ICS PAS (Warszawa) software1-P 79.51 10. SLT-Interactions (Bengaluru) software2-P 79.43 11. NLP-Cube (București) software1-P 79.28 12. iParse (Pittsburgh) software1-P 79.08 13. LeisureX (Shanghai) software1-P 78.94 14. LATTICE (Paris) software1-P 78.89 15. UniMelb (Melbourne) software1-P 77.18 16. Fudan (Shanghai) software5-P 75.43 17. BASELINE UDPipe 1.2 (Praha) software1-P 74.65 18. Phoenix (Shanghai) software1-P 74.59 19. KParse (İstanbul) software1-P 73.52 20. BOUN (İstanbul) software2-P 72.64 21. CUNI x-ling (Praha) software1-P 72.01 22. HUJI (Yerushalayim) software1-P 71.98 23. ONLP lab (Ra'anana) software3-P 69.77 24. IBM NY (Yorktown Heights) software1-P 47.71 25. ArmParser (Yerevan) software1-P 0.00 26. SParse (İstanbul) software1-P 0.00
no_nynorsk
1. UDPipe Future (Praha) software1-P 81.86
2. Stanford (Stanford) software2 81.76
3. TurkuNLP (Turku) software1-P 81.37
4. HIT-SCIR (Harbin) software1-P 80.89
5. CEA LIST (Paris) software1-P 80.55
6. Uppsala (Uppsala) software1-P 79.42
7. ICS PAS (Warszawa) software1-P 79.32
8. NLP-Cube (București) software1-P 78.33
9. ParisNLP (Paris) software1-P 78.08
10. AntNLP (Shanghai) software1-P 77.98
11. SLT-Interactions (Bengaluru) software2-P 77.71
12. LATTICE (Paris) software1-P 77.24
13. iParse (Pittsburgh) software1-P 76.95
14. LeisureX (Shanghai) software1-P 76.85
15. UniMelb (Melbourne) software1-P 75.55
16. Fudan (Shanghai) software5-P 73.46
17. BASELINE UDPipe 1.2 (Praha) software1-P 72.40
Phoenix (Shanghai) software1-P 72.40
19. KParse (İstanbul) software1-P 70.78
20. CUNI x-ling (Praha) software1-P 69.87
21. BOUN (İstanbul) software2-P 68.49
22. ONLP lab (Ra'anana) software3-P 67.57
23. HUJI (Yerushalayim) software1-P 60.07
24. IBM NY (Yorktown Heights) software1-P 45.33
25. ArmParser (Yerevan) software1-P 0.00
26. SParse (İstanbul) software1-P 0.00
no_nynorsklia
1. ICS PAS (Warszawa) software1-P 57.51
2. HIT-SCIR (Harbin) software1-P 51.39
3. LATTICE (Paris) software1-P 50.03
4. SLT-Interactions (Bengaluru) software2-P 47.84
5. AntNLP (Shanghai) software1-P 46.93
6. UDPipe Future (Praha) software1-P 46.57
7. Uppsala (Uppsala) software1-P 45.51
8. TurkuNLP (Turku) software1-P 44.17
9. CEA LIST (Paris) software1-P 41.73
10. KParse (İstanbul) software1-P 41.01
11. ParisNLP (Paris) software1-P 39.68
12. UniMelb (Melbourne) software1-P 39.12
13. CUNI x-ling (Praha) software1-P 38.23
14. BASELINE UDPipe 1.2 (Praha) software1-P 37.60
LeisureX (Shanghai) software1-P 37.60
16. Phoenix (Shanghai) software1-P 37.24
17. Fudan (Shanghai) software5-P 37.22
18. Stanford (Stanford) software2 36.46
19. BOUN (İstanbul) software2-P 35.58
20. NLP-Cube (București) software1-P 35.31
21. iParse (Pittsburgh) software1-P 33.88
22. ONLP lab (Ra'anana) software3-P 32.58
23. HUJI (Yerushalayim) software1-P 25.97
24. IBM NY (Yorktown Heights) software1-P 24.85
25. ArmParser (Yerevan) software1-P 0.00
26. SParse (İstanbul) software1-P 0.00
pcm_nsc
1. KParse (İstanbul) software1-P 5.30
2. AntNLP (Shanghai) software1-P 4.78
3. BASELINE UDPipe 1.2 (Praha) software1-P 4.60
LeisureX (Shanghai) software1-P 4.60
UniMelb (Melbourne) software1-P 4.60
6. CUNI x-ling (Praha) software1-P 4.59
7. ONLP lab (Ra'anana) software3-P 4.57
8. SLT-Interactions (Bengaluru) software2-P 4.20
9. LATTICE (Paris) software1-P 3.87
10. BOUN (İstanbul) software2-P 3.84
11. UDPipe Future (Praha) software1-P 3.72
12. Uppsala (Uppsala) software1-P 3.55
13. ParisNLP (Paris) software1-P 3.49
14. Phoenix (Shanghai) software1-P 3.42
15. HIT-SCIR (Harbin) software1-P 3.30
16. Stanford (Stanford) software2 3.16
17. TurkuNLP (Turku) software1-P 2.79
18. NLP-Cube (București) software1-P 2.67
19. ICS PAS (Warszawa) software1-P 2.41
20. CEA LIST (Paris) software1-P 2.35
21. Fudan (Shanghai) software5-P 1.80
22. HUJI (Yerushalayim) software1-P 0.22
23. IBM NY (Yorktown Heights) software1-P 0.14
24. ArmParser (Yerevan) software1-P 0.00
25. SParse (İstanbul) software1-P 0.00
26. iParse (Pittsburgh) software1-P 0.00
pl_lfg
1. UDPipe Future (Praha) software1-P 86.93 2. Stanford (Stanford) software2 86.62 3. ICS PAS (Warszawa) software1-P 86.44 4. CEA LIST (Paris) software1-P 86.26 5. TurkuNLP (Turku) software1-P 86.00 6. Uppsala (Uppsala) software1-P 84.09 7. NLP-Cube (București) software1-P 82.67 8. HIT-SCIR (Harbin) software1-P 77.88 9. ParisNLP (Paris) software1-P 76.96 10. SLT-Interactions (Bengaluru) software2-P 76.78 11. LATTICE (Paris) software1-P 76.47 12. UniMelb (Melbourne) software1-P 76.32 13. iParse (Pittsburgh) software1-P 76.10 14. AntNLP (Shanghai) software1-P 75.25 15. Fudan (Shanghai) software5-P 75.24 16. LeisureX (Shanghai) software1-P 74.89 17. BASELINE UDPipe 1.2 (Praha) software1-P 74.54 18. Phoenix (Shanghai) software1-P 74.48 19. CUNI x-ling (Praha) software1-P 73.17 20. HUJI (Yerushalayim) software1-P 72.91 21. KParse (İstanbul) software1-P 71.96 22. BOUN (İstanbul) software2-P 71.71 23. IBM NY (Yorktown Heights) software1-P 70.06 24. ArmParser (Yerevan) software1-P 62.64 25. ONLP lab (Ra'anana) software3-P 60.48 26. SParse (İstanbul) software1-P 0.00
pl_sz
1. Stanford (Stanford) software2 80.77
2. ICS PAS (Warszawa) software1-P 80.45
3. CEA LIST (Paris) software1-P 80.44
4. TurkuNLP (Turku) software1-P 80.24
5. UDPipe Future (Praha) software1-P 79.76
6. Uppsala (Uppsala) software1-P 77.28
7. NLP-Cube (București) software1-P 74.06
8. HIT-SCIR (Harbin) software1-P 69.05
9. ParisNLP (Paris) software1-P 67.31
10. SLT-Interactions (Bengaluru) software2-P 67.05
11. LATTICE (Paris) software1-P 66.44
12. iParse (Pittsburgh) software1-P 65.70
13. UniMelb (Melbourne) software1-P 65.31
14. LeisureX (Shanghai) software1-P 64.03
15. BASELINE UDPipe 1.2 (Praha) software1-P 63.84
Fudan (Shanghai) software5-P 63.84
17. KParse (İstanbul) software1-P 63.76
18. Phoenix (Shanghai) software1-P 63.49
19. AntNLP (Shanghai) software1-P 63.26
20. HUJI (Yerushalayim) software1-P 62.86
21. CUNI x-ling (Praha) software1-P 62.66
22. BOUN (İstanbul) software2-P 61.89
23. ONLP lab (Ra'anana) software3-P 54.81
24. IBM NY (Yorktown Heights) software1-P 54.27
25. ArmParser (Yerevan) software1-P 52.29
26. SParse (İstanbul) software1-P 0.00
pt_bosque
1. Stanford (Stanford) software2 75.94
2. CEA LIST (Paris) software1-P 75.72
3. ICS PAS (Warszawa) software1-P 74.31
4. TurkuNLP (Turku) software1-P 74.29
5. UDPipe Future (Praha) software1-P 74.16
6. HIT-SCIR (Harbin) software1-P 73.33
7. AntNLP (Shanghai) software1-P 71.85
8. Uppsala (Uppsala) software1-P 71.76
9. ParisNLP (Paris) software1-P 71.73
10. LATTICE (Paris) software1-P 71.58
11. iParse (Pittsburgh) software1-P 70.99
12. LeisureX (Shanghai) software1-P 70.70
13. NLP-Cube (București) software1-P 70.62
SLT-Interactions (Bengaluru) software2-P 70.62
15. UniMelb (Melbourne) software1-P 69.35
16. Fudan (Shanghai) software5-P 68.84
17. KParse (İstanbul) software1-P 68.01
18. BOUN (İstanbul) software2-P 67.97
19. BASELINE UDPipe 1.2 (Praha) software1-P 67.40
20. Phoenix (Shanghai) software1-P 67.29
21. HUJI (Yerushalayim) software1-P 66.41
22. CUNI x-ling (Praha) software1-P 65.42
23. ONLP lab (Ra'anana) software3-P 62.64
24. ArmParser (Yerevan) software1-P 52.90
25. IBM NY (Yorktown Heights) software1-P 47.78
26. SParse (İstanbul) software1-P 0.00
ro_rrt
1. TurkuNLP (Turku) software1-P 78.68 2. Stanford (Stanford) software2 78.62 3. UDPipe Future (Praha) software1-P 77.94 4. CEA LIST (Paris) software1-P 77.70 5. HIT-SCIR (Harbin) software1-P 77.47 6. ICS PAS (Warszawa) software1-P 76.84 7. AntNLP (Shanghai) software1-P 76.29 8. NLP-Cube (București) software1-P 76.26 9. ParisNLP (Paris) software1-P 76.02 10. Uppsala (Uppsala) software1-P 76.00 11. LeisureX (Shanghai) software1-P 74.60 12. LATTICE (Paris) software1-P 74.45 13. SLT-Interactions (Bengaluru) software2-P 73.98 14. KParse (İstanbul) software1-P 72.39 15. UniMelb (Melbourne) software1-P 72.38 16. Phoenix (Shanghai) software1-P 71.61 17. Fudan (Shanghai) software5-P 71.60 18. BASELINE UDPipe 1.2 (Praha) software1-P 71.48 19. BOUN (İstanbul) software2-P 71.00 20. HUJI (Yerushalayim) software1-P 70.57 21. IBM NY (Yorktown Heights) software1-P 68.89 22. CUNI x-ling (Praha) software1-P 68.21 23. ONLP lab (Ra'anana) software3-P 63.78 24. ArmParser (Yerevan) software1-P 56.43 25. SParse (İstanbul) software1-P 0.00 26. iParse (Pittsburgh) software1-P 0.00
ru_syntagrus
1. UDPipe Future (Praha) software1-P 86.76 2. TurkuNLP (Turku) software1-P 85.81 3. ICS PAS (Warszawa) software1-P 85.37 4. Stanford (Stanford) software2 85.12 5. NLP-Cube (București) software1-P 84.09 6. CEA LIST (Paris) software1-P 83.27 7. HIT-SCIR (Harbin) software1-P 82.73 8. ParisNLP (Paris) software1-P 81.74 9. LATTICE (Paris) software1-P 81.38 10. Uppsala (Uppsala) software1-P 81.01 11. LeisureX (Shanghai) software1-P 80.63 12. AntNLP (Shanghai) software1-P 80.59 13. SLT-Interactions (Bengaluru) software2-P 79.60 14. UniMelb (Melbourne) software1-P 78.48 15. Fudan (Shanghai) software5-P 78.00 16. Phoenix (Shanghai) software1-P 76.95 17. BASELINE UDPipe 1.2 (Praha) software1-P 76.87 18. BOUN (İstanbul) software2-P 76.43 19. KParse (İstanbul) software1-P 73.69 20. CUNI x-ling (Praha) software1-P 71.46 21. HUJI (Yerushalayim) software1-P 68.69 22. ONLP lab (Ra'anana) software3-P 66.49 23. ArmParser (Yerevan) software1-P 60.05 24. IBM NY (Yorktown Heights) software1-P 57.10 25. SParse (İstanbul) software1-P 0.00 26. iParse (Pittsburgh) software1-P 0.00
ru_taiga
1. ICS PAS (Warszawa) software1-P 61.59
2. Uppsala (Uppsala) software1-P 46.07
3. LATTICE (Paris) software1-P 46.06
4. TurkuNLP (Turku) software1-P 46.04
5. UDPipe Future (Praha) software1-P 44.93
6. HIT-SCIR (Harbin) software1-P 44.75
7. AntNLP (Shanghai) software1-P 43.48
8. CEA LIST (Paris) software1-P 40.90
9. KParse (İstanbul) software1-P 39.41
10. NLP-Cube (București) software1-P 39.17
11. Stanford (Stanford) software2 38.95
12. IBM NY (Yorktown Heights) software1-P 38.58
13. ParisNLP (Paris) software1-P 38.46
14. BASELINE UDPipe 1.2 (Praha) software1-P 36.79
LeisureX (Shanghai) software1-P 36.79
16. CUNI x-ling (Praha) software1-P 36.47
17. Fudan (Shanghai) software5-P 36.05
18. Phoenix (Shanghai) software1-P 36.04
19. iParse (Pittsburgh) software1-P 35.27
20. SLT-Interactions (Bengaluru) software2-P 34.84
21. ArmParser (Yerevan) software1-P 32.95
22. UniMelb (Melbourne) software1-P 31.97
23. ONLP lab (Ra'anana) software3-P 31.77
24. BOUN (İstanbul) software2-P 29.00
25. HUJI (Yerushalayim) software1-P 19.82
26. SParse (İstanbul) software1-P 0.00
sk_snk
1. Stanford (Stanford) software2 75.01 2. CEA LIST (Paris) software1-P 73.44 3. UDPipe Future (Praha) software1-P 72.08 4. TurkuNLP (Turku) software1-P 71.85 5. Uppsala (Uppsala) software1-P 71.15 6. NLP-Cube (București) software1-P 66.99 7. ICS PAS (Warszawa) software1-P 63.97 8. HIT-SCIR (Harbin) software1-P 62.91 9. SLT-Interactions (Bengaluru) software2-P 59.27 10. ParisNLP (Paris) software1-P 58.52 11. AntNLP (Shanghai) software1-P 56.88 12. iParse (Pittsburgh) software1-P 56.66 13. LATTICE (Paris) software1-P 56.58 14. UniMelb (Melbourne) software1-P 56.34 15. LeisureX (Shanghai) software1-P 55.02 16. Fudan (Shanghai) software5-P 54.95 17. BASELINE UDPipe 1.2 (Praha) software1-P 54.38 18. Phoenix (Shanghai) software1-P 54.22 19. BOUN (İstanbul) software2-P 53.95 20. KParse (İstanbul) software1-P 53.49 21. CUNI x-ling (Praha) software1-P 53.33 22. IBM NY (Yorktown Heights) software1-P 52.20 23. HUJI (Yerushalayim) software1-P 51.64 24. ONLP lab (Ra'anana) software3-P 48.45 25. ArmParser (Yerevan) software1-P 44.16 26. SParse (İstanbul) software1-P 0.00
sl_ssj
1. Stanford (Stanford) software2 82.38 2. CEA LIST (Paris) software1-P 78.65 3. UDPipe Future (Praha) software1-P 77.95 4. Uppsala (Uppsala) software1-P 77.81 5. TurkuNLP (Turku) software1-P 77.76 6. NLP-Cube (București) software1-P 76.83 7. ICS PAS (Warszawa) software1-P 75.07 8. HIT-SCIR (Harbin) software1-P 73.10 9. ParisNLP (Paris) software1-P 67.85 10. SLT-Interactions (Bengaluru) software2-P 67.70 11. LATTICE (Paris) software1-P 67.35 12. AntNLP (Shanghai) software1-P 66.90 13. LeisureX (Shanghai) software1-P 65.00 14. UniMelb (Melbourne) software1-P 64.43 15. Fudan (Shanghai) software5-P 63.63 16. BASELINE UDPipe 1.2 (Praha) software1-P 63.47 17. Phoenix (Shanghai) software1-P 63.24 18. KParse (İstanbul) software1-P 62.94 19. BOUN (İstanbul) software2-P 62.89 20. CUNI x-ling (Praha) software1-P 61.56 21. HUJI (Yerushalayim) software1-P 61.49 22. IBM NY (Yorktown Heights) software1-P 57.73 23. ONLP lab (Ra'anana) software3-P 57.51 24. ArmParser (Yerevan) software1-P 49.41 25. SParse (İstanbul) software1-P 0.00 26. iParse (Pittsburgh) software1-P 0.00
sl_sst
1. ICS PAS (Warszawa) software1-P 45.93
2. HIT-SCIR (Harbin) software1-P 41.74
3. Uppsala (Uppsala) software1-P 41.22
4. TurkuNLP (Turku) software1-P 40.25
5. UDPipe Future (Praha) software1-P 40.24
6. AntNLP (Shanghai) software1-P 38.69
7. LATTICE (Paris) software1-P 38.45
8. SLT-Interactions (Bengaluru) software2-P 35.58
9. ParisNLP (Paris) software1-P 35.21
10. Stanford (Stanford) software2 34.93
11. KParse (İstanbul) software1-P 34.66
12. BASELINE UDPipe 1.2 (Praha) software1-P 34.19
CEA LIST (Paris) software1-P 34.19
LeisureX (Shanghai) software1-P 34.19
15. Phoenix (Shanghai) software1-P 33.39
16. NLP-Cube (București) software1-P 33.27
17. CUNI x-ling (Praha) software1-P 33.00
18. BOUN (İstanbul) software2-P 32.07
19. UniMelb (Melbourne) software1-P 31.86
20. ArmParser (Yerevan) software1-P 31.52
21. iParse (Pittsburgh) software1-P 30.43
22. Fudan (Shanghai) software5-P 30.05
23. ONLP lab (Ra'anana) software3-P 28.96
24. HUJI (Yerushalayim) software1-P 27.58
25. IBM NY (Yorktown Heights) software1-P 19.54
26. SParse (İstanbul) software1-P 0.00
sme_giella
1. TurkuNLP (Turku) software1-P 57.47
2. UDPipe Future (Praha) software1-P 54.07
3. Uppsala (Uppsala) software1-P 51.67
4. LATTICE (Paris) software1-P 50.65
5. Fudan (Shanghai) software5-P 49.82
6. iParse (Pittsburgh) software1-P 49.73
7. HIT-SCIR (Harbin) software1-P 49.47
8. ParisNLP (Paris) software1-P 48.73
9. Phoenix (Shanghai) software1-P 46.35
10. BASELINE UDPipe 1.2 (Praha) software1-P 46.05
CEA LIST (Paris) software1-P 46.05
LeisureX (Shanghai) software1-P 46.05
13. CUNI x-ling (Praha) software1-P 45.12
14. BOUN (İstanbul) software2-P 42.13
15. AntNLP (Shanghai) software1-P 40.94
16. UniMelb (Melbourne) software1-P 40.71
17. NLP-Cube (București) software1-P 39.90
18. ICS PAS (Warszawa) software1-P 39.66
19. KParse (İstanbul) software1-P 39.13
20. ONLP lab (Ra'anana) software3-P 37.23
21. Stanford (Stanford) software2 34.05
22. IBM NY (Yorktown Heights) software1-P 28.37
23. SLT-Interactions (Bengaluru) software2-P 8.53
24. HUJI (Yerushalayim) software1-P 3.58
25. ArmParser (Yerevan) software1-P 0.00
26. SParse (İstanbul) software1-P 0.00
sr_set
1. UDPipe Future (Praha) software1-P 77.73 2. Stanford (Stanford) software2 77.69 3. TurkuNLP (Turku) software1-P 77.42 4. CEA LIST (Paris) software1-P 76.95 5. Uppsala (Uppsala) software1-P 75.54 6. ICS PAS (Warszawa) software1-P 73.79 7. NLP-Cube (București) software1-P 73.71 8. HIT-SCIR (Harbin) software1-P 72.90 9. ParisNLP (Paris) software1-P 72.20 10. AntNLP (Shanghai) software1-P 71.55 11. iParse (Pittsburgh) software1-P 71.03 12. LeisureX (Shanghai) software1-P 70.68 13. BASELINE UDPipe 1.2 (Praha) software1-P 70.04 14. Phoenix (Shanghai) software1-P 69.61 15. LATTICE (Paris) software1-P 69.54 16. SLT-Interactions (Bengaluru) software2-P 69.31 17. UniMelb (Melbourne) software1-P 69.20 18. Fudan (Shanghai) software5-P 67.95 19. KParse (İstanbul) software1-P 67.46 20. CUNI x-ling (Praha) software1-P 67.23 21. HUJI (Yerushalayim) software1-P 65.21 22. ONLP lab (Ra'anana) software3-P 64.70 23. BOUN (İstanbul) software2-P 62.84 24. IBM NY (Yorktown Heights) software1-P 62.78 25. ArmParser (Yerevan) software1-P 53.55 26. SParse (İstanbul) software1-P 0.00
sv_lines
1. Stanford (Stanford) software2 66.58 2. ICS PAS (Warszawa) software1-P 66.26 3. TurkuNLP (Turku) software1-P 66.04 4. HIT-SCIR (Harbin) software1-P 65.87 5. CEA LIST (Paris) software1-P 65.84 6. UDPipe Future (Praha) software1-P 65.77 7. Uppsala (Uppsala) software1-P 65.38 8. NLP-Cube (București) software1-P 64.33 9. LATTICE (Paris) software1-P 63.00 10. AntNLP (Shanghai) software1-P 62.99 11. ParisNLP (Paris) software1-P 61.59 12. SLT-Interactions (Bengaluru) software2-P 61.32 13. UniMelb (Melbourne) software1-P 60.61 14. iParse (Pittsburgh) software1-P 60.26 15. KParse (İstanbul) software1-P 59.72 16. LeisureX (Shanghai) software1-P 59.25 17. BASELINE UDPipe 1.2 (Praha) software1-P 58.62 18. Fudan (Shanghai) software5-P 58.44 19. Phoenix (Shanghai) software1-P 58.42 20. BOUN (İstanbul) software2-P 57.75 21. CUNI x-ling (Praha) software1-P 57.53 22. HUJI (Yerushalayim) software1-P 55.90 23. ONLP lab (Ra'anana) software3-P 54.28 24. ArmParser (Yerevan) software1-P 40.10 25. IBM NY (Yorktown Heights) software1-P 36.52 26. SParse (İstanbul) software1-P 0.00
sv_pud
1. TurkuNLP (Turku) software1-P 51.74
2. ICS PAS (Warszawa) software1-P 51.64
3. Stanford (Stanford) software2 51.32
4. UDPipe Future (Praha) software1-P 49.90
5. Uppsala (Uppsala) software1-P 49.73
6. NLP-Cube (București) software1-P 48.35
7. LATTICE (Paris) software1-P 47.10
8. AntNLP (Shanghai) software1-P 46.43
9. BASELINE UDPipe 1.2 (Praha) software1-P 43.38
Fudan (Shanghai) software5-P 43.38
11. Phoenix (Shanghai) software1-P 43.16
12. KParse (İstanbul) software1-P 43.04
13. CEA LIST (Paris) software1-P 42.80
14. SLT-Interactions (Bengaluru) software2-P 42.73
15. ParisNLP (Paris) software1-P 42.69
16. iParse (Pittsburgh) software1-P 42.15
17. CUNI x-ling (Praha) software1-P 42.13
18. UniMelb (Melbourne) software1-P 41.81
19. HIT-SCIR (Harbin) software1-P 41.79
20. HUJI (Yerushalayim) software1-P 38.82
21. BOUN (İstanbul) software2-P 37.53
22. LeisureX (Shanghai) software1-P 35.44
23. IBM NY (Yorktown Heights) software1-P 30.75
24. ONLP lab (Ra'anana) software3-P 16.79
25. ArmParser (Yerevan) software1-P 0.00
26. SParse (İstanbul) software1-P 0.00
sv_talbanken
1. Stanford (Stanford) software2 79.32
2. UDPipe Future (Praha) software1-P 79.08
3. TurkuNLP (Turku) software1-P 78.67
4. HIT-SCIR (Harbin) software1-P 78.63
5. CEA LIST (Paris) software1-P 78.19
6. ICS PAS (Warszawa) software1-P 77.68
7. Uppsala (Uppsala) software1-P 76.74
8. NLP-Cube (București) software1-P 75.03
9. LATTICE (Paris) software1-P 74.59
10. ParisNLP (Paris) software1-P 73.98
11. SLT-Interactions (Bengaluru) software2-P 73.69
12. AntNLP (Shanghai) software1-P 73.44
13. iParse (Pittsburgh) software1-P 71.86
14. LeisureX (Shanghai) software1-P 71.64
15. UniMelb (Melbourne) software1-P 71.37
16. KParse (İstanbul) software1-P 69.25
17. BASELINE UDPipe 1.2 (Praha) software1-P 69.22
Fudan (Shanghai) software5-P 69.22
19. Phoenix (Shanghai) software1-P 68.88
20. BOUN (İstanbul) software2-P 67.83
21. CUNI x-ling (Praha) software1-P 66.12
22. ONLP lab (Ra'anana) software3-P 65.84
23. HUJI (Yerushalayim) software1-P 64.89
24. IBM NY (Yorktown Heights) software1-P 47.28
25. ArmParser (Yerevan) software1-P 46.89
26. SParse (İstanbul) software1-P 0.00
th_pud
1. CUNI x-ling (Praha) software1-P 6.29
2. Uppsala (Uppsala) software1-P 2.22
3. TurkuNLP (Turku) software1-P 1.66
4. HIT-SCIR (Harbin) software1-P 0.20
5. CEA LIST (Paris) software1-P 0.16
6. SLT-Interactions (Bengaluru) software2-P 0.10
7. AntNLP (Shanghai) software1-P 0.04
BOUN (İstanbul) software2-P 0.04
KParse (İstanbul) software1-P 0.04
UDPipe Future (Praha) software1-P 0.04
11. BASELINE UDPipe 1.2 (Praha) software1-P 0.03
Fudan (Shanghai) software5-P 0.03
Stanford (Stanford) software2 0.03
UniMelb (Melbourne) software1-P 0.03
15. LATTICE (Paris) software1-P 0.01
LeisureX (Shanghai) software1-P 0.01
Phoenix (Shanghai) software1-P 0.01
18. ArmParser (Yerevan) software1-P 0.00
19. HUJI (Yerushalayim) software1-P 0.00
IBM NY (Yorktown Heights) software1-P 0.00
ICS PAS (Warszawa) software1-P 0.00
NLP-Cube (București) software1-P 0.00
ONLP lab (Ra'anana) software3-P 0.00
ParisNLP (Paris) software1-P 0.00
SParse (İstanbul) software1-P 0.00
iParse (Pittsburgh) software1-P 0.00
tr_imst
1. Stanford (Stanford) software2 55.73
TurkuNLP (Turku) software1-P 55.73
3. CEA LIST (Paris) software1-P 55.00
4. UDPipe Future (Praha) software1-P 54.02
5. HIT-SCIR (Harbin) software1-P 53.81
6. ICS PAS (Warszawa) software1-P 52.51
7. Uppsala (Uppsala) software1-P 51.23
8. SLT-Interactions (Bengaluru) software2-P 50.02
9. NLP-Cube (București) software1-P 48.76
10. iParse (Pittsburgh) software1-P 48.65
11. ParisNLP (Paris) software1-P 48.32
12. KParse (İstanbul) software1-P 48.28
13. AntNLP (Shanghai) software1-P 48.01
14. UniMelb (Melbourne) software1-P 47.06
15. LATTICE (Paris) software1-P 46.92
16. IBM NY (Yorktown Heights) software1-P 46.34
17. Fudan (Shanghai) software5-P 45.09
18. Phoenix (Shanghai) software1-P 44.99
19. BASELINE UDPipe 1.2 (Praha) software1-P 44.50
20. LeisureX (Shanghai) software1-P 44.49
21. CUNI x-ling (Praha) software1-P 40.66
22. BOUN (İstanbul) software2-P 40.54
23. ArmParser (Yerevan) software1-P 38.40
24. ONLP lab (Ra'anana) software3-P 34.37
25. HUJI (Yerushalayim) software1-P 33.42
26. SParse (İstanbul) software1-P 0.00
ug_udt
1. UDPipe Future (Praha) software1-P 45.78 2. HIT-SCIR (Harbin) software1-P 44.75 3. TurkuNLP (Turku) software1-P 43.89 4. CEA LIST (Paris) software1-P 43.82 5. Stanford (Stanford) software2 43.24 6. Uppsala (Uppsala) software1-P 42.54 7. SLT-Interactions (Bengaluru) software2-P 42.41 8. AntNLP (Shanghai) software1-P 41.30 9. ParisNLP (Paris) software1-P 40.73 10. ICS PAS (Warszawa) software1-P 40.71 11. UniMelb (Melbourne) software1-P 39.58 12. LATTICE (Paris) software1-P 39.27 13. NLP-Cube (București) software1-P 38.48 14. LeisureX (Shanghai) software1-P 37.46 15. BASELINE UDPipe 1.2 (Praha) software1-P 36.82 16. KParse (İstanbul) software1-P 36.63 17. Phoenix (Shanghai) software1-P 36.26 18. Fudan (Shanghai) software5-P 36.09 19. BOUN (İstanbul) software2-P 35.98 20. CUNI x-ling (Praha) software1-P 34.58 21. ArmParser (Yerevan) software1-P 29.98 22. ONLP lab (Ra'anana) software3-P 28.89 23. HUJI (Yerushalayim) software1-P 28.02 24. IBM NY (Yorktown Heights) software1-P 24.82 25. SParse (İstanbul) software1-P 0.00 26. iParse (Pittsburgh) software1-P 0.00
uk_iu
1. UDPipe Future (Praha) software1-P 72.27
2. TurkuNLP (Turku) software1-P 71.91
3. Stanford (Stanford) software2 71.84
4. CEA LIST (Paris) software1-P 71.12
5. ICS PAS (Warszawa) software1-P 69.88
6. NLP-Cube (București) software1-P 66.86
7. HIT-SCIR (Harbin) software1-P 64.92
8. ParisNLP (Paris) software1-P 59.99
9. SLT-Interactions (Bengaluru) software2-P 59.92
10. Uppsala (Uppsala) software1-P 59.15
11. AntNLP (Shanghai) software1-P 59.09
12. LATTICE (Paris) software1-P 58.12
13. KParse (İstanbul) software1-P 57.10
14. LeisureX (Shanghai) software1-P 56.96
15. UniMelb (Melbourne) software1-P 56.80
16. BASELINE UDPipe 1.2 (Praha) software1-P 56.78
Fudan (Shanghai) software5-P 56.78
18. Phoenix (Shanghai) software1-P 56.56
19. BOUN (İstanbul) software2-P 56.38
20. CUNI x-ling (Praha) software1-P 55.01
21. HUJI (Yerushalayim) software1-P 53.92
22. IBM NY (Yorktown Heights) software1-P 53.23
23. ONLP lab (Ra'anana) software3-P 51.42
24. ArmParser (Yerevan) software1-P 45.79
25. SParse (İstanbul) software1-P 0.00
26. iParse (Pittsburgh) software1-P 0.00
ur_udtb
1. TurkuNLP (Turku) software1-P 57.98 2. Stanford (Stanford) software2 57.02 3. CEA LIST (Paris) software1-P 56.85 4. ICS PAS (Warszawa) software1-P 55.70 5. NLP-Cube (București) software1-P 55.29 6. UDPipe Future (Praha) software1-P 54.72 7. HIT-SCIR (Harbin) software1-P 53.99 8. SLT-Interactions (Bengaluru) software2-P 52.72 9. ParisNLP (Paris) software1-P 52.34 10. iParse (Pittsburgh) software1-P 52.19 11. Uppsala (Uppsala) software1-P 52.15 12. AntNLP (Shanghai) software1-P 52.10 13. LeisureX (Shanghai) software1-P 51.65 14. UniMelb (Melbourne) software1-P 51.41 15. KParse (İstanbul) software1-P 51.25 16. LATTICE (Paris) software1-P 51.00 17. Fudan (Shanghai) software5-P 50.78 18. BOUN (İstanbul) software2-P 50.47 19. Phoenix (Shanghai) software1-P 50.35 20. BASELINE UDPipe 1.2 (Praha) software1-P 50.31 21. CUNI x-ling (Praha) software1-P 49.41 22. ONLP lab (Ra'anana) software3-P 48.80 23. IBM NY (Yorktown Heights) software1-P 46.54 24. HUJI (Yerushalayim) software1-P 45.66 25. ArmParser (Yerevan) software1-P 39.86 26. SParse (İstanbul) software1-P 0.00
vi_vtb
1. HIT-SCIR (Harbin) software1-P 47.61 2. Stanford (Stanford) software2 40.83 3. UDPipe Future (Praha) software1-P 40.26 4. Uppsala (Uppsala) software1-P 40.03 5. CEA LIST (Paris) software1-P 37.98 6. NLP-Cube (București) software1-P 37.10 7. TurkuNLP (Turku) software1-P 36.62 8. AntNLP (Shanghai) software1-P 35.52 9. ParisNLP (Paris) software1-P 35.45 10. ICS PAS (Warszawa) software1-P 35.11 11. UniMelb (Melbourne) software1-P 34.84 12. iParse (Pittsburgh) software1-P 34.40 13. LeisureX (Shanghai) software1-P 34.18 14. KParse (İstanbul) software1-P 33.88 15. LATTICE (Paris) software1-P 33.82 16. BASELINE UDPipe 1.2 (Praha) software1-P 33.49 17. HUJI (Yerushalayim) software1-P 33.05 18. Phoenix (Shanghai) software1-P 33.04 19. Fudan (Shanghai) software5-P 32.33 20. ONLP lab (Ra'anana) software3-P 32.18 21. SLT-Interactions (Bengaluru) software2-P 31.34 22. CUNI x-ling (Praha) software1-P 30.94 23. ArmParser (Yerevan) software1-P 29.31 24. BOUN (İstanbul) software2-P 25.90 25. IBM NY (Yorktown Heights) software1-P 4.37 26. SParse (İstanbul) software1-P 0.00
zh_gsd
1. HIT-SCIR (Harbin) software1-P 66.62 2. Stanford (Stanford) software2 62.26 3. Uppsala (Uppsala) software1-P 59.53 4. NLP-Cube (București) software1-P 59.22 5. LATTICE (Paris) software1-P 58.61 6. TurkuNLP (Turku) software1-P 57.28 7. UDPipe Future (Praha) software1-P 55.97 8. CEA LIST (Paris) software1-P 55.20 9. ICS PAS (Warszawa) software1-P 53.48 10. UniMelb (Melbourne) software1-P 53.02 11. ParisNLP (Paris) software1-P 52.47 12. iParse (Pittsburgh) software1-P 52.11 13. LeisureX (Shanghai) software1-P 51.64 14. AntNLP (Shanghai) software1-P 50.89 15. KParse (İstanbul) software1-P 50.87 16. IBM NY (Yorktown Heights) software1-P 50.40 17. Fudan (Shanghai) software5-P 49.17 18. BASELINE UDPipe 1.2 (Praha) software1-P 48.49 19. Phoenix (Shanghai) software1-P 48.13 20. CUNI x-ling (Praha) software1-P 47.17 21. ONLP lab (Ra'anana) software3-P 46.88 22. BOUN (İstanbul) software2-P 46.55 23. ArmParser (Yerevan) software1-P 45.66 24. SLT-Interactions (Bengaluru) software2-P 45.51 25. HUJI (Yerushalayim) software1-P 43.72 26. SParse (İstanbul) software1-P 0.00