Results: Lemmas F1
All treebanks
1. HIT-SCIR (Harbin) software4 83.74 2. LIMSI-LIPN (Paris) software2 82.64 3. TurkuNLP (Turku) software1 82.64 4. darc (Tübingen) software1 82.60 5. MQuni (Sydney) software2 82.46 LATTICE (Paris) software7 82.46 7. IIT Kharagpur (Kharagpur) software3 82.46 NAIST SATO (Nara) software1 82.46 naistCL (Nara) software1 82.46 UALING (Tucson) software1 82.46 Koç University (İstanbul) software3 82.46 Stanford (Stanford) software1 82.46 C2L2 (Ithaca) software5 82.46 CLCL (Genève) software2 82.46 15. UParse (Edinburgh) software1 82.46 16. BASELINE UDPipe 1.1 (Praha) software2 82.45 17. Wanghao-ftd-SJTU (Shanghai) software2 81.63 18. Mengest (Shanghai) software1 80.52 19. LyS-FASTPARSE (A Coruña) software5 79.14 20. RACAI (București) software1 77.45 21. ParisNLP (Paris) software1 75.32 22. MetaRomance (Santiago de Compostela) software1 72.05 23. ÚFAL – UDPipe 1.2 (Praha) software1 71.17 24. IMS (Stuttgart) software2 62.83 25. TRL (Tokyo) software1 53.71 26. Wenba-NLU (Wuhan) software1 52.59 27. OpenU NLP Lab (Ra'anana) software6 46.69 28. UT (Tartu) software1 16.89 29. Orange – Deskiñ (Lannion) software1 15.38 METU (Ankara) software2 15.38 31. Uppsala (Uppsala) software1 15.28 32. fbaml (Palo Alto) software1 15.22 33. ECNU (Shanghai) software1 8.50
Big treebanks only
Macro-average Lemmas-F1 of the 55 big treebanks: ar, bg, ca, cs, cs_cac, cs_cltt, cu, da, de, el, en, en_lines, en_partut, es, es_ancora, et, eu, fa, fi, fi_ftb, fr, fr_sequoia, gl, got, grc, grc_proiel, he, hi, hr, hu, id, it, ja, ko, la_ittb, la_proiel, lv, nl, nl_lassysmall, no_bokmaal, no_nynorsk, pl, pt, pt_br, ro, ru, ru_syntagrus, sk, sl, sv, sv_lines, tr, ur, vi, zh. These are the treebanks that have development data available, hence these results should be comparable to the performance of the systems on the development data.
1. HIT-SCIR (Harbin) software4 93.21 2. LIMSI-LIPN (Paris) software2 93.14 3. darc (Tübingen) software1 93.09 4. TurkuNLP (Turku) software1 93.05 5. IIT Kharagpur (Kharagpur) software3 92.94 6. NAIST SATO (Nara) software1 92.94 MQuni (Sydney) software2 92.94 LATTICE (Paris) software7 92.94 naistCL (Nara) software1 92.94 Stanford (Stanford) software1 92.94 11. UParse (Edinburgh) software1 92.94 UALING (Tucson) software1 92.94 Koç University (İstanbul) software3 92.94 C2L2 (Ithaca) software5 92.94 Mengest (Shanghai) software1 92.94 CLCL (Genève) software2 92.94 17. BASELINE UDPipe 1.1 (Praha) software2 92.94 18. Wanghao-ftd-SJTU (Shanghai) software2 91.91 19. LyS-FASTPARSE (A Coruña) software5 89.12 20. RACAI (București) software1 87.65 21. ParisNLP (Paris) software1 84.22 22. ÚFAL – UDPipe 1.2 (Praha) software1 81.27 23. MetaRomance (Santiago de Compostela) software1 80.88 24. Wenba-NLU (Wuhan) software1 77.45 25. IMS (Stuttgart) software2 68.31 26. TRL (Tokyo) software1 59.89 27. OpenU NLP Lab (Ra'anana) software6 51.30 28. UT (Tartu) software1 20.62 29. METU (Ankara) software2 8.78 30. Orange – Deskiñ (Lannion) software1 8.78 31. Uppsala (Uppsala) software1 8.78 32. fbaml (Palo Alto) software1 8.77 33. ECNU (Shanghai) software1 7.15
PUD treebanks only
Macro-average Lemmas-F1 of the 14 PUD treebanks (additional parallel test sets): ar_pud, cs_pud, de_pud, en_pud, es_pud, fi_pud, fr_pud, hi_pud, it_pud, ja_pud, pt_pud, ru_pud, sv_pud, tr_pud. These are languages for which there exists at least one big training treebank. However, these test sets have been produced separately and their domain may differ.
1. Orange – Deskiñ (Lannion) software1 47.34 METU (Ankara) software2 47.34 3. Uppsala (Uppsala) software1 46.77 4. HIT-SCIR (Harbin) software4 46.74 5. fbaml (Palo Alto) software1 46.55 6. LIMSI-LIPN (Paris) software2 40.99 7. TurkuNLP (Turku) software1 40.75 8. darc (Tübingen) software1 40.72 BASELINE UDPipe 1.1 (Praha) software2 40.72 10. IIT Kharagpur (Kharagpur) software3 40.72 NAIST SATO (Nara) software1 40.72 UParse (Edinburgh) software1 40.72 MQuni (Sydney) software2 40.72 LATTICE (Paris) software7 40.72 naistCL (Nara) software1 40.72 UALING (Tucson) software1 40.72 Koç University (İstanbul) software3 40.72 Stanford (Stanford) software1 40.72 C2L2 (Ithaca) software5 40.72 Mengest (Shanghai) software1 40.72 CLCL (Genève) software2 40.72 22. ParisNLP (Paris) software1 40.71 23. MetaRomance (Santiago de Compostela) software1 40.71 24. IMS (Stuttgart) software2 40.67 25. Wanghao-ftd-SJTU (Shanghai) software2 40.13 26. RACAI (București) software1 39.23 27. LyS-FASTPARSE (A Coruña) software5 38.00 28. TRL (Tokyo) software1 35.28 29. ÚFAL – UDPipe 1.2 (Praha) software1 34.09 30. OpenU NLP Lab (Ra'anana) software6 28.16 31. ECNU (Shanghai) software1 13.93 32. UT (Tartu) software1 13.27 33. Wenba-NLU (Wuhan) software1 0.00
Small treebanks only
Macro-average Lemmas-F1 of the 8 small treebanks: fr_partut, ga, gl_treegal, kk, la, sl_sst, ug, uk. These treebanks lack development data and some of them have very little training data (especially Uyghur and Kazakh).
1. TurkuNLP (Turku) software1 83.09 2. HIT-SCIR (Harbin) software4 82.73 3. darc (Tübingen) software1 82.48 4. MQuni (Sydney) software2 82.05 naistCL (Nara) software1 82.05 6. IIT Kharagpur (Kharagpur) software3 82.05 UParse (Edinburgh) software1 82.05 LATTICE (Paris) software7 82.05 UALING (Tucson) software1 82.05 Koç University (İstanbul) software3 82.05 Stanford (Stanford) software1 82.05 CLCL (Genève) software2 82.05 13. NAIST SATO (Nara) software1 82.05 LIMSI-LIPN (Paris) software2 82.05 C2L2 (Ithaca) software5 82.05 16. BASELINE UDPipe 1.1 (Praha) software2 82.01 17. Wanghao-ftd-SJTU (Shanghai) software2 81.85 18. LyS-FASTPARSE (A Coruña) software5 80.94 19. RACAI (București) software1 70.32 20. ParisNLP (Paris) software1 69.75 21. MetaRomance (Santiago de Compostela) software1 69.75 22. Mengest (Shanghai) software1 62.42 23. ÚFAL – UDPipe 1.2 (Praha) software1 59.64 24. IMS (Stuttgart) software2 52.77 25. TRL (Tokyo) software1 45.96 26. OpenU NLP Lab (Ra'anana) software6 44.83 27. Orange – Deskiñ (Lannion) software1 12.49 METU (Ankara) software2 12.49 29. ECNU (Shanghai) software1 12.46 30. Uppsala (Uppsala) software1 12.40 31. fbaml (Palo Alto) software1 12.30 32. UT (Tartu) software1 6.02 33. Wenba-NLU (Wuhan) software1 0.00
Surprise languages only
Macro-average Lemmas-F1 of the 4 surprise language treebanks: bxr, hsb, kmr, sme.
1. ParisNLP (Paris) software1 85.23 2. Wanghao-ftd-SJTU (Shanghai) software2 85.18 darc (Tübingen) software1 85.18 IIT Kharagpur (Kharagpur) software3 85.18 NAIST SATO (Nara) software1 85.18 UParse (Edinburgh) software1 85.18 LIMSI-LIPN (Paris) software2 85.18 MQuni (Sydney) software2 85.18 TurkuNLP (Turku) software1 85.18 LATTICE (Paris) software7 85.18 naistCL (Nara) software1 85.18 UALING (Tucson) software1 85.18 Koç University (İstanbul) software3 85.18 BASELINE UDPipe 1.1 (Praha) software2 85.18 Stanford (Stanford) software1 85.18 C2L2 (Ithaca) software5 85.18 HIT-SCIR (Harbin) software4 85.18 IMS (Stuttgart) software2 85.18 Mengest (Shanghai) software1 85.18 CLCL (Genève) software2 85.18 RACAI (București) software1 85.18 22. ÚFAL – UDPipe 1.2 (Praha) software1 85.18 23. LyS-FASTPARSE (A Coruña) software5 82.16 24. MetaRomance (Santiago de Compostela) software1 64.83 25. OpenU NLP Lab (Ra'anana) software6 51.83 26. TRL (Tokyo) software1 48.81 27. ECNU (Shanghai) software1 0.12 Uppsala (Uppsala) software1 0.12 Orange – Deskiñ (Lannion) software1 0.12 METU (Ankara) software2 0.12 fbaml (Palo Alto) software1 0.12 32. Wenba-NLU (Wuhan) software1 0.00 UT (Tartu) software1 0.00
Per treebank Lemmas-F1
ar
1. darc (Tübingen) software1 87.43 HIT-SCIR (Harbin) software4 87.43 3. ÚFAL – UDPipe 1.2 (Praha) software1 87.34 4. Wenba-NLU (Wuhan) software1 87.29 ParisNLP (Paris) software1 87.29 IIT Kharagpur (Kharagpur) software3 87.29 CLCL (Genève) software1 87.29 NAIST SATO (Nara) software1 87.29 UParse (Edinburgh) software1 87.29 LIMSI-LIPN (Paris) software2 87.29 MQuni (Sydney) software2 87.29 LATTICE (Paris) software7 87.29 naistCL (Nara) software1 87.29 UALING (Tucson) software1 87.29 Koç University (İstanbul) software3 87.29 BASELINE UDPipe 1.1 (Praha) software2 87.29 Stanford (Stanford) software1 87.29 C2L2 (Ithaca) software5 87.29 MetaRomance (Santiago de Compostela) software1 87.29 Mengest (Shanghai) software1 87.29 21. TurkuNLP (Turku) software1 87.28 22. Wanghao-ftd-SJTU (Shanghai) software2 86.31 23. RACAI (București) software1 85.51 24. LyS-FASTPARSE (A Coruña) software5 85.49 25. OpenU NLP Lab (Ra'anana) software6 14.13 26. TRL (Tokyo) software1 10.58 27. ECNU (Shanghai) software1 0.00 28. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00 IMS (Stuttgart) software2 0.00
ar_pud
1. Wanghao-ftd-SJTU (Shanghai) software2 0.00 Wenba-NLU (Wuhan) software1 0.00 ECNU (Shanghai) software1 0.00 ParisNLP (Paris) software1 0.00 darc (Tübingen) software1 0.00 IIT Kharagpur (Kharagpur) software3 0.00 Uppsala (Uppsala) software1 0.00 TRL (Tokyo) software1 0.00 CLCL (Genève) software1 0.00 NAIST SATO (Nara) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 UParse (Edinburgh) software1 0.00 LIMSI-LIPN (Paris) software2 0.00 MQuni (Sydney) software2 0.00 LyS-FASTPARSE (A Coruña) software5 0.00 TurkuNLP (Turku) software1 0.00 LATTICE (Paris) software7 0.00 naistCL (Nara) software1 0.00 UALING (Tucson) software1 0.00 Koç University (İstanbul) software3 0.00 BASELINE UDPipe 1.1 (Praha) software2 0.00 ÚFAL – UDPipe 1.2 (Praha) software1 0.00 Stanford (Stanford) software1 0.00 METU (Ankara) software2 0.00 C2L2 (Ithaca) software5 0.00 fbaml (Palo Alto) software1 0.00 MetaRomance (Santiago de Compostela) software1 0.00 HIT-SCIR (Harbin) software4 0.00 UT (Tartu) software1 0.00 IMS (Stuttgart) software2 0.00 Mengest (Shanghai) software1 0.00 RACAI (București) software1 0.00 OpenU NLP Lab (Ra'anana) software6 0.00
bg
1. ÚFAL – UDPipe 1.2 (Praha) software1 94.60 2. TurkuNLP (Turku) software1 94.58 3. darc (Tübingen) software1 94.41 HIT-SCIR (Harbin) software4 94.41 5. Wenba-NLU (Wuhan) software1 94.31 ParisNLP (Paris) software1 94.31 IIT Kharagpur (Kharagpur) software3 94.31 CLCL (Genève) software1 94.31 NAIST SATO (Nara) software1 94.31 UParse (Edinburgh) software1 94.31 LIMSI-LIPN (Paris) software2 94.31 MQuni (Sydney) software2 94.31 LATTICE (Paris) software7 94.31 naistCL (Nara) software1 94.31 UALING (Tucson) software1 94.31 Koç University (İstanbul) software3 94.31 BASELINE UDPipe 1.1 (Praha) software2 94.31 Stanford (Stanford) software1 94.31 C2L2 (Ithaca) software5 94.31 MetaRomance (Santiago de Compostela) software1 94.31 IMS (Stuttgart) software2 94.31 Mengest (Shanghai) software1 94.31 23. LyS-FASTPARSE (A Coruña) software5 93.44 24. Wanghao-ftd-SJTU (Shanghai) software2 92.74 25. RACAI (București) software1 92.14 26. OpenU NLP Lab (Ra'anana) software6 52.79 27. TRL (Tokyo) software1 51.89 28. UT (Tartu) software1 42.93 29. Uppsala (Uppsala) software1 0.01 Orange – Deskiñ (Lannion) software1 0.01 METU (Ankara) software2 0.01 fbaml (Palo Alto) software1 0.01 33. ECNU (Shanghai) software1 0.00
bxr
1. ParisNLP (Paris) software1 81.60 2. Wanghao-ftd-SJTU (Shanghai) software2 81.40 darc (Tübingen) software1 81.40 IIT Kharagpur (Kharagpur) software3 81.40 NAIST SATO (Nara) software1 81.40 UParse (Edinburgh) software1 81.40 LIMSI-LIPN (Paris) software2 81.40 MQuni (Sydney) software2 81.40 TurkuNLP (Turku) software1 81.40 LATTICE (Paris) software7 81.40 naistCL (Nara) software1 81.40 UALING (Tucson) software1 81.40 Koç University (İstanbul) software3 81.40 BASELINE UDPipe 1.1 (Praha) software2 81.40 ÚFAL – UDPipe 1.2 (Praha) software1 81.40 Stanford (Stanford) software1 81.40 C2L2 (Ithaca) software5 81.40 HIT-SCIR (Harbin) software4 81.40 IMS (Stuttgart) software2 81.40 Mengest (Shanghai) software1 81.40 CLCL (Genève) software2 81.40 RACAI (București) software1 81.40 23. LyS-FASTPARSE (A Coruña) software5 80.56 24. OpenU NLP Lab (Ra'anana) software6 53.76 25. TRL (Tokyo) software1 43.95 26. ECNU (Shanghai) software1 0.47 Uppsala (Uppsala) software1 0.47 Orange – Deskiñ (Lannion) software1 0.47 METU (Ankara) software2 0.47 fbaml (Palo Alto) software1 0.47 31. Wenba-NLU (Wuhan) software1 0.00 32. MetaRomance (Santiago de Compostela) software1 0.00 33. UT (Tartu) software1 0.00
ca
1. ÚFAL – UDPipe 1.2 (Praha) software1 97.87 2. darc (Tübingen) software1 97.85 HIT-SCIR (Harbin) software4 97.85 4. Wenba-NLU (Wuhan) software1 97.83 ParisNLP (Paris) software1 97.83 IIT Kharagpur (Kharagpur) software3 97.83 NAIST SATO (Nara) software1 97.83 UParse (Edinburgh) software1 97.83 LIMSI-LIPN (Paris) software2 97.83 MQuni (Sydney) software2 97.83 TurkuNLP (Turku) software1 97.83 LATTICE (Paris) software7 97.83 naistCL (Nara) software1 97.83 UALING (Tucson) software1 97.83 Koç University (İstanbul) software3 97.83 BASELINE UDPipe 1.1 (Praha) software2 97.83 Stanford (Stanford) software1 97.83 C2L2 (Ithaca) software5 97.83 MetaRomance (Santiago de Compostela) software1 97.83 IMS (Stuttgart) software2 97.83 Mengest (Shanghai) software1 97.83 CLCL (Genève) software2 97.83 23. Wanghao-ftd-SJTU (Shanghai) software2 97.48 24. LyS-FASTPARSE (A Coruña) software5 87.62 25. RACAI (București) software1 84.26 26. OpenU NLP Lab (Ra'anana) software6 68.42 27. TRL (Tokyo) software1 60.60 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
cs
1. darc (Tübingen) software1 97.83 HIT-SCIR (Harbin) software4 97.83 3. ÚFAL – UDPipe 1.2 (Praha) software1 97.82 4. TurkuNLP (Turku) software1 97.71 5. ParisNLP (Paris) software1 97.70 IIT Kharagpur (Kharagpur) software3 97.70 CLCL (Genève) software1 97.70 NAIST SATO (Nara) software1 97.70 UParse (Edinburgh) software1 97.70 LIMSI-LIPN (Paris) software2 97.70 MQuni (Sydney) software2 97.70 LATTICE (Paris) software7 97.70 naistCL (Nara) software1 97.70 UALING (Tucson) software1 97.70 Koç University (İstanbul) software3 97.70 BASELINE UDPipe 1.1 (Praha) software2 97.70 Stanford (Stanford) software1 97.70 C2L2 (Ithaca) software5 97.70 IMS (Stuttgart) software2 97.70 Mengest (Shanghai) software1 97.70 21. RACAI (București) software1 95.03 22. Wanghao-ftd-SJTU (Shanghai) software2 93.76 23. LyS-FASTPARSE (A Coruña) software5 91.07 24. TRL (Tokyo) software1 90.45 25. OpenU NLP Lab (Ra'anana) software6 52.99 26. Wenba-NLU (Wuhan) software1 0.00 27. ECNU (Shanghai) software1 0.00 28. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 MetaRomance (Santiago de Compostela) software1 0.00 UT (Tartu) software1 0.00
cs_cac
1. TurkuNLP (Turku) software1 97.15 2. ParisNLP (Paris) software1 97.10 IIT Kharagpur (Kharagpur) software3 97.10 CLCL (Genève) software1 97.10 NAIST SATO (Nara) software1 97.10 UParse (Edinburgh) software1 97.10 LIMSI-LIPN (Paris) software2 97.10 MQuni (Sydney) software2 97.10 LATTICE (Paris) software7 97.10 naistCL (Nara) software1 97.10 UALING (Tucson) software1 97.10 Koç University (İstanbul) software3 97.10 BASELINE UDPipe 1.1 (Praha) software2 97.10 Stanford (Stanford) software1 97.10 C2L2 (Ithaca) software5 97.10 MetaRomance (Santiago de Compostela) software1 97.10 IMS (Stuttgart) software2 97.10 Mengest (Shanghai) software1 97.10 19. darc (Tübingen) software1 97.03 HIT-SCIR (Harbin) software4 97.03 21. LyS-FASTPARSE (A Coruña) software5 96.38 22. Wanghao-ftd-SJTU (Shanghai) software2 96.28 23. RACAI (București) software1 96.27 24. TRL (Tokyo) software1 91.14 25. OpenU NLP Lab (Ra'anana) software6 48.37 26. Wenba-NLU (Wuhan) software1 0.00 27. ECNU (Shanghai) software1 0.00 28. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 ÚFAL – UDPipe 1.2 (Praha) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
cs_cltt
1. Wenba-NLU (Wuhan) software1 95.70 ParisNLP (Paris) software1 95.70 IIT Kharagpur (Kharagpur) software3 95.70 CLCL (Genève) software1 95.70 NAIST SATO (Nara) software1 95.70 UParse (Edinburgh) software1 95.70 LIMSI-LIPN (Paris) software2 95.70 MQuni (Sydney) software2 95.70 LATTICE (Paris) software7 95.70 naistCL (Nara) software1 95.70 UALING (Tucson) software1 95.70 Koç University (İstanbul) software3 95.70 BASELINE UDPipe 1.1 (Praha) software2 95.70 Stanford (Stanford) software1 95.70 C2L2 (Ithaca) software5 95.70 MetaRomance (Santiago de Compostela) software1 95.70 IMS (Stuttgart) software2 95.70 Mengest (Shanghai) software1 95.70 19. darc (Tübingen) software1 95.63 20. TurkuNLP (Turku) software1 95.59 21. HIT-SCIR (Harbin) software4 95.58 22. Wanghao-ftd-SJTU (Shanghai) software2 94.56 RACAI (București) software1 94.56 24. LyS-FASTPARSE (A Coruña) software5 92.11 25. TRL (Tokyo) software1 84.80 26. OpenU NLP Lab (Ra'anana) software6 55.26 27. ECNU (Shanghai) software1 0.00 28. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 ÚFAL – UDPipe 1.2 (Praha) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
cs_pud
1. ÚFAL – UDPipe 1.2 (Praha) software1 95.37 2. HIT-SCIR (Harbin) software4 95.32 3. TurkuNLP (Turku) software1 95.27 4. ParisNLP (Paris) software1 95.22 darc (Tübingen) software1 95.22 IIT Kharagpur (Kharagpur) software3 95.22 CLCL (Genève) software1 95.22 NAIST SATO (Nara) software1 95.22 UParse (Edinburgh) software1 95.22 LIMSI-LIPN (Paris) software2 95.22 MQuni (Sydney) software2 95.22 LATTICE (Paris) software7 95.22 naistCL (Nara) software1 95.22 UALING (Tucson) software1 95.22 Koç University (İstanbul) software3 95.22 BASELINE UDPipe 1.1 (Praha) software2 95.22 Stanford (Stanford) software1 95.22 C2L2 (Ithaca) software5 95.22 MetaRomance (Santiago de Compostela) software1 95.22 IMS (Stuttgart) software2 95.22 Mengest (Shanghai) software1 95.22 22. RACAI (București) software1 92.00 23. Wanghao-ftd-SJTU (Shanghai) software2 90.50 24. LyS-FASTPARSE (A Coruña) software5 88.43 25. TRL (Tokyo) software1 87.57 26. OpenU NLP Lab (Ra'anana) software6 51.01 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
cu
1. ÚFAL – UDPipe 1.2 (Praha) software1 90.69 2. darc (Tübingen) software1 90.17 3. HIT-SCIR (Harbin) software4 89.95 4. TurkuNLP (Turku) software1 89.80 5. Wenba-NLU (Wuhan) software1 89.58 ParisNLP (Paris) software1 89.58 IIT Kharagpur (Kharagpur) software3 89.58 CLCL (Genève) software1 89.58 NAIST SATO (Nara) software1 89.58 UParse (Edinburgh) software1 89.58 LIMSI-LIPN (Paris) software2 89.58 MQuni (Sydney) software2 89.58 LyS-FASTPARSE (A Coruña) software5 89.58 LATTICE (Paris) software7 89.58 naistCL (Nara) software1 89.58 UALING (Tucson) software1 89.58 Koç University (İstanbul) software3 89.58 BASELINE UDPipe 1.1 (Praha) software2 89.58 Stanford (Stanford) software1 89.58 C2L2 (Ithaca) software5 89.58 MetaRomance (Santiago de Compostela) software1 89.58 Mengest (Shanghai) software1 89.58 23. UT (Tartu) software1 88.24 24. Wanghao-ftd-SJTU (Shanghai) software2 88.15 25. RACAI (București) software1 86.38 26. TRL (Tokyo) software1 29.02 OpenU NLP Lab (Ra'anana) software6 29.02 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 IMS (Stuttgart) software2 0.00
da
1. HIT-SCIR (Harbin) software4 95.22 2. darc (Tübingen) software1 95.09 3. TurkuNLP (Turku) software1 94.80 4. ParisNLP (Paris) software1 94.74 5. Wanghao-ftd-SJTU (Shanghai) software2 94.65 6. Wenba-NLU (Wuhan) software1 94.64 IIT Kharagpur (Kharagpur) software3 94.64 CLCL (Genève) software1 94.64 NAIST SATO (Nara) software1 94.64 UParse (Edinburgh) software1 94.64 LIMSI-LIPN (Paris) software2 94.64 MQuni (Sydney) software2 94.64 LATTICE (Paris) software7 94.64 naistCL (Nara) software1 94.64 UALING (Tucson) software1 94.64 Koç University (İstanbul) software3 94.64 Stanford (Stanford) software1 94.64 C2L2 (Ithaca) software5 94.64 MetaRomance (Santiago de Compostela) software1 94.64 IMS (Stuttgart) software2 94.64 Mengest (Shanghai) software1 94.64 22. BASELINE UDPipe 1.1 (Praha) software2 94.63 23. ÚFAL – UDPipe 1.2 (Praha) software1 94.51 24. RACAI (București) software1 94.14 25. LyS-FASTPARSE (A Coruña) software5 88.52 26. TRL (Tokyo) software1 79.45 27. OpenU NLP Lab (Ra'anana) software6 66.63 28. UT (Tartu) software1 41.93 29. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00
de
1. Wenba-NLU (Wuhan) software1 95.61 ParisNLP (Paris) software1 95.61 IIT Kharagpur (Kharagpur) software3 95.61 CLCL (Genève) software1 95.61 NAIST SATO (Nara) software1 95.61 UParse (Edinburgh) software1 95.61 LIMSI-LIPN (Paris) software2 95.61 MQuni (Sydney) software2 95.61 LATTICE (Paris) software7 95.61 naistCL (Nara) software1 95.61 UALING (Tucson) software1 95.61 Koç University (İstanbul) software3 95.61 BASELINE UDPipe 1.1 (Praha) software2 95.61 Stanford (Stanford) software1 95.61 C2L2 (Ithaca) software5 95.61 MetaRomance (Santiago de Compostela) software1 95.61 IMS (Stuttgart) software2 95.61 Mengest (Shanghai) software1 95.61 19. ÚFAL – UDPipe 1.2 (Praha) software1 95.38 20. darc (Tübingen) software1 95.35 HIT-SCIR (Harbin) software4 95.35 22. TurkuNLP (Turku) software1 95.22 23. Wanghao-ftd-SJTU (Shanghai) software2 94.87 24. RACAI (București) software1 90.82 25. TRL (Tokyo) software1 82.39 26. LyS-FASTPARSE (A Coruña) software5 71.51 27. OpenU NLP Lab (Ra'anana) software6 66.04 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
de_pud
1. Orange – Deskiñ (Lannion) software1 94.90 METU (Ankara) software2 94.90 3. Uppsala (Uppsala) software1 93.71 4. fbaml (Palo Alto) software1 93.57 5. ÚFAL – UDPipe 1.2 (Praha) software1 3.10 6. Wanghao-ftd-SJTU (Shanghai) software2 3.09 ParisNLP (Paris) software1 3.09 darc (Tübingen) software1 3.09 IIT Kharagpur (Kharagpur) software3 3.09 CLCL (Genève) software1 3.09 NAIST SATO (Nara) software1 3.09 UParse (Edinburgh) software1 3.09 LIMSI-LIPN (Paris) software2 3.09 MQuni (Sydney) software2 3.09 LyS-FASTPARSE (A Coruña) software5 3.09 TurkuNLP (Turku) software1 3.09 LATTICE (Paris) software7 3.09 naistCL (Nara) software1 3.09 UALING (Tucson) software1 3.09 Koç University (İstanbul) software3 3.09 BASELINE UDPipe 1.1 (Praha) software2 3.09 Stanford (Stanford) software1 3.09 C2L2 (Ithaca) software5 3.09 MetaRomance (Santiago de Compostela) software1 3.09 HIT-SCIR (Harbin) software4 3.09 IMS (Stuttgart) software2 3.09 Mengest (Shanghai) software1 3.09 28. RACAI (București) software1 2.71 29. OpenU NLP Lab (Ra'anana) software6 1.46 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 32. TRL (Tokyo) software1 0.00 UT (Tartu) software1 0.00
el
1. ÚFAL – UDPipe 1.2 (Praha) software1 94.44 2. darc (Tübingen) software1 94.42 HIT-SCIR (Harbin) software4 94.42 4. TurkuNLP (Turku) software1 94.36 5. Wenba-NLU (Wuhan) software1 94.08 IIT Kharagpur (Kharagpur) software3 94.08 CLCL (Genève) software1 94.08 NAIST SATO (Nara) software1 94.08 UParse (Edinburgh) software1 94.08 LIMSI-LIPN (Paris) software2 94.08 MQuni (Sydney) software2 94.08 LATTICE (Paris) software7 94.08 naistCL (Nara) software1 94.08 UALING (Tucson) software1 94.08 Koç University (İstanbul) software3 94.08 BASELINE UDPipe 1.1 (Praha) software2 94.08 Stanford (Stanford) software1 94.08 C2L2 (Ithaca) software5 94.08 MetaRomance (Santiago de Compostela) software1 94.08 IMS (Stuttgart) software2 94.08 Mengest (Shanghai) software1 94.08 22. ParisNLP (Paris) software1 93.93 23. LyS-FASTPARSE (A Coruña) software5 92.35 24. Wanghao-ftd-SJTU (Shanghai) software2 92.04 25. RACAI (București) software1 91.78 26. TRL (Tokyo) software1 76.25 27. OpenU NLP Lab (Ra'anana) software6 44.00 28. UT (Tartu) software1 41.77 29. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00
en
1. ÚFAL – UDPipe 1.2 (Praha) software1 96.10 2. darc (Tübingen) software1 96.04 HIT-SCIR (Harbin) software4 96.04 4. TurkuNLP (Turku) software1 95.64 5. Wenba-NLU (Wuhan) software1 95.61 ParisNLP (Paris) software1 95.61 IIT Kharagpur (Kharagpur) software3 95.61 CLCL (Genève) software1 95.61 NAIST SATO (Nara) software1 95.61 UParse (Edinburgh) software1 95.61 LIMSI-LIPN (Paris) software2 95.61 MQuni (Sydney) software2 95.61 LATTICE (Paris) software7 95.61 naistCL (Nara) software1 95.61 UALING (Tucson) software1 95.61 Koç University (İstanbul) software3 95.61 BASELINE UDPipe 1.1 (Praha) software2 95.61 Stanford (Stanford) software1 95.61 C2L2 (Ithaca) software5 95.61 MetaRomance (Santiago de Compostela) software1 95.61 Mengest (Shanghai) software1 95.61 22. Wanghao-ftd-SJTU (Shanghai) software2 95.01 23. RACAI (București) software1 93.43 24. LyS-FASTPARSE (A Coruña) software5 86.94 25. TRL (Tokyo) software1 84.45 26. OpenU NLP Lab (Ra'anana) software6 77.87 27. ECNU (Shanghai) software1 0.00 28. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00 IMS (Stuttgart) software2 0.00
en_lines
1. fbaml (Palo Alto) software1 99.96 2. Wenba-NLU (Wuhan) software1 99.94 ECNU (Shanghai) software1 99.94 IIT Kharagpur (Kharagpur) software3 99.94 CLCL (Genève) software1 99.94 NAIST SATO (Nara) software1 99.94 Orange – Deskiñ (Lannion) software1 99.94 UParse (Edinburgh) software1 99.94 LIMSI-LIPN (Paris) software2 99.94 MQuni (Sydney) software2 99.94 LyS-FASTPARSE (A Coruña) software5 99.94 TurkuNLP (Turku) software1 99.94 LATTICE (Paris) software7 99.94 naistCL (Nara) software1 99.94 UALING (Tucson) software1 99.94 Koç University (İstanbul) software3 99.94 BASELINE UDPipe 1.1 (Praha) software2 99.94 Stanford (Stanford) software1 99.94 METU (Ankara) software2 99.94 C2L2 (Ithaca) software5 99.94 IMS (Stuttgart) software2 99.94 Mengest (Shanghai) software1 99.94 23. Wanghao-ftd-SJTU (Shanghai) software2 99.93 24. ÚFAL – UDPipe 1.2 (Praha) software1 99.92 25. darc (Tübingen) software1 99.91 HIT-SCIR (Harbin) software4 99.91 27. Uppsala (Uppsala) software1 99.82 28. RACAI (București) software1 88.36 29. ParisNLP (Paris) software1 0.00 TRL (Tokyo) software1 0.00 MetaRomance (Santiago de Compostela) software1 0.00 UT (Tartu) software1 0.00 OpenU NLP Lab (Ra'anana) software6 0.00
en_partut
1. TurkuNLP (Turku) software1 96.55 2. darc (Tübingen) software1 96.46 3. Wenba-NLU (Wuhan) software1 96.39 ParisNLP (Paris) software1 96.39 IIT Kharagpur (Kharagpur) software3 96.39 CLCL (Genève) software1 96.39 NAIST SATO (Nara) software1 96.39 UParse (Edinburgh) software1 96.39 LIMSI-LIPN (Paris) software2 96.39 MQuni (Sydney) software2 96.39 LATTICE (Paris) software7 96.39 naistCL (Nara) software1 96.39 UALING (Tucson) software1 96.39 Koç University (İstanbul) software3 96.39 BASELINE UDPipe 1.1 (Praha) software2 96.39 Stanford (Stanford) software1 96.39 C2L2 (Ithaca) software5 96.39 MetaRomance (Santiago de Compostela) software1 96.39 IMS (Stuttgart) software2 96.39 Mengest (Shanghai) software1 96.39 21. Wanghao-ftd-SJTU (Shanghai) software2 94.86 22. RACAI (București) software1 94.81 23. HIT-SCIR (Harbin) software4 94.73 24. TRL (Tokyo) software1 93.12 25. LyS-FASTPARSE (A Coruña) software5 91.80 26. OpenU NLP Lab (Ra'anana) software6 76.45 27. ECNU (Shanghai) software1 0.00 28. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 ÚFAL – UDPipe 1.2 (Praha) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
en_pud
1. ÚFAL – UDPipe 1.2 (Praha) software1 95.47 2. ParisNLP (Paris) software1 95.39 darc (Tübingen) software1 95.39 IIT Kharagpur (Kharagpur) software3 95.39 CLCL (Genève) software1 95.39 NAIST SATO (Nara) software1 95.39 UParse (Edinburgh) software1 95.39 LIMSI-LIPN (Paris) software2 95.39 MQuni (Sydney) software2 95.39 LATTICE (Paris) software7 95.39 naistCL (Nara) software1 95.39 UALING (Tucson) software1 95.39 Koç University (İstanbul) software3 95.39 BASELINE UDPipe 1.1 (Praha) software2 95.39 Stanford (Stanford) software1 95.39 C2L2 (Ithaca) software5 95.39 MetaRomance (Santiago de Compostela) software1 95.39 HIT-SCIR (Harbin) software4 95.39 IMS (Stuttgart) software2 95.39 Mengest (Shanghai) software1 95.39 21. TurkuNLP (Turku) software1 95.37 22. RACAI (București) software1 95.00 23. Wanghao-ftd-SJTU (Shanghai) software2 94.41 24. UT (Tartu) software1 94.30 25. LyS-FASTPARSE (A Coruña) software5 88.75 26. TRL (Tokyo) software1 88.32 27. OpenU NLP Lab (Ra'anana) software6 75.71 28. Wenba-NLU (Wuhan) software1 0.00 29. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00
es
1. LyS-FASTPARSE (A Coruña) software5 96.75 2. darc (Tübingen) software1 95.98 HIT-SCIR (Harbin) software4 95.98 4. ÚFAL – UDPipe 1.2 (Praha) software1 95.89 5. TurkuNLP (Turku) software1 95.83 6. ParisNLP (Paris) software1 95.75 IIT Kharagpur (Kharagpur) software3 95.75 NAIST SATO (Nara) software1 95.75 UParse (Edinburgh) software1 95.75 LIMSI-LIPN (Paris) software2 95.75 MQuni (Sydney) software2 95.75 LATTICE (Paris) software7 95.75 naistCL (Nara) software1 95.75 UALING (Tucson) software1 95.75 Koç University (İstanbul) software3 95.75 BASELINE UDPipe 1.1 (Praha) software2 95.75 Stanford (Stanford) software1 95.75 C2L2 (Ithaca) software5 95.75 MetaRomance (Santiago de Compostela) software1 95.75 IMS (Stuttgart) software2 95.75 Mengest (Shanghai) software1 95.75 CLCL (Genève) software2 95.75 23. Wanghao-ftd-SJTU (Shanghai) software2 94.40 24. RACAI (București) software1 94.17 25. TRL (Tokyo) software1 85.94 26. OpenU NLP Lab (Ra'anana) software6 60.64 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
es_ancora
1. ÚFAL – UDPipe 1.2 (Praha) software1 98.09 2. darc (Tübingen) software1 98.01 HIT-SCIR (Harbin) software4 98.01 4. ParisNLP (Paris) software1 97.99 IIT Kharagpur (Kharagpur) software3 97.99 NAIST SATO (Nara) software1 97.99 UParse (Edinburgh) software1 97.99 LIMSI-LIPN (Paris) software2 97.99 MQuni (Sydney) software2 97.99 TurkuNLP (Turku) software1 97.99 LATTICE (Paris) software7 97.99 naistCL (Nara) software1 97.99 UALING (Tucson) software1 97.99 Koç University (İstanbul) software3 97.99 BASELINE UDPipe 1.1 (Praha) software2 97.99 Stanford (Stanford) software1 97.99 C2L2 (Ithaca) software5 97.99 MetaRomance (Santiago de Compostela) software1 97.99 IMS (Stuttgart) software2 97.99 Mengest (Shanghai) software1 97.99 CLCL (Genève) software2 97.99 22. Wanghao-ftd-SJTU (Shanghai) software2 97.61 23. TRL (Tokyo) software1 90.10 24. LyS-FASTPARSE (A Coruña) software5 89.45 25. RACAI (București) software1 78.56 26. OpenU NLP Lab (Ra'anana) software6 69.06 27. Uppsala (Uppsala) software1 0.01 Orange – Deskiñ (Lannion) software1 0.01 METU (Ankara) software2 0.01 fbaml (Palo Alto) software1 0.01 31. Wenba-NLU (Wuhan) software1 0.00 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
es_pud
1. Uppsala (Uppsala) software1 96.07 2. Orange – Deskiñ (Lannion) software1 96.04 METU (Ankara) software2 96.04 4. fbaml (Palo Alto) software1 95.92 5. Wanghao-ftd-SJTU (Shanghai) software2 3.43 ParisNLP (Paris) software1 3.43 darc (Tübingen) software1 3.43 IIT Kharagpur (Kharagpur) software3 3.43 CLCL (Genève) software1 3.43 NAIST SATO (Nara) software1 3.43 UParse (Edinburgh) software1 3.43 LIMSI-LIPN (Paris) software2 3.43 MQuni (Sydney) software2 3.43 LyS-FASTPARSE (A Coruña) software5 3.43 TurkuNLP (Turku) software1 3.43 LATTICE (Paris) software7 3.43 naistCL (Nara) software1 3.43 UALING (Tucson) software1 3.43 Koç University (İstanbul) software3 3.43 BASELINE UDPipe 1.1 (Praha) software2 3.43 ÚFAL – UDPipe 1.2 (Praha) software1 3.43 Stanford (Stanford) software1 3.43 C2L2 (Ithaca) software5 3.43 MetaRomance (Santiago de Compostela) software1 3.43 IMS (Stuttgart) software2 3.43 Mengest (Shanghai) software1 3.43 27. RACAI (București) software1 3.32 OpenU NLP Lab (Ra'anana) software6 3.32 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. TRL (Tokyo) software1 0.00 HIT-SCIR (Harbin) software4 0.00 UT (Tartu) software1 0.00
et
1. HIT-SCIR (Harbin) software4 80.99 2. ÚFAL – UDPipe 1.2 (Praha) software1 80.96 3. Wenba-NLU (Wuhan) software1 79.47 IIT Kharagpur (Kharagpur) software3 79.47 CLCL (Genève) software1 79.47 NAIST SATO (Nara) software1 79.47 UParse (Edinburgh) software1 79.47 LIMSI-LIPN (Paris) software2 79.47 MQuni (Sydney) software2 79.47 LATTICE (Paris) software7 79.47 naistCL (Nara) software1 79.47 UALING (Tucson) software1 79.47 Koç University (İstanbul) software3 79.47 BASELINE UDPipe 1.1 (Praha) software2 79.47 Stanford (Stanford) software1 79.47 C2L2 (Ithaca) software5 79.47 MetaRomance (Santiago de Compostela) software1 79.47 Mengest (Shanghai) software1 79.47 19. darc (Tübingen) software1 79.36 20. RACAI (București) software1 79.28 21. TurkuNLP (Turku) software1 79.25 22. ParisNLP (Paris) software1 79.23 23. Wanghao-ftd-SJTU (Shanghai) software2 76.94 24. LyS-FASTPARSE (A Coruña) software5 76.76 25. OpenU NLP Lab (Ra'anana) software6 48.48 26. TRL (Tokyo) software1 46.43 27. UT (Tartu) software1 32.72 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 IMS (Stuttgart) software2 0.00
eu
1. ÚFAL – UDPipe 1.2 (Praha) software1 93.49 2. HIT-SCIR (Harbin) software4 93.32 3. TurkuNLP (Turku) software1 93.23 4. Wenba-NLU (Wuhan) software1 93.20 darc (Tübingen) software1 93.20 IIT Kharagpur (Kharagpur) software3 93.20 NAIST SATO (Nara) software1 93.20 UParse (Edinburgh) software1 93.20 LIMSI-LIPN (Paris) software2 93.20 MQuni (Sydney) software2 93.20 LATTICE (Paris) software7 93.20 naistCL (Nara) software1 93.20 UALING (Tucson) software1 93.20 Koç University (İstanbul) software3 93.20 BASELINE UDPipe 1.1 (Praha) software2 93.20 Stanford (Stanford) software1 93.20 C2L2 (Ithaca) software5 93.20 IMS (Stuttgart) software2 93.20 Mengest (Shanghai) software1 93.20 CLCL (Genève) software2 93.20 21. ParisNLP (Paris) software1 93.16 MetaRomance (Santiago de Compostela) software1 93.16 23. Wanghao-ftd-SJTU (Shanghai) software2 91.06 24. RACAI (București) software1 88.89 25. LyS-FASTPARSE (A Coruña) software5 85.92 26. OpenU NLP Lab (Ra'anana) software6 48.61 27. TRL (Tokyo) software1 45.33 28. UT (Tartu) software1 39.89 29. ECNU (Shanghai) software1 0.10 Uppsala (Uppsala) software1 0.10 Orange – Deskiñ (Lannion) software1 0.10 METU (Ankara) software2 0.10 fbaml (Palo Alto) software1 0.10
fa
1. RACAI (București) software1 96.58 2. ParisNLP (Paris) software1 95.07 MetaRomance (Santiago de Compostela) software1 95.07 4. ÚFAL – UDPipe 1.2 (Praha) software1 93.58 5. darc (Tübingen) software1 93.46 HIT-SCIR (Harbin) software4 93.46 7. TurkuNLP (Turku) software1 93.35 8. Wenba-NLU (Wuhan) software1 93.27 IIT Kharagpur (Kharagpur) software3 93.27 NAIST SATO (Nara) software1 93.27 UParse (Edinburgh) software1 93.27 LIMSI-LIPN (Paris) software2 93.27 MQuni (Sydney) software2 93.27 LyS-FASTPARSE (A Coruña) software5 93.27 LATTICE (Paris) software7 93.27 naistCL (Nara) software1 93.27 UALING (Tucson) software1 93.27 Koç University (İstanbul) software3 93.27 BASELINE UDPipe 1.1 (Praha) software2 93.27 Stanford (Stanford) software1 93.27 C2L2 (Ithaca) software5 93.27 IMS (Stuttgart) software2 93.27 Mengest (Shanghai) software1 93.27 CLCL (Genève) software2 93.27 25. Wanghao-ftd-SJTU (Shanghai) software2 89.36 26. OpenU NLP Lab (Ra'anana) software6 81.63 27. TRL (Tokyo) software1 81.51 28. Uppsala (Uppsala) software1 0.11 Orange – Deskiñ (Lannion) software1 0.11 METU (Ankara) software2 0.11 fbaml (Palo Alto) software1 0.11 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
fi
1. darc (Tübingen) software1 86.54 HIT-SCIR (Harbin) software4 86.54 3. ÚFAL – UDPipe 1.2 (Praha) software1 86.49 4. TurkuNLP (Turku) software1 86.43 5. MetaRomance (Santiago de Compostela) software1 86.14 6. Wenba-NLU (Wuhan) software1 86.13 IIT Kharagpur (Kharagpur) software3 86.13 NAIST SATO (Nara) software1 86.13 UParse (Edinburgh) software1 86.13 LIMSI-LIPN (Paris) software2 86.13 MQuni (Sydney) software2 86.13 LATTICE (Paris) software7 86.13 naistCL (Nara) software1 86.13 UALING (Tucson) software1 86.13 Koç University (İstanbul) software3 86.13 BASELINE UDPipe 1.1 (Praha) software2 86.13 Stanford (Stanford) software1 86.13 C2L2 (Ithaca) software5 86.13 IMS (Stuttgart) software2 86.13 Mengest (Shanghai) software1 86.13 CLCL (Genève) software2 86.13 22. ParisNLP (Paris) software1 85.90 23. Wanghao-ftd-SJTU (Shanghai) software2 84.16 24. UT (Tartu) software1 84.13 25. RACAI (București) software1 81.87 26. LyS-FASTPARSE (A Coruña) software5 80.45 27. TRL (Tokyo) software1 67.19 28. OpenU NLP Lab (Ra'anana) software6 42.60 29. ECNU (Shanghai) software1 0.00 30. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00
fi_ftb
1. LyS-FASTPARSE (A Coruña) software5 90.33 2. darc (Tübingen) software1 88.79 3. HIT-SCIR (Harbin) software4 88.77 4. ÚFAL – UDPipe 1.2 (Praha) software1 88.68 5. TurkuNLP (Turku) software1 88.62 6. ParisNLP (Paris) software1 88.47 7. MetaRomance (Santiago de Compostela) software1 88.45 8. Wenba-NLU (Wuhan) software1 88.44 IIT Kharagpur (Kharagpur) software3 88.44 NAIST SATO (Nara) software1 88.44 UParse (Edinburgh) software1 88.44 LIMSI-LIPN (Paris) software2 88.44 MQuni (Sydney) software2 88.44 LATTICE (Paris) software7 88.44 naistCL (Nara) software1 88.44 UALING (Tucson) software1 88.44 Koç University (İstanbul) software3 88.44 BASELINE UDPipe 1.1 (Praha) software2 88.44 Stanford (Stanford) software1 88.44 C2L2 (Ithaca) software5 88.44 IMS (Stuttgart) software2 88.44 Mengest (Shanghai) software1 88.44 CLCL (Genève) software2 88.44 24. Wanghao-ftd-SJTU (Shanghai) software2 85.95 25. RACAI (București) software1 85.58 26. TRL (Tokyo) software1 74.23 27. OpenU NLP Lab (Ra'anana) software6 41.70 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
fi_pud
1. TurkuNLP (Turku) software1 86.71 2. HIT-SCIR (Harbin) software4 86.67 3. ÚFAL – UDPipe 1.2 (Praha) software1 86.50 4. ParisNLP (Paris) software1 86.26 darc (Tübingen) software1 86.26 IIT Kharagpur (Kharagpur) software3 86.26 CLCL (Genève) software1 86.26 NAIST SATO (Nara) software1 86.26 UParse (Edinburgh) software1 86.26 LIMSI-LIPN (Paris) software2 86.26 MQuni (Sydney) software2 86.26 LATTICE (Paris) software7 86.26 naistCL (Nara) software1 86.26 UALING (Tucson) software1 86.26 Koç University (İstanbul) software3 86.26 BASELINE UDPipe 1.1 (Praha) software2 86.26 Stanford (Stanford) software1 86.26 C2L2 (Ithaca) software5 86.26 MetaRomance (Santiago de Compostela) software1 86.26 IMS (Stuttgart) software2 86.26 Mengest (Shanghai) software1 86.26 22. Wanghao-ftd-SJTU (Shanghai) software2 84.41 23. RACAI (București) software1 81.06 24. LyS-FASTPARSE (A Coruña) software5 77.28 25. TRL (Tokyo) software1 68.12 26. OpenU NLP Lab (Ra'anana) software6 42.21 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
fr
1. ÚFAL – UDPipe 1.2 (Praha) software1 96.59 2. Wenba-NLU (Wuhan) software1 96.44 ParisNLP (Paris) software1 96.44 IIT Kharagpur (Kharagpur) software3 96.44 NAIST SATO (Nara) software1 96.44 UParse (Edinburgh) software1 96.44 LIMSI-LIPN (Paris) software2 96.44 MQuni (Sydney) software2 96.44 TurkuNLP (Turku) software1 96.44 LATTICE (Paris) software7 96.44 naistCL (Nara) software1 96.44 UALING (Tucson) software1 96.44 Koç University (İstanbul) software3 96.44 BASELINE UDPipe 1.1 (Praha) software2 96.44 Stanford (Stanford) software1 96.44 C2L2 (Ithaca) software5 96.44 MetaRomance (Santiago de Compostela) software1 96.44 Mengest (Shanghai) software1 96.44 CLCL (Genève) software2 96.44 20. darc (Tübingen) software1 96.17 HIT-SCIR (Harbin) software4 96.17 22. Wanghao-ftd-SJTU (Shanghai) software2 95.90 23. RACAI (București) software1 95.41 24. LyS-FASTPARSE (A Coruña) software5 89.95 25. TRL (Tokyo) software1 87.76 26. OpenU NLP Lab (Ra'anana) software6 65.86 27. ECNU (Shanghai) software1 0.00 28. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00 IMS (Stuttgart) software2 0.00
fr_partut
1. TurkuNLP (Turku) software1 94.56 2. darc (Tübingen) software1 94.26 3. ParisNLP (Paris) software1 94.17 IIT Kharagpur (Kharagpur) software3 94.17 NAIST SATO (Nara) software1 94.17 UParse (Edinburgh) software1 94.17 LIMSI-LIPN (Paris) software2 94.17 MQuni (Sydney) software2 94.17 LATTICE (Paris) software7 94.17 naistCL (Nara) software1 94.17 UALING (Tucson) software1 94.17 Koç University (İstanbul) software3 94.17 BASELINE UDPipe 1.1 (Praha) software2 94.17 Stanford (Stanford) software1 94.17 C2L2 (Ithaca) software5 94.17 MetaRomance (Santiago de Compostela) software1 94.17 Mengest (Shanghai) software1 94.17 CLCL (Genève) software2 94.17 19. HIT-SCIR (Harbin) software4 94.15 20. Wanghao-ftd-SJTU (Shanghai) software2 93.97 21. RACAI (București) software1 92.86 22. LyS-FASTPARSE (A Coruña) software5 91.68 23. TRL (Tokyo) software1 88.28 24. OpenU NLP Lab (Ra'anana) software6 64.67 25. Wenba-NLU (Wuhan) software1 0.00 26. ECNU (Shanghai) software1 0.00 27. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 ÚFAL – UDPipe 1.2 (Praha) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00 IMS (Stuttgart) software2 0.00
fr_pud
1. IMS (Stuttgart) software2 94.21 2. Orange – Deskiñ (Lannion) software1 93.37 METU (Ankara) software2 93.37 4. Uppsala (Uppsala) software1 92.71 5. fbaml (Palo Alto) software1 91.81 6. RACAI (București) software1 4.82 7. ParisNLP (Paris) software1 4.80 darc (Tübingen) software1 4.80 IIT Kharagpur (Kharagpur) software3 4.80 CLCL (Genève) software1 4.80 NAIST SATO (Nara) software1 4.80 UParse (Edinburgh) software1 4.80 LIMSI-LIPN (Paris) software2 4.80 MQuni (Sydney) software2 4.80 LyS-FASTPARSE (A Coruña) software5 4.80 TurkuNLP (Turku) software1 4.80 LATTICE (Paris) software7 4.80 naistCL (Nara) software1 4.80 UALING (Tucson) software1 4.80 Koç University (İstanbul) software3 4.80 BASELINE UDPipe 1.1 (Praha) software2 4.80 Stanford (Stanford) software1 4.80 C2L2 (Ithaca) software5 4.80 MetaRomance (Santiago de Compostela) software1 4.80 Mengest (Shanghai) software1 4.80 26. Wanghao-ftd-SJTU (Shanghai) software2 4.79 ÚFAL – UDPipe 1.2 (Praha) software1 4.79 HIT-SCIR (Harbin) software4 4.79 29. OpenU NLP Lab (Ra'anana) software6 3.78 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 32. TRL (Tokyo) software1 0.00 UT (Tartu) software1 0.00
fr_sequoia
1. ÚFAL – UDPipe 1.2 (Praha) software1 96.82 2. TurkuNLP (Turku) software1 96.76 3. darc (Tübingen) software1 96.75 HIT-SCIR (Harbin) software4 96.75 5. Wenba-NLU (Wuhan) software1 96.65 ParisNLP (Paris) software1 96.65 IIT Kharagpur (Kharagpur) software3 96.65 NAIST SATO (Nara) software1 96.65 UParse (Edinburgh) software1 96.65 LIMSI-LIPN (Paris) software2 96.65 MQuni (Sydney) software2 96.65 LATTICE (Paris) software7 96.65 naistCL (Nara) software1 96.65 UALING (Tucson) software1 96.65 Koç University (İstanbul) software3 96.65 BASELINE UDPipe 1.1 (Praha) software2 96.65 Stanford (Stanford) software1 96.65 C2L2 (Ithaca) software5 96.65 MetaRomance (Santiago de Compostela) software1 96.65 Mengest (Shanghai) software1 96.65 CLCL (Genève) software2 96.65 22. Wanghao-ftd-SJTU (Shanghai) software2 96.48 23. RACAI (București) software1 95.66 24. LyS-FASTPARSE (A Coruña) software5 89.28 25. TRL (Tokyo) software1 86.04 26. OpenU NLP Lab (Ra'anana) software6 63.74 27. ECNU (Shanghai) software1 0.00 28. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00 IMS (Stuttgart) software2 0.00
ga
1. TurkuNLP (Turku) software1 85.99 2. ÚFAL – UDPipe 1.2 (Praha) software1 85.45 3. darc (Tübingen) software1 85.38 4. HIT-SCIR (Harbin) software4 85.36 5. ParisNLP (Paris) software1 85.22 MetaRomance (Santiago de Compostela) software1 85.22 7. IIT Kharagpur (Kharagpur) software3 85.21 NAIST SATO (Nara) software1 85.21 UParse (Edinburgh) software1 85.21 LIMSI-LIPN (Paris) software2 85.21 MQuni (Sydney) software2 85.21 LATTICE (Paris) software7 85.21 naistCL (Nara) software1 85.21 UALING (Tucson) software1 85.21 Koç University (İstanbul) software3 85.21 BASELINE UDPipe 1.1 (Praha) software2 85.21 Stanford (Stanford) software1 85.21 C2L2 (Ithaca) software5 85.21 IMS (Stuttgart) software2 85.21 Mengest (Shanghai) software1 85.21 CLCL (Genève) software2 85.21 22. Wanghao-ftd-SJTU (Shanghai) software2 84.89 23. RACAI (București) software1 83.33 24. LyS-FASTPARSE (A Coruña) software5 82.32 25. OpenU NLP Lab (Ra'anana) software6 63.71 26. TRL (Tokyo) software1 60.48 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
gl
1. RACAI (București) software1 96.94 2. ÚFAL – UDPipe 1.2 (Praha) software1 96.93 3. darc (Tübingen) software1 96.89 HIT-SCIR (Harbin) software4 96.89 5. TurkuNLP (Turku) software1 96.81 6. Wenba-NLU (Wuhan) software1 96.72 ParisNLP (Paris) software1 96.72 IIT Kharagpur (Kharagpur) software3 96.72 NAIST SATO (Nara) software1 96.72 UParse (Edinburgh) software1 96.72 LIMSI-LIPN (Paris) software2 96.72 MQuni (Sydney) software2 96.72 LATTICE (Paris) software7 96.72 naistCL (Nara) software1 96.72 UALING (Tucson) software1 96.72 Koç University (İstanbul) software3 96.72 BASELINE UDPipe 1.1 (Praha) software2 96.72 Stanford (Stanford) software1 96.72 C2L2 (Ithaca) software5 96.72 MetaRomance (Santiago de Compostela) software1 96.72 IMS (Stuttgart) software2 96.72 Mengest (Shanghai) software1 96.72 CLCL (Genève) software2 96.72 24. LyS-FASTPARSE (A Coruña) software5 96.05 25. Wanghao-ftd-SJTU (Shanghai) software2 95.83 26. TRL (Tokyo) software1 72.33 27. OpenU NLP Lab (Ra'anana) software6 64.51 28. UT (Tartu) software1 44.01 29. ECNU (Shanghai) software1 0.17 Uppsala (Uppsala) software1 0.17 Orange – Deskiñ (Lannion) software1 0.17 METU (Ankara) software2 0.17 fbaml (Palo Alto) software1 0.17
gl_treegal
1. TurkuNLP (Turku) software1 92.63 2. HIT-SCIR (Harbin) software4 92.61 3. ÚFAL – UDPipe 1.2 (Praha) software1 92.56 4. darc (Tübingen) software1 92.46 5. Wanghao-ftd-SJTU (Shanghai) software2 92.37 6. ParisNLP (Paris) software1 92.30 IIT Kharagpur (Kharagpur) software3 92.30 NAIST SATO (Nara) software1 92.30 UParse (Edinburgh) software1 92.30 LIMSI-LIPN (Paris) software2 92.30 MQuni (Sydney) software2 92.30 LATTICE (Paris) software7 92.30 naistCL (Nara) software1 92.30 UALING (Tucson) software1 92.30 Koç University (İstanbul) software3 92.30 BASELINE UDPipe 1.1 (Praha) software2 92.30 Stanford (Stanford) software1 92.30 C2L2 (Ithaca) software5 92.30 MetaRomance (Santiago de Compostela) software1 92.30 IMS (Stuttgart) software2 92.30 Mengest (Shanghai) software1 92.30 CLCL (Genève) software2 92.30 23. LyS-FASTPARSE (A Coruña) software5 91.27 24. RACAI (București) software1 90.94 25. OpenU NLP Lab (Ra'anana) software6 64.78 26. TRL (Tokyo) software1 63.06 27. Uppsala (Uppsala) software1 0.21 Orange – Deskiñ (Lannion) software1 0.21 METU (Ankara) software2 0.21 30. fbaml (Palo Alto) software1 0.20 31. Wenba-NLU (Wuhan) software1 0.00 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
got
1. ÚFAL – UDPipe 1.2 (Praha) software1 92.45 2. HIT-SCIR (Harbin) software4 92.44 3. TurkuNLP (Turku) software1 92.36 4. darc (Tübingen) software1 92.32 5. Wenba-NLU (Wuhan) software1 92.05 ParisNLP (Paris) software1 92.05 IIT Kharagpur (Kharagpur) software3 92.05 NAIST SATO (Nara) software1 92.05 UParse (Edinburgh) software1 92.05 LIMSI-LIPN (Paris) software2 92.05 MQuni (Sydney) software2 92.05 LATTICE (Paris) software7 92.05 naistCL (Nara) software1 92.05 UALING (Tucson) software1 92.05 Koç University (İstanbul) software3 92.05 BASELINE UDPipe 1.1 (Praha) software2 92.05 Stanford (Stanford) software1 92.05 C2L2 (Ithaca) software5 92.05 MetaRomance (Santiago de Compostela) software1 92.05 Mengest (Shanghai) software1 92.05 CLCL (Genève) software2 92.05 22. Wanghao-ftd-SJTU (Shanghai) software2 88.82 23. RACAI (București) software1 88.80 24. LyS-FASTPARSE (A Coruña) software5 88.59 25. OpenU NLP Lab (Ra'anana) software6 41.08 26. UT (Tartu) software1 36.53 27. TRL (Tokyo) software1 35.25 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 IMS (Stuttgart) software2 0.00
grc
1. darc (Tübingen) software1 82.67 HIT-SCIR (Harbin) software4 82.67 3. TurkuNLP (Turku) software1 82.65 4. Wenba-NLU (Wuhan) software1 81.91 ParisNLP (Paris) software1 81.91 IIT Kharagpur (Kharagpur) software3 81.91 NAIST SATO (Nara) software1 81.91 UParse (Edinburgh) software1 81.91 LIMSI-LIPN (Paris) software2 81.91 MQuni (Sydney) software2 81.91 LyS-FASTPARSE (A Coruña) software5 81.91 LATTICE (Paris) software7 81.91 naistCL (Nara) software1 81.91 UALING (Tucson) software1 81.91 Koç University (İstanbul) software3 81.91 BASELINE UDPipe 1.1 (Praha) software2 81.91 Stanford (Stanford) software1 81.91 C2L2 (Ithaca) software5 81.91 MetaRomance (Santiago de Compostela) software1 81.91 IMS (Stuttgart) software2 81.91 Mengest (Shanghai) software1 81.91 CLCL (Genève) software2 81.91 23. Wanghao-ftd-SJTU (Shanghai) software2 80.09 24. RACAI (București) software1 72.35 25. UT (Tartu) software1 31.16 26. TRL (Tokyo) software1 26.27 27. OpenU NLP Lab (Ra'anana) software6 26.25 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 ÚFAL – UDPipe 1.2 (Praha) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00
grc_proiel
1. TurkuNLP (Turku) software1 92.57 HIT-SCIR (Harbin) software4 92.57 3. darc (Tübingen) software1 92.56 4. Wenba-NLU (Wuhan) software1 92.25 ParisNLP (Paris) software1 92.25 IIT Kharagpur (Kharagpur) software3 92.25 NAIST SATO (Nara) software1 92.25 UParse (Edinburgh) software1 92.25 LIMSI-LIPN (Paris) software2 92.25 MQuni (Sydney) software2 92.25 LyS-FASTPARSE (A Coruña) software5 92.25 LATTICE (Paris) software7 92.25 naistCL (Nara) software1 92.25 UALING (Tucson) software1 92.25 Koç University (İstanbul) software3 92.25 BASELINE UDPipe 1.1 (Praha) software2 92.25 Stanford (Stanford) software1 92.25 C2L2 (Ithaca) software5 92.25 MetaRomance (Santiago de Compostela) software1 92.25 Mengest (Shanghai) software1 92.25 CLCL (Genève) software2 92.25 22. Wanghao-ftd-SJTU (Shanghai) software2 90.18 23. RACAI (București) software1 90.17 24. OpenU NLP Lab (Ra'anana) software6 16.22 25. TRL (Tokyo) software1 16.17 26. ECNU (Shanghai) software1 0.00 27. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 ÚFAL – UDPipe 1.2 (Praha) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00 IMS (Stuttgart) software2 0.00
he
1. ÚFAL – UDPipe 1.2 (Praha) software1 79.58 2. darc (Tübingen) software1 79.28 HIT-SCIR (Harbin) software4 79.28 4. Wanghao-ftd-SJTU (Shanghai) software2 78.98 5. TurkuNLP (Turku) software1 78.96 6. Wenba-NLU (Wuhan) software1 78.91 IIT Kharagpur (Kharagpur) software3 78.91 NAIST SATO (Nara) software1 78.91 UParse (Edinburgh) software1 78.91 LIMSI-LIPN (Paris) software2 78.91 MQuni (Sydney) software2 78.91 LATTICE (Paris) software7 78.91 naistCL (Nara) software1 78.91 UALING (Tucson) software1 78.91 Koç University (İstanbul) software3 78.91 BASELINE UDPipe 1.1 (Praha) software2 78.91 Stanford (Stanford) software1 78.91 C2L2 (Ithaca) software5 78.91 Mengest (Shanghai) software1 78.91 CLCL (Genève) software2 78.91 21. ParisNLP (Paris) software1 78.83 MetaRomance (Santiago de Compostela) software1 78.83 23. LyS-FASTPARSE (A Coruña) software5 77.84 24. RACAI (București) software1 75.64 25. TRL (Tokyo) software1 72.68 26. OpenU NLP Lab (Ra'anana) software6 61.95 27. fbaml (Palo Alto) software1 2.69 28. Uppsala (Uppsala) software1 2.67 29. Orange – Deskiñ (Lannion) software1 2.62 METU (Ankara) software2 2.62 IMS (Stuttgart) software2 2.62 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
hi
1. Wenba-NLU (Wuhan) software1 98.00 ParisNLP (Paris) software1 98.00 darc (Tübingen) software1 98.00 IIT Kharagpur (Kharagpur) software3 98.00 NAIST SATO (Nara) software1 98.00 UParse (Edinburgh) software1 98.00 LIMSI-LIPN (Paris) software2 98.00 MQuni (Sydney) software2 98.00 TurkuNLP (Turku) software1 98.00 LATTICE (Paris) software7 98.00 naistCL (Nara) software1 98.00 UALING (Tucson) software1 98.00 Koç University (İstanbul) software3 98.00 BASELINE UDPipe 1.1 (Praha) software2 98.00 ÚFAL – UDPipe 1.2 (Praha) software1 98.00 Stanford (Stanford) software1 98.00 C2L2 (Ithaca) software5 98.00 MetaRomance (Santiago de Compostela) software1 98.00 HIT-SCIR (Harbin) software4 98.00 IMS (Stuttgart) software2 98.00 Mengest (Shanghai) software1 98.00 CLCL (Genève) software2 98.00 23. Wanghao-ftd-SJTU (Shanghai) software2 97.85 24. LyS-FASTPARSE (A Coruña) software5 96.34 25. RACAI (București) software1 87.09 26. OpenU NLP Lab (Ra'anana) software6 72.30 27. TRL (Tokyo) software1 71.50 28. UT (Tartu) software1 48.63 29. ECNU (Shanghai) software1 0.00 30. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00
hi_pud
1. ECNU (Shanghai) software1 97.81 Orange – Deskiñ (Lannion) software1 97.81 METU (Ankara) software2 97.81 4. fbaml (Palo Alto) software1 92.38 5. Uppsala (Uppsala) software1 92.27 6. UT (Tartu) software1 48.40 7. Wanghao-ftd-SJTU (Shanghai) software2 0.00 Wenba-NLU (Wuhan) software1 0.00 ParisNLP (Paris) software1 0.00 darc (Tübingen) software1 0.00 IIT Kharagpur (Kharagpur) software3 0.00 TRL (Tokyo) software1 0.00 CLCL (Genève) software1 0.00 NAIST SATO (Nara) software1 0.00 UParse (Edinburgh) software1 0.00 LIMSI-LIPN (Paris) software2 0.00 MQuni (Sydney) software2 0.00 LyS-FASTPARSE (A Coruña) software5 0.00 TurkuNLP (Turku) software1 0.00 LATTICE (Paris) software7 0.00 naistCL (Nara) software1 0.00 UALING (Tucson) software1 0.00 Koç University (İstanbul) software3 0.00 BASELINE UDPipe 1.1 (Praha) software2 0.00 ÚFAL – UDPipe 1.2 (Praha) software1 0.00 Stanford (Stanford) software1 0.00 C2L2 (Ithaca) software5 0.00 MetaRomance (Santiago de Compostela) software1 0.00 HIT-SCIR (Harbin) software4 0.00 IMS (Stuttgart) software2 0.00 Mengest (Shanghai) software1 0.00 RACAI (București) software1 0.00 OpenU NLP Lab (Ra'anana) software6 0.00
hr
1. TurkuNLP (Turku) software1 94.47 2. Wenba-NLU (Wuhan) software1 94.41 ParisNLP (Paris) software1 94.41 IIT Kharagpur (Kharagpur) software3 94.41 CLCL (Genève) software1 94.41 NAIST SATO (Nara) software1 94.41 UParse (Edinburgh) software1 94.41 LIMSI-LIPN (Paris) software2 94.41 MQuni (Sydney) software2 94.41 LATTICE (Paris) software7 94.41 naistCL (Nara) software1 94.41 UALING (Tucson) software1 94.41 Koç University (İstanbul) software3 94.41 BASELINE UDPipe 1.1 (Praha) software2 94.41 Stanford (Stanford) software1 94.41 C2L2 (Ithaca) software5 94.41 MetaRomance (Santiago de Compostela) software1 94.41 IMS (Stuttgart) software2 94.41 Mengest (Shanghai) software1 94.41 20. darc (Tübingen) software1 94.39 HIT-SCIR (Harbin) software4 94.39 22. ÚFAL – UDPipe 1.2 (Praha) software1 94.33 23. RACAI (București) software1 93.36 24. Wanghao-ftd-SJTU (Shanghai) software2 92.78 25. LyS-FASTPARSE (A Coruña) software5 89.55 26. OpenU NLP Lab (Ra'anana) software6 47.14 27. TRL (Tokyo) software1 43.94 28. UT (Tartu) software1 42.76 29. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00
hsb
1. Wanghao-ftd-SJTU (Shanghai) software2 87.70 ParisNLP (Paris) software1 87.70 darc (Tübingen) software1 87.70 IIT Kharagpur (Kharagpur) software3 87.70 NAIST SATO (Nara) software1 87.70 UParse (Edinburgh) software1 87.70 LIMSI-LIPN (Paris) software2 87.70 MQuni (Sydney) software2 87.70 TurkuNLP (Turku) software1 87.70 LATTICE (Paris) software7 87.70 naistCL (Nara) software1 87.70 UALING (Tucson) software1 87.70 Koç University (İstanbul) software3 87.70 BASELINE UDPipe 1.1 (Praha) software2 87.70 ÚFAL – UDPipe 1.2 (Praha) software1 87.70 Stanford (Stanford) software1 87.70 C2L2 (Ithaca) software5 87.70 MetaRomance (Santiago de Compostela) software1 87.70 HIT-SCIR (Harbin) software4 87.70 IMS (Stuttgart) software2 87.70 Mengest (Shanghai) software1 87.70 CLCL (Genève) software2 87.70 RACAI (București) software1 87.70 24. LyS-FASTPARSE (A Coruña) software5 82.87 25. TRL (Tokyo) software1 59.86 26. OpenU NLP Lab (Ra'anana) software6 54.24 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
hu
1. ÚFAL – UDPipe 1.2 (Praha) software1 88.40 2. TurkuNLP (Turku) software1 88.06 3. darc (Tübingen) software1 87.85 4. ParisNLP (Paris) software1 87.67 MetaRomance (Santiago de Compostela) software1 87.67 6. Wenba-NLU (Wuhan) software1 87.65 IIT Kharagpur (Kharagpur) software3 87.65 CLCL (Genève) software1 87.65 NAIST SATO (Nara) software1 87.65 UParse (Edinburgh) software1 87.65 LIMSI-LIPN (Paris) software2 87.65 MQuni (Sydney) software2 87.65 LATTICE (Paris) software7 87.65 naistCL (Nara) software1 87.65 UALING (Tucson) software1 87.65 Koç University (İstanbul) software3 87.65 Stanford (Stanford) software1 87.65 C2L2 (Ithaca) software5 87.65 IMS (Stuttgart) software2 87.65 Mengest (Shanghai) software1 87.65 21. BASELINE UDPipe 1.1 (Praha) software2 87.63 22. Wanghao-ftd-SJTU (Shanghai) software2 87.17 23. HIT-SCIR (Harbin) software4 87.09 24. RACAI (București) software1 80.02 25. LyS-FASTPARSE (A Coruña) software5 79.55 26. OpenU NLP Lab (Ra'anana) software6 66.10 27. TRL (Tokyo) software1 56.21 28. UT (Tartu) software1 37.39 29. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00
id
1. Wanghao-ftd-SJTU (Shanghai) software2 100.00 darc (Tübingen) software1 100.00 Uppsala (Uppsala) software1 100.00 ÚFAL – UDPipe 1.2 (Praha) software1 100.00 HIT-SCIR (Harbin) software4 100.00 6. Wenba-NLU (Wuhan) software1 99.99 ECNU (Shanghai) software1 99.99 IIT Kharagpur (Kharagpur) software3 99.99 NAIST SATO (Nara) software1 99.99 Orange – Deskiñ (Lannion) software1 99.99 UParse (Edinburgh) software1 99.99 LIMSI-LIPN (Paris) software2 99.99 MQuni (Sydney) software2 99.99 LyS-FASTPARSE (A Coruña) software5 99.99 TurkuNLP (Turku) software1 99.99 LATTICE (Paris) software7 99.99 naistCL (Nara) software1 99.99 UALING (Tucson) software1 99.99 Koç University (İstanbul) software3 99.99 BASELINE UDPipe 1.1 (Praha) software2 99.99 Stanford (Stanford) software1 99.99 METU (Ankara) software2 99.99 C2L2 (Ithaca) software5 99.99 UT (Tartu) software1 99.99 IMS (Stuttgart) software2 99.99 Mengest (Shanghai) software1 99.99 CLCL (Genève) software2 99.99 28. fbaml (Palo Alto) software1 99.96 29. RACAI (București) software1 85.47 30. ParisNLP (Paris) software1 0.00 TRL (Tokyo) software1 0.00 MetaRomance (Santiago de Compostela) software1 0.00 OpenU NLP Lab (Ra'anana) software6 0.00
it
1. Wenba-NLU (Wuhan) software1 97.06 darc (Tübingen) software1 97.06 IIT Kharagpur (Kharagpur) software3 97.06 NAIST SATO (Nara) software1 97.06 UParse (Edinburgh) software1 97.06 LIMSI-LIPN (Paris) software2 97.06 MQuni (Sydney) software2 97.06 LATTICE (Paris) software7 97.06 naistCL (Nara) software1 97.06 UALING (Tucson) software1 97.06 Koç University (İstanbul) software3 97.06 BASELINE UDPipe 1.1 (Praha) software2 97.06 Stanford (Stanford) software1 97.06 C2L2 (Ithaca) software5 97.06 MetaRomance (Santiago de Compostela) software1 97.06 HIT-SCIR (Harbin) software4 97.06 IMS (Stuttgart) software2 97.06 Mengest (Shanghai) software1 97.06 CLCL (Genève) software2 97.06 20. ParisNLP (Paris) software1 97.04 21. TurkuNLP (Turku) software1 97.01 22. Wanghao-ftd-SJTU (Shanghai) software2 96.76 23. LyS-FASTPARSE (A Coruña) software5 91.83 24. RACAI (București) software1 89.40 25. TRL (Tokyo) software1 78.05 26. OpenU NLP Lab (Ra'anana) software6 65.04 27. ECNU (Shanghai) software1 0.00 28. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 ÚFAL – UDPipe 1.2 (Praha) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
it_pud
1. ParisNLP (Paris) software1 95.50 darc (Tübingen) software1 95.50 IIT Kharagpur (Kharagpur) software3 95.50 CLCL (Genève) software1 95.50 NAIST SATO (Nara) software1 95.50 UParse (Edinburgh) software1 95.50 LIMSI-LIPN (Paris) software2 95.50 MQuni (Sydney) software2 95.50 LATTICE (Paris) software7 95.50 naistCL (Nara) software1 95.50 UALING (Tucson) software1 95.50 Koç University (İstanbul) software3 95.50 BASELINE UDPipe 1.1 (Praha) software2 95.50 Stanford (Stanford) software1 95.50 C2L2 (Ithaca) software5 95.50 MetaRomance (Santiago de Compostela) software1 95.50 IMS (Stuttgart) software2 95.50 Mengest (Shanghai) software1 95.50 19. TurkuNLP (Turku) software1 95.42 HIT-SCIR (Harbin) software4 95.42 21. Wanghao-ftd-SJTU (Shanghai) software2 95.22 22. RACAI (București) software1 88.22 23. LyS-FASTPARSE (A Coruña) software5 87.75 24. TRL (Tokyo) software1 76.29 25. OpenU NLP Lab (Ra'anana) software6 64.89 26. Wenba-NLU (Wuhan) software1 0.00 27. ECNU (Shanghai) software1 0.00 28. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 ÚFAL – UDPipe 1.2 (Praha) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
ja
1. TRL (Tokyo) software1 98.54 2. LIMSI-LIPN (Paris) software2 92.99 3. HIT-SCIR (Harbin) software4 92.19 4. ÚFAL – UDPipe 1.2 (Praha) software1 90.19 5. darc (Tübingen) software1 89.04 6. TurkuNLP (Turku) software1 88.95 7. Wenba-NLU (Wuhan) software1 88.92 IIT Kharagpur (Kharagpur) software3 88.92 NAIST SATO (Nara) software1 88.92 UParse (Edinburgh) software1 88.92 MQuni (Sydney) software2 88.92 LATTICE (Paris) software7 88.92 naistCL (Nara) software1 88.92 UALING (Tucson) software1 88.92 Koç University (İstanbul) software3 88.92 BASELINE UDPipe 1.1 (Praha) software2 88.92 Stanford (Stanford) software1 88.92 C2L2 (Ithaca) software5 88.92 MetaRomance (Santiago de Compostela) software1 88.92 Mengest (Shanghai) software1 88.92 CLCL (Genève) software2 88.92 22. Wanghao-ftd-SJTU (Shanghai) software2 88.49 23. ParisNLP (Paris) software1 87.93 24. LyS-FASTPARSE (A Coruña) software5 86.82 25. RACAI (București) software1 86.00 26. OpenU NLP Lab (Ra'anana) software6 77.53 27. UT (Tartu) software1 43.80 28. ECNU (Shanghai) software1 0.04 Uppsala (Uppsala) software1 0.04 Orange – Deskiñ (Lannion) software1 0.04 METU (Ankara) software2 0.04 32. fbaml (Palo Alto) software1 0.01 33. IMS (Stuttgart) software2 0.00
ja_pud
1. LIMSI-LIPN (Paris) software2 93.95 2. HIT-SCIR (Harbin) software4 93.52 3. ÚFAL – UDPipe 1.2 (Praha) software1 91.39 4. ParisNLP (Paris) software1 90.06 darc (Tübingen) software1 90.06 IIT Kharagpur (Kharagpur) software3 90.06 CLCL (Genève) software1 90.06 NAIST SATO (Nara) software1 90.06 UParse (Edinburgh) software1 90.06 MQuni (Sydney) software2 90.06 LATTICE (Paris) software7 90.06 naistCL (Nara) software1 90.06 UALING (Tucson) software1 90.06 Koç University (İstanbul) software3 90.06 BASELINE UDPipe 1.1 (Praha) software2 90.06 Stanford (Stanford) software1 90.06 C2L2 (Ithaca) software5 90.06 MetaRomance (Santiago de Compostela) software1 90.06 Mengest (Shanghai) software1 90.06 20. TurkuNLP (Turku) software1 90.05 21. Wanghao-ftd-SJTU (Shanghai) software2 90.04 22. TRL (Tokyo) software1 89.36 23. RACAI (București) software1 88.55 24. LyS-FASTPARSE (A Coruña) software5 87.76 25. OpenU NLP Lab (Ra'anana) software6 79.29 26. UT (Tartu) software1 43.12 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 IMS (Stuttgart) software2 0.00
kk
1. TurkuNLP (Turku) software1 59.69 2. Wanghao-ftd-SJTU (Shanghai) software2 59.65 3. ÚFAL – UDPipe 1.2 (Praha) software1 59.46 4. darc (Tübingen) software1 58.86 5. HIT-SCIR (Harbin) software4 58.83 6. ParisNLP (Paris) software1 58.53 MetaRomance (Santiago de Compostela) software1 58.53 8. IIT Kharagpur (Kharagpur) software3 58.52 NAIST SATO (Nara) software1 58.52 UParse (Edinburgh) software1 58.52 LIMSI-LIPN (Paris) software2 58.52 MQuni (Sydney) software2 58.52 LATTICE (Paris) software7 58.52 naistCL (Nara) software1 58.52 UALING (Tucson) software1 58.52 Koç University (İstanbul) software3 58.52 Stanford (Stanford) software1 58.52 C2L2 (Ithaca) software5 58.52 IMS (Stuttgart) software2 58.52 CLCL (Genève) software2 58.52 21. BASELINE UDPipe 1.1 (Praha) software2 58.16 22. LyS-FASTPARSE (A Coruña) software5 57.05 23. RACAI (București) software1 51.48 24. TRL (Tokyo) software1 47.59 25. OpenU NLP Lab (Ra'anana) software6 46.67 26. Wenba-NLU (Wuhan) software1 0.00 27. ECNU (Shanghai) software1 0.00 28. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00 Mengest (Shanghai) software1 0.00
kmr
1. Wanghao-ftd-SJTU (Shanghai) software2 89.76 ParisNLP (Paris) software1 89.76 darc (Tübingen) software1 89.76 IIT Kharagpur (Kharagpur) software3 89.76 NAIST SATO (Nara) software1 89.76 UParse (Edinburgh) software1 89.76 LIMSI-LIPN (Paris) software2 89.76 MQuni (Sydney) software2 89.76 TurkuNLP (Turku) software1 89.76 LATTICE (Paris) software7 89.76 naistCL (Nara) software1 89.76 UALING (Tucson) software1 89.76 Koç University (İstanbul) software3 89.76 BASELINE UDPipe 1.1 (Praha) software2 89.76 ÚFAL – UDPipe 1.2 (Praha) software1 89.76 Stanford (Stanford) software1 89.76 C2L2 (Ithaca) software5 89.76 MetaRomance (Santiago de Compostela) software1 89.76 HIT-SCIR (Harbin) software4 89.76 IMS (Stuttgart) software2 89.76 Mengest (Shanghai) software1 89.76 CLCL (Genève) software2 89.76 RACAI (București) software1 89.76 24. LyS-FASTPARSE (A Coruña) software5 85.59 25. OpenU NLP Lab (Ra'anana) software6 52.06 26. TRL (Tokyo) software1 51.62 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
ko
1. TurkuNLP (Turku) software1 99.36 2. Wanghao-ftd-SJTU (Shanghai) software2 99.34 IIT Kharagpur (Kharagpur) software3 99.34 NAIST SATO (Nara) software1 99.34 UParse (Edinburgh) software1 99.34 LIMSI-LIPN (Paris) software2 99.34 MQuni (Sydney) software2 99.34 LyS-FASTPARSE (A Coruña) software5 99.34 LATTICE (Paris) software7 99.34 naistCL (Nara) software1 99.34 UALING (Tucson) software1 99.34 Koç University (İstanbul) software3 99.34 BASELINE UDPipe 1.1 (Praha) software2 99.34 Stanford (Stanford) software1 99.34 C2L2 (Ithaca) software5 99.34 IMS (Stuttgart) software2 99.34 Mengest (Shanghai) software1 99.34 CLCL (Genève) software2 99.34 19. darc (Tübingen) software1 99.33 20. ÚFAL – UDPipe 1.2 (Praha) software1 99.32 HIT-SCIR (Harbin) software4 99.32 22. UT (Tartu) software1 96.20 23. ECNU (Shanghai) software1 92.64 Orange – Deskiñ (Lannion) software1 92.64 METU (Ankara) software2 92.64 26. Uppsala (Uppsala) software1 92.60 27. fbaml (Palo Alto) software1 92.07 28. RACAI (București) software1 53.80 29. ParisNLP (Paris) software1 7.08 MetaRomance (Santiago de Compostela) software1 7.08 OpenU NLP Lab (Ra'anana) software6 7.08 32. TRL (Tokyo) software1 7.02 33. Wenba-NLU (Wuhan) software1 0.00
la
1. TurkuNLP (Turku) software1 54.00 2. HIT-SCIR (Harbin) software4 53.82 3. ÚFAL – UDPipe 1.2 (Praha) software1 51.85 4. darc (Tübingen) software1 50.81 5. ParisNLP (Paris) software1 50.00 IIT Kharagpur (Kharagpur) software3 50.00 NAIST SATO (Nara) software1 50.00 UParse (Edinburgh) software1 50.00 LIMSI-LIPN (Paris) software2 50.00 MQuni (Sydney) software2 50.00 LATTICE (Paris) software7 50.00 naistCL (Nara) software1 50.00 UALING (Tucson) software1 50.00 Koç University (İstanbul) software3 50.00 BASELINE UDPipe 1.1 (Praha) software2 50.00 Stanford (Stanford) software1 50.00 C2L2 (Ithaca) software5 50.00 MetaRomance (Santiago de Compostela) software1 50.00 Mengest (Shanghai) software1 50.00 CLCL (Genève) software2 50.00 21. LyS-FASTPARSE (A Coruña) software5 49.41 22. UT (Tartu) software1 48.15 23. Wanghao-ftd-SJTU (Shanghai) software2 47.65 24. RACAI (București) software1 31.42 25. TRL (Tokyo) software1 5.39 26. OpenU NLP Lab (Ra'anana) software6 5.13 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 IMS (Stuttgart) software2 0.00
la_ittb
1. IIT Kharagpur (Kharagpur) software3 97.99 CLCL (Genève) software1 97.99 NAIST SATO (Nara) software1 97.99 UParse (Edinburgh) software1 97.99 LIMSI-LIPN (Paris) software2 97.99 MQuni (Sydney) software2 97.99 LyS-FASTPARSE (A Coruña) software5 97.99 LATTICE (Paris) software7 97.99 naistCL (Nara) software1 97.99 UALING (Tucson) software1 97.99 Koç University (İstanbul) software3 97.99 BASELINE UDPipe 1.1 (Praha) software2 97.99 Stanford (Stanford) software1 97.99 C2L2 (Ithaca) software5 97.99 Mengest (Shanghai) software1 97.99 16. TurkuNLP (Turku) software1 97.88 17. darc (Tübingen) software1 97.81 18. HIT-SCIR (Harbin) software4 97.80 19. MetaRomance (Santiago de Compostela) software1 97.42 20. ParisNLP (Paris) software1 97.41 21. Wanghao-ftd-SJTU (Shanghai) software2 97.39 22. RACAI (București) software1 94.32 23. OpenU NLP Lab (Ra'anana) software6 50.01 24. TRL (Tokyo) software1 48.55 25. UT (Tartu) software1 21.73 26. ECNU (Shanghai) software1 0.60 Orange – Deskiñ (Lannion) software1 0.60 METU (Ankara) software2 0.60 IMS (Stuttgart) software2 0.60 30. Uppsala (Uppsala) software1 0.59 fbaml (Palo Alto) software1 0.59 32. ÚFAL – UDPipe 1.2 (Praha) software1 0.53 33. Wenba-NLU (Wuhan) software1 0.00
la_proiel
1. TurkuNLP (Turku) software1 95.00 2. ÚFAL – UDPipe 1.2 (Praha) software1 94.91 3. HIT-SCIR (Harbin) software4 94.89 4. darc (Tübingen) software1 94.81 5. Wenba-NLU (Wuhan) software1 94.22 ParisNLP (Paris) software1 94.22 IIT Kharagpur (Kharagpur) software3 94.22 CLCL (Genève) software1 94.22 NAIST SATO (Nara) software1 94.22 UParse (Edinburgh) software1 94.22 LIMSI-LIPN (Paris) software2 94.22 MQuni (Sydney) software2 94.22 LATTICE (Paris) software7 94.22 naistCL (Nara) software1 94.22 UALING (Tucson) software1 94.22 Koç University (İstanbul) software3 94.22 BASELINE UDPipe 1.1 (Praha) software2 94.22 Stanford (Stanford) software1 94.22 C2L2 (Ithaca) software5 94.22 MetaRomance (Santiago de Compostela) software1 94.22 Mengest (Shanghai) software1 94.22 22. Wanghao-ftd-SJTU (Shanghai) software2 91.99 23. LyS-FASTPARSE (A Coruña) software5 90.03 24. RACAI (București) software1 88.08 25. OpenU NLP Lab (Ra'anana) software6 39.86 26. TRL (Tokyo) software1 38.74 27. ECNU (Shanghai) software1 0.00 28. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00 IMS (Stuttgart) software2 0.00
lv
1. ÚFAL – UDPipe 1.2 (Praha) software1 86.76 2. darc (Tübingen) software1 86.65 HIT-SCIR (Harbin) software4 86.65 4. TurkuNLP (Turku) software1 86.39 5. MetaRomance (Santiago de Compostela) software1 85.93 6. Wenba-NLU (Wuhan) software1 85.92 IIT Kharagpur (Kharagpur) software3 85.92 CLCL (Genève) software1 85.92 NAIST SATO (Nara) software1 85.92 UParse (Edinburgh) software1 85.92 LIMSI-LIPN (Paris) software2 85.92 MQuni (Sydney) software2 85.92 LATTICE (Paris) software7 85.92 naistCL (Nara) software1 85.92 UALING (Tucson) software1 85.92 Koç University (İstanbul) software3 85.92 BASELINE UDPipe 1.1 (Praha) software2 85.92 Stanford (Stanford) software1 85.92 C2L2 (Ithaca) software5 85.92 IMS (Stuttgart) software2 85.92 Mengest (Shanghai) software1 85.92 22. ParisNLP (Paris) software1 85.68 23. UT (Tartu) software1 85.56 24. Wanghao-ftd-SJTU (Shanghai) software2 85.25 25. RACAI (București) software1 84.86 26. LyS-FASTPARSE (A Coruña) software5 83.62 27. TRL (Tokyo) software1 52.86 28. OpenU NLP Lab (Ra'anana) software6 52.30 29. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00
nl
1. ÚFAL – UDPipe 1.2 (Praha) software1 89.77 2. Wenba-NLU (Wuhan) software1 89.62 ParisNLP (Paris) software1 89.62 IIT Kharagpur (Kharagpur) software3 89.62 CLCL (Genève) software1 89.62 NAIST SATO (Nara) software1 89.62 UParse (Edinburgh) software1 89.62 LIMSI-LIPN (Paris) software2 89.62 MQuni (Sydney) software2 89.62 LATTICE (Paris) software7 89.62 naistCL (Nara) software1 89.62 UALING (Tucson) software1 89.62 Koç University (İstanbul) software3 89.62 BASELINE UDPipe 1.1 (Praha) software2 89.62 Stanford (Stanford) software1 89.62 C2L2 (Ithaca) software5 89.62 MetaRomance (Santiago de Compostela) software1 89.62 IMS (Stuttgart) software2 89.62 Mengest (Shanghai) software1 89.62 20. TurkuNLP (Turku) software1 89.60 21. darc (Tübingen) software1 89.56 HIT-SCIR (Harbin) software4 89.56 23. Wanghao-ftd-SJTU (Shanghai) software2 89.27 24. LyS-FASTPARSE (A Coruña) software5 82.74 25. RACAI (București) software1 77.02 26. TRL (Tokyo) software1 72.02 27. OpenU NLP Lab (Ra'anana) software6 70.82 28. UT (Tartu) software1 41.20 29. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00
nl_lassysmall
1. darc (Tübingen) software1 98.01 HIT-SCIR (Harbin) software4 98.01 3. ÚFAL – UDPipe 1.2 (Praha) software1 97.99 4. TurkuNLP (Turku) software1 97.98 5. Wenba-NLU (Wuhan) software1 97.89 ParisNLP (Paris) software1 97.89 IIT Kharagpur (Kharagpur) software3 97.89 CLCL (Genève) software1 97.89 NAIST SATO (Nara) software1 97.89 UParse (Edinburgh) software1 97.89 LIMSI-LIPN (Paris) software2 97.89 MQuni (Sydney) software2 97.89 LATTICE (Paris) software7 97.89 naistCL (Nara) software1 97.89 UALING (Tucson) software1 97.89 Koç University (İstanbul) software3 97.89 BASELINE UDPipe 1.1 (Praha) software2 97.89 Stanford (Stanford) software1 97.89 C2L2 (Ithaca) software5 97.89 MetaRomance (Santiago de Compostela) software1 97.89 Mengest (Shanghai) software1 97.89 22. Wanghao-ftd-SJTU (Shanghai) software2 97.55 23. RACAI (București) software1 97.13 24. TRL (Tokyo) software1 83.03 25. LyS-FASTPARSE (A Coruña) software5 81.07 26. OpenU NLP Lab (Ra'anana) software6 75.52 27. UT (Tartu) software1 38.14 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 IMS (Stuttgart) software2 0.00
no_bokmaal
1. ÚFAL – UDPipe 1.2 (Praha) software1 96.66 2. Wenba-NLU (Wuhan) software1 96.54 ParisNLP (Paris) software1 96.54 IIT Kharagpur (Kharagpur) software3 96.54 CLCL (Genève) software1 96.54 NAIST SATO (Nara) software1 96.54 UParse (Edinburgh) software1 96.54 LIMSI-LIPN (Paris) software2 96.54 MQuni (Sydney) software2 96.54 LATTICE (Paris) software7 96.54 naistCL (Nara) software1 96.54 UALING (Tucson) software1 96.54 Koç University (İstanbul) software3 96.54 BASELINE UDPipe 1.1 (Praha) software2 96.54 Stanford (Stanford) software1 96.54 C2L2 (Ithaca) software5 96.54 MetaRomance (Santiago de Compostela) software1 96.54 IMS (Stuttgart) software2 96.54 Mengest (Shanghai) software1 96.54 20. TurkuNLP (Turku) software1 96.50 21. darc (Tübingen) software1 96.48 HIT-SCIR (Harbin) software4 96.48 23. Wanghao-ftd-SJTU (Shanghai) software2 96.12 24. RACAI (București) software1 95.55 25. LyS-FASTPARSE (A Coruña) software5 90.36 26. TRL (Tokyo) software1 71.71 27. OpenU NLP Lab (Ra'anana) software6 54.43 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
no_nynorsk
1. ÚFAL – UDPipe 1.2 (Praha) software1 96.48 2. darc (Tübingen) software1 96.27 HIT-SCIR (Harbin) software4 96.27 4. TurkuNLP (Turku) software1 96.25 5. Wenba-NLU (Wuhan) software1 96.15 ParisNLP (Paris) software1 96.15 IIT Kharagpur (Kharagpur) software3 96.15 CLCL (Genève) software1 96.15 NAIST SATO (Nara) software1 96.15 UParse (Edinburgh) software1 96.15 LIMSI-LIPN (Paris) software2 96.15 MQuni (Sydney) software2 96.15 LATTICE (Paris) software7 96.15 naistCL (Nara) software1 96.15 UALING (Tucson) software1 96.15 Koç University (İstanbul) software3 96.15 BASELINE UDPipe 1.1 (Praha) software2 96.15 Stanford (Stanford) software1 96.15 C2L2 (Ithaca) software5 96.15 MetaRomance (Santiago de Compostela) software1 96.15 IMS (Stuttgart) software2 96.15 Mengest (Shanghai) software1 96.15 23. Wanghao-ftd-SJTU (Shanghai) software2 95.59 24. RACAI (București) software1 93.30 25. LyS-FASTPARSE (A Coruña) software5 90.00 26. TRL (Tokyo) software1 60.83 27. OpenU NLP Lab (Ra'anana) software6 53.80 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
pl
1. ÚFAL – UDPipe 1.2 (Praha) software1 93.34 2. TurkuNLP (Turku) software1 93.21 3. Wenba-NLU (Wuhan) software1 93.14 ParisNLP (Paris) software1 93.14 IIT Kharagpur (Kharagpur) software3 93.14 CLCL (Genève) software1 93.14 NAIST SATO (Nara) software1 93.14 UParse (Edinburgh) software1 93.14 LIMSI-LIPN (Paris) software2 93.14 MQuni (Sydney) software2 93.14 LATTICE (Paris) software7 93.14 naistCL (Nara) software1 93.14 UALING (Tucson) software1 93.14 Koç University (İstanbul) software3 93.14 BASELINE UDPipe 1.1 (Praha) software2 93.14 Stanford (Stanford) software1 93.14 C2L2 (Ithaca) software5 93.14 MetaRomance (Santiago de Compostela) software1 93.14 IMS (Stuttgart) software2 93.14 Mengest (Shanghai) software1 93.14 21. darc (Tübingen) software1 93.09 HIT-SCIR (Harbin) software4 93.09 23. RACAI (București) software1 92.23 24. Wanghao-ftd-SJTU (Shanghai) software2 91.40 25. LyS-FASTPARSE (A Coruña) software5 91.11 26. TRL (Tokyo) software1 87.40 27. OpenU NLP Lab (Ra'anana) software6 47.37 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
pt
1. Wenba-NLU (Wuhan) software1 96.70 IIT Kharagpur (Kharagpur) software3 96.70 CLCL (Genève) software1 96.70 NAIST SATO (Nara) software1 96.70 UParse (Edinburgh) software1 96.70 LIMSI-LIPN (Paris) software2 96.70 MQuni (Sydney) software2 96.70 LATTICE (Paris) software7 96.70 naistCL (Nara) software1 96.70 UALING (Tucson) software1 96.70 Koç University (İstanbul) software3 96.70 BASELINE UDPipe 1.1 (Praha) software2 96.70 ÚFAL – UDPipe 1.2 (Praha) software1 96.70 Stanford (Stanford) software1 96.70 C2L2 (Ithaca) software5 96.70 IMS (Stuttgart) software2 96.70 Mengest (Shanghai) software1 96.70 18. ParisNLP (Paris) software1 96.68 MetaRomance (Santiago de Compostela) software1 96.68 20. TurkuNLP (Turku) software1 96.64 21. darc (Tübingen) software1 96.63 HIT-SCIR (Harbin) software4 96.63 23. Wanghao-ftd-SJTU (Shanghai) software2 96.30 24. RACAI (București) software1 94.05 25. LyS-FASTPARSE (A Coruña) software5 87.64 26. TRL (Tokyo) software1 74.90 27. OpenU NLP Lab (Ra'anana) software6 70.71 28. Uppsala (Uppsala) software1 0.02 Orange – Deskiñ (Lannion) software1 0.02 METU (Ankara) software2 0.02 fbaml (Palo Alto) software1 0.02 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
pt_br
1. darc (Tübingen) software1 98.76 TurkuNLP (Turku) software1 98.76 HIT-SCIR (Harbin) software4 98.76 4. ÚFAL – UDPipe 1.2 (Praha) software1 98.75 5. Wenba-NLU (Wuhan) software1 98.74 IIT Kharagpur (Kharagpur) software3 98.74 CLCL (Genève) software1 98.74 NAIST SATO (Nara) software1 98.74 UParse (Edinburgh) software1 98.74 LIMSI-LIPN (Paris) software2 98.74 MQuni (Sydney) software2 98.74 LyS-FASTPARSE (A Coruña) software5 98.74 LATTICE (Paris) software7 98.74 naistCL (Nara) software1 98.74 UALING (Tucson) software1 98.74 Koç University (İstanbul) software3 98.74 BASELINE UDPipe 1.1 (Praha) software2 98.74 Stanford (Stanford) software1 98.74 C2L2 (Ithaca) software5 98.74 IMS (Stuttgart) software2 98.74 Mengest (Shanghai) software1 98.74 22. Wanghao-ftd-SJTU (Shanghai) software2 98.48 23. Orange – Deskiñ (Lannion) software1 86.78 METU (Ankara) software2 86.78 25. fbaml (Palo Alto) software1 86.77 26. Uppsala (Uppsala) software1 86.75 27. RACAI (București) software1 81.13 28. ParisNLP (Paris) software1 13.07 MetaRomance (Santiago de Compostela) software1 13.07 30. OpenU NLP Lab (Ra'anana) software6 9.31 31. TRL (Tokyo) software1 0.01 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
pt_pud
1. HIT-SCIR (Harbin) software4 96.14 2. Orange – Deskiñ (Lannion) software1 86.78 METU (Ankara) software2 86.78 4. Uppsala (Uppsala) software1 85.95 5. fbaml (Palo Alto) software1 85.87 6. darc (Tübingen) software1 12.59 IIT Kharagpur (Kharagpur) software3 12.59 CLCL (Genève) software1 12.59 NAIST SATO (Nara) software1 12.59 UParse (Edinburgh) software1 12.59 LIMSI-LIPN (Paris) software2 12.59 MQuni (Sydney) software2 12.59 LyS-FASTPARSE (A Coruña) software5 12.59 LATTICE (Paris) software7 12.59 naistCL (Nara) software1 12.59 UALING (Tucson) software1 12.59 Koç University (İstanbul) software3 12.59 BASELINE UDPipe 1.1 (Praha) software2 12.59 Stanford (Stanford) software1 12.59 C2L2 (Ithaca) software5 12.59 IMS (Stuttgart) software2 12.59 Mengest (Shanghai) software1 12.59 23. Wanghao-ftd-SJTU (Shanghai) software2 12.58 ParisNLP (Paris) software1 12.58 MetaRomance (Santiago de Compostela) software1 12.58 26. TurkuNLP (Turku) software1 12.57 ÚFAL – UDPipe 1.2 (Praha) software1 12.57 28. RACAI (București) software1 11.87 29. OpenU NLP Lab (Ra'anana) software6 8.67 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 32. TRL (Tokyo) software1 0.00 UT (Tartu) software1 0.00
ro
1. ÚFAL – UDPipe 1.2 (Praha) software1 96.54 2. ParisNLP (Paris) software1 96.36 IIT Kharagpur (Kharagpur) software3 96.36 CLCL (Genève) software1 96.36 NAIST SATO (Nara) software1 96.36 UParse (Edinburgh) software1 96.36 LIMSI-LIPN (Paris) software2 96.36 MQuni (Sydney) software2 96.36 LATTICE (Paris) software7 96.36 naistCL (Nara) software1 96.36 UALING (Tucson) software1 96.36 Koç University (İstanbul) software3 96.36 BASELINE UDPipe 1.1 (Praha) software2 96.36 Stanford (Stanford) software1 96.36 C2L2 (Ithaca) software5 96.36 MetaRomance (Santiago de Compostela) software1 96.36 IMS (Stuttgart) software2 96.36 Mengest (Shanghai) software1 96.36 19. TurkuNLP (Turku) software1 96.29 20. darc (Tübingen) software1 96.27 HIT-SCIR (Harbin) software4 96.27 22. RACAI (București) software1 95.90 23. Wanghao-ftd-SJTU (Shanghai) software2 95.56 24. UT (Tartu) software1 95.47 25. LyS-FASTPARSE (A Coruña) software5 91.66 26. OpenU NLP Lab (Ra'anana) software6 56.30 27. TRL (Tokyo) software1 52.46 28. Wenba-NLU (Wuhan) software1 0.00 29. ECNU (Shanghai) software1 0.00 30. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00
ru
1. ÚFAL – UDPipe 1.2 (Praha) software1 74.91 2. darc (Tübingen) software1 74.78 HIT-SCIR (Harbin) software4 74.78 4. TurkuNLP (Turku) software1 74.77 5. ParisNLP (Paris) software1 74.35 IIT Kharagpur (Kharagpur) software3 74.35 CLCL (Genève) software1 74.35 NAIST SATO (Nara) software1 74.35 UParse (Edinburgh) software1 74.35 LIMSI-LIPN (Paris) software2 74.35 MQuni (Sydney) software2 74.35 LATTICE (Paris) software7 74.35 naistCL (Nara) software1 74.35 UALING (Tucson) software1 74.35 Koç University (İstanbul) software3 74.35 BASELINE UDPipe 1.1 (Praha) software2 74.35 Stanford (Stanford) software1 74.35 C2L2 (Ithaca) software5 74.35 MetaRomance (Santiago de Compostela) software1 74.35 IMS (Stuttgart) software2 74.35 Mengest (Shanghai) software1 74.35 22. RACAI (București) software1 74.14 23. Wanghao-ftd-SJTU (Shanghai) software2 74.09 24. LyS-FASTPARSE (A Coruña) software5 70.22 25. OpenU NLP Lab (Ra'anana) software6 24.39 26. TRL (Tokyo) software1 20.01 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
ru_pud
1. Uppsala (Uppsala) software1 97.31 2. ECNU (Shanghai) software1 97.18 Orange – Deskiñ (Lannion) software1 97.18 METU (Ankara) software2 97.18 5. fbaml (Palo Alto) software1 97.15 6. Wanghao-ftd-SJTU (Shanghai) software2 0.00 Wenba-NLU (Wuhan) software1 0.00 ParisNLP (Paris) software1 0.00 darc (Tübingen) software1 0.00 IIT Kharagpur (Kharagpur) software3 0.00 TRL (Tokyo) software1 0.00 CLCL (Genève) software1 0.00 NAIST SATO (Nara) software1 0.00 UParse (Edinburgh) software1 0.00 LIMSI-LIPN (Paris) software2 0.00 MQuni (Sydney) software2 0.00 LyS-FASTPARSE (A Coruña) software5 0.00 TurkuNLP (Turku) software1 0.00 LATTICE (Paris) software7 0.00 naistCL (Nara) software1 0.00 UALING (Tucson) software1 0.00 Koç University (İstanbul) software3 0.00 BASELINE UDPipe 1.1 (Praha) software2 0.00 ÚFAL – UDPipe 1.2 (Praha) software1 0.00 Stanford (Stanford) software1 0.00 C2L2 (Ithaca) software5 0.00 MetaRomance (Santiago de Compostela) software1 0.00 HIT-SCIR (Harbin) software4 0.00 UT (Tartu) software1 0.00 IMS (Stuttgart) software2 0.00 Mengest (Shanghai) software1 0.00 RACAI (București) software1 0.00 OpenU NLP Lab (Ra'anana) software6 0.00
ru_syntagrus
1. HIT-SCIR (Harbin) software4 95.55 2. darc (Tübingen) software1 95.51 TurkuNLP (Turku) software1 95.51 4. ParisNLP (Paris) software1 95.45 IIT Kharagpur (Kharagpur) software3 95.45 CLCL (Genève) software1 95.45 NAIST SATO (Nara) software1 95.45 UParse (Edinburgh) software1 95.45 LIMSI-LIPN (Paris) software2 95.45 MQuni (Sydney) software2 95.45 LATTICE (Paris) software7 95.45 naistCL (Nara) software1 95.45 UALING (Tucson) software1 95.45 Koç University (İstanbul) software3 95.45 BASELINE UDPipe 1.1 (Praha) software2 95.45 Stanford (Stanford) software1 95.45 C2L2 (Ithaca) software5 95.45 MetaRomance (Santiago de Compostela) software1 95.45 IMS (Stuttgart) software2 95.45 Mengest (Shanghai) software1 95.45 21. ÚFAL – UDPipe 1.2 (Praha) software1 95.43 22. LyS-FASTPARSE (A Coruña) software5 94.02 23. Wanghao-ftd-SJTU (Shanghai) software2 93.60 24. RACAI (București) software1 93.55 25. TRL (Tokyo) software1 85.15 26. OpenU NLP Lab (Ra'anana) software6 49.83 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
sk
1. LyS-FASTPARSE (A Coruña) software5 88.87 2. TurkuNLP (Turku) software1 86.51 3. HIT-SCIR (Harbin) software4 86.34 4. darc (Tübingen) software1 86.22 5. RACAI (București) software1 86.18 6. ÚFAL – UDPipe 1.2 (Praha) software1 86.17 7. Wenba-NLU (Wuhan) software1 86.01 ParisNLP (Paris) software1 86.01 IIT Kharagpur (Kharagpur) software3 86.01 CLCL (Genève) software1 86.01 NAIST SATO (Nara) software1 86.01 UParse (Edinburgh) software1 86.01 LIMSI-LIPN (Paris) software2 86.01 MQuni (Sydney) software2 86.01 LATTICE (Paris) software7 86.01 naistCL (Nara) software1 86.01 UALING (Tucson) software1 86.01 Koç University (İstanbul) software3 86.01 BASELINE UDPipe 1.1 (Praha) software2 86.01 Stanford (Stanford) software1 86.01 C2L2 (Ithaca) software5 86.01 MetaRomance (Santiago de Compostela) software1 86.01 IMS (Stuttgart) software2 86.01 Mengest (Shanghai) software1 86.01 25. Wanghao-ftd-SJTU (Shanghai) software2 84.71 26. TRL (Tokyo) software1 48.32 27. OpenU NLP Lab (Ra'anana) software6 44.21 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
sl
1. ÚFAL – UDPipe 1.2 (Praha) software1 95.27 2. darc (Tübingen) software1 95.06 HIT-SCIR (Harbin) software4 95.06 4. TurkuNLP (Turku) software1 95.04 5. ParisNLP (Paris) software1 94.99 MetaRomance (Santiago de Compostela) software1 94.99 7. Wenba-NLU (Wuhan) software1 94.98 IIT Kharagpur (Kharagpur) software3 94.98 CLCL (Genève) software1 94.98 NAIST SATO (Nara) software1 94.98 UParse (Edinburgh) software1 94.98 LIMSI-LIPN (Paris) software2 94.98 MQuni (Sydney) software2 94.98 LATTICE (Paris) software7 94.98 naistCL (Nara) software1 94.98 UALING (Tucson) software1 94.98 Koç University (İstanbul) software3 94.98 BASELINE UDPipe 1.1 (Praha) software2 94.98 Stanford (Stanford) software1 94.98 C2L2 (Ithaca) software5 94.98 IMS (Stuttgart) software2 94.98 Mengest (Shanghai) software1 94.98 23. Wanghao-ftd-SJTU (Shanghai) software2 94.12 24. RACAI (București) software1 93.95 25. LyS-FASTPARSE (A Coruña) software5 92.76 26. OpenU NLP Lab (Ra'anana) software6 48.16 27. TRL (Tokyo) software1 46.58 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
sl_sst
1. TurkuNLP (Turku) software1 91.63 2. darc (Tübingen) software1 91.56 3. IIT Kharagpur (Kharagpur) software3 91.25 CLCL (Genève) software1 91.25 NAIST SATO (Nara) software1 91.25 UParse (Edinburgh) software1 91.25 LIMSI-LIPN (Paris) software2 91.25 MQuni (Sydney) software2 91.25 LATTICE (Paris) software7 91.25 naistCL (Nara) software1 91.25 UALING (Tucson) software1 91.25 Koç University (İstanbul) software3 91.25 BASELINE UDPipe 1.1 (Praha) software2 91.25 Stanford (Stanford) software1 91.25 C2L2 (Ithaca) software5 91.25 Mengest (Shanghai) software1 91.25 17. HIT-SCIR (Harbin) software4 91.00 18. LyS-FASTPARSE (A Coruña) software5 90.88 19. Wanghao-ftd-SJTU (Shanghai) software2 90.79 20. RACAI (București) software1 90.64 21. ParisNLP (Paris) software1 90.51 MetaRomance (Santiago de Compostela) software1 90.51 23. OpenU NLP Lab (Ra'anana) software6 58.27 24. TRL (Tokyo) software1 48.01 25. fbaml (Palo Alto) software1 1.23 26. ECNU (Shanghai) software1 1.20 Uppsala (Uppsala) software1 1.20 Orange – Deskiñ (Lannion) software1 1.20 METU (Ankara) software2 1.20 IMS (Stuttgart) software2 1.20 31. ÚFAL – UDPipe 1.2 (Praha) software1 1.19 32. Wenba-NLU (Wuhan) software1 0.00 33. UT (Tartu) software1 0.00
sme
1. Wanghao-ftd-SJTU (Shanghai) software2 81.86 ParisNLP (Paris) software1 81.86 darc (Tübingen) software1 81.86 IIT Kharagpur (Kharagpur) software3 81.86 NAIST SATO (Nara) software1 81.86 UParse (Edinburgh) software1 81.86 LIMSI-LIPN (Paris) software2 81.86 MQuni (Sydney) software2 81.86 TurkuNLP (Turku) software1 81.86 LATTICE (Paris) software7 81.86 naistCL (Nara) software1 81.86 UALING (Tucson) software1 81.86 Koç University (İstanbul) software3 81.86 BASELINE UDPipe 1.1 (Praha) software2 81.86 ÚFAL – UDPipe 1.2 (Praha) software1 81.86 Stanford (Stanford) software1 81.86 C2L2 (Ithaca) software5 81.86 MetaRomance (Santiago de Compostela) software1 81.86 HIT-SCIR (Harbin) software4 81.86 IMS (Stuttgart) software2 81.86 Mengest (Shanghai) software1 81.86 CLCL (Genève) software2 81.86 RACAI (București) software1 81.86 24. LyS-FASTPARSE (A Coruña) software5 79.64 25. OpenU NLP Lab (Ra'anana) software6 47.25 26. TRL (Tokyo) software1 39.80 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
sv
1. ÚFAL – UDPipe 1.2 (Praha) software1 95.48 2. darc (Tübingen) software1 95.43 HIT-SCIR (Harbin) software4 95.43 4. Wenba-NLU (Wuhan) software1 95.24 ParisNLP (Paris) software1 95.24 IIT Kharagpur (Kharagpur) software3 95.24 CLCL (Genève) software1 95.24 NAIST SATO (Nara) software1 95.24 UParse (Edinburgh) software1 95.24 LIMSI-LIPN (Paris) software2 95.24 MQuni (Sydney) software2 95.24 LATTICE (Paris) software7 95.24 naistCL (Nara) software1 95.24 UALING (Tucson) software1 95.24 Koç University (İstanbul) software3 95.24 Stanford (Stanford) software1 95.24 C2L2 (Ithaca) software5 95.24 MetaRomance (Santiago de Compostela) software1 95.24 IMS (Stuttgart) software2 95.24 Mengest (Shanghai) software1 95.24 21. BASELINE UDPipe 1.1 (Praha) software2 95.23 22. TurkuNLP (Turku) software1 95.20 23. Wanghao-ftd-SJTU (Shanghai) software2 94.41 24. LyS-FASTPARSE (A Coruña) software5 93.37 25. RACAI (București) software1 91.62 26. TRL (Tokyo) software1 86.44 27. OpenU NLP Lab (Ra'anana) software6 59.63 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
sv_lines
1. Wanghao-ftd-SJTU (Shanghai) software2 99.98 Wenba-NLU (Wuhan) software1 99.98 ECNU (Shanghai) software1 99.98 IIT Kharagpur (Kharagpur) software3 99.98 CLCL (Genève) software1 99.98 NAIST SATO (Nara) software1 99.98 Orange – Deskiñ (Lannion) software1 99.98 UParse (Edinburgh) software1 99.98 LIMSI-LIPN (Paris) software2 99.98 MQuni (Sydney) software2 99.98 LyS-FASTPARSE (A Coruña) software5 99.98 TurkuNLP (Turku) software1 99.98 LATTICE (Paris) software7 99.98 naistCL (Nara) software1 99.98 UALING (Tucson) software1 99.98 Koç University (İstanbul) software3 99.98 BASELINE UDPipe 1.1 (Praha) software2 99.98 Stanford (Stanford) software1 99.98 METU (Ankara) software2 99.98 C2L2 (Ithaca) software5 99.98 fbaml (Palo Alto) software1 99.98 IMS (Stuttgart) software2 99.98 Mengest (Shanghai) software1 99.98 24. ÚFAL – UDPipe 1.2 (Praha) software1 99.97 25. darc (Tübingen) software1 99.96 HIT-SCIR (Harbin) software4 99.96 27. Uppsala (Uppsala) software1 99.86 28. RACAI (București) software1 83.82 29. ParisNLP (Paris) software1 0.00 TRL (Tokyo) software1 0.00 MetaRomance (Santiago de Compostela) software1 0.00 UT (Tartu) software1 0.00 OpenU NLP Lab (Ra'anana) software6 0.00
sv_pud
1. ÚFAL – UDPipe 1.2 (Praha) software1 84.55 2. TRL (Tokyo) software1 84.20 3. HIT-SCIR (Harbin) software4 83.95 4. TurkuNLP (Turku) software1 83.72 5. ParisNLP (Paris) software1 83.66 darc (Tübingen) software1 83.66 IIT Kharagpur (Kharagpur) software3 83.66 CLCL (Genève) software1 83.66 NAIST SATO (Nara) software1 83.66 UParse (Edinburgh) software1 83.66 LIMSI-LIPN (Paris) software2 83.66 MQuni (Sydney) software2 83.66 LATTICE (Paris) software7 83.66 naistCL (Nara) software1 83.66 UALING (Tucson) software1 83.66 Koç University (İstanbul) software3 83.66 BASELINE UDPipe 1.1 (Praha) software2 83.66 Stanford (Stanford) software1 83.66 C2L2 (Ithaca) software5 83.66 MetaRomance (Santiago de Compostela) software1 83.66 IMS (Stuttgart) software2 83.66 Mengest (Shanghai) software1 83.66 23. Wanghao-ftd-SJTU (Shanghai) software2 83.33 24. RACAI (București) software1 81.73 25. LyS-FASTPARSE (A Coruña) software5 78.14 26. OpenU NLP Lab (Ra'anana) software6 63.92 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
tr
1. ÚFAL – UDPipe 1.2 (Praha) software1 89.60 2. darc (Tübingen) software1 89.52 3. HIT-SCIR (Harbin) software4 89.51 4. TurkuNLP (Turku) software1 89.26 5. BASELINE UDPipe 1.1 (Praha) software2 88.97 6. Wenba-NLU (Wuhan) software1 88.96 IIT Kharagpur (Kharagpur) software3 88.96 CLCL (Genève) software1 88.96 NAIST SATO (Nara) software1 88.96 UParse (Edinburgh) software1 88.96 LIMSI-LIPN (Paris) software2 88.96 MQuni (Sydney) software2 88.96 LATTICE (Paris) software7 88.96 naistCL (Nara) software1 88.96 UALING (Tucson) software1 88.96 Koç University (İstanbul) software3 88.96 Stanford (Stanford) software1 88.96 C2L2 (Ithaca) software5 88.96 IMS (Stuttgart) software2 88.96 Mengest (Shanghai) software1 88.96 21. ParisNLP (Paris) software1 88.95 22. Wanghao-ftd-SJTU (Shanghai) software2 87.84 23. LyS-FASTPARSE (A Coruña) software5 86.33 24. RACAI (București) software1 84.83 25. TRL (Tokyo) software1 78.05 26. OpenU NLP Lab (Ra'anana) software6 48.40 27. Orange – Deskiñ (Lannion) software1 0.07 METU (Ankara) software2 0.07 29. fbaml (Palo Alto) software1 0.06 30. Uppsala (Uppsala) software1 0.03 31. ECNU (Shanghai) software1 0.00 32. MetaRomance (Santiago de Compostela) software1 0.00 33. UT (Tartu) software1 0.00
tr_pud
1. Uppsala (Uppsala) software1 96.82 2. Orange – Deskiñ (Lannion) software1 96.62 METU (Ankara) software2 96.62 4. fbaml (Palo Alto) software1 94.94 5. ÚFAL – UDPipe 1.2 (Praha) software1 0.09 6. Wanghao-ftd-SJTU (Shanghai) software2 0.08 7. TurkuNLP (Turku) software1 0.05 8. darc (Tübingen) software1 0.04 IIT Kharagpur (Kharagpur) software3 0.04 CLCL (Genève) software1 0.04 NAIST SATO (Nara) software1 0.04 UParse (Edinburgh) software1 0.04 LIMSI-LIPN (Paris) software2 0.04 MQuni (Sydney) software2 0.04 LyS-FASTPARSE (A Coruña) software5 0.04 LATTICE (Paris) software7 0.04 naistCL (Nara) software1 0.04 UALING (Tucson) software1 0.04 Koç University (İstanbul) software3 0.04 BASELINE UDPipe 1.1 (Praha) software2 0.04 Stanford (Stanford) software1 0.04 C2L2 (Ithaca) software5 0.04 HIT-SCIR (Harbin) software4 0.04 IMS (Stuttgart) software2 0.04 Mengest (Shanghai) software1 0.04 26. Wenba-NLU (Wuhan) software1 0.00 27. ECNU (Shanghai) software1 0.00 28. ParisNLP (Paris) software1 0.00 TRL (Tokyo) software1 0.00 MetaRomance (Santiago de Compostela) software1 0.00 UT (Tartu) software1 0.00 RACAI (București) software1 0.00 OpenU NLP Lab (Ra'anana) software6 0.00
ug
1. ÚFAL – UDPipe 1.2 (Praha) software1 99.94 2. Wanghao-ftd-SJTU (Shanghai) software2 99.79 3. darc (Tübingen) software1 99.67 4. HIT-SCIR (Harbin) software4 99.33 5. ECNU (Shanghai) software1 98.52 IIT Kharagpur (Kharagpur) software3 98.52 CLCL (Genève) software1 98.52 NAIST SATO (Nara) software1 98.52 Orange – Deskiñ (Lannion) software1 98.52 UParse (Edinburgh) software1 98.52 LIMSI-LIPN (Paris) software2 98.52 MQuni (Sydney) software2 98.52 LyS-FASTPARSE (A Coruña) software5 98.52 TurkuNLP (Turku) software1 98.52 LATTICE (Paris) software7 98.52 naistCL (Nara) software1 98.52 UALING (Tucson) software1 98.52 Koç University (İstanbul) software3 98.52 BASELINE UDPipe 1.1 (Praha) software2 98.52 Stanford (Stanford) software1 98.52 METU (Ankara) software2 98.52 C2L2 (Ithaca) software5 98.52 IMS (Stuttgart) software2 98.52 24. Uppsala (Uppsala) software1 97.82 25. fbaml (Palo Alto) software1 96.94 26. RACAI (București) software1 36.73 27. ParisNLP (Paris) software1 0.83 MetaRomance (Santiago de Compostela) software1 0.83 OpenU NLP Lab (Ra'anana) software6 0.83 30. TRL (Tokyo) software1 0.82 31. Wenba-NLU (Wuhan) software1 0.00 32. UT (Tartu) software1 0.00 33. Mengest (Shanghai) software1 0.00
uk
1. TurkuNLP (Turku) software1 87.73 2. darc (Tübingen) software1 86.83 3. HIT-SCIR (Harbin) software4 86.76 4. ÚFAL – UDPipe 1.2 (Praha) software1 86.64 5. ParisNLP (Paris) software1 86.45 MetaRomance (Santiago de Compostela) software1 86.45 7. IIT Kharagpur (Kharagpur) software3 86.44 CLCL (Genève) software1 86.44 NAIST SATO (Nara) software1 86.44 UParse (Edinburgh) software1 86.44 LIMSI-LIPN (Paris) software2 86.44 MQuni (Sydney) software2 86.44 LATTICE (Paris) software7 86.44 naistCL (Nara) software1 86.44 UALING (Tucson) software1 86.44 Koç University (İstanbul) software3 86.44 BASELINE UDPipe 1.1 (Praha) software2 86.44 Stanford (Stanford) software1 86.44 C2L2 (Ithaca) software5 86.44 IMS (Stuttgart) software2 86.44 Mengest (Shanghai) software1 86.44 22. LyS-FASTPARSE (A Coruña) software5 86.38 23. Wanghao-ftd-SJTU (Shanghai) software2 85.69 24. RACAI (București) software1 85.16 25. OpenU NLP Lab (Ra'anana) software6 54.59 26. TRL (Tokyo) software1 54.02 27. Wenba-NLU (Wuhan) software1 0.00 28. ECNU (Shanghai) software1 0.00 29. Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
ur
1. ÚFAL – UDPipe 1.2 (Praha) software1 93.04 2. TurkuNLP (Turku) software1 92.72 3. HIT-SCIR (Harbin) software4 92.68 4. darc (Tübingen) software1 92.64 5. Wenba-NLU (Wuhan) software1 92.52 ParisNLP (Paris) software1 92.52 IIT Kharagpur (Kharagpur) software3 92.52 CLCL (Genève) software1 92.52 NAIST SATO (Nara) software1 92.52 UParse (Edinburgh) software1 92.52 LIMSI-LIPN (Paris) software2 92.52 MQuni (Sydney) software2 92.52 LATTICE (Paris) software7 92.52 naistCL (Nara) software1 92.52 UALING (Tucson) software1 92.52 Koç University (İstanbul) software3 92.52 BASELINE UDPipe 1.1 (Praha) software2 92.52 Stanford (Stanford) software1 92.52 C2L2 (Ithaca) software5 92.52 MetaRomance (Santiago de Compostela) software1 92.52 IMS (Stuttgart) software2 92.52 Mengest (Shanghai) software1 92.52 23. Wanghao-ftd-SJTU (Shanghai) software2 91.90 24. LyS-FASTPARSE (A Coruña) software5 91.27 25. OpenU NLP Lab (Ra'anana) software6 75.65 26. TRL (Tokyo) software1 74.71 27. RACAI (București) software1 69.78 28. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00
vi
1. LIMSI-LIPN (Paris) software2 86.33 2. TRL (Tokyo) software1 84.67 3. HIT-SCIR (Harbin) software4 83.82 4. ÚFAL – UDPipe 1.2 (Praha) software1 83.54 5. OpenU NLP Lab (Ra'anana) software6 82.47 6. darc (Tübingen) software1 82.04 7. Wanghao-ftd-SJTU (Shanghai) software2 81.94 8. Wenba-NLU (Wuhan) software1 81.81 IIT Kharagpur (Kharagpur) software3 81.81 CLCL (Genève) software1 81.81 NAIST SATO (Nara) software1 81.81 UParse (Edinburgh) software1 81.81 MQuni (Sydney) software2 81.81 LATTICE (Paris) software7 81.81 naistCL (Nara) software1 81.81 UALING (Tucson) software1 81.81 Koç University (İstanbul) software3 81.81 BASELINE UDPipe 1.1 (Praha) software2 81.81 Stanford (Stanford) software1 81.81 C2L2 (Ithaca) software5 81.81 MetaRomance (Santiago de Compostela) software1 81.81 Mengest (Shanghai) software1 81.81 23. TurkuNLP (Turku) software1 81.80 24. ParisNLP (Paris) software1 80.45 25. RACAI (București) software1 78.18 26. LyS-FASTPARSE (A Coruña) software5 76.05 27. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00 IMS (Stuttgart) software2 0.00
zh
1. LIMSI-LIPN (Paris) software2 91.35 2. HIT-SCIR (Harbin) software4 91.18 3. ÚFAL – UDPipe 1.2 (Praha) software1 89.54 4. darc (Tübingen) software1 88.98 5. Wenba-NLU (Wuhan) software1 88.91 ParisNLP (Paris) software1 88.91 IIT Kharagpur (Kharagpur) software3 88.91 CLCL (Genève) software1 88.91 NAIST SATO (Nara) software1 88.91 UParse (Edinburgh) software1 88.91 MQuni (Sydney) software2 88.91 TurkuNLP (Turku) software1 88.91 LATTICE (Paris) software7 88.91 naistCL (Nara) software1 88.91 UALING (Tucson) software1 88.91 Koç University (İstanbul) software3 88.91 BASELINE UDPipe 1.1 (Praha) software2 88.91 Stanford (Stanford) software1 88.91 C2L2 (Ithaca) software5 88.91 MetaRomance (Santiago de Compostela) software1 88.91 Mengest (Shanghai) software1 88.91 22. OpenU NLP Lab (Ra'anana) software6 88.71 23. Wanghao-ftd-SJTU (Shanghai) software2 88.70 24. RACAI (București) software1 88.38 25. LyS-FASTPARSE (A Coruña) software5 85.00 26. TRL (Tokyo) software1 50.84 27. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 Orange – Deskiñ (Lannion) software1 0.00 METU (Ankara) software2 0.00 fbaml (Palo Alto) software1 0.00 UT (Tartu) software1 0.00 IMS (Stuttgart) software2 0.00