Results: UPOS tags F1
All treebanks
1. Stanford (Stanford) software1 93.09 2. IMS (Stuttgart) software2 91.98 3. ParisNLP (Paris) software1 91.91 4. ÚFAL – UDPipe 1.2 (Praha) software1 91.22 5. HIT-SCIR (Harbin) software4 91.13 6. TurkuNLP (Turku) software1 91.10 7. LIMSI-LIPN (Paris) software2 91.05 8. darc (Tübingen) software1 91.00 9. IIT Kharagpur (Kharagpur) software3 90.88 10. NAIST SATO (Nara) software1 90.88 UParse (Edinburgh) software1 90.88 LATTICE (Paris) software7 90.88 UALING (Tucson) software1 90.88 Koç University (İstanbul) software3 90.88 C2L2 (Ithaca) software5 90.88 16. Orange – Deskiñ (Lannion) software1 90.88 naistCL (Nara) software1 90.88 18. LyS-FASTPARSE (A Coruña) software5 90.88 19. CLCL (Genève) software2 90.88 20. BASELINE UDPipe 1.1 (Praha) software2 90.88 21. RACAI (București) software1 90.71 22. Wanghao-ftd-SJTU (Shanghai) software2 90.63 23. Mengest (Shanghai) software1 89.36 24. fbaml (Palo Alto) software1 89.30 25. MQuni (Sydney) software2 88.84 26. OpenU NLP Lab (Ra'anana) software6 85.84 27. TRL (Tokyo) software1 80.36 28. Wenba-NLU (Wuhan) software1 52.66 29. MetaRomance (Santiago de Compostela) software1 43.91 30. UT (Tartu) software1 30.14 31. METU (Ankara) software2 6.54 32. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00
Big treebanks only
Macro-average UPOS-F1 of the 55 big treebanks: ar, bg, ca, cs, cs_cac, cs_cltt, cu, da, de, el, en, en_lines, en_partut, es, es_ancora, et, eu, fa, fi, fi_ftb, fr, fr_sequoia, gl, got, grc, grc_proiel, he, hi, hr, hu, id, it, ja, ko, la_ittb, la_proiel, lv, nl, nl_lassysmall, no_bokmaal, no_nynorsk, pl, pt, pt_br, ro, ru, ru_syntagrus, sk, sl, sv, sv_lines, tr, ur, vi, zh. These are the treebanks that have development data available, hence these results should be comparable to the performance of the systems on the development data.
1. Stanford (Stanford) software1 95.58 2. IMS (Stuttgart) software2 94.45 3. ParisNLP (Paris) software1 94.28 4. MQuni (Sydney) software2 93.72 5. HIT-SCIR (Harbin) software4 93.69 6. ÚFAL – UDPipe 1.2 (Praha) software1 93.65 7. LIMSI-LIPN (Paris) software2 93.55 8. TurkuNLP (Turku) software1 93.51 9. darc (Tübingen) software1 93.50 10. Orange – Deskiñ (Lannion) software1 93.37 LyS-FASTPARSE (A Coruña) software5 93.37 UALING (Tucson) software1 93.37 13. naistCL (Nara) software1 93.37 Koç University (İstanbul) software3 93.37 BASELINE UDPipe 1.1 (Praha) software2 93.37 C2L2 (Ithaca) software5 93.37 Mengest (Shanghai) software1 93.37 CLCL (Genève) software2 93.37 19. IIT Kharagpur (Kharagpur) software3 93.37 20. UParse (Edinburgh) software1 93.37 21. NAIST SATO (Nara) software1 93.37 LATTICE (Paris) software7 93.37 23. RACAI (București) software1 93.18 24. Wanghao-ftd-SJTU (Shanghai) software2 93.13 25. fbaml (Palo Alto) software1 92.97 26. OpenU NLP Lab (Ra'anana) software6 88.44 27. TRL (Tokyo) software1 83.74 28. Wenba-NLU (Wuhan) software1 77.55 29. MetaRomance (Santiago de Compostela) software1 45.12 30. UT (Tartu) software1 36.73 31. METU (Ankara) software2 9.50 32. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00
PUD treebanks only
Macro-average UPOS-F1 of the 14 PUD treebanks (additional parallel test sets): ar_pud, cs_pud, de_pud, en_pud, es_pud, fi_pud, fr_pud, hi_pud, it_pud, ja_pud, pt_pud, ru_pud, sv_pud, tr_pud. These are languages for which there exists at least one big training treebank. However, these test sets have been produced separately and their domain may differ.
1. Stanford (Stanford) software1 88.25 2. IMS (Stuttgart) software2 87.69 3. ParisNLP (Paris) software1 87.61 4. LIMSI-LIPN (Paris) software2 87.33 5. ÚFAL – UDPipe 1.2 (Praha) software1 87.30 6. UParse (Edinburgh) software1 87.06 7. IIT Kharagpur (Kharagpur) software3 87.06 NAIST SATO (Nara) software1 87.06 C2L2 (Ithaca) software5 87.06 10. darc (Tübingen) software1 87.06 CLCL (Genève) software1 87.06 Orange – Deskiñ (Lannion) software1 87.06 LyS-FASTPARSE (A Coruña) software5 87.06 LATTICE (Paris) software7 87.06 naistCL (Nara) software1 87.06 UALING (Tucson) software1 87.06 Koç University (İstanbul) software3 87.06 Mengest (Shanghai) software1 87.06 19. BASELINE UDPipe 1.1 (Praha) software2 87.06 20. TurkuNLP (Turku) software1 87.01 21. MQuni (Sydney) software2 86.98 22. fbaml (Palo Alto) software1 86.79 23. HIT-SCIR (Harbin) software4 86.22 24. RACAI (București) software1 86.12 25. Wanghao-ftd-SJTU (Shanghai) software2 85.56 26. OpenU NLP Lab (Ra'anana) software6 81.21 27. TRL (Tokyo) software1 80.49 28. MetaRomance (Santiago de Compostela) software1 42.27 29. UT (Tartu) software1 24.06 30. METU (Ankara) software2 0.20 31. Wenba-NLU (Wuhan) software1 0.00 ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00
Small treebanks only
Macro-average UPOS-F1 of the 8 small treebanks: fr_partut, ga, gl_treegal, kk, la, sl_sst, ug, uk. These treebanks lack development data and some of them have very little training data (especially Uyghur and Kazakh).
1. Stanford (Stanford) software1 87.02 2. ParisNLP (Paris) software1 85.17 3. fbaml (Palo Alto) software1 84.99 4. IMS (Stuttgart) software2 84.58 5. HIT-SCIR (Harbin) software4 83.78 6. Wanghao-ftd-SJTU (Shanghai) software2 83.67 7. TurkuNLP (Turku) software1 83.31 8. RACAI (București) software1 83.20 9. ÚFAL – UDPipe 1.2 (Praha) software1 83.11 10. darc (Tübingen) software1 82.28 11. IIT Kharagpur (Kharagpur) software3 81.99 NAIST SATO (Nara) software1 81.99 Orange – Deskiñ (Lannion) software1 81.99 UParse (Edinburgh) software1 81.99 LIMSI-LIPN (Paris) software2 81.99 LyS-FASTPARSE (A Coruña) software5 81.99 naistCL (Nara) software1 81.99 Koç University (İstanbul) software3 81.99 C2L2 (Ithaca) software5 81.99 CLCL (Genève) software2 81.99 21. LATTICE (Paris) software7 81.99 UALING (Tucson) software1 81.99 23. BASELINE UDPipe 1.1 (Praha) software2 81.99 24. MQuni (Sydney) software2 81.48 25. OpenU NLP Lab (Ra'anana) software6 75.16 26. TRL (Tokyo) software1 73.46 27. Mengest (Shanghai) software1 66.53 28. MetaRomance (Santiago de Compostela) software1 43.36 29. UT (Tartu) software1 10.49 30. METU (Ankara) software2 0.55 31. Wenba-NLU (Wuhan) software1 0.00 ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00
Surprise languages only
Macro-average UPOS-F1 of the 4 surprise language treebanks: bxr, hsb, kmr, sme.
1. Wanghao-ftd-SJTU (Shanghai) software2 87.82 ParisNLP (Paris) software1 87.82 darc (Tübingen) software1 87.82 IIT Kharagpur (Kharagpur) software3 87.82 NAIST SATO (Nara) software1 87.82 Orange – Deskiñ (Lannion) software1 87.82 UParse (Edinburgh) software1 87.82 LIMSI-LIPN (Paris) software2 87.82 LyS-FASTPARSE (A Coruña) software5 87.82 TurkuNLP (Turku) software1 87.82 LATTICE (Paris) software7 87.82 naistCL (Nara) software1 87.82 UALING (Tucson) software1 87.82 Koç University (İstanbul) software3 87.82 BASELINE UDPipe 1.1 (Praha) software2 87.82 ÚFAL – UDPipe 1.2 (Praha) software1 87.82 Stanford (Stanford) software1 87.82 C2L2 (Ithaca) software5 87.82 HIT-SCIR (Harbin) software4 87.82 RACAI (București) software1 87.82 Mengest (Shanghai) software1 87.82 OpenU NLP Lab (Ra'anana) software6 87.82 CLCL (Genève) software2 87.82 IMS (Stuttgart) software2 87.82 25. fbaml (Palo Alto) software1 56.25 26. TRL (Tokyo) software1 47.15 27. MQuni (Sydney) software2 42.94 28. MetaRomance (Santiago de Compostela) software1 34.06 29. METU (Ankara) software2 0.11 30. Wenba-NLU (Wuhan) software1 0.00 ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
Per treebank UPOS-F1
ar
1. IMS (Stuttgart) software2 90.62 2. RACAI (București) software1 90.01 3. Stanford (Stanford) software1 89.36 4. MQuni (Sydney) software2 88.75 5. HIT-SCIR (Harbin) software4 88.72 6. darc (Tübingen) software1 88.27 7. ÚFAL – UDPipe 1.2 (Praha) software1 88.26 8. Wenba-NLU (Wuhan) software1 88.13 ParisNLP (Paris) software1 88.13 IIT Kharagpur (Kharagpur) software3 88.13 CLCL (Genève) software1 88.13 NAIST SATO (Nara) software1 88.13 Orange – Deskiñ (Lannion) software1 88.13 UParse (Edinburgh) software1 88.13 LIMSI-LIPN (Paris) software2 88.13 LyS-FASTPARSE (A Coruña) software5 88.13 LATTICE (Paris) software7 88.13 naistCL (Nara) software1 88.13 UALING (Tucson) software1 88.13 Koç University (İstanbul) software3 88.13 BASELINE UDPipe 1.1 (Praha) software2 88.13 C2L2 (Ithaca) software5 88.13 Mengest (Shanghai) software1 88.13 24. TurkuNLP (Turku) software1 88.12 25. Wanghao-ftd-SJTU (Shanghai) software2 86.79 26. fbaml (Palo Alto) software1 86.59 27. OpenU NLP Lab (Ra'anana) software6 82.73 28. TRL (Tokyo) software1 80.05 29. MetaRomance (Santiago de Compostela) software1 54.97 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
ar_pud
1. IMS (Stuttgart) software2 73.89 2. RACAI (București) software1 73.54 3. TRL (Tokyo) software1 73.06 4. MQuni (Sydney) software2 71.20 5. Stanford (Stanford) software1 71.17 6. HIT-SCIR (Harbin) software4 70.53 7. ÚFAL – UDPipe 1.2 (Praha) software1 70.39 8. ParisNLP (Paris) software1 70.27 darc (Tübingen) software1 70.27 IIT Kharagpur (Kharagpur) software3 70.27 CLCL (Genève) software1 70.27 NAIST SATO (Nara) software1 70.27 Orange – Deskiñ (Lannion) software1 70.27 UParse (Edinburgh) software1 70.27 LIMSI-LIPN (Paris) software2 70.27 LyS-FASTPARSE (A Coruña) software5 70.27 LATTICE (Paris) software7 70.27 naistCL (Nara) software1 70.27 UALING (Tucson) software1 70.27 Koç University (İstanbul) software3 70.27 BASELINE UDPipe 1.1 (Praha) software2 70.27 C2L2 (Ithaca) software5 70.27 Mengest (Shanghai) software1 70.27 24. TurkuNLP (Turku) software1 70.15 25. fbaml (Palo Alto) software1 69.85 26. Wanghao-ftd-SJTU (Shanghai) software2 65.81 27. OpenU NLP Lab (Ra'anana) software6 65.49 28. MetaRomance (Santiago de Compostela) software1 38.06 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
bg
1. Stanford (Stanford) software1 98.75 2. IMS (Stuttgart) software2 97.95 3. UT (Tartu) software1 97.80 4. ÚFAL – UDPipe 1.2 (Praha) software1 97.72 5. TurkuNLP (Turku) software1 97.70 6. fbaml (Palo Alto) software1 97.67 7. Wenba-NLU (Wuhan) software1 97.58 IIT Kharagpur (Kharagpur) software3 97.58 CLCL (Genève) software1 97.58 NAIST SATO (Nara) software1 97.58 Orange – Deskiñ (Lannion) software1 97.58 UParse (Edinburgh) software1 97.58 LIMSI-LIPN (Paris) software2 97.58 LyS-FASTPARSE (A Coruña) software5 97.58 LATTICE (Paris) software7 97.58 naistCL (Nara) software1 97.58 UALING (Tucson) software1 97.58 Koç University (İstanbul) software3 97.58 BASELINE UDPipe 1.1 (Praha) software2 97.58 C2L2 (Ithaca) software5 97.58 Mengest (Shanghai) software1 97.58 22. darc (Tübingen) software1 97.57 23. Wanghao-ftd-SJTU (Shanghai) software2 97.56 24. HIT-SCIR (Harbin) software4 97.43 25. ParisNLP (Paris) software1 97.29 26. MQuni (Sydney) software2 97.28 27. RACAI (București) software1 97.20 28. OpenU NLP Lab (Ra'anana) software6 94.47 29. TRL (Tokyo) software1 88.27 30. MetaRomance (Santiago de Compostela) software1 46.27 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
bxr
1. Wanghao-ftd-SJTU (Shanghai) software2 84.12 ParisNLP (Paris) software1 84.12 darc (Tübingen) software1 84.12 IIT Kharagpur (Kharagpur) software3 84.12 NAIST SATO (Nara) software1 84.12 Orange – Deskiñ (Lannion) software1 84.12 UParse (Edinburgh) software1 84.12 LIMSI-LIPN (Paris) software2 84.12 LyS-FASTPARSE (A Coruña) software5 84.12 TurkuNLP (Turku) software1 84.12 LATTICE (Paris) software7 84.12 naistCL (Nara) software1 84.12 UALING (Tucson) software1 84.12 Koç University (İstanbul) software3 84.12 BASELINE UDPipe 1.1 (Praha) software2 84.12 ÚFAL – UDPipe 1.2 (Praha) software1 84.12 Stanford (Stanford) software1 84.12 C2L2 (Ithaca) software5 84.12 HIT-SCIR (Harbin) software4 84.12 RACAI (București) software1 84.12 Mengest (Shanghai) software1 84.12 OpenU NLP Lab (Ra'anana) software6 84.12 CLCL (Genève) software2 84.12 IMS (Stuttgart) software2 84.12 25. fbaml (Palo Alto) software1 49.11 26. TRL (Tokyo) software1 47.69 27. MQuni (Sydney) software2 42.89 28. Wenba-NLU (Wuhan) software1 0.00 29. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 MetaRomance (Santiago de Compostela) software1 0.00 UT (Tartu) software1 0.00
ca
1. Stanford (Stanford) software1 98.59 2. MQuni (Sydney) software2 98.06 3. Wenba-NLU (Wuhan) software1 98.04 ParisNLP (Paris) software1 98.04 IIT Kharagpur (Kharagpur) software3 98.04 NAIST SATO (Nara) software1 98.04 Orange – Deskiñ (Lannion) software1 98.04 UParse (Edinburgh) software1 98.04 LIMSI-LIPN (Paris) software2 98.04 LyS-FASTPARSE (A Coruña) software5 98.04 LATTICE (Paris) software7 98.04 naistCL (Nara) software1 98.04 UALING (Tucson) software1 98.04 Koç University (İstanbul) software3 98.04 BASELINE UDPipe 1.1 (Praha) software2 98.04 METU (Ankara) software2 98.04 C2L2 (Ithaca) software5 98.04 Mengest (Shanghai) software1 98.04 CLCL (Genève) software2 98.04 20. TurkuNLP (Turku) software1 98.01 21. ÚFAL – UDPipe 1.2 (Praha) software1 98.00 22. IMS (Stuttgart) software2 97.97 23. Wanghao-ftd-SJTU (Shanghai) software2 97.95 24. darc (Tübingen) software1 97.93 25. fbaml (Palo Alto) software1 97.68 26. RACAI (București) software1 97.60 27. HIT-SCIR (Harbin) software4 96.59 28. OpenU NLP Lab (Ra'anana) software6 93.55 29. TRL (Tokyo) software1 85.90 30. MetaRomance (Santiago de Compostela) software1 34.25 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
cs
1. Stanford (Stanford) software1 98.83 2. fbaml (Palo Alto) software1 98.53 3. IMS (Stuttgart) software2 98.44 4. MQuni (Sydney) software2 98.29 5. ÚFAL – UDPipe 1.2 (Praha) software1 98.23 6. ParisNLP (Paris) software1 98.13 IIT Kharagpur (Kharagpur) software3 98.13 CLCL (Genève) software1 98.13 NAIST SATO (Nara) software1 98.13 Orange – Deskiñ (Lannion) software1 98.13 UParse (Edinburgh) software1 98.13 LIMSI-LIPN (Paris) software2 98.13 LyS-FASTPARSE (A Coruña) software5 98.13 LATTICE (Paris) software7 98.13 naistCL (Nara) software1 98.13 UALING (Tucson) software1 98.13 Koç University (İstanbul) software3 98.13 BASELINE UDPipe 1.1 (Praha) software2 98.13 C2L2 (Ithaca) software5 98.13 Mengest (Shanghai) software1 98.13 OpenU NLP Lab (Ra'anana) software6 98.13 22. RACAI (București) software1 98.07 23. TurkuNLP (Turku) software1 98.03 24. darc (Tübingen) software1 97.92 25. HIT-SCIR (Harbin) software4 97.66 26. Wanghao-ftd-SJTU (Shanghai) software2 96.42 27. TRL (Tokyo) software1 93.29 28. Wenba-NLU (Wuhan) software1 0.00 29. ECNU (Shanghai) software1 0.00 30. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 MetaRomance (Santiago de Compostela) software1 0.00 UT (Tartu) software1 0.00
cs_cac
1. Stanford (Stanford) software1 99.05 2. IMS (Stuttgart) software2 98.76 3. MQuni (Sydney) software2 98.51 4. fbaml (Palo Alto) software1 98.43 5. Wanghao-ftd-SJTU (Shanghai) software2 98.39 6. RACAI (București) software1 98.38 7. ÚFAL – UDPipe 1.2 (Praha) software1 98.34 8. ParisNLP (Paris) software1 98.27 IIT Kharagpur (Kharagpur) software3 98.27 CLCL (Genève) software1 98.27 NAIST SATO (Nara) software1 98.27 Orange – Deskiñ (Lannion) software1 98.27 UParse (Edinburgh) software1 98.27 LIMSI-LIPN (Paris) software2 98.27 LyS-FASTPARSE (A Coruña) software5 98.27 LATTICE (Paris) software7 98.27 naistCL (Nara) software1 98.27 UALING (Tucson) software1 98.27 Koç University (İstanbul) software3 98.27 BASELINE UDPipe 1.1 (Praha) software2 98.27 C2L2 (Ithaca) software5 98.27 Mengest (Shanghai) software1 98.27 OpenU NLP Lab (Ra'anana) software6 98.27 24. TurkuNLP (Turku) software1 98.26 25. darc (Tübingen) software1 98.15 26. HIT-SCIR (Harbin) software4 97.45 27. TRL (Tokyo) software1 92.90 28. MetaRomance (Santiago de Compostela) software1 57.28 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
cs_cltt
1. Stanford (Stanford) software1 97.91 2. ParisNLP (Paris) software1 97.76 3. IMS (Stuttgart) software2 96.79 4. fbaml (Palo Alto) software1 96.65 5. MQuni (Sydney) software2 96.55 6. HIT-SCIR (Harbin) software4 96.49 7. Wanghao-ftd-SJTU (Shanghai) software2 96.22 8. darc (Tübingen) software1 95.85 9. TurkuNLP (Turku) software1 95.83 10. RACAI (București) software1 95.78 11. ÚFAL – UDPipe 1.2 (Praha) software1 95.49 12. Wenba-NLU (Wuhan) software1 95.41 IIT Kharagpur (Kharagpur) software3 95.41 CLCL (Genève) software1 95.41 NAIST SATO (Nara) software1 95.41 Orange – Deskiñ (Lannion) software1 95.41 UParse (Edinburgh) software1 95.41 LIMSI-LIPN (Paris) software2 95.41 LyS-FASTPARSE (A Coruña) software5 95.41 LATTICE (Paris) software7 95.41 naistCL (Nara) software1 95.41 UALING (Tucson) software1 95.41 Koç University (İstanbul) software3 95.41 BASELINE UDPipe 1.1 (Praha) software2 95.41 C2L2 (Ithaca) software5 95.41 Mengest (Shanghai) software1 95.41 OpenU NLP Lab (Ra'anana) software6 95.41 28. TRL (Tokyo) software1 79.91 29. MetaRomance (Santiago de Compostela) software1 62.06 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
cs_pud
1. ÚFAL – UDPipe 1.2 (Praha) software1 96.57 2. ParisNLP (Paris) software1 96.55 darc (Tübingen) software1 96.55 IIT Kharagpur (Kharagpur) software3 96.55 CLCL (Genève) software1 96.55 NAIST SATO (Nara) software1 96.55 Orange – Deskiñ (Lannion) software1 96.55 UParse (Edinburgh) software1 96.55 LIMSI-LIPN (Paris) software2 96.55 LyS-FASTPARSE (A Coruña) software5 96.55 LATTICE (Paris) software7 96.55 naistCL (Nara) software1 96.55 UALING (Tucson) software1 96.55 Koç University (İstanbul) software3 96.55 BASELINE UDPipe 1.1 (Praha) software2 96.55 C2L2 (Ithaca) software5 96.55 Mengest (Shanghai) software1 96.55 OpenU NLP Lab (Ra'anana) software6 96.55 19. TurkuNLP (Turku) software1 96.42 Stanford (Stanford) software1 96.42 21. fbaml (Palo Alto) software1 96.32 22. IMS (Stuttgart) software2 95.76 23. MQuni (Sydney) software2 95.52 24. RACAI (București) software1 95.40 25. Wanghao-ftd-SJTU (Shanghai) software2 94.99 26. HIT-SCIR (Harbin) software4 94.74 27. TRL (Tokyo) software1 92.67 28. MetaRomance (Santiago de Compostela) software1 50.68 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
cu
1. Stanford (Stanford) software1 95.90 2. IMS (Stuttgart) software2 94.94 3. fbaml (Palo Alto) software1 94.80 4. HIT-SCIR (Harbin) software4 94.27 5. RACAI (București) software1 94.06 6. UT (Tartu) software1 93.65 7. Wanghao-ftd-SJTU (Shanghai) software2 93.61 8. darc (Tübingen) software1 93.60 9. ÚFAL – UDPipe 1.2 (Praha) software1 93.55 10. TurkuNLP (Turku) software1 93.36 11. Wenba-NLU (Wuhan) software1 93.34 ParisNLP (Paris) software1 93.34 IIT Kharagpur (Kharagpur) software3 93.34 CLCL (Genève) software1 93.34 NAIST SATO (Nara) software1 93.34 Orange – Deskiñ (Lannion) software1 93.34 UParse (Edinburgh) software1 93.34 LIMSI-LIPN (Paris) software2 93.34 LyS-FASTPARSE (A Coruña) software5 93.34 LATTICE (Paris) software7 93.34 naistCL (Nara) software1 93.34 UALING (Tucson) software1 93.34 Koç University (İstanbul) software3 93.34 BASELINE UDPipe 1.1 (Praha) software2 93.34 C2L2 (Ithaca) software5 93.34 Mengest (Shanghai) software1 93.34 27. MQuni (Sydney) software2 92.63 28. OpenU NLP Lab (Ra'anana) software6 88.53 29. TRL (Tokyo) software1 85.52 30. MetaRomance (Santiago de Compostela) software1 57.56 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
da
1. Stanford (Stanford) software1 97.40 2. ParisNLP (Paris) software1 96.43 3. fbaml (Palo Alto) software1 95.84 4. MQuni (Sydney) software2 95.50 5. Wanghao-ftd-SJTU (Shanghai) software2 95.31 6. ÚFAL – UDPipe 1.2 (Praha) software1 95.28 7. IMS (Stuttgart) software2 95.27 8. UT (Tartu) software1 95.23 9. darc (Tübingen) software1 95.21 10. TurkuNLP (Turku) software1 95.16 11. Wenba-NLU (Wuhan) software1 95.04 IIT Kharagpur (Kharagpur) software3 95.04 CLCL (Genève) software1 95.04 NAIST SATO (Nara) software1 95.04 Orange – Deskiñ (Lannion) software1 95.04 UParse (Edinburgh) software1 95.04 LIMSI-LIPN (Paris) software2 95.04 LyS-FASTPARSE (A Coruña) software5 95.04 LATTICE (Paris) software7 95.04 naistCL (Nara) software1 95.04 UALING (Tucson) software1 95.04 Koç University (İstanbul) software3 95.04 BASELINE UDPipe 1.1 (Praha) software2 95.04 C2L2 (Ithaca) software5 95.04 Mengest (Shanghai) software1 95.04 26. HIT-SCIR (Harbin) software4 95.01 27. RACAI (București) software1 94.62 28. OpenU NLP Lab (Ra'anana) software6 90.02 29. TRL (Tokyo) software1 79.57 30. MetaRomance (Santiago de Compostela) software1 42.44 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
de
1. Stanford (Stanford) software1 94.41 2. HIT-SCIR (Harbin) software4 92.88 3. fbaml (Palo Alto) software1 92.42 4. IMS (Stuttgart) software2 92.24 5. MQuni (Sydney) software2 92.15 6. ParisNLP (Paris) software1 92.04 7. RACAI (București) software1 91.02 8. Wanghao-ftd-SJTU (Shanghai) software2 90.90 9. Wenba-NLU (Wuhan) software1 90.83 IIT Kharagpur (Kharagpur) software3 90.83 CLCL (Genève) software1 90.83 NAIST SATO (Nara) software1 90.83 Orange – Deskiñ (Lannion) software1 90.83 UParse (Edinburgh) software1 90.83 LIMSI-LIPN (Paris) software2 90.83 LyS-FASTPARSE (A Coruña) software5 90.83 LATTICE (Paris) software7 90.83 naistCL (Nara) software1 90.83 UALING (Tucson) software1 90.83 Koç University (İstanbul) software3 90.83 BASELINE UDPipe 1.1 (Praha) software2 90.83 C2L2 (Ithaca) software5 90.83 Mengest (Shanghai) software1 90.83 24. TurkuNLP (Turku) software1 90.82 25. darc (Tübingen) software1 90.76 26. ÚFAL – UDPipe 1.2 (Praha) software1 90.72 27. OpenU NLP Lab (Ra'anana) software6 84.32 28. TRL (Tokyo) software1 79.32 29. MetaRomance (Santiago de Compostela) software1 42.73 30. METU (Ankara) software2 5.22 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
de_pud
1. Stanford (Stanford) software1 85.71 2. ParisNLP (Paris) software1 84.58 3. Wanghao-ftd-SJTU (Shanghai) software2 84.55 4. IMS (Stuttgart) software2 84.53 5. ÚFAL – UDPipe 1.2 (Praha) software1 84.46 6. HIT-SCIR (Harbin) software4 84.39 7. darc (Tübingen) software1 84.38 IIT Kharagpur (Kharagpur) software3 84.38 CLCL (Genève) software1 84.38 NAIST SATO (Nara) software1 84.38 Orange – Deskiñ (Lannion) software1 84.38 UParse (Edinburgh) software1 84.38 LIMSI-LIPN (Paris) software2 84.38 LyS-FASTPARSE (A Coruña) software5 84.38 LATTICE (Paris) software7 84.38 naistCL (Nara) software1 84.38 UALING (Tucson) software1 84.38 Koç University (İstanbul) software3 84.38 BASELINE UDPipe 1.1 (Praha) software2 84.38 C2L2 (Ithaca) software5 84.38 Mengest (Shanghai) software1 84.38 22. TurkuNLP (Turku) software1 84.36 23. MQuni (Sydney) software2 84.25 24. fbaml (Palo Alto) software1 83.82 25. RACAI (București) software1 83.12 26. OpenU NLP Lab (Ra'anana) software6 77.61 27. TRL (Tokyo) software1 77.55 28. MetaRomance (Santiago de Compostela) software1 37.19 29. METU (Ankara) software2 2.74 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
el
1. Stanford (Stanford) software1 97.74 2. IMS (Stuttgart) software2 96.53 3. ParisNLP (Paris) software1 96.26 4. fbaml (Palo Alto) software1 96.24 5. MQuni (Sydney) software2 95.89 6. UT (Tartu) software1 95.86 7. RACAI (București) software1 95.78 8. ÚFAL – UDPipe 1.2 (Praha) software1 95.35 9. darc (Tübingen) software1 95.32 10. TurkuNLP (Turku) software1 95.23 11. Wenba-NLU (Wuhan) software1 95.18 IIT Kharagpur (Kharagpur) software3 95.18 CLCL (Genève) software1 95.18 NAIST SATO (Nara) software1 95.18 Orange – Deskiñ (Lannion) software1 95.18 UParse (Edinburgh) software1 95.18 LIMSI-LIPN (Paris) software2 95.18 LyS-FASTPARSE (A Coruña) software5 95.18 LATTICE (Paris) software7 95.18 naistCL (Nara) software1 95.18 UALING (Tucson) software1 95.18 Koç University (İstanbul) software3 95.18 BASELINE UDPipe 1.1 (Praha) software2 95.18 METU (Ankara) software2 95.18 C2L2 (Ithaca) software5 95.18 Mengest (Shanghai) software1 95.18 27. HIT-SCIR (Harbin) software4 95.08 28. Wanghao-ftd-SJTU (Shanghai) software2 94.69 29. OpenU NLP Lab (Ra'anana) software6 92.44 30. TRL (Tokyo) software1 86.66 31. MetaRomance (Santiago de Compostela) software1 47.34 32. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00
en
1. Stanford (Stanford) software1 95.11 2. fbaml (Palo Alto) software1 94.09 3. ParisNLP (Paris) software1 93.52 4. ÚFAL – UDPipe 1.2 (Praha) software1 93.50 5. MQuni (Sydney) software2 93.48 6. darc (Tübingen) software1 93.47 7. Wanghao-ftd-SJTU (Shanghai) software2 93.41 8. IMS (Stuttgart) software2 93.29 9. HIT-SCIR (Harbin) software4 93.23 10. Wenba-NLU (Wuhan) software1 93.11 IIT Kharagpur (Kharagpur) software3 93.11 CLCL (Genève) software1 93.11 NAIST SATO (Nara) software1 93.11 Orange – Deskiñ (Lannion) software1 93.11 UParse (Edinburgh) software1 93.11 LIMSI-LIPN (Paris) software2 93.11 LyS-FASTPARSE (A Coruña) software5 93.11 LATTICE (Paris) software7 93.11 naistCL (Nara) software1 93.11 UALING (Tucson) software1 93.11 Koç University (İstanbul) software3 93.11 BASELINE UDPipe 1.1 (Praha) software2 93.11 C2L2 (Ithaca) software5 93.11 Mengest (Shanghai) software1 93.11 OpenU NLP Lab (Ra'anana) software6 93.11 26. TurkuNLP (Turku) software1 93.08 27. RACAI (București) software1 92.76 28. TRL (Tokyo) software1 82.41 29. MetaRomance (Santiago de Compostela) software1 40.71 30. METU (Ankara) software2 0.03 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
en_lines
1. Stanford (Stanford) software1 96.64 2. ParisNLP (Paris) software1 95.99 3. fbaml (Palo Alto) software1 95.40 HIT-SCIR (Harbin) software4 95.40 5. IMS (Stuttgart) software2 95.08 6. Wanghao-ftd-SJTU (Shanghai) software2 94.93 7. ÚFAL – UDPipe 1.2 (Praha) software1 94.87 8. darc (Tübingen) software1 94.84 9. TurkuNLP (Turku) software1 94.76 10. MQuni (Sydney) software2 94.64 11. Wenba-NLU (Wuhan) software1 94.53 IIT Kharagpur (Kharagpur) software3 94.53 CLCL (Genève) software1 94.53 NAIST SATO (Nara) software1 94.53 Orange – Deskiñ (Lannion) software1 94.53 UParse (Edinburgh) software1 94.53 LIMSI-LIPN (Paris) software2 94.53 LyS-FASTPARSE (A Coruña) software5 94.53 LATTICE (Paris) software7 94.53 naistCL (Nara) software1 94.53 UALING (Tucson) software1 94.53 Koç University (İstanbul) software3 94.53 BASELINE UDPipe 1.1 (Praha) software2 94.53 C2L2 (Ithaca) software5 94.53 Mengest (Shanghai) software1 94.53 26. RACAI (București) software1 93.86 27. OpenU NLP Lab (Ra'anana) software6 91.78 28. UT (Tartu) software1 91.69 29. TRL (Tokyo) software1 86.90 30. MetaRomance (Santiago de Compostela) software1 42.46 31. METU (Ankara) software2 0.05 32. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00
en_partut
1. Stanford (Stanford) software1 95.22 2. ParisNLP (Paris) software1 94.78 3. HIT-SCIR (Harbin) software4 94.59 4. fbaml (Palo Alto) software1 94.20 5. MQuni (Sydney) software2 93.76 6. Wanghao-ftd-SJTU (Shanghai) software2 93.56 7. ÚFAL – UDPipe 1.2 (Praha) software1 93.41 8. darc (Tübingen) software1 93.35 9. IMS (Stuttgart) software2 93.32 10. Wenba-NLU (Wuhan) software1 93.03 IIT Kharagpur (Kharagpur) software3 93.03 CLCL (Genève) software1 93.03 NAIST SATO (Nara) software1 93.03 Orange – Deskiñ (Lannion) software1 93.03 UParse (Edinburgh) software1 93.03 LIMSI-LIPN (Paris) software2 93.03 LyS-FASTPARSE (A Coruña) software5 93.03 LATTICE (Paris) software7 93.03 naistCL (Nara) software1 93.03 UALING (Tucson) software1 93.03 Koç University (İstanbul) software3 93.03 BASELINE UDPipe 1.1 (Praha) software2 93.03 C2L2 (Ithaca) software5 93.03 Mengest (Shanghai) software1 93.03 25. TurkuNLP (Turku) software1 92.98 26. RACAI (București) software1 92.93 27. OpenU NLP Lab (Ra'anana) software6 90.60 28. TRL (Tokyo) software1 88.32 29. MetaRomance (Santiago de Compostela) software1 41.53 30. METU (Ankara) software2 2.29 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
en_pud
1. Stanford (Stanford) software1 95.40 2. ParisNLP (Paris) software1 94.74 3. fbaml (Palo Alto) software1 94.46 4. MQuni (Sydney) software2 94.43 5. ÚFAL – UDPipe 1.2 (Praha) software1 94.11 6. Wanghao-ftd-SJTU (Shanghai) software2 94.03 7. UT (Tartu) software1 94.01 8. darc (Tübingen) software1 94.00 IIT Kharagpur (Kharagpur) software3 94.00 CLCL (Genève) software1 94.00 NAIST SATO (Nara) software1 94.00 Orange – Deskiñ (Lannion) software1 94.00 UParse (Edinburgh) software1 94.00 LIMSI-LIPN (Paris) software2 94.00 LyS-FASTPARSE (A Coruña) software5 94.00 LATTICE (Paris) software7 94.00 naistCL (Nara) software1 94.00 UALING (Tucson) software1 94.00 Koç University (İstanbul) software3 94.00 BASELINE UDPipe 1.1 (Praha) software2 94.00 C2L2 (Ithaca) software5 94.00 Mengest (Shanghai) software1 94.00 23. TurkuNLP (Turku) software1 93.96 24. IMS (Stuttgart) software2 93.95 25. RACAI (București) software1 93.65 26. HIT-SCIR (Harbin) software4 92.95 27. OpenU NLP Lab (Ra'anana) software6 89.60 28. TRL (Tokyo) software1 85.43 29. MetaRomance (Santiago de Compostela) software1 40.24 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
es
1. Stanford (Stanford) software1 96.59 2. MQuni (Sydney) software2 96.00 3. fbaml (Palo Alto) software1 95.87 4. HIT-SCIR (Harbin) software4 95.75 5. ParisNLP (Paris) software1 95.60 IIT Kharagpur (Kharagpur) software3 95.60 NAIST SATO (Nara) software1 95.60 Orange – Deskiñ (Lannion) software1 95.60 UParse (Edinburgh) software1 95.60 LIMSI-LIPN (Paris) software2 95.60 LyS-FASTPARSE (A Coruña) software5 95.60 LATTICE (Paris) software7 95.60 naistCL (Nara) software1 95.60 UALING (Tucson) software1 95.60 Koç University (İstanbul) software3 95.60 BASELINE UDPipe 1.1 (Praha) software2 95.60 C2L2 (Ithaca) software5 95.60 Mengest (Shanghai) software1 95.60 CLCL (Genève) software2 95.60 20. darc (Tübingen) software1 95.55 TurkuNLP (Turku) software1 95.55 22. ÚFAL – UDPipe 1.2 (Praha) software1 95.54 23. IMS (Stuttgart) software2 95.53 24. Wanghao-ftd-SJTU (Shanghai) software2 95.44 25. RACAI (București) software1 95.21 26. OpenU NLP Lab (Ra'anana) software6 91.14 27. TRL (Tokyo) software1 88.82 28. MetaRomance (Santiago de Compostela) software1 37.20 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
es_ancora
1. Stanford (Stanford) software1 98.72 2. MQuni (Sydney) software2 98.24 3. IMS (Stuttgart) software2 98.19 4. ParisNLP (Paris) software1 98.15 IIT Kharagpur (Kharagpur) software3 98.15 NAIST SATO (Nara) software1 98.15 Orange – Deskiñ (Lannion) software1 98.15 UParse (Edinburgh) software1 98.15 LIMSI-LIPN (Paris) software2 98.15 LyS-FASTPARSE (A Coruña) software5 98.15 LATTICE (Paris) software7 98.15 naistCL (Nara) software1 98.15 UALING (Tucson) software1 98.15 Koç University (İstanbul) software3 98.15 BASELINE UDPipe 1.1 (Praha) software2 98.15 METU (Ankara) software2 98.15 C2L2 (Ithaca) software5 98.15 Mengest (Shanghai) software1 98.15 CLCL (Genève) software2 98.15 20. TurkuNLP (Turku) software1 98.14 ÚFAL – UDPipe 1.2 (Praha) software1 98.14 22. Wanghao-ftd-SJTU (Shanghai) software2 98.13 23. darc (Tübingen) software1 98.09 24. fbaml (Palo Alto) software1 97.87 25. RACAI (București) software1 97.60 26. HIT-SCIR (Harbin) software4 96.92 27. OpenU NLP Lab (Ra'anana) software6 93.73 28. TRL (Tokyo) software1 89.35 29. MetaRomance (Santiago de Compostela) software1 35.50 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
es_pud
1. IMS (Stuttgart) software2 88.48 2. Stanford (Stanford) software1 88.39 3. MQuni (Sydney) software2 88.20 4. ÚFAL – UDPipe 1.2 (Praha) software1 88.17 5. Wanghao-ftd-SJTU (Shanghai) software2 88.15 ParisNLP (Paris) software1 88.15 darc (Tübingen) software1 88.15 IIT Kharagpur (Kharagpur) software3 88.15 CLCL (Genève) software1 88.15 NAIST SATO (Nara) software1 88.15 Orange – Deskiñ (Lannion) software1 88.15 UParse (Edinburgh) software1 88.15 LIMSI-LIPN (Paris) software2 88.15 LyS-FASTPARSE (A Coruña) software5 88.15 LATTICE (Paris) software7 88.15 naistCL (Nara) software1 88.15 UALING (Tucson) software1 88.15 Koç University (İstanbul) software3 88.15 BASELINE UDPipe 1.1 (Praha) software2 88.15 C2L2 (Ithaca) software5 88.15 Mengest (Shanghai) software1 88.15 22. TurkuNLP (Turku) software1 88.11 23. fbaml (Palo Alto) software1 88.01 24. RACAI (București) software1 87.55 25. HIT-SCIR (Harbin) software4 84.99 26. OpenU NLP Lab (Ra'anana) software6 84.74 27. TRL (Tokyo) software1 84.45 28. MetaRomance (Santiago de Compostela) software1 39.71 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
et
1. Stanford (Stanford) software1 93.01 2. HIT-SCIR (Harbin) software4 90.21 3. fbaml (Palo Alto) software1 89.90 4. IMS (Stuttgart) software2 89.50 5. ParisNLP (Paris) software1 89.24 6. UT (Tartu) software1 88.90 7. darc (Tübingen) software1 87.96 8. Wanghao-ftd-SJTU (Shanghai) software2 87.83 9. BASELINE UDPipe 1.1 (Praha) software2 87.71 10. Wenba-NLU (Wuhan) software1 87.70 IIT Kharagpur (Kharagpur) software3 87.70 CLCL (Genève) software1 87.70 NAIST SATO (Nara) software1 87.70 Orange – Deskiñ (Lannion) software1 87.70 UParse (Edinburgh) software1 87.70 LIMSI-LIPN (Paris) software2 87.70 LyS-FASTPARSE (A Coruña) software5 87.70 LATTICE (Paris) software7 87.70 naistCL (Nara) software1 87.70 UALING (Tucson) software1 87.70 Koç University (İstanbul) software3 87.70 C2L2 (Ithaca) software5 87.70 Mengest (Shanghai) software1 87.70 24. TurkuNLP (Turku) software1 87.66 25. ÚFAL – UDPipe 1.2 (Praha) software1 87.60 26. RACAI (București) software1 87.53 27. MQuni (Sydney) software2 87.31 28. TRL (Tokyo) software1 79.68 29. OpenU NLP Lab (Ra'anana) software6 78.80 30. MetaRomance (Santiago de Compostela) software1 47.19 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
eu
1. Stanford (Stanford) software1 95.89 2. fbaml (Palo Alto) software1 94.59 3. ParisNLP (Paris) software1 94.01 IMS (Stuttgart) software2 94.01 5. HIT-SCIR (Harbin) software4 93.90 6. UT (Tartu) software1 93.36 7. MQuni (Sydney) software2 93.12 8. Wanghao-ftd-SJTU (Shanghai) software2 92.67 9. TurkuNLP (Turku) software1 92.49 10. RACAI (București) software1 92.44 11. Wenba-NLU (Wuhan) software1 92.36 IIT Kharagpur (Kharagpur) software3 92.36 NAIST SATO (Nara) software1 92.36 Orange – Deskiñ (Lannion) software1 92.36 UParse (Edinburgh) software1 92.36 LIMSI-LIPN (Paris) software2 92.36 LyS-FASTPARSE (A Coruña) software5 92.36 LATTICE (Paris) software7 92.36 naistCL (Nara) software1 92.36 UALING (Tucson) software1 92.36 Koç University (İstanbul) software3 92.36 BASELINE UDPipe 1.1 (Praha) software2 92.36 C2L2 (Ithaca) software5 92.36 Mengest (Shanghai) software1 92.36 CLCL (Genève) software2 92.36 26. ÚFAL – UDPipe 1.2 (Praha) software1 92.33 27. darc (Tübingen) software1 92.31 28. OpenU NLP Lab (Ra'anana) software6 87.06 29. TRL (Tokyo) software1 85.58 30. MetaRomance (Santiago de Compostela) software1 47.81 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
fa
1. Stanford (Stanford) software1 97.15 2. HIT-SCIR (Harbin) software4 96.36 3. IMS (Stuttgart) software2 96.21 4. MQuni (Sydney) software2 96.05 5. TurkuNLP (Turku) software1 96.03 6. ÚFAL – UDPipe 1.2 (Praha) software1 96.02 7. Wenba-NLU (Wuhan) software1 96.00 ParisNLP (Paris) software1 96.00 IIT Kharagpur (Kharagpur) software3 96.00 NAIST SATO (Nara) software1 96.00 Orange – Deskiñ (Lannion) software1 96.00 UParse (Edinburgh) software1 96.00 LIMSI-LIPN (Paris) software2 96.00 LyS-FASTPARSE (A Coruña) software5 96.00 LATTICE (Paris) software7 96.00 naistCL (Nara) software1 96.00 UALING (Tucson) software1 96.00 Koç University (İstanbul) software3 96.00 BASELINE UDPipe 1.1 (Praha) software2 96.00 C2L2 (Ithaca) software5 96.00 Mengest (Shanghai) software1 96.00 CLCL (Genève) software2 96.00 23. darc (Tübingen) software1 95.89 24. fbaml (Palo Alto) software1 95.86 25. Wanghao-ftd-SJTU (Shanghai) software2 95.83 26. RACAI (București) software1 94.92 27. TRL (Tokyo) software1 92.32 28. OpenU NLP Lab (Ra'anana) software6 91.50 29. MetaRomance (Santiago de Compostela) software1 61.12 30. METU (Ankara) software2 12.89 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
fi
1. Stanford (Stanford) software1 96.62 2. fbaml (Palo Alto) software1 95.15 IMS (Stuttgart) software2 95.15 4. ParisNLP (Paris) software1 94.59 5. ÚFAL – UDPipe 1.2 (Praha) software1 94.49 6. MQuni (Sydney) software2 94.45 7. TurkuNLP (Turku) software1 94.42 8. darc (Tübingen) software1 94.29 9. UT (Tartu) software1 94.11 10. Wanghao-ftd-SJTU (Shanghai) software2 94.07 11. Wenba-NLU (Wuhan) software1 94.01 IIT Kharagpur (Kharagpur) software3 94.01 NAIST SATO (Nara) software1 94.01 Orange – Deskiñ (Lannion) software1 94.01 UParse (Edinburgh) software1 94.01 LIMSI-LIPN (Paris) software2 94.01 LyS-FASTPARSE (A Coruña) software5 94.01 LATTICE (Paris) software7 94.01 naistCL (Nara) software1 94.01 UALING (Tucson) software1 94.01 Koç University (İstanbul) software3 94.01 BASELINE UDPipe 1.1 (Praha) software2 94.01 C2L2 (Ithaca) software5 94.01 Mengest (Shanghai) software1 94.01 CLCL (Genève) software2 94.01 26. HIT-SCIR (Harbin) software4 93.88 27. RACAI (București) software1 92.56 28. OpenU NLP Lab (Ra'anana) software6 84.99 29. TRL (Tokyo) software1 84.02 30. MetaRomance (Santiago de Compostela) software1 53.54 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
fi_ftb
1. Stanford (Stanford) software1 96.30 2. ParisNLP (Paris) software1 93.11 fbaml (Palo Alto) software1 93.11 4. HIT-SCIR (Harbin) software4 93.10 5. IMS (Stuttgart) software2 92.80 6. ÚFAL – UDPipe 1.2 (Praha) software1 92.28 7. Wanghao-ftd-SJTU (Shanghai) software2 92.24 8. darc (Tübingen) software1 92.21 9. TurkuNLP (Turku) software1 92.12 10. MQuni (Sydney) software2 92.03 11. Wenba-NLU (Wuhan) software1 91.87 IIT Kharagpur (Kharagpur) software3 91.87 NAIST SATO (Nara) software1 91.87 Orange – Deskiñ (Lannion) software1 91.87 UParse (Edinburgh) software1 91.87 LIMSI-LIPN (Paris) software2 91.87 LyS-FASTPARSE (A Coruña) software5 91.87 LATTICE (Paris) software7 91.87 naistCL (Nara) software1 91.87 UALING (Tucson) software1 91.87 Koç University (İstanbul) software3 91.87 C2L2 (Ithaca) software5 91.87 Mengest (Shanghai) software1 91.87 CLCL (Genève) software2 91.87 25. BASELINE UDPipe 1.1 (Praha) software2 91.86 26. RACAI (București) software1 89.77 27. OpenU NLP Lab (Ra'anana) software6 82.41 28. TRL (Tokyo) software1 78.95 29. MetaRomance (Santiago de Compostela) software1 57.43 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
fi_pud
1. Stanford (Stanford) software1 97.54 2. IMS (Stuttgart) software2 96.77 3. fbaml (Palo Alto) software1 96.13 4. ParisNLP (Paris) software1 95.98 TurkuNLP (Turku) software1 95.98 6. ÚFAL – UDPipe 1.2 (Praha) software1 95.84 7. MQuni (Sydney) software2 95.83 8. darc (Tübingen) software1 95.61 IIT Kharagpur (Kharagpur) software3 95.61 CLCL (Genève) software1 95.61 NAIST SATO (Nara) software1 95.61 Orange – Deskiñ (Lannion) software1 95.61 UParse (Edinburgh) software1 95.61 LIMSI-LIPN (Paris) software2 95.61 LyS-FASTPARSE (A Coruña) software5 95.61 LATTICE (Paris) software7 95.61 naistCL (Nara) software1 95.61 UALING (Tucson) software1 95.61 Koç University (İstanbul) software3 95.61 BASELINE UDPipe 1.1 (Praha) software2 95.61 C2L2 (Ithaca) software5 95.61 Mengest (Shanghai) software1 95.61 23. Wanghao-ftd-SJTU (Shanghai) software2 95.45 24. HIT-SCIR (Harbin) software4 94.72 25. RACAI (București) software1 93.74 26. TRL (Tokyo) software1 85.59 27. OpenU NLP Lab (Ra'anana) software6 82.98 28. MetaRomance (Santiago de Compostela) software1 51.76 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
fr
1. IMS (Stuttgart) software2 96.22 2. Stanford (Stanford) software1 96.20 3. fbaml (Palo Alto) software1 95.68 4. MQuni (Sydney) software2 95.60 5. TurkuNLP (Turku) software1 95.53 6. ParisNLP (Paris) software1 95.51 7. ÚFAL – UDPipe 1.2 (Praha) software1 95.49 8. Wanghao-ftd-SJTU (Shanghai) software2 95.41 9. Wenba-NLU (Wuhan) software1 95.33 IIT Kharagpur (Kharagpur) software3 95.33 NAIST SATO (Nara) software1 95.33 Orange – Deskiñ (Lannion) software1 95.33 UParse (Edinburgh) software1 95.33 LIMSI-LIPN (Paris) software2 95.33 LyS-FASTPARSE (A Coruña) software5 95.33 LATTICE (Paris) software7 95.33 naistCL (Nara) software1 95.33 UALING (Tucson) software1 95.33 Koç University (İstanbul) software3 95.33 BASELINE UDPipe 1.1 (Praha) software2 95.33 C2L2 (Ithaca) software5 95.33 Mengest (Shanghai) software1 95.33 CLCL (Genève) software2 95.33 24. darc (Tübingen) software1 95.22 25. HIT-SCIR (Harbin) software4 95.10 26. RACAI (București) software1 94.95 27. OpenU NLP Lab (Ra'anana) software6 92.20 28. TRL (Tokyo) software1 85.75 29. MetaRomance (Santiago de Compostela) software1 36.66 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
fr_partut
1. Stanford (Stanford) software1 96.16 2. IMS (Stuttgart) software2 95.92 3. ÚFAL – UDPipe 1.2 (Praha) software1 95.38 4. fbaml (Palo Alto) software1 95.26 5. TurkuNLP (Turku) software1 94.99 6. Wanghao-ftd-SJTU (Shanghai) software2 94.78 7. ParisNLP (Paris) software1 94.46 darc (Tübingen) software1 94.46 IIT Kharagpur (Kharagpur) software3 94.46 NAIST SATO (Nara) software1 94.46 Orange – Deskiñ (Lannion) software1 94.46 UParse (Edinburgh) software1 94.46 LIMSI-LIPN (Paris) software2 94.46 LyS-FASTPARSE (A Coruña) software5 94.46 LATTICE (Paris) software7 94.46 naistCL (Nara) software1 94.46 UALING (Tucson) software1 94.46 Koç University (İstanbul) software3 94.46 BASELINE UDPipe 1.1 (Praha) software2 94.46 C2L2 (Ithaca) software5 94.46 Mengest (Shanghai) software1 94.46 CLCL (Genève) software2 94.46 23. RACAI (București) software1 94.30 24. MQuni (Sydney) software2 94.25 25. HIT-SCIR (Harbin) software4 93.97 26. OpenU NLP Lab (Ra'anana) software6 93.60 27. TRL (Tokyo) software1 86.64 28. MetaRomance (Santiago de Compostela) software1 38.22 29. METU (Ankara) software2 0.66 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
fr_pud
1. Stanford (Stanford) software1 89.32 2. HIT-SCIR (Harbin) software4 89.21 3. IMS (Stuttgart) software2 89.07 4. ParisNLP (Paris) software1 88.54 5. MQuni (Sydney) software2 88.43 6. Wanghao-ftd-SJTU (Shanghai) software2 88.06 7. ÚFAL – UDPipe 1.2 (Praha) software1 88.00 8. darc (Tübingen) software1 87.90 IIT Kharagpur (Kharagpur) software3 87.90 CLCL (Genève) software1 87.90 NAIST SATO (Nara) software1 87.90 Orange – Deskiñ (Lannion) software1 87.90 UParse (Edinburgh) software1 87.90 LIMSI-LIPN (Paris) software2 87.90 LyS-FASTPARSE (A Coruña) software5 87.90 LATTICE (Paris) software7 87.90 naistCL (Nara) software1 87.90 UALING (Tucson) software1 87.90 Koç University (İstanbul) software3 87.90 BASELINE UDPipe 1.1 (Praha) software2 87.90 C2L2 (Ithaca) software5 87.90 Mengest (Shanghai) software1 87.90 23. TurkuNLP (Turku) software1 87.85 24. fbaml (Palo Alto) software1 87.56 25. RACAI (București) software1 87.23 26. OpenU NLP Lab (Ra'anana) software6 84.28 27. TRL (Tokyo) software1 81.19 28. MetaRomance (Santiago de Compostela) software1 40.99 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
fr_sequoia
1. Stanford (Stanford) software1 97.41 2. ParisNLP (Paris) software1 96.78 3. IMS (Stuttgart) software2 96.61 4. fbaml (Palo Alto) software1 96.40 5. MQuni (Sydney) software2 96.13 6. Wanghao-ftd-SJTU (Shanghai) software2 95.69 7. darc (Tübingen) software1 95.64 8. TurkuNLP (Turku) software1 95.63 ÚFAL – UDPipe 1.2 (Praha) software1 95.63 10. HIT-SCIR (Harbin) software4 95.42 11. RACAI (București) software1 95.41 12. Wenba-NLU (Wuhan) software1 95.40 IIT Kharagpur (Kharagpur) software3 95.40 NAIST SATO (Nara) software1 95.40 Orange – Deskiñ (Lannion) software1 95.40 UParse (Edinburgh) software1 95.40 LIMSI-LIPN (Paris) software2 95.40 LyS-FASTPARSE (A Coruña) software5 95.40 LATTICE (Paris) software7 95.40 naistCL (Nara) software1 95.40 UALING (Tucson) software1 95.40 Koç University (İstanbul) software3 95.40 BASELINE UDPipe 1.1 (Praha) software2 95.40 C2L2 (Ithaca) software5 95.40 Mengest (Shanghai) software1 95.40 OpenU NLP Lab (Ra'anana) software6 95.40 CLCL (Genève) software2 95.40 28. TRL (Tokyo) software1 84.35 29. MetaRomance (Santiago de Compostela) software1 37.13 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
ga
1. Stanford (Stanford) software1 92.43 2. fbaml (Palo Alto) software1 90.79 3. ParisNLP (Paris) software1 90.00 4. IMS (Stuttgart) software2 89.99 5. HIT-SCIR (Harbin) software4 89.87 6. darc (Tübingen) software1 89.02 7. RACAI (București) software1 88.95 8. ÚFAL – UDPipe 1.2 (Praha) software1 88.86 9. TurkuNLP (Turku) software1 88.79 10. Wanghao-ftd-SJTU (Shanghai) software2 88.53 11. IIT Kharagpur (Kharagpur) software3 88.17 NAIST SATO (Nara) software1 88.17 Orange – Deskiñ (Lannion) software1 88.17 UParse (Edinburgh) software1 88.17 LIMSI-LIPN (Paris) software2 88.17 LyS-FASTPARSE (A Coruña) software5 88.17 LATTICE (Paris) software7 88.17 naistCL (Nara) software1 88.17 UALING (Tucson) software1 88.17 Koç University (İstanbul) software3 88.17 BASELINE UDPipe 1.1 (Praha) software2 88.17 C2L2 (Ithaca) software5 88.17 Mengest (Shanghai) software1 88.17 CLCL (Genève) software2 88.17 25. MQuni (Sydney) software2 87.78 26. OpenU NLP Lab (Ra'anana) software6 83.72 27. TRL (Tokyo) software1 82.54 28. MetaRomance (Santiago de Compostela) software1 43.45 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
gl
1. Stanford (Stanford) software1 97.72 2. ParisNLP (Paris) software1 97.42 3. HIT-SCIR (Harbin) software4 97.31 4. fbaml (Palo Alto) software1 96.98 5. ÚFAL – UDPipe 1.2 (Praha) software1 96.93 6. UT (Tartu) software1 96.88 7. IMS (Stuttgart) software2 96.87 8. Wanghao-ftd-SJTU (Shanghai) software2 96.84 Wenba-NLU (Wuhan) software1 96.84 IIT Kharagpur (Kharagpur) software3 96.84 NAIST SATO (Nara) software1 96.84 Orange – Deskiñ (Lannion) software1 96.84 UParse (Edinburgh) software1 96.84 LIMSI-LIPN (Paris) software2 96.84 LyS-FASTPARSE (A Coruña) software5 96.84 LATTICE (Paris) software7 96.84 naistCL (Nara) software1 96.84 UALING (Tucson) software1 96.84 Koç University (İstanbul) software3 96.84 BASELINE UDPipe 1.1 (Praha) software2 96.84 C2L2 (Ithaca) software5 96.84 Mengest (Shanghai) software1 96.84 CLCL (Genève) software2 96.84 24. darc (Tübingen) software1 96.80 25. MQuni (Sydney) software2 96.77 26. TurkuNLP (Turku) software1 96.65 27. RACAI (București) software1 96.11 28. OpenU NLP Lab (Ra'anana) software6 95.18 29. TRL (Tokyo) software1 88.73 30. MetaRomance (Santiago de Compostela) software1 42.34 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
gl_treegal
1. Stanford (Stanford) software1 94.51 2. IMS (Stuttgart) software2 92.32 3. fbaml (Palo Alto) software1 91.89 4. HIT-SCIR (Harbin) software4 91.75 5. Wanghao-ftd-SJTU (Shanghai) software2 91.51 6. MQuni (Sydney) software2 91.47 7. TurkuNLP (Turku) software1 91.23 8. ÚFAL – UDPipe 1.2 (Praha) software1 91.08 9. ParisNLP (Paris) software1 90.69 IIT Kharagpur (Kharagpur) software3 90.69 NAIST SATO (Nara) software1 90.69 Orange – Deskiñ (Lannion) software1 90.69 UParse (Edinburgh) software1 90.69 LIMSI-LIPN (Paris) software2 90.69 LyS-FASTPARSE (A Coruña) software5 90.69 LATTICE (Paris) software7 90.69 naistCL (Nara) software1 90.69 UALING (Tucson) software1 90.69 Koç University (İstanbul) software3 90.69 BASELINE UDPipe 1.1 (Praha) software2 90.69 C2L2 (Ithaca) software5 90.69 Mengest (Shanghai) software1 90.69 CLCL (Genève) software2 90.69 24. darc (Tübingen) software1 90.57 25. RACAI (București) software1 90.51 26. OpenU NLP Lab (Ra'anana) software6 86.77 27. TRL (Tokyo) software1 71.85 28. MetaRomance (Santiago de Compostela) software1 34.40 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
got
1. Stanford (Stanford) software1 95.74 2. IMS (Stuttgart) software2 95.03 3. fbaml (Palo Alto) software1 94.85 4. UT (Tartu) software1 94.38 5. ÚFAL – UDPipe 1.2 (Praha) software1 94.32 6. darc (Tübingen) software1 93.96 7. Wanghao-ftd-SJTU (Shanghai) software2 93.94 8. MQuni (Sydney) software2 93.87 9. TurkuNLP (Turku) software1 93.77 10. Wenba-NLU (Wuhan) software1 93.55 ParisNLP (Paris) software1 93.55 IIT Kharagpur (Kharagpur) software3 93.55 NAIST SATO (Nara) software1 93.55 Orange – Deskiñ (Lannion) software1 93.55 UParse (Edinburgh) software1 93.55 LIMSI-LIPN (Paris) software2 93.55 LyS-FASTPARSE (A Coruña) software5 93.55 LATTICE (Paris) software7 93.55 naistCL (Nara) software1 93.55 UALING (Tucson) software1 93.55 Koç University (İstanbul) software3 93.55 BASELINE UDPipe 1.1 (Praha) software2 93.55 C2L2 (Ithaca) software5 93.55 Mengest (Shanghai) software1 93.55 CLCL (Genève) software2 93.55 26. RACAI (București) software1 93.39 27. HIT-SCIR (Harbin) software4 93.13 28. OpenU NLP Lab (Ra'anana) software6 89.19 29. TRL (Tokyo) software1 86.85 30. MetaRomance (Santiago de Compostela) software1 54.46 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
grc
1. Stanford (Stanford) software1 92.64 2. HIT-SCIR (Harbin) software4 89.28 3. ParisNLP (Paris) software1 88.48 4. IMS (Stuttgart) software2 87.59 5. fbaml (Palo Alto) software1 87.25 6. MQuni (Sydney) software2 86.90 7. RACAI (București) software1 86.48 8. UT (Tartu) software1 85.61 9. ÚFAL – UDPipe 1.2 (Praha) software1 85.55 10. darc (Tübingen) software1 82.87 TurkuNLP (Turku) software1 82.87 12. Wenba-NLU (Wuhan) software1 82.13 IIT Kharagpur (Kharagpur) software3 82.13 NAIST SATO (Nara) software1 82.13 Orange – Deskiñ (Lannion) software1 82.13 UParse (Edinburgh) software1 82.13 LIMSI-LIPN (Paris) software2 82.13 LyS-FASTPARSE (A Coruña) software5 82.13 LATTICE (Paris) software7 82.13 naistCL (Nara) software1 82.13 UALING (Tucson) software1 82.13 Koç University (İstanbul) software3 82.13 BASELINE UDPipe 1.1 (Praha) software2 82.13 C2L2 (Ithaca) software5 82.13 Mengest (Shanghai) software1 82.13 CLCL (Genève) software2 82.13 27. Wanghao-ftd-SJTU (Shanghai) software2 81.59 28. OpenU NLP Lab (Ra'anana) software6 72.54 29. TRL (Tokyo) software1 71.46 30. MetaRomance (Santiago de Compostela) software1 49.26 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
grc_proiel
1. Stanford (Stanford) software1 97.06 2. IMS (Stuttgart) software2 96.48 3. fbaml (Palo Alto) software1 96.05 4. TurkuNLP (Turku) software1 95.77 5. darc (Tübingen) software1 95.75 6. HIT-SCIR (Harbin) software4 95.73 7. Wenba-NLU (Wuhan) software1 95.72 ParisNLP (Paris) software1 95.72 IIT Kharagpur (Kharagpur) software3 95.72 NAIST SATO (Nara) software1 95.72 Orange – Deskiñ (Lannion) software1 95.72 UParse (Edinburgh) software1 95.72 LIMSI-LIPN (Paris) software2 95.72 LyS-FASTPARSE (A Coruña) software5 95.72 LATTICE (Paris) software7 95.72 naistCL (Nara) software1 95.72 UALING (Tucson) software1 95.72 Koç University (İstanbul) software3 95.72 BASELINE UDPipe 1.1 (Praha) software2 95.72 C2L2 (Ithaca) software5 95.72 Mengest (Shanghai) software1 95.72 CLCL (Genève) software2 95.72 23. RACAI (București) software1 95.70 24. ÚFAL – UDPipe 1.2 (Praha) software1 95.60 25. Wanghao-ftd-SJTU (Shanghai) software2 95.33 26. MQuni (Sydney) software2 94.76 27. OpenU NLP Lab (Ra'anana) software6 89.80 28. TRL (Tokyo) software1 87.75 29. MetaRomance (Santiago de Compostela) software1 51.50 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
he
1. IMS (Stuttgart) software2 87.34 2. RACAI (București) software1 83.24 3. Stanford (Stanford) software1 82.42 4. ParisNLP (Paris) software1 81.42 5. HIT-SCIR (Harbin) software4 81.39 6. Wanghao-ftd-SJTU (Shanghai) software2 81.23 7. darc (Tübingen) software1 81.02 8. ÚFAL – UDPipe 1.2 (Praha) software1 80.87 9. TurkuNLP (Turku) software1 80.72 10. Wenba-NLU (Wuhan) software1 80.48 IIT Kharagpur (Kharagpur) software3 80.48 NAIST SATO (Nara) software1 80.48 Orange – Deskiñ (Lannion) software1 80.48 UParse (Edinburgh) software1 80.48 LIMSI-LIPN (Paris) software2 80.48 LyS-FASTPARSE (A Coruña) software5 80.48 LATTICE (Paris) software7 80.48 naistCL (Nara) software1 80.48 UALING (Tucson) software1 80.48 Koç University (İstanbul) software3 80.48 BASELINE UDPipe 1.1 (Praha) software2 80.48 METU (Ankara) software2 80.48 C2L2 (Ithaca) software5 80.48 Mengest (Shanghai) software1 80.48 CLCL (Genève) software2 80.48 26. MQuni (Sydney) software2 80.35 27. fbaml (Palo Alto) software1 77.34 28. OpenU NLP Lab (Ra'anana) software6 73.55 29. TRL (Tokyo) software1 73.29 30. MetaRomance (Santiago de Compostela) software1 38.33 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
hi
1. Stanford (Stanford) software1 97.50 2. HIT-SCIR (Harbin) software4 96.64 3. ParisNLP (Paris) software1 96.61 4. MQuni (Sydney) software2 96.41 5. fbaml (Palo Alto) software1 96.40 6. IMS (Stuttgart) software2 96.28 7. UT (Tartu) software1 95.99 8. RACAI (București) software1 95.94 9. TurkuNLP (Turku) software1 95.77 10. ÚFAL – UDPipe 1.2 (Praha) software1 95.75 11. darc (Tübingen) software1 95.73 12. Wanghao-ftd-SJTU (Shanghai) software2 95.67 13. Wenba-NLU (Wuhan) software1 95.63 IIT Kharagpur (Kharagpur) software3 95.63 NAIST SATO (Nara) software1 95.63 Orange – Deskiñ (Lannion) software1 95.63 UParse (Edinburgh) software1 95.63 LIMSI-LIPN (Paris) software2 95.63 LyS-FASTPARSE (A Coruña) software5 95.63 LATTICE (Paris) software7 95.63 naistCL (Nara) software1 95.63 UALING (Tucson) software1 95.63 Koç University (İstanbul) software3 95.63 BASELINE UDPipe 1.1 (Praha) software2 95.63 C2L2 (Ithaca) software5 95.63 Mengest (Shanghai) software1 95.63 CLCL (Genève) software2 95.63 28. OpenU NLP Lab (Ra'anana) software6 92.44 29. TRL (Tokyo) software1 90.15 30. MetaRomance (Santiago de Compostela) software1 44.13 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
hi_pud
1. Stanford (Stanford) software1 85.48 2. HIT-SCIR (Harbin) software4 85.45 3. ÚFAL – UDPipe 1.2 (Praha) software1 84.69 4. ParisNLP (Paris) software1 84.62 5. Wanghao-ftd-SJTU (Shanghai) software2 84.11 6. darc (Tübingen) software1 83.75 IIT Kharagpur (Kharagpur) software3 83.75 CLCL (Genève) software1 83.75 NAIST SATO (Nara) software1 83.75 Orange – Deskiñ (Lannion) software1 83.75 UParse (Edinburgh) software1 83.75 LIMSI-LIPN (Paris) software2 83.75 LyS-FASTPARSE (A Coruña) software5 83.75 LATTICE (Paris) software7 83.75 naistCL (Nara) software1 83.75 UALING (Tucson) software1 83.75 Koç University (İstanbul) software3 83.75 BASELINE UDPipe 1.1 (Praha) software2 83.75 C2L2 (Ithaca) software5 83.75 Mengest (Shanghai) software1 83.75 21. TurkuNLP (Turku) software1 83.68 IMS (Stuttgart) software2 83.68 23. MQuni (Sydney) software2 83.57 24. UT (Tartu) software1 83.32 25. TRL (Tokyo) software1 81.48 26. OpenU NLP Lab (Ra'anana) software6 79.93 27. fbaml (Palo Alto) software1 79.04 28. RACAI (București) software1 78.12 29. MetaRomance (Santiago de Compostela) software1 42.05 30. METU (Ankara) software2 0.01 31. Wenba-NLU (Wuhan) software1 0.00 32. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00
hr
1. Stanford (Stanford) software1 97.68 2. IMS (Stuttgart) software2 96.48 3. MQuni (Sydney) software2 96.14 4. fbaml (Palo Alto) software1 96.13 5. UT (Tartu) software1 96.12 6. darc (Tübingen) software1 95.88 ÚFAL – UDPipe 1.2 (Praha) software1 95.88 8. Wanghao-ftd-SJTU (Shanghai) software2 95.85 9. HIT-SCIR (Harbin) software4 95.84 10. RACAI (București) software1 95.80 11. TurkuNLP (Turku) software1 95.73 12. Wenba-NLU (Wuhan) software1 95.67 ParisNLP (Paris) software1 95.67 IIT Kharagpur (Kharagpur) software3 95.67 CLCL (Genève) software1 95.67 NAIST SATO (Nara) software1 95.67 Orange – Deskiñ (Lannion) software1 95.67 UParse (Edinburgh) software1 95.67 LIMSI-LIPN (Paris) software2 95.67 LyS-FASTPARSE (A Coruña) software5 95.67 LATTICE (Paris) software7 95.67 naistCL (Nara) software1 95.67 UALING (Tucson) software1 95.67 Koç University (İstanbul) software3 95.67 BASELINE UDPipe 1.1 (Praha) software2 95.67 C2L2 (Ithaca) software5 95.67 Mengest (Shanghai) software1 95.67 28. OpenU NLP Lab (Ra'anana) software6 89.45 29. TRL (Tokyo) software1 87.71 30. MetaRomance (Santiago de Compostela) software1 50.28 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
hsb
1. Wanghao-ftd-SJTU (Shanghai) software2 90.30 ParisNLP (Paris) software1 90.30 darc (Tübingen) software1 90.30 IIT Kharagpur (Kharagpur) software3 90.30 NAIST SATO (Nara) software1 90.30 Orange – Deskiñ (Lannion) software1 90.30 UParse (Edinburgh) software1 90.30 LIMSI-LIPN (Paris) software2 90.30 LyS-FASTPARSE (A Coruña) software5 90.30 TurkuNLP (Turku) software1 90.30 LATTICE (Paris) software7 90.30 naistCL (Nara) software1 90.30 UALING (Tucson) software1 90.30 Koç University (İstanbul) software3 90.30 BASELINE UDPipe 1.1 (Praha) software2 90.30 ÚFAL – UDPipe 1.2 (Praha) software1 90.30 Stanford (Stanford) software1 90.30 C2L2 (Ithaca) software5 90.30 HIT-SCIR (Harbin) software4 90.30 RACAI (București) software1 90.30 Mengest (Shanghai) software1 90.30 OpenU NLP Lab (Ra'anana) software6 90.30 CLCL (Genève) software2 90.30 IMS (Stuttgart) software2 90.30 25. fbaml (Palo Alto) software1 63.89 26. TRL (Tokyo) software1 61.48 27. MQuni (Sydney) software2 48.90 28. MetaRomance (Santiago de Compostela) software1 44.07 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
hu
1. Stanford (Stanford) software1 95.34 2. IMS (Stuttgart) software2 92.63 fbaml (Palo Alto) software1 92.63 4. ParisNLP (Paris) software1 92.19 5. UT (Tartu) software1 91.93 6. MQuni (Sydney) software2 91.72 7. TurkuNLP (Turku) software1 90.95 8. Wenba-NLU (Wuhan) software1 90.80 IIT Kharagpur (Kharagpur) software3 90.80 CLCL (Genève) software1 90.80 NAIST SATO (Nara) software1 90.80 Orange – Deskiñ (Lannion) software1 90.80 UParse (Edinburgh) software1 90.80 LIMSI-LIPN (Paris) software2 90.80 LyS-FASTPARSE (A Coruña) software5 90.80 LATTICE (Paris) software7 90.80 naistCL (Nara) software1 90.80 UALING (Tucson) software1 90.80 Koç University (İstanbul) software3 90.80 BASELINE UDPipe 1.1 (Praha) software2 90.80 ÚFAL – UDPipe 1.2 (Praha) software1 90.80 C2L2 (Ithaca) software5 90.80 Mengest (Shanghai) software1 90.80 24. Wanghao-ftd-SJTU (Shanghai) software2 90.60 25. RACAI (București) software1 90.52 26. darc (Tübingen) software1 90.37 27. HIT-SCIR (Harbin) software4 88.61 28. TRL (Tokyo) software1 78.98 29. OpenU NLP Lab (Ra'anana) software6 77.31 30. MetaRomance (Santiago de Compostela) software1 48.00 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
id
1. Stanford (Stanford) software1 94.09 2. ParisNLP (Paris) software1 93.59 3. UT (Tartu) software1 93.52 4. ÚFAL – UDPipe 1.2 (Praha) software1 93.43 5. IMS (Stuttgart) software2 93.42 6. fbaml (Palo Alto) software1 93.41 7. Wanghao-ftd-SJTU (Shanghai) software2 93.37 8. darc (Tübingen) software1 93.36 9. Wenba-NLU (Wuhan) software1 93.32 IIT Kharagpur (Kharagpur) software3 93.32 NAIST SATO (Nara) software1 93.32 Orange – Deskiñ (Lannion) software1 93.32 UParse (Edinburgh) software1 93.32 LIMSI-LIPN (Paris) software2 93.32 LyS-FASTPARSE (A Coruña) software5 93.32 LATTICE (Paris) software7 93.32 naistCL (Nara) software1 93.32 UALING (Tucson) software1 93.32 Koç University (İstanbul) software3 93.32 BASELINE UDPipe 1.1 (Praha) software2 93.32 C2L2 (Ithaca) software5 93.32 Mengest (Shanghai) software1 93.32 CLCL (Genève) software2 93.32 24. TurkuNLP (Turku) software1 93.23 25. MQuni (Sydney) software2 93.13 26. RACAI (București) software1 92.71 27. TRL (Tokyo) software1 90.54 28. HIT-SCIR (Harbin) software4 90.41 29. OpenU NLP Lab (Ra'anana) software6 88.98 30. MetaRomance (Santiago de Compostela) software1 38.72 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
it
1. Stanford (Stanford) software1 98.04 2. IMS (Stuttgart) software2 97.43 3. ParisNLP (Paris) software1 97.38 4. MQuni (Sydney) software2 97.35 5. ÚFAL – UDPipe 1.2 (Praha) software1 97.31 6. fbaml (Palo Alto) software1 97.29 7. Wanghao-ftd-SJTU (Shanghai) software2 97.16 8. Wenba-NLU (Wuhan) software1 97.07 IIT Kharagpur (Kharagpur) software3 97.07 NAIST SATO (Nara) software1 97.07 Orange – Deskiñ (Lannion) software1 97.07 UParse (Edinburgh) software1 97.07 LIMSI-LIPN (Paris) software2 97.07 LyS-FASTPARSE (A Coruña) software5 97.07 LATTICE (Paris) software7 97.07 naistCL (Nara) software1 97.07 UALING (Tucson) software1 97.07 Koç University (İstanbul) software3 97.07 BASELINE UDPipe 1.1 (Praha) software2 97.07 C2L2 (Ithaca) software5 97.07 Mengest (Shanghai) software1 97.07 CLCL (Genève) software2 97.07 23. TurkuNLP (Turku) software1 97.00 24. darc (Tübingen) software1 96.99 25. HIT-SCIR (Harbin) software4 96.56 RACAI (București) software1 96.56 27. OpenU NLP Lab (Ra'anana) software6 94.52 28. TRL (Tokyo) software1 77.66 29. MetaRomance (Santiago de Compostela) software1 38.49 30. METU (Ankara) software2 0.05 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
it_pud
1. Stanford (Stanford) software1 93.74 2. IMS (Stuttgart) software2 93.22 3. Wanghao-ftd-SJTU (Shanghai) software2 93.20 4. fbaml (Palo Alto) software1 93.19 5. ÚFAL – UDPipe 1.2 (Praha) software1 93.10 6. ParisNLP (Paris) software1 93.08 7. darc (Tübingen) software1 93.07 IIT Kharagpur (Kharagpur) software3 93.07 CLCL (Genève) software1 93.07 NAIST SATO (Nara) software1 93.07 Orange – Deskiñ (Lannion) software1 93.07 UParse (Edinburgh) software1 93.07 LIMSI-LIPN (Paris) software2 93.07 LyS-FASTPARSE (A Coruña) software5 93.07 LATTICE (Paris) software7 93.07 naistCL (Nara) software1 93.07 UALING (Tucson) software1 93.07 Koç University (İstanbul) software3 93.07 BASELINE UDPipe 1.1 (Praha) software2 93.07 C2L2 (Ithaca) software5 93.07 Mengest (Shanghai) software1 93.07 22. TurkuNLP (Turku) software1 93.05 23. MQuni (Sydney) software2 93.03 24. RACAI (București) software1 92.50 25. HIT-SCIR (Harbin) software4 91.10 26. OpenU NLP Lab (Ra'anana) software6 88.38 27. TRL (Tokyo) software1 73.72 28. MetaRomance (Santiago de Compostela) software1 36.58 29. METU (Ankara) software2 0.10 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
ja
1. TRL (Tokyo) software1 98.45 2. LIMSI-LIPN (Paris) software2 91.12 3. fbaml (Palo Alto) software1 91.04 4. HIT-SCIR (Harbin) software4 90.58 5. ParisNLP (Paris) software1 90.00 6. IMS (Stuttgart) software2 89.07 7. ÚFAL – UDPipe 1.2 (Praha) software1 88.19 8. Stanford (Stanford) software1 88.14 9. darc (Tübingen) software1 87.15 TurkuNLP (Turku) software1 87.15 11. Wenba-NLU (Wuhan) software1 87.08 IIT Kharagpur (Kharagpur) software3 87.08 NAIST SATO (Nara) software1 87.08 Orange – Deskiñ (Lannion) software1 87.08 UParse (Edinburgh) software1 87.08 LyS-FASTPARSE (A Coruña) software5 87.08 LATTICE (Paris) software7 87.08 naistCL (Nara) software1 87.08 UALING (Tucson) software1 87.08 Koç University (İstanbul) software3 87.08 BASELINE UDPipe 1.1 (Praha) software2 87.08 C2L2 (Ithaca) software5 87.08 Mengest (Shanghai) software1 87.08 CLCL (Genève) software2 87.08 25. MQuni (Sydney) software2 87.02 26. UT (Tartu) software1 86.96 27. Wanghao-ftd-SJTU (Shanghai) software2 86.94 28. OpenU NLP Lab (Ra'anana) software6 85.20 29. RACAI (București) software1 84.82 30. MetaRomance (Santiago de Compostela) software1 44.13 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
ja_pud
1. LIMSI-LIPN (Paris) software2 92.46 2. HIT-SCIR (Harbin) software4 91.76 3. fbaml (Palo Alto) software1 91.70 4. TRL (Tokyo) software1 91.31 5. IMS (Stuttgart) software2 91.07 6. ÚFAL – UDPipe 1.2 (Praha) software1 90.02 7. Stanford (Stanford) software1 89.41 8. Wanghao-ftd-SJTU (Shanghai) software2 88.84 9. darc (Tübingen) software1 88.69 IIT Kharagpur (Kharagpur) software3 88.69 CLCL (Genève) software1 88.69 NAIST SATO (Nara) software1 88.69 Orange – Deskiñ (Lannion) software1 88.69 UParse (Edinburgh) software1 88.69 LyS-FASTPARSE (A Coruña) software5 88.69 TurkuNLP (Turku) software1 88.69 LATTICE (Paris) software7 88.69 naistCL (Nara) software1 88.69 UALING (Tucson) software1 88.69 Koç University (İstanbul) software3 88.69 BASELINE UDPipe 1.1 (Praha) software2 88.69 C2L2 (Ithaca) software5 88.69 Mengest (Shanghai) software1 88.69 24. MQuni (Sydney) software2 88.68 25. ParisNLP (Paris) software1 88.49 26. UT (Tartu) software1 88.48 27. RACAI (București) software1 87.78 28. OpenU NLP Lab (Ra'anana) software6 85.75 29. MetaRomance (Santiago de Compostela) software1 42.67 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
kk
1. ParisNLP (Paris) software1 67.86 2. IMS (Stuttgart) software2 58.48 3. Stanford (Stanford) software1 57.36 4. fbaml (Palo Alto) software1 56.76 5. RACAI (București) software1 56.49 6. TRL (Tokyo) software1 56.39 7. HIT-SCIR (Harbin) software4 55.94 8. Wanghao-ftd-SJTU (Shanghai) software2 55.72 9. TurkuNLP (Turku) software1 55.47 10. ÚFAL – UDPipe 1.2 (Praha) software1 50.69 11. darc (Tübingen) software1 50.08 12. IIT Kharagpur (Kharagpur) software3 50.06 NAIST SATO (Nara) software1 50.06 Orange – Deskiñ (Lannion) software1 50.06 UParse (Edinburgh) software1 50.06 LIMSI-LIPN (Paris) software2 50.06 LyS-FASTPARSE (A Coruña) software5 50.06 LATTICE (Paris) software7 50.06 naistCL (Nara) software1 50.06 UALING (Tucson) software1 50.06 Koç University (İstanbul) software3 50.06 C2L2 (Ithaca) software5 50.06 CLCL (Genève) software2 50.06 24. BASELINE UDPipe 1.1 (Praha) software2 50.01 25. MQuni (Sydney) software2 47.20 26. OpenU NLP Lab (Ra'anana) software6 43.34 27. MetaRomance (Santiago de Compostela) software1 28.85 28. Wenba-NLU (Wuhan) software1 0.00 29. ECNU (Shanghai) software1 0.00 30. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00 Mengest (Shanghai) software1 0.00
kmr
1. Wanghao-ftd-SJTU (Shanghai) software2 90.04 ParisNLP (Paris) software1 90.04 darc (Tübingen) software1 90.04 IIT Kharagpur (Kharagpur) software3 90.04 NAIST SATO (Nara) software1 90.04 Orange – Deskiñ (Lannion) software1 90.04 UParse (Edinburgh) software1 90.04 LIMSI-LIPN (Paris) software2 90.04 LyS-FASTPARSE (A Coruña) software5 90.04 TurkuNLP (Turku) software1 90.04 LATTICE (Paris) software7 90.04 naistCL (Nara) software1 90.04 UALING (Tucson) software1 90.04 Koç University (İstanbul) software3 90.04 BASELINE UDPipe 1.1 (Praha) software2 90.04 ÚFAL – UDPipe 1.2 (Praha) software1 90.04 Stanford (Stanford) software1 90.04 C2L2 (Ithaca) software5 90.04 HIT-SCIR (Harbin) software4 90.04 RACAI (București) software1 90.04 Mengest (Shanghai) software1 90.04 OpenU NLP Lab (Ra'anana) software6 90.04 CLCL (Genève) software2 90.04 IMS (Stuttgart) software2 90.04 25. fbaml (Palo Alto) software1 58.03 26. MQuni (Sydney) software2 48.45 27. MetaRomance (Santiago de Compostela) software1 39.78 28. TRL (Tokyo) software1 35.55 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
ko
1. Stanford (Stanford) software1 96.14 2. HIT-SCIR (Harbin) software4 94.69 3. ÚFAL – UDPipe 1.2 (Praha) software1 94.22 4. Wanghao-ftd-SJTU (Shanghai) software2 94.10 5. TurkuNLP (Turku) software1 93.86 6. darc (Tübingen) software1 93.85 7. ParisNLP (Paris) software1 93.79 IIT Kharagpur (Kharagpur) software3 93.79 NAIST SATO (Nara) software1 93.79 Orange – Deskiñ (Lannion) software1 93.79 UParse (Edinburgh) software1 93.79 LIMSI-LIPN (Paris) software2 93.79 LyS-FASTPARSE (A Coruña) software5 93.79 LATTICE (Paris) software7 93.79 naistCL (Nara) software1 93.79 UALING (Tucson) software1 93.79 Koç University (İstanbul) software3 93.79 BASELINE UDPipe 1.1 (Praha) software2 93.79 C2L2 (Ithaca) software5 93.79 Mengest (Shanghai) software1 93.79 CLCL (Genève) software2 93.79 22. UT (Tartu) software1 93.78 23. IMS (Stuttgart) software2 93.74 24. MQuni (Sydney) software2 93.12 25. fbaml (Palo Alto) software1 92.51 26. RACAI (București) software1 91.21 27. OpenU NLP Lab (Ra'anana) software6 81.90 28. MetaRomance (Santiago de Compostela) software1 81.82 29. TRL (Tokyo) software1 76.56 30. METU (Ankara) software2 56.51 31. Wenba-NLU (Wuhan) software1 0.00 32. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00
la
1. Stanford (Stanford) software1 90.67 2. fbaml (Palo Alto) software1 88.57 3. RACAI (București) software1 84.58 4. HIT-SCIR (Harbin) software4 84.41 IMS (Stuttgart) software2 84.41 6. Wanghao-ftd-SJTU (Shanghai) software2 83.91 7. TurkuNLP (Turku) software1 83.90 8. UT (Tartu) software1 83.89 9. darc (Tübingen) software1 83.70 10. ÚFAL – UDPipe 1.2 (Praha) software1 83.66 11. ParisNLP (Paris) software1 83.39 IIT Kharagpur (Kharagpur) software3 83.39 NAIST SATO (Nara) software1 83.39 Orange – Deskiñ (Lannion) software1 83.39 UParse (Edinburgh) software1 83.39 LIMSI-LIPN (Paris) software2 83.39 LyS-FASTPARSE (A Coruña) software5 83.39 LATTICE (Paris) software7 83.39 naistCL (Nara) software1 83.39 UALING (Tucson) software1 83.39 Koç University (İstanbul) software3 83.39 BASELINE UDPipe 1.1 (Praha) software2 83.39 C2L2 (Ithaca) software5 83.39 Mengest (Shanghai) software1 83.39 CLCL (Genève) software2 83.39 26. MQuni (Sydney) software2 83.25 27. TRL (Tokyo) software1 73.24 28. OpenU NLP Lab (Ra'anana) software6 68.33 29. MetaRomance (Santiago de Compostela) software1 49.01 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
la_ittb
1. Stanford (Stanford) software1 98.36 2. fbaml (Palo Alto) software1 97.49 3. MQuni (Sydney) software2 97.47 4. HIT-SCIR (Harbin) software4 97.45 5. IMS (Stuttgart) software2 97.41 6. ParisNLP (Paris) software1 97.39 7. Wanghao-ftd-SJTU (Shanghai) software2 97.28 8. TurkuNLP (Turku) software1 97.27 9. IIT Kharagpur (Kharagpur) software3 97.21 CLCL (Genève) software1 97.21 NAIST SATO (Nara) software1 97.21 Orange – Deskiñ (Lannion) software1 97.21 UParse (Edinburgh) software1 97.21 LIMSI-LIPN (Paris) software2 97.21 LyS-FASTPARSE (A Coruña) software5 97.21 LATTICE (Paris) software7 97.21 naistCL (Nara) software1 97.21 UALING (Tucson) software1 97.21 Koç University (İstanbul) software3 97.21 BASELINE UDPipe 1.1 (Praha) software2 97.21 C2L2 (Ithaca) software5 97.21 Mengest (Shanghai) software1 97.21 23. darc (Tübingen) software1 97.16 24. ÚFAL – UDPipe 1.2 (Praha) software1 96.83 25. RACAI (București) software1 96.68 26. OpenU NLP Lab (Ra'anana) software6 93.65 27. TRL (Tokyo) software1 91.33 28. UT (Tartu) software1 72.98 29. MetaRomance (Santiago de Compostela) software1 46.04 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
la_proiel
1. Stanford (Stanford) software1 96.72 2. fbaml (Palo Alto) software1 95.75 3. IMS (Stuttgart) software2 95.63 4. Wanghao-ftd-SJTU (Shanghai) software2 95.18 5. TurkuNLP (Turku) software1 95.17 6. darc (Tübingen) software1 95.05 7. ÚFAL – UDPipe 1.2 (Praha) software1 95.00 8. Wenba-NLU (Wuhan) software1 94.82 ParisNLP (Paris) software1 94.82 IIT Kharagpur (Kharagpur) software3 94.82 CLCL (Genève) software1 94.82 NAIST SATO (Nara) software1 94.82 Orange – Deskiñ (Lannion) software1 94.82 UParse (Edinburgh) software1 94.82 LIMSI-LIPN (Paris) software2 94.82 LyS-FASTPARSE (A Coruña) software5 94.82 LATTICE (Paris) software7 94.82 naistCL (Nara) software1 94.82 UALING (Tucson) software1 94.82 Koç University (İstanbul) software3 94.82 BASELINE UDPipe 1.1 (Praha) software2 94.82 C2L2 (Ithaca) software5 94.82 Mengest (Shanghai) software1 94.82 24. HIT-SCIR (Harbin) software4 94.75 25. MQuni (Sydney) software2 93.78 26. RACAI (București) software1 93.73 27. OpenU NLP Lab (Ra'anana) software6 87.32 28. TRL (Tokyo) software1 85.27 29. MetaRomance (Santiago de Compostela) software1 57.60 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
lv
1. Stanford (Stanford) software1 93.59 2. ParisNLP (Paris) software1 91.10 3. fbaml (Palo Alto) software1 90.09 4. IMS (Stuttgart) software2 89.72 5. MQuni (Sydney) software2 89.46 6. HIT-SCIR (Harbin) software4 88.99 7. RACAI (București) software1 88.62 8. darc (Tübingen) software1 88.55 9. UT (Tartu) software1 88.43 10. ÚFAL – UDPipe 1.2 (Praha) software1 88.40 11. Wenba-NLU (Wuhan) software1 88.37 IIT Kharagpur (Kharagpur) software3 88.37 CLCL (Genève) software1 88.37 NAIST SATO (Nara) software1 88.37 Orange – Deskiñ (Lannion) software1 88.37 UParse (Edinburgh) software1 88.37 LIMSI-LIPN (Paris) software2 88.37 LyS-FASTPARSE (A Coruña) software5 88.37 LATTICE (Paris) software7 88.37 naistCL (Nara) software1 88.37 UALING (Tucson) software1 88.37 Koç University (İstanbul) software3 88.37 BASELINE UDPipe 1.1 (Praha) software2 88.37 C2L2 (Ithaca) software5 88.37 Mengest (Shanghai) software1 88.37 26. TurkuNLP (Turku) software1 88.33 27. Wanghao-ftd-SJTU (Shanghai) software2 88.27 28. OpenU NLP Lab (Ra'anana) software6 80.84 29. TRL (Tokyo) software1 78.66 30. MetaRomance (Santiago de Compostela) software1 47.71 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
nl
1. Stanford (Stanford) software1 93.24 2. fbaml (Palo Alto) software1 92.04 3. ParisNLP (Paris) software1 91.57 4. TurkuNLP (Turku) software1 91.50 5. UT (Tartu) software1 91.42 6. Wanghao-ftd-SJTU (Shanghai) software2 91.38 IMS (Stuttgart) software2 91.38 8. ÚFAL – UDPipe 1.2 (Praha) software1 91.33 9. RACAI (București) software1 91.19 10. HIT-SCIR (Harbin) software4 91.18 11. Wenba-NLU (Wuhan) software1 91.00 IIT Kharagpur (Kharagpur) software3 91.00 CLCL (Genève) software1 91.00 NAIST SATO (Nara) software1 91.00 Orange – Deskiñ (Lannion) software1 91.00 UParse (Edinburgh) software1 91.00 LIMSI-LIPN (Paris) software2 91.00 LyS-FASTPARSE (A Coruña) software5 91.00 LATTICE (Paris) software7 91.00 naistCL (Nara) software1 91.00 UALING (Tucson) software1 91.00 Koç University (İstanbul) software3 91.00 BASELINE UDPipe 1.1 (Praha) software2 91.00 C2L2 (Ithaca) software5 91.00 Mengest (Shanghai) software1 91.00 26. darc (Tübingen) software1 90.78 27. MQuni (Sydney) software2 90.67 28. OpenU NLP Lab (Ra'anana) software6 80.03 29. TRL (Tokyo) software1 78.53 30. MetaRomance (Santiago de Compostela) software1 40.15 31. METU (Ankara) software2 2.78 32. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00
nl_lassysmall
1. Stanford (Stanford) software1 98.39 2. ParisNLP (Paris) software1 97.84 3. fbaml (Palo Alto) software1 97.74 4. IMS (Stuttgart) software2 97.61 5. TurkuNLP (Turku) software1 97.57 6. darc (Tübingen) software1 97.48 7. ÚFAL – UDPipe 1.2 (Praha) software1 97.43 8. Wanghao-ftd-SJTU (Shanghai) software2 97.37 9. RACAI (București) software1 96.88 10. Wenba-NLU (Wuhan) software1 96.86 IIT Kharagpur (Kharagpur) software3 96.86 CLCL (Genève) software1 96.86 NAIST SATO (Nara) software1 96.86 Orange – Deskiñ (Lannion) software1 96.86 UParse (Edinburgh) software1 96.86 LIMSI-LIPN (Paris) software2 96.86 LyS-FASTPARSE (A Coruña) software5 96.86 LATTICE (Paris) software7 96.86 naistCL (Nara) software1 96.86 UALING (Tucson) software1 96.86 Koç University (İstanbul) software3 96.86 BASELINE UDPipe 1.1 (Praha) software2 96.86 C2L2 (Ithaca) software5 96.86 Mengest (Shanghai) software1 96.86 25. HIT-SCIR (Harbin) software4 96.26 26. MQuni (Sydney) software2 95.64 27. OpenU NLP Lab (Ra'anana) software6 95.09 28. UT (Tartu) software1 85.12 29. TRL (Tokyo) software1 75.54 30. MetaRomance (Santiago de Compostela) software1 35.42 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00
no_bokmaal
1. Stanford (Stanford) software1 98.35 2. MQuni (Sydney) software2 97.14 3. IMS (Stuttgart) software2 97.12 4. TurkuNLP (Turku) software1 96.85 5. ÚFAL – UDPipe 1.2 (Praha) software1 96.83 6. Wanghao-ftd-SJTU (Shanghai) software2 96.75 Wenba-NLU (Wuhan) software1 96.75 ParisNLP (Paris) software1 96.75 IIT Kharagpur (Kharagpur) software3 96.75 CLCL (Genève) software1 96.75 NAIST SATO (Nara) software1 96.75 Orange – Deskiñ (Lannion) software1 96.75 UParse (Edinburgh) software1 96.75 LIMSI-LIPN (Paris) software2 96.75 LyS-FASTPARSE (A Coruña) software5 96.75 LATTICE (Paris) software7 96.75 naistCL (Nara) software1 96.75 UALING (Tucson) software1 96.75 Koç University (İstanbul) software3 96.75 BASELINE UDPipe 1.1 (Praha) software2 96.75 C2L2 (Ithaca) software5 96.75 Mengest (Shanghai) software1 96.75 23. darc (Tübingen) software1 96.72 24. fbaml (Palo Alto) software1 96.64 25. HIT-SCIR (Harbin) software4 96.27 26. RACAI (București) software1 96.04 27. OpenU NLP Lab (Ra'anana) software6 93.40 28. TRL (Tokyo) software1 87.63 29. MetaRomance (Santiago de Compostela) software1 42.77 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
no_nynorsk
1. Stanford (Stanford) software1 98.11 2. MQuni (Sydney) software2 96.80 IMS (Stuttgart) software2 96.80 4. ÚFAL – UDPipe 1.2 (Praha) software1 96.54 5. Wanghao-ftd-SJTU (Shanghai) software2 96.53 6. darc (Tübingen) software1 96.43 7. Wenba-NLU (Wuhan) software1 96.38 ParisNLP (Paris) software1 96.38 IIT Kharagpur (Kharagpur) software3 96.38 CLCL (Genève) software1 96.38 NAIST SATO (Nara) software1 96.38 Orange – Deskiñ (Lannion) software1 96.38 UParse (Edinburgh) software1 96.38 LIMSI-LIPN (Paris) software2 96.38 LyS-FASTPARSE (A Coruña) software5 96.38 LATTICE (Paris) software7 96.38 naistCL (Nara) software1 96.38 UALING (Tucson) software1 96.38 Koç University (İstanbul) software3 96.38 BASELINE UDPipe 1.1 (Praha) software2 96.38 C2L2 (Ithaca) software5 96.38 Mengest (Shanghai) software1 96.38 23. TurkuNLP (Turku) software1 96.36 24. HIT-SCIR (Harbin) software4 96.29 25. RACAI (București) software1 95.51 26. OpenU NLP Lab (Ra'anana) software6 92.69 27. TRL (Tokyo) software1 86.43 28. MetaRomance (Santiago de Compostela) software1 44.58 29. fbaml (Palo Alto) software1 28.19 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
pl
1. Stanford (Stanford) software1 98.15 2. ParisNLP (Paris) software1 96.95 3. IMS (Stuttgart) software2 96.35 4. MQuni (Sydney) software2 96.00 5. fbaml (Palo Alto) software1 95.66 6. RACAI (București) software1 95.45 7. ÚFAL – UDPipe 1.2 (Praha) software1 95.43 8. TurkuNLP (Turku) software1 95.41 9. darc (Tübingen) software1 95.39 10. Wenba-NLU (Wuhan) software1 95.31 IIT Kharagpur (Kharagpur) software3 95.31 CLCL (Genève) software1 95.31 NAIST SATO (Nara) software1 95.31 Orange – Deskiñ (Lannion) software1 95.31 UParse (Edinburgh) software1 95.31 LIMSI-LIPN (Paris) software2 95.31 LyS-FASTPARSE (A Coruña) software5 95.31 LATTICE (Paris) software7 95.31 naistCL (Nara) software1 95.31 UALING (Tucson) software1 95.31 Koç University (İstanbul) software3 95.31 BASELINE UDPipe 1.1 (Praha) software2 95.31 C2L2 (Ithaca) software5 95.31 Mengest (Shanghai) software1 95.31 25. Wanghao-ftd-SJTU (Shanghai) software2 95.26 26. HIT-SCIR (Harbin) software4 94.61 27. TRL (Tokyo) software1 89.14 28. OpenU NLP Lab (Ra'anana) software6 86.81 29. MetaRomance (Santiago de Compostela) software1 53.11 30. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
pt
1. Stanford (Stanford) software1 97.24 2. IMS (Stuttgart) software2 96.58 3. fbaml (Palo Alto) software1 96.51 4. TurkuNLP (Turku) software1 96.36 5. ÚFAL – UDPipe 1.2 (Praha) software1 96.30 6. Wenba-NLU (Wuhan) software1 96.22 ParisNLP (Paris) software1 96.22 IIT Kharagpur (Kharagpur) software3 96.22 CLCL (Genève) software1 96.22 NAIST SATO (Nara) software1 96.22 Orange – Deskiñ (Lannion) software1 96.22 UParse (Edinburgh) software1 96.22 LIMSI-LIPN (Paris) software2 96.22 LyS-FASTPARSE (A Coruña) software5 96.22 LATTICE (Paris) software7 96.22 naistCL (Nara) software1 96.22 UALING (Tucson) software1 96.22 Koç University (İstanbul) software3 96.22 BASELINE UDPipe 1.1 (Praha) software2 96.22 C2L2 (Ithaca) software5 96.22 Mengest (Shanghai) software1 96.22 22. darc (Tübingen) software1 96.21 23. MQuni (Sydney) software2 96.13 24. RACAI (București) software1 96.01 25. HIT-SCIR (Harbin) software4 95.40 26. Wanghao-ftd-SJTU (Shanghai) software2 95.30 27. OpenU NLP Lab (Ra'anana) software6 88.46 28. TRL (Tokyo) software1 71.60 29. MetaRomance (Santiago de Compostela) software1 36.14 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
pt_br
1. Stanford (Stanford) software1 98.22 2. ParisNLP (Paris) software1 97.54 3. MQuni (Sydney) software2 97.48 4. fbaml (Palo Alto) software1 97.42 5. IMS (Stuttgart) software2 97.36 6. TurkuNLP (Turku) software1 97.07 ÚFAL – UDPipe 1.2 (Praha) software1 97.07 8. Wanghao-ftd-SJTU (Shanghai) software2 97.05 9. darc (Tübingen) software1 97.03 10. Wenba-NLU (Wuhan) software1 96.97 IIT Kharagpur (Kharagpur) software3 96.97 CLCL (Genève) software1 96.97 NAIST SATO (Nara) software1 96.97 Orange – Deskiñ (Lannion) software1 96.97 UParse (Edinburgh) software1 96.97 LIMSI-LIPN (Paris) software2 96.97 LyS-FASTPARSE (A Coruña) software5 96.97 LATTICE (Paris) software7 96.97 naistCL (Nara) software1 96.97 UALING (Tucson) software1 96.97 Koç University (İstanbul) software3 96.97 BASELINE UDPipe 1.1 (Praha) software2 96.97 C2L2 (Ithaca) software5 96.97 Mengest (Shanghai) software1 96.97 25. RACAI (București) software1 96.81 26. HIT-SCIR (Harbin) software4 95.45 27. OpenU NLP Lab (Ra'anana) software6 94.44 28. METU (Ankara) software2 70.31 29. TRL (Tokyo) software1 70.12 30. MetaRomance (Santiago de Compostela) software1 34.38 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
pt_pud
1. Stanford (Stanford) software1 88.99 2. ParisNLP (Paris) software1 88.88 3. darc (Tübingen) software1 88.45 IIT Kharagpur (Kharagpur) software3 88.45 CLCL (Genève) software1 88.45 NAIST SATO (Nara) software1 88.45 Orange – Deskiñ (Lannion) software1 88.45 UParse (Edinburgh) software1 88.45 LIMSI-LIPN (Paris) software2 88.45 LyS-FASTPARSE (A Coruña) software5 88.45 LATTICE (Paris) software7 88.45 naistCL (Nara) software1 88.45 UALING (Tucson) software1 88.45 Koç University (İstanbul) software3 88.45 BASELINE UDPipe 1.1 (Praha) software2 88.45 ÚFAL – UDPipe 1.2 (Praha) software1 88.45 C2L2 (Ithaca) software5 88.45 Mengest (Shanghai) software1 88.45 19. TurkuNLP (Turku) software1 88.43 20. IMS (Stuttgart) software2 88.36 21. MQuni (Sydney) software2 88.20 22. RACAI (București) software1 88.12 23. fbaml (Palo Alto) software1 88.00 24. Wanghao-ftd-SJTU (Shanghai) software2 87.98 25. HIT-SCIR (Harbin) software4 86.30 26. OpenU NLP Lab (Ra'anana) software6 82.18 27. TRL (Tokyo) software1 71.70 28. MetaRomance (Santiago de Compostela) software1 37.87 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
ro
1. Stanford (Stanford) software1 97.59 2. IMS (Stuttgart) software2 96.86 3. Wanghao-ftd-SJTU (Shanghai) software2 96.71 TurkuNLP (Turku) software1 96.71 fbaml (Palo Alto) software1 96.71 6. UT (Tartu) software1 96.68 7. darc (Tübingen) software1 96.63 8. ÚFAL – UDPipe 1.2 (Praha) software1 96.62 9. HIT-SCIR (Harbin) software4 96.60 10. ParisNLP (Paris) software1 96.40 IIT Kharagpur (Kharagpur) software3 96.40 CLCL (Genève) software1 96.40 NAIST SATO (Nara) software1 96.40 Orange – Deskiñ (Lannion) software1 96.40 UParse (Edinburgh) software1 96.40 LIMSI-LIPN (Paris) software2 96.40 MQuni (Sydney) software2 96.40 LyS-FASTPARSE (A Coruña) software5 96.40 LATTICE (Paris) software7 96.40 naistCL (Nara) software1 96.40 UALING (Tucson) software1 96.40 Koç University (İstanbul) software3 96.40 BASELINE UDPipe 1.1 (Praha) software2 96.40 C2L2 (Ithaca) software5 96.40 Mengest (Shanghai) software1 96.40 26. RACAI (București) software1 96.02 27. OpenU NLP Lab (Ra'anana) software6 93.86 28. TRL (Tokyo) software1 87.64 29. MetaRomance (Santiago de Compostela) software1 47.49 30. METU (Ankara) software2 0.01 31. Wenba-NLU (Wuhan) software1 0.00 32. ECNU (Shanghai) software1 0.00 33. Uppsala (Uppsala) software1 0.00
ru
1. Stanford (Stanford) software1 96.99 2. ParisNLP (Paris) software1 96.60 3. fbaml (Palo Alto) software1 95.49 4. IMS (Stuttgart) software2 95.45 5. MQuni (Sydney) software2 95.23 6. RACAI (București) software1 95.15 7. darc (Tübingen) software1 94.71 8. ÚFAL – UDPipe 1.2 (Praha) software1 94.69 9. TurkuNLP (Turku) software1 94.56 10. IIT Kharagpur (Kharagpur) software3 94.47 CLCL (Genève) software1 94.47 NAIST SATO (Nara) software1 94.47 Orange – Deskiñ (Lannion) software1 94.47 UParse (Edinburgh) software1 94.47 LIMSI-LIPN (Paris) software2 94.47 LyS-FASTPARSE (A Coruña) software5 94.47 LATTICE (Paris) software7 94.47 naistCL (Nara) software1 94.47 UALING (Tucson) software1 94.47 Koç University (İstanbul) software3 94.47 BASELINE UDPipe 1.1 (Praha) software2 94.47 C2L2 (Ithaca) software5 94.47 Mengest (Shanghai) software1 94.47 24. HIT-SCIR (Harbin) software4 94.08 25. TRL (Tokyo) software1 85.62 26. OpenU NLP Lab (Ra'anana) software6 84.32 27. Wanghao-ftd-SJTU (Shanghai) software2 78.73 28. MetaRomance (Santiago de Compostela) software1 53.51 29. METU (Ankara) software2 0.14 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
ru_pud
1. IMS (Stuttgart) software2 87.19 2. Stanford (Stanford) software1 86.85 3. ParisNLP (Paris) software1 86.66 4. TRL (Tokyo) software1 86.39 5. TurkuNLP (Turku) software1 85.99 6. ÚFAL – UDPipe 1.2 (Praha) software1 85.86 7. darc (Tübingen) software1 85.85 IIT Kharagpur (Kharagpur) software3 85.85 CLCL (Genève) software1 85.85 NAIST SATO (Nara) software1 85.85 Orange – Deskiñ (Lannion) software1 85.85 UParse (Edinburgh) software1 85.85 LIMSI-LIPN (Paris) software2 85.85 LyS-FASTPARSE (A Coruña) software5 85.85 LATTICE (Paris) software7 85.85 naistCL (Nara) software1 85.85 UALING (Tucson) software1 85.85 Koç University (İstanbul) software3 85.85 BASELINE UDPipe 1.1 (Praha) software2 85.85 C2L2 (Ithaca) software5 85.85 Mengest (Shanghai) software1 85.85 22. fbaml (Palo Alto) software1 85.67 23. MQuni (Sydney) software2 85.49 24. RACAI (București) software1 85.33 25. HIT-SCIR (Harbin) software4 84.44 26. OpenU NLP Lab (Ra'anana) software6 75.21 27. Wanghao-ftd-SJTU (Shanghai) software2 71.00 UT (Tartu) software1 71.00 29. MetaRomance (Santiago de Compostela) software1 47.42 30. METU (Ankara) software2 0.01 31. Wenba-NLU (Wuhan) software1 0.00 32. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00
ru_syntagrus
1. Stanford (Stanford) software1 98.59 2. fbaml (Palo Alto) software1 98.20 3. IMS (Stuttgart) software2 98.18 4. ParisNLP (Paris) software1 97.99 IIT Kharagpur (Kharagpur) software3 97.99 CLCL (Genève) software1 97.99 NAIST SATO (Nara) software1 97.99 Orange – Deskiñ (Lannion) software1 97.99 UParse (Edinburgh) software1 97.99 LIMSI-LIPN (Paris) software2 97.99 LyS-FASTPARSE (A Coruña) software5 97.99 LATTICE (Paris) software7 97.99 naistCL (Nara) software1 97.99 UALING (Tucson) software1 97.99 Koç University (İstanbul) software3 97.99 BASELINE UDPipe 1.1 (Praha) software2 97.99 C2L2 (Ithaca) software5 97.99 Mengest (Shanghai) software1 97.99 OpenU NLP Lab (Ra'anana) software6 97.99 20. TurkuNLP (Turku) software1 97.97 21. ÚFAL – UDPipe 1.2 (Praha) software1 97.91 22. Wanghao-ftd-SJTU (Shanghai) software2 97.90 darc (Tübingen) software1 97.90 24. MQuni (Sydney) software2 97.70 RACAI (București) software1 97.70 26. HIT-SCIR (Harbin) software4 94.95 27. TRL (Tokyo) software1 89.44 28. MetaRomance (Santiago de Compostela) software1 52.56 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
sk
1. Stanford (Stanford) software1 96.87 2. ParisNLP (Paris) software1 95.10 3. IMS (Stuttgart) software2 94.60 4. MQuni (Sydney) software2 94.25 5. fbaml (Palo Alto) software1 94.22 6. RACAI (București) software1 94.11 7. ÚFAL – UDPipe 1.2 (Praha) software1 92.85 8. TurkuNLP (Turku) software1 92.80 9. HIT-SCIR (Harbin) software4 92.78 10. darc (Tübingen) software1 92.46 11. Wanghao-ftd-SJTU (Shanghai) software2 92.37 12. Wenba-NLU (Wuhan) software1 92.19 IIT Kharagpur (Kharagpur) software3 92.19 CLCL (Genève) software1 92.19 NAIST SATO (Nara) software1 92.19 Orange – Deskiñ (Lannion) software1 92.19 UParse (Edinburgh) software1 92.19 LIMSI-LIPN (Paris) software2 92.19 LyS-FASTPARSE (A Coruña) software5 92.19 LATTICE (Paris) software7 92.19 naistCL (Nara) software1 92.19 UALING (Tucson) software1 92.19 Koç University (İstanbul) software3 92.19 BASELINE UDPipe 1.1 (Praha) software2 92.19 C2L2 (Ithaca) software5 92.19 Mengest (Shanghai) software1 92.19 27. TRL (Tokyo) software1 81.11 28. OpenU NLP Lab (Ra'anana) software6 77.99 29. MetaRomance (Santiago de Compostela) software1 50.14 30. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
sl
1. Stanford (Stanford) software1 98.63 2. ParisNLP (Paris) software1 97.36 3. fbaml (Palo Alto) software1 96.92 4. IMS (Stuttgart) software2 96.90 5. MQuni (Sydney) software2 96.84 6. TurkuNLP (Turku) software1 96.43 7. HIT-SCIR (Harbin) software4 96.41 8. darc (Tübingen) software1 96.36 9. Wenba-NLU (Wuhan) software1 96.34 IIT Kharagpur (Kharagpur) software3 96.34 CLCL (Genève) software1 96.34 NAIST SATO (Nara) software1 96.34 Orange – Deskiñ (Lannion) software1 96.34 UParse (Edinburgh) software1 96.34 LIMSI-LIPN (Paris) software2 96.34 LyS-FASTPARSE (A Coruña) software5 96.34 LATTICE (Paris) software7 96.34 naistCL (Nara) software1 96.34 UALING (Tucson) software1 96.34 Koç University (İstanbul) software3 96.34 BASELINE UDPipe 1.1 (Praha) software2 96.34 C2L2 (Ithaca) software5 96.34 Mengest (Shanghai) software1 96.34 24. Wanghao-ftd-SJTU (Shanghai) software2 96.27 25. RACAI (București) software1 96.24 26. ÚFAL – UDPipe 1.2 (Praha) software1 96.11 27. OpenU NLP Lab (Ra'anana) software6 89.19 28. TRL (Tokyo) software1 86.89 29. MetaRomance (Santiago de Compostela) software1 48.98 30. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
sl_sst
1. Stanford (Stanford) software1 94.04 2. ÚFAL – UDPipe 1.2 (Praha) software1 91.78 fbaml (Palo Alto) software1 91.78 4. HIT-SCIR (Harbin) software4 91.12 5. IMS (Stuttgart) software2 90.91 6. RACAI (București) software1 89.42 7. Wanghao-ftd-SJTU (Shanghai) software2 89.35 8. TurkuNLP (Turku) software1 88.95 9. ParisNLP (Paris) software1 88.82 IIT Kharagpur (Kharagpur) software3 88.82 CLCL (Genève) software1 88.82 NAIST SATO (Nara) software1 88.82 Orange – Deskiñ (Lannion) software1 88.82 UParse (Edinburgh) software1 88.82 LIMSI-LIPN (Paris) software2 88.82 LyS-FASTPARSE (A Coruña) software5 88.82 LATTICE (Paris) software7 88.82 naistCL (Nara) software1 88.82 UALING (Tucson) software1 88.82 Koç University (İstanbul) software3 88.82 BASELINE UDPipe 1.1 (Praha) software2 88.82 C2L2 (Ithaca) software5 88.82 Mengest (Shanghai) software1 88.82 24. MQuni (Sydney) software2 88.55 25. darc (Tübingen) software1 88.42 26. OpenU NLP Lab (Ra'anana) software6 83.12 27. TRL (Tokyo) software1 77.78 28. MetaRomance (Santiago de Compostela) software1 50.96 29. METU (Ankara) software2 3.72 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
sme
1. Wanghao-ftd-SJTU (Shanghai) software2 86.81 ParisNLP (Paris) software1 86.81 darc (Tübingen) software1 86.81 IIT Kharagpur (Kharagpur) software3 86.81 NAIST SATO (Nara) software1 86.81 Orange – Deskiñ (Lannion) software1 86.81 UParse (Edinburgh) software1 86.81 LIMSI-LIPN (Paris) software2 86.81 LyS-FASTPARSE (A Coruña) software5 86.81 TurkuNLP (Turku) software1 86.81 LATTICE (Paris) software7 86.81 naistCL (Nara) software1 86.81 UALING (Tucson) software1 86.81 Koç University (İstanbul) software3 86.81 BASELINE UDPipe 1.1 (Praha) software2 86.81 ÚFAL – UDPipe 1.2 (Praha) software1 86.81 Stanford (Stanford) software1 86.81 C2L2 (Ithaca) software5 86.81 HIT-SCIR (Harbin) software4 86.81 RACAI (București) software1 86.81 Mengest (Shanghai) software1 86.81 OpenU NLP Lab (Ra'anana) software6 86.81 CLCL (Genève) software2 86.81 IMS (Stuttgart) software2 86.81 25. fbaml (Palo Alto) software1 53.98 26. MetaRomance (Santiago de Compostela) software1 52.40 27. TRL (Tokyo) software1 43.88 28. MQuni (Sydney) software2 31.53 29. METU (Ankara) software2 0.43 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
sv
1. Stanford (Stanford) software1 97.70 2. ParisNLP (Paris) software1 96.74 3. IMS (Stuttgart) software2 96.10 4. fbaml (Palo Alto) software1 96.05 5. MQuni (Sydney) software2 95.87 6. HIT-SCIR (Harbin) software4 95.68 7. darc (Tübingen) software1 95.67 8. ÚFAL – UDPipe 1.2 (Praha) software1 95.66 9. Wanghao-ftd-SJTU (Shanghai) software2 95.64 10. TurkuNLP (Turku) software1 95.53 11. Wenba-NLU (Wuhan) software1 95.41 IIT Kharagpur (Kharagpur) software3 95.41 CLCL (Genève) software1 95.41 NAIST SATO (Nara) software1 95.41 Orange – Deskiñ (Lannion) software1 95.41 UParse (Edinburgh) software1 95.41 LIMSI-LIPN (Paris) software2 95.41 LyS-FASTPARSE (A Coruña) software5 95.41 LATTICE (Paris) software7 95.41 naistCL (Nara) software1 95.41 UALING (Tucson) software1 95.41 Koç University (İstanbul) software3 95.41 BASELINE UDPipe 1.1 (Praha) software2 95.41 C2L2 (Ithaca) software5 95.41 Mengest (Shanghai) software1 95.41 26. RACAI (București) software1 94.63 27. OpenU NLP Lab (Ra'anana) software6 92.22 28. TRL (Tokyo) software1 82.37 29. MetaRomance (Santiago de Compostela) software1 50.47 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
sv_lines
1. Stanford (Stanford) software1 96.74 2. ParisNLP (Paris) software1 95.83 3. fbaml (Palo Alto) software1 94.88 4. MQuni (Sydney) software2 94.65 5. IMS (Stuttgart) software2 94.40 6. darc (Tübingen) software1 94.32 7. HIT-SCIR (Harbin) software4 94.30 8. ÚFAL – UDPipe 1.2 (Praha) software1 94.26 9. TurkuNLP (Turku) software1 94.24 10. Wenba-NLU (Wuhan) software1 94.22 IIT Kharagpur (Kharagpur) software3 94.22 CLCL (Genève) software1 94.22 NAIST SATO (Nara) software1 94.22 Orange – Deskiñ (Lannion) software1 94.22 UParse (Edinburgh) software1 94.22 LIMSI-LIPN (Paris) software2 94.22 LyS-FASTPARSE (A Coruña) software5 94.22 LATTICE (Paris) software7 94.22 naistCL (Nara) software1 94.22 UALING (Tucson) software1 94.22 Koç University (İstanbul) software3 94.22 BASELINE UDPipe 1.1 (Praha) software2 94.22 C2L2 (Ithaca) software5 94.22 Mengest (Shanghai) software1 94.22 25. Wanghao-ftd-SJTU (Shanghai) software2 94.11 26. RACAI (București) software1 93.48 27. OpenU NLP Lab (Ra'anana) software6 91.39 28. TRL (Tokyo) software1 83.09 29. MetaRomance (Santiago de Compostela) software1 44.51 30. METU (Ankara) software2 0.20 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
sv_pud
1. Stanford (Stanford) software1 94.33 2. ParisNLP (Paris) software1 93.43 3. fbaml (Palo Alto) software1 92.54 4. darc (Tübingen) software1 91.16 IIT Kharagpur (Kharagpur) software3 91.16 CLCL (Genève) software1 91.16 NAIST SATO (Nara) software1 91.16 Orange – Deskiñ (Lannion) software1 91.16 UParse (Edinburgh) software1 91.16 LIMSI-LIPN (Paris) software2 91.16 LyS-FASTPARSE (A Coruña) software5 91.16 LATTICE (Paris) software7 91.16 naistCL (Nara) software1 91.16 UALING (Tucson) software1 91.16 Koç University (İstanbul) software3 91.16 BASELINE UDPipe 1.1 (Praha) software2 91.16 ÚFAL – UDPipe 1.2 (Praha) software1 91.16 C2L2 (Ithaca) software5 91.16 Mengest (Shanghai) software1 91.16 20. RACAI (București) software1 90.87 21. TurkuNLP (Turku) software1 90.82 22. Wanghao-ftd-SJTU (Shanghai) software2 90.79 23. MQuni (Sydney) software2 90.75 24. IMS (Stuttgart) software2 90.32 25. HIT-SCIR (Harbin) software4 87.80 26. OpenU NLP Lab (Ra'anana) software6 82.66 27. TRL (Tokyo) software1 80.36 28. MetaRomance (Santiago de Compostela) software1 44.18 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
tr
1. Stanford (Stanford) software1 93.86 2. TurkuNLP (Turku) software1 91.80 3. Wanghao-ftd-SJTU (Shanghai) software2 91.71 4. MQuni (Sydney) software2 91.67 5. darc (Tübingen) software1 91.62 6. IMS (Stuttgart) software2 91.54 7. ÚFAL – UDPipe 1.2 (Praha) software1 91.51 8. HIT-SCIR (Harbin) software4 91.37 9. fbaml (Palo Alto) software1 91.30 10. Wenba-NLU (Wuhan) software1 91.22 ParisNLP (Paris) software1 91.22 IIT Kharagpur (Kharagpur) software3 91.22 CLCL (Genève) software1 91.22 NAIST SATO (Nara) software1 91.22 Orange – Deskiñ (Lannion) software1 91.22 UParse (Edinburgh) software1 91.22 LIMSI-LIPN (Paris) software2 91.22 LyS-FASTPARSE (A Coruña) software5 91.22 LATTICE (Paris) software7 91.22 naistCL (Nara) software1 91.22 UALING (Tucson) software1 91.22 Koç University (İstanbul) software3 91.22 BASELINE UDPipe 1.1 (Praha) software2 91.22 C2L2 (Ithaca) software5 91.22 Mengest (Shanghai) software1 91.22 26. RACAI (București) software1 89.30 27. OpenU NLP Lab (Ra'anana) software6 83.15 28. TRL (Tokyo) software1 77.25 29. ECNU (Shanghai) software1 0.00 30. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 MetaRomance (Santiago de Compostela) software1 0.00 UT (Tartu) software1 0.00
tr_pud
1. Stanford (Stanford) software1 72.73 2. ParisNLP (Paris) software1 72.55 3. IMS (Stuttgart) software2 71.39 4. ÚFAL – UDPipe 1.2 (Praha) software1 71.38 5. darc (Tübingen) software1 71.04 IIT Kharagpur (Kharagpur) software3 71.04 CLCL (Genève) software1 71.04 NAIST SATO (Nara) software1 71.04 Orange – Deskiñ (Lannion) software1 71.04 UParse (Edinburgh) software1 71.04 LIMSI-LIPN (Paris) software2 71.04 LyS-FASTPARSE (A Coruña) software5 71.04 LATTICE (Paris) software7 71.04 naistCL (Nara) software1 71.04 UALING (Tucson) software1 71.04 Koç University (İstanbul) software3 71.04 C2L2 (Ithaca) software5 71.04 Mengest (Shanghai) software1 71.04 19. BASELINE UDPipe 1.1 (Praha) software2 71.03 20. Wanghao-ftd-SJTU (Shanghai) software2 70.88 21. TurkuNLP (Turku) software1 70.69 22. MQuni (Sydney) software2 70.16 23. fbaml (Palo Alto) software1 68.80 24. HIT-SCIR (Harbin) software4 68.72 25. RACAI (București) software1 68.66 26. TRL (Tokyo) software1 62.02 27. OpenU NLP Lab (Ra'anana) software6 61.51 28. MetaRomance (Santiago de Compostela) software1 42.42 29. Wenba-NLU (Wuhan) software1 0.00 30. ECNU (Shanghai) software1 0.00 31. Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
ug
1. Wanghao-ftd-SJTU (Shanghai) software2 77.05 2. Stanford (Stanford) software1 76.65 3. ÚFAL – UDPipe 1.2 (Praha) software1 76.09 4. HIT-SCIR (Harbin) software4 75.76 5. TurkuNLP (Turku) software1 75.27 6. IMS (Stuttgart) software2 74.96 7. fbaml (Palo Alto) software1 74.76 8. darc (Tübingen) software1 74.74 9. ParisNLP (Paris) software1 74.06 10. IIT Kharagpur (Kharagpur) software3 73.63 CLCL (Genève) software1 73.63 NAIST SATO (Nara) software1 73.63 Orange – Deskiñ (Lannion) software1 73.63 UParse (Edinburgh) software1 73.63 LIMSI-LIPN (Paris) software2 73.63 LyS-FASTPARSE (A Coruña) software5 73.63 LATTICE (Paris) software7 73.63 naistCL (Nara) software1 73.63 UALING (Tucson) software1 73.63 Koç University (İstanbul) software3 73.63 BASELINE UDPipe 1.1 (Praha) software2 73.63 C2L2 (Ithaca) software5 73.63 23. RACAI (București) software1 72.79 24. MQuni (Sydney) software2 71.44 25. OpenU NLP Lab (Ra'anana) software6 66.15 26. TRL (Tokyo) software1 65.27 27. MetaRomance (Santiago de Compostela) software1 54.74 28. Wenba-NLU (Wuhan) software1 0.00 29. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00 Mengest (Shanghai) software1 0.00
uk
1. Stanford (Stanford) software1 94.31 2. ParisNLP (Paris) software1 92.10 3. fbaml (Palo Alto) software1 90.08 4. IMS (Stuttgart) software2 89.68 5. RACAI (București) software1 88.58 6. Wanghao-ftd-SJTU (Shanghai) software2 88.47 7. MQuni (Sydney) software2 87.89 8. TurkuNLP (Turku) software1 87.87 9. HIT-SCIR (Harbin) software4 87.42 10. ÚFAL – UDPipe 1.2 (Praha) software1 87.33 11. darc (Tübingen) software1 87.27 12. IIT Kharagpur (Kharagpur) software3 86.72 CLCL (Genève) software1 86.72 NAIST SATO (Nara) software1 86.72 Orange – Deskiñ (Lannion) software1 86.72 UParse (Edinburgh) software1 86.72 LIMSI-LIPN (Paris) software2 86.72 LyS-FASTPARSE (A Coruña) software5 86.72 LATTICE (Paris) software7 86.72 naistCL (Nara) software1 86.72 UALING (Tucson) software1 86.72 Koç University (İstanbul) software3 86.72 BASELINE UDPipe 1.1 (Praha) software2 86.72 C2L2 (Ithaca) software5 86.72 Mengest (Shanghai) software1 86.72 26. OpenU NLP Lab (Ra'anana) software6 76.26 27. TRL (Tokyo) software1 73.97 28. MetaRomance (Santiago de Compostela) software1 47.28 29. METU (Ankara) software2 0.03 30. Wenba-NLU (Wuhan) software1 0.00 31. ECNU (Shanghai) software1 0.00 32. Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
ur
1. Stanford (Stanford) software1 93.95 2. HIT-SCIR (Harbin) software4 93.36 3. fbaml (Palo Alto) software1 93.17 4. IMS (Stuttgart) software2 92.98 5. MQuni (Sydney) software2 92.96 6. ParisNLP (Paris) software1 92.65 7. TurkuNLP (Turku) software1 92.57 8. ÚFAL – UDPipe 1.2 (Praha) software1 92.13 9. RACAI (București) software1 92.12 10. Wanghao-ftd-SJTU (Shanghai) software2 91.95 11. darc (Tübingen) software1 91.75 12. Wenba-NLU (Wuhan) software1 91.71 IIT Kharagpur (Kharagpur) software3 91.71 CLCL (Genève) software1 91.71 NAIST SATO (Nara) software1 91.71 Orange – Deskiñ (Lannion) software1 91.71 UParse (Edinburgh) software1 91.71 LIMSI-LIPN (Paris) software2 91.71 LyS-FASTPARSE (A Coruña) software5 91.71 LATTICE (Paris) software7 91.71 naistCL (Nara) software1 91.71 UALING (Tucson) software1 91.71 Koç University (İstanbul) software3 91.71 BASELINE UDPipe 1.1 (Praha) software2 91.71 C2L2 (Ithaca) software5 91.71 Mengest (Shanghai) software1 91.71 27. OpenU NLP Lab (Ra'anana) software6 88.56 28. TRL (Tokyo) software1 86.31 29. MetaRomance (Santiago de Compostela) software1 45.25 30. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00
vi
1. IMS (Stuttgart) software2 77.88 2. ParisNLP (Paris) software1 77.64 3. LIMSI-LIPN (Paris) software2 77.49 4. fbaml (Palo Alto) software1 75.84 5. HIT-SCIR (Harbin) software4 75.58 6. ÚFAL – UDPipe 1.2 (Praha) software1 75.29 7. Stanford (Stanford) software1 75.28 8. TRL (Tokyo) software1 74.53 9. Wanghao-ftd-SJTU (Shanghai) software2 74.14 10. darc (Tübingen) software1 74.01 11. Wenba-NLU (Wuhan) software1 73.82 IIT Kharagpur (Kharagpur) software3 73.82 CLCL (Genève) software1 73.82 NAIST SATO (Nara) software1 73.82 Orange – Deskiñ (Lannion) software1 73.82 UParse (Edinburgh) software1 73.82 LyS-FASTPARSE (A Coruña) software5 73.82 LATTICE (Paris) software7 73.82 naistCL (Nara) software1 73.82 UALING (Tucson) software1 73.82 Koç University (İstanbul) software3 73.82 BASELINE UDPipe 1.1 (Praha) software2 73.82 C2L2 (Ithaca) software5 73.82 Mengest (Shanghai) software1 73.82 25. TurkuNLP (Turku) software1 73.75 26. MQuni (Sydney) software2 73.45 27. OpenU NLP Lab (Ra'anana) software6 71.84 28. RACAI (București) software1 71.23 29. MetaRomance (Santiago de Compostela) software1 34.58 30. METU (Ankara) software2 0.05 31. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 UT (Tartu) software1 0.00
zh
1. fbaml (Palo Alto) software1 88.36 2. IMS (Stuttgart) software2 86.33 3. HIT-SCIR (Harbin) software4 85.38 4. Stanford (Stanford) software1 85.26 5. LIMSI-LIPN (Paris) software2 84.58 6. ÚFAL – UDPipe 1.2 (Praha) software1 83.47 7. MQuni (Sydney) software2 83.07 8. darc (Tübingen) software1 83.00 9. RACAI (București) software1 82.81 10. Wanghao-ftd-SJTU (Shanghai) software2 82.75 11. Wenba-NLU (Wuhan) software1 82.69 ParisNLP (Paris) software1 82.69 IIT Kharagpur (Kharagpur) software3 82.69 CLCL (Genève) software1 82.69 NAIST SATO (Nara) software1 82.69 Orange – Deskiñ (Lannion) software1 82.69 UParse (Edinburgh) software1 82.69 LyS-FASTPARSE (A Coruña) software5 82.69 LATTICE (Paris) software7 82.69 naistCL (Nara) software1 82.69 UALING (Tucson) software1 82.69 Koç University (İstanbul) software3 82.69 BASELINE UDPipe 1.1 (Praha) software2 82.69 C2L2 (Ithaca) software5 82.69 Mengest (Shanghai) software1 82.69 26. TurkuNLP (Turku) software1 82.57 27. OpenU NLP Lab (Ra'anana) software6 80.08 28. TRL (Tokyo) software1 71.31 29. MetaRomance (Santiago de Compostela) software1 51.77 30. ECNU (Shanghai) software1 0.00 Uppsala (Uppsala) software1 0.00 METU (Ankara) software2 0.00 UT (Tartu) software1 0.00