Results: Unlabeled Attachment Score (UAS)
All treebanks
1. Stanford (Stanford) software1 81.30 2. C2L2 (Ithaca) software5 80.35 3. IMS (Stuttgart) software2 79.90 4. HIT-SCIR (Harbin) software4 77.81 5. LATTICE (Paris) software7 76.75 6. NAIST SATO (Nara) software1 76.35 7. UParse (Edinburgh) software1 75.49 8. Koç University (İstanbul) software3 75.44 9. ÚFAL – UDPipe 1.2 (Praha) software1 75.39 10. Orange – Deskiñ (Lannion) software1 75.11 11. RACAI (București) software1 74.67 12. LyS-FASTPARSE (A Coruña) software5 74.42 13. BASELINE UDPipe 1.1 (Praha) software2 74.41 14. fbaml (Palo Alto) software1 74.34 15. TurkuNLP (Turku) software1 74.32 16. MQuni (Sydney) software2 74.31 17. naistCL (Nara) software1 74.28 18. darc (Tübingen) software1 74.22 19. LIMSI-LIPN (Paris) software2 74.06 20. IIT Kharagpur (Kharagpur) software3 73.68 21. Wanghao-ftd-SJTU (Shanghai) software2 72.69 22. Uppsala (Uppsala) software1 72.20 23. UALING (Tucson) software1 71.41 24. METU (Ankara) software2 68.82 25. Mengest (Shanghai) software1 68.59 26. CLCL (Genève) software2 68.43 27. ParisNLP (Paris) software1 68.01 28. OpenU NLP Lab (Ra'anana) software6 64.85 29. TRL (Tokyo) software1 53.27 30. MetaRomance (Santiago de Compostela) software1 42.55 31. UT (Tartu) software1 24.01 32. ECNU (Shanghai) software1 8.25 33. Wenba-NLU (Wuhan) software1 7.41
Big treebanks only
Macro-average UAS-F1 of the 55 big treebanks: ar, bg, ca, cs, cs_cac, cs_cltt, cu, da, de, el, en, en_lines, en_partut, es, es_ancora, et, eu, fa, fi, fi_ftb, fr, fr_sequoia, gl, got, grc, grc_proiel, he, hi, hr, hu, id, it, ja, ko, la_ittb, la_proiel, lv, nl, nl_lassysmall, no_bokmaal, no_nynorsk, pl, pt, pt_br, ro, ru, ru_syntagrus, sk, sl, sv, sv_lines, tr, ur, vi, zh. These are the treebanks that have development data available, hence these results should be comparable to the performance of the systems on the development data.
1. Stanford (Stanford) software1 85.16 2. C2L2 (Ithaca) software5 83.81 3. IMS (Stuttgart) software2 83.64 4. HIT-SCIR (Harbin) software4 81.63 5. NAIST SATO (Nara) software1 80.55 6. LATTICE (Paris) software7 80.28 7. LyS-FASTPARSE (A Coruña) software5 79.33 8. Orange – Deskiñ (Lannion) software1 78.99 9. Koç University (İstanbul) software3 78.93 10. ÚFAL – UDPipe 1.2 (Praha) software1 78.86 11. MQuni (Sydney) software2 78.85 12. UParse (Edinburgh) software1 78.84 13. TurkuNLP (Turku) software1 78.62 14. LIMSI-LIPN (Paris) software2 78.37 15. RACAI (București) software1 78.36 16. fbaml (Palo Alto) software1 78.30 17. naistCL (Nara) software1 77.83 18. darc (Tübingen) software1 77.81 19. BASELINE UDPipe 1.1 (Praha) software2 77.72 20. IIT Kharagpur (Kharagpur) software3 77.32 21. Uppsala (Uppsala) software1 76.54 22. Wanghao-ftd-SJTU (Shanghai) software2 76.08 23. CLCL (Genève) software2 75.95 24. UALING (Tucson) software1 74.68 25. Mengest (Shanghai) software1 74.31 26. METU (Ankara) software2 74.11 27. ParisNLP (Paris) software1 69.91 28. OpenU NLP Lab (Ra'anana) software6 68.13 29. TRL (Tokyo) software1 55.25 30. MetaRomance (Santiago de Compostela) software1 43.14 31. UT (Tartu) software1 29.33 32. Wenba-NLU (Wuhan) software1 10.91 33. ECNU (Shanghai) software1 8.35
PUD treebanks only
Macro-average UAS-F1 of the 14 PUD treebanks (additional parallel test sets): ar_pud, cs_pud, de_pud, en_pud, es_pud, fi_pud, fr_pud, hi_pud, it_pud, ja_pud, pt_pud, ru_pud, sv_pud, tr_pud. These are languages for which there exists at least one big training treebank. However, these test sets have been produced separately and their domain may differ.
1. Stanford (Stanford) software1 80.17 2. C2L2 (Ithaca) software5 78.61 3. IMS (Stuttgart) software2 78.60 4. LATTICE (Paris) software7 77.64 5. NAIST SATO (Nara) software1 76.92 6. HIT-SCIR (Harbin) software4 76.89 7. UParse (Edinburgh) software1 76.79 8. Koç University (İstanbul) software3 76.59 9. MQuni (Sydney) software2 76.23 10. ÚFAL – UDPipe 1.2 (Praha) software1 75.88 11. Orange – Deskiñ (Lannion) software1 75.78 12. naistCL (Nara) software1 75.65 13. TurkuNLP (Turku) software1 75.30 14. BASELINE UDPipe 1.1 (Praha) software2 75.24 15. fbaml (Palo Alto) software1 75.15 16. RACAI (București) software1 74.92 17. darc (Tübingen) software1 74.87 18. IIT Kharagpur (Kharagpur) software3 74.45 19. Uppsala (Uppsala) software1 73.69 20. CLCL (Genève) software1 73.53 21. Wanghao-ftd-SJTU (Shanghai) software2 72.73 22. METU (Ankara) software2 72.36 23. UALING (Tucson) software1 71.41 24. Mengest (Shanghai) software1 71.18 25. LIMSI-LIPN (Paris) software2 70.48 26. ParisNLP (Paris) software1 70.35 27. LyS-FASTPARSE (A Coruña) software5 69.99 28. OpenU NLP Lab (Ra'anana) software6 64.50 29. TRL (Tokyo) software1 56.71 30. MetaRomance (Santiago de Compostela) software1 45.56 31. UT (Tartu) software1 19.98 32. ECNU (Shanghai) software1 9.03 33. Wenba-NLU (Wuhan) software1 0.00
Small treebanks only
Macro-average UAS-F1 of the 8 small treebanks: fr_partut, ga, gl_treegal, kk, la, sl_sst, ug, uk. These treebanks lack development data and some of them have very little training data (especially Uyghur and Kazakh).
1. C2L2 (Ithaca) software5 70.59 2. Stanford (Stanford) software1 70.19 3. IMS (Stuttgart) software2 68.48 4. fbaml (Palo Alto) software1 65.53 5. LATTICE (Paris) software7 64.99 6. HIT-SCIR (Harbin) software4 64.87 7. RACAI (București) software1 64.69 8. NAIST SATO (Nara) software1 64.32 9. TurkuNLP (Turku) software1 64.09 10. ÚFAL – UDPipe 1.2 (Praha) software1 63.76 11. MQuni (Sydney) software2 62.90 12. darc (Tübingen) software1 62.57 13. UParse (Edinburgh) software1 62.39 14. BASELINE UDPipe 1.1 (Praha) software2 62.30 15. LIMSI-LIPN (Paris) software2 62.26 16. Koç University (İstanbul) software3 62.24 17. UALING (Tucson) software1 62.05 18. Wanghao-ftd-SJTU (Shanghai) software2 61.91 19. naistCL (Nara) software1 61.53 20. LyS-FASTPARSE (A Coruña) software5 60.42 21. IIT Kharagpur (Kharagpur) software3 59.14 22. ParisNLP (Paris) software1 59.10 23. Orange – Deskiñ (Lannion) software1 58.50 24. Uppsala (Uppsala) software1 56.92 25. OpenU NLP Lab (Ra'anana) software6 50.05 26. TRL (Tokyo) software1 48.64 27. METU (Ankara) software2 43.87 28. Mengest (Shanghai) software1 42.30 29. MetaRomance (Santiago de Compostela) software1 40.02 30. CLCL (Genève) software2 21.37 31. UT (Tartu) software1 6.46 32. ECNU (Shanghai) software1 4.09 33. Wenba-NLU (Wuhan) software1 0.00
Surprise languages only
Macro-average UAS-F1 of the 4 surprise language treebanks: bxr, hsb, kmr, sme.
1. C2L2 (Ithaca) software5 58.40
2. IMS (Stuttgart) software2 56.01
3. Stanford (Stanford) software1 54.47
4. HIT-SCIR (Harbin) software4 54.43
5. Orange – Deskiñ (Lannion) software1 52.56
6. ParisNLP (Paris) software1 51.53
7. UParse (Edinburgh) software1 51.02
8. LIMSI-LIPN (Paris) software2 50.98
9. OpenU NLP Lab (Ra'anana) software6 50.48
10. LyS-FASTPARSE (A Coruña) software5 50.30
11. BASELINE UDPipe 1.1 (Praha) software2 50.23
12. IIT Kharagpur (Kharagpur) software3 49.98
13. Koç University (İstanbul) software3 49.75
14. ÚFAL – UDPipe 1.2 (Praha) software1 49.21
15. LATTICE (Paris) software7 48.66
16. Wanghao-ftd-SJTU (Shanghai) software2 47.52
17. naistCL (Nara) software1 46.18
18. darc (Tübingen) software1 45.85
19. UALING (Tucson) software1 45.25
20. RACAI (București) software1 43.06
21. CLCL (Genève) software2 41.41
22. NAIST SATO (Nara) software1 40.72
23. Uppsala (Uppsala) software1 37.94
24. fbaml (Palo Alto) software1 34.80
25. METU (Ankara) software2 33.58
26. Mengest (Shanghai) software1 33.41
27. TurkuNLP (Turku) software1 32.18
28. MetaRomance (Santiago de Compostela) software1 28.95
29. MQuni (Sydney) software2 27.96
30. TRL (Tokyo) software1 23.16
31. ECNU (Shanghai) software1 12.41
32. Wenba-NLU (Wuhan) software1 0.00
UT (Tartu) software1 0.00
Per treebank UAS-F1
ar
1. IMS (Stuttgart) software2 78.09 2. Stanford (Stanford) software1 76.59 3. RACAI (București) software1 76.35 4. C2L2 (Ithaca) software5 75.87 5. HIT-SCIR (Harbin) software4 74.13 6. LATTICE (Paris) software7 74.00 7. MQuni (Sydney) software2 73.73 8. NAIST SATO (Nara) software1 73.34 9. Orange – Deskiñ (Lannion) software1 73.16 10. Uppsala (Uppsala) software1 72.51 11. UParse (Edinburgh) software1 72.40 12. LyS-FASTPARSE (A Coruña) software5 72.37 13. Koç University (İstanbul) software3 71.94 14. Mengest (Shanghai) software1 71.71 15. ÚFAL – UDPipe 1.2 (Praha) software1 71.69 16. naistCL (Nara) software1 71.63 17. TurkuNLP (Turku) software1 71.51 18. LIMSI-LIPN (Paris) software2 71.48 19. darc (Tübingen) software1 71.22 20. BASELINE UDPipe 1.1 (Praha) software2 71.19 21. IIT Kharagpur (Kharagpur) software3 70.24 22. fbaml (Palo Alto) software1 70.16 23. METU (Ankara) software2 69.97 24. CLCL (Genève) software1 69.71 25. Wanghao-ftd-SJTU (Shanghai) software2 68.40 26. UALING (Tucson) software1 67.45 27. ParisNLP (Paris) software1 63.74 28. OpenU NLP Lab (Ra'anana) software6 53.41 29. TRL (Tokyo) software1 51.44 30. MetaRomance (Santiago de Compostela) software1 37.25 31. Wenba-NLU (Wuhan) software1 19.60 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
ar_pud
1. RACAI (București) software1 59.80
2. IMS (Stuttgart) software2 59.57
3. Uppsala (Uppsala) software1 59.24
4. Stanford (Stanford) software1 58.87
5. C2L2 (Ithaca) software5 58.48
6. HIT-SCIR (Harbin) software4 57.18
7. LATTICE (Paris) software7 56.63
8. TRL (Tokyo) software1 56.59
9. MQuni (Sydney) software2 56.36
10. NAIST SATO (Nara) software1 55.66
11. UParse (Edinburgh) software1 55.59
12. LyS-FASTPARSE (A Coruña) software5 55.57
13. Orange – Deskiñ (Lannion) software1 55.26
14. Koç University (İstanbul) software3 55.22
15. naistCL (Nara) software1 54.68
16. ÚFAL – UDPipe 1.2 (Praha) software1 54.57
17. darc (Tübingen) software1 53.97
LIMSI-LIPN (Paris) software2 53.97
19. Mengest (Shanghai) software1 53.80
20. fbaml (Palo Alto) software1 53.74
21. IIT Kharagpur (Kharagpur) software3 53.61
22. BASELINE UDPipe 1.1 (Praha) software2 53.55
23. TurkuNLP (Turku) software1 52.89
24. METU (Ankara) software2 52.85
25. UALING (Tucson) software1 52.79
26. CLCL (Genève) software1 52.55
27. ParisNLP (Paris) software1 52.34
28. Wanghao-ftd-SJTU (Shanghai) software2 51.22
29. OpenU NLP Lab (Ra'anana) software6 41.54
30. MetaRomance (Santiago de Compostela) software1 37.02
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
bg
1. Stanford (Stanford) software1 92.89
2. C2L2 (Ithaca) software5 92.04
3. IMS (Stuttgart) software2 91.40
4. HIT-SCIR (Harbin) software4 90.30
5. NAIST SATO (Nara) software1 89.95
6. LyS-FASTPARSE (A Coruña) software5 89.72
7. LATTICE (Paris) software7 89.57
8. Orange – Deskiñ (Lannion) software1 89.17
9. Koç University (İstanbul) software3 89.01
10. ÚFAL – UDPipe 1.2 (Praha) software1 88.82
11. TurkuNLP (Turku) software1 88.80
12. Mengest (Shanghai) software1 88.57
13. darc (Tübingen) software1 88.44
14. UT (Tartu) software1 88.34
15. naistCL (Nara) software1 88.06
16. fbaml (Palo Alto) software1 87.96
17. IIT Kharagpur (Kharagpur) software3 87.79
UParse (Edinburgh) software1 87.79
BASELINE UDPipe 1.1 (Praha) software2 87.79
20. CLCL (Genève) software1 87.73
21. RACAI (București) software1 87.66
22. LIMSI-LIPN (Paris) software2 87.56
23. MQuni (Sydney) software2 87.50
24. Wanghao-ftd-SJTU (Shanghai) software2 87.29
25. UALING (Tucson) software1 86.89
26. Uppsala (Uppsala) software1 86.45
27. METU (Ankara) software2 86.44
28. ParisNLP (Paris) software1 81.48
29. OpenU NLP Lab (Ra'anana) software6 80.09
30. TRL (Tokyo) software1 61.26
31. MetaRomance (Santiago de Compostela) software1 54.09
32. Wenba-NLU (Wuhan) software1 13.14
33. ECNU (Shanghai) software1 0.00
bxr
1. Stanford (Stanford) software1 51.19 2. C2L2 (Ithaca) software5 50.79 3. Wanghao-ftd-SJTU (Shanghai) software2 49.67 4. LyS-FASTPARSE (A Coruña) software5 49.32 5. IMS (Stuttgart) software2 48.78 6. Orange – Deskiñ (Lannion) software1 47.58 7. LIMSI-LIPN (Paris) software2 47.32 8. BASELINE UDPipe 1.1 (Praha) software2 46.97 9. HIT-SCIR (Harbin) software4 46.04 10. ParisNLP (Paris) software1 45.09 11. IIT Kharagpur (Kharagpur) software3 44.42 12. NAIST SATO (Nara) software1 44.07 13. naistCL (Nara) software1 43.57 14. Koç University (İstanbul) software3 42.98 15. ÚFAL – UDPipe 1.2 (Praha) software1 41.64 16. LATTICE (Paris) software7 41.27 17. OpenU NLP Lab (Ra'anana) software6 41.15 18. CLCL (Genève) software2 39.17 19. RACAI (București) software1 38.46 20. fbaml (Palo Alto) software1 36.42 21. Mengest (Shanghai) software1 36.25 22. METU (Ankara) software2 36.17 23. Uppsala (Uppsala) software1 35.87 24. UParse (Edinburgh) software1 34.74 25. UALING (Tucson) software1 34.65 26. TurkuNLP (Turku) software1 29.82 27. darc (Tübingen) software1 29.78 28. MQuni (Sydney) software2 28.14 29. TRL (Tokyo) software1 23.40 30. ECNU (Shanghai) software1 13.58 31. Wenba-NLU (Wuhan) software1 0.00 32. MetaRomance (Santiago de Compostela) software1 0.00 33. UT (Tartu) software1 0.00
ca
1. Stanford (Stanford) software1 92.88
2. C2L2 (Ithaca) software5 91.38
3. HIT-SCIR (Harbin) software4 90.79
4. IMS (Stuttgart) software2 90.61
5. NAIST SATO (Nara) software1 90.59
6. UParse (Edinburgh) software1 90.53
7. LATTICE (Paris) software7 89.70
8. Mengest (Shanghai) software1 89.40
9. Koç University (İstanbul) software3 89.26
10. Orange – Deskiñ (Lannion) software1 89.22
11. TurkuNLP (Turku) software1 88.69
naistCL (Nara) software1 88.69
ÚFAL – UDPipe 1.2 (Praha) software1 88.69
14. LyS-FASTPARSE (A Coruña) software5 88.66
15. LIMSI-LIPN (Paris) software2 88.62
BASELINE UDPipe 1.1 (Praha) software2 88.62
17. MQuni (Sydney) software2 88.54
18. Uppsala (Uppsala) software1 88.53
19. fbaml (Palo Alto) software1 88.48
20. darc (Tübingen) software1 88.45
21. RACAI (București) software1 87.98
22. IIT Kharagpur (Kharagpur) software3 87.50
23. Wanghao-ftd-SJTU (Shanghai) software2 87.25
24. CLCL (Genève) software2 86.36
25. ParisNLP (Paris) software1 86.25
26. METU (Ankara) software2 86.14
27. UALING (Tucson) software1 85.80
28. OpenU NLP Lab (Ra'anana) software6 80.09
29. MetaRomance (Santiago de Compostela) software1 65.57
30. TRL (Tokyo) software1 58.31
31. Wenba-NLU (Wuhan) software1 25.94
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
cs
1. Stanford (Stanford) software1 92.62
2. C2L2 (Ithaca) software5 89.85
3. NAIST SATO (Nara) software1 89.74
4. HIT-SCIR (Harbin) software4 89.57
5. IMS (Stuttgart) software2 89.55
6. Uppsala (Uppsala) software1 89.17
7. UParse (Edinburgh) software1 89.03
8. fbaml (Palo Alto) software1 88.14
9. Orange – Deskiñ (Lannion) software1 87.99
10. Mengest (Shanghai) software1 87.55
11. LyS-FASTPARSE (A Coruña) software5 87.43
12. LATTICE (Paris) software7 87.21
13. MQuni (Sydney) software2 87.02
14. TurkuNLP (Turku) software1 86.86
15. ÚFAL – UDPipe 1.2 (Praha) software1 86.73
16. LIMSI-LIPN (Paris) software2 86.46
BASELINE UDPipe 1.1 (Praha) software2 86.46
18. RACAI (București) software1 85.97
19. CLCL (Genève) software1 85.65
20. darc (Tübingen) software1 85.62
21. Koç University (İstanbul) software3 85.53
22. naistCL (Nara) software1 84.99
23. IIT Kharagpur (Kharagpur) software3 84.14
24. METU (Ankara) software2 83.84
25. Wanghao-ftd-SJTU (Shanghai) software2 83.47
26. UALING (Tucson) software1 82.41
27. OpenU NLP Lab (Ra'anana) software6 81.45
28. ParisNLP (Paris) software1 77.20
29. TRL (Tokyo) software1 61.32
30. Wenba-NLU (Wuhan) software1 0.00
31. ECNU (Shanghai) software1 0.00
32. MetaRomance (Santiago de Compostela) software1 0.00
33. UT (Tartu) software1 0.00
cs_cac
1. Stanford (Stanford) software1 93.14
2. C2L2 (Ithaca) software5 90.80
3. IMS (Stuttgart) software2 90.62
4. NAIST SATO (Nara) software1 90.09
5. UParse (Edinburgh) software1 90.08
6. Orange – Deskiñ (Lannion) software1 88.34
7. LATTICE (Paris) software7 88.29
8. TurkuNLP (Turku) software1 88.27
9. ÚFAL – UDPipe 1.2 (Praha) software1 88.21
10. Uppsala (Uppsala) software1 87.68
11. HIT-SCIR (Harbin) software4 87.66
12. Mengest (Shanghai) software1 87.56
13. fbaml (Palo Alto) software1 87.54
14. MQuni (Sydney) software2 87.51
15. LyS-FASTPARSE (A Coruña) software5 87.38
16. RACAI (București) software1 87.18
17. Koç University (İstanbul) software3 86.86
18. naistCL (Nara) software1 86.75
19. LIMSI-LIPN (Paris) software2 86.49
BASELINE UDPipe 1.1 (Praha) software2 86.49
21. darc (Tübingen) software1 85.96
22. Wanghao-ftd-SJTU (Shanghai) software2 85.60
23. IIT Kharagpur (Kharagpur) software3 85.32
24. CLCL (Genève) software1 85.24
25. OpenU NLP Lab (Ra'anana) software6 84.73
26. UALING (Tucson) software1 84.30
27. METU (Ankara) software2 83.94
28. ParisNLP (Paris) software1 79.91
29. TRL (Tokyo) software1 64.88
30. MetaRomance (Santiago de Compostela) software1 49.45
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
cs_cltt
1. C2L2 (Ithaca) software5 88.00
2. Stanford (Stanford) software1 86.02
3. HIT-SCIR (Harbin) software4 84.96
4. IMS (Stuttgart) software2 84.07
5. NAIST SATO (Nara) software1 81.10
6. ÚFAL – UDPipe 1.2 (Praha) software1 80.52
7. fbaml (Palo Alto) software1 80.26
8. LATTICE (Paris) software7 79.64
9. MQuni (Sydney) software2 78.63
10. Koç University (İstanbul) software3 78.44
11. LIMSI-LIPN (Paris) software2 78.30
12. TurkuNLP (Turku) software1 78.21
13. Orange – Deskiñ (Lannion) software1 77.67
14. darc (Tübingen) software1 77.41
15. IIT Kharagpur (Kharagpur) software3 76.94
16. OpenU NLP Lab (Ra'anana) software6 76.40
17. UParse (Edinburgh) software1 76.26
BASELINE UDPipe 1.1 (Praha) software2 76.26
19. RACAI (București) software1 76.17
20. UALING (Tucson) software1 75.96
21. Wanghao-ftd-SJTU (Shanghai) software2 75.86
22. naistCL (Nara) software1 74.89
23. CLCL (Genève) software1 74.47
24. Mengest (Shanghai) software1 74.23
25. LyS-FASTPARSE (A Coruña) software5 74.09
26. METU (Ankara) software2 73.18
27. ParisNLP (Paris) software1 67.62
28. Uppsala (Uppsala) software1 67.56
29. TRL (Tokyo) software1 54.09
30. MetaRomance (Santiago de Compostela) software1 43.50
31. Wenba-NLU (Wuhan) software1 8.25
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
cs_pud
1. Stanford (Stanford) software1 89.11
2. C2L2 (Ithaca) software5 87.38
3. NAIST SATO (Nara) software1 87.22
4. UParse (Edinburgh) software1 86.82
5. IMS (Stuttgart) software2 86.01
6. HIT-SCIR (Harbin) software4 85.79
7. Mengest (Shanghai) software1 85.51
8. LATTICE (Paris) software7 85.48
9. LyS-FASTPARSE (A Coruña) software5 85.36
10. Uppsala (Uppsala) software1 85.24
11. fbaml (Palo Alto) software1 85.12
12. TurkuNLP (Turku) software1 84.82
13. Orange – Deskiñ (Lannion) software1 84.71
14. ÚFAL – UDPipe 1.2 (Praha) software1 84.50
15. LIMSI-LIPN (Paris) software2 84.42
BASELINE UDPipe 1.1 (Praha) software2 84.42
17. darc (Tübingen) software1 84.38
18. MQuni (Sydney) software2 84.29
19. Koç University (İstanbul) software3 84.21
20. RACAI (București) software1 84.13
21. naistCL (Nara) software1 83.87
22. CLCL (Genève) software1 83.62
23. Wanghao-ftd-SJTU (Shanghai) software2 83.50
24. IIT Kharagpur (Kharagpur) software3 83.05
25. METU (Ankara) software2 82.19
26. UALING (Tucson) software1 82.08
27. OpenU NLP Lab (Ra'anana) software6 81.33
28. ParisNLP (Paris) software1 77.76
29. TRL (Tokyo) software1 64.47
30. MetaRomance (Santiago de Compostela) software1 44.03
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
cu
1. IMS (Stuttgart) software2 81.56
2. C2L2 (Ithaca) software5 77.56
3. Stanford (Stanford) software1 77.10
4. RACAI (București) software1 74.04
5. fbaml (Palo Alto) software1 73.68
6. LyS-FASTPARSE (A Coruña) software5 73.41
7. ÚFAL – UDPipe 1.2 (Praha) software1 72.60
8. darc (Tübingen) software1 72.52
9. LIMSI-LIPN (Paris) software2 72.44
10. NAIST SATO (Nara) software1 72.19
HIT-SCIR (Harbin) software4 72.19
12. Orange – Deskiñ (Lannion) software1 71.87
13. TurkuNLP (Turku) software1 71.21
14. ParisNLP (Paris) software1 71.07
15. IIT Kharagpur (Kharagpur) software3 71.01
16. MQuni (Sydney) software2 70.60
17. UT (Tartu) software1 69.96
18. Wanghao-ftd-SJTU (Shanghai) software2 69.92
19. CLCL (Genève) software1 69.81
20. UParse (Edinburgh) software1 69.68
BASELINE UDPipe 1.1 (Praha) software2 69.68
22. UALING (Tucson) software1 68.65
23. LATTICE (Paris) software7 68.60
24. Uppsala (Uppsala) software1 67.94
25. METU (Ankara) software2 67.48
26. naistCL (Nara) software1 67.27
27. Koç University (İstanbul) software3 66.53
28. OpenU NLP Lab (Ra'anana) software6 65.69
29. Mengest (Shanghai) software1 58.92
30. TRL (Tokyo) software1 51.09
31. MetaRomance (Santiago de Compostela) software1 50.90
32. Wenba-NLU (Wuhan) software1 19.64
33. ECNU (Shanghai) software1 15.93
da
1. Stanford (Stanford) software1 85.33
2. C2L2 (Ithaca) software5 84.36
3. IMS (Stuttgart) software2 82.88
4. HIT-SCIR (Harbin) software4 81.14
5. NAIST SATO (Nara) software1 80.90
6. LATTICE (Paris) software7 80.29
7. Koç University (İstanbul) software3 79.71
8. fbaml (Palo Alto) software1 79.48
9. MQuni (Sydney) software2 79.24
10. ÚFAL – UDPipe 1.2 (Praha) software1 78.91
11. LyS-FASTPARSE (A Coruña) software5 78.85
12. TurkuNLP (Turku) software1 78.49
13. UParse (Edinburgh) software1 78.26
14. ParisNLP (Paris) software1 78.21
15. Orange – Deskiñ (Lannion) software1 78.05
16. Wanghao-ftd-SJTU (Shanghai) software2 77.56
LIMSI-LIPN (Paris) software2 77.56
18. naistCL (Nara) software1 77.51
19. darc (Tübingen) software1 77.50
20. IIT Kharagpur (Kharagpur) software3 77.43
21. RACAI (București) software1 77.15
UT (Tartu) software1 77.15
23. BASELINE UDPipe 1.1 (Praha) software2 76.94
24. Mengest (Shanghai) software1 76.73
25. UALING (Tucson) software1 76.53
26. Uppsala (Uppsala) software1 75.35
27. CLCL (Genève) software1 73.59
28. METU (Ankara) software2 72.88
29. OpenU NLP Lab (Ra'anana) software6 70.27
30. TRL (Tokyo) software1 48.62
31. MetaRomance (Santiago de Compostela) software1 46.96
32. ECNU (Shanghai) software1 20.23
33. Wenba-NLU (Wuhan) software1 8.03
de
1. Stanford (Stanford) software1 84.10 2. C2L2 (Ithaca) software5 81.06 3. IMS (Stuttgart) software2 79.80 4. LATTICE (Paris) software7 79.31 5. fbaml (Palo Alto) software1 79.17 6. HIT-SCIR (Harbin) software4 79.03 7. NAIST SATO (Nara) software1 78.43 8. Orange – Deskiñ (Lannion) software1 77.95 9. MQuni (Sydney) software2 77.71 10. Uppsala (Uppsala) software1 77.16 11. Koç University (İstanbul) software3 76.82 12. naistCL (Nara) software1 76.38 13. Mengest (Shanghai) software1 76.34 14. UParse (Edinburgh) software1 76.28 15. RACAI (București) software1 76.21 16. LIMSI-LIPN (Paris) software2 75.77 17. TurkuNLP (Turku) software1 74.74 18. LyS-FASTPARSE (A Coruña) software5 74.54 19. BASELINE UDPipe 1.1 (Praha) software2 74.27 20. CLCL (Genève) software1 74.18 21. ÚFAL – UDPipe 1.2 (Praha) software1 74.15 22. IIT Kharagpur (Kharagpur) software3 73.87 23. darc (Tübingen) software1 73.58 24. ParisNLP (Paris) software1 73.25 25. METU (Ankara) software2 72.77 26. UALING (Tucson) software1 71.85 27. Wanghao-ftd-SJTU (Shanghai) software2 71.51 28. OpenU NLP Lab (Ra'anana) software6 55.21 29. TRL (Tokyo) software1 49.28 30. MetaRomance (Santiago de Compostela) software1 43.10 31. Wenba-NLU (Wuhan) software1 7.10 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
de_pud
1. Stanford (Stanford) software1 80.88
2. C2L2 (Ithaca) software5 79.96
3. IMS (Stuttgart) software2 78.39
4. HIT-SCIR (Harbin) software4 77.90
5. LATTICE (Paris) software7 77.73
6. NAIST SATO (Nara) software1 77.20
Koç University (İstanbul) software3 77.20
8. Orange – Deskiñ (Lannion) software1 76.52
9. MQuni (Sydney) software2 76.30
10. Mengest (Shanghai) software1 75.74
11. naistCL (Nara) software1 75.66
12. UParse (Edinburgh) software1 75.63
13. fbaml (Palo Alto) software1 75.61
14. LIMSI-LIPN (Paris) software2 75.50
15. RACAI (București) software1 74.65
16. Uppsala (Uppsala) software1 74.26
17. LyS-FASTPARSE (A Coruña) software5 74.24
18. CLCL (Genève) software1 74.19
19. TurkuNLP (Turku) software1 73.96
20. ÚFAL – UDPipe 1.2 (Praha) software1 73.75
21. BASELINE UDPipe 1.1 (Praha) software2 73.64
22. IIT Kharagpur (Kharagpur) software3 73.33
23. darc (Tübingen) software1 72.50
24. METU (Ankara) software2 72.46
25. ParisNLP (Paris) software1 71.94
26. Wanghao-ftd-SJTU (Shanghai) software2 71.73
27. UALING (Tucson) software1 71.22
28. OpenU NLP Lab (Ra'anana) software6 52.98
29. TRL (Tokyo) software1 51.35
30. MetaRomance (Santiago de Compostela) software1 44.49
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
el
1. Stanford (Stanford) software1 89.73
2. C2L2 (Ithaca) software5 89.36
3. IMS (Stuttgart) software2 88.00
4. HIT-SCIR (Harbin) software4 85.72
5. NAIST SATO (Nara) software1 85.48
6. LyS-FASTPARSE (A Coruña) software5 85.34
7. Koç University (İstanbul) software3 84.59
8. LATTICE (Paris) software7 84.47
9. MQuni (Sydney) software2 84.40
10. Orange – Deskiñ (Lannion) software1 84.33
11. ÚFAL – UDPipe 1.2 (Praha) software1 84.31
fbaml (Palo Alto) software1 84.31
13. RACAI (București) software1 84.03
14. TurkuNLP (Turku) software1 83.74
15. IIT Kharagpur (Kharagpur) software3 83.38
16. naistCL (Nara) software1 83.16
17. darc (Tübingen) software1 83.04
18. UParse (Edinburgh) software1 83.00
LIMSI-LIPN (Paris) software2 83.00
BASELINE UDPipe 1.1 (Praha) software2 83.00
Mengest (Shanghai) software1 83.00
22. UALING (Tucson) software1 82.48
23. CLCL (Genève) software1 81.69
24. ParisNLP (Paris) software1 81.49
25. Wanghao-ftd-SJTU (Shanghai) software2 81.04
26. METU (Ankara) software2 80.53
27. UT (Tartu) software1 80.13
28. Uppsala (Uppsala) software1 77.78
29. OpenU NLP Lab (Ra'anana) software6 77.56
30. TRL (Tokyo) software1 61.06
31. MetaRomance (Santiago de Compostela) software1 52.74
32. Wenba-NLU (Wuhan) software1 29.03
33. ECNU (Shanghai) software1 6.38
en
1. Stanford (Stanford) software1 84.74
2. HIT-SCIR (Harbin) software4 82.88
3. C2L2 (Ithaca) software5 82.65
4. LATTICE (Paris) software7 81.87
5. IMS (Stuttgart) software2 81.70
6. NAIST SATO (Nara) software1 80.96
7. Orange – Deskiñ (Lannion) software1 80.85
8. fbaml (Palo Alto) software1 80.80
9. ÚFAL – UDPipe 1.2 (Praha) software1 80.34
10. MQuni (Sydney) software2 80.20
11. UParse (Edinburgh) software1 80.12
12. TurkuNLP (Turku) software1 79.74
13. Mengest (Shanghai) software1 79.71
14. Uppsala (Uppsala) software1 79.31
15. LyS-FASTPARSE (A Coruña) software5 79.19
16. Koç University (İstanbul) software3 79.05
17. darc (Tübingen) software1 78.96
18. LIMSI-LIPN (Paris) software2 78.87
BASELINE UDPipe 1.1 (Praha) software2 78.87
20. IIT Kharagpur (Kharagpur) software3 78.72
21. naistCL (Nara) software1 78.62
22. RACAI (București) software1 78.34
23. CLCL (Genève) software1 78.12
24. OpenU NLP Lab (Ra'anana) software6 78.09
25. Wanghao-ftd-SJTU (Shanghai) software2 77.84
26. METU (Ankara) software2 76.60
27. UALING (Tucson) software1 76.04
28. ParisNLP (Paris) software1 74.10
29. TRL (Tokyo) software1 56.44
30. MetaRomance (Santiago de Compostela) software1 41.05
31. Wenba-NLU (Wuhan) software1 5.59
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
en_lines
1. Stanford (Stanford) software1 85.16
2. C2L2 (Ithaca) software5 84.22
3. HIT-SCIR (Harbin) software4 82.70
4. IMS (Stuttgart) software2 82.27
5. NAIST SATO (Nara) software1 81.87
6. LATTICE (Paris) software7 80.31
7. fbaml (Palo Alto) software1 79.27
8. TurkuNLP (Turku) software1 79.22
9. ÚFAL – UDPipe 1.2 (Praha) software1 79.06
10. Koç University (İstanbul) software3 78.74
11. IIT Kharagpur (Kharagpur) software3 78.55
12. UParse (Edinburgh) software1 78.41
LyS-FASTPARSE (A Coruña) software5 78.41
14. MQuni (Sydney) software2 78.40
15. naistCL (Nara) software1 77.96
16. Orange – Deskiñ (Lannion) software1 77.83
17. LIMSI-LIPN (Paris) software2 77.39
BASELINE UDPipe 1.1 (Praha) software2 77.39
19. darc (Tübingen) software1 77.35
20. Mengest (Shanghai) software1 77.32
21. Wanghao-ftd-SJTU (Shanghai) software2 77.31
22. UALING (Tucson) software1 77.27
23. CLCL (Genève) software1 76.88
24. RACAI (București) software1 76.84
25. UT (Tartu) software1 75.84
26. METU (Ankara) software2 75.01
27. OpenU NLP Lab (Ra'anana) software6 73.50
28. Uppsala (Uppsala) software1 73.20
29. ParisNLP (Paris) software1 71.12
30. TRL (Tokyo) software1 59.77
31. ECNU (Shanghai) software1 43.70
32. MetaRomance (Santiago de Compostela) software1 42.16
33. Wenba-NLU (Wuhan) software1 10.44
en_partut
1. C2L2 (Ithaca) software5 87.29
2. Stanford (Stanford) software1 86.10
3. HIT-SCIR (Harbin) software4 85.57
4. LATTICE (Paris) software7 84.45
5. IMS (Stuttgart) software2 83.39
6. NAIST SATO (Nara) software1 83.17
7. ÚFAL – UDPipe 1.2 (Praha) software1 81.13
8. fbaml (Palo Alto) software1 80.83
9. MQuni (Sydney) software2 80.69
10. Orange – Deskiñ (Lannion) software1 79.99
11. Koç University (İstanbul) software3 79.66
12. LyS-FASTPARSE (A Coruña) software5 79.13
13. IIT Kharagpur (Kharagpur) software3 78.65
14. TurkuNLP (Turku) software1 78.56
15. darc (Tübingen) software1 78.23
16. Wanghao-ftd-SJTU (Shanghai) software2 78.22
17. Mengest (Shanghai) software1 78.20
18. RACAI (București) software1 78.11
19. UALING (Tucson) software1 77.84
20. UParse (Edinburgh) software1 77.83
LIMSI-LIPN (Paris) software2 77.83
BASELINE UDPipe 1.1 (Praha) software2 77.83
23. naistCL (Nara) software1 77.62
24. METU (Ankara) software2 76.68
25. CLCL (Genève) software1 76.56
26. ParisNLP (Paris) software1 76.42
27. OpenU NLP Lab (Ra'anana) software6 73.43
28. Uppsala (Uppsala) software1 69.64
29. TRL (Tokyo) software1 62.48
30. MetaRomance (Santiago de Compostela) software1 49.90
31. Wenba-NLU (Wuhan) software1 4.17
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
en_pud
1. Stanford (Stanford) software1 88.22
2. LATTICE (Paris) software7 85.77
3. IMS (Stuttgart) software2 85.14
4. HIT-SCIR (Harbin) software4 84.97
5. MQuni (Sydney) software2 84.79
6. NAIST SATO (Nara) software1 84.75
7. UParse (Edinburgh) software1 83.78
8. fbaml (Palo Alto) software1 83.56
9. Orange – Deskiñ (Lannion) software1 83.47
10. TurkuNLP (Turku) software1 83.31
11. Koç University (İstanbul) software3 83.13
12. ÚFAL – UDPipe 1.2 (Praha) software1 82.80
13. Mengest (Shanghai) software1 82.75
14. LIMSI-LIPN (Paris) software2 82.74
BASELINE UDPipe 1.1 (Praha) software2 82.74
16. RACAI (București) software1 82.59
17. LyS-FASTPARSE (A Coruña) software5 82.56
18. naistCL (Nara) software1 82.44
19. UT (Tartu) software1 82.41
20. C2L2 (Ithaca) software5 82.36
21. IIT Kharagpur (Kharagpur) software3 82.00
22. CLCL (Genève) software1 81.80
23. Wanghao-ftd-SJTU (Shanghai) software2 81.53
24. darc (Tübingen) software1 81.46
25. UALING (Tucson) software1 80.31
26. Uppsala (Uppsala) software1 79.79
27. METU (Ankara) software2 79.76
28. ParisNLP (Paris) software1 79.71
29. OpenU NLP Lab (Ra'anana) software6 78.27
30. TRL (Tokyo) software1 60.05
31. MetaRomance (Santiago de Compostela) software1 48.35
32. ECNU (Shanghai) software1 39.55
33. Wenba-NLU (Wuhan) software1 0.00
es
1. Stanford (Stanford) software1 90.01
2. C2L2 (Ithaca) software5 88.59
3. LATTICE (Paris) software7 88.40
4. NAIST SATO (Nara) software1 87.80
5. HIT-SCIR (Harbin) software4 87.20
6. MQuni (Sydney) software2 86.93
7. Orange – Deskiñ (Lannion) software1 86.72
UParse (Edinburgh) software1 86.72
9. LyS-FASTPARSE (A Coruña) software5 86.70
10. Koç University (İstanbul) software3 86.64
11. IMS (Stuttgart) software2 86.54
12. Uppsala (Uppsala) software1 85.83
13. naistCL (Nara) software1 85.63
14. ÚFAL – UDPipe 1.2 (Praha) software1 85.32
15. TurkuNLP (Turku) software1 85.14
16. fbaml (Palo Alto) software1 85.05
17. darc (Tübingen) software1 84.85
18. LIMSI-LIPN (Paris) software2 84.84
BASELINE UDPipe 1.1 (Praha) software2 84.84
20. RACAI (București) software1 84.43
21. IIT Kharagpur (Kharagpur) software3 83.75
22. Wanghao-ftd-SJTU (Shanghai) software2 83.57
23. CLCL (Genève) software2 83.54
24. ParisNLP (Paris) software1 82.85
25. UALING (Tucson) software1 82.60
26. METU (Ankara) software2 81.48
27. Mengest (Shanghai) software1 80.14
28. OpenU NLP Lab (Ra'anana) software6 73.51
29. MetaRomance (Santiago de Compostela) software1 67.20
30. TRL (Tokyo) software1 63.80
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
es_ancora
1. Stanford (Stanford) software1 92.11
2. C2L2 (Ithaca) software5 90.44
3. HIT-SCIR (Harbin) software4 89.94
4. NAIST SATO (Nara) software1 89.93
5. IMS (Stuttgart) software2 89.82
6. UParse (Edinburgh) software1 89.66
7. LATTICE (Paris) software7 89.62
8. LyS-FASTPARSE (A Coruña) software5 89.57
9. Koç University (İstanbul) software3 88.49
10. Orange – Deskiñ (Lannion) software1 88.42
11. MQuni (Sydney) software2 88.24
12. ÚFAL – UDPipe 1.2 (Praha) software1 87.91
13. naistCL (Nara) software1 87.90
14. Uppsala (Uppsala) software1 87.74
15. TurkuNLP (Turku) software1 87.19
16. fbaml (Palo Alto) software1 87.13
17. darc (Tübingen) software1 86.97
LIMSI-LIPN (Paris) software2 86.97
BASELINE UDPipe 1.1 (Praha) software2 86.97
20. IIT Kharagpur (Kharagpur) software3 86.14
21. RACAI (București) software1 86.12
22. Wanghao-ftd-SJTU (Shanghai) software2 85.90
23. UALING (Tucson) software1 84.80
24. CLCL (Genève) software2 84.51
25. METU (Ankara) software2 84.23
26. Mengest (Shanghai) software1 83.13
27. ParisNLP (Paris) software1 82.31
28. OpenU NLP Lab (Ra'anana) software6 76.74
29. MetaRomance (Santiago de Compostela) software1 69.63
30. TRL (Tokyo) software1 65.22
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
es_pud
1. Stanford (Stanford) software1 88.14 2. C2L2 (Ithaca) software5 87.29 3. LATTICE (Paris) software7 87.05 4. NAIST SATO (Nara) software1 86.91 5. MQuni (Sydney) software2 86.62 6. UParse (Edinburgh) software1 86.59 7. IMS (Stuttgart) software2 86.30 8. Orange – Deskiñ (Lannion) software1 86.02 9. Koç University (İstanbul) software3 85.73 10. naistCL (Nara) software1 85.48 11. Uppsala (Uppsala) software1 85.43 12. TurkuNLP (Turku) software1 85.05 13. ÚFAL – UDPipe 1.2 (Praha) software1 84.96 14. BASELINE UDPipe 1.1 (Praha) software2 84.71 15. RACAI (București) software1 84.60 16. darc (Tübingen) software1 84.56 17. fbaml (Palo Alto) software1 84.27 18. Wanghao-ftd-SJTU (Shanghai) software2 84.04 19. UALING (Tucson) software1 83.80 20. ParisNLP (Paris) software1 83.77 21. IIT Kharagpur (Kharagpur) software3 83.58 22. CLCL (Genève) software1 83.12 23. HIT-SCIR (Harbin) software4 82.34 24. METU (Ankara) software2 82.33 25. Mengest (Shanghai) software1 80.66 26. LIMSI-LIPN (Paris) software2 77.74 27. OpenU NLP Lab (Ra'anana) software6 74.66 28. MetaRomance (Santiago de Compostela) software1 71.68 29. LyS-FASTPARSE (A Coruña) software5 66.69 30. TRL (Tokyo) software1 66.68 31. Wenba-NLU (Wuhan) software1 0.00 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
et
1. Stanford (Stanford) software1 78.08
2. C2L2 (Ithaca) software5 76.26
3. IMS (Stuttgart) software2 75.06
4. HIT-SCIR (Harbin) software4 73.09
5. LATTICE (Paris) software7 71.79
6. Koç University (İstanbul) software3 70.33
7. LyS-FASTPARSE (A Coruña) software5 70.14
8. fbaml (Palo Alto) software1 69.98
9. LIMSI-LIPN (Paris) software2 69.14
10. NAIST SATO (Nara) software1 69.00
11. Orange – Deskiñ (Lannion) software1 68.77
12. RACAI (București) software1 68.69
13. ÚFAL – UDPipe 1.2 (Praha) software1 68.65
14. TurkuNLP (Turku) software1 68.38
15. MQuni (Sydney) software2 68.07
16. darc (Tübingen) software1 67.90
17. IIT Kharagpur (Kharagpur) software3 67.71
BASELINE UDPipe 1.1 (Praha) software2 67.71
19. UParse (Edinburgh) software1 67.70
20. Wanghao-ftd-SJTU (Shanghai) software2 67.52
21. UALING (Tucson) software1 67.42
22. ParisNLP (Paris) software1 66.92
23. UT (Tartu) software1 66.84
24. Mengest (Shanghai) software1 66.76
25. naistCL (Nara) software1 65.85
26. CLCL (Genève) software1 64.12
27. METU (Ankara) software2 62.95
28. Uppsala (Uppsala) software1 61.16
29. OpenU NLP Lab (Ra'anana) software6 58.20
30. TRL (Tokyo) software1 49.79
31. MetaRomance (Santiago de Compostela) software1 37.43
32. ECNU (Shanghai) software1 20.11
33. Wenba-NLU (Wuhan) software1 14.17
eu
1. Stanford (Stanford) software1 85.28 2. C2L2 (Ithaca) software5 83.45 3. IMS (Stuttgart) software2 82.58 4. HIT-SCIR (Harbin) software4 79.29 5. LyS-FASTPARSE (A Coruña) software5 78.30 6. LATTICE (Paris) software7 77.97 7. NAIST SATO (Nara) software1 77.94 8. MQuni (Sydney) software2 77.77 9. UParse (Edinburgh) software1 77.74 10. fbaml (Palo Alto) software1 77.38 11. RACAI (București) software1 77.31 12. Koç University (İstanbul) software3 76.37 13. Uppsala (Uppsala) software1 76.10 14. naistCL (Nara) software1 75.76 15. ÚFAL – UDPipe 1.2 (Praha) software1 75.59 16. UT (Tartu) software1 75.34 17. TurkuNLP (Turku) software1 74.97 18. LIMSI-LIPN (Paris) software2 74.75 19. BASELINE UDPipe 1.1 (Praha) software2 74.39 20. IIT Kharagpur (Kharagpur) software3 74.10 21. darc (Tübingen) software1 73.32 22. UALING (Tucson) software1 72.37 23. Orange – Deskiñ (Lannion) software1 72.23 24. Mengest (Shanghai) software1 72.01 25. Wanghao-ftd-SJTU (Shanghai) software2 71.74 26. CLCL (Genève) software2 70.33 27. METU (Ankara) software2 67.18 28. OpenU NLP Lab (Ra'anana) software6 66.24 29. ParisNLP (Paris) software1 61.61 30. TRL (Tokyo) software1 53.63 31. MetaRomance (Santiago de Compostela) software1 18.23 32. ECNU (Shanghai) software1 17.46 33. Wenba-NLU (Wuhan) software1 11.78
fa
1. Stanford (Stanford) software1 89.64
2. C2L2 (Ithaca) software5 88.61
3. IMS (Stuttgart) software2 87.13
4. LATTICE (Paris) software7 86.40
5. HIT-SCIR (Harbin) software4 86.24
6. NAIST SATO (Nara) software1 86.06
7. MQuni (Sydney) software2 85.42
8. Orange – Deskiñ (Lannion) software1 85.02
9. UParse (Edinburgh) software1 84.68
10. naistCL (Nara) software1 84.32
11. ÚFAL – UDPipe 1.2 (Praha) software1 84.18
12. Koç University (İstanbul) software3 83.62
13. LIMSI-LIPN (Paris) software2 83.36
BASELINE UDPipe 1.1 (Praha) software2 83.36
15. IIT Kharagpur (Kharagpur) software3 83.10
16. RACAI (București) software1 82.69
17. LyS-FASTPARSE (A Coruña) software5 82.28
18. fbaml (Palo Alto) software1 82.11
19. darc (Tübingen) software1 81.60
20. TurkuNLP (Turku) software1 81.31
21. Uppsala (Uppsala) software1 81.18
22. UALING (Tucson) software1 80.78
23. CLCL (Genève) software2 80.04
24. METU (Ankara) software2 79.99
25. Wanghao-ftd-SJTU (Shanghai) software2 79.81
26. OpenU NLP Lab (Ra'anana) software6 69.04
27. ParisNLP (Paris) software1 68.27
28. Mengest (Shanghai) software1 68.06
29. TRL (Tokyo) software1 56.28
30. MetaRomance (Santiago de Compostela) software1 35.94
31. Wenba-NLU (Wuhan) software1 7.38
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
fi
1. Stanford (Stanford) software1 87.97
2. C2L2 (Ithaca) software5 85.72
3. IMS (Stuttgart) software2 84.50
4. HIT-SCIR (Harbin) software4 81.98
5. Koç University (İstanbul) software3 81.56
6. LATTICE (Paris) software7 81.42
7. ÚFAL – UDPipe 1.2 (Praha) software1 80.74
8. UParse (Edinburgh) software1 80.66
9. LyS-FASTPARSE (A Coruña) software5 80.42
10. NAIST SATO (Nara) software1 80.17
11. MQuni (Sydney) software2 79.78
12. Uppsala (Uppsala) software1 79.63
13. naistCL (Nara) software1 79.60
14. TurkuNLP (Turku) software1 79.40
15. UT (Tartu) software1 79.07
16. IIT Kharagpur (Kharagpur) software3 79.03
17. fbaml (Palo Alto) software1 78.87
18. darc (Tübingen) software1 78.63
Orange – Deskiñ (Lannion) software1 78.63
20. RACAI (București) software1 78.23
21. LIMSI-LIPN (Paris) software2 77.90
BASELINE UDPipe 1.1 (Praha) software2 77.90
23. UALING (Tucson) software1 77.51
24. Wanghao-ftd-SJTU (Shanghai) software2 77.27
25. Mengest (Shanghai) software1 76.37
26. METU (Ankara) software2 72.21
27. CLCL (Genève) software2 69.88
28. ParisNLP (Paris) software1 67.85
29. OpenU NLP Lab (Ra'anana) software6 57.63
30. TRL (Tokyo) software1 45.45
31. MetaRomance (Santiago de Compostela) software1 32.91
32. Wenba-NLU (Wuhan) software1 18.32
33. ECNU (Shanghai) software1 0.00
fi_ftb
1. Stanford (Stanford) software1 89.24
2. C2L2 (Ithaca) software5 86.59
3. IMS (Stuttgart) software2 85.30
4. LATTICE (Paris) software7 83.87
5. Orange – Deskiñ (Lannion) software1 83.07
6. HIT-SCIR (Harbin) software4 82.79
7. LyS-FASTPARSE (A Coruña) software5 81.14
8. CLCL (Genève) software2 80.48
9. NAIST SATO (Nara) software1 80.43
10. MQuni (Sydney) software2 80.15
11. Koç University (İstanbul) software3 79.98
12. TurkuNLP (Turku) software1 79.73
13. Mengest (Shanghai) software1 79.70
14. ÚFAL – UDPipe 1.2 (Praha) software1 79.69
15. darc (Tübingen) software1 79.48
16. UParse (Edinburgh) software1 78.77
LIMSI-LIPN (Paris) software2 78.77
BASELINE UDPipe 1.1 (Praha) software2 78.77
19. IIT Kharagpur (Kharagpur) software3 78.53
20. naistCL (Nara) software1 78.40
21. Uppsala (Uppsala) software1 78.39
22. RACAI (București) software1 78.21
23. fbaml (Palo Alto) software1 78.16
24. UALING (Tucson) software1 77.48
25. METU (Ankara) software2 76.93
26. Wanghao-ftd-SJTU (Shanghai) software2 76.79
27. OpenU NLP Lab (Ra'anana) software6 63.91
28. TRL (Tokyo) software1 57.45
29. ParisNLP (Paris) software1 53.30
30. MetaRomance (Santiago de Compostela) software1 34.54
31. Wenba-NLU (Wuhan) software1 30.91
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
fi_pud
1. Stanford (Stanford) software1 90.60 2. C2L2 (Ithaca) software5 88.33 3. IMS (Stuttgart) software2 87.93 4. Koç University (İstanbul) software3 85.77 5. LATTICE (Paris) software7 84.70 6. UParse (Edinburgh) software1 84.67 7. ÚFAL – UDPipe 1.2 (Praha) software1 83.89 8. naistCL (Nara) software1 83.08 9. MQuni (Sydney) software2 82.93 10. HIT-SCIR (Harbin) software4 82.76 11. TurkuNLP (Turku) software1 82.70 12. NAIST SATO (Nara) software1 82.40 13. BASELINE UDPipe 1.1 (Praha) software2 82.24 14. darc (Tübingen) software1 82.11 15. fbaml (Palo Alto) software1 81.65 16. Orange – Deskiñ (Lannion) software1 81.63 17. Uppsala (Uppsala) software1 81.33 18. UALING (Tucson) software1 81.13 19. RACAI (București) software1 80.85 20. IIT Kharagpur (Kharagpur) software3 80.15 21. Wanghao-ftd-SJTU (Shanghai) software2 80.02 22. Mengest (Shanghai) software1 78.49 23. METU (Ankara) software2 74.83 24. CLCL (Genève) software1 70.79 25. ParisNLP (Paris) software1 70.33 26. LIMSI-LIPN (Paris) software2 57.73 27. OpenU NLP Lab (Ra'anana) software6 56.51 28. LyS-FASTPARSE (A Coruña) software5 56.38 29. TRL (Tokyo) software1 46.67 30. MetaRomance (Santiago de Compostela) software1 37.08 31. ECNU (Shanghai) software1 21.20 32. Wenba-NLU (Wuhan) software1 0.00 33. UT (Tartu) software1 0.00
fr
1. Stanford (Stanford) software1 88.57
2. C2L2 (Ithaca) software5 87.73
3. IMS (Stuttgart) software2 87.13
4. LATTICE (Paris) software7 86.45
5. MQuni (Sydney) software2 86.21
6. HIT-SCIR (Harbin) software4 86.07
7. NAIST SATO (Nara) software1 85.88
8. UParse (Edinburgh) software1 85.47
9. Koç University (İstanbul) software3 84.79
10. Orange – Deskiñ (Lannion) software1 84.38
11. Uppsala (Uppsala) software1 84.25
12. darc (Tübingen) software1 84.15
13. LIMSI-LIPN (Paris) software2 84.13
BASELINE UDPipe 1.1 (Praha) software2 84.13
15. ÚFAL – UDPipe 1.2 (Praha) software1 84.09
16. TurkuNLP (Turku) software1 83.93
17. fbaml (Palo Alto) software1 83.83
18. LyS-FASTPARSE (A Coruña) software5 83.49
19. naistCL (Nara) software1 83.48
20. Mengest (Shanghai) software1 83.45
21. CLCL (Genève) software2 83.41
22. IIT Kharagpur (Kharagpur) software3 82.76
23. RACAI (București) software1 82.64
24. Wanghao-ftd-SJTU (Shanghai) software2 82.32
25. METU (Ankara) software2 81.49
26. ParisNLP (Paris) software1 81.24
27. UALING (Tucson) software1 80.93
28. OpenU NLP Lab (Ra'anana) software6 77.67
29. MetaRomance (Santiago de Compostela) software1 62.20
30. TRL (Tokyo) software1 61.71
31. Wenba-NLU (Wuhan) software1 16.15
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
fr_partut
1. C2L2 (Ithaca) software5 90.92
2. Stanford (Stanford) software1 88.64
3. HIT-SCIR (Harbin) software4 88.39
4. IMS (Stuttgart) software2 87.09
5. LATTICE (Paris) software7 86.82
6. NAIST SATO (Nara) software1 84.79
7. fbaml (Palo Alto) software1 84.20
8. ÚFAL – UDPipe 1.2 (Praha) software1 84.03
9. Koç University (İstanbul) software3 83.89
10. MQuni (Sydney) software2 83.56
11. Orange – Deskiñ (Lannion) software1 83.26
12. Wanghao-ftd-SJTU (Shanghai) software2 83.16
13. TurkuNLP (Turku) software1 82.98
14. darc (Tübingen) software1 82.75
15. LIMSI-LIPN (Paris) software2 82.74
16. UALING (Tucson) software1 82.37
17. naistCL (Nara) software1 82.23
18. UParse (Edinburgh) software1 81.69
BASELINE UDPipe 1.1 (Praha) software2 81.69
20. RACAI (București) software1 81.42
21. ParisNLP (Paris) software1 81.34
22. IIT Kharagpur (Kharagpur) software3 79.84
23. OpenU NLP Lab (Ra'anana) software6 78.86
24. METU (Ankara) software2 77.93
25. Mengest (Shanghai) software1 77.87
26. LyS-FASTPARSE (A Coruña) software5 77.23
27. Uppsala (Uppsala) software1 77.21
28. TRL (Tokyo) software1 64.75
29. MetaRomance (Santiago de Compostela) software1 63.10
30. CLCL (Genève) software2 31.95
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
fr_pud
1. Stanford (Stanford) software1 83.45
2. C2L2 (Ithaca) software5 82.82
3. IMS (Stuttgart) software2 82.65
4. HIT-SCIR (Harbin) software4 82.55
5. LATTICE (Paris) software7 81.95
6. Koç University (İstanbul) software3 81.08
7. MQuni (Sydney) software2 81.00
8. NAIST SATO (Nara) software1 80.32
9. Orange – Deskiñ (Lannion) software1 80.12
10. CLCL (Genève) software1 79.99
11. ParisNLP (Paris) software1 79.82
12. UParse (Edinburgh) software1 79.72
13. ÚFAL – UDPipe 1.2 (Praha) software1 79.64
14. TurkuNLP (Turku) software1 79.01
15. Mengest (Shanghai) software1 78.96
16. fbaml (Palo Alto) software1 78.74
17. naistCL (Nara) software1 78.64
18. LIMSI-LIPN (Paris) software2 78.62
BASELINE UDPipe 1.1 (Praha) software2 78.62
20. Uppsala (Uppsala) software1 78.43
21. Wanghao-ftd-SJTU (Shanghai) software2 78.42
22. IIT Kharagpur (Kharagpur) software3 78.37
23. LyS-FASTPARSE (A Coruña) software5 78.34
24. darc (Tübingen) software1 78.16
25. RACAI (București) software1 77.50
26. UALING (Tucson) software1 77.33
27. METU (Ankara) software2 76.41
28. OpenU NLP Lab (Ra'anana) software6 74.51
29. MetaRomance (Santiago de Compostela) software1 65.94
30. TRL (Tokyo) software1 64.04
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
fr_sequoia
1. C2L2 (Ithaca) software5 89.22
2. Stanford (Stanford) software1 88.48
3. IMS (Stuttgart) software2 87.75
4. HIT-SCIR (Harbin) software4 87.11
5. LATTICE (Paris) software7 86.24
6. NAIST SATO (Nara) software1 85.85
7. Koç University (İstanbul) software3 84.53
8. Orange – Deskiñ (Lannion) software1 84.52
9. LIMSI-LIPN (Paris) software2 84.16
10. ÚFAL – UDPipe 1.2 (Praha) software1 84.06
11. TurkuNLP (Turku) software1 83.73
12. MQuni (Sydney) software2 83.63
13. IIT Kharagpur (Kharagpur) software3 83.02
14. fbaml (Palo Alto) software1 82.91
15. UParse (Edinburgh) software1 82.89
16. BASELINE UDPipe 1.1 (Praha) software2 82.62
17. darc (Tübingen) software1 82.13
18. naistCL (Nara) software1 81.96
UALING (Tucson) software1 81.96
20. Mengest (Shanghai) software1 81.83
21. OpenU NLP Lab (Ra'anana) software6 81.74
22. Wanghao-ftd-SJTU (Shanghai) software2 81.60
23. RACAI (București) software1 81.52
24. LyS-FASTPARSE (A Coruña) software5 80.99
25. CLCL (Genève) software2 79.99
26. Uppsala (Uppsala) software1 79.38
27. METU (Ankara) software2 79.28
28. ParisNLP (Paris) software1 78.32
29. MetaRomance (Santiago de Compostela) software1 60.76
30. TRL (Tokyo) software1 59.60
31. Wenba-NLU (Wuhan) software1 4.81
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
ga
1. C2L2 (Ithaca) software5 79.10
2. Stanford (Stanford) software1 78.50
3. IMS (Stuttgart) software2 77.97
4. fbaml (Palo Alto) software1 76.51
5. RACAI (București) software1 76.27
6. LATTICE (Paris) software7 74.49
7. TurkuNLP (Turku) software1 74.14
8. Orange – Deskiñ (Lannion) software1 73.89
9. HIT-SCIR (Harbin) software4 73.48
10. Koç University (İstanbul) software3 73.42
11. NAIST SATO (Nara) software1 73.29
12. ÚFAL – UDPipe 1.2 (Praha) software1 73.10
13. naistCL (Nara) software1 72.99
14. darc (Tübingen) software1 72.81
15. MQuni (Sydney) software2 72.67
16. LIMSI-LIPN (Paris) software2 72.58
17. UALING (Tucson) software1 72.55
18. UParse (Edinburgh) software1 72.08
BASELINE UDPipe 1.1 (Praha) software2 72.08
20. Wanghao-ftd-SJTU (Shanghai) software2 71.49
21. ParisNLP (Paris) software1 69.69
22. Mengest (Shanghai) software1 69.26
23. IIT Kharagpur (Kharagpur) software3 69.20
24. LyS-FASTPARSE (A Coruña) software5 68.70
25. OpenU NLP Lab (Ra'anana) software6 67.64
26. Uppsala (Uppsala) software1 66.96
27. TRL (Tokyo) software1 61.87
28. MetaRomance (Santiago de Compostela) software1 40.26
29. METU (Ankara) software2 32.47
30. CLCL (Genève) software2 22.43
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
gl
1. C2L2 (Ithaca) software5 86.21
2. Stanford (Stanford) software1 85.87
3. IMS (Stuttgart) software2 84.58
4. LATTICE (Paris) software7 83.98
5. MQuni (Sydney) software2 83.54
6. NAIST SATO (Nara) software1 83.51
7. Koç University (İstanbul) software3 83.38
8. HIT-SCIR (Harbin) software4 83.31
9. fbaml (Palo Alto) software1 83.00
10. Orange – Deskiñ (Lannion) software1 82.86
11. Mengest (Shanghai) software1 82.52
12. LyS-FASTPARSE (A Coruña) software5 82.48
13. RACAI (București) software1 82.43
14. UParse (Edinburgh) software1 81.97
naistCL (Nara) software1 81.97
16. TurkuNLP (Turku) software1 80.99
17. ÚFAL – UDPipe 1.2 (Praha) software1 80.95
18. LIMSI-LIPN (Paris) software2 80.66
BASELINE UDPipe 1.1 (Praha) software2 80.66
20. ParisNLP (Paris) software1 80.30
21. darc (Tübingen) software1 80.27
22. UT (Tartu) software1 79.75
23. CLCL (Genève) software2 79.53
24. IIT Kharagpur (Kharagpur) software3 79.28
25. METU (Ankara) software2 78.90
26. OpenU NLP Lab (Ra'anana) software6 78.59
27. Uppsala (Uppsala) software1 78.36
28. Wanghao-ftd-SJTU (Shanghai) software2 78.03
29. UALING (Tucson) software1 77.41
30. TRL (Tokyo) software1 64.69
31. MetaRomance (Santiago de Compostela) software1 62.59
32. ECNU (Shanghai) software1 29.41
33. Wenba-NLU (Wuhan) software1 2.87
gl_treegal
1. C2L2 (Ithaca) software5 79.17 2. Stanford (Stanford) software1 78.28 3. IMS (Stuttgart) software2 76.02 4. Koç University (İstanbul) software3 74.51 5. LATTICE (Paris) software7 74.01 6. NAIST SATO (Nara) software1 73.60 7. fbaml (Palo Alto) software1 73.44 8. HIT-SCIR (Harbin) software4 72.65 9. MQuni (Sydney) software2 72.03 10. ParisNLP (Paris) software1 72.02 11. TurkuNLP (Turku) software1 71.79 12. RACAI (București) software1 71.74 13. ÚFAL – UDPipe 1.2 (Praha) software1 71.59 14. UALING (Tucson) software1 71.44 15. Wanghao-ftd-SJTU (Shanghai) software2 71.41 16. LIMSI-LIPN (Paris) software2 71.35 17. UParse (Edinburgh) software1 71.32 18. BASELINE UDPipe 1.1 (Praha) software2 71.17 19. LyS-FASTPARSE (A Coruña) software5 71.14 20. naistCL (Nara) software1 70.79 21. darc (Tübingen) software1 70.65 22. IIT Kharagpur (Kharagpur) software3 69.48 23. Mengest (Shanghai) software1 68.29 24. OpenU NLP Lab (Ra'anana) software6 66.79 25. Uppsala (Uppsala) software1 65.97 26. MetaRomance (Santiago de Compostela) software1 63.87 27. METU (Ankara) software2 54.90 28. TRL (Tokyo) software1 46.75 29. Orange – Deskiñ (Lannion) software1 38.39 30. CLCL (Genève) software2 13.83 31. Wenba-NLU (Wuhan) software1 0.00 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
got
1. IMS (Stuttgart) software2 77.25 2. C2L2 (Ithaca) software5 74.18 3. Stanford (Stanford) software1 73.10 4. RACAI (București) software1 70.18 5. fbaml (Palo Alto) software1 70.13 6. UParse (Edinburgh) software1 69.83 7. LyS-FASTPARSE (A Coruña) software5 69.71 8. ÚFAL – UDPipe 1.2 (Praha) software1 69.26 9. LIMSI-LIPN (Paris) software2 68.88 10. darc (Tübingen) software1 68.31 11. TurkuNLP (Turku) software1 68.25 12. NAIST SATO (Nara) software1 67.84 13. LATTICE (Paris) software7 67.71 14. HIT-SCIR (Harbin) software4 67.61 15. BASELINE UDPipe 1.1 (Praha) software2 67.13 16. IIT Kharagpur (Kharagpur) software3 67.05 17. MQuni (Sydney) software2 66.91 18. ParisNLP (Paris) software1 66.69 19. Wanghao-ftd-SJTU (Shanghai) software2 66.67 20. Orange – Deskiñ (Lannion) software1 65.97 21. Uppsala (Uppsala) software1 65.50 22. Mengest (Shanghai) software1 65.45 23. Koç University (İstanbul) software3 65.43 24. UALING (Tucson) software1 65.05 25. CLCL (Genève) software2 65.00 26. naistCL (Nara) software1 64.15 27. UT (Tartu) software1 63.75 28. OpenU NLP Lab (Ra'anana) software6 59.25 29. TRL (Tokyo) software1 51.80 30. MetaRomance (Santiago de Compostela) software1 50.32 31. METU (Ankara) software2 33.45 32. ECNU (Shanghai) software1 20.08 33. Wenba-NLU (Wuhan) software1 19.30
grc
1. Stanford (Stanford) software1 78.42
2. IMS (Stuttgart) software2 74.19
3. C2L2 (Ithaca) software5 71.76
4. NAIST SATO (Nara) software1 68.85
5. LyS-FASTPARSE (A Coruña) software5 68.61
6. RACAI (București) software1 68.53
7. HIT-SCIR (Harbin) software4 66.86
8. UParse (Edinburgh) software1 66.54
9. TurkuNLP (Turku) software1 66.39
10. fbaml (Palo Alto) software1 66.23
11. ÚFAL – UDPipe 1.2 (Praha) software1 65.37
12. darc (Tübingen) software1 64.92
13. LIMSI-LIPN (Paris) software2 62.74
BASELINE UDPipe 1.1 (Praha) software2 62.74
15. Orange – Deskiñ (Lannion) software1 62.66
16. CLCL (Genève) software2 61.63
17. IIT Kharagpur (Kharagpur) software3 61.03
18. UALING (Tucson) software1 59.77
19. Wanghao-ftd-SJTU (Shanghai) software2 59.06
20. Uppsala (Uppsala) software1 58.89
21. Mengest (Shanghai) software1 58.85
22. LATTICE (Paris) software7 58.50
naistCL (Nara) software1 58.50
24. Koç University (İstanbul) software3 57.72
25. METU (Ankara) software2 57.29
26. ParisNLP (Paris) software1 55.73
27. MQuni (Sydney) software2 54.68
28. UT (Tartu) software1 52.55
29. OpenU NLP Lab (Ra'anana) software6 42.33
30. TRL (Tokyo) software1 41.18
31. MetaRomance (Santiago de Compostela) software1 35.05
32. Wenba-NLU (Wuhan) software1 17.65
33. ECNU (Shanghai) software1 0.00
grc_proiel
1. IMS (Stuttgart) software2 79.61
2. Stanford (Stanford) software1 78.30
3. C2L2 (Ithaca) software5 75.60
4. RACAI (București) software1 74.89
5. NAIST SATO (Nara) software1 74.33
6. HIT-SCIR (Harbin) software4 74.19
7. LyS-FASTPARSE (A Coruña) software5 73.19
8. fbaml (Palo Alto) software1 73.17
9. TurkuNLP (Turku) software1 72.82
10. ÚFAL – UDPipe 1.2 (Praha) software1 71.72
11. Orange – Deskiñ (Lannion) software1 71.38
12. darc (Tübingen) software1 71.04
13. UParse (Edinburgh) software1 70.97
14. LIMSI-LIPN (Paris) software2 70.42
BASELINE UDPipe 1.1 (Praha) software2 70.42
16. Uppsala (Uppsala) software1 69.85
17. IIT Kharagpur (Kharagpur) software3 68.93
18. naistCL (Nara) software1 68.21
19. Wanghao-ftd-SJTU (Shanghai) software2 68.09
20. Koç University (İstanbul) software3 67.90
21. CLCL (Genève) software2 67.79
22. UALING (Tucson) software1 67.23
23. Mengest (Shanghai) software1 67.06
24. LATTICE (Paris) software7 66.03
25. METU (Ankara) software2 65.92
26. MQuni (Sydney) software2 65.77
27. ParisNLP (Paris) software1 61.39
28. OpenU NLP Lab (Ra'anana) software6 59.13
29. TRL (Tokyo) software1 49.97
30. MetaRomance (Santiago de Compostela) software1 46.87
31. Wenba-NLU (Wuhan) software1 11.42
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
he
1. IMS (Stuttgart) software2 72.10
2. Uppsala (Uppsala) software1 69.22
3. Stanford (Stanford) software1 67.70
4. C2L2 (Ithaca) software5 66.24
5. RACAI (București) software1 66.23
6. LATTICE (Paris) software7 65.12
7. HIT-SCIR (Harbin) software4 64.30
8. NAIST SATO (Nara) software1 64.16
9. LyS-FASTPARSE (A Coruña) software5 63.70
10. MQuni (Sydney) software2 63.35
11. Koç University (İstanbul) software3 63.14
12. UParse (Edinburgh) software1 62.76
13. Orange – Deskiñ (Lannion) software1 62.73
14. Mengest (Shanghai) software1 62.58
15. ÚFAL – UDPipe 1.2 (Praha) software1 62.06
16. TurkuNLP (Turku) software1 61.87
naistCL (Nara) software1 61.87
18. darc (Tübingen) software1 61.58
19. LIMSI-LIPN (Paris) software2 61.54
BASELINE UDPipe 1.1 (Praha) software2 61.54
21. IIT Kharagpur (Kharagpur) software3 60.90
22. Wanghao-ftd-SJTU (Shanghai) software2 60.38
23. UALING (Tucson) software1 59.99
24. CLCL (Genève) software2 59.81
25. METU (Ankara) software2 59.80
26. fbaml (Palo Alto) software1 58.54
27. ParisNLP (Paris) software1 51.65
28. TRL (Tokyo) software1 47.31
29. OpenU NLP Lab (Ra'anana) software6 46.67
30. MetaRomance (Santiago de Compostela) software1 38.10
31. Wenba-NLU (Wuhan) software1 4.70
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
hi
1. Stanford (Stanford) software1 94.70
2. C2L2 (Ithaca) software5 93.92
3. IMS (Stuttgart) software2 93.86
4. HIT-SCIR (Harbin) software4 93.31
5. NAIST SATO (Nara) software1 92.64
6. UParse (Edinburgh) software1 92.39
7. fbaml (Palo Alto) software1 92.31
8. TurkuNLP (Turku) software1 91.71
9. darc (Tübingen) software1 91.52
10. naistCL (Nara) software1 91.51
11. ÚFAL – UDPipe 1.2 (Praha) software1 91.45
12. Koç University (İstanbul) software3 91.26
13. LyS-FASTPARSE (A Coruña) software5 91.11
14. Orange – Deskiñ (Lannion) software1 91.07
15. LIMSI-LIPN (Paris) software2 90.97
BASELINE UDPipe 1.1 (Praha) software2 90.97
17. Mengest (Shanghai) software1 90.93
18. IIT Kharagpur (Kharagpur) software3 90.92
19. LATTICE (Paris) software7 90.82
20. CLCL (Genève) software2 90.74
21. MQuni (Sydney) software2 90.56
22. Wanghao-ftd-SJTU (Shanghai) software2 90.31
23. UT (Tartu) software1 90.28
24. UALING (Tucson) software1 90.25
25. RACAI (București) software1 89.90
26. METU (Ankara) software2 89.22
27. Uppsala (Uppsala) software1 78.45
28. OpenU NLP Lab (Ra'anana) software6 77.74
29. TRL (Tokyo) software1 66.60
30. ParisNLP (Paris) software1 54.84
31. MetaRomance (Santiago de Compostela) software1 14.01
32. Wenba-NLU (Wuhan) software1 9.22
33. ECNU (Shanghai) software1 0.00
hi_pud
1. Stanford (Stanford) software1 67.24
HIT-SCIR (Harbin) software4 67.24
3. C2L2 (Ithaca) software5 66.86
4. IMS (Stuttgart) software2 66.24
5. ÚFAL – UDPipe 1.2 (Praha) software1 65.56
6. NAIST SATO (Nara) software1 65.29
7. UParse (Edinburgh) software1 65.08
8. TurkuNLP (Turku) software1 64.40
9. naistCL (Nara) software1 64.24
10. Koç University (İstanbul) software3 64.16
11. Wanghao-ftd-SJTU (Shanghai) software2 64.07
12. IIT Kharagpur (Kharagpur) software3 63.80
13. LyS-FASTPARSE (A Coruña) software5 63.79
14. CLCL (Genève) software1 63.78
Mengest (Shanghai) software1 63.78
16. Orange – Deskiñ (Lannion) software1 63.64
17. darc (Tübingen) software1 63.63
18. LIMSI-LIPN (Paris) software2 63.43
BASELINE UDPipe 1.1 (Praha) software2 63.43
20. UALING (Tucson) software1 63.13
21. LATTICE (Paris) software7 63.02
22. UT (Tartu) software1 62.45
23. METU (Ankara) software2 62.18
24. MQuni (Sydney) software2 62.10
25. Uppsala (Uppsala) software1 57.43
26. RACAI (București) software1 57.33
27. OpenU NLP Lab (Ra'anana) software6 55.53
28. fbaml (Palo Alto) software1 54.70
29. TRL (Tokyo) software1 51.26
30. ParisNLP (Paris) software1 43.96
31. MetaRomance (Santiago de Compostela) software1 16.65
32. ECNU (Shanghai) software1 12.48
33. Wenba-NLU (Wuhan) software1 0.00
hr
1. Stanford (Stanford) software1 90.11
2. C2L2 (Ithaca) software5 88.55
3. IMS (Stuttgart) software2 87.77
4. LATTICE (Paris) software7 86.66
5. HIT-SCIR (Harbin) software4 86.58
6. NAIST SATO (Nara) software1 85.47
7. MQuni (Sydney) software2 85.20
8. Koç University (İstanbul) software3 84.93
9. TurkuNLP (Turku) software1 84.45
10. RACAI (București) software1 84.13
11. LIMSI-LIPN (Paris) software2 83.88
12. LyS-FASTPARSE (A Coruña) software5 83.75
13. ÚFAL – UDPipe 1.2 (Praha) software1 83.73
14. UT (Tartu) software1 83.62
15. naistCL (Nara) software1 83.41
16. UParse (Edinburgh) software1 83.20
BASELINE UDPipe 1.1 (Praha) software2 83.20
18. Orange – Deskiñ (Lannion) software1 83.13
19. fbaml (Palo Alto) software1 82.95
20. darc (Tübingen) software1 82.87
21. Mengest (Shanghai) software1 82.84
22. IIT Kharagpur (Kharagpur) software3 82.49
23. Uppsala (Uppsala) software1 82.14
24. ParisNLP (Paris) software1 81.40
25. UALING (Tucson) software1 81.11
26. Wanghao-ftd-SJTU (Shanghai) software2 80.92
27. CLCL (Genève) software1 80.48
28. METU (Ankara) software2 78.88
29. OpenU NLP Lab (Ra'anana) software6 68.49
30. TRL (Tokyo) software1 56.49
31. MetaRomance (Santiago de Compostela) software1 48.33
32. Wenba-NLU (Wuhan) software1 10.71
33. ECNU (Shanghai) software1 4.05
hsb
1. C2L2 (Ithaca) software5 69.45 2. IMS (Stuttgart) software2 68.98 3. Stanford (Stanford) software1 67.83 4. UParse (Edinburgh) software1 66.84 5. HIT-SCIR (Harbin) software4 66.64 6. Orange – Deskiñ (Lannion) software1 66.57 7. LIMSI-LIPN (Paris) software2 65.06 8. ParisNLP (Paris) software1 64.67 9. OpenU NLP Lab (Ra'anana) software6 64.50 10. Wanghao-ftd-SJTU (Shanghai) software2 64.33 11. ÚFAL – UDPipe 1.2 (Praha) software1 63.34 12. IIT Kharagpur (Kharagpur) software3 62.54 13. darc (Tübingen) software1 62.33 14. BASELINE UDPipe 1.1 (Praha) software2 61.70 15. LyS-FASTPARSE (A Coruña) software5 61.05 16. LATTICE (Paris) software7 58.83 17. Koç University (İstanbul) software3 57.09 18. naistCL (Nara) software1 56.88 19. CLCL (Genève) software2 55.52 20. Uppsala (Uppsala) software1 54.33 21. UALING (Tucson) software1 54.26 22. RACAI (București) software1 54.24 23. NAIST SATO (Nara) software1 49.38 24. MetaRomance (Santiago de Compostela) software1 45.67 25. TurkuNLP (Turku) software1 42.46 26. fbaml (Palo Alto) software1 37.58 27. Mengest (Shanghai) software1 35.41 28. MQuni (Sydney) software2 31.23 29. METU (Ankara) software2 30.82 30. TRL (Tokyo) software1 30.74 31. ECNU (Shanghai) software1 18.30 32. Wenba-NLU (Wuhan) software1 0.00 33. UT (Tartu) software1 0.00
hu
1. Stanford (Stanford) software1 82.35
2. C2L2 (Ithaca) software5 82.07
3. IMS (Stuttgart) software2 79.90
4. LATTICE (Paris) software7 75.79
5. Koç University (İstanbul) software3 75.59
6. HIT-SCIR (Harbin) software4 74.68
7. fbaml (Palo Alto) software1 74.22
8. MQuni (Sydney) software2 73.54
9. LyS-FASTPARSE (A Coruña) software5 72.68
10. ÚFAL – UDPipe 1.2 (Praha) software1 72.36
11. RACAI (București) software1 72.34
12. LIMSI-LIPN (Paris) software2 72.28
13. Orange – Deskiñ (Lannion) software1 72.08
14. TurkuNLP (Turku) software1 71.88
15. NAIST SATO (Nara) software1 71.87
16. UParse (Edinburgh) software1 71.46
BASELINE UDPipe 1.1 (Praha) software2 71.46
18. IIT Kharagpur (Kharagpur) software3 71.42
19. darc (Tübingen) software1 71.27
20. Wanghao-ftd-SJTU (Shanghai) software2 70.78
21. UALING (Tucson) software1 70.54
22. naistCL (Nara) software1 70.03
23. Mengest (Shanghai) software1 69.30
24. UT (Tartu) software1 68.30
25. METU (Ankara) software2 63.92
26. Uppsala (Uppsala) software1 63.76
27. CLCL (Genève) software1 62.42
28. ParisNLP (Paris) software1 61.98
29. OpenU NLP Lab (Ra'anana) software6 54.56
30. TRL (Tokyo) software1 46.56
31. MetaRomance (Santiago de Compostela) software1 46.09
32. ECNU (Shanghai) software1 24.04
33. Wenba-NLU (Wuhan) software1 3.54
id
1. C2L2 (Ithaca) software5 85.20 2. Stanford (Stanford) software1 85.17 3. IMS (Stuttgart) software2 83.98 4. NAIST SATO (Nara) software1 83.11 5. HIT-SCIR (Harbin) software4 83.06 6. MQuni (Sydney) software2 83.04 7. LATTICE (Paris) software7 82.97 8. UParse (Edinburgh) software1 82.36 9. fbaml (Palo Alto) software1 82.27 10. Koç University (İstanbul) software3 81.78 11. ÚFAL – UDPipe 1.2 (Praha) software1 81.67 12. Orange – Deskiñ (Lannion) software1 81.35 13. UT (Tartu) software1 81.27 14. TurkuNLP (Turku) software1 81.19 15. LIMSI-LIPN (Paris) software2 81.13 16. naistCL (Nara) software1 80.94 17. BASELINE UDPipe 1.1 (Praha) software2 80.91 18. RACAI (București) software1 80.89 19. Mengest (Shanghai) software1 80.70 20. IIT Kharagpur (Kharagpur) software3 80.38 21. darc (Tübingen) software1 79.90 22. LyS-FASTPARSE (A Coruña) software5 79.79 23. Wanghao-ftd-SJTU (Shanghai) software2 79.71 24. Uppsala (Uppsala) software1 79.24 25. UALING (Tucson) software1 79.19 26. METU (Ankara) software2 76.48 27. OpenU NLP Lab (Ra'anana) software6 76.13 28. CLCL (Genève) software2 75.56 29. ParisNLP (Paris) software1 73.81 30. TRL (Tokyo) software1 63.72 31. MetaRomance (Santiago de Compostela) software1 51.93 32. Wenba-NLU (Wuhan) software1 20.77 33. ECNU (Shanghai) software1 19.17
it
1. Stanford (Stanford) software1 92.51
2. C2L2 (Ithaca) software5 91.76
3. LATTICE (Paris) software7 90.48
4. IMS (Stuttgart) software2 90.29
5. HIT-SCIR (Harbin) software4 90.05
6. NAIST SATO (Nara) software1 89.93
7. MQuni (Sydney) software2 89.70
8. UParse (Edinburgh) software1 89.69
9. Orange – Deskiñ (Lannion) software1 89.36
10. Mengest (Shanghai) software1 89.10
11. Koç University (İstanbul) software3 89.06
12. naistCL (Nara) software1 88.91
13. ÚFAL – UDPipe 1.2 (Praha) software1 88.62
14. fbaml (Palo Alto) software1 88.42
15. LyS-FASTPARSE (A Coruña) software5 88.30
16. TurkuNLP (Turku) software1 88.29
17. CLCL (Genève) software2 88.04
18. LIMSI-LIPN (Paris) software2 88.03
BASELINE UDPipe 1.1 (Praha) software2 88.03
20. RACAI (București) software1 87.98
21. Uppsala (Uppsala) software1 87.86
22. darc (Tübingen) software1 87.73
23. IIT Kharagpur (Kharagpur) software3 87.54
24. Wanghao-ftd-SJTU (Shanghai) software2 87.27
25. UALING (Tucson) software1 86.89
26. METU (Ankara) software2 85.92
27. ParisNLP (Paris) software1 85.55
28. OpenU NLP Lab (Ra'anana) software6 81.98
29. MetaRomance (Santiago de Compostela) software1 70.35
30. TRL (Tokyo) software1 57.96
31. Wenba-NLU (Wuhan) software1 2.99
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
it_pud
1. Stanford (Stanford) software1 91.08
2. C2L2 (Ithaca) software5 90.21
3. LATTICE (Paris) software7 89.78
4. IMS (Stuttgart) software2 89.38
5. UParse (Edinburgh) software1 88.79
6. NAIST SATO (Nara) software1 88.61
7. HIT-SCIR (Harbin) software4 88.59
8. MQuni (Sydney) software2 88.58
9. Orange – Deskiñ (Lannion) software1 88.21
10. Koç University (İstanbul) software3 87.83
11. fbaml (Palo Alto) software1 87.72
12. TurkuNLP (Turku) software1 87.48
13. naistCL (Nara) software1 87.46
14. ÚFAL – UDPipe 1.2 (Praha) software1 87.39
15. Mengest (Shanghai) software1 87.23
16. LyS-FASTPARSE (A Coruña) software5 87.16
17. LIMSI-LIPN (Paris) software2 87.04
BASELINE UDPipe 1.1 (Praha) software2 87.04
19. darc (Tübingen) software1 86.93
20. Uppsala (Uppsala) software1 86.89
21. RACAI (București) software1 86.73
22. IIT Kharagpur (Kharagpur) software3 86.47
23. CLCL (Genève) software1 86.35
24. Wanghao-ftd-SJTU (Shanghai) software2 86.06
25. UALING (Tucson) software1 85.93
26. ParisNLP (Paris) software1 85.91
27. METU (Ankara) software2 84.31
28. OpenU NLP Lab (Ra'anana) software6 80.01
29. MetaRomance (Santiago de Compostela) software1 71.82
30. TRL (Tokyo) software1 58.76
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
ja
1. TRL (Tokyo) software1 91.14
2. HIT-SCIR (Harbin) software4 81.94
3. LIMSI-LIPN (Paris) software2 81.38
4. fbaml (Palo Alto) software1 80.71
5. IMS (Stuttgart) software2 79.06
6. ÚFAL – UDPipe 1.2 (Praha) software1 75.81
7. C2L2 (Ithaca) software5 75.46
8. Stanford (Stanford) software1 75.42
9. LATTICE (Paris) software7 74.99
10. UT (Tartu) software1 74.58
11. Orange – Deskiñ (Lannion) software1 74.51
12. NAIST SATO (Nara) software1 74.46
13. MQuni (Sydney) software2 74.27
14. Mengest (Shanghai) software1 74.26
15. naistCL (Nara) software1 74.23
16. darc (Tübingen) software1 74.17
17. TurkuNLP (Turku) software1 74.01
18. LyS-FASTPARSE (A Coruña) software5 73.98
19. Koç University (İstanbul) software3 73.88
20. IIT Kharagpur (Kharagpur) software3 73.67
21. UParse (Edinburgh) software1 73.52
BASELINE UDPipe 1.1 (Praha) software2 73.52
23. Wanghao-ftd-SJTU (Shanghai) software2 73.47
24. CLCL (Genève) software2 73.46
25. UALING (Tucson) software1 73.22
26. ParisNLP (Paris) software1 72.57
27. METU (Ankara) software2 72.43
28. OpenU NLP Lab (Ra'anana) software6 70.79
29. RACAI (București) software1 69.14
30. Uppsala (Uppsala) software1 67.37
31. MetaRomance (Santiago de Compostela) software1 9.61
32. ECNU (Shanghai) software1 8.16
33. Wenba-NLU (Wuhan) software1 6.26
ja_pud
1. HIT-SCIR (Harbin) software4 84.38
2. LIMSI-LIPN (Paris) software2 83.93
3. IMS (Stuttgart) software2 82.55
4. fbaml (Palo Alto) software1 82.04
5. ÚFAL – UDPipe 1.2 (Praha) software1 79.26
6. C2L2 (Ithaca) software5 78.85
7. Stanford (Stanford) software1 78.64
8. LATTICE (Paris) software7 78.09
9. MQuni (Sydney) software2 77.66
10. NAIST SATO (Nara) software1 77.65
11. Orange – Deskiñ (Lannion) software1 77.58
Mengest (Shanghai) software1 77.58
13. UT (Tartu) software1 77.43
14. naistCL (Nara) software1 77.38
15. Koç University (İstanbul) software3 77.18
16. UParse (Edinburgh) software1 77.15
17. BASELINE UDPipe 1.1 (Praha) software2 77.13
18. IIT Kharagpur (Kharagpur) software3 77.10
19. CLCL (Genève) software1 77.06
20. LyS-FASTPARSE (A Coruña) software5 77.02
21. TurkuNLP (Turku) software1 76.85
22. Wanghao-ftd-SJTU (Shanghai) software2 76.74
23. darc (Tübingen) software1 76.73
UALING (Tucson) software1 76.73
25. METU (Ankara) software2 76.25
26. RACAI (București) software1 74.92
27. Uppsala (Uppsala) software1 73.09
OpenU NLP Lab (Ra'anana) software6 73.09
29. ParisNLP (Paris) software1 69.11
30. TRL (Tokyo) software1 67.47
31. MetaRomance (Santiago de Compostela) software1 8.15
32. ECNU (Shanghai) software1 7.59
33. Wenba-NLU (Wuhan) software1 0.00
kk
1. TRL (Tokyo) software1 45.72
2. fbaml (Palo Alto) software1 44.67
3. IMS (Stuttgart) software2 44.25
4. C2L2 (Ithaca) software5 43.90
5. TurkuNLP (Turku) software1 43.51
Stanford (Stanford) software1 43.51
7. naistCL (Nara) software1 43.11
8. RACAI (București) software1 43.01
9. HIT-SCIR (Harbin) software4 42.11
10. BASELINE UDPipe 1.1 (Praha) software2 41.92
11. ÚFAL – UDPipe 1.2 (Praha) software1 41.77
12. UParse (Edinburgh) software1 41.60
13. Orange – Deskiñ (Lannion) software1 41.50
14. ParisNLP (Paris) software1 40.91
15. MQuni (Sydney) software2 40.85
16. LATTICE (Paris) software7 40.56
17. NAIST SATO (Nara) software1 40.12
18. IIT Kharagpur (Kharagpur) software3 40.04
19. darc (Tübingen) software1 39.90
20. UALING (Tucson) software1 39.61
21. Koç University (İstanbul) software3 38.41
22. LIMSI-LIPN (Paris) software2 37.92
23. Uppsala (Uppsala) software1 37.66
24. Wanghao-ftd-SJTU (Shanghai) software2 35.22
25. LyS-FASTPARSE (A Coruña) software5 34.79
26. METU (Ankara) software2 31.00
27. OpenU NLP Lab (Ra'anana) software6 30.40
28. MetaRomance (Santiago de Compostela) software1 18.28
29. CLCL (Genève) software2 8.20
30. Wenba-NLU (Wuhan) software1 0.00
31. ECNU (Shanghai) software1 0.00
32. UT (Tartu) software1 0.00
33. Mengest (Shanghai) software1 0.00
kmr
1. IMS (Stuttgart) software2 54.73 2. C2L2 (Ithaca) software5 54.51 3. HIT-SCIR (Harbin) software4 52.55 4. UParse (Edinburgh) software1 52.22 5. LATTICE (Paris) software7 51.80 6. OpenU NLP Lab (Ra'anana) software6 51.24 7. Orange – Deskiñ (Lannion) software1 50.76 8. Koç University (İstanbul) software3 49.32 9. LIMSI-LIPN (Paris) software2 48.67 10. UALING (Tucson) software1 48.66 11. ParisNLP (Paris) software1 47.76 12. Stanford (Stanford) software1 47.71 13. IIT Kharagpur (Kharagpur) software3 46.45 14. ÚFAL – UDPipe 1.2 (Praha) software1 46.33 15. darc (Tübingen) software1 46.32 16. BASELINE UDPipe 1.1 (Praha) software2 46.20 17. LyS-FASTPARSE (A Coruña) software5 45.37 18. naistCL (Nara) software1 43.73 19. MetaRomance (Santiago de Compostela) software1 35.02 20. fbaml (Palo Alto) software1 33.98 21. Uppsala (Uppsala) software1 33.22 22. TurkuNLP (Turku) software1 32.54 23. CLCL (Genève) software2 32.52 24. Mengest (Shanghai) software1 32.15 25. RACAI (București) software1 32.05 26. NAIST SATO (Nara) software1 31.68 27. METU (Ankara) software2 31.01 28. Wanghao-ftd-SJTU (Shanghai) software2 30.49 29. MQuni (Sydney) software2 30.20 30. TRL (Tokyo) software1 10.59 31. Wenba-NLU (Wuhan) software1 0.00 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
ko
1. Stanford (Stanford) software1 85.90
2. C2L2 (Ithaca) software5 84.86
3. IMS (Stuttgart) software2 83.08
4. naistCL (Nara) software1 79.29
5. MQuni (Sydney) software2 78.80
6. LATTICE (Paris) software7 77.42
7. Koç University (İstanbul) software3 77.05
8. HIT-SCIR (Harbin) software4 76.95
9. Uppsala (Uppsala) software1 75.09
10. Orange – Deskiñ (Lannion) software1 73.66
11. TurkuNLP (Turku) software1 72.18
12. NAIST SATO (Nara) software1 71.48
13. UT (Tartu) software1 70.94
14. LyS-FASTPARSE (A Coruña) software5 70.38
15. METU (Ankara) software2 70.17
16. Mengest (Shanghai) software1 69.83
17. RACAI (București) software1 69.45
18. fbaml (Palo Alto) software1 68.14
19. CLCL (Genève) software2 67.61
20. ÚFAL – UDPipe 1.2 (Praha) software1 66.64
21. UParse (Edinburgh) software1 66.40
LIMSI-LIPN (Paris) software2 66.40
BASELINE UDPipe 1.1 (Praha) software2 66.40
24. IIT Kharagpur (Kharagpur) software3 65.53
25. darc (Tübingen) software1 65.38
26. Wanghao-ftd-SJTU (Shanghai) software2 61.83
27. UALING (Tucson) software1 61.45
28. OpenU NLP Lab (Ra'anana) software6 60.75
29. TRL (Tokyo) software1 55.54
30. ParisNLP (Paris) software1 51.08
31. ECNU (Shanghai) software1 37.84
32. MetaRomance (Santiago de Compostela) software1 27.35
33. Wenba-NLU (Wuhan) software1 0.00
la
1. Stanford (Stanford) software1 72.56
2. C2L2 (Ithaca) software5 69.42
3. NAIST SATO (Nara) software1 63.60
4. IMS (Stuttgart) software2 62.23
5. LATTICE (Paris) software7 62.07
6. LyS-FASTPARSE (A Coruña) software5 60.66
7. fbaml (Palo Alto) software1 60.60
8. HIT-SCIR (Harbin) software4 59.15
RACAI (București) software1 59.15
10. TurkuNLP (Turku) software1 58.37
11. MQuni (Sydney) software2 57.74
12. ÚFAL – UDPipe 1.2 (Praha) software1 57.57
13. Koç University (İstanbul) software3 56.85
14. darc (Tübingen) software1 55.64
15. LIMSI-LIPN (Paris) software2 55.22
16. UALING (Tucson) software1 55.03
17. IIT Kharagpur (Kharagpur) software3 54.68
18. Orange – Deskiñ (Lannion) software1 54.41
19. Wanghao-ftd-SJTU (Shanghai) software2 54.35
UParse (Edinburgh) software1 54.35
BASELINE UDPipe 1.1 (Praha) software2 54.35
22. Uppsala (Uppsala) software1 53.07
23. UT (Tartu) software1 51.70
24. ParisNLP (Paris) software1 50.56
25. Mengest (Shanghai) software1 49.57
26. naistCL (Nara) software1 49.35
27. TRL (Tokyo) software1 37.40
28. OpenU NLP Lab (Ra'anana) software6 36.86
29. MetaRomance (Santiago de Compostela) software1 36.46
30. METU (Ankara) software2 29.71
31. CLCL (Genève) software2 18.01
32. ECNU (Shanghai) software1 15.69
33. Wenba-NLU (Wuhan) software1 0.00
la_ittb
1. Stanford (Stanford) software1 89.44
2. IMS (Stuttgart) software2 87.00
3. C2L2 (Ithaca) software5 86.10
4. NAIST SATO (Nara) software1 85.53
5. HIT-SCIR (Harbin) software4 84.07
6. Uppsala (Uppsala) software1 84.05
7. LyS-FASTPARSE (A Coruña) software5 83.66
8. UParse (Edinburgh) software1 83.55
9. TurkuNLP (Turku) software1 82.70
10. fbaml (Palo Alto) software1 82.08
11. LIMSI-LIPN (Paris) software2 80.78
BASELINE UDPipe 1.1 (Praha) software2 80.78
13. Orange – Deskiñ (Lannion) software1 80.77
14. Koç University (İstanbul) software3 79.90
15. CLCL (Genève) software1 79.88
16. darc (Tübingen) software1 79.86
17. IIT Kharagpur (Kharagpur) software3 79.76
18. ÚFAL – UDPipe 1.2 (Praha) software1 79.74
19. naistCL (Nara) software1 79.72
20. RACAI (București) software1 79.61
21. Wanghao-ftd-SJTU (Shanghai) software2 78.98
22. LATTICE (Paris) software7 78.75
23. Mengest (Shanghai) software1 78.58
24. MQuni (Sydney) software2 77.97
25. UALING (Tucson) software1 77.42
26. METU (Ankara) software2 75.41
27. ParisNLP (Paris) software1 62.17
28. OpenU NLP Lab (Ra'anana) software6 57.99
29. TRL (Tokyo) software1 47.21
30. UT (Tartu) software1 42.41
31. MetaRomance (Santiago de Compostela) software1 38.50
32. ECNU (Shanghai) software1 18.09
33. Wenba-NLU (Wuhan) software1 0.00
la_proiel
1. IMS (Stuttgart) software2 76.16
2. Stanford (Stanford) software1 73.71
3. C2L2 (Ithaca) software5 69.53
4. HIT-SCIR (Harbin) software4 68.94
5. fbaml (Palo Alto) software1 67.80
6. NAIST SATO (Nara) software1 67.68
RACAI (București) software1 67.68
8. LyS-FASTPARSE (A Coruña) software5 67.57
9. Orange – Deskiñ (Lannion) software1 66.70
10. ÚFAL – UDPipe 1.2 (Praha) software1 66.45
11. Uppsala (Uppsala) software1 65.70
12. Koç University (İstanbul) software3 65.32
13. darc (Tübingen) software1 65.11
14. TurkuNLP (Turku) software1 65.03
15. LIMSI-LIPN (Paris) software2 63.50
BASELINE UDPipe 1.1 (Praha) software2 63.50
17. UParse (Edinburgh) software1 63.47
18. IIT Kharagpur (Kharagpur) software3 62.68
19. Mengest (Shanghai) software1 61.73
20. LATTICE (Paris) software7 61.35
21. Wanghao-ftd-SJTU (Shanghai) software2 61.23
22. naistCL (Nara) software1 60.93
23. CLCL (Genève) software1 60.31
24. UALING (Tucson) software1 60.29
25. MQuni (Sydney) software2 58.95
26. METU (Ankara) software2 58.59
27. ParisNLP (Paris) software1 52.79
28. OpenU NLP Lab (Ra'anana) software6 46.46
29. TRL (Tokyo) software1 43.87
30. MetaRomance (Santiago de Compostela) software1 37.80
31. Wenba-NLU (Wuhan) software1 10.30
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
lv
1. Stanford (Stanford) software1 79.26
2. C2L2 (Ithaca) software5 77.43
3. IMS (Stuttgart) software2 74.49
4. HIT-SCIR (Harbin) software4 71.91
5. LATTICE (Paris) software7 71.69
6. LyS-FASTPARSE (A Coruña) software5 71.08
7. Koç University (İstanbul) software3 70.79
8. TurkuNLP (Turku) software1 69.15
fbaml (Palo Alto) software1 69.15
10. Orange – Deskiñ (Lannion) software1 68.86
11. NAIST SATO (Nara) software1 68.83
12. darc (Tübingen) software1 68.77
13. RACAI (București) software1 68.54
14. ÚFAL – UDPipe 1.2 (Praha) software1 68.38
15. IIT Kharagpur (Kharagpur) software3 68.21
16. MQuni (Sydney) software2 68.15
17. UParse (Edinburgh) software1 67.14
BASELINE UDPipe 1.1 (Praha) software2 67.14
19. Mengest (Shanghai) software1 66.84
20. UALING (Tucson) software1 66.77
21. LIMSI-LIPN (Paris) software2 66.71
22. CLCL (Genève) software1 66.39
23. Wanghao-ftd-SJTU (Shanghai) software2 66.31
24. UT (Tartu) software1 66.04
25. naistCL (Nara) software1 65.27
26. METU (Ankara) software2 63.45
27. Uppsala (Uppsala) software1 61.14
28. ParisNLP (Paris) software1 60.09
29. OpenU NLP Lab (Ra'anana) software6 58.08
30. TRL (Tokyo) software1 45.13
31. MetaRomance (Santiago de Compostela) software1 36.54
32. ECNU (Shanghai) software1 22.03
33. Wenba-NLU (Wuhan) software1 18.08
nl
1. Stanford (Stanford) software1 85.17 2. C2L2 (Ithaca) software5 82.28 3. IMS (Stuttgart) software2 81.01 4. NAIST SATO (Nara) software1 79.16 5. HIT-SCIR (Harbin) software4 78.90 6. fbaml (Palo Alto) software1 77.93 7. LyS-FASTPARSE (A Coruña) software5 77.72 8. Uppsala (Uppsala) software1 77.22 9. UParse (Edinburgh) software1 76.85 10. LATTICE (Paris) software7 76.68 11. ÚFAL – UDPipe 1.2 (Praha) software1 76.50 12. MQuni (Sydney) software2 76.44 13. RACAI (București) software1 76.32 14. Orange – Deskiñ (Lannion) software1 76.28 15. Koç University (İstanbul) software3 75.89 16. TurkuNLP (Turku) software1 75.50 17. BASELINE UDPipe 1.1 (Praha) software2 74.94 18. darc (Tübingen) software1 74.89 19. Mengest (Shanghai) software1 74.83 20. LIMSI-LIPN (Paris) software2 74.67 21. IIT Kharagpur (Kharagpur) software3 74.19 22. naistCL (Nara) software1 74.05 23. Wanghao-ftd-SJTU (Shanghai) software2 73.87 24. CLCL (Genève) software1 73.80 25. UT (Tartu) software1 73.38 26. UALING (Tucson) software1 72.36 27. METU (Ankara) software2 70.95 28. ParisNLP (Paris) software1 66.23 29. OpenU NLP Lab (Ra'anana) software6 50.44 30. TRL (Tokyo) software1 47.58 31. MetaRomance (Santiago de Compostela) software1 44.98 32. ECNU (Shanghai) software1 20.95 33. Wenba-NLU (Wuhan) software1 13.76
nl_lassysmall
1. Stanford (Stanford) software1 89.56
2. IMS (Stuttgart) software2 89.32
3. HIT-SCIR (Harbin) software4 89.06
4. NAIST SATO (Nara) software1 87.74
5. fbaml (Palo Alto) software1 86.35
6. LyS-FASTPARSE (A Coruña) software5 85.29
7. C2L2 (Ithaca) software5 84.83
8. RACAI (București) software1 84.05
9. UParse (Edinburgh) software1 83.34
10. Koç University (İstanbul) software3 83.14
11. ÚFAL – UDPipe 1.2 (Praha) software1 82.76
12. darc (Tübingen) software1 82.73
naistCL (Nara) software1 82.73
14. TurkuNLP (Turku) software1 81.76
15. Uppsala (Uppsala) software1 81.66
16. LIMSI-LIPN (Paris) software2 81.37
BASELINE UDPipe 1.1 (Praha) software2 81.37
18. Wanghao-ftd-SJTU (Shanghai) software2 81.25
19. Orange – Deskiñ (Lannion) software1 80.39
20. LATTICE (Paris) software7 79.44
21. IIT Kharagpur (Kharagpur) software3 78.46
22. CLCL (Genève) software1 77.13
23. UALING (Tucson) software1 76.47
24. MQuni (Sydney) software2 76.34
25. Mengest (Shanghai) software1 75.56
26. METU (Ankara) software2 75.02
27. OpenU NLP Lab (Ra'anana) software6 73.80
28. UT (Tartu) software1 69.22
29. ParisNLP (Paris) software1 64.76
30. MetaRomance (Santiago de Compostela) software1 51.82
31. TRL (Tokyo) software1 45.95
32. ECNU (Shanghai) software1 20.59
33. Wenba-NLU (Wuhan) software1 10.45
no_bokmaal
1. Stanford (Stanford) software1 91.60
2. C2L2 (Ithaca) software5 90.10
3. HIT-SCIR (Harbin) software4 89.09
4. IMS (Stuttgart) software2 88.58
5. NAIST SATO (Nara) software1 88.55
6. LATTICE (Paris) software7 88.12
7. MQuni (Sydney) software2 87.42
8. LyS-FASTPARSE (A Coruña) software5 87.19
9. UParse (Edinburgh) software1 87.14
10. Orange – Deskiñ (Lannion) software1 86.69
11. ÚFAL – UDPipe 1.2 (Praha) software1 86.62
12. Koç University (İstanbul) software3 86.52
13. TurkuNLP (Turku) software1 86.40
14. Uppsala (Uppsala) software1 86.33
15. LIMSI-LIPN (Paris) software2 86.14
BASELINE UDPipe 1.1 (Praha) software2 86.14
17. fbaml (Palo Alto) software1 85.80
18. naistCL (Nara) software1 85.61
19. IIT Kharagpur (Kharagpur) software3 85.51
20. CLCL (Genève) software1 85.29
21. darc (Tübingen) software1 85.13
22. Wanghao-ftd-SJTU (Shanghai) software2 84.44
23. UALING (Tucson) software1 83.92
24. RACAI (București) software1 83.84
25. METU (Ankara) software2 82.27
26. OpenU NLP Lab (Ra'anana) software6 80.69
27. Mengest (Shanghai) software1 80.63
28. ParisNLP (Paris) software1 75.36
29. TRL (Tokyo) software1 57.07
30. MetaRomance (Santiago de Compostela) software1 49.93
31. Wenba-NLU (Wuhan) software1 13.86
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
no_nynorsk
1. Stanford (Stanford) software1 90.75
2. C2L2 (Ithaca) software5 89.70
3. HIT-SCIR (Harbin) software4 87.95
4. IMS (Stuttgart) software2 87.84
5. LATTICE (Paris) software7 87.57
6. NAIST SATO (Nara) software1 87.22
7. LyS-FASTPARSE (A Coruña) software5 86.13
8. ÚFAL – UDPipe 1.2 (Praha) software1 85.86
9. UParse (Edinburgh) software1 85.81
10. Koç University (İstanbul) software3 85.60
11. MQuni (Sydney) software2 85.30
12. TurkuNLP (Turku) software1 85.28
13. Orange – Deskiñ (Lannion) software1 85.05
14. LIMSI-LIPN (Paris) software2 84.88
BASELINE UDPipe 1.1 (Praha) software2 84.88
16. Uppsala (Uppsala) software1 84.67
17. IIT Kharagpur (Kharagpur) software3 84.42
18. naistCL (Nara) software1 84.22
19. darc (Tübingen) software1 84.09
20. Wanghao-ftd-SJTU (Shanghai) software2 83.44
21. UALING (Tucson) software1 82.72
22. CLCL (Genève) software1 82.49
23. RACAI (București) software1 82.33
24. METU (Ankara) software2 80.29
25. OpenU NLP Lab (Ra'anana) software6 76.51
26. Mengest (Shanghai) software1 76.02
27. ParisNLP (Paris) software1 72.62
28. TRL (Tokyo) software1 54.20
29. MetaRomance (Santiago de Compostela) software1 46.52
30. fbaml (Palo Alto) software1 23.91
31. Wenba-NLU (Wuhan) software1 6.87
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
pl
1. Stanford (Stanford) software1 93.98
2. C2L2 (Ithaca) software5 91.96
3. IMS (Stuttgart) software2 91.33
4. LATTICE (Paris) software7 90.72
5. HIT-SCIR (Harbin) software4 88.18
6. LyS-FASTPARSE (A Coruña) software5 88.10
7. MQuni (Sydney) software2 88.01
8. Orange – Deskiñ (Lannion) software1 87.89
9. NAIST SATO (Nara) software1 86.89
10. Koç University (İstanbul) software3 86.77
11. ÚFAL – UDPipe 1.2 (Praha) software1 86.31
12. naistCL (Nara) software1 86.19
13. TurkuNLP (Turku) software1 86.04
14. LIMSI-LIPN (Paris) software2 85.97
15. darc (Tübingen) software1 85.75
16. RACAI (București) software1 85.56
17. IIT Kharagpur (Kharagpur) software3 85.39
18. CLCL (Genève) software1 85.15
19. UParse (Edinburgh) software1 85.08
BASELINE UDPipe 1.1 (Praha) software2 85.08
21. UALING (Tucson) software1 84.81
22. Wanghao-ftd-SJTU (Shanghai) software2 84.53
23. Uppsala (Uppsala) software1 84.50
24. fbaml (Palo Alto) software1 84.05
25. METU (Ankara) software2 82.70
26. ParisNLP (Paris) software1 81.99
27. Mengest (Shanghai) software1 76.13
28. OpenU NLP Lab (Ra'anana) software6 71.07
29. TRL (Tokyo) software1 68.47
30. MetaRomance (Santiago de Compostela) software1 51.17
31. Wenba-NLU (Wuhan) software1 37.21
32. ECNU (Shanghai) software1 12.10
33. UT (Tartu) software1 0.00
pt
1. Stanford (Stanford) software1 89.90
2. C2L2 (Ithaca) software5 87.93
3. IMS (Stuttgart) software2 87.92
4. HIT-SCIR (Harbin) software4 87.75
5. NAIST SATO (Nara) software1 87.70
6. LATTICE (Paris) software7 87.35
7. UParse (Edinburgh) software1 86.84
8. MQuni (Sydney) software2 86.68
9. ÚFAL – UDPipe 1.2 (Praha) software1 86.30
10. Koç University (İstanbul) software3 86.29
11. TurkuNLP (Turku) software1 86.01
12. RACAI (București) software1 85.81
13. LIMSI-LIPN (Paris) software2 85.77
BASELINE UDPipe 1.1 (Praha) software2 85.77
15. naistCL (Nara) software1 85.67
16. fbaml (Palo Alto) software1 85.15
17. darc (Tübingen) software1 84.88
18. Uppsala (Uppsala) software1 84.56
19. LyS-FASTPARSE (A Coruña) software5 84.54
20. IIT Kharagpur (Kharagpur) software3 84.36
21. Wanghao-ftd-SJTU (Shanghai) software2 83.94
22. CLCL (Genève) software1 83.23
23. ParisNLP (Paris) software1 83.13
24. Orange – Deskiñ (Lannion) software1 80.69
25. METU (Ankara) software2 80.57
26. MetaRomance (Santiago de Compostela) software1 71.77
27. Mengest (Shanghai) software1 68.85
28. OpenU NLP Lab (Ra'anana) software6 59.59
29. TRL (Tokyo) software1 52.04
30. UALING (Tucson) software1 43.38
31. Wenba-NLU (Wuhan) software1 12.60
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
pt_br
1. Stanford (Stanford) software1 92.76
2. C2L2 (Ithaca) software5 91.29
3. LATTICE (Paris) software7 90.57
4. HIT-SCIR (Harbin) software4 90.51
5. NAIST SATO (Nara) software1 90.06
6. MQuni (Sydney) software2 89.99
7. IMS (Stuttgart) software2 89.59
8. Orange – Deskiñ (Lannion) software1 89.30
9. UParse (Edinburgh) software1 89.16
10. LyS-FASTPARSE (A Coruña) software5 89.06
11. Koç University (İstanbul) software3 88.95
12. TurkuNLP (Turku) software1 88.56
13. Uppsala (Uppsala) software1 88.44
14. naistCL (Nara) software1 88.35
15. ÚFAL – UDPipe 1.2 (Praha) software1 88.18
16. LIMSI-LIPN (Paris) software2 87.75
BASELINE UDPipe 1.1 (Praha) software2 87.75
18. fbaml (Palo Alto) software1 87.57
19. darc (Tübingen) software1 87.39
20. RACAI (București) software1 86.92
21. IIT Kharagpur (Kharagpur) software3 86.79
22. CLCL (Genève) software1 86.45
23. Wanghao-ftd-SJTU (Shanghai) software2 86.20
24. METU (Ankara) software2 85.70
25. UALING (Tucson) software1 85.30
26. OpenU NLP Lab (Ra'anana) software6 83.90
27. Mengest (Shanghai) software1 82.99
28. ParisNLP (Paris) software1 75.38
29. MetaRomance (Santiago de Compostela) software1 65.80
30. TRL (Tokyo) software1 53.10
31. Wenba-NLU (Wuhan) software1 10.40
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
pt_pud
1. C2L2 (Ithaca) software5 84.19 2. IMS (Stuttgart) software2 83.84 3. Stanford (Stanford) software1 83.27 4. NAIST SATO (Nara) software1 82.58 5. LATTICE (Paris) software7 82.48 6. UParse (Edinburgh) software1 81.42 7. Koç University (İstanbul) software3 81.29 8. HIT-SCIR (Harbin) software4 81.18 9. MQuni (Sydney) software2 80.95 10. ParisNLP (Paris) software1 80.64 11. naistCL (Nara) software1 80.45 12. ÚFAL – UDPipe 1.2 (Praha) software1 80.32 13. TurkuNLP (Turku) software1 80.12 14. BASELINE UDPipe 1.1 (Praha) software2 80.10 15. darc (Tübingen) software1 79.96 16. RACAI (București) software1 79.85 17. IIT Kharagpur (Kharagpur) software3 79.09 18. CLCL (Genève) software1 78.95 19. Wanghao-ftd-SJTU (Shanghai) software2 78.81 20. fbaml (Palo Alto) software1 78.75 21. Uppsala (Uppsala) software1 78.69 22. Orange – Deskiñ (Lannion) software1 76.19 23. METU (Ankara) software2 75.47 24. MetaRomance (Santiago de Compostela) software1 71.43 25. LIMSI-LIPN (Paris) software2 67.78 26. Mengest (Shanghai) software1 67.63 27. LyS-FASTPARSE (A Coruña) software5 67.19 28. OpenU NLP Lab (Ra'anana) software6 60.53 29. TRL (Tokyo) software1 54.83 30. UALING (Tucson) software1 42.66 31. Wenba-NLU (Wuhan) software1 0.00 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
ro
1. Stanford (Stanford) software1 90.43
2. C2L2 (Ithaca) software5 89.46
3. IMS (Stuttgart) software2 88.40
4. LATTICE (Paris) software7 87.50
5. HIT-SCIR (Harbin) software4 87.30
6. NAIST SATO (Nara) software1 87.28
7. UParse (Edinburgh) software1 86.97
8. Koç University (İstanbul) software3 86.95
9. Orange – Deskiñ (Lannion) software1 86.73
10. fbaml (Palo Alto) software1 86.68
11. LyS-FASTPARSE (A Coruña) software5 86.56
12. MQuni (Sydney) software2 86.11
13. TurkuNLP (Turku) software1 85.92
14. darc (Tübingen) software1 85.86
15. RACAI (București) software1 85.75
16. ÚFAL – UDPipe 1.2 (Praha) software1 85.74
17. LIMSI-LIPN (Paris) software2 85.50
BASELINE UDPipe 1.1 (Praha) software2 85.50
19. Uppsala (Uppsala) software1 85.47
20. naistCL (Nara) software1 85.31
21. UT (Tartu) software1 84.20
22. Wanghao-ftd-SJTU (Shanghai) software2 83.96
23. IIT Kharagpur (Kharagpur) software3 83.87
24. ParisNLP (Paris) software1 83.16
CLCL (Genève) software1 83.16
26. UALING (Tucson) software1 82.56
27. METU (Ankara) software2 82.52
28. OpenU NLP Lab (Ra'anana) software6 79.55
29. Mengest (Shanghai) software1 73.45
30. TRL (Tokyo) software1 64.24
31. MetaRomance (Santiago de Compostela) software1 53.90
32. Wenba-NLU (Wuhan) software1 0.00
33. ECNU (Shanghai) software1 0.00
ru
1. C2L2 (Ithaca) software5 87.43
2. Stanford (Stanford) software1 87.15
3. IMS (Stuttgart) software2 85.62
4. HIT-SCIR (Harbin) software4 84.32
5. LATTICE (Paris) software7 82.86
6. NAIST SATO (Nara) software1 82.75
7. LyS-FASTPARSE (A Coruña) software5 82.05
8. MQuni (Sydney) software2 81.62
9. Koç University (İstanbul) software3 81.58
fbaml (Palo Alto) software1 81.58
11. Orange – Deskiñ (Lannion) software1 81.22
12. RACAI (București) software1 81.06
13. ÚFAL – UDPipe 1.2 (Praha) software1 80.94
14. LIMSI-LIPN (Paris) software2 80.51
15. naistCL (Nara) software1 80.27
16. darc (Tübingen) software1 79.69
17. IIT Kharagpur (Kharagpur) software3 79.56
18. UParse (Edinburgh) software1 79.28
BASELINE UDPipe 1.1 (Praha) software2 79.28
20. TurkuNLP (Turku) software1 79.22
21. UALING (Tucson) software1 78.51
22. Uppsala (Uppsala) software1 78.07
23. CLCL (Genève) software1 77.37
24. METU (Ankara) software2 76.84
25. ParisNLP (Paris) software1 73.08
26. Mengest (Shanghai) software1 65.09
27. OpenU NLP Lab (Ra'anana) software6 64.02
28. Wanghao-ftd-SJTU (Shanghai) software2 61.60
29. TRL (Tokyo) software1 55.70
30. MetaRomance (Santiago de Compostela) software1 53.94
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
ru_pud
1. Stanford (Stanford) software1 82.31 2. LATTICE (Paris) software7 79.31 3. Koç University (İstanbul) software3 78.31 4. NAIST SATO (Nara) software1 77.93 5. fbaml (Palo Alto) software1 77.50 6. RACAI (București) software1 77.32 7. Orange – Deskiñ (Lannion) software1 77.26 8. UParse (Edinburgh) software1 77.24 9. MQuni (Sydney) software2 76.71 10. ÚFAL – UDPipe 1.2 (Praha) software1 76.69 11. TurkuNLP (Turku) software1 76.39 12. naistCL (Nara) software1 75.98 13. darc (Tübingen) software1 75.92 14. BASELINE UDPipe 1.1 (Praha) software2 75.67 15. CLCL (Genève) software1 75.34 16. UALING (Tucson) software1 74.94 17. Uppsala (Uppsala) software1 73.84 18. ParisNLP (Paris) software1 73.70 19. METU (Ankara) software2 73.54 20. IMS (Stuttgart) software2 73.32 21. C2L2 (Ithaca) software5 72.86 22. IIT Kharagpur (Kharagpur) software3 72.78 23. HIT-SCIR (Harbin) software4 72.33 24. Mengest (Shanghai) software1 63.41 25. LIMSI-LIPN (Paris) software2 62.76 26. OpenU NLP Lab (Ra'anana) software6 61.06 27. TRL (Tokyo) software1 58.58 28. UT (Tartu) software1 57.49 29. Wanghao-ftd-SJTU (Shanghai) software2 56.23 30. LyS-FASTPARSE (A Coruña) software5 55.16 31. MetaRomance (Santiago de Compostela) software1 54.32 32. ECNU (Shanghai) software1 25.26 33. Wenba-NLU (Wuhan) software1 0.00
ru_syntagrus
1. Stanford (Stanford) software1 94.00
2. C2L2 (Ithaca) software5 92.15
3. UParse (Edinburgh) software1 91.90
4. IMS (Stuttgart) software2 91.81
5. HIT-SCIR (Harbin) software4 91.71
6. NAIST SATO (Nara) software1 91.68
7. Uppsala (Uppsala) software1 90.43
8. LATTICE (Paris) software7 90.23
9. LyS-FASTPARSE (A Coruña) software5 90.18
10. Orange – Deskiñ (Lannion) software1 89.68
11. RACAI (București) software1 89.41
12. fbaml (Palo Alto) software1 89.36
13. ÚFAL – UDPipe 1.2 (Praha) software1 89.35
14. TurkuNLP (Turku) software1 89.33
15. LIMSI-LIPN (Paris) software2 89.30
BASELINE UDPipe 1.1 (Praha) software2 89.30
17. darc (Tübingen) software1 89.02
18. MQuni (Sydney) software2 88.94
19. naistCL (Nara) software1 88.83
20. Koç University (İstanbul) software3 88.00
21. IIT Kharagpur (Kharagpur) software3 87.83
22. Wanghao-ftd-SJTU (Shanghai) software2 87.27
23. CLCL (Genève) software1 86.88
24. Mengest (Shanghai) software1 86.15
25. METU (Ankara) software2 84.82
26. OpenU NLP Lab (Ra'anana) software6 84.20
27. TRL (Tokyo) software1 69.49
28. ParisNLP (Paris) software1 63.07
29. UALING (Tucson) software1 61.14
30. MetaRomance (Santiago de Compostela) software1 49.25
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
sk
1. Stanford (Stanford) software1 89.58
2. C2L2 (Ithaca) software5 86.44
3. IMS (Stuttgart) software2 85.45
4. HIT-SCIR (Harbin) software4 84.38
5. LATTICE (Paris) software7 83.91
6. LyS-FASTPARSE (A Coruña) software5 82.05
7. Koç University (İstanbul) software3 81.89
8. Orange – Deskiñ (Lannion) software1 81.81
9. fbaml (Palo Alto) software1 81.58
10. NAIST SATO (Nara) software1 81.11
11. ÚFAL – UDPipe 1.2 (Praha) software1 80.78
12. RACAI (București) software1 80.77
13. LIMSI-LIPN (Paris) software2 80.17
14. TurkuNLP (Turku) software1 79.70
15. MQuni (Sydney) software2 79.28
16. naistCL (Nara) software1 78.88
17. darc (Tübingen) software1 78.85
18. IIT Kharagpur (Kharagpur) software3 78.62
19. UALING (Tucson) software1 78.58
20. CLCL (Genève) software1 78.55
21. UParse (Edinburgh) software1 78.14
BASELINE UDPipe 1.1 (Praha) software2 78.14
23. Wanghao-ftd-SJTU (Shanghai) software2 77.69
24. METU (Ankara) software2 76.45
25. ParisNLP (Paris) software1 75.92
26. Uppsala (Uppsala) software1 75.82
27. Mengest (Shanghai) software1 68.91
28. OpenU NLP Lab (Ra'anana) software6 57.95
29. TRL (Tokyo) software1 46.60
30. MetaRomance (Santiago de Compostela) software1 44.60
31. Wenba-NLU (Wuhan) software1 11.49
32. ECNU (Shanghai) software1 7.47
33. UT (Tartu) software1 0.00
sl
1. Stanford (Stanford) software1 93.34
2. C2L2 (Ithaca) software5 90.86
3. HIT-SCIR (Harbin) software4 89.54
4. IMS (Stuttgart) software2 89.02
5. NAIST SATO (Nara) software1 87.35
6. LATTICE (Paris) software7 87.20
7. LyS-FASTPARSE (A Coruña) software5 86.50
8. TurkuNLP (Turku) software1 86.03
9. Orange – Deskiñ (Lannion) software1 85.80
10. fbaml (Palo Alto) software1 85.74
11. ÚFAL – UDPipe 1.2 (Praha) software1 85.37
12. Koç University (İstanbul) software3 85.00
13. UParse (Edinburgh) software1 84.68
LIMSI-LIPN (Paris) software2 84.68
BASELINE UDPipe 1.1 (Praha) software2 84.68
16. RACAI (București) software1 84.67
17. MQuni (Sydney) software2 84.62
18. darc (Tübingen) software1 84.61
19. ParisNLP (Paris) software1 84.59
20. naistCL (Nara) software1 84.38
21. CLCL (Genève) software1 84.33
22. Wanghao-ftd-SJTU (Shanghai) software2 84.24
23. IIT Kharagpur (Kharagpur) software3 84.02
24. Uppsala (Uppsala) software1 83.73
25. UALING (Tucson) software1 83.11
26. METU (Ankara) software2 81.82
27. OpenU NLP Lab (Ra'anana) software6 70.92
28. Mengest (Shanghai) software1 66.61
29. TRL (Tokyo) software1 56.55
30. MetaRomance (Santiago de Compostela) software1 47.03
31. Wenba-NLU (Wuhan) software1 8.19
32. ECNU (Shanghai) software1 4.31
33. UT (Tartu) software1 0.00
sl_sst
1. C2L2 (Ithaca) software5 64.27 2. IMS (Stuttgart) software2 62.37 3. Stanford (Stanford) software1 61.71 4. HIT-SCIR (Harbin) software4 60.36 5. ÚFAL – UDPipe 1.2 (Praha) software1 59.26 6. NAIST SATO (Nara) software1 57.47 7. fbaml (Palo Alto) software1 56.73 8. LATTICE (Paris) software7 56.67 9. RACAI (București) software1 55.84 10. Koç University (İstanbul) software3 55.82 11. UParse (Edinburgh) software1 54.76 12. darc (Tübingen) software1 54.46 13. Wanghao-ftd-SJTU (Shanghai) software2 54.26 14. TurkuNLP (Turku) software1 54.22 15. LIMSI-LIPN (Paris) software2 53.80 16. BASELINE UDPipe 1.1 (Praha) software2 53.79 17. IIT Kharagpur (Kharagpur) software3 53.00 18. UALING (Tucson) software1 52.96 19. naistCL (Nara) software1 52.02 20. MQuni (Sydney) software2 51.15 21. LyS-FASTPARSE (A Coruña) software5 50.84 22. ParisNLP (Paris) software1 50.12 23. Orange – Deskiñ (Lannion) software1 49.52 24. METU (Ankara) software2 47.15 25. OpenU NLP Lab (Ra'anana) software6 45.92 26. Uppsala (Uppsala) software1 45.15 27. TRL (Tokyo) software1 38.65 28. Mengest (Shanghai) software1 34.78 29. MetaRomance (Santiago de Compostela) software1 30.69 30. CLCL (Genève) software1 14.62 31. ECNU (Shanghai) software1 3.88 32. Wenba-NLU (Wuhan) software1 0.00 33. UT (Tartu) software1 0.00
sme
1. C2L2 (Ithaca) software5 58.85 2. HIT-SCIR (Harbin) software4 52.51 3. IMS (Stuttgart) software2 51.56 4. Stanford (Stanford) software1 51.13 5. UParse (Edinburgh) software1 50.28 6. Koç University (İstanbul) software3 49.61 7. ParisNLP (Paris) software1 48.59 8. RACAI (București) software1 47.51 9. IIT Kharagpur (Kharagpur) software3 46.53 10. BASELINE UDPipe 1.1 (Praha) software2 46.06 11. Wanghao-ftd-SJTU (Shanghai) software2 45.60 12. ÚFAL – UDPipe 1.2 (Praha) software1 45.53 13. LyS-FASTPARSE (A Coruña) software5 45.48 14. Orange – Deskiñ (Lannion) software1 45.32 15. OpenU NLP Lab (Ra'anana) software6 45.03 16. darc (Tübingen) software1 44.98 17. UALING (Tucson) software1 43.45 18. LIMSI-LIPN (Paris) software2 42.89 19. LATTICE (Paris) software7 42.72 20. naistCL (Nara) software1 40.54 21. CLCL (Genève) software2 38.41 22. NAIST SATO (Nara) software1 37.74 23. METU (Ankara) software2 36.32 24. MetaRomance (Santiago de Compostela) software1 35.11 25. fbaml (Palo Alto) software1 31.22 26. Mengest (Shanghai) software1 29.83 27. Uppsala (Uppsala) software1 28.33 28. TRL (Tokyo) software1 27.93 29. TurkuNLP (Turku) software1 23.89 30. MQuni (Sydney) software2 22.26 31. ECNU (Shanghai) software1 17.77 32. Wenba-NLU (Wuhan) software1 0.00 33. UT (Tartu) software1 0.00
sv
1. Stanford (Stanford) software1 88.50
2. C2L2 (Ithaca) software5 88.10
3. IMS (Stuttgart) software2 85.96
4. LATTICE (Paris) software7 84.90
5. HIT-SCIR (Harbin) software4 83.93
6. NAIST SATO (Nara) software1 83.71
7. MQuni (Sydney) software2 82.82
8. Orange – Deskiñ (Lannion) software1 82.78
9. fbaml (Palo Alto) software1 82.31
10. Koç University (İstanbul) software3 81.98
11. UParse (Edinburgh) software1 81.67
ÚFAL – UDPipe 1.2 (Praha) software1 81.67
13. LyS-FASTPARSE (A Coruña) software5 81.43
14. TurkuNLP (Turku) software1 81.31
15. ParisNLP (Paris) software1 81.28
16. IIT Kharagpur (Kharagpur) software3 80.81
17. LIMSI-LIPN (Paris) software2 80.78
BASELINE UDPipe 1.1 (Praha) software2 80.78
19. naistCL (Nara) software1 80.64
20. darc (Tübingen) software1 80.39
21. Wanghao-ftd-SJTU (Shanghai) software2 79.89
22. CLCL (Genève) software1 79.86
23. UALING (Tucson) software1 79.46
24. RACAI (București) software1 79.36
25. Uppsala (Uppsala) software1 78.42
26. METU (Ankara) software2 78.13
27. OpenU NLP Lab (Ra'anana) software6 75.94
28. Mengest (Shanghai) software1 68.58
29. TRL (Tokyo) software1 54.98
30. MetaRomance (Santiago de Compostela) software1 44.32
31. Wenba-NLU (Wuhan) software1 13.76
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
sv_lines
1. Stanford (Stanford) software1 86.51
2. C2L2 (Ithaca) software5 86.09
3. IMS (Stuttgart) software2 83.51
4. LATTICE (Paris) software7 82.83
5. HIT-SCIR (Harbin) software4 81.77
6. NAIST SATO (Nara) software1 81.49
7. UParse (Edinburgh) software1 80.73
8. MQuni (Sydney) software2 80.61
9. Koç University (İstanbul) software3 80.51
10. fbaml (Palo Alto) software1 80.33
11. ÚFAL – UDPipe 1.2 (Praha) software1 80.14
12. LyS-FASTPARSE (A Coruña) software5 80.07
13. IIT Kharagpur (Kharagpur) software3 79.51
14. TurkuNLP (Turku) software1 79.45
15. Orange – Deskiñ (Lannion) software1 79.31
16. LIMSI-LIPN (Paris) software2 79.18
BASELINE UDPipe 1.1 (Praha) software2 79.18
18. naistCL (Nara) software1 79.04
19. CLCL (Genève) software1 78.90
20. darc (Tübingen) software1 78.73
21. Wanghao-ftd-SJTU (Shanghai) software2 78.30
22. UALING (Tucson) software1 77.73
23. METU (Ankara) software2 76.97
24. RACAI (București) software1 76.95
25. Uppsala (Uppsala) software1 75.68
26. OpenU NLP Lab (Ra'anana) software6 75.10
27. ParisNLP (Paris) software1 72.17
28. Mengest (Shanghai) software1 67.82
29. TRL (Tokyo) software1 57.70
30. MetaRomance (Santiago de Compostela) software1 41.65
31. ECNU (Shanghai) software1 21.32
32. Wenba-NLU (Wuhan) software1 13.39
33. UT (Tartu) software1 0.00
sv_pud
1. Stanford (Stanford) software1 81.90 2. C2L2 (Ithaca) software5 81.67 3. IMS (Stuttgart) software2 80.05 4. LATTICE (Paris) software7 78.32 5. NAIST SATO (Nara) software1 77.47 6. UParse (Edinburgh) software1 76.93 7. Koç University (İstanbul) software3 76.57 8. ParisNLP (Paris) software1 76.35 9. fbaml (Palo Alto) software1 75.94 10. MQuni (Sydney) software2 75.69 11. ÚFAL – UDPipe 1.2 (Praha) software1 75.43 12. Orange – Deskiñ (Lannion) software1 75.42 13. HIT-SCIR (Harbin) software4 75.15 14. BASELINE UDPipe 1.1 (Praha) software2 75.09 15. IIT Kharagpur (Kharagpur) software3 74.95 16. RACAI (București) software1 74.81 17. LyS-FASTPARSE (A Coruña) software5 74.48 18. naistCL (Nara) software1 74.38 19. UALING (Tucson) software1 74.09 20. TurkuNLP (Turku) software1 74.07 21. CLCL (Genève) software1 73.49 22. darc (Tübingen) software1 73.45 23. Wanghao-ftd-SJTU (Shanghai) software2 73.44 24. METU (Ankara) software2 72.15 25. Uppsala (Uppsala) software1 68.41 26. OpenU NLP Lab (Ra'anana) software6 68.35 27. Mengest (Shanghai) software1 62.66 28. LIMSI-LIPN (Paris) software2 57.04 29. TRL (Tokyo) software1 54.05 30. MetaRomance (Santiago de Compostela) software1 48.56 31. ECNU (Shanghai) software1 20.38 32. Wenba-NLU (Wuhan) software1 0.00 33. UT (Tartu) software1 0.00
tr
1. Stanford (Stanford) software1 69.62 2. C2L2 (Ithaca) software5 69.60 3. IMS (Stuttgart) software2 69.15 4. LATTICE (Paris) software7 66.86 5. LyS-FASTPARSE (A Coruña) software5 64.77 6. HIT-SCIR (Harbin) software4 64.14 7. RACAI (București) software1 64.09 8. MQuni (Sydney) software2 63.96 9. Koç University (İstanbul) software3 63.89 10. Orange – Deskiñ (Lannion) software1 63.27 11. LIMSI-LIPN (Paris) software2 62.85 12. NAIST SATO (Nara) software1 62.48 13. fbaml (Palo Alto) software1 61.69 14. naistCL (Nara) software1 61.62 15. TurkuNLP (Turku) software1 61.52 16. darc (Tübingen) software1 61.33 17. IIT Kharagpur (Kharagpur) software3 61.28 18. ÚFAL – UDPipe 1.2 (Praha) software1 60.78 19. UParse (Edinburgh) software1 60.50 20. BASELINE UDPipe 1.1 (Praha) software2 60.48 21. Mengest (Shanghai) software1 59.81 22. Wanghao-ftd-SJTU (Shanghai) software2 58.96 23. UALING (Tucson) software1 58.45 24. Uppsala (Uppsala) software1 57.91 25. METU (Ankara) software2 57.39 26. CLCL (Genève) software1 56.95 27. ParisNLP (Paris) software1 54.50 28. OpenU NLP Lab (Ra'anana) software6 52.71 29. TRL (Tokyo) software1 42.07 30. Wenba-NLU (Wuhan) software1 6.72 31. ECNU (Shanghai) software1 0.00 32. MetaRomance (Santiago de Compostela) software1 0.00 33. UT (Tartu) software1 0.00
tr_pud
1. C2L2 (Ithaca) software5 59.35 2. IMS (Stuttgart) software2 59.06 3. Stanford (Stanford) software1 58.72 4. LATTICE (Paris) software7 56.61 5. LyS-FASTPARSE (A Coruña) software5 55.97 6. UParse (Edinburgh) software1 55.70 7. naistCL (Nara) software1 55.41 8. BASELINE UDPipe 1.1 (Praha) software2 55.01 9. Orange – Deskiñ (Lannion) software1 54.91 10. Koç University (İstanbul) software3 54.53 11. darc (Tübingen) software1 54.39 12. HIT-SCIR (Harbin) software4 54.17 13. IIT Kharagpur (Kharagpur) software3 54.06 14. LIMSI-LIPN (Paris) software2 54.05 15. RACAI (București) software1 53.78 16. UALING (Tucson) software1 53.61 17. ÚFAL – UDPipe 1.2 (Praha) software1 53.58 18. MQuni (Sydney) software2 53.27 19. TurkuNLP (Turku) software1 53.21 20. NAIST SATO (Nara) software1 52.95 21. fbaml (Palo Alto) software1 52.75 22. Wanghao-ftd-SJTU (Shanghai) software2 52.43 23. Uppsala (Uppsala) software1 49.65 24. METU (Ankara) software2 48.37 25. CLCL (Genève) software1 48.33 26. OpenU NLP Lab (Ra'anana) software6 44.67 27. ParisNLP (Paris) software1 39.57 28. TRL (Tokyo) software1 39.14 29. Mengest (Shanghai) software1 38.26 30. MetaRomance (Santiago de Compostela) software1 18.26 31. Wenba-NLU (Wuhan) software1 0.00 32. ECNU (Shanghai) software1 0.00 33. UT (Tartu) software1 0.00
ug
1. IMS (Stuttgart) software2 60.57
2. C2L2 (Ithaca) software5 58.46
3. RACAI (București) software1 57.61
4. Stanford (Stanford) software1 56.86
5. Orange – Deskiñ (Lannion) software1 55.72
6. TurkuNLP (Turku) software1 55.48
7. Wanghao-ftd-SJTU (Shanghai) software2 54.64
8. fbaml (Palo Alto) software1 54.54
9. MQuni (Sydney) software2 54.53
10. IIT Kharagpur (Kharagpur) software3 54.25
11. LIMSI-LIPN (Paris) software2 54.00
12. darc (Tübingen) software1 53.79
13. UParse (Edinburgh) software1 53.58
BASELINE UDPipe 1.1 (Praha) software2 53.58
15. ÚFAL – UDPipe 1.2 (Praha) software1 53.49
16. LATTICE (Paris) software7 52.95
17. UALING (Tucson) software1 52.69
18. naistCL (Nara) software1 52.36
19. HIT-SCIR (Harbin) software4 51.57
20. NAIST SATO (Nara) software1 51.45
21. Uppsala (Uppsala) software1 50.35
22. LyS-FASTPARSE (A Coruña) software5 49.53
23. TRL (Tokyo) software1 48.10
24. Koç University (İstanbul) software3 44.00
25. CLCL (Genève) software1 38.14
26. ParisNLP (Paris) software1 34.80
27. METU (Ankara) software2 31.14
28. OpenU NLP Lab (Ra'anana) software6 20.70
29. MetaRomance (Santiago de Compostela) software1 18.76
30. ECNU (Shanghai) software1 13.17
31. Wenba-NLU (Wuhan) software1 0.00
32. UT (Tartu) software1 0.00
33. Mengest (Shanghai) software1 0.00
uk
1. Stanford (Stanford) software1 81.44
2. C2L2 (Ithaca) software5 79.51
3. IMS (Stuttgart) software2 77.38
4. fbaml (Palo Alto) software1 73.52
5. ParisNLP (Paris) software1 73.36
6. RACAI (București) software1 72.45
7. LATTICE (Paris) software7 72.36
8. TurkuNLP (Turku) software1 72.22
9. Orange – Deskiñ (Lannion) software1 71.30
10. HIT-SCIR (Harbin) software4 71.22
11. Koç University (İstanbul) software3 70.99
12. Wanghao-ftd-SJTU (Shanghai) software2 70.76
13. MQuni (Sydney) software2 70.68
14. darc (Tübingen) software1 70.55
15. LyS-FASTPARSE (A Coruña) software5 70.51
16. LIMSI-LIPN (Paris) software2 70.44
17. NAIST SATO (Nara) software1 70.22
18. UParse (Edinburgh) software1 69.78
BASELINE UDPipe 1.1 (Praha) software2 69.78
20. UALING (Tucson) software1 69.73
21. naistCL (Nara) software1 69.40
22. ÚFAL – UDPipe 1.2 (Praha) software1 69.28
23. Uppsala (Uppsala) software1 58.98
24. OpenU NLP Lab (Ra'anana) software6 53.25
25. IIT Kharagpur (Kharagpur) software3 52.65
26. MetaRomance (Santiago de Compostela) software1 48.77
27. METU (Ankara) software2 46.65
28. TRL (Tokyo) software1 45.91
29. Mengest (Shanghai) software1 38.59
30. CLCL (Genève) software1 23.74
31. Wenba-NLU (Wuhan) software1 0.00
32. ECNU (Shanghai) software1 0.00
33. UT (Tartu) software1 0.00
ur
1. Stanford (Stanford) software1 87.98
2. C2L2 (Ithaca) software5 87.05
3. IMS (Stuttgart) software2 86.97
4. HIT-SCIR (Harbin) software4 86.41
5. NAIST SATO (Nara) software1 86.40
6. LATTICE (Paris) software7 86.01
7. MQuni (Sydney) software2 86.00
8. UParse (Edinburgh) software1 85.41
9. LyS-FASTPARSE (A Coruña) software5 85.24
10. fbaml (Palo Alto) software1 85.22
11. Orange – Deskiñ (Lannion) software1 84.78
12. Koç University (İstanbul) software3 84.31
13. TurkuNLP (Turku) software1 84.17
14. naistCL (Nara) software1 84.04
15. ÚFAL – UDPipe 1.2 (Praha) software1 83.86
16. IIT Kharagpur (Kharagpur) software3 83.78
17. LIMSI-LIPN (Paris) software2 83.67
BASELINE UDPipe 1.1 (Praha) software2 83.67
19. darc (Tübingen) software1 83.64
20. CLCL (Genève) software1 82.89
21. RACAI (București) software1 82.72
22. METU (Ankara) software2 82.61
23. Wanghao-ftd-SJTU (Shanghai) software2 82.50
24. UALING (Tucson) software1 82.26
25. OpenU NLP Lab (Ra'anana) software6 77.95
26. Mengest (Shanghai) software1 73.73
27. Uppsala (Uppsala) software1 72.12
28. TRL (Tokyo) software1 62.47
29. ParisNLP (Paris) software1 49.28
30. Wenba-NLU (Wuhan) software1 33.00
31. ECNU (Shanghai) software1 20.35
32. MetaRomance (Santiago de Compostela) software1 13.62
33. UT (Tartu) software1 0.00
vi
1. IMS (Stuttgart) software2 52.99
2. LIMSI-LIPN (Paris) software2 47.59
3. HIT-SCIR (Harbin) software4 47.53
4. C2L2 (Ithaca) software5 46.52
5. Uppsala (Uppsala) software1 46.22
6. fbaml (Palo Alto) software1 46.16
7. Stanford (Stanford) software1 46.14
8. ÚFAL – UDPipe 1.2 (Praha) software1 44.99
9. LATTICE (Paris) software7 44.97
10. Orange – Deskiñ (Lannion) software1 44.26
11. MQuni (Sydney) software2 44.10
12. NAIST SATO (Nara) software1 44.01
13. LyS-FASTPARSE (A Coruña) software5 43.52
14. Koç University (İstanbul) software3 43.07
15. naistCL (Nara) software1 42.71
16. TurkuNLP (Turku) software1 42.70
17. UParse (Edinburgh) software1 42.12
BASELINE UDPipe 1.1 (Praha) software2 42.12
19. darc (Tübingen) software1 41.94
20. Wanghao-ftd-SJTU (Shanghai) software2 41.92
21. METU (Ankara) software2 41.59
22. IIT Kharagpur (Kharagpur) software3 41.47
23. OpenU NLP Lab (Ra'anana) software6 41.25
24. CLCL (Genève) software1 40.74
25. ParisNLP (Paris) software1 40.70
26. UALING (Tucson) software1 40.58
27. RACAI (București) software1 39.98
28. Mengest (Shanghai) software1 38.71
29. TRL (Tokyo) software1 37.13
30. MetaRomance (Santiago de Compostela) software1 18.35
31. Wenba-NLU (Wuhan) software1 11.73
32. ECNU (Shanghai) software1 8.61
33. UT (Tartu) software1 0.00
zh
1. IMS (Stuttgart) software2 72.39
2. fbaml (Palo Alto) software1 70.35
3. Stanford (Stanford) software1 68.95
HIT-SCIR (Harbin) software4 68.95
5. C2L2 (Ithaca) software5 67.79
6. LATTICE (Paris) software7 65.75
7. Uppsala (Uppsala) software1 65.62
8. LIMSI-LIPN (Paris) software2 64.33
9. NAIST SATO (Nara) software1 63.87
10. MQuni (Sydney) software2 63.73
11. Orange – Deskiñ (Lannion) software1 63.42
12. TurkuNLP (Turku) software1 62.74
13. naistCL (Nara) software1 62.57
14. RACAI (București) software1 62.56
15. Mengest (Shanghai) software1 62.10
16. ÚFAL – UDPipe 1.2 (Praha) software1 61.81
17. UParse (Edinburgh) software1 61.50
BASELINE UDPipe 1.1 (Praha) software2 61.50
19. Koç University (İstanbul) software3 61.48
20. LyS-FASTPARSE (A Coruña) software5 61.32
21. IIT Kharagpur (Kharagpur) software3 61.16
22. darc (Tübingen) software1 60.54
23. UALING (Tucson) software1 60.10
24. Wanghao-ftd-SJTU (Shanghai) software2 59.45
25. CLCL (Genève) software1 58.96
26. METU (Ankara) software2 58.16
27. OpenU NLP Lab (Ra'anana) software6 58.03
28. ParisNLP (Paris) software1 51.29
29. ECNU (Shanghai) software1 36.87
30. TRL (Tokyo) software1 31.49
31. MetaRomance (Santiago de Compostela) software1 14.83
32. Wenba-NLU (Wuhan) software1 4.35
33. UT (Tartu) software1 0.00