UD Indonesian PUD
Language: Indonesian (code: id
)
Family: Austronesian, Malayo-Sumbawan
This treebank has been part of Universal Dependencies since the UD v2.2 release.
The following people have contributed to making this treebank part of UD: Hans Uszkoreit, Vivien Macketanz, Aljoscha Burchardt, Kim Harris, Katrin Marheinecke, Slav Petrov, Tolga Kayadelen, Mohammed Attia, Ali Elkahky, Zhuoran Yu, Emily Pitler, Saran Lertpradit, Ruli Manurung, Muh Shohibussirri, Martin Popel, Daniel Zeman, Ika Alfina, Arawinda Dinakaramani, Muhammad Yudistira Hanifmuti, Jessica Naraiswari Arwidarasti, Yogi Lesmana Sulestio.
Repository: UD_Indonesian-PUD
Search this treebank on-line: PML-TQ
Download all treebanks: UD 2.14
License: CC BY-SA 3.0
Genre: news, wiki
Questions, comments? General annotation questions (either Indonesian-specific or cross-linguistic) can be raised in the main UD issue tracker. You can report bugs in this treebank in the treebank-specific issue tracker on Github. If you want to collaborate, please contact [ika • alfina (æt) cs • ui • ac • id]. Development of the treebank happens directly in the UD repository, so you may submit bug fixes as pull requests against the dev branch.
Annotation | Source |
---|---|
Lemmas | annotated manually |
UPOS | annotated manually, natively in UD style |
XPOS | not available |
Features | annotated manually, natively in UD style |
Relations | annotated manually, natively in UD style |
Description
This is a part of the Parallel Universal Dependencies (PUD) treebanks created for the CoNLL 2017 shared task on Multilingual Parsing from Raw Text to Universal Dependencies.
There are 1000 sentences in each language, always in the same order. (The sentence alignment is 1-1 but occasionally a sentence-level segment actually consists of two real sentences.) The sentences are taken from the news domain (sentence id starts in ‘n’) and from Wikipedia (sentence id starts with ‘w’). There are usually only a few sentences from each document, selected randomly, not necessarily adjacent. The digits on the second and third position in the sentence ids encode the original language of the sentence. The first 750 sentences are originally English (01). The remaining 250 sentences are originally German (02), French (03), Italian (04) or Spanish (05) and they were translated to other languages via English. Translation into German, French, Italian, Spanish, Arabic, Hindi, Chinese, Indonesian, Japanese, Korean, Portuguese, Russian, Thai and Turkish has been provided by DFKI and performed (except for German) by professional translators. Then the data has been annotated morphologically and syntactically by Google according to Google universal annotation guidelines; finally, it has been converted by members of the UD community to UD v2 guidelines.
Additional languages have been provided (both translation and native UD v2 annotation) by other teams: Czech by Charles University, Finnish by University of Turku and Swedish by Uppsala University.
The entire treebank is labeled as test set (and was used for testing in the shared task). If it is used for training in future research, the users should employ ten-fold cross-validation.
Acknowledgments
-
The original treebank was built by Google for the CoNLL 2018 shared task in Zeman et al. (2018), based on method proposed by McDonald et al. (2013). We are greatful to the many people who made this dataset possible: Fernando Pereira, Hans Uszkoreit, Aljoscha Burchardt, Vivien Macketanz, Ali Elkahky, Abhijit Barde, and Tolga Kayadelen.
- The treebank was revised manually by Alfina et al. (2019) and Alfina et al (2020) from Universitas Indonesia (UI). We thank the contributors of the revision project of the Indonesian PUD:
- Designers of the Indonesian annotation guidelines: Ika Alfina, Daniel Zeman, and Arawinda Dinakaramani.
- Annotators: Ika Alfina, Arawinda Dinakaramani, Muhammad Yudistira Hanifmuti, Jessica Naraiswari Arwidarasti, and Yogi Lesmana Sulestio.
References
- Ika Alfina, Daniel Zeman, Arawinda Dinakaramani, Indra Budi, and Heru Suhartanto. “Selecting the UD v2 Morphological Features for Indonesian Dependency Treebank”. In Proceedings of the 2020 International Conference of Asian Language Processing (IALP) in Kuala Lumpur, Malaysia, 4-6 Desember 2020.
- Ika Alfina, Arawinda Dinakaramani, Mohamad Ivan Fanany, and Heru Suhartanto. “A Gold Standard Dependency Treebank for Indonesian”. In Proceedings of 33rd Pacific Asia Conference on Language, Information and Computation (PACLIC) 2019 in Hakodate, Japan, 13-15 September 2019.
- Daniel Zeman, Jan Hajiˇc, Martin Popel, Martin Potthast, Milan Straka, Filip Ginter, Joakim Nivre, and Slav Petrov. “CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies”. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, 2018.
- Ryan McDonald, Joakim Nivre, Yvonne Quirmbach-Brundage, Yoav Goldberg, Dipanjan Das, Kuzman Ganchev, Keith Hall, Slav Petrov, Hao Zhang, Oscar Tackstrom, Claudia Bedini, Nuria Bertomeu Castello and Jungmee Lee. “Universal Dependency Annotation for Multilingual Parsing”. In Proceedings of ACL 2013.
Statistics of UD Indonesian PUD
POS Tags
ADJ – ADP – ADV – AUX – CCONJ – DET – INTJ – NOUN – NUM – PART – PRON – PROPN – PUNCT – SCONJ – SYM – VERB – X
Features
Abbr – Clusivity – Definite – Degree – Foreign – Mood – Number – NumType – Person – Polarity – Polite – PronType – Reflex – Typo – Voice
Relations
acl – acl:relcl – advcl – advmod – advmod:emph – amod – appos – aux – case – case:adv – cc – cc:preconj – ccomp – clf – compound – compound:a – conj – cop – csubj – csubj:pass – det – discourse – dislocated – fixed – flat – flat:foreign – flat:name – goeswith – iobj – mark – nmod – nmod:lmod – nmod:poss – nmod:tmod – nsubj – nsubj:pass – nummod – obj – obl – obl:agent – obl:tmod – orphan – parataxis – punct – root – vocative – xcomp
Tokenization and Word Segmentation
- This corpus contains 1000 sentences, 19034 tokens and 19446 syntactic words.
- This corpus contains 2402 tokens (13%) that are not followed by a space.
- This corpus does not contain words with spaces.
- This corpus contains 175 types of words that contain both letters and punctuation. Examples: rata-rata, laki-laki, orang-orang, baru-baru, negara-negara, undang-undang, anak-anak, bertahun-tahun, masing-masing, A.S., batas-batas, 1970-an, Nn., No., St., Tn., bagian-bagian, batu-batu, benar-benar, bersama-sama, bulan-bulan, kira-kira, kota-kota, paru-paru, puing-puing, pulau-pulau, satu-satu, 1960-an, 1980-an, 1990-an, 60-an, B.C., Joliot-Curie, Ms., asal-muasal, bangsa-bangsa, benda-benda, berhati-hati, besar-besaran, gereja-gereja, hal-hal, hati-hati, ide-ide, jelas-jelas, ke-16, ke-3, ke-5, lagi-lagi, n't, partikel-partikel
- This corpus contains 412 multi-word tokens. On average, one multi-word token consists of 2.00 syntactic words.
- There are 293 types of multi-word tokens. Examples: apakah, lainnya, dirinya, kalinya, istrinya, katanya, meskipun, semuanya, hidupnya, itulah, kepadanya, menyebutnya, terakhirnya, terjadinya, ujarnya, dalamnya, dengannya, jabatannya, kariernya, keduanya, kemampuannya, membuatnya, satu-satunya, sebabnya, adanya, akhirnya, artinya, ayahnya, banyaknya, bawahnya, berkembangnya, demikianlah, depannya, filmnya, harganya, hasilnya, inilah, kaitannya, kematiannya, kesehatannya, kurangnya, laki-lakinya, membawanya, menontonnya, misalnya, negaranya, neneknya, pasukannya, pemerintahannya, putrinya.
Morphology
Tags
- This corpus uses 17 UPOS tags out of 17 possible: ADJ, ADP, ADV, AUX, CCONJ, DET, INTJ, NOUN, NUM, PART, PRON, PROPN, PUNCT, SCONJ, SYM, VERB, X
- This corpus contains 7 word types tagged as particles (PART): belum, bukan, kah, lah, pun, tak, tidak
- This corpus contains 26 lemmas tagged as pronouns (PRON): aku, anda, apa, begitu, demikian, dia, diri, ia, ini, itu, kalian, kami, kamu, kita, ku, mana, mereka, nya, orang, sana, saya, semua, siapa, sini, suatu, yang
- This corpus contains 24 lemmas tagged as determiners (DET): bagai, bagi, banyak, berapa, buah, ini, itu, jenis, masing-masing, nya, orang, para, pasang, rangkai, sang, sebut, segala, seluruh, semua, sendiri, si, suatu, tiap, yang
- Out of the above, 7 lemmas occurred sometimes as PRON and sometimes as DET: ini, itu, nya, orang, semua, suatu, yang
- This corpus contains 11 lemmas tagged as auxiliaries (AUX): adalah, akan, bisa, boleh, dapat, harus, mampu, mungkin, sedang, sudah, telah
- Out of the above, 3 lemmas occurred sometimes as AUX and sometimes as VERB: boleh, dapat, mungkin
- This corpus does not use the VerbForm feature.
Nominal Features
- Plur
- DET: para, banyak, beberapa, berbagai, serangkaian, sepasang
- NOUN: orang-orang, negara-negara, anak-anak, batas-batas, 1970-an, bagian-bagian, batu-batu, bertahun-tahun, bulan-bulan, kota-kota
- PRON: mereka, kami, kita, kalian
- Sing
- NOUN: tahun, orang, bulan, bagian, hari, negara, kota, laut, hal, perang
- PRON: nya, ia, saya, dia, Anda, Aku, ku, kamu
- Def
- DET: nya, yang
- Ind
- DET: sebuah, seorang, suatu
Degree and Polarity
- Sup
- ADJ: terakhir, terbaik, terbesar, tertinggi, terutama, teratas, terburuk, terawal, terbanyak, terbaru
- Neg
- PART: tidak, tak, belum, bukan
Verbal Features
- Ind
- VERB: menjadi, ada, memiliki, membuat, mulai, mengatakan, merupakan, ujar, digunakan, mendapatkan
- Act
- VERB: menjadi, ada, memiliki, membuat, mulai, mengatakan, merupakan, ujar, mendapatkan, bekerja
- Pass
- VERB: digunakan, terjadi, termasuk, terletak, diberi, didirikan, diikuti, dikenal, diperlukan, terbuka
Pronouns, Determiners, Quantifiers
- Art
- DET: nya, sebuah, seorang, yang, suatu
- Dem
- DET: ini, itu, tersebut, sang, si
- PRON: itu, ini, mana, sana, begitu, demikian, sini
- Emp
- DET: sendiri
- Ind
- ADV: kadang, kadang-kadang
- DET: para, banyak, beberapa, berbagai, sebagian, kebanyakan, sejenis, serangkaian, sepasang
- PRON: seseorang, sesuatu
- Int
- ADV: apa, bagaimana
- PRON: siapa, mana
- Prs
- PRON: nya, ia, mereka, saya, kami, dia, kita, diri, Anda, Aku
- Rel
- ADV: saat, ketika, mengapa, bagaimana, berapa, kapan, seberapa
- PRON: yang, apa, siapa
- Tot
- ADV: selalu
- DET: semua, seluruh, setiap, masing-masing, segala
- PRON: semua
- Card
- NUM: satu, dua, kedua, tiga, juta, empat, 1, 10, 3, puluh
- Ord
- ADJ: pertama, kedua, ketiga, ke-16, ke-3, ke-5, ke-13, ke-14, ke-15, ke-20
- Yes
- PRON: diri
- 1
- PRON: saya, kami, kita, Aku, ku
- 2
- PRON: Anda, kalian, kamu
- 3
- PRON: nya, ia, mereka, dia
- Form
- PRON: saya, Anda
- Infm
- PRON: Aku, kalian, kamu
Other Features
- Abbr
- Yes
- NOUN: SM, AIDS, ATM, BC, DFB, GIF, HFC, MLA, MP, No.
- PROPN: AS, A.S., BBC, CNN, Nn., Tn., B.C., DNA, GCA, GOP
- Yes
- Clusivity
- Ex
- PRON: kami
- In
- PRON: kita
- Ex
- Foreign
- Yes
- X: estate, landmark, real, Energies, International, Investors, MultiStrategy, Organization, Renewable, Return
- Yes
- Typo
- Yes
- ADP: dari
- NOUN: mercu, Kontituensi, konsulate
- Yes
Syntax
Auxiliary Verbs and Copula
- This corpus uses 1 lemmas as copulas (cop). Examples: adalah.
- This corpus uses 10 lemmas as auxiliaries (aux). Examples: telah, akan, bisa, sudah, dapat, harus, mungkin, sedang, boleh, mampu.
Core Arguments, Oblique Arguments and Adjuncts
Here we consider only relations between verbs (parent) and nouns or pronouns (child).
- nsubj
- VERB--NOUN (473)
- VERB--PRON (454)
- obj
- VERB--NOUN (687)
- VERB--NOUN-ADP(hingga) (1)
- VERB--PRON (78)
- iobj
- VERB--PRON (4)
Verbs with Reflexive Core Objects
- This corpus contains 7 lemmas that occur at least once with a reflexive core object (obj or iobj). Examples: nyata diri, bentuk diri, dapat diri, kukuh diri, lindung diri, puas diri, tenggelam diri
Relations Overview
- This corpus uses 14 relation subtypes: acl:relcl, advmod:emph, case:adv, cc:preconj, compound:a, csubj:pass, flat:foreign, flat:name, nmod:lmod, nmod:poss, nmod:tmod, nsubj:pass, obl:agent, obl:tmod
- The following 4 relation types are not used in this corpus at all: expl, list, reparandum, dep