UD for Indonesian

Tokenization and Word Segmentation

• In general, words are delimited by whitespace characters. Special treatments are given to multiword tokens and punctuations.

• Special treatments of multiword tokens:
  • Multiword tokens that ended with particles -lah/-kah/-tah/-pun are split into two tokens. These particles are usually used to emphasize the word before them. Particles of -lah/-kah/-tah are clitics, while particle pun can be written as clitic or a single token. The examples of how to tokenize these clitic particles are as follows:
    • bacalah is split into baca “read” and lah
    • diakah is split into dia “he/she” and kah
    • apatah is split into apa “what” and tah
    • walaupun is split into walau “although” and pun
  • Multiword tokens that contain clitics of -ku “me/my”, -mu “you/your”, -nya “he/him/she/her/it” are split into two tokens, with exceptions for words ended with -nya.
    • Words ended with -nya where _-nya- itself serves as a pronoun or determiner are split into two tokens. For example:
      • Word -nya as pronoun, as in mencintainya “love him/her/it”, this token is split into mencintai “love” and nya “him/her/it”.
      • Word -nya as posessive pronoun, as in bukunya “his/her/its book”, this token is split into buku “book” and nya “his/her/its”.
      • Word -nya as determiner in predicate nominalisation case, as in meningkatnya “the increase”, this token is split into meningkat “increase” and nya “the”.
    • Words ended with -nya that functions as adverbs, adjectives or auxiliary are not split. For example:
      • adverbs ended with -nya: khususnya “especially”, awalnya “initially”, akhirnya “finally”
      • adjectives ended with -nya: sebelumnya “previous”, sesudahnya “next”, berikutnya “next”
      • auxiliary ended with -nya: seharusnya/sebaiknya “shall/should”
• Special treatments for punctuations. All punctuation symbols are separated from the words, except in two cases:
  • Hyphen in reduplicated words. Indonesian has many reduplicated words as nouns (both singular and plural), verbs, adjectives, adverbs, and so on. These reduplicated words are not split and remain one token. The examples of reduplicated words are:
    • Singular noun: mata-mata “spy”
    • Plural noun: anak-anak “children”
    • Verb: merobek-robek “shredding”
    • Adjective: hiruk-pikuk “noisy”
    • Adverb: terus-menerus “continuously”
  • For abbreviations. All abbreviations such as Mr., M.Sc. Tn., are not split and remain one token.

Morphology

Tags

• We refer to KBBI (Kamus Besar Bahasa Indonesia/Indonesian Great Dictionary) as the reference dictionary. However, since this dictionary only defines 7 word classes: noun, verb, adjective, adverb, pronoun, particle and number, we need to make adjustments so that the tags conform to UD v2.
• Indonesian UD treebanks use all 17 universal POS categories.
• PART is used for:
  • negation words: tidak/tak/bukan “no/not”, belum “not yet”, jangan “don’t + VERB”
  • particles of -lah, -kah, -tah, pun, that have been discussed in the previous section.
• The auxiliary (AUX) vs. VERB distinction is based on examples for English treebank, since initially there is no AUX type in KBBI. We defined 14 Indonesian words as AUX as follows:
  • adalah and ialah “be” serve as copulas.
  • Tenses-related AUX:
    • akan/bakal “will/would” for the future tense.
    • sedang/tengah “be” for the present tense.
    • telah/sudah “have/has/had” for the past tense.
  • Modal-related AUX:
    • harus/mesti/wajib as the equivalents of modal “must”.
    • sebaiknya/seharusnya/perlu as the equivalents of modal ‘shall/should’.
    • bisa/dapat/sanggup/mampu as the equivalents of modal “can/could”.
    • boleh as the equivalent of modal “may”.
    • mungkin as the equivalent of modal “might”.
• The pronoun (PRON) vs. determiner (DET) distinction is also based on examples for English treebank, since DET word class also is not defined in KBBI.
  • The following word types are tagged as PRON:
    • personal pronouns, such as saya/aku/ku “I”, kamu/mu/anda “you”, dia/ia/nya “he/she/it/him/her/its”, kami/kita “we/us/our”, mereka “they/them/their”
    • interrogative pronouns, apa “what”, siapa “who” as in Apa yang kamu inginkan? “What do you want?”
    • relative pronouns: apa “what”, siapa “who” as in Saya tahu siapa yang kamu maksud. “I know who you mean”
    • indefinite pronouns: seseorang “seomeone/somebody”, sesuatu “something”
    • total pronouns, such as semua “all” as in Semua kecuali bukumu “All except your books”.
    • demonstrative pronouns: ini “this” as in Ini bukan salahmu. “This is not your fault”.
  • The following word types are tagged as DET:
    • demonstrative determiners: ini “this” as in Kota ini sangat indah “This city is beautiful”
    • pronominal numerals: beberapa, berbagai, para “some/many”, semua “all” as in semua siswa “all students”
• Indonesian has the following coordinating conjunction words (CCONJ):
  • dan, serta, maupun as the equivalents of “and” in English
  • atau “or”
  • tapi, tetapi, namun, melainkan as the equivalents of “but” in English

Features

• We propose the use of 14 of 24 features defined in UD v2 that are relevant to Indonesian grammar:
  • Abbr, with one possible value: Yes. This feature can be applied to all UPOS categories, except PUNCT and SYM.
  • Clusivity, applies to PRON with two possible values: Ex and In.
    • Clusivity=Ex for kami “we/our”
    • Clusivity=In for kita “we/our”
  • Degree, applies to ADJ with one possible value: Sup.
    • Degree=Sup for superlative adjectives, such as terbaik “best”, tercantik “most beautiful”, etc.
  • Foreign, with one possible value: Yes. This feature only applies to X.
  • Mood, with two possinle values: Ind, and Imp
  • Number, applies to DET, NOUN, and PRON, with two possible values: Sing, or Plur.
  • NumType, applies to NUM and ADJ, with two possible values: Card or Ord.
    • NumType=Card is used for NUM.
    • NumType=Ord is used for ordinal numbers tagged as ADJ.
  • Person, applies to PRON with three possible values: 1, 2, 3.
  • Polarity, with one possible value: Neg, applies to PART and INTJ.
    • Polarity=Neg for PART applies for negation particles as in Saya tidak menyukainya “I do not like him/her/it”. The word tidak “no” will be tagged with Polarity=Neg.
    • Polarity=Neg for INTJ as in Tidak, terima kasih “No, thanks”. The word tidak “no” will be given feature Polarity=Neg.
  • Poss, applies to PRON, with one possible value: Yes for PRON that serves as possessive pronouns.
  • PronType, applies to PRON, DET, and ADV. For Indonesian, 7 possible values can be applied:
    1. PronType=Dem, applies to ADV, DET, and PRON such as for itu “that” in Itu masalahmu. “That is your problem.”
    2. PronType=Emp, applies to DET such as for sendiri “self” in Kamu harus percaya pada dirimu sendiri “You have to believe in yourself”.
    3. PronType=Ind, applies to ADV, DET, and PRON such as for seseorang “someone/somebody” or sesuatu “something”
    4. PronType=Int, applies to PRON and ADV.
       • PronType=Int for PRON, such as for apa “what” and siapa “who” in interrogative sentences
       • PronType=Int for ADV, such as for bagaimana “how” and kapan “when” in interrogative sentences
    5. PronType=Prs, applies to PRONfor all personal pronouns.
    6. PronType=Rel, applies to PRON and ADV.
       • PronType=Rel for PRON, such as for apa “what”, siapa “who”, yang “that”.
       • PronType=Rel for ADV, such as for di mana “where”, bagaimana “how” and kapan/saat/ketika “when” in non-interrogative sentences
    7. PronType=Tot, applies to ADV, DET, and PRON.
       • PronType=Tot for PRON, such as for semua “all” in Semua adalah milikmu. “All is yours.”
       • PronType=Tot for DET, such as for semua “all” in Semua siswa terlihat senang. “All students look happy.”
       • PronType=Tot for ADV, such as for selalu “always” in Dia selalu terlambat. “She is always late.”
  • Reflex, applies to PRON with one possible value: Yes.
  • Typo, with one possible value, Yes. This feature can be applied to all UPOS categories except PUNCT and SYM.
  • Voice, applies to VERB with two possible values: Act and Pass. Voice alternation is treated as inflection and the active and passive counterparts have the same lemma.
    • Voice=Act for active verbs that have characteristic of using base word, prefixes me-, ber-
      • Active verbs without affix: duduk “sit”, pergi “go”
      • Active verbs with prefix me-: memperbaiki “fix”, mengakui “admit”
      • Active verbs with prefix ber-: belajar “study”, bekerja “work”
    • Voice=Pass for passive verbs that have characteristic of using prefixes di-, ter- or circumfix ke-an.
      • Passive verbs with prefix di- : dipublikasikan “be published”, dilepaskan “be released”
      • Passive verbs with prefix ter-: terbakar “on fire”, terjatuh “fell”, terkejut “shocked”
      • Passive verbs with confix ke-an: ketinggalan “lag behind”, kecurian “be stolen”
• We consider these 10 UD v2 features are not relevant to Indonesian grammar:
  • Gender. Indonesian words have no gender.
  • Animacy. Similar with Gender, there is no requirements of agreements between words in Indonesian.
  • NounClass, with the same reason for Gender and Animacy
  • Case, with the same reason for Gender, Animacy, and NounClass
  • Tense. Indonesian verbs have the same form in all tenses.
  • Aspect, with the same reason for Tense.
  • Definite
  • Evident
  • Polite
  • VerbForm

Syntax

Core Arguments, Oblique Arguments and Adjuncts

• The default word order is SVO, so the subject (nsubj) normally precedes and the object follows the verb (with the exception of inverted sentences).
• A verb may serve as the subject and is labeled as clausal subject, either as csubj or csubj:pass.
• Transitive verbs will have a noun phrase as the object (obj).
• Passive verbs could be followed by agent (obl:agent), such as in Pesan yang dikirimkan presiden “Messages sent by president”, presiden “president” is the agent of predicate dikirimkan “be sent”.
• Verbs can have oblique arguments (obl). Special for temporal modifiers, we label it as obl:tmod.

Non-verbal Clauses

• The copula ialah or adalah (be) is optionally used in equational, attributional, locative, possessive and benefactory nonverbal clauses. The two forms are interchangeable but adalah is more common. For example: “This is my house.”, in Indonesian can be written as:
  • Ini rumahku., without copula
  • Ini adalah rumahku., with copula adalah

Relations Overview

• The following 14 relation subtypes could be used in Indonesian UD treebank:
  • acl:relcl for relative clauses that modify a noun phrase. In Indonesian, relative clauses usually use yang as the subject of the clause.
  • advmod:emph for particles (PART) -lah, -kah, -tah, pun that emphasize other words that could be a NOUN, PRON, VERB, or SCONJ. For example, token itulah “that” in tokenization phase was split into itu “that” and lah, then lah is annotated as the dependent of itu and the relation between them is advmod:emph.
  • case:adv for adposition (ADP) that together with its following word of ADJ/ADV/VERB serve as an adverb. In this case the ADP word is annotated as the dependent of ADJ/ADV/VERB and the dependency relation between them is case:adv, and the relation between the ADJ/ADV/VERB word and its parent is advmod. For example:
    • ADP + ADJ as adverb, such as secara hati-hati “carefully”, that consists of secara “with”_ (ADP) + hati-hati “careful” (ADJ)
    • ADP + ADV as adverb, such as dengan sungguh-sungguh “seriously”, that consists of dengan “with” (ADP) + sungguh-sungguh “serious” (ADV)
    • ADP + VERB as adverb, such as secara terpisah “separately”, that consists of secara “with” (ADP) + terpisah “separated” (VERB).
  • cc:preconj, such as in baik Mongolia maupun Tingkok “both Mongolia and China”, baik “both” is considered as preconjunct.
  • compound:a for adjective compounds, such as: luar biasa “extraordinary”, besar hati “heartened”
  • csubj:pass for clausal subjects of passive verbs.
  • flat:foreign to label sequences of foreign words.
  • flat:name to label sequences of names of PROPN-PROPN pairs.
  • nmod:lmod for locative nouns. In Indonesian, dalam “in/inside”, luar “out/outside” are considered as locative nouns. For noun phrases like dalam ruangan “in a/the room”, locative noun is annotated as the dependent of the noun phrase that it modify. This deprel has a head-final direction, different with nmod that has a head-initial direction.
  • nmod:poss for possessive relationship between NOUN/PROPN and another NOUN/PROPN. For example, in istri Trump “Trump’s wife”, token Trump will be given deprel nmod:poss.
  • nmod:tmod for the head of time-related noun phrases that becomes dependent of a noun phrase. For example, in pengeluaran tahun ini “this year spending”, tahun ini “this year” modifies pengeluaran “spending”, and the head of this phrase, tahun “year” will be annotated as the dependent of pengeluaran “spending” with the deprel nmod:tmod.
  • nsubj:pass for nominal subjects of passive verbs
  • obl:agent for agents of passive verbs
  • obl:tmod for head of time-related noun phrases that depend on a VERB/ADJ. For example, in Kali ini saya setuju. “This time I agree.”, kali ini “this time” describes the predicate setuju “agree”, and the head of this noun phrase, kali “time”, will be annotated as the dependent of setuju “agree” with the deprel obl:tmod

• Universal deprel clf is relevant for Indonesian. This label is used in the Indonesian-CSUI treebank but not represented in the Indonesian-PUD.

• The following universal delrel are not represented in both the Indonesian-PUD and Indonesian-CSUI:
  • dep
  • expl
  • list
  • reparandum

Remark

This Indonesian documentation is applied only to the Indonesian-PUD and the Indonesian-CSUI treebank. The Indonesian-GSD does not conform to these guidelines.

Treebanks

There are 3 Indonesian UD treebanks:

• Indonesian-GSD
• Indonesian-PUD
• Indonesian-CSUI

© 2014–2020 Universal Dependencies contributors. Site powered by Annodoc and brat