home edit page issue tracker
This page pertains to UD version 2.

UD Japanese BCCWJLUW

Language: Japanese (code: ja)
Family: Japanese

This treebank has been part of Universal Dependencies since the UD v2.9 release.

The following people have contributed to making this treebank part of UD: Mai Omura, Masayuki Asahara, Yusuke Miyao, Takaaki Tanaka, Hiroshi Kanayama, Yuji Matsumoto, Shinsuke Mori, Sumire Uematsu, Yugo Murawaki.

Repository: UD_Japanese-BCCWJLUW
Search this treebank on-line: PML-TQ
Download all treebanks: UD 2.15

License: CC BY-NC-SA 4.0. The underlying text is not included; the user must obtain it separately and then merge with the UD annotation using a script distributed with UD

Genre: news, nonfiction, fiction, blog, web

Questions, comments? General annotation questions (either Japanese-specific or cross-linguistic) can be raised in the main UD issue tracker. You can report bugs in this treebank in the treebank-specific issue tracker on Github. If you want to collaborate, please contact [masayu-a (æt) ninjal • ac • jp]. Development of the treebank happens outside the UD repository. If there are bugs, either the original data source or the conversion procedure must be fixed. Do not submit pull requests against the UD repository.

Annotation Source
Lemmas not available
UPOS annotated manually in non-UD style, automatically converted to UD
XPOS not available
Features not available
Relations annotated manually in non-UD style, automatically converted to UD

Description

This Universal Dependencies (UD) Japanese treebank is based on the definition of UD Japanese convention described in the UD documentation. The original sentences are from `Balanced Corpus of Contemporary Written Japanese’(BCCWJ).

UD-Japanese-BCCWJLUW is the other word segmentation version of UD-Japanese-BCCWJ. We use Long Unit Word (LUW) as their syntactic word in UD definition.

The Japanese UD treebank contains the sentences from BCCWJ [1] https://clrd.ninjal.ac.jp/bccwj/en/ with BCCWJ-DepPara[2] annotation.

The word units is based on Long Unit Word in BCCWJ [1]. We prepared conversion rules from BCCWJ-DepPara to UD_Japanese v2.1 guidelines [3][4].

Recovering data

The data is provided in the CoNLL format, but original texts are stripped off due to the license issue.

The corpus is obtained by running the following command:

./merge/merge.sh -c BCCWJ_CORE_FILE

where BCCWJ_CORE_FILE denotes the file of BCCWJ core file (core_LUW.txt, OT) the script requires Python (3.x)

or

The BCCWJ DVD edition purchaser can download the data with the original text from https://bccwj-data.ninjal.ac.jp/

Spliting

Each data set contains UD annotations for the following parts in BCCWJ

training: annotation B, C, D, E subsets development: annotation A subset test: annotation A subset

See also https://github.com/masayu-a/BCCWJ-ANNOTATION-ORDER

Acknowledgments

The original treebank was provided by:

The corpus was converted by:

through annotation, discussion and validation with

This work was supported by JSPS KAKENHI Grants Numbers JP17H00917 and NINJAL Annotation Project.

Statistics of UD Japanese BCCWJLUW

POS Tags

ADJ – ADP – ADV – AUX – CCONJ – DET – INTJ – NOUN – NUM – PART – PRON – PROPN – PUNCT – SCONJ – SYM – VERB – X

Features

Foreign – Polarity

Relations

acl – advcl – advmod – amod – aux – case – cc – ccomp – compound – cop – csubj – csubj:outer – dep – det – discourse – dislocated – fixed – mark – nmod – nsubj – nsubj:outer – nummod – obj – obl – punct – reparandum – root

Tokenization and Word Segmentation

Morphology

Tags

Nominal Features

Degree and Polarity

Verbal Features

Pronouns, Determiners, Quantifiers

Other Features

Syntax

Auxiliary Verbs and Copula

Core Arguments, Oblique Arguments and Adjuncts

Here we consider only relations between verbs (parent) and nouns or pronouns (child).

Relations Overview