home edit page issue tracker

UD English PUD

Language: English (code: en)
Family: IE

This treebank has been part of Universal Dependencies since the UD v2.1 release.

The following people have contributed to making this treebank part of UD: Hans Uszkoreit, Vivien Macketanz, Aljoscha Burchardt, Kim Harris, Katrin Marheinecke, Slav Petrov, Tolga Kayadelen, Mohammed Attia, Ali Elkahky, Zhuoran Yu, Emily Pitler, Saran Lertpradit, Jesse Kirchner, Lorenzo Lambertino, Martin Popel, Daniel Zeman, Christopher Manning, Sebastian Schuster, Siva Reddy.

Repository: UD_English-PUD
Search this treebank on-line: PML-TQ
Download all treebanks: UD 2.15

License: CC BY-SA 3.0

Genre: news, wiki

Questions, comments? General annotation questions (either English-specific or cross-linguistic) can be raised in the main UD issue tracker. You can report bugs in this treebank in the treebank-specific issue tracker on Github. If you want to collaborate, please contact [syntacticdependencies (æt) lists • stanford • edu]. Development of the treebank happens outside the UD repository. If there are bugs, either the original data source or the conversion procedure must be fixed. Do not submit pull requests against the UD repository.

Annotation	Source
Lemmas	assigned by a program, not checked manually
UPOS	annotated manually, natively in UD style
XPOS	annotated manually
Features	assigned by a program, not checked manually
Relations	annotated manually, natively in UD style

Description

This is the English portion of the Parallel Universal Dependencies (PUD) treebanks created for the CoNLL 2017 shared task on Multilingual Parsing from Raw Text to Universal Dependencies (http://universaldependencies.org/conll17/).

This is a part of the Parallel Universal Dependencies (PUD) treebanks created for the CoNLL 2017 shared task on Multilingual Parsing from Raw Text to Universal Dependencies (http://universaldependencies.org/conll17/). There are 1000 sentences in each language, always in the same order. (The sentence alignment is 1-1 but occasionally a sentence-level segment actually consists of two real sentences.) The sentences are taken from the news domain (sentence id starts in ‘n’) and from Wikipedia (sentence id starts with ‘w’). There are usually only a few sentences from each document, selected randomly, not necessarily adjacent. The digits on the second and third position in the sentence ids encode the original language of the sentence. The first 750 sentences are originally English (01). The remaining 250 sentences are originally German (02), French (03), Italian (04) or Spanish (05) and they were translated to other languages via English. Translation into German, French, Italian, Spanish, Arabic, Hindi, Chinese, Indonesian, Japanese, Korean, Portuguese, Russian, Thai and Turkish has been provided by DFKI and performed (except for German) by professional translators. Then the data has been annotated morphologically and syntactically by Google according to Google universal annotation guidelines; finally, it has been converted by members of the UD community to UD v2 guidelines. Martin Popel automatically converted the data to UD v2 and Sebastian Schuster, Siva Reddy, and Christopher Manning manually corrected UPOS tags and syntactic annotations. Morphological features and lemmata were added automatically using Stanford CoreNLP.

Additional languages have been provided (both translation and native UD v2 annotation) by other teams: Czech by Charles University, Finnish by University of Turku and Swedish by Uppsala University.

The entire treebank is labeled as test set (and was used for testing in the shared task). If it is used for training in future research, the users should employ ten-fold cross-validation.

Acknowledgments

The sentences were provided by DKFI, and the 250 sentences in German, French, Italian, and Spanish were translated to English by professional translators.

Syntactic and morphological annotations were originally added by Google according to Google universal annotation guidelines, then automatically converted to UD v2 by Martin Popel, and finally manually corrected by Sebastian Schuster, Siva Reddy, and Christopher Manning. Morphological features and lemmata were added by Sebastian Schuster.

Statistics of UD English PUD

POS Tags

ADJ – ADP – ADV – AUX – CCONJ – DET – INTJ – NOUN – NUM – PART – PRON – PROPN – PUNCT – SCONJ – SYM – VERB – X

Features

Abbr – Case – Definite – Degree – ExtPos – Foreign – Gender – Mood – Number – NumForm – NumType – Person – Polarity – Poss – PronType – Reflex – Style – Tense – Typo – VerbForm

Relations

acl – acl:relcl – advcl – advcl:relcl – advmod – amod – appos – aux – aux:pass – case – cc – cc:preconj – ccomp – compound – compound:prt – conj – cop – csubj – csubj:pass – dep – det – det:predet – discourse – dislocated – expl – fixed – flat – goeswith – iobj – mark – nmod – nmod:poss – nmod:unmarked – nsubj – nsubj:pass – nummod – obj – obl – obl:unmarked – orphan – parataxis – punct – reparandum – root – vocative – xcomp

Tokenization and Word Segmentation

• This corpus contains 1000 sentences, 21051 tokens and 21180 syntactic words.

• This corpus contains 2621 tokens (12%) that are not followed by a space.

• This corpus does not contain words with spaces.

• This corpus contains 45 types of words that contain both letters and punctuation. Examples: 's, ’s, n't, n’t, U.S., No., St., co-starring, ’d, B.C., Ms., ’m, ’ve, 'Ya, 'd, 'm, 've, B-29s, B.C.E., G.D.P., Jr., M.A., Mr., Z., anti-fascist, ca., co-starred, co-wrote, e-mail, ex-minister, extra-marital, inter-communal, mid-1962, mid-1970s, mid-1980s, mid-Sixties, multi-ethnic, non-fiction, non-white, pro-Beijing, re-domesticated, re-elected, un-detectable, wi-fi, ’re

• This corpus contains 129 multi-word tokens. On average, one multi-word token consists of 2.00 syntactic words.
• There are 93 types of multi-word tokens. Examples: it's, that's, city's, China's, didn't, don't, Disney's, Earth's, Hitchcock's, Kong's, Russia's, Years', can't, company's, director's, doesn't, isn't, there's, town's, world's, AKP's, Addenbrooke's, Alvarez's, Apple's, Australia's, Bangkok's, Beria's, Bogart's, Brisbane's, Carangi's, Clinton's, Comey's, Darius's, Duffy's, Edgar's, Erdogan's, Germaine's, Grafton's, He'd, Hitchhiker's, I'm, Institute's, Kingdom's, Kipling's, Knightley's, LaBeouf's, Lamarr's, Motors', Negan's, Nevada's.

Morphology

Tags

• This corpus uses 17 UPOS tags out of 17 possible: ADJ, ADP, ADV, AUX, CCONJ, DET, INTJ, NOUN, NUM, PART, PRON, PROPN, PUNCT, SCONJ, SYM, VERB, X

• This corpus contains 8 word types tagged as particles (PART): ', 's, n't, not, n’t, to, up, ’s

• This corpus contains 38 lemmas tagged as pronouns (PRON): I, anybody, anyone, anything, everyone, everything, he, her, herself, himself, his, it, its, itself, my, none, one, our, she, somebody, someone, something, that, their, themselves, there, they, this, we, what, where, which, who, whoever, whom, whose, you, your

• This corpus contains 18 lemmas tagged as determiners (DET): a, all, another, any, both, each, either, every, half, nary, no, some, such, that, the, this, whatever, which

• Out of the above, 3 lemmas occurred sometimes as PRON and sometimes as DET: that, this, which

• This corpus contains 12 lemmas tagged as auxiliaries (AUX): be, can, could, do, get, have, may, might, must, should, will, would

• Out of the above, 5 lemmas occurred sometimes as AUX and sometimes as VERB: be, do, get, have, will

• There are 4 (de)verbal forms:

• Fin
  • AUX: was, is, would, will, are, were, can, has, had, could
  • VERB: said, took, has, began, are, is, became, says, have, had

• Ger
  • AUX: being, having
  • VERB: following, including, according, making, playing, using, getting, working, co-starring, growing

• Inf
  • AUX: be, have
  • VERB: have, take, do, go, keep, help, make, see, come, get

• Part
  • AUX: been
  • VERB: used, known, given, made, built, left, released, seen, allowed, considered

Nominal Features

• Gender

• Fem
  • PRON: her, she, herself

• Masc
  • PRON: he, his, him, himself

• Neut
  • PRON: it, its, itself

• Number

• Plur
  • DET: these, those
  • NOUN: people, years, police, investors, months, companies, countries, euros, films, children
  • NUM: 2000s
  • PRON: their, they, we, them, our, us, those, themselves, these
  • PROPN: States, Alps, Powers, Ages, Americans, Americas, Andes, Balkans, Chinese, Democrats

• Sing
  • AUX-Fin: was, is, has, 's, ’s, does, am
  • DET: this, that
  • NOUN: time, year, government, city, state, century, world, day, war, place
  • PRON: it, he, his, I, her, its, she, this, him, that
  • PROPN: China, Sea, October, Trump, North, War, America, April, Europe, France
  • SYM: %
  • VERB: has, is, says, was, makes, helps, seems, working, 's, appears
  • VERB-Fin: has, is, says, was, makes, helps, seems, 's, appears, contains

• Case

• Acc
  • PRON: it, him, them, her, us, me, himself, themselves, itself, You

• Nom
  • PRON: it, he, they, I, she, we, you, 'Ya

• Definite

• Def
  • DET: the

• Ind
  • DET: a, an

Degree and Polarity

• Degree

• Cmp
  • ADJ: more, greater, higher, better, earlier, fewer, lower, Elder, Stranger, bigger
  • ADV: longer, earlier, less, better, closer, further

• Pos
  • ADJ: new, many, other, last, great, high, first, own, several, political
  • ADV: well, far, late, soon, close, early, hard, long, Fast

• Sup
  • ADJ: best, most, biggest, latest, worst, tallest, largest, least, deepest, earliest
  • ADV: least, best

• Polarity

• Neg
  • ADV: no
  • PART: not, n't, n’t

Verbal Features

• Mood

• Ind
  • AUX-Fin: was, is, are, were, has, had, have, 's, did, do
  • VERB-Fin: said, took, has, began, are, is, became, says, have, had

• Tense

• Past
  • AUX-Fin: was, were, had, did, got
  • AUX-Part: been
  • VERB-Fin: said, took, began, became, had, told, worked, was, were, allowed
  • VERB-Part: used, known, given, made, built, left, released, seen, allowed, considered

• Pres
  • AUX-Fin: is, are, has, have, 's, do, ’s, does, am, ’m
  • VERB-Fin: has, are, is, says, have, include, makes, helps, say, seems
  • VERB-Part: investigating, seeking, thinking, attending, boarding, bracing, calling, carrying, celebrating, coming

Pronouns, Determiners, Quantifiers

• PronType

• Art
  • DET: the, a, an

• Dem
  • ADV: now, then, there, here
  • DET: this, that, these, those
  • PRON: this, that, those, these

• Ind
  • ADV: sometimes, ever
  • DET: some, another, any, such, either, half
  • PRON: someone, something, anybody, anyone, anything, somebody

• Int
  • ADV: when, how, why, where
  • DET: which
  • PRON: what, which, who, whose, where, whom

• Neg
  • ADV: never, nowhere
  • DET: no, nary
  • PRON: none

• Prs
  • PRON: it, he, his, their, they, I, her, its, she, we

• Rel
  • ADV: where, when, why, whenever
  • DET: whatever, which
  • PRON: which, that, who, whoever

• Tot
  • ADV: always
  • DET: all, each, both, every
  • PRON: everyone, everything

• NumType

• Card
  • NUM: one, two, three, million, 10, four, 1, six, 3, I

• Frac
  • DET: half
  • NUM: 1,165, 1,335, 1,365

• Mult
  • ADV: once, twice

• Ord
  • ADJ: first, second, third, 8th, 16th, 20th, 3rd, 5th, 13th, 14th

• Poss

• Yes
  • PRON: his, their, its, her, our, my, whose, your

• Reflex

• Yes
  • PRON: himself, themselves, itself

• Person

• 1
  • AUX-Fin: am
  • PRON: I, we, our, my, us, me

• 2
  • PRON: you, your, 'Ya

• 3
  • AUX-Fin: was, is, has, 's, ’s, does
  • PRON: it, he, his, their, they, her, its, she, him, them
  • VERB-Fin: has, is, says, was, makes, helps, seems, 's, appears, contains

Other Features

• Abbr
  • Yes
    • NOUN: BC
    • NUM: bn
    • PROPN: U.S., UK, BBC, CNN, EU, US, USA, B.C., GCA, GOP

• ExtPos
  • ADP
    • ADJ: such, due, Megarian
    • ADP: because, Due
    • ADV: Prior
    • VERB-Ger: according
  • ADV
    • ADJ: more
    • ADP: at, of, up
    • ADV: all, at
  • PRON
    • DET: each
  • SCONJ
    • ADP: in
    • SCONJ: in, Prior

• Foreign
  • Yes
    • X: de, Andes, Force, coup, tipo

• NumForm
  • Combi
    • ADJ: 8th, 16th, 20th, 3rd, 5th, 13th, 14th, 15th, 1st, 45th
  • Digit
    • NUM: 10, 1, 3, 2014, 2015, 100, 1492, 20, 2010, 2012
  • Roman
    • NUM: I, III, IV, II, V, VI, X
  • Word
    • ADJ: first, second, third, fourth
    • ADV: once, twice
    • DET: half
    • NUM: one, two, three, million, four, six, bn, five, seven, ten

• Style
  • Coll
    • PRON: 'Ya

• Typo
  • Yes
    • ADP: is
    • NOUN: after

Syntax

Auxiliary Verbs and Copula

• This corpus uses 1 lemmas as copulas (cop). Examples: be.

• This corpus uses 11 lemmas as auxiliaries (aux). Examples: have, be, would, will, can, do, could, may, might, should, must.
• This corpus uses 2 lemmas as passive auxiliaries (aux:pass). Examples: be, get.

Core Arguments, Oblique Arguments and Adjuncts

Here we consider only relations between verbs (parent) and nouns or pronouns (child).

• nsubj
  • VERB-Fin--NOUN (321)
  • VERB-Fin--NOUN-ADP(on) (1)
  • VERB-Fin--PRON (94)
  • VERB-Fin--PRON-Nom (180)
  • VERB-Ger--NOUN (4)
  • VERB-Ger--PRON (1)
  • VERB-Ger--PRON-Acc (1)
  • VERB-Ger--PRON-Nom (3)
  • VERB-Inf--NOUN (59)
  • VERB-Inf--PRON (14)
  • VERB-Inf--PRON-Acc (3)
  • VERB-Inf--PRON-Nom (51)
  • VERB-Part--NOUN (71)
  • VERB-Part--PRON (17)
  • VERB-Part--PRON-Nom (33)

• obj
  • VERB-Fin--NOUN (297)
  • VERB-Fin--PRON (5)
  • VERB-Fin--PRON-Acc (29)
  • VERB-Ger--NOUN (109)
  • VERB-Ger--PRON (3)
  • VERB-Ger--PRON-Acc (6)
  • VERB-Inf--NOUN (206)
  • VERB-Inf--PRON (11)
  • VERB-Inf--PRON-Acc (14)
  • VERB-Part--NOUN (72)
  • VERB-Part--PRON (3)
  • VERB-Part--PRON-Acc (6)

• iobj
  • VERB-Fin--NOUN (2)
  • VERB-Fin--PRON-Acc (1)
  • VERB-Ger--PRON-Acc (1)
  • VERB-Inf--NOUN (2)
  • VERB-Inf--PRON-Acc (1)

Verbs with Reflexive Core Objects

• This corpus contains 8 lemmas that occur at least once with a reflexive core object (obj or iobj). Examples: declare himself, establish itself, establish themselves, find himself, find itself, identify themselves, immerse themselves, protect themselves

Relations Overview

• This corpus uses 11 relation subtypes: acl:relcl, advcl:relcl, aux:pass, cc:preconj, compound:prt, csubj:pass, det:predet, nmod:poss, nmod:unmarked, nsubj:pass, obl:unmarked
• The following 2 relation types are not used in this corpus at all: clf, list

© 2014–2024 Universal Dependencies contributors. Site powered by Annodoc and brat

.