PUNCT
: punctuation
Definition
Punctuation marks are non-alphabetical characters and character groups used in many languages to delimit linguistic units in printed text.
Punctuation is not taken to include logograms such as $, %, and §, which are instead tagged as SYM.
Note, that there is infixed punctuation (exclamation, emphasis and question marks). We refer to such cases as multiword tokens, as in ինչպէ՞ս “how?”, which become two tokens, ինչպէս and ՞ (for more details see the tokenization page).
Examples
- Period (Armenian full stop): ։
- Comma: ,
- Parentheses: ()
- Quotation mark: «»
- Exclamation mark: ՜
- Question mark։ ՞
- Emphasis mark, Acute accent: ՛
- Apostrophe: ՚
- Armenian hyphen (yentamna): ֊
PUNCT in other languages: [bej] [bg] [ca] [cs] [cy] [da] [el] [en] [es] [et] [fi] [fr] [ga] [grc] [hy] [hyw] [it] [ja] [ka] [kk] [kpv] [ky] [myv] [no] [pt] [ru] [sl] [sv] [tr] [tt] [uk] [u] [urj] [xcl] [yue] [zh]