System description papers - Submission information for authors

Paper Submission Format and Procedure

Each team which has submitted a system that has produced valid results is invited to submit a system description paper. There will be a separate volume of papers for the UD Shared task, published as “Proceedings of the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies”.

By default, system description papers will be presented as posters. If there are any exceptions, we will contact those concerned individually.

Format and length

Submissions for the CoNLL 2017 Shared Task system description paper are NOT anonymous. Papers should be at most eight (8) pages in length, excluding references which can be of any length. We strongly recommend the use of the CoNLL 2017 UD Shared Task style files, modified from the ACL 2017 files, available from here. Alternatively, you might want to clone the sample file on Overleaf to jump-start writing your paper: https://www.overleaf.com/read/btssrcdqdwmg

The system description papers must describe the approach taken to perform parsing (and tokenization, morphology and tagging if it is part of your system), and provide an informative analysis of the results. We encourage authors to include information on training/evaluation times and memory requirements (if available). This will facilitate comparisons on several dimensions besides the main metrics. The system description papers need not describe the shared task itself. This will be covered in the task description paper (see below for a proper reference). The system description papers may report results of post-evaluation systems in addition to the official scores, as long as these results are marked as post-evaluation. In any case, please do report your official scores from the Shared Task website (available here: http://universaldependencies.org/conll17/results.html).

Please give credit to the data and baseline and evaluation system authors and providers. We have included the necessary .bib entries in the udst2017.bib file (available in the style package).

Also, we need your input for the UD Shared Task overview paper: please fill the Google form available here: https://docs.google.com/forms/d/19gqRx7vTi6q33giFvDUTxFhrLAYSEfDPCeE1HgZCn90

(For the Shared Task general feedback (possibly anonymous), please use a different form: https://docs.google.com/forms/d/1FBiLiESUAnzaaY3k2UhXb1ezFznWPUkfyjx8jr8crCQ)

If you have already published the core ideas of your system, please cite it properly. Please bear in mind that the CoNLL 2017 Shared Task papers are system description papers, and as such should be different from research papers describing the main ideas behind your system in that focus should be on replicability, description of all modules, software, data and settings that you have used.

Submission site

We are using the START system, as CoNLL and ACL 2017 does. Please submit your paper here: https://www.softconf.com/acl2017/conll-udparsing-st2017/

Review process

All papers will be reviewed by at least two reviewers, which will be recruited from you (task participants) as well as from the organization team. The purpose of the review process is to make sure that the papers respect basic requirements for a research paper, not to decide whether to accept them or not. Only papers which are below acceptable standard or submitted late will be excluded from the proceedings.

Important dates (UTC-11, 23:59)

Submission deadline: May 26, 2017

Reviews due: June 2, 2017

Camera ready due in START: June 9, 2017

Conference: August 3-4, 2017