Pangeanic is organizing the MT task as a part of the Covid-19 MLIA @ Eval

Pangeanic is organizing the MT task as a part of the Covid-19 MLIA @ Eval. The goal is to organize a community evaluation effort aimed at accelerating the creation of resources and tools for improved MultiLingual Information Access (MLIA) in the current emergency situation covid19MLIA-300x113

We invite you to participate in the MT task as a part of the Covid-19 MLIA @ Eval. The goal is to organize a community evaluation effort aimed at accelerating the creation of resources and tools for improved Multilingual Information Access (MLIA) in the current emergency situation. Covid-19 MLIA @ Eval adopts an incremental and iterative evaluation methodology to:

enable the release of intermediate (but functional) resources, and
move progressively (iteration-after-iteration) towards consolidated tools and resources.

We plan for three rounds, tentatively 1.5 month each. Each round consists of the following phases:

Data release
Submission of participants’ runs
Scoring of participants’ runs
Trans writing of the rolling technical report
Round wrap virtual meeting

An integral part of the Covid-19 MLIA @ Eval approach consists in sharing information and ideas among the participants. This will be made possible through both the rolling technical report where participants describe their solutions throughout the evaluation rounds and the virtual meetings held at the end of each round where participants present briefly the main highlights of what did/did not work and exchange with each other’s in order to share ideas and improve for the next round. We offer tasks in the following language pairs: English->French, English->German, English->Greek, English->Italian, English->Spanish, and English->Swedish. Registration for the tasks is open at: http://eval.covid19-mlia.eu/registration/ Important Dates - Round 1:

Round starts: October 23, 2020
Release of training data: October 23, 2020
Release of test data: November 20, 2020
Translations submission deadline: December 2, 2020
Translations scored: December 4, 2020
Rolling report submission deadline (preliminary version): December 23, 2020
Rolling report submission deadline (camera ready): January 8, 2021
Slot for a virtual meeting to discuss the results: January 12-14, 2021
Round ends: January 15, 2021

More information at this link Organizers:

Overall

Khalid Choukri, ELDA, France

Nicola Ferro, University of Padua, Italy

Machine Translation

Francisco Casacuberta, Universitat Politècnica de València, Spain

Miguel Domingo, Universitat Politècnica de València, Spain

Mercedes García-Martínez, Pangeanic, Spain

Manuel Herranz, Pangeanic, Spain

Supporters Covid-19 MLIA @ Eval is an evaluation effort promoted by several communities which are closely working together.

European Commission

European Language Resources Coordination (ELRC),

European Language Resources Association (ELRA)

European Research Infrastructure for Language Resources and Technology (CLARIN)

CLEF Initiative

We hope that other communities will join us in this shared effort. You are very welcome! Additional Information You can find additional information on our Website, click here You can follow updates through our Twitter account: @covid19mlia Any requests or comments? Drop us an email at: info@covid19-mlia.eu

Marisol L.D.

11/30/20