Welcome to OCELoT!

OCELoT stands for Open, Competitive Evaluation Leaderboard of Translations. This project started as part of the Fifth Machine Translation Marathon in the Americas. Project OCELoT aims to create an open platform for competitive evaluation of machine translation output, based on both automatic metrics and human evalation. It has been used for several shared tasks, including the WMT20 News Task. Code is available from GitHub and shared under an open license.

Download test sets Register your team Create submission Competition updates

Competitions

# Competition Test sets Submissions Start time Deadline
1 WMT22: Unsup and Very Low Res Task 12 75 Aug. 21, 2022, 2 p.m. Aug. 29, 2022, 2 p.m.
2 WMT-SLT 22: Sign Language Translation Task 2 26 July 21, 2022, 2 p.m. Aug. 6, 2022, 2 p.m.
3 WMT22: Biomedical Translation Task 14 155 July 21, 2022, 2 p.m. July 29, 2022, 5 p.m.
4 WMT22: General MT Task 21 800 July 21, 2022, 2 p.m. July 29, 2022, 2 p.m.