WMT-SLT 22: Sign Language Translation Task

First WMT shared task on sign language translation. This shared task is concerned with automatic translation between signed and spoken languages. The task is novel in the sense that it requires processing visual information (such as video frames or human pose estimation) beyond the well-known paradigm of text-to-text machine translation.

Website: https://www.wmt-slt.com/

Download test sets Register your team Create submission Competition updates

Leaderboard of WMT-SLT 22: Sign Language Translation Task

slttest2022.de-dsgs test set (de-dsgs)

# Name BLEU chrF Date
1 Anonymous submission #4 --- --- July 21, 2022, 11:01 p.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

slttest2022.dsgs-de test set (dsgs-de)

# Name BLEU chrF Date
1 Anonymous submission #860 0.2 0.2 Aug. 2, 2022, 9:34 p.m.
2 Anonymous submission #189 0.3 0.2 July 26, 2022, 3:22 p.m.
3 Anonymous submission #886 0.1 0.2 Aug. 5, 2022, 9:12 a.m.
4 Anonymous submission #271 0.2 0.2 July 27, 2022, 10:07 p.m.
5 Anonymous submission #881 0.2 0.2 Aug. 5, 2022, 3:45 a.m.
6 Anonymous submission #897 0.6 0.2 Aug. 6, 2022, 1:44 p.m.
7 Anonymous submission #859 0.1 0.2 Aug. 1, 2022, 8:30 p.m.
8 Anonymous submission #889 0.4 0.2 Aug. 5, 2022, 1:04 p.m.
9 Anonymous submission #891 0.3 0.2 Aug. 6, 2022, 10:46 a.m.
10 Anonymous submission #890 0.3 0.2 Aug. 6, 2022, 10:02 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.