Is monolingual data used in the paper available for downloading?

Question

xiamengzhou opened this issue 5 years ago · comments

Hi, I don't find any access to get the monolingual data used in the paper. Is there anyway I can access those?

Vishrav Chaudhary · Answer 1 · Wed Apr 03 2019 01:33:11 GMT+0800 (China Standard Time)

Hi. You can download the data from the shared task webpage http://www.statmt.org/wmt19/parallel-corpus-filtering.html

xiamengzhou · Answer 2 · Wed Apr 03 2019 02:46:22 GMT+0800 (China Standard Time)

Thanks! But it's like the common crawl monolingual data for sin and nep is not provided in the shared task webpage?

Vishrav Chaudhary · Answer 3 · Thu Apr 04 2019 04:18:13 GMT+0800 (China Standard Time)

The commoncrawl data links have now been updated in the shared task webpage http://www.statmt.org/wmt19/parallel-corpus-filtering.html

Zi-Yi Dou · Answer 4 · Mon Jul 01 2019 09:54:59 GMT+0800 (China Standard Time)

Hi, I'm having trouble decompressing ”commoncrawl.deduped.en.xz“.

unxz: commoncrawl.deduped.en.xz: Unexpected end of input

I can decompress other files. Is there anything wrong with the file?