OSCAR

OSCAR's repositories

:spider: The pipeline for the OSCAR corpus

Language:RustApache-2.0156 2 43

An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.

Language:GoApache-2.085 9 2

Downloading all files of a language from the OSCAR (Open Super-large Crawled Aggregated coRpus)

Language:PythonMIT10 1 3

The website of the Oscar Project

Language:TeXApache-2.010 4 10

corpus issues.

Apache-2.05 2 24

Apache-2.03 2 11

The original tooling for the OSCAR corpus rewritten in Rust

Language:RustApache-2.03 2 16

A compilation of multilingual URL blocklist

CC0-1.02 20

Language:Jupyter Notebook2 3 2

Compute statistics for OSCAR Monthly releases

Language:RustApache-2.0200

Collab around OSCAR: Data soucing..

Language:Python1 2 2

A tooling for the OSCAR corpus

Language:GoApache-2.01 10

ut1-blocklist rust library

Language:RustMIT1 2 2

Readers/Writers for OSCAR Corpus

Language:RustApache-2.002 3

020

020