facebookresearch / stopes

A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB team.

https://facebookresearch.github.io/stopes/

facebookresearch/stopes Issues

attribution of LLMs
Updated 6 months ago1
Error with posix_ipc semaphore when trying to run AutoPCP
Updated 6 months ago2
[VSim ECAPA] What $MODEL_PATH should be used when using the ECAPA model for speaker similarity evaluation?
Closed 6 months ago2
Missing file and functions
Closed 8 months ago2
Bug in tokenizer for Tibetian Language
Updated 8 months ago1
the list index overflow
Updated 9 months ago1
eng_twl_short_porn.txt missing (toxicity filtering NLLB)
Updated a year ago
NLLB mined data?
Closed a year ago1
Filtering pipeline produces a config with wrong lang directions
Updated a year ago1
Efficient mining using all the available computational resources
Updated a year ago4
error when prepare_data
Updated a year ago2
Fix: Refactor the seamlisten project Documentation (installation) for Mac and Windows User
Updated a year ago
[seamlisten] download button
Updated a year ago2
[seamlisten] add initial backend test
Updated a year ago1
[seamlisten] play on paste
Updated a year ago1
[seamlisten] remove double slash comments in css
Updated a year ago2
[seamlisten] add initial frontend test
Updated a year ago1
[seamlisten] The context region is not grayed
Updated a year ago
[seamlisten] stop playpack at the end of non-gray segment
Updated a year ago
[seamlisten] ability to sort/filter by score
Updated a year ago
[seamlisten] audio timestamps during playback (relative and absolute)
Updated a year ago
[seamlisten] bug: padding is added to segments without the grey area to indicate it
Updated a year ago
[seamlisten] internal server error for some data
Updated a year ago
[seamlisten] Explore folders
Updated a year ago
[seamlisten] Improve audio fetching
Updated a year ago
Some small typo in README.md file
Closed a year ago1
Prepare new data for NLLB-200
Updated a year ago9
Minor bug in ALTI's code
Updated a year ago1
Using `stopes` for filtering instead of mining
Closed a year ago1
spm-200 dictionary duplicate error
Closed a year ago4
Index training failing with CUDA out of memory error.
Closed 2 years ago4
Prepare data for NLLB finetuning - what is the format of data files?
Closed 2 years ago2
Filtering and Preparing the Data to finetune NLLB-200
Closed 2 years ago12
How to create training data through pipeline
Updated 2 years ago4
Using stopes with an unseen language
Updated 2 years ago5
CUDA error while running on cpus
Closed 2 years ago
Demo bitext mining fails in faiss population
Closed 2 years ago6
Which pipeline is used specifically to preprocess input to NLLB model for inference?
Closed 2 years ago5
Unable to run Demo present in demo folder.
Closed 2 years ago9