theyorubayesian / masakhane_miracl

masakhane_miracl

This repository guides our submission to the WSDM 2023 Cup: MIRACL

Setup & Installation

• Create an environment using either Conda or Venv

conda create -n miracl python=3.8 openjdk=11
conda activate miracl

• Clone the repo

git clone --recurse-submodules https://github.com/theyorubayesian/masakhane_miracl.git 

• Install Pytorch>=1.10 suitable for your CUDA version. See Pytorch

• Install other requirements

pip install -r requirements.txt

• Login to Weights & Biases where we are logging our experiments.

wandb login

• Hack away 🔨🔨

Experiments

1. Training on MS Marco & Reporting Zero-Shot Results on Mr.TyDi Swahili
2. Zero-Shot Evaluation of the Dense Retriever on Miracl Dev Set
3. Finetuning the Dense Retriever on the Miracl Train Set & Generating Rankings for the testA set