ToluClassics

candle-tutorial

Tutorial for Porting PyTorch Transformer Models to Candle (Rust)

mlx-transformers

MLX Transformers is a library that provides model implementation in MLX. It uses a similar model interface as HuggingFace Transformers and provides a way to load and run models in Apple Silicon devices.

search-related-articles

This repository is dedicated to collecting blog posts and articles on the implementation of state-of-the-art techniques in semantic search, dense retrieval, and retrieval augmented generation (RAG).

LowResourceOCR

This work is an adaptation of CNN+Transformer architecture to training text recognition models for Yorùbá & Igbo Languages

rustserini

A port of Pyserini and Anserini in Rust

datasets

TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...

Low-Resource-NLP-Tutorials

Getting started in NLP for low resource languages

pyserini

Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.

afriberta

AfriBERTa: Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages

anserini

Anserini is a Lucene toolkit for reproducible information retrieval research

candle

Minimalist ML framework for Rust

candle-model-archive

A model archiving package for loading and inference candle models similar to torch-serve

candle-training

checklist

Beyond Accuracy: Behavioral Testing of NLP models with CheckList

covidex

A multi-stage neural search engine for the COVID-19 Open Research Dataset

DPR

Dense Passage Retriever - is a set of tools and models for open domain Q&A task.

flaxformer

gwf-publications

j4rs

Java for Rust

mlx-examples

Examples in the MLX framework

pygaggle

a gaggle of deep neural architectures for text ranking and question answering, designed for Pyserini

roots-search-tool

Scripts supporting the development and serving the Roots Search Tool - https://hf.co/spaces/bigscience-data/roots-search

rust-tokenizers

Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (SentencePiece) models

scikit-llm

Seamlessly integrate powerful language models like ChatGPT into scikit-learn for enhanced text analysis tasks.

t5x_retrieval

text-embeddings-inference

A blazing fast inference solution for text embeddings models

tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

toluclassics.github.io

Portfolio

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

wai