mekaneeky

gpt4all

GPT4All: Chat with Local LLMs on Any Device

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

trl

Train transformer language models with reinforcement learning.

automl

Google Brain AutoML

nlpaug

Data augmentation for NLP

LLMLingua

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

whisper-diarization

Automatic Speech Recognition with Speaker Diarization based on OpenAI Whisper

Torch-Pruning

[CVPR 2023] Towards Any Structural Pruning; LLMs / SAM / Diffusion / Transformers / YOLOv8 / CNNs

lion-pytorch

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

hivemind

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

BitNet

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

HashingDeepLearning

Codebase for "SLIDE : In Defense of Smart Algorithms over Hardware Acceleration for Large-Scale Deep Learning Systems"

pytorch_notebooks

tutorial notebooks

zero-cost-nas

Zero-Cost Proxies for Lightweight NAS

DARTS

Differentiable architecture search for convolutional and recurrent networks

1.58BitNet

Experimental BitNet Implementation

bittensor-mining-tutorial

masakhane-pos

POS for African languages

Data-Distillation-for-Text-Classification

bittensor-model-finetune

Model Fine-tuning for Bittensor miners using the dataset generated by validators

endpoint-center

automl-cup-starter-kit

parallel-text-EDA

Exploratory data analysis and data preparation the ug-language-parallel-text dataset

PretrainSubnet

mlops

delta-subnet

Secret.

detrain

testing playground for distributed federated learning

gradient

Gradient

mach-subnet

Secret.

turing

Turing: distributed training