Yuan Wu's repositories
accelerate
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
BigDL
Building Large-Scale AI Applications for Distributed Big Data
ColBERT
ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22)
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
fedlearner
A multi-party collaborative machine learning framework
haystack
:mag: Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex decision making, question answering, semantic search, text generation applications, and more.
llm-on-ray
Pretrain, finetune and serve LLMs on Intel platforms with Ray
MAmmoTH
This repo contains the code and data for "MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning"
material-dashboard
Material Dashboard - Open Source Bootstrap 5 Material Design Admin
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
occlum
Occlum is a memory-safe, multi-process library OS for Intel SGX
python
Official Python client library for kubernetes
Model-References
TensorFlow and PyTorch Reference models for Gaudi(R)
nanotron
Minimalistic large language model 3D-parallelism training
optimum
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
optimum-habana
Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
text-embeddings-inference
A blazing fast inference solution for text embeddings models
tgi-gaudi
Large Language Model Text Generation Inference on Habana Gaudi
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
trl
Train transformer language models with reinforcement learning.
vue-material-dashboard
Vue Material Dashboard - Open Source Material Design Admin