Keita Watanabe's repositories
2017_CRCNS_Summer_School
Repo for reviewing 2017 Berkeley summer course in mining and modeling of neuroscience data.
introduction-to-kubeflow
Kubernetes Meetup Tokyo https://k8sjp.connpass.com/ でのKubeflowに関するLTの内容をまとめたレポジトリです
aws-efa-nccl-baseami-pipeline
EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
ecsdemo-nodejs
Part 3 of a 4 part ECS workshop
eks-manage-node-groups-placement-group
EKS Managed Node Groups with Placement Group
Generative_Deep_Learning_2nd_Edition
The official code repository for the second edition of the O'Reilly book Generative Deep Learning: Teaching Machines to Paint, Write, Compose and Play.
gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
llama-recipes
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
llama3
The official Meta Llama 3 GitHub site
machine-learning-engineering-for-production-public
Public repo for DeepLearning.AI MLEP Specialization
mpi-operator
Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)
National-Research-University-Higher-School-of-Economics-Advanced-Machine-Learning-Specialization
Repository for the National Research University Higher School of Economics - Advanced Machine Learning Specialization on Coursera
server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
torchtune
A Native-PyTorch Library for LLM Fine-tuning
training-operator
Training operators on Kubernetes.