JackCaoG

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

jetstream-pytorch

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"

MuKoe

ml-auto-solutions

A simplified and automated orchestration workflow to perform ML end-to-end (E2E) model tests and benchmarking on Cloud VMs across different frameworks.

xla

A machine learning compiler for GPUs, CPUs, and ML accelerators

ghstack

Submit stacked diffs to GitHub on the command line

jax

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

moco_v3_tpu

vit_10b_fsdp_example

See details in https://github.com/pytorch/xla/blob/r1.12/torch_xla/distributed/fsdp/README.md

examples

This repository contains example code to build models on TPUs

taichi

Productive, portable, and performant GPU programming in Python.

pytorch-image-models

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNet-V3/V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

xla

Enabling PyTorch on XLA Devices (e.g. Google TPU)