realnumber666

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

mlc-llm

Universal LLM Deployment Engine with ML Compilation

system-design-resources

These are the best resources for System Design on the Internet

horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

PySimpleGUI

Python GUIs for Humans! PySimpleGUI is the top-rated Python application development environment. Launched in 2018 and actively developed, maintained, and supported in 2024. Transforms tkinter, Qt, WxPython, and Remi into a simple, intuitive, and fun experience for both hobbyists and expert users.

ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

Tkinter-Designer

An easy and fast way to create a Python GUI 🐍

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

skypilot

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

FasterTransformer

Transformer related optimization, including BERT, GPT

Grokking-System-Design

Systems design is the process of defining the architecture, modules, interfaces, and data for a system to satisfy specified requirements. Systems design could be seen as the application of systems theory to product development.

nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

kruise

Automated management of large-scale applications on Kubernetes (incubating project under CNCF)

lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation

Awesome-System-for-Machine-Learning

A curated list of research in machine learning systems (MLSys). Paper notes are also provided.

optimum

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

mentoring

👩🏿‍🎓👨🏽‍🎓👩🏻‍🎓CNCF Mentoring: LFX Mentorship + Summer of Code

ttkbootstrap

A supercharged theme extension for tkinter that enables on-demand modern flat style themes inspired by Bootstrap.

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

aitextgen

A robust Python tool for text-based AI training and generation using GPT-2.

2024-Tech-OA

List of Tech Company OAs. Save your time from finding them all over the internet.

benchmark

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

effective_transformer

Running BERT without Padding

optimum-benchmark

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

slapo

A schedule language for large model training

rldb

Performances of Reinforcement Learning Agents

use-ray-with-slurm

A brief tutorial on how to use ray/rllib/tun in slurm cluster.

Getting-Started-with-aitextgen

A robust Python tool for text-based AI training and generation using GPT-2.

MediPlot