TonyMou

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

flash-attention

Fast and memory-efficient exact attention

pytorch-image-models

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNet-V3/V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

SwiftUI-DesignCode

 SwiftUI-DesignCode is some examples in the process of learning swiftUI 2.0

gpt-researcher

GPT based autonomous agent that does online comprehensive research on any given topic

mlc-llm

Universal LLM Deployment Engine with ML Compilation

openpilot

openpilot is an open source driver assistance system. openpilot performs the functions of Automated Lane Centering and Adaptive Cruise Control for 250+ supported car makes and models.

tinygrad

You like pytorch? You like micrograd? You love tinygrad! ❤️

Langchain-Chatchat

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM) QA app with langchain

carla

Open-source simulator for autonomous driving research.

AirSim

Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research

tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

fauxpilot

FauxPilot - an open-source alternative to GitHub Copilot server

tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

copilot-explorer

Hacky repo to see what the Copilot extension sends to the server

erdos

Dataflow system for building self-driving car and robotics applications.

bazel-buildfarm

Bazel remote caching and execution service

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

k2

FSA/FST algorithms, differentiable, with PyTorch compatibility.

mace-kit

activityrecognition

Resources about activity recognition-行为识别资料

kaldi-onnx

Kaldi model converter to ONNX

openpose

OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

mace-models

Mobile AI Compute Engine Model Zoo

mace

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

embedded_ai

medical-inference

This project is a deep learning medical xray-image inference demo based on nvidia jetson tx2' s jetson-inference.

nbashots

NBA shot charts using matplotlib, seaborn, and bokeh.