conver334

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

Megatron-LM

Ongoing research training transformer models at scale

cutlass

CUDA Templates for Linear Algebra Subroutines

cs249r_book

Collaborative book Machine Learning Systems

LLMs_interview_notes

该仓库主要记录 大模型（LLMs） 算法工程师相关的面试题

flash-linear-attention

Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton

awesome-llm-powered-agent

Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...

LLMAgentPapers

Must-read Papers on LLM Agents.

LLM-Agents-Papers

A repo lists papers related to LLM based agent

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

OpenVoice

Instant voice cloning by MyShell.

SWE-agent

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.47% of bugs in the SWE-bench evaluation set and takes just 1 minute to run.

tortoise-tts

A multi-voice TTS system trained with an emphasis on quality

CrossViVit

This repository contains code for the paper "Improving day-ahead Solar Irradiance Time Series Forecasting by Leveraging Spatio-Temporal Context"

grok-1

Grok open release

AgentBench

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

SWE-bench

[ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

VideoGPT

torch-discounted-cumsum

Fast Discounted Cumulative Sums in PyTorch

flash-attention

Fast and memory-efficient exact attention

transformer_vq

vector-quantize-pytorch

Vector (and Scalar) Quantization, in Pytorch

reformer-pytorch

Reformer, the efficient Transformer, in Pytorch

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

long-range-arena

Long Range Arena for Benchmarking Efficient Transformers

Skyformer

Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)

google-research

Google Research