Mr-Nineteen's repositories
RecSysPapers
推荐/广告/搜索领域工业界经典以及最前沿论文集合。A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.
baichuan-Dynamic-NTK-ALiBi
百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本
ChatGLM2-6B
ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
Chinese-LlaMA2
Repo for adapting Meta LlaMA2 in Chinese! META最新发布的LlaMA2的汉化版！ （完全开源可商用）
CUDA-Programming
Sample codes for my CUDA programming book
cuda-samples
Samples for CUDA Developers which demonstrates features in CUDA Toolkit
CUDALibrarySamples
CUDA Library Samples
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
flash-attention
Fast and memory-efficient exact attention
generative-recommenders
Repository hosting code used to reproduce results in "Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations" (https://arxiv.org/abs/2402.17152).
grok-1
Grok open release
HierarchicalKV
HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of Merlin-KV is to store key-value feature-embeddings on high-bandwidth memory (HBM) of GPUs and in host memory. It also can be used as a generic key-value storage.
how-to-optim-algorithm-in-cuda
how to optimize some algorithm in cuda.
iTransformer
Official implementation for "iTransformer: Inverted Transformers Are Effective for Time Series Forecasting" (ICLR 2024 Spotlight), https://openreview.net/forum?id=JePfAI8fah
llama
Inference code for LLaMA models
LLaMA-Efficient-Tuning
Fine-tuning LLaMA with PEFT (PT+SFT+RLHF with QLoRA)
llama-recipes
Examples and recipes for Llama 2 model
llm-action
本项目旨在分享大模型相关技术原理以及实战经验。
nvcomp
Repository for nvCOMP docs and examples. nvCOMP is a library for fast lossless compression/decompression on the GPU that can be downloaded from https://developer.nvidia.com/nvcomp.
onnx
Open standard for machine learning interoperability
onnx-simplifier
Simplify your onnx model
onnxruntime-inference-examples
Examples for using ONNX Runtime for machine learning inferencing.
tensorrtx
Implementation of popular deep learning networks with TensorRT network definition API
Time-Series-Library
A Library for Advanced Deep Time Series Models.
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
transformers-stream-generator
This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
Transformers-Tutorials
This repository contains demos I made with the Transformers library by HuggingFace.
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs