HYZhao's starred repositories

COMET

A Neural Framework for MT Evaluation

Language:PythonLicense:Apache-2.0Stargazers:469Issues:0Issues:0

language-identification-survey

Live survey of off-the-shelf language identification tools for python

Language:PythonLicense:MITStargazers:26Issues:0Issues:0

awesome-nlp

:book: A curated list of resources dedicated to Natural Language Processing (NLP)

License:CC0-1.0Stargazers:16399Issues:0Issues:0

Recommender-System

推荐系统综述

Stargazers:433Issues:0Issues:0

bigscience

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

Language:ShellLicense:NOASSERTIONStargazers:971Issues:0Issues:0

FastGEMV

High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.

Language:CudaLicense:MITStargazers:79Issues:0Issues:0

YHs_Sample

Yinghan's Code Sample

Language:CudaLicense:GPL-3.0Stargazers:266Issues:0Issues:0

backend

Common source, scripts and utilities for creating Triton backends.

Language:C++License:BSD-3-ClauseStargazers:275Issues:0Issues:0

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

Language:C++License:Apache-2.0Stargazers:7973Issues:0Issues:0

how-to-optim-algorithm-in-cuda

how to optimize some algorithm in cuda.

Language:CudaStargazers:1351Issues:0Issues:0
Language:C++License:Apache-2.0Stargazers:121Issues:0Issues:0

WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

Language:PythonStargazers:9164Issues:0Issues:0

flash-attention

Fast and memory-efficient exact attention

Language:PythonLicense:BSD-3-ClauseStargazers:13041Issues:0Issues:0

fastllm

纯c++的全平台llm加速库,支持python调用,chatglm-6B级模型单卡可达10000+token / s,支持glm, llama, moss基座,手机端流畅运行

Language:C++License:Apache-2.0Stargazers:3261Issues:0Issues:0

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Language:PythonLicense:Apache-2.0Stargazers:2218Issues:0Issues:0

AISystem

AISystem 主要是指AI系统,包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

Language:Jupyter NotebookLicense:Apache-2.0Stargazers:10130Issues:0Issues:0

batch-inference

Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.

Language:PythonLicense:MITStargazers:78Issues:0Issues:0
Language:PythonLicense:BSD-3-ClauseStargazers:412Issues:0Issues:0
Language:PythonLicense:BSD-3-ClauseStargazers:22Issues:0Issues:0

FasterTransformer

Transformer related optimization, including BERT, GPT

Language:C++License:Apache-2.0Stargazers:58Issues:0Issues:0

tensorrtx

Implementation of popular deep learning networks with TensorRT network definition API

Language:C++License:MITStargazers:6838Issues:0Issues:0

TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

Language:C++License:Apache-2.0Stargazers:10466Issues:0Issues:0

pandas-ai

Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.

Language:PythonLicense:NOASSERTIONStargazers:12388Issues:0Issues:0

Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

Language:PythonLicense:MITStargazers:2942Issues:0Issues:0

MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

Language:PythonLicense:BSD-3-ClauseStargazers:25261Issues:0Issues:0

GPT-4-LLM

Instruction Tuning with GPT-4

Language:HTMLLicense:Apache-2.0Stargazers:4144Issues:0Issues:0

javascript-algorithms

📝 Algorithms and data structures implemented in JavaScript with explanations and links to further readings

Language:JavaScriptLicense:MITStargazers:186354Issues:0Issues:0

OpenPromptStudio

🥣 AIGC 提示词可视化编辑器 | OPS | Open Prompt Studio

Language:VueStargazers:5932Issues:0Issues:0

awesome-python

An opinionated list of awesome Python frameworks, libraries, software and resources.

Language:PythonLicense:NOASSERTIONStargazers:216366Issues:0Issues:0

chroma

the AI-native open-source embedding database

Language:RustLicense:Apache-2.0Stargazers:14193Issues:0Issues:0