DeyangKong's repositories
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Apache-2.0000
MAPS-mt
[TACL 2024] MAPS enables LLMs🤖 to mimic the human😁 translation process.
000
SimpleAIAgentServer
A simple, small programming framework for agentic AI.
LLM-FineTuneHub
Details about training, fine-tuing and evaluating LLM.
sglang
SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
Apache-2.0000
Text-Generation-Inference-One-Click-Deployment-Edition
This fork of the original "Text-Generation-Inference" project introduces a streamlined, one-click deployment solution designed to significantly ease the installation process for users.
text-embeddings-inference
A blazing fast inference solution for text embeddings models
NOASSERTION000