Yu Liu's repositories
gpt_server
gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。
LLMs_finetuning
致力于用简洁的代码实现对现有大模型（chatGLM1/2、BaiChuan、QWen、Internlm、Llama等）的训练、推理和部署。
oneapi2langchain
LangChain 实现闭源大模型的统一(星火 已实现)
api-for-open-llm
Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口
chatgpt_system_prompt
store all agent's system prompt
CosyVoice
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
ffmpy
Pythonic interface for FFmpeg/FFprobe command line
infinity
Infinity is a high-throughput, low-latency REST API for serving text-embeddings, reranking models and clip
langchain
⚡ Building applications with LLMs through composability ⚡
lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
stable-diffusion-webui
Stable Diffusion web UI
flock
Flock is a workflow-based low-code platform for rapidly building chatbots, RAG, and coordinating multi-agent teams, powered by LangGraph, Langchain, FastAPI, and NextJS.（Flock 是一个基于workflow工作流的低代码平台，用于快速构建聊天机器人、RAG、Agent和Muti-Agent应用，采用 LangGraph、Langchain、FastAPI 和 NextJS 构建。）
funboost
pip install funboost，python全功能分布式函数调度框架,funboost的功能是全面性重量级，用户能想得到的功能99%全都有;funboost的使用方式是轻量级，只有@boost一行代码需要写。支持python所有类型的并发模式和一切知名消息队列中间件，支持如 celery dramatiq等框架整体作为funboost中间件，python函数加速器，框架包罗万象，用户能想到的控制功能全都有。一统编程思维，兼容50% python业务场景，适用范围广。只需要一行代码即可分布式执行python一切函数，99%用过funboost的pythoner 感受是 简易 方便 强劲 强大，相见恨晚 。
langmanus
A community-driven AI automation framework that builds upon the incredible work of the open source community. Our goal is to combine language models with specialized tools for tasks like web search, crawling, and Python code execution, while giving back to the community that made this possible.
textembed
TextEmbed is a REST API crafted for high-throughput and low-latency embedding inference. It accommodates a wide variety of embedding models and frameworks, making it ideal for various natural language processing applications.
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
upload_docker_hub
打包镜像并发布到docker hub