cloud Lee's repositories
AIAS
AIAS (AI Acceleration Suite), AI算法落地加速器套件(超过100个项目组成的项目集,包含了sdk,平台引擎,场景套件)
applied-ml
📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
autolabel
Label, clean and enrich text datasets with LLMs. Discord: https://discord.gg/fweVnRx6CU
Awesome-Chinese-LLM
整理开源的中文大语言模型,以规模较小、可私有化部署、训练成本较低的模型为主,包括底座模型,垂直领域微调及应用,数据集与教程等。
Awesome-LLM
Awesome-LLM: a curated list of Large Language Model
Awesome-LLM-Inference
💻A small Collection for Awesome LLM Inference [Papers|Blogs|Docs] with codes, contains TensorRT-LLM, streaming-llm, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
Awesome-LLMOps
An awesome & curated list of best LLMOps tools for developers
BERTopic
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
Book4_Power-of-Matrix
Book_4_《矩阵力量》 | 鸢尾花书:从加减乘除到机器学习;本册有,584幅图,81个代码文件,其中18个Streamlit App;状态:清华社五审五校中;Github稿件基本稳定,欢迎提意见,会及时修改
clueai-python
3行代码3分钟,搞定NLP模型开发!
CLUENER2020
CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition
ColossalAI
Colossal-AI: A Unified Deep Learning System for Big Model Era
doccano
Open source annotation tool for machine learning practitioners.
espnet
End-to-End Speech Processing Toolkit
fastmoe
A fast MoE impl for PyTorch
Fengshenbang-LM
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系
hyperopt
Distributed Asynchronous Hyperparameter Optimization in Python
k8s-device-plugin
OpenAIOS vGPU device plugin for Kubernetes is originated from the OpenAIOS project to virtualize GPU device memory, in order to allow applications to access larger memory space than its physical capacity. It is designed for ease of use of extended device memory for AI workloads.
kubeasz
使用Ansible脚本安装K8S集群,介绍组件交互原理,方便直接,不受国内网络环境影响
label-studio
Label Studio is a multi-type data labeling and annotation tool with standardized output format
langchain
⚡ Building applications with LLMs through composability ⚡
leetcode
LeetCode Solutions: A Record of My Problem Solving Journey.( leetcode题解,记录自己的leetcode解题之路。)
MLab
“云上炼丹师”中的云
NeMo
NeMo: a toolkit for conversational AI
sentence-transformers
Multilingual Sentence & Image Embeddings with BERT
snorkel
A system for quickly generating training data with weak supervision
sparrow
运维管理平台(python3+flask+pycharts+apscheduler+gunicorn),模块化结构设计,底层依托mysql、influxdb、elasticsearch、zabbix、k8s等数据源数据
TextBrewer
A PyTorch-based knowledge distillation toolkit for natural language processing
TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
TurboTransformers
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.