heluocs

paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

sparrow

Data processing with ML and LLM

pygwalker

PyGWalker: Turn your pandas dataframe into an interactive UI for visual analysis

LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

MediaCrawler

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 ｜ 评论爬虫、微博帖子 ｜ 评论爬虫

trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

hudi

Upserts, Deletes And Incremental Processing on Big Data.

iceberg

Apache Iceberg

data-juicer

A one-stop data processing system to make data higher-quality, juicier, and more digestible for (multimodal) LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

build-your-own-x

Master programming by recreating your favorite technologies from scratch.

LWM

ant

Ant game engine

flink

Apache Flink

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

spark

Apache Spark - A unified analytics engine for large-scale data processing

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

streaming-llm

[ICLR 2024] Efficient Streaming Language Models with Attention Sinks

javascript

JavaScript Style Guide

parquet-format

Apache Parquet Format

tarp

Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

llama-lab

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

bark

🔊 Text-Prompted Generative Audio Model

Awesome-LLMOps

An awesome & curated list of best LLMOps tools for developers

AudioGPT

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head

COLA

🥤 COLA: Clean Object-oriented & Layered Architecture

katalyst-core

Katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This is the core components in Katalyst system, including multiple agents and centralized components

mpire

A Python package for easy multiprocessing, but faster than multiprocessing