shanshanpt

seastar_example

seastar example

shanshanpt.github.io

BLOG

brpc

Most common RPC framework used throughout Baidu, with 600,000+ instances and 500+ kinds of services, called "baidu-rpc" inside Baidu.

concurrentqueue

A fast multi-producer, multi-consumer lock-free concurrent queue for C++11

DeepRec-1

estimator

TensorFlow Estimator

etcd

Distributed reliable key-value store for the most critical data of a distributed system

grpc

The C based gRPC (C++, Node.js, Python, Ruby, Objective-C, PHP, C#)

iree

👻

jax

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

leveldb

LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

mlir

"Multi-Level Intermediate Representation" Compiler Infrastructure

muduo

A C++ non-blocking network library for multi-threaded server in Linux

mxnet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

pedis

NoSQL data store using the SEASTAR framework, compatible with Redis

ps-lite

A lightweight parameter server interface

readerwriterqueue

A fast single-producer, single-consumer lock-free queue for C++

recommenders-addons

Additional utils and helpers to extend TensorFlow when build recommendation systems, contributed and maintained by SIG Recommenders.

rocksdb

A library that provides an embeddable, persistent key-value store for fast storage.

RouteLLM

A framework for serving and evaluating LLM routers.

seastar_test

serving

A flexible, high-performance serving system for machine learning models

tensorflow

An Open Source Machine Learning Framework for Everyone

tera

An Internet-Scale Database.

tidb

TiDB is a distributed NewSQL database compatible with MySQL protocol

tikv

Distributed transactional key value database powered by Rust and Raft

transformers_tasks

⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

x-deeplearning

An industrial deep learning framework for high-dimension sparse data