Crystalyyy

RecommenderSystem

Ray-DeepSpeed-Inference

byzer-llm

Easy, fast, and cheap pretrain,finetune, serving for everyone

web-terminal-in-go

implementat k8s/docker web terminal with golang

kubefilebrowser

kubernetes container filebrowser and webshell

how-to-optim-algorithm-in-cuda

how to optimize some algorithm in cuda.

ray_vllm_inference

A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

BladeDISC

BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.

TorchAccelerator

PyTorch model wrapper to accelerate models

hey

HTTP load generator, ApacheBench (ab) replacement

stress-go

a stress testing tool（压测工具）

go-stress-testing

go 实现的压测工具，ab、locust、Jmeter压测工具介绍【单台机器100w连接压测实战】

jjwt

Java JWT: JSON Web Token for Java and Android

springcloud-auth

SpringCloud服务统一通过Gateway网关利用JWT生成token校验

notification-manager

K8s native notification management with multi-tenancy support

aliyun-log-grafana-datasource-plugin

阿里云日志服务Grafana数据源插件 Aliyun Log Service grafana datasource plugin

OMP

OMP（Operation Management Platform）是云智慧公司自主设计、研发的轻量级、聚合型、智能运维管理平台。是一款为用户提供便捷运维能力和业务管理的综合平台。具备运维一应俱全的功能，目的是提升运维自动化、智能化，提高运维效率，提升业务连续性和安全性。

aliyun-exporter

Prometheus exporter for Alibaba Cloud Monitor

nacos_service_exporter

logai

LogAI - An open-source library for log analytics and intelligence

log-anomaly-detector

Log Anomaly Detection - Machine learning to detect abnormal events logs

aiops-engine-for-skywalking

This is an incubating repository of the Apache SkyWalking AIOps Engine

AIOPS-Anomaly-Detection

loglizer

A machine learning toolkit for log-based anomaly detection [ISSRE'16]

AgentVerse

🤖 AgentVerse 🪐 is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation

kube-copilot

Kubernetes Copilot powered by OpenAI

AISystem

AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

java-langchains

A Java 8+ LangChain implementation. Build powerful LLM based applications in an (enterprise) Java context.

my-chatglm2

my-chatglm2 是基于 chatglm2 的 API 服务端 + 客户端一键启动方案。