davidwong18

nicegui

Create web-based user interfaces with Python. The nice way.

bisheng

Bisheng is an open LLM devops platform for next generation AI applications.

FastCFS

A high performance distributed file system which can be used as the back-end storage of databases, K8s and VM etc.

LLM-Inference-Performance

llm-performance

CPU & GPU performance measures of LLM engine

perf_llm

LLM-PerformanceTest

LLM- PerformanceTest

llm-perf-backend

The backend behind the LLM-Perf Leaderboard

LLM-Performance-Improvement-Paper

HighPerfLLMs2024

llm-perf-bench

llm-inference-benchmark

LLM Inference benchmark

llmperf

LLMPerf is a library for validating and benchmarking LLMs

evidently

Evaluate and monitor ML models from validation to production. Join our Discord: https://discord.com/invite/xZjKRaNp8b

CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型

fc-clip

[NeurIPS 2023] This repo contains the code for our paper Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIP

open-webui

User-friendly WebUI for LLMs (Formerly Ollama WebUI)

Awesome-Chinese-LLM

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

DragGAN

Official Code for DragGAN (SIGGRAPH 2023)

Awesome-Segment-Anything

This repository is for the first comprehensive survey on Meta AI's Segment Anything Model (SAM).

CTranslate2

Fast inference engine for Transformer models

horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

open-llms

📋 A list of open LLMs available for commercial use.

Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

ColossalAI

Making large AI models cheaper, faster and more accessible

OpenChat

LLMs custom-chatbots console ⚡

LLMsPracticalGuide

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

inference

Reference implementations of MLPerf™ inference benchmarks