wxbbuaa2011

gpt-computer-assistant

gpt-4o for windows, macos and ubuntu

FPGA-QOI

FPGA-based QOI image compressor and decompressor in Verilog language.

sdspi

SD-Card controller, using either SPI, SDIO, or eMMC interfaces

trl

Train transformer language models with reinforcement learning.

BARVINN

BARVINN: A Barrel RISC-V Neural Network Accelerator: https://barvinn.readthedocs.io/en/latest/

FlooNoC

A Fast, Low-Overhead On-chip Network

FEATHER

A Reconfigurable Accelerator with Data Reordering Support for Low-Cost On-Chip Dataflow Switching

lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

S-LoRA

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Efficient-LLMs-Survey

Efficient Large Language Models: A Survey

iEDA

corenet

CoreNet: A library for training deep neural networks

uPIMulator

SA-DS

morpher

An Open-Source Tool for CGRA Accelerators

ScaleLLM

A high-performance inference system for large language models, designed for production environments.

PARTIES

Scripts and code for PARTIES (ASPLOS'19)

multi-armed-bandit

Play with the solutions to the multi-armed-bandit problem.

lm-evaluation-harness

A framework for few-shot evaluation of language models.

FreeAskInternet

FreeAskInternet is a completely free, PRIVATE and LOCALLY running search aggregator & answer generate using MULTI LLMs, without GPU needed. The user can ask a question and the system will make a multi engine search and combine the search result to LLM and generate the answer based on search results. It's all FREE to use.

llm-cost-estimator

Estimating hardware and cloud costs of LLMs and transformer projects

survey

State of the art on the domain of LLM Hardware accelerators

llm-hardware-test-generation

LLMRoofline

Compare different hardware platforms via the Roofline Model for LLM inference tasks.

LLMPerf-for-TiledArch

Analytical Performance Model for Tiled Accelerators/Dies in Spatial Architecture Running Large Language Models (LLMs)

Awesome-LLM-System-Papers

Awesome-Efficient-LLM

A curated list for Efficient Large Language Models

tinyTPU

Implementation of a Tensor Processing Unit for embedded systems and the IoT.

LLM-Viewer

Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.