Jan

jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

cortex

Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan

awesome-local-ai

An awesome repository of local AI tools

nitro-tensorrt-llm

Nitro is an C++ inference server on top of TensorRT-LLM. OpenAI-compatible API. Run blazing fast inference on Nvidia GPUs. Used in Jan

model-converter

docs

Jan.ai Website & Documentation

extension-template

models

app-backend

cortex.python-runtime

C++ code that run Python embedding

thinking-machines

Thinking Machines

architecture

cortex.llamacpp

node-nitro

open-foundry

R&D experiments

Real-ESRGAN

Real-ESRGAN aims at developing Practical Algorithms for General Image/Video Restoration.

TensorRT

NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

triton_tensorrt_llm

charts

This repository contains helm chart for our team

jan-web

plugin-catalog

py-nitro

cortex.tensorrt-llm

infinity

The AI-native database built for LLM applications, providing incredibly fast vector and full-text search

langchainjs

llama.cpp-avx-vnni

Port of Facebook's LLaMA model in C/C++

openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend

pymaker

Make the py

tensorrtllm_backend

The Triton TensorRT-LLM Backend

trt-llm-as-openai-windows

This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.