leo-gan

open-interpreter

A natural language interface for computers

black

The uncompromising Python code formatter

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

cookiecutter

A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C projects.

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

gpt-researcher

GPT based autonomous agent that does online comprehensive research on any given topic

mamba

WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

opengpts

lm-evaluation-harness

A framework for few-shot evaluation of language models.

udlbook

Understanding Deep Learning - Simon J.D. Prince

tree-of-thought-llm

[NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models

giskard

🐢 Open-Source Evaluation & Testing for LLMs and ML models

examples

Jupyter Notebooks to help you get hands-on with Pinecone vector databases

RapidFuzz

Rapid fuzzy string matching in Python using various string metrics

vearch

Distributed vector search for AI-native applications

graph-of-thoughts

Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"

cookiecutter-hypermodern-python

Hypermodern Python Cookiecutter

helm

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in Holistic Evaluation of Text-to-Image Models (HEIM) (https://arxiv.org/abs/2311.04287).

python-o365

A simple python library to interact with Microsoft Graph and Office 365 API

agentkit

Starter-kit to build constrained agents with Nextjs, FastAPI and Langchain

fully-local-pdf-chatbot

Yes, it's another chat over documents implementation... but this one is entirely local!

inference

Reference implementations of MLPerf™ inference benchmarks

test

Measuring Massive Multitask Language Understanding | ICLR 2021

generative_ai_with_langchain

Build large language model (LLM) apps with Python, ChatGPT and other models. This is the companion repository for the book on generative AI with LangChain.

instruct-eval

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

textcomplexity

Linguistic and stylistic complexity measures for (literary) texts

hallucination-index

Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.

kolena

Python client for Kolena's machine learning testing platform