KeremTurgutlu

langchain

🦜🔗 Build context-aware reasoning applications

scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

Prompt-Engineering-Guide

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

llama_index

LlamaIndex is a data framework for your LLM applications

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

haystack

:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

newspaper

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

ParlAI

A framework for training and evaluating AI models on a variety of openly available dialogue datasets.

nebuly

The user analytics platform for LLMs

cortex

Production infrastructure for machine learning at scale

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

datasets

TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...

praw

PRAW, an acronym for "Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.

Promptify

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

geziyor

Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

mctx

Monte Carlo tree search in JAX

tldextract

Accurately separates a URL’s subdomain, domain, and public suffix, using the Public Suffix List (PSL).

DAMO-ConvAI

DAMO-ConvAI: The official repository which contains the codebase for Alibaba DAMO Conversational AI.

openwebtext

Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.

public-amazon-crawler

Topical-Chat

A dataset containing human-human knowledge-grounded open-domain conversations.

ChatLearner

A chatbot implemented in TensorFlow based on the seq2seq model, with certain rules integrated.

GPTZero

An open-source implementation of GPTZero

manifest

Prompt programming with FMs.

olm-datasets

Pipeline for pulling and processing online language model pretraining data from the web

chat_corpus

chat corpus collection from various open sources

abcd

Official repository for "Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems"

DST-as-Prompting

Source code for Dialogue State Tracking with a Language Model using Schema-Driven Prompting

metaCAT