jg-bernard

awesome-web-archiving

An Awesome List for getting started with web archiving

open-parse

Improved file parsing for LLM’s

waymore

Find way more from the Wayback Machine, Common Crawl, Alien Vault OTX, URLScan & VirusTotal!

fabric

fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.

gpt-crawler

Crawl a site to generate knowledge files to create your own custom GPT from a URL

unstructured

Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.

gpt-researcher

GPT based autonomous agent that does online comprehensive research on any given topic

nomic

Interact, analyze and structure massive text, image, embedding, audio and video datasets

gpt4all

GPT4All: Chat with Local LLMs on Any Device

stringdist

String distance functions for R

rollama

ollama

Get up and running with Llama 3, Mistral, Gemma 2, and other large language models.

anything-llm

The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

pytok

A web scraper for TikTok using Playwright

flair

A very simple framework for state-of-the-art Natural Language Processing (NLP)

fabricator

[EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.

Giveme5W1H

Extraction of the journalistic five W and one H questions (5W1H) from news articles: who did what, when, where, why, and how?

NewsMTSC

Target-dependent sentiment classification in news articles reporting on political events. Includes a high-quality data set of over 11k sentences and a state-of-the-art classification model.

OpenLLM

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

timelms

TimeLMs: Diachronic Language Models from Twitter

tweetnlp

TweetNLP for all the NLP enthusiasts working on Twitter! The Python library tweetnlp provides a collection of useful tools to analyze/understand tweets such as sentiment analysis, emoji prediction, and named entity recognition, powered by state-of-the-art language models specialised on Twitter.

gentle

gentle forced aligner

relatio

code base for constructing narrative statements from text

uwot

An R package implementing the UMAP dimensionality reduction method.

umap

Uniform Manifold Approximation and Projection

text

Using Transformers from HuggingFace in R

huggingfaceR

Hugging Face state-of-the-art models in R

recogito

Interactive Annotation of Text and Images

annotorious

Add image annotation functionality to any web page with a few lines of JavaScript.

recogito-js

A JavaScript library for text annotation