tomaarsen

attention_sinks

Extend existing LLMs way beyond the original training length with constant memory usage, without retraining

SpanMarkerNER

SpanMarker for Named Entity Recognition

AnglE

Angle-optimized Text Embeddings | 🔥 SOTA on STS and MTEB Leaderboard

ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, ModelScope, etc.

AIR-Bench

AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark

bm25s

BM25S is an ultra-fast lexical search library that implements BM25 using scipy

canopy

Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone

ColBERT

ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)

deep-learning-pytorch-huggingface

EMO

[ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)

setfit

Efficient few-shot learning with Sentence Transformers

accelerate

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

api-inference-community

blog

Public repo for HF blog posts

datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

dspy

DSPy: The framework for programming—not prompting—foundation models

GLiNER

Generalist model for NER (Extract any entity types from texts)

Hotel-ID-2022

7th place entry to the Hotel-ID 2022 Kaggle challenge

huggingface.js

Utilities to use the Hugging Face hub API

huggingface_hub

All the open source things related to the Hugging Face Hub.

langchain

⚡ Building applications with LLMs through composability ⚡

llama_index

LlamaIndex (GPT Index) is a data framework for your LLM applications

optimum

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

postgresml

The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models.

sentence-transformers

Multilingual Sentence & Image Embeddings with BERT

stsb-multi-mt

Machine translated multilingual STS benchmark dataset.

tomaarsen.com-backend

Backend for www.tomaarsen.com

tomaarsen.com-frontend

Frontend for www.tomaarsen.com

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Verba

Retrieval Augmented Generation (RAG) chatbot powered by Weaviate