tomaarsen

attention_sinks

Extend existing LLMs way beyond the original training length with constant memory usage, without retraining

SpanMarkerNER

SpanMarker for Named Entity Recognition

AnglE

Angle-optimized Text Embeddings | 🔥 SOTA on STS and MTEB Leaderboard

ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, ModelScope, etc.

AIR-Bench

AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark

canopy

Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone

ColBERT

ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)

deep-learning-pytorch-huggingface

EMO

[ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)

setfit

Efficient few-shot learning with Sentence Transformers

accelerate

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

api-inference-community

blog

Public repo for HF blog posts

doc-builder

The package used to build the documentation of our Hugging Face repos

dspy

DSPy: The framework for programming—not prompting—foundation models

GLiNER

Generalist model for NER (Extract any entity types from texts)

gsap-ner

hub-docs

Frontend components, documentation and information hosted on the Hugging Face website.

huggingface.js

Utilities to use the Hugging Face hub API

huggingface_hub

All the open source things related to the Hugging Face Hub.

langchain

⚡ Building applications with LLMs through composability ⚡

llama_index

LlamaIndex (GPT Index) is a data framework for your LLM applications

nltk

NLTK Source

optimum

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

sentence-transformers

Multilingual Sentence & Image Embeddings with BERT

stsb-multi-mt

Machine translated multilingual STS benchmark dataset.

tomaarsen.com-backend

Backend for www.tomaarsen.com

tomaarsen.com-frontend

Frontend for www.tomaarsen.com

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Verba

Retrieval Augmented Generation (RAG) chatbot powered by Weaviate