Tom Aarsen's repositories
attention_sinks
Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
SpanMarkerNER
SpanMarker for Named Entity Recognition
ipex-llm
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, ModelScope, etc.
accelerate
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
datasets
🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
Hotel-ID-2022
7th place entry to the Hotel-ID 2022 Kaggle challenge
huggingface.js
Utilities to use the Hugging Face hub API
huggingface_hub
All the open source things related to the Hugging Face Hub.
llama_index
LlamaIndex (GPT Index) is a data framework for your LLM applications
postgresml
The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models.
sentence-transformers
Multilingual Sentence & Image Embeddings with BERT
stsb-multi-mt
Machine translated multilingual STS benchmark dataset.
tomaarsen.com-backend
Backend for www.tomaarsen.com
tomaarsen.com-frontend
Frontend for www.tomaarsen.com
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Verba
Retrieval Augmented Generation (RAG) chatbot powered by Weaviate