Dufumiza

Hamed's starred repositories

search_with_lepton

Building a quick conversation-based search demo with Lepton AI.

Language:TypeScriptApache-2.0776100

promptsource

Toolkit for creating, sharing and using natural language prompts.

Language:PythonApache-2.0265400

infinity

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text

Language:C++Apache-2.0247000

faiss

A library for efficient similarity search and clustering of dense vectors.

Language:C++MIT3074700

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

Language:C++Apache-2.0831600

LLMLingua

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

Language:PythonMIT447700

promptbench

A unified evaluation framework for large language models

Language:PythonMIT239900