yotamnahum

code2flow

Pretty good call graphs for dynamic languages

intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

html2text

Convert HTML to Markdown-formatted text.

CrossLinked

LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping

Transformers-for-NLP-2nd-Edition

Transformer models from BERT to GPT-4, environments from Hugging Face to OpenAI. Fine-tuning, training, and prompt engineering examples. A bonus section with ChatGPT, GPT-3.5-turbo, GPT-4, and DALL-E including jump starting GPT-4, speech-to-text, text-to-speech, text to image generation with DALL-E, Google Cloud AI,HuggingGPT, and more

MergeLM

Codebase for Merging Language Models (ICML 2024)

FlashRank

Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & Collaborations.

AnglE

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard

xllm

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

TLM

ICML'2022: NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework

tokenization

A comprehensive deep dive into the world of tokens

d3graph

Creation of interactive networks using d3 Javascript

geograpy3

Extract place names from a URL or text, and add context to those names -- for example distinguishing between a country, region or city.

factoid-wiki

Dense X Retrieval: What Retrieval Granularity Should We Use?

LinkedIn-Job-Scraper

LinkedIn scraper to retrieve and store a live stream of job postings

flaxkv

🗲 A high-performance on-disk dictionary.

gbswt5

CharFormer(Tay et al., 2022; Gradient-based Subword Tokenizer + T5) model implementation for Huggingface Transformers

llm-embedding

Finetune Malaysian LLM for Malaysian context embedding task.

CharacterBERT-DR

The offcial repository for 'CharacterBERT and Self-Teaching for Improving the Robustness of Dense Retrievers on Queries with Typos', SIGIR2022

longBert

长文本相似度模型

X-RetroMAE

Code Roberta version of RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder

BiPFT

This is the implementation of our AAAI2024 paper: BiPFT: Binary Pre-trained Foundation Transformer with Low-rank Estimation of Binarization Residual Polynomials.

MURAL

A Multi-Granularity-Aware Aspect Learning Model for Multi-Aspect Dense Retrieval

irelease

Library that automates releasing your Github python package at Pypi.

company-profile-scrapper

POC of a multiprocesses web scrapper for Google search and Linkedin

hubness-reduction-improves-sbert-semantic-spaces

Hubness Reduction Improves Sentence-BERT Semantic Spaces

clustsum

Unsupervised extractive summary using sentence embeddings and clustering.

RetroMAE

CheXbert-characterBERT

repo-tree

A simple python package to display a repository tree structure. Pythonic alternative to linux tree command.