mehdidc

llm.c

LLM training in simple, raw C/CUDA

aider

aider is AI pair programming in your terminal

litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

undetected-chromedriver

Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

trl

Train transformer language models with reinforcement learning.

docker-selenium

Provides a simple way to run Selenium Grid with Chrome, Firefox, and Edge using Docker, making it easier to perform browser automation

FlareSolverr

Proxy server to bypass Cloudflare protection

DrissionPage

基于python的网页自动化工具。既能控制浏览器，也能收发数据包。可兼顾浏览器自动化的便利性和requests的高效率。功能强大，内置无数人性化设计和便捷功能。语法简洁而优雅，代码量少。

SeleniumBase

📊 Python's all-in-one framework for web crawling, scraping, testing, and reporting. Supports pytest. UC Mode provides stealth. Includes many tools.

cloudscraper

A Python module to bypass Cloudflare's anti-bot page.

helm

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in Holistic Evaluation of Text-to-Image Models (HEIM) (https://arxiv.org/abs/2311.04287).

curl_cffi

Python binding for curl-impersonate via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints.

torchtitan

A native PyTorch Library for large model training

PixArt-sigma

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

DeepSeek-MoE

LLaVA-pp

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

recurrentgemma

Open weights language model from Google DeepMind, based on Griffin.

HPSv2

Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis

rho

Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.

OmniFusion

OmniFusion — a multimodal model to communicate using text and images

CloudflareBypassForScraping

A cloudflare verification bypass script for webscraping

coconut_cvpr2024

nxtp

Object Recognition as Next Token Prediction (CVPR 2024)

llm-compression-intelligence

Official github repo for the paper "Compression Represents Intelligence Linearly"

t2v_metrics

Evaluating text-to-image/video/3D models with VQAScore

vlm-evaluation

VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning

scaling_laws_data_filtering

lumi-llm-scaling

Scripts and documentation on scaling large language model training on the LUMI supercomputer

Social-Reward

scaling-laws-openclip

Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)