JCruan519

quivr

Open-source RAG Framework for building GenAI Second Brains 🧠 Build productivity assistant (RAG) ⚡️🤖 Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic, VertexAI, Ollama, LLMs, Groq that you can share with users ! Efficient retrieval augmented generation framework

mem0

The Memory layer for your AI apps

firecrawl

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

pykan

Kolmogorov Arnold Networks

MiniCPM-V

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

self-llm

《开源大模型食用指南》基于Linux环境快速部署开源大模型，更适合**宝宝的部署教程

xtuner

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

gptpdf

Using GPT to parse PDF

llm_aided_ocr

Enhance Tesseract OCR output for scanned PDFs by applying Large Language Model (LLM) corrections.

Awesome-Diffusion-Models-in-Medical-Imaging

Diffusion Models in Medical Imaging (Published in Medical Image Analysis Journal)

VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks

SimPO

SimPO: Simple Preference Optimization with a Reference-Free Reward

PLLaVA

Official repository for the paper PLLaVA

U-KAN

[ArXiv' 24] U-KAN Makes Strong Backbone for Medical Image Segmentation and Generation

CRUD_RAG

CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models

EVE

[NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models

RWKV-CLIP

[EMNLP 2024] RWKV-CLIP: A Robust Vision-Language Representation Learner

VIGC

AAAI 2024: Visual Instruction Generation and Correction

VL-RLHF

A RLHF Infrastructure for Vision-Language Models

SynthCLIP

Code base of SynthCLIP: CLIP training with purely synthetic text-image pairs from LLMs and TTIs.

Genixer

(ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator

VLFeedback

LLaVA-Align

This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strategy.

GMS

Official repository of Generative Medical Segmentation

MoE-SFT

🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts

VEGA

polyp-ddpm

Polyp dataset generation

OVCamo

(ECCV 2024) Open-Vocabulary Camouflaged Object Segmentation

corruption

The code for generating natural distribution shifts on image and text datasets.

JCruan519.github.io