SLTK1

langflow

Langflow is a low-code app builder for RAG and multi-agent AI applications. It’s Python-based and agnostic to any model, API, or database.

generative_agents

Generative Agents: Interactive Simulacra of Human Behavior

ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

fiftyone

The open-source tool for building high-quality datasets and computer vision models

ARC-AGI

The Abstraction and Reasoning Corpus

cambrian

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

torchtitan

A native PyTorch Library for large model training

OpenDiT

OpenDiT: An Easy, Fast and Memory-Efficient System for DiT Training and Inference

License-Plate-Detector

基于Yolov5车牌检测,更快更准.

LlamaGen

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

LLaVA-pp

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

groundingLMM

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

camera_calibration

Accurate geometric camera calibration with generic camera models

libSGM

Stereo Semi Global Matching by cuda

Segmentation-Pytorch

Semantic Segmentation in Pytorch. Network include: FCN、FCN_ResNet、SegNet、UNet、BiSeNet、BiSeNetV2、PSPNet、DeepLabv3_plus、 HRNet、DDRNet

chat_templates

Chat Templates for 🤗 HuggingFace Large Language Models

Rotated_IoU

Differentiable IoU of rotated bounding boxes using Pytorch

awesome-large-multimodal-agents

Hi-SAM

[arXiv preprint] Hi-SAM: Marrying Segment Anything Model for Hierarchical Text Segmentation

DocScanner

The official repo for “DocScanner: Robust Document Image Rectification with Progressive Learning”.

OneChart

[ACM'MM 2024 Oral] Official code for "OneChart: Purify the Chart Structural Extraction via One Auxiliary Token"

Awesome-Chart-Understanding

A curated list of recent and past chart understanding work based on our survey paper: From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models.

Table-LLaVA

Dataset and Code for our ACL 2024 paper: "Multimodal Table Understanding". We propose the first large-scale Multimodal IFT and Pre-Train Dataset for table understanding and develop a generalist tabular MLLM named Table-LLaVA.

Ant-Multi-Modal-Framework

Research Code for Multimodal-Cognition Team in Ant Group

awesome-table-structure-recognition

A Curated List of Awesome Table Structure Recognition (TSR) Research. Including models, papers, datasets and codes. Continuously updating.

DocGenome

DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models

RapidLayout

Analysis of Chinese and English layouts 中英文版面分析

vllm-fork

A high-throughput and memory-efficient inference and serving engine for LLMs

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2