echo840

ollama

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

pykan

Kolmogorov Arnold Networks

MiniCPM-V

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

bertviz

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

Transformer-Explainability

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

awesome-grounding

awesome grounding: A curated list of research papers in visual grounding

onnxmltools

ONNXMLTools enables conversion of models to ONNX

BlueLM

BlueLM(蓝心大模型): Open large language models developed by vivo AI Lab

Transformer-MM-Explainability

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

shikra

Convolutional-KANs

This project extends the idea of the innovative architecture of Kolmogorov-Arnold Networks (KAN) to the Convolutional Layers, changing the classic linear transformation of the convolution to learnable non linear activations in each pixel.

RADIO

Official repository for "AM-RADIO: Reduce All Domains Into One"

DenseCL

Dense Contrastive Learning (DenseCL) for self-supervised representation learning, CVPR 2021 Oral.

Groma

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

all-seeing

[ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of the Open World"

MultimodalOCR

On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)

rho

Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.

Visual-Instruction-Tuning

SVIT: Scaling up Visual Instruction Tuning

Document-AI-Recommendations

Algorithms, papers, datasets, performance comparisons for Document AI. Continuously updating.

torchkan

An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations

Awesome-Open-Vocabulary-Detection-and-Segmentation

Awesome OVD-OVS - A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Future

VimTS

VimTS: A Unified Video and Image Text Spotter

KANs

🕹️The toy examples of Kolmogorov-Arnold Network (Get Started Quickly)

multimodal_cognitive_ai

research work on multimodal cognitive ai

QA-ViT

onnx-donut

Export Donut model to onnx and run it with onnxruntime

EST-VQA

[CVPR2020] EST-VQA Dataset

DT-VQA