ZizhenWang

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

vision_transformer

big_vision

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.

dinov2

PyTorch code and models for the DINOv2 self-supervised learning method.

open_clip

An open source implementation of CLIP.

CLIP

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

coyo-dataset

COYO-700M: Large-scale Image-Text Pair Dataset

PALO

Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, Bengali and Urdu.

ImageBind

ImageBind One Embedding Space to Bind Them All

sglang

SGLang is yet another fast serving framework for large language models and vision language models.

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

llm-embedding

Finetune Malaysian LLM for Malaysian context embedding task.

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

ControlNet

Let us control diffusion models!

llama

Inference code for Llama models

stable-diffusion-webui

Stable Diffusion web UI

CHILS

Code and results accompanying our paper titled CHiLS: Zero-Shot Image Classification with Hierarchical Label Sets

luke

LUKE -- Language Understanding with Knowledge-based Embeddings

bort

Repository for the paper "Optimal Subarchitecture Extraction for BERT"

MNN

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

awesome-emdl

Embedded and mobile deep learning research resources

annotated_deep_learning_paper_implementations

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

Awesome-SLU-Survey

Tracking the progress in SLU (resources, code, and new frontiers etc.)

Capsule-NLU

Joint Slot Filling and Intent Detection via Capsule Neural Networks (ACL'19) https://arxiv.org/abs/1812.09471

task-specific-datasets

A collection of task-specific NLU datasets

AGIF

Open source code for EMNLP 2020 Findings Paper "AGIF: An Adaptive Graph-Interactive Framework for Joint Multiple Intent Detection and Slot Filling"

QA-Survey-CN

北京航空航天大学大数据高精尖中心自然语言处理研究团队开展了智能问答的研究与应用总结。包括基于知识图谱的问答（KBQA），基于文本的问答系统（TextQA），基于表格的问答系统（TableQA）、基于视觉的问答系统（VisualQA）和机器阅读理解（MRC）等，每类任务分别对学术界和工业界进行了相关总结。