adrielkuek

chameleon

Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

VideoLLaMA2

VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs

LLaVA-NeXT

llama3

The official Meta Llama 3 GitHub site

mPLUG-Owl

mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model

axolotl

Go ahead and axolotl questions

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

rellm

Exact structure out of any language model completion.

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

NeMo-Guardrails

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

laptop-mode-tools

Power Savings tool for Linux

attention-center

FocalNet

[NeurIPS 2022] Official code for "Focal Modulation Networks"

cotrain-prompting

Code for co-training large language models (e.g. T0) with smaller ones (e.g. BERT) to boost few-shot performance

OpenPrompt

An Open-Source Framework for Prompt-Learning.

Tip-Adapter

wit

WIT (Wikipedia-based Image Text) Dataset is a large multimodal multilingual dataset comprising 37M+ image-text sets with 11M+ unique images across 100+ languages.

perceiver-ar

Sphere

Web-scale retrieval for knowledge-intensive NLP

Adapt-InfoMap

face clustering

clipscore

CLIPScore EMNLP code

composer

Supercharge Your Model Training

CogView2

official code repo for paper "CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers"

ivy

Convert ML Code Between Frameworks

metaseq

Repo for external large-scale work