power0341

gpt4all

gpt4all: run open-source LLMs anywhere

OpenDevin

🐚 OpenDevin: Code Less, Make More

dspy

DSPy: The framework for programming—not prompting—foundation models

SWE-agent

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.29% of bugs in the SWE-bench evaluation set and takes just 1.5 minutes to run.

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

transformer-debugger

YOLO-World

[CVPR 2024] Real-Time Open-Vocabulary Object Detection

VAR

[GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

LLaMA2-Accessory

An Open-source Toolkit for LLM Development

jepa

PyTorch code and models for V-JEPA self-supervised learning from video.

RAGatouille

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

T-Rex

API for T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergy

aici

AICI: Prompts as (Wasm) Programs

BrushNet

The official implementation of paper "BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion"

evolutionary-model-merge

Official repository of Evolutionary Optimization of Model Merging Recipes

lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval

recurrentgemma

Open weights language model from Google DeepMind, based on Griffin.

long-form-factuality

Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

vitaGL

openGL wrapper for PSVITA.

megalodon

Reference implementation of Megalodon 7B model

DINOv

[CVPR 2024] Official implementation of the paper "Visual In-context Learning"

SEED-X

Multimodal Models in Real World

cobra

Cobra: Extending Mamba to Multi-modal Large Language Model for Efficient Inference

ARENA_2.0

Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.

FastV

Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models

WSDM-Cup-2024

1st Solution For Conversational Multi-Doc QA Workshop & International Challenge @ WSDM'24 - Xiaohongshu.Inc

Griffon

The official repo of Griffon

ovtrack

OVTrack: Open-Vocabulary Multiple Object Tracking [CVPR 2023]

transformers-crash-course

A collection of tutorials and notebooks explaining transformer models in deep learning.

InstaGen

InstaGen: Enhancing Object Detection by Training on Synthetic Dataset, CVPR2024