bmount

loft

LOFT: A 1 Million+ Token Long-Context Benchmark

ScribeWizard

ScribeWizard: Generate organized notes from audio using Groq, Whisper, and Llama3

ml-mobileclip

This repository contains the official implementation of the research paper, "MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training" CVPR 2024

moondream

tiny vision language model

silero-vad

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

VILA

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.

lag-llama

Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

Qwen-VL

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.

opencap-core

Main OpenCap processing pipeline

antibioticsai

Supporting code for the paper "Discovery of a structural class of antibiotics with explainable deep learning"

coffee

Build and iterate on your UI 10x faster with AI - right from your own IDE ☕️

Marigold

[CVPR 2024 - Oral, Best Paper Award Candidate] Marigold: Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation

screenshot-to-code

Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)

spin-model-transformers

Physics-inspired transformer modules based on mean-field dynamics of vector-spin models in JAX

mamba

Mamba SSM architecture

self-operating-computer

A framework to enable multimodal models to operate a computer.

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

AnimateAnyone

Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation

visual_anagrams

Code for the paper "Visual Anagrams: Generating Multi-View Optical Illusions with Diffusion Models"

scenic

Scenic: A Jax Library for Computer Vision Research and Beyond

webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"

sqlcoder

SoTA LLM for converting natural language questions to SQL queries

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

awesome-openai-vision-api-experiments

Must-have resource for anyone who wants to experiment with and build on the OpenAI vision API 🔥

CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型

realtime-bakllava

llama.cpp with BakLLaVA model describes what does it see

yarn

YaRN: Efficient Context Window Extension of Large Language Models

LLaVA-Interactive-Demo

LLaVA-Interactive-Demo

Dynamic3DGaussians