pbarker

BitNet

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

LLM4Teach

Python code to implement LLM4Teach, a policy distillation approach for teaching reinforcement learning agents with Large Language Model

rund

OCI Container Runtime for Darwin

anole

Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation

chameleon

Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

robbie-g2

sqlite-vec

A vector search SQLite extension that runs anywhere!

sqlite-vss

A SQLite extension for efficient vector search, based on Faiss!

pyvecdb

A Python library for efficient similarity search using high-dimensional vectors.

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

agenata

Build Web Datasets with Ease

ml-4m

4M: Massively Multimodal Masked Modeling

alpaca_lora_4bit

Phi3-Vision-Finetune

An open-source implementaion for fine-tuning Phi3-Vision-128k-insturct by Microsoft.

lumos

Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"

digirl

Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.

Semantic-SAM

[ECCV 2024] Official implementation of the paper "Semantic-SAM: Segment and Recognize Anything at Any Granularity"

VLFeedback

open_clip

An open source implementation of CLIP.

ruff

An extremely fast Python linter and code formatter, written in Rust.

awesome-ai-agents

A list of AI autonomous agents

surya

OCR, layout analysis, reading order, line detection in 90+ languages

datamodel-code-generator

Pydantic model and dataclasses.dataclass generator for easy conversion of JSON, OpenAPI, JSON Schema, and YAML data sources.

ms-swift

Use PEFT or Full-parameter to finetune 300+ LLMs or 60+ MLLMs. (Qwen2, GLM4v, Internlm2.5, Yi, Llama3.1, Llava-Video, Internvl2, MiniCPM-V-2.6, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)

screen2words

The dataset includes screen summaries that describes Android app screenshot's functionalities. It is used for training and evaluation of the screen2words models (our paper accepted by UIST'21 will be linked soon).

widget-caption

The dataset includes widget captions that describes UI element's functionalities. It is used for training and evaluation of the widget captioning model (please see the EMNLP'20 paper: https://arxiv.org/abs/2010.04295).

taperception

This repository contains the datasets that were used for the research described in "Predicting and Explaining Mobile UI Tappability with Vision Modeling and Saliency Analysis" by Eldon Schoop, Xin Zhou, Gang Li, Zhourong Chen, Bjoern Hartmann and Yang Li, which is to appear in CHI 2022.

ml-ferret

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

VoiceCraft

Zero-Shot Speech Editing and Text-to-Speech in the Wild