anas-awadalla

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

whisperX

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

reactpy

It's React, but in Python

Voyager

An Open-Ended Embodied Agent with Large Language Models

Bard-API

The unofficial python package that returns response of Google Bard through cookie value.

grobid

A machine learning software for extracting information from scholarly documents

LISA

Project Page for "LISA: Reasoning Segmentation via Large Language Model"

awesome-grounding

awesome grounding: A curated list of research papers in visual grounding

LLM-Training-Puzzles

What would you do with 1000 H100s...

visprog

Official code for VisProg (CVPR 2023 Best Paper!)

SEED

Official implementation of SEED-LLaMA (ICLR 2024).

LLM-groundedDiffusion

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models (LLM-grounded Diffusion: LMD)

med-flamingo

Awesome-Multimodal-LLM

Research Trends in LLM-guided Multimodal Learning.

minimal-text-diffusion

A minimal implementation of diffusion models for text generation

pylatexenc

Simple LaTeX parser providing latex-to-unicode and unicode-to-latex conversion

TexSoup

fault-tolerant Python3 package for searching, navigating, and modifying LaTeX documents

grobid_client_python

Python client for GROBID Web services

LRV-Instruction

[ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning

MM-Vet

MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)

OBELICS

Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M documents, 115B text tokens and 353M images.

ParroT

The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1-mt) and human written translation and evaluation data.

composed_image_retrieval

Visual-Instruction-Tuning

SVIT: Scaling up Visual Instruction Tuning

TheoremQA

The dataset and code for paper: TheoremQA: A Theorem-driven Question Answering dataset

MultiInstruct

MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning

VL-CheckList

Evaluating Vision & Language Pretraining Models with Objects, Attributes and Relations.

few-shot-clustering

BYTESIZED32

Byte-sized text games for code generation tasks on virtual environments

PDF-to-Image-Cluster

This project is designed to automate the process of downloading and processing large datasets from the web: specifically, it scrapes and downloads .snappy.parquet files, converts them to CSV, extracts URLs, downloads associated PDFs, performs OCR on the PDFs to extract text and bounding boxes, and finally organizes and archives the data.