stdKonjac

gpt-2

Code for the paper "Language Models are Unsupervised Multitask Learners"

MAC

Online Adaptation of Language Models with a Memory of Amortized Contexts

recomp

RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentation.

WSDM-Cup-2024

1st Solution For Conversational Multi-Doc QA Workshop & International Challenge @ WSDM'24 - Xiaohongshu.Inc

openai-python

The official Python library for the OpenAI API

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

AutoCompressors

[EMNLP 2023] Adapting Language Models to Compress Long Contexts

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

llama2-lora-fine-tuning

llama2 finetuning with deepspeed and lora

ReMuQ

a multimodal retrieval dataset

AnglE

Angle-optimized Text Embeddings | 🔥 SOTA on STS and MTEB Leaderboard

retriever_reader_for_okvqa

Retrieval-Augmented-Visual-Question-Answering

This is the official repository for Retrieval Augmented Visual Question Answering

Anima

33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU

VQA

Awesome-Healthcare-Foundation-Models

self-rag

This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.

Owl

A Large Language Model for IT Operations

MM23-MISSRec

The code for the paper "MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendation" (ACM MM'23).

ADSampling

[SIGMOD 2023] High-Dimensional Approximate Nearest Neighbor Search: with Reliable and Efficient Distance Comparison Operations

DreamLLM

[ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation

VIP5

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

SeViLA

[NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering

visdial-challenge-starter-pytorch

Starter code in PyTorch for the Visual Dialog challenge

visdial

[CVPR 2017] Torch code for Visual Dialog

NExT-OE

NExT-QA: Next Phase of Question-Answering to Explaining Temporal Actions (CVPR'21)

NExT-QA

NExT-QA: Next Phase of Question-Answering to Explaining Temporal Actions (CVPR'21)

SEMICON

kinetics-dataset