foundation-models

There are 18 repositories under foundation-models topic.

ColossalAI
hpcaitech / ColossalAI
Making large AI models cheaper, faster and more accessible
ai big-model data-parallelism deep-learning distributed-computing foundation-models heterogeneous-training hpc inference large-scale model-parallelism pipeline-parallelism
Language:Python 38011
microsoft / unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
beit beit-3 bitnet deepnet document-ai foundation-models kosmos kosmos-1 layoutlm layoutxlm llm minilm mllm multimodal nlp pre-trained-model textdiffuser trocr unilm xlm-e
Language:Python 18553
haotian-liu / LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
gpt-4 chatbot chatgpt llama multimodal llava foundation-models instruction-tuning multi-modality visual-language-learning llama-2 llama2 vision-language-model
Language:Python 16711
Otter
Luodian / Otter
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
gpt-4 visual-language-learning artificial-inteligence deep-learning foundation-models multi-modality machine-learning chatgpt instruction-tuning large-scale-models embodied-ai
Language:Python 3464
NExT-GPT / NExT-GPT
Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model
chatgpt foundation-models gpt-4 instruction-tuning large-language-models llm multi-modal-chatgpt multimodal visual-language-learning
Language:Python 2900
OpenGVLab / Ask-Anything
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
captioning-videos chatgpt gradio langchain video-question-answering video-understanding stablelm chat video big-model foundation-models large-language-models large-model
Language:Python 2717
CLUEbenchmark / SuperCLUE
SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese
chatgpt chinese evaluation foundation-models gpt-4
2652
baaivision / EVA
EVA Series: Visual Representation Fantasies from BAAI
foundation-models representation-learning vision-transformer
Language:Python 1999
amazon-science / chronos-forecasting
Chronos: Pretrained (Language) Models for Probabilistic Time Series Forecasting
forecasting large-language-models llm machine-learning time-series foundation-models pretrained-models time-series-forecasting timeseries artificial-intelligence huggingface huggingface-transformers transformers
Language:Python 1782
deepseek-ai / DeepSeek-VL
DeepSeek-VL: Towards Real-World Vision-Language Understanding
vision-language-model vision-language-pretraining foundation-models
Language:Python 1643
autodistill
autodistill / autodistill
Images to inference with no labeling (use foundation models to train supervised models).
auto-labeling computer-vision deep-learning foundation-models grounding-dino image-annotation image-classification instance-segmentation labeling-tool machine-learning model-distillation multimodal object-detection pytorch segment-anything yolov5 yolov8
Language:Python 1557
baaivision / Emu
Emu Series: Generative Multimodal Models from BAAI
foundation-models generative-pretraining-in-multimodality in-context-learning instruct-tuning multimodal-generalist multimodal-pretraining
Language:Python 1510
tatsu-lab / alpaca_eval
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
deep-learning evaluation foundation-models instruction-following large-language-models leaderboard nlp rlhf
Language:Jupyter Notebook 1154
hyp1231 / awesome-llm-powered-agent
Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...
awesome-list chatgpt embodied-agent embodied-ai foundation-model foundation-models generative-agents generative-ai generative-model generative-models gpt-4 large-language-model large-language-models llm llm-powered-agents llms
1015
time-series-foundation-models / lag-llama
Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting
forecasting foundation-models time-series time-series-forecasting timeseries timeseries-forecasting llama time-series-prediction time-series-transformer transformers lag-llama
Language:Python 1003
OpenGVLab / InternVideo
Video Foundation Models & Data for Multimodal Understanding
foundation-models video-understanding vision-transformer action-recognition masked-autoencoder multimodal open-set-recognition spatio-temporal-action-localization temporal-action-localization video-question-answering video-retrieval zero-shot-classification zero-shot-retrieval benchmark contrastive-learning self-supervised instruction-tuning video-data video-dataset video-clip
Language:Python 982
OFA-Sys / ONE-PEACE
A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
foundation-models multimodal representation-learning vision-language audio-language vision-and-language vision-transformer contrastive-loss
Language:Python 851
torchxrayvision
mlmed / torchxrayvision
TorchXRayVision: A library of chest X-ray datasets and models. Classifiers, segmentation, and autoencoders.
medical-imaging medical-ai deep-learning machine-learning transfer-learning dataset image-classification medical-image-processing medical-application medical medical-image-analysis chest-xray chest-radiographs cxr cxr-images chest-xray-images pytorch torchxrayvision foundation-models
Language:Jupyter Notebook 841
HazyResearch / meerkat
Creative interactive views of any dataset.
data-science foundation-models machine-learning ml pandas
Language:Python 813
llm-jp / awesome-japanese-llm
日本語LLMまとめ - Overview of Japanese LLMs
language-model language-models large-language-model large-language-models llm llms japanese japanese-language vision-and-language foundation-models multimodal vision-language vision-language-model generative-ai generative-model generative-models japanese-llm japanese-language-model llm-japanese
769
qingsongedu / Awesome-TimeSeries-SpatioTemporal-LM-LLM
A professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time Series, Spatiotemporal, and Event Data.
anomalydetection autoscaling deeplearning forecasting foundation-models large-language-models large-models machinelearning pre-training rca timeseries
761
MrGiovanni / ModelsGenesis
[MICCAI 2019] [MEDIA 2020] Models Genesis
fine-tuning representation-learning transfer-learning self-supervised-learning 3d-model pre-trained-model foundation-models
Language:Jupyter Notebook 722
NVlabs / FasterViT
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention
ade20k backbone deep-learning image-net pre-trained-model self-attention vision-transformer visual-recognition coco object-detection semantic-segmentation foundation-models image-classification
Language:Python 684
zjunlp / KnowledgeEditingPapers
Must-read Papers on Knowledge Editing for Large Language Models.
paper-list pre-trained-language-models pre-trained-model knowledge-editing model-editing large-language-models awsome-list foundation-models natural-language-processing review survey rome easyedit knowlm paper
608
mbzuai-oryx / groundingLMM
[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.
foundation-models lmm vision-and-language vision-language-model llm-agent
Language:Python 586
uncbiag / Awesome-Foundation-Models
A curated list of foundation models for vision and language tasks
foundation-models vision-transformer large-language-models transformer-models multimodal-models
582
HazyResearch / hyena-dna
Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena
foundation-models genomics language-models
Language:Assembly 507
NVlabs / EmerNeRF
PyTorch Implementation of EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervision
autonomous-driving driving foundation-models nerf
Language:Python 495
baaivision / tokenize-anything
Tokenize Anything via Prompting
foundation-models multimodal promptable representation-learning
Language:Jupyter Notebook 435
baaivision / Uni3D
[ICLR'24 Spotlight] Uni3D: 3D Visual Representation from BAAI
3d-representation-learning foundation-models vision-transformers
Language:Python 402
OpenRobotLab / PointLLM
[arXiv 2023] PointLLM: Empowering Large Language Models to Understand Point Clouds
3d chatbot foundation-models gpt-4 large-language-models llama multimodal objaverse point-cloud representation-learning vision-and-language pointllm
Language:Python 392
huangwl18 / VoxPoser
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
embodied-ai foundation-models large-language-models motion-planning robotic-manipulation robotics vision-language-model
Language:Python 390
gen-cv
Azure / gen-cv
Vision AI Solution Accelerator
azure-computer-vision embeddings florence foundation-models image-search stable-diffusion cognitive-search-vector-store generative-computer-vision dalle-3
Language:Jupyter Notebook 362
jqin4749 / MindVideo
Official code base for MinD-Video
brain-decoding foundation-models large-language-models stable-diffusion video-reconstruction
Language:Python 352
JerryX1110 / awesome-segment-anything-extensions
Segment-anything related awesome extensions/projects/repos.
application awesome awesome-list caption-anything computer-vision foundation-models generation generative-model image-segmentation machine-learning object-detection segment-anything segment-anything-meta segmentation style-transfer tracking
327
fondant
ml6team / fondant
Production-ready data processing made easy and shareable
data-processing fine-tuning foundation-models machine-learning pipeline python
Language:Python 322