foundation-models

There are 17 repositories under foundation-models topic.

ColossalAI
hpcaitech / ColossalAI
Making large AI models cheaper, faster and more accessible
ai big-model data-parallelism deep-learning distributed-computing foundation-models heterogeneous-training hpc inference large-scale model-parallelism pipeline-parallelism
Language:Python 37818
microsoft / unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
nlp pre-trained-model unilm minilm layoutlm layoutxlm beit document-ai trocr beit-3 foundation-models xlm-e deepnet llm multimodal mllm kosmos kosmos-1 textdiffuser bitnet
Language:Python 18284
haotian-liu / LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
chatbot chatgpt foundation-models gpt-4 instruction-tuning llama llama-2 llama2 llava multi-modality multimodal vision-language-model visual-language-learning
Language:Python 15970
Otter
Luodian / Otter
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
artificial-inteligence chatgpt deep-learning embodied-ai foundation-models gpt-4 instruction-tuning large-scale-models machine-learning multi-modality visual-language-learning
Language:Python 3440
NExT-GPT / NExT-GPT
Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model
chatgpt foundation-models gpt-4 instruction-tuning large-language-models llm multi-modal-chatgpt multimodal visual-language-learning
Language:Python 2841
OpenGVLab / Ask-Anything
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
captioning-videos chatgpt gradio langchain video-question-answering video-understanding stablelm chat video big-model foundation-models large-language-models large-model
Language:Python 2654
CLUEbenchmark / SuperCLUE
SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese
chatgpt chinese evaluation foundation-models gpt-4
2570
baaivision / EVA
EVA Series: Visual Representation Fantasies from BAAI
foundation-models representation-learning vision-transformer
Language:Python 1952
amazon-science / chronos-forecasting
Chronos: Pretrained (Language) Models for Probabilistic Time Series Forecasting
artificial-intelligence forecasting foundation-models huggingface huggingface-transformers large-language-models llm machine-learning pretrained-models time-series time-series-forecasting timeseries transformers
Language:Python 1566
autodistill
autodistill / autodistill
Images to inference with no labeling (use foundation models to train supervised models).
auto-labeling computer-vision deep-learning foundation-models grounding-dino image-annotation image-classification instance-segmentation labeling-tool machine-learning model-distillation multimodal object-detection pytorch segment-anything yolov5 yolov8
Language:Python 1520
baaivision / Emu
Emu Series: Generative Multimodal Models from BAAI
foundation-models in-context-learning instruct-tuning multimodal-pretraining generative-pretraining-in-multimodality multimodal-generalist
Language:Python 1488
deepseek-ai / DeepSeek-VL
DeepSeek-VL: Towards Real-World Vision-Language Understanding
vision-language-model vision-language-pretraining foundation-models
Language:Python 1474
tatsu-lab / alpaca_eval
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
deep-learning evaluation foundation-models instruction-following large-language-models leaderboard nlp rlhf
Language:Jupyter Notebook 1081
hyp1231 / awesome-llm-powered-agent
Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...
awesome-list embodied-agent embodied-ai foundation-model foundation-models generative-agents generative-ai generative-model generative-models large-language-model large-language-models llms llm chatgpt gpt-4 llm-powered-agents
939
time-series-foundation-models / lag-llama
Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting
forecasting foundation-models time-series time-series-forecasting timeseries timeseries-forecasting llama time-series-prediction time-series-transformer transformers lag-llama
Language:Python 936
OpenGVLab / InternVideo
Video Foundation Models & Data for Multimodal Understanding
action-recognition benchmark contrastive-learning foundation-models instruction-tuning masked-autoencoder multimodal open-set-recognition self-supervised spatio-temporal-action-localization temporal-action-localization video-clip video-data video-dataset video-question-answering video-retrieval video-understanding vision-transformer zero-shot-classification zero-shot-retrieval
Language:Python 900
OFA-Sys / ONE-PEACE
A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
foundation-models multimodal representation-learning vision-language audio-language vision-and-language vision-transformer contrastive-loss
Language:Python 830
torchxrayvision
mlmed / torchxrayvision
TorchXRayVision: A library of chest X-ray datasets and models. Classifiers, segmentation, and autoencoders.
medical-imaging medical-ai deep-learning machine-learning transfer-learning dataset image-classification medical-image-processing medical-application medical medical-image-analysis chest-xray chest-radiographs cxr cxr-images chest-xray-images pytorch torchxrayvision foundation-models
Language:Jupyter Notebook 827
HazyResearch / meerkat
Creative interactive views of any dataset.
data-science foundation-models machine-learning ml pandas
Language:Python 808
llm-jp / awesome-japanese-llm
日本語LLMまとめ - Overview of Japanese LLMs
awesome awesome-list language-model language-models large-language-model large-language-models llm llms japanese japanese-language embeddings vision-and-language foundation-models multimodal vision-language vision-language-model generative-ai generative-model generative-models awesome-lists
738
MrGiovanni / ModelsGenesis
[MICCAI 2019] [MEDIA 2020] Models Genesis
3d-model fine-tuning foundation-models pre-trained-model representation-learning self-supervised-learning transfer-learning
Language:Jupyter Notebook 720
qingsongedu / Awesome-TimeSeries-SpatioTemporal-LM-LLM
A professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time Series, Spatiotemporal, and Event Data.
anomalydetection autoscaling deeplearning forecasting foundation-models large-language-models large-models machinelearning pre-training rca timeseries
703
NVlabs / FasterViT
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention
ade20k backbone deep-learning image-net pre-trained-model self-attention vision-transformer visual-recognition coco object-detection semantic-segmentation foundation-models image-classification
Language:Python 663
zjunlp / KnowledgeEditingPapers
Must-read Papers on Knowledge Editing for Large Language Models.
paper-list pre-trained-language-models pre-trained-model knowledge-editing model-editing large-language-models awsome-list foundation-models natural-language-processing review survey rome easyedit knowlm paper
581
mbzuai-oryx / groundingLMM
Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks [CVPR 2024].
foundation-models llm-agent lmm vision-and-language vision-language-model
Language:Python 567
uncbiag / Awesome-Foundation-Models
A curated list of foundation models for vision and language tasks
foundation-models large-language-models transformer-models vision-transformer
535
HazyResearch / hyena-dna
Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena
foundation-models genomics language-models
Language:Assembly 482
NVlabs / EmerNeRF
PyTorch Implementation of EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervision
autonomous-driving driving foundation-models nerf
Language:Python 479
baaivision / tokenize-anything
Tokenize Anything via Prompting
foundation-models multimodal promptable representation-learning
Language:Jupyter Notebook 422
baaivision / Uni3D
[ICLR'24 Spotlight] Uni3D: 3D Visual Representation from BAAI
3d-representation-learning foundation-models vision-transformers
Language:Python 396
OpenRobotLab / PointLLM
[arXiv 2023] PointLLM: Empowering Large Language Models to Understand Point Clouds
3d chatbot foundation-models gpt-4 large-language-models llama multimodal objaverse point-cloud pointllm representation-learning vision-and-language
Language:Python 374
huangwl18 / VoxPoser
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
embodied-ai foundation-models large-language-models motion-planning robotic-manipulation robotics vision-language-model
Language:Python 358
gen-cv
Azure / gen-cv
Vision AI Solution Accelerator
azure-computer-vision embeddings florence foundation-models image-search stable-diffusion cognitive-search-vector-store generative-computer-vision dalle-3
Language:Jupyter Notebook 349
jqin4749 / MindVideo
Official code base for MinD-Video
brain-decoding foundation-models large-language-models stable-diffusion video-reconstruction
Language:Python 346
JerryX1110 / awesome-segment-anything-extensions
Segment-anything related awesome extensions/projects/repos.
application awesome awesome-list caption-anything computer-vision foundation-models generation generative-model image-segmentation machine-learning object-detection segment-anything segment-anything-meta segmentation style-transfer tracking
324
fondant
ml6team / fondant
Production-ready data processing made easy and shareable
data-processing fine-tuning foundation-models machine-learning pipeline python
Language:Python 318