vlm

There are 0 repository under vlm topic.

xlang-ai / OSWorld
OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
agent artificial-intelligence benchmark cli code-generation gui language-model large-action-model llm multimodal natural-language-processing reinforcement-learning rpa vlm
Language:Python 947
BAAI-DCAI / Bunny
A family of lightweight multimodal models.
chatgpt chinese english gpt-4 mllm multimodal-large-language-models vlm
Language:Python 673
AeroSandbox
peterdsharpe / AeroSandbox
Aircraft design optimization made fast through modern automatic differentiation. Composable analysis tools for aerodynamics, propulsion, structures, trajectory design, and much more.
aerodynamics airplane cfd mdo aircraft-design aerospace optimization vlm aerodynamic-analysis xfoil analysis 3d-panel python aircraft automatic-differentiation mdao aerospace-engineering simulation
Language:Jupyter Notebook 661
BAAI-Agents / Cradle
The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.
ai-agent ai-agents-framework computer-control cradle gcc generative-ai grounding large-language-models llm lmm multimodality vision-language-model vlm general-computer-control personoid ai foundation-agent
Language:Python 568
ThuCCSLab / Awesome-LM-SSP
A reading list for large models safety, security, and privacy.
adversarial-attacks awesome-list diffusion-models jailbreak language-model llm nlp privacy safety security vlm
434
mbzuai-oryx / GeoChat
[CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing
remote-sensing vlm
Language:Python 291
gokayfem / ComfyUI_VLM_nodes
Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation
nodes comfyui custom-nodes llava llm siglip phi15 img2text joytag image-captioning mllm vlm img2sfx
Language:Python 222
niuzaisheng / ScreenAgent
ScreenAgent: A Computer Control Agent Driven by Visual Language Large Model
agent ai llm vlm
Language:Python 175
PteraSoftware
camUrban / PteraSoftware
Ptera Software is a fast, easy-to-use, and open-source software package for analyzing flapping-wing flight.
unmanned-aerial-vehicle ornithopter ornithology aerospace aerodynamics aerospace-engineering aeronautics computational-biology computational-fluid-dynamics vortex-lattice-method aircraft-design cfd unsteady-flows vlm potential-flow uav simulation python solvers pyvista
Language:Python 156
haoranD / Awesome-Embodied-AI
A curated list of awesome papers on Embodied AI and related research/industry-driven resources.
awesome awesome-list classification detection embodied embodied-agent embodied-ai embodied-artificial-intelligence embodied-cognition languange learning navigation perception perceptron recognition segmentation understanding visual visual-language vlm
119
wisdomikezogwo / quilt1m
[NeurIPS 2023 Oral] Quilt-1M: One Million Image-Text Pairs for Histopathology.
clip-model histopathology medical-dataset multimodal-datasets vlm
Language:Python 113
jrgenerative / fixed-wing-sim
Matlab implementation to simulate the non-linear dynamics of a fixed-wing unmanned areal glider. Includes tools to calculate aerodynamic coefficients using a vortex lattice method implementation, and to extract longitudinal and lateral linear systems around the trimmed gliding state.
matlab flightgear simulation uav remote-control flight-simulator aerodynamics vlm glider simulink aerospace lti linear-systems aircraft stability flight-dynamics tornado wings
Language:MATLAB 108
gokayfem / awesome-vlm-architectures
Famous Vision Language Models and Their Architectures
clip llava vlm image-encoder text-encoder multimodal blip cogvlm internlm kosmos qwen-vl vision-language-model awesome awesome-list
Language:Markdown 96
mgonzs13 / llama_ros
llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2
cpp gpt llama llm ros2 ggml gguf llamacpp llava vlm llavacpp
Language:C++ 93
thomas-yanxin / KarmaVLM
🧘🏻‍♂️KarmaVLM (相生)：A family of high efficiency and powerful visual language model.
llama2 llava qwen2 vlm vision-language-model visual-language-learning multimodel
Language:Python 83
TIGER-AI-Lab / Mantis
Official code for Paper "Mantis: Multi-Image Instruction Tuning"
language vision fuyu llava-llama3 lmm mantis mllm video vlm multi-image-understanding multimodal
Language:Python 73
ThuCCSLab / FigStep
Jailbreaking Large Vision-language Models via Typographic Visual Prompts
gpt-4 jailbreak llm multi-modal safety security vlm
Language:Python 55
BAAI-Agents / GPA-LM
This repo is a live list of papers on game playing and large multimodality model - "A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challenges".
agent-framework agents ai awesome-list gameai gameplay games gcc general-computer-control generative-ai large-language-models llm multimodal planning vision-language-models vlm
49
FlyCole / Dream2Real
[ICRA 2024] Dream2Real: Zero-Shot 3D Object Rearrangement with Vision-Language Models
computer-vision manipulation nerf robotics vlm
Language:Python 41
GodotMisogi / AeroFuse.jl
A toolbox meant for aircraft design analyses.
aerospace design julia mdao vlm
Language:Julia 41
OpenM3D / M3DBench
M3DBench introduces a comprehensive 3D instruction-following dataset with support for interleaved multi-modal prompts. Furthermore, M3DBench provides a new benchmark to assess large models across 3D vision-centric tasks.
3d benchmark dataset instruction-tuning language-model multi-modal llm mlm prompt vlm
41
BatsResearch / alfred
A system for prompted weak supervision.
annotation-tool data data-annotation llm programmatic-weak-supervision prompting vlm weak-supervision
Language:Python 39
byuflowlab / FLOWVLM
Vortex lattice method for inviscid lifting-surface aerodynamics
aerodynamics aircraft vortex-lattice vlm
Language:Julia 38
opendilab / PsyDI
PsyDI: A MBTI agent that helps you understand your personality type through a relaxed multi-modal interaction.
chatbot mbti reinforcement-learning llm vlm
Language:TypeScript 32
partmor / ezaero
ezaero - Easy aerodynamics in Python :airplane:
aerodynamics aeronautics vlm python
Language:Python 28
TobiasLee / VEC
Visual and Embodied Concepts evaluation benchmark
emnlp2023 vlm
21
labcalaero-20
andreagalle / labcalaero-20
Computational Aerodynamics Lab
aerodynamics aerospace cfd matlab vlm
Language:MATLAB 20
alwinw / KatzPlotkinPy
Python companion to Low Speed Aerodynamics by Joseph Katz and Allen Plotkin
python low-speed-aerodynamics panel-methods vlm aerodynamics vortex-lattice-method mit-license
Language:Fortran 19
UCSC-VLAA / Sight-Beyond-Text
This repository includes the official implementation of our paper "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
llama2 llava llm mllm vicuna vision-language ai-alignment alignment vlm
Language:Python 19
DLR-AE / PanelAero
An Implementation of the Vortex Lattice (VLM) and the Doublet Lattice Method (DLM) for aeroelasticity.
python aircraft-design vlm dlm aeordynamics aeroelasticity
Language:Python 13
Sid2697 / HOI-Ref
Code implementation for paper titled "HOI-Ref: Hand-Object Interaction Referral in Egocentric Vision"
dataset dataset-generation egocentric-vision hand-object-interaction large-language-models visual-language-models vlm
Language:Python 13
FSI_by_FEM_and_UVLM
KRproject-tech / FSI_by_FEM_and_UVLM
Fluid-Structure Interaction Analysis Using FEM and UVLM
finite-element-methods fluid-simulation matlab fluid-structure-interaction absolute-nodal-coordinate-formulation aerodynamics vlm vortex-lattice
Language:MATLAB 11
Xiaohao-Xu / Customizable-VLM
Customizing Visual-Language Foundation Models for Multi-modal Anomaly Detection and Reasoning
gemini-api gpt vlm anomaly anomaly-detection
Language:Python 9
ProGamerGov / VLM-Captioning-Tools
Python scripts to use for captioning images with VLMs
cogvlm image-captioning llm mistral text-summarization vision-language vlm
Language:Python 8
ggruszczynski / pyVLM
python implementation of a 3D Vortex Lattice Method
vortex-lattice-method python vlm
Language:Python 6
nowisesys / libvlcpp
C++ class library for the VLC/VLM (VideoLan Manager) API.
vlc-libvlc streaming cpp-library vlm vlc
Language:C++ 6

vlm

xlang-ai / OSWorld

BAAI-DCAI / Bunny

peterdsharpe / AeroSandbox

BAAI-Agents / Cradle

ThuCCSLab / Awesome-LM-SSP

mbzuai-oryx / GeoChat

gokayfem / ComfyUI_VLM_nodes

niuzaisheng / ScreenAgent

camUrban / PteraSoftware

haoranD / Awesome-Embodied-AI

wisdomikezogwo / quilt1m

jrgenerative / fixed-wing-sim

gokayfem / awesome-vlm-architectures

mgonzs13 / llama_ros

thomas-yanxin / KarmaVLM

TIGER-AI-Lab / Mantis

ThuCCSLab / FigStep

BAAI-Agents / GPA-LM

FlyCole / Dream2Real

GodotMisogi / AeroFuse.jl

OpenM3D / M3DBench

BatsResearch / alfred

byuflowlab / FLOWVLM

opendilab / PsyDI

partmor / ezaero

TobiasLee / VEC

andreagalle / labcalaero-20

alwinw / KatzPlotkinPy

UCSC-VLAA / Sight-Beyond-Text

DLR-AE / PanelAero

Sid2697 / HOI-Ref

KRproject-tech / FSI_by_FEM_and_UVLM

Xiaohao-Xu / Customizable-VLM

ProGamerGov / VLM-Captioning-Tools

ggruszczynski / pyVLM

nowisesys / libvlcpp