cross-modality

There are 6 repositories under cross-modality topic.

clip-as-service
jina-ai / clip-as-service
🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
bert bert-as-service clip-as-service clip-model cross-modal-retrieval cross-modality deep-learning image2vec multi-modality neural-search onnx openai pytorch sentence-encoding sentence2vec
Language:Python 12627
THUDM / CogVLM
a state-of-the-art-level open visual language model | 多模态预训练模型
cross-modality language-model multi-modal pretrained-models visual-language-models
Language:Python 6466
KimMeen / Time-LLM
[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"
cross-modal-learning cross-modality deep-learning language-model large-language-models machine-learning multimodal-deep-learning multimodal-time-series prompt-tuning time-series time-series-analysis time-series-forecast time-series-forecasting
Language:Python 1926
hangzhaomit / Sound-of-Pixels
Codebase for ECCV18 "The Sound of Pixels"
cross-modality computer-vision sound-separation self-supervised-learning
Language:Python 378
movienet / movienet-tools
Tools for movie and video research
movie computer-vision video-understanding action-recognition deep-learning vision-language cross-modality shot-detection person-analysis
Language:C++ 294
Image-Text-Embedding
layumi / Image-Text-Embedding
TOMM2020 Dual-Path Convolutional Image-Text Embedding with Instance Loss :feet: https://arxiv.org/abs/1711.05535
bidirectional-retrieval cross-modal-retrieval cross-modality image-retrieval image-search language-retrieval matconvnet matlab person-reidentification visual-semantic
Language:MATLAB 290
haofanwang / awesome-conditional-content-generation
Update-to-data resources for conditional content generation, including human motion generation, image or video generation and editing.
aigc awesome-list conditional-generation controllable-generation cross-modality diffusion-models
268
sail-sg / ptp
[CVPR2023] The code for 《Position-guided Text Prompt for Vision-Language Pre-training》
cross-modality vision-language-pretraining vlp
Language:Python 151
bismex / Awesome-cross-modality-person-re-identification
Awesome Cross-modality Person Re-identification
awesome awesome-list awesome-reid cross-modality cross-modality-re-identification cross-modality-reid infrared-reid person-re-identification person-reid person-reidentification re-id reid reidentification rgb-infrared-tracking rgb-t-tracking thermal-image-translation visible-thermal visible-thermal-reid
147
ZYK100 / LLCM
[CVPR 2023] Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identification
cross-modality cvpr2023 dataset low-light llcm vireid person-re-identification t-sne visible-infrared
Language:Python 119
AnjanDutta / sem-pcyc
PyTorch implementation of the paper "Semantically Tied Paired Cycle Consistency for Zero-Shot Sketch-based Image Retrieval", CVPR 2019.
zero-shot-learning cross-modality cycle-gan generative-model sketch-based-image-retrieval
Language:Python 110
Event-AHU / EventVOT_Benchmark
[CVPR-2024] The First High Definition (HD) Event based Visual Object Tracking Benchmark Dataset
benchmark-dataset cross-modality event-based-tracking high-definition multi-modal rgb-event single-object-tracking visual-object-tracking visual-tracking
Language:Python 108
rhgao / co-separation
Co-Separating Sounds of Visual Objects (ICCV 2019)
audio-visual-learning sound-separation cross-modality
Language:Python 94
mangye16 / Visible-Thermal-Person-Re-Identification
Demo code for visible thermal (cross-modality) person re-identification
cross-modality person-reidentification re-id
Language:Python 90
JDAI-CV / CM-NAS
CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification (ICCV2021)
cm-nas cross-modality nas neural-architecture-search reid visible-infrared
Language:Python 48
chenjingong / DN-ReID
[CVPR2024]Day-Night Cross-domain Vehicle Re-identification
cross-modality cvpr2024 dataset deep-learning low-light re-identification
Language:Python 37
workingcoder / MCJA
A New Strong and Simple Baseline Method for VI-ReID (Bridging the Gap: Multi-level Cross-modality Joint Alignment for Visible-infrared Person Re-identification)
baseline cross-modality cross-modality-re-identification person-re-identification person-reid person-reidentification re-id re-identification reid reidentification rgb-infrared visible-infrared visible-infrared-re-identification visible-thermal
Language:Python 37
ZYK100 / MMN
Pytorch code for Towards a Unified Middle Modality Learning for Visible-Infrared Person Re-Identification
re-identification vireid cross-modality visible-infrared
Language:Python 34
M-3LAB / awesome-multimodal-brain-image-systhesis
brain-images cross-modality deep-learning image-synthesis image-to-image-translation medical-image-processing survey
33
GuiyuZhao / VRHCF
[ICME 2024] VRHCF: Cross-Source Point Cloud Registration via Voxel Representation and Hierarchical Correspondence Filtering
cross-modality cross-source lidar point-cloud-registration
Language:Python 26
catalina17 / VideoNavQA
An alternative EQA paradigm and informative benchmark + models (BMVC 2019, ViGIL 2019 spotlight)
benchmark conditioning cross-modality deep-neural-networks embodied machine-learning multimodal navigation question-answering video videonavqa visual-reasoning vqa
Language:Python 25
AdityaLab / MM4TSA
A professional list on Multi-Modalities For Time Series Analysis (MM4TSA) Papers and Resource.
awesome awesome-list cross-modality forecasting foundation-models large-language-models multimodal multimodal-learning multimodal-time-series resources reusing survey time-series
22
zjzsliyang / CrossLeak
Code for the WWW'20 paper "Nowhere to Hide: Cross-modal Identity Leakage between Biometrics and Devices"
cross-modality www
Language:Python 22
JacobYuan7 / OCN-HOI-Benchmark
[AAAI 2022] Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semantics.
detr human-object-interaction cross-modality detection end-to-end-pipeline
Language:Python 17
Mithunjha / EarEEG_KnowledgeDistillation
Official implementation of "A Knowledge Distillation Framework for Enhancing Ear-EEG based Sleep Staging with Scalp-EEG Data"
cross-modality deep-learning eeg-signals-processing knowledge-distillation sleep-research sleep-staging ear-eeg
Language:Jupyter Notebook 12
MIS-DevWorks / FBR
This repository contains the official code for "Flexible Biometrics Recognition: Bridging the Multimodality Gap through Attention, Alignment and Prompt Tuning," presented at CVPR 2024.
cross-modality flexible-biometrics
Language:Python 8
Atmegal / Comprehensive-Distance-Preserving-Autoencoders-for-Cross-Modal-Retrieval
The code of Comprehensive Distance-Preserving Autoencoders for Cross-Modal Retrieval
cross-modality python retrieval tensorflow
Language:Python 6
GWxuan / CL-Gait
[ECCV 2024] Camera-LiDAR Cross-modality Gait Recognition
cross-modality gait gait-recognition lidar-point-cloud
6
llcing / Cross-modal-hashing-SRLCH
Codes of our work SRLCH
cross-modality hashing retrieval
Language:MATLAB 6
BEAM-Labs / CrossBind
Official Pytorch implementation of CrossBind: Collaborative Cross-Modal Identification of Protein Nucleic-Acid-Binding Residues.
cross-modality protein-dna-interactions protein-rna-interactions
Language:Python 4
mx-mark / SPMNet
Source code for "Visually aligned sound generation via sound-producing motion parsing" (Published at Neurocomputing)
audio-generation cross-modality synchronization visual-audio visual-to-sound audioset vas video-understanding
1