video-instance-segmentation

There are 3 repositories under video-instance-segmentation topic.

• open-mmlab / mmtracking

  OpenMMLab Video Perception Toolbox. It supports Video Object Detection (VID), Multiple Object Tracking (MOT), Single Object Tracking (SOT), Video Instance Segmentation (VIS) with a unified framework.

  multi-object-trackingsingle-object-trackingtrackingvideo-instance-segmentationvideo-object-detection
  Language:Python 3453

• MasterBin-IIAU / UNINEXT

  [CVPR'23] Universal Instance Perception as Object Discovery and Retrieval

  instance-segmentationobject-detectionobject-trackingperceptionreferring-expression-comprehensionreferring-expression-segmentationunified-modelmulti-object-tracking-segmentationmultiple-object-trackingreferring-video-object-segmentationvideo-instance-segmentationsingle-object-trackingvideo-object-segmentation
  Language:Python 1471

• FoundationVision / GLEE

  [CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale

  foundation-modelinteractive-segmentationobject-detectionopen-vocabulary-detectionopen-vocabulary-segmentationopen-vocabulary-video-segmentationopen-worldreferring-expression-comprehensionreferring-expression-segmentationreferring-video-object-segmentationsegment-anythingtrackingvideo-instance-segmentationvideo-object-segmentationzero-shot-object-detection
  Language:Python 979

• SysCV / sam-pt

  SAM-PT: Extending SAM to zero-shot video segmentation with point-based tracking.

  segment-anythingsegment-anything-modelvideo-instance-segmentationvideo-object-segmentationzero-shot-segmentationinteractive-video-segmentationtrack-anything
  Language:Python 937

• Epiphqny / VisTR

  [CVPR2021 Oral] End-to-End Video Instance Segmentation with Transformers

  cvpr2021video-instance-segmentationtransformersinstance-segmentation
  Language:Python 739

• wjf5203 / VNext

  Next-generation Video instance recognition framework on top of Detectron2 which supports InstMove (CVPR 2023), SeqFormer(ECCV Oral), and IDOL(ECCV Oral))

  instance-segmentationobject-detectiontransformervideo-instance-segmentationtrackingmotion
  Language:Python 596

• hustvl / QueryInst

  [ICCV 2021] Instances as Queries

  computer-visioninstance-segmentationmmdetectionvideo-instance-segmentation
  Language:Python 400

• SysCV / pcan

  Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentation, NeurIPS 2021 Spotlight

  computer-visionmotsmulti-object-tracking-segmentationneurips-2021segmentationtrackingvideo-instance-segmentation
  Language:Python 364

• SysCV / MaskFreeVIS

  Mask-Free Video Instance Segmentation [CVPR 2023]

  annotation-efficient-learningcvpr2023instance-segmentationvideo-instance-segmentationvideo-segmentationweakly-supervised-learningweakly-supervised-segmentation
  Language:Python 354

• wjf5203 / SeqFormer

  SeqFormer: Sequential Transformer for Video Instance Segmentation (ECCV 2022 Oral)

  transformer-architecturevideo-instance-segmentation
  Language:Python 339

• Zhongdao / UniTrack

  [NeurIPS'21] Unified tracking framework with a single appearance model. It supports Single Object Tracking (SOT), Video Object Segmentation (VOS), Multi-Object Tracking (MOT), Multi-Object Tracking and Segmentation (MOTS), Pose Tracking, Video Instance Segmentation (VIS), and class-agnostic MOT (e.g. TAO dataset).

  object-trackingsingle-object-trackingmulti-object-trackingmulti-object-tracking-segmentationmulti-object-trackermulti-object-trackpose-trackingvideo-object-segmentationvideo-object-trackingvideo-instance-segmentationtracking-by-detection
  Language:Python 335

• JialeCao001 / SipMask

  SipMask: Spatial Information Preservation for Fast Image and Video Instance Segmentation (ECCV2020)

  image-instance-segmentationvideo-instance-segmentationmulti-object-tracking-segmentationobject-detectiondetectionsegmentationtracking
  Language:Jupyter Notebook 334

• hustvl / TeViT

  Temporally Efficient Vision Transformer for Video Instance Segmentation, CVPR 2022, Oral

  instance-segmentationvideo-instance-segmentationvideo-understanding
  Language:Python 236

• SeokjuLee / Insta-DM

  Learning Monocular Depth in Dynamic Scenes via Instance-Aware Projection Consistency (AAAI 2021)

  monocular-depth-estimationmotion-estimationvideo-instance-segmentationdepth-estimationvisual-odometrypytorch
  Language:Python 222

• MinghanLi / UniVS

  Code release for "UniVS: Unified and Universal Video Segmentation with Prompts as Queries" (CVPR2024)

  referring-expression-segmentationvideo-instance-segmentationvideo-object-segmentationvideo-panoptic-segmentationvideo-segmentationvideo-semantic-segmentationprompt-video-object-segmentationvideo-segment-anything
  Language:Python 149

• zhang-tao-whu / DVIS

  DVIS: Decoupled Video Instance Segmentation Framework

  offlineonlineovissegmentationvideo-instance-segmentationvideo-panoptic-segmentation
  Language:Python 120

• zhang-tao-whu / DVIS_Plus

  open-vocabularyvideo-instance-segmentationvideo-segmentationvideo-semantic-segmentation
  Language:Python 85

• acaelles97 / DeVIS

  DeVIS: Making Deformable Transformers Work for Video Instance Segmentation

  video-instance-segmentationvisdeformable-transformerscomputer-visioninstance-segmentationpytorch
  Language:Python 39

• MinghanLi / STMask

  Code release for "STMask: Spatial Feature Calibration and Temporal Fusion for Effective One-stage Video Instance Segmentation"(CVPR2021)

  correlation-coefficientvideo-instance-segmentationvideo-segmentation
  Language:Python 35

• fanghaook / Awesome-Video-Instance-Segmentation

  Awesome video instance segmentation papers

  video-instance-segmentation
  24

• fanghaook / LBVQ

  Learning Better Video Query with SAM for Video Instance Segmentation (TCSVT 2024)

  video-instance-segmentation
  Language:Python 19

• clownrat6 / OpenVIS

  Open-vocabulary Video Instance Segmentation Codebase built upon Detectron2, which is really easy to use.

  open-vocabulary-segmentationopen-vocabulary-video-segmentationvideo-instance-segmentation
  Language:Python 16

• MinghanLi / MDQE_CVPR2023

  Code release for "MDQE: Mining Discriminative Query Embeddings to Segment Occluded Instances on Challenging Videos"(CVPR2023)

  video-instance-segmentationocclusion-segmentation
  Language:Python 13

• MinghanLi / BoxVIS

  Code release for "BoxVIS: Video Instance Segmentation with Box Annotation"

  video-instance-segmentationbox-supervised-segmentationpairwise-affinity-segmentation-lossweak-supervision-segmentation
  Language:Python 11

• anirudh-chakravarthy / ObjProp

  [CVPRW 2021] - Object Propagation via Inter-Frame Attentions for Temporally Stable Video Instance Segmentation

  video-instance-segmentationvideo-segmentationcvpr2021
  Language:Python 6

• SHI-Labs / Mask-Selection-Networks

  [CVPR 2021] Youtube-VIS 2021 3rd place, [CVPR 2020] winner DAVIS 2020. Code for mask selection based methods.

  video-segmentationcomputer-visionvideo-instance-segmentation
  6

• Exely / masktrackrcnn-mmdet2.0

  UNOFFICIAL implement of MaskTrackRCNN for video instance segmentation via mmdetection 2.11.0.

  computer-visionmmdetectionvideo-instance-segmentationvideo-object-segmentationinstance-segmentationtracking-algorithm
  Language:Python 5

• KainingYing / mmvis

  A video instance segmentation codebase based on OpenMMLab projects.

  deep-learningvideo-instance-segmentation
  Language:Python 3

• jkd2021 / joint-QDTrack

  Implementation of joint construction of Mask/BBox heads in QDTrack-mots for joint training research

  amodal-instance-segmentationamodal-perceptionjoint-learningjoint-modelvideo-instance-segmentation
  Language:Python 2

• Allamrahul / ObjProp

  This repository captures our work on Video Instance Segmentation, as a part of our CS 534 AI course project, under Prof. Jacob Whitehill. We describe and analyze the experimental trials performed on the baseline ([CVPRW 2021] - Object Propagation via Inter-Frame Attentions for Temporally Stable Video Instance Segmentation).

  deep-learningvideo-instance-segmentation
  Language:Python 1

• caganselim / flying_mnist

  Dynamic MNIST digit sequences for video instance segmentation with optical flow data.

  optical-flowvideo-instance-segmentationvisvos
  Language:Python 1

• caganselim / MaskTrackRCNN-PyTorch16

  This repo contains fixes for MaskTrackRCNN paper to make it compatible on PyTorch 1.6+.

  pytorchvideo-instance-segmentation
  Language:Python 1

• caganselim / TLTM

  The repository for TLTM: Two-Level Temporal Relation Model for Online Video Instance Segmentation.

  computer-visiondetectron2object-detectionobject-segmentationvideo-instance-segmentationgraph-neural-networks
  Language:Python 1

• caganselim / centermasktrackrcnn

  CenterMask is powered with MaskTrackRCNN tracking algorithm for video instance segmentation.

  computer-visionmotobject-detectionobject-trackingvideo-instance-segmentation
  Language:Python