VITA

VITA's repositories

NeuralLift-360

[CVPR 2023, Highlight] "NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360° Views", Dejia Xu, Yifan Jiang, Peihao Wang, Zhiwen Fan, Yi Wang, Zhangyang Wang

Language:Python313 18 11

SViTE

[NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang

Language:PythonMIT90 15 3

ViT-Anti-Oversmoothing

[ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wenqing Zheng, Tianlong Chen, Zhangyang Wang

Language:PythonMIT75 9 8

CADTransformer

[CVPR 2022]"CADTransformer: Panoptic Symbol Spotting Transformer for CAD Drawings", Zhiwen Fan, Tianlong Chen, Peihao Wang, Zhangyang Wang

Language:PythonMIT70 13 22

Unified-LTH-GNN

[ICML 2021] "A Unified Lottery Tickets Hypothesis for Graph Neural Networks", Tianlong Chen*, Yongduo Sui*, Xuxi Chen, Aston Zhang, Zhangyang Wang

Language:PythonMIT61 11 7

[ICCV2023] "Enhancing NeRF akin to Enhancing LLMs: Generalizable NeRF Transformer with Mixture-of-View-Experts" by Wenyan Cong, Hanxue Liang, Peihao Wang, Zhiwen Fan, Tianlong Chen, Mukund Varma, Yi Wang, Zhangyang Wang

Language:Python47 14 3

UVC

[ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Liu, Zhangyang Wang

Language:PythonMIT45 9 8

ChainCoder

📜 [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, Kevin Wang, Yihan Xi, Dejia Xu, Zhangyang Wang

Language:PythonMIT36 12 2

SteinDreamer

“SteinDreamer: Variance Reduction for Text-to-3D Score Distillation via Stein Identity” by Peihao Wang, Zhiwen Fan, Dejia Xu, Dilin Wang, Sreyas Mohan, Forrest Iandola, Rakesh Ranjan, Yilei Li, Qiang Liu, Zhangyang Wang, Vikas Chandra

34 7 1

Graph-Mixture-of-Experts

[NeurIPS'23] Graph Mixture of Experts: Learning on Large-Scale Graphs with Explicit Diversity Modeling. Haotao Wang, Ziyu Jiang, Yuning You, Yan Han, Gaowen Liu, Jayanth Srinivasa, Ramana Rao Kompella, Zhangyang Wang

Language:PythonMIT28 12 7

TurbNet

[ECCV 2022] "Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and A New Physics-Inspired Transformer Model" by Zhiyuan Mao, Ajay Jaiswal, Zhangyang Wang, Stanley Chan.

Language:Python28 11 4

SMC-Bench

[ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen, Tianjin Huang, AJAY KUMAR JAISWAL, Zhangyang Wang

Language:Python27 110

TEGNAS

"Understanding and Accelerating Neural Architecture Search with Training-Free and Theory-Grounded Metrics" by Wuyang Chen, Xinyu Gong, Yunchao Wei, Humphrey Shi, Zhicheng Yan, Yi Yang, and Zhangyang Wang

Language:PythonMIT25 8 4

MLSP

[ECCV 2022] "Point Cloud Domain Adaptation via Masked Local 3D Structure Prediction" by Hanxue Liang, Hehe Fan, Zhiwen Fan, Yi Wang, Tianlong Chen, Yu Cheng, Zhangyang Wang

Language:Python19 12 4

PiRN

[ICCV2023] Physics-Driven Turbulence Image Restoration with Stochastic Refinement. Ajay Jaiswal, Xingguang Zhang, Stanley Chan, and Zhangyang Wang

Language:Python18 13 4

ppt2script

Auto Generate Speech Script From PPT - Based on ChatGPT

Language:Python14 110

Data-Efficient-Scaling

[ICML 2023] "Data Efficient Neural Scaling Law via Model Reusing" by Peihao Wang, Rameswar Panda, Zhangyang Wang

Language:Python13 120

ramanujan-on-pai

[ICLR 2023] 'Revisiting Pruning At Initialization Through The Lens of Ramanujan Graph" by Duc Hoang, Shiwei Liu, Radu Marculescu, Atlas Wang

Language:Jupyter Notebook13 110

Trap-and-Replace-Backdoor-Defense

[NeurIPS'22] Trap and Replace: Defending Backdoor Attacks by Trapping Them into an Easy-to-Replace Subnetwork. Haotao Wang, Junyuan Hong, Aston Zhang, Jiayu Zhou, Zhangyang Wang

Language:Python13 13 1

graph_ladling

[ICML2023] Graph Ladling: Shockingly Simple Parallel GNN Training without Intermediate Communication. Ajay Jaiswal, Shiwei Liu, Tianlong Chen, Ying Ding, and Zhangyang Wang

Language:PythonMIT11 12 1

MaT-FL

[CVPRW 2023] "Many-Task Federated Learning: A New Problem Setting and A Simple Baseline" by Ruisi Cai, Xiaohan Chen, Shiwei Liu, Jayanth Srinivasa, Myungjin Lee, Ramana Kompella, Zhangyang Wang

Language:Python11 11 1

TinT

[Information Fusion] "Integrating the Urban Science with Deep Learning for City-wide Network Congestion Prediction" by Wenqing Zheng, Hao (Frank) Yang, Jiarui Cai, Peihao Wang, Xuan Jiang, Simon Du, Yinhai Wang, and Zhangyang Wang

Language:Jupyter NotebookMIT11 2 3

instant_soup

[ICML2023] Instant Soup Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models. Ajay Jaiswal, Shiwei Liu, Tianlong Chen, Ying Ding, and Zhangyang Wang

Language:PythonMIT10 14 2

DSEE

[ACL 2023] "DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models" by Xuxi Chen, Tianlong Chen, Weizhu Chen, Ahmed Hassan Awadallah, Zhangyang Wang, Yu Cheng

Language:PythonMIT9 80

L2PG

[ICML 2023] "Learning to Optimize Differentiable Games" by Xuxi Chen, Nelson Vadori, Tianlong Chen, Zhangyang Wang

Language:Python9 110

essential_sparsity

[NeurIPS 2023] "The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Matter", Ajay Jaiswal, Shiwei Liu, Tianlong Chen, and Zhangyang Wang

Language:Python8 130

Chasing-Better-DIPs

[TMLR] "Chasing Better Deep Image Priors between Over- and Under-parameterization" Qiming Wu, Xiaohan Chen, Yifan Jiang, Zhangyang Wang

Language:Jupyter NotebookMIT3 10

Bi-RPT

[CPAL 2024] "Cross-Quality Few-Shot Transfer for Alloy Yield Strength Prediction: A New Materials Science Benchmark and A Sparsity-Oriented Optimization Framework" by Xuxi Chen, Tianlong Chen, Everardo Yeriel Olivares, Kate Elder, Scott K. McCall, Aurelien Pierre Philippe Perron, Joseph T. McKeown, Bhavya Kailkhura, Zhangyang Wang, Brian Gallagher

Language:Python2 100

QuantumSEA

[QCE 2023]"QuantumSEA: In-Time Sparse Exploration for Noise Adaptive Quantum Circuits" Tianlong Chen, Zhenyu Zhang, Hanrui Wang, Jiaqi Gu, Zirui Li, David Z Pan, Frederic T Chong, Song Han, Zhangyang Wang

Language:PythonMIT2 110

FullSpectrum-PAI

[NEURIPS'23] "Don’t Just Prune by Magnitude! Your Mask Topology is Another Secret Weapon" Duc Hoang, Souvik Kundu, Shiwei Liu, Zhangyang Wang

0110

VITA-Group