jaiwei98 / MobileNetV4-pytorch

An unofficial implementation of MobileNetV4 in Pytorch

Home Page:https://arxiv.org/abs/2404.10518

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

MobileNetV4-pytorch

An unofficial implementation of MobileNetV4 (MNv4) in Pytorch.

There are 5 types of MNv4 as indicated in the MobileNetV4 -- Universal Models for the Mobile Ecosystem, e.g.

  • MobileNetV4ConvSmall (MNv4-Conv-S)
  • MobileNetV4ConvMedium (MNv4-Conv-M)
  • MobileNetV4ConvLarge (MNv4-Conv-L)
  • MobileNetV4HybridMedium (MNv4-Hybrid-M)
  • MobileNetV4HybridLarge (MNv4-Hybrid-L)

Table of Content

MobileNetV4

This section mainly showed how to import MobileNetV4

import torch
from mobilenet.mobilenetv4 import MobileNetV4

# Support ['MobileNetV4ConvSmall', 'MobileNetV4ConvMedium', 'MobileNetV4ConvLarge']
# Also supported ['MobileNetV4HybridMedium', 'MobileNetV4HybridLarge']
model = MobileNetV4("MobileNetV4ConvSmall")

# Check the trainable params
total_params = sum(p.numel() for p in model.parameters())
print(f"Number of parameters: {total_params}")

# Check the model's output shape
print("Check output shape ...")
x = torch.rand(1, 3, 224, 224)
y = model(x)
for i in y:
    print(i.shape)

TODO

  • Support 'MobileNetV4HybridMedium' and 'MobileNetV4HybridLarge'
  • Release pretrained weight (welcome any contributors to submit PR 😉)

Notes

Note that there are few parts which not excatly the same as implementation in tensorflow

  • The "fused_ib" block
  • The global average pooling layers at the end of model

Credits

Some function and code are adapted and referenced from official repo tensorflow/models.

Citations

@misc{qin2024mobilenetv4,
      title={MobileNetV4 -- Universal Models for the Mobile Ecosystem}, 
      author={Danfeng Qin and Chas Leichner and Manolis Delakis and Marco Fornoni and Shixin Luo and Fan Yang and Weijun Wang and Colby Banbury and Chengxi Ye and Berkin Akin and Vaibhav Aggarwal and Tenghui Zhu and Daniele Moro and Andrew Howard},
      year={2024},
      eprint={2404.10518},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

About

An unofficial implementation of MobileNetV4 in Pytorch

https://arxiv.org/abs/2404.10518

License:MIT License


Languages

Language:Python 100.0%