tucan9389 / ObjectDetection-CoreML

An example running Object Detection using Core ML (YOLOv8, YOLOv5, YOLOv3, MobileNetV2+SSDLite)

Home Page:https://github.com/motlabs/awesome-ml-demos-with-ios

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Inference time, execution time, fps

tucan9389 opened this issue · comments

Infernece Time (ms)

Model vs. Device 11
Pro
XS XS
Max
XR X 7+ 7
YOLOv3 83 108 93 100 356 569 561
YOLOv3FP16 84 104 89 101 348 572 565
YOLOv3Int8LUT 86 101 92 100 337 575 572
YOLOv3Tiny 44 46 41 47 106 165 168
YOLOv3TinyFP16 44 51 41 44 103 165 167
YOLOv3TinyInt8LUT 44 45 39 39 106 160 161
MobileNetV2_SSDLite 18 31 31 31 109 141 134
ObjectDetector 18 24 26 23 63 86 84

Total Time (ms)

Model vs. Device 11
Pro
XS XS
Max
XR X 7+ 7
YOLOv3 84 108 93 100 357 569 561
YOLOv3FP16 85 104 89 101 348 572 565
YOLOv3Int8LUT 86 102 92 102 338 576 573
YOLOv3Tiny 45 46 42 48 106 166 169
YOLOv3TinyFP16 45 51 41 44 104 165 167
YOLOv3TinyInt8LUT 45 45 39 40 107 160 161
MobileNetV2_SSDLite 19 32 31 32 109 142 134
ObjectDetector 18 25 26 23 64 87 85

FPS

Model vs. Device 11
Pro
XS XS
Max
XR X 7+ 7
YOLOv3 9 8 10 9 2 1 1
YOLOv3FP16 9 9 10 8 2 1 1
YOLOv3Int8LUT 9 9 10 9 2 1 1
YOLOv3Tiny 14 21 22 20 8 5 5
YOLOv3TinyFP16 14 19 23 21 9 5 5
YOLOv3TinyInt8LUT 14 21 24 23 8 5 5
MobileNetV2_SSDLite 29 23 23 23 8 6 6
ObjectDetector 29 23 23 24 14 10 11
Model Size
(MB)
Minimum
iOS Version
Download Link
YOLOv3 248.4 iOS12 Machine Learning - Models - Apple Developer
YOLOv3FP16 124.2 iOS12 Machine Learning - Models - Apple Developer
YOLOv3Int8LUT 62.2 iOS12 Machine Learning - Models - Apple Developer
YOLOv3Tiny 35.5 iOS12 Machine Learning - Models - Apple Developer
YOLOv3TinyFP16 17.8 iOS12 Machine Learning - Models - Apple Developer
YOLOv3TinyInt8LUT 8.9 iOS12 Machine Learning - Models - Apple Developer
MobileNetV2_SSDLite 9.3 iOS12 SSDMobileNet - Core ML Survival Guide
ObjectDetector 63.7 iOS12 Recognizing Objects in Live Capture | Apple Developer Documentation

Excellent work!

Are you planning to add yolov4 too?

@Pad90

Excellent work!

Are you planning to add yolov4 too?

If I get the model, I'm able to measure the performance. But I haven't plan to convert the yolo v4 to Core ML model now myself.

ok I may try it next week when v3 is to slow.

what is the "ObjectDetector" exactly? is it a detector from apple itself?

@Pad90

Hmm, I can't remember the detail of ObjectDetector.mlmodel but It seems it can detect general objects.

Here is the sample output of the model.

If you want to know the detail, please check the sample project provided by apple.