Inference time, execution time, fps
tucan9389 opened this issue · comments
Infernece Time (ms)
Model vs. Device | 11 Pro |
XS | XS Max |
XR | X | 7+ | 7 |
---|---|---|---|---|---|---|---|
YOLOv3 | 83 | 108 | 93 | 100 | 356 | 569 | 561 |
YOLOv3FP16 | 84 | 104 | 89 | 101 | 348 | 572 | 565 |
YOLOv3Int8LUT | 86 | 101 | 92 | 100 | 337 | 575 | 572 |
YOLOv3Tiny | 44 | 46 | 41 | 47 | 106 | 165 | 168 |
YOLOv3TinyFP16 | 44 | 51 | 41 | 44 | 103 | 165 | 167 |
YOLOv3TinyInt8LUT | 44 | 45 | 39 | 39 | 106 | 160 | 161 |
MobileNetV2_SSDLite | 18 | 31 | 31 | 31 | 109 | 141 | 134 |
ObjectDetector | 18 | 24 | 26 | 23 | 63 | 86 | 84 |
Total Time (ms)
Model vs. Device | 11 Pro |
XS | XS Max |
XR | X | 7+ | 7 |
---|---|---|---|---|---|---|---|
YOLOv3 | 84 | 108 | 93 | 100 | 357 | 569 | 561 |
YOLOv3FP16 | 85 | 104 | 89 | 101 | 348 | 572 | 565 |
YOLOv3Int8LUT | 86 | 102 | 92 | 102 | 338 | 576 | 573 |
YOLOv3Tiny | 45 | 46 | 42 | 48 | 106 | 166 | 169 |
YOLOv3TinyFP16 | 45 | 51 | 41 | 44 | 104 | 165 | 167 |
YOLOv3TinyInt8LUT | 45 | 45 | 39 | 40 | 107 | 160 | 161 |
MobileNetV2_SSDLite | 19 | 32 | 31 | 32 | 109 | 142 | 134 |
ObjectDetector | 18 | 25 | 26 | 23 | 64 | 87 | 85 |
FPS
Model vs. Device | 11 Pro |
XS | XS Max |
XR | X | 7+ | 7 |
---|---|---|---|---|---|---|---|
YOLOv3 | 9 | 8 | 10 | 9 | 2 | 1 | 1 |
YOLOv3FP16 | 9 | 9 | 10 | 8 | 2 | 1 | 1 |
YOLOv3Int8LUT | 9 | 9 | 10 | 9 | 2 | 1 | 1 |
YOLOv3Tiny | 14 | 21 | 22 | 20 | 8 | 5 | 5 |
YOLOv3TinyFP16 | 14 | 19 | 23 | 21 | 9 | 5 | 5 |
YOLOv3TinyInt8LUT | 14 | 21 | 24 | 23 | 8 | 5 | 5 |
MobileNetV2_SSDLite | 29 | 23 | 23 | 23 | 8 | 6 | 6 |
ObjectDetector | 29 | 23 | 23 | 24 | 14 | 10 | 11 |
Model | Size (MB) |
Minimum iOS Version |
Download Link |
---|---|---|---|
YOLOv3 | 248.4 | iOS12 | Machine Learning - Models - Apple Developer |
YOLOv3FP16 | 124.2 | iOS12 | Machine Learning - Models - Apple Developer |
YOLOv3Int8LUT | 62.2 | iOS12 | Machine Learning - Models - Apple Developer |
YOLOv3Tiny | 35.5 | iOS12 | Machine Learning - Models - Apple Developer |
YOLOv3TinyFP16 | 17.8 | iOS12 | Machine Learning - Models - Apple Developer |
YOLOv3TinyInt8LUT | 8.9 | iOS12 | Machine Learning - Models - Apple Developer |
MobileNetV2_SSDLite | 9.3 | iOS12 | SSDMobileNet - Core ML Survival Guide |
ObjectDetector | 63.7 | iOS12 | Recognizing Objects in Live Capture | Apple Developer Documentation |
Excellent work!
Are you planning to add yolov4 too?
Excellent work!
Are you planning to add yolov4 too?
If I get the model, I'm able to measure the performance. But I haven't plan to convert the yolo v4 to Core ML model now myself.
ok I may try it next week when v3 is to slow.
what is the "ObjectDetector" exactly? is it a detector from apple itself?
Hmm, I can't remember the detail of ObjectDetector.mlmodel
but It seems it can detect general objects.
Here is the sample output of the model.
If you want to know the detail, please check the sample project provided by apple.