weecology / DeepForest

Python Package for Airborne RGB machine learning

Home Page:https://deepforest.readthedocs.io/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Multi-scale cropping based on density maps.

bw4sz opened this issue · comments

https://openaccess.thecvf.com/content_CVPRW_2020/papers/w11/Li_Density_Map_Guided_Object_Detection_in_Aerial_Images_CVPRW_2020_paper.pdf

image

We often have multi-scale challenges, especially as predict_tile just cuts images into uniform pieces. This an interesting idea for bird detection. with trees the images are often uniformly trees.

Sparse RCNN

https://github.com/PeizeSun/SparseR-CNN
worth exploring as well.

commented

Hi @bw4sz, can I work on this issue?

@Om-Doiphode, Feel free to address any unresolved issues without needing explicit permission. If an issue remains unassigned, you are welcome to take initiative and work on it.

commented

I have read the research paper on Density Map Guided Object Detection in Aerial Images. Should I include the code for DMNet under deepforest/models folder?

This seems like a pretty complex topic that is unlikely to be easily added on a short time-frame, but could make a decent GSOC proposal. This would implement dynamic cropping, which would influence the behavior of predict_tile rather than replacing the detection model (though I'm not super clear on the double use of the detector yet).

@bw4sz - I'm assuming you were thinking about this as a more complex feature request project rather than a smaller issue. Is that right?

yes, anything with the machine learning label is going to be a pretty big lift.

Thanks @bw4sz.

So, @Om-Doiphode - it's great that you're excited about this one, but we think it's better to think of it as a GSOC project to propose (if you want; there are certainly other good options) not an initial contribution. We've done some issue cleanup and labeled a bunch of additional issues as good first issue which will be a little more manageable to engage with as you're getting familiar with the code base.

commented

Thank you @ethanwhite