deepfence / SecretScanner

:unlock: :unlock: Find secrets and passwords in container images and file systems :unlock: :unlock:

Home Page:https://deepfence.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Reduce memory usage of SecretScanner

ramanan-ravi opened this issue · comments

SecretScanner takes >250 mb of memory when scanning hosts with huge number of files

#28
It was saving list of all files to process in a slice which was taking lot of memory beyond 300k entries.
Now optimized that part to process the files inside filepath.Walk as and when we get a file.

What is the current memory usage for scanning a large container image (say 1g+)?

Now it takes ~60 mb for all scans