visual-layer / fastdup

fastdup is a powerful free tool designed to rapidly extract valuable insights from your image & video datasets. Assisting you to increase your dataset images & labels quality and reduce your data operations costs at an unparalleled scale.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Bug]: fastdup overwrites similarity.csv when calling run_mode=4 or search

Tompil3r opened this issue · comments

What happened?

When calling run(run_mode=4) or search - which both generate new similarities, fastdup overwrites the similarity.csv in the work_dir. Meaning in order to keep the similarities a copy of the file needs to be made each time.

What did you expect to see?

No response

What version of fastdup were you runnning on?

1.30

What version of Python were you running on?

Python 3.10

Operating System

Ubuntu 20

Reproduction steps

No response

Relevant log output

No response

Attach a screenshot [Optional]

No response

Contact Details [Optional]

No response

I find that this is the line that overwrites the similarity.csv file.

ret = fun(img_arr, int(elems), int(verbose), bytes(filename, 'utf-8'))

@dbickson could you please check on the C side?