zuliani99 / AutoML-Benchmark

Benchmark for some usual automated machine learning, such as: AutoSklearn, MLJAR, H2O, TPOT and AutoGluon. All visualized via a Dash Web Application

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

accuracy_score and clf.evaluate of Autokeras are not the same

zuliani99 opened this issue · comments

Dataframe tested: 10.csv

I find out that is a problem with the if not isinstance(df, pd.DataFrame): in line 118.
In fact if i want to run a test the if will be true, on the other hand if I want to run an OpenML Benchmark the if will false.

The problem is that return_X_y(df) take in input a DataFrame in case of OpenML Benchmark or a couple of DataFrame in case of Kaggle Benchmark

I'll re-check what input type the all algorithms accept to make sure every dataframe is adapt on the usage of that specific algorithm

Implement with the copy library a deep copy of the dataframe before every algorithm manipulation