automl / HPOlib

HPOlib is a hyperparameter optimization library. It provides a common interface to three state of the art hyperparameter optimization packages: SMAC, spearmint and hyperopt. This package is discontinued, please read the longer note in the info box below.

Home Page:http://automl.org/hpolib

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

returning a constant value makes HPOLib crash

tdomhan opened this issue · comments

I just modified branin to return a constant value instead of the branin function and ran HPOLib using SMAC on this. After about 20-30 evaluations HPOLib will crash.
I admit that returning a constant value isn't really a practical function, buuuut there seems to be a problem somewhere, and also for example many of my caffe runs will, in the beginning, return random performance, before finding a decent configuration, so it's not that unrealistic.

Did you get an error message? Could you post the error. Have you tried it with Spearmint and/or TPE?

Problem happens when function evaluation is too fast and runsolver < 3.3.4 is used.
Solution: Use runsolver 3.3.4