Issue with hebo/acq_optimizers/evolution_optimizer.py
Sunny276 opened this issue · comments
Shuyuan Sun commented
When the eval() function in the acquisition function class involves gradient backward, because line 102 of hebo/acq_optimizers/evolution_optimizer.py is ''with torch.no_grad():'', the gradient cannot be passed back. delete this line solves the problem. Why add this line ? Will deleting this line affect the final output result ?
background: I am using the genetic algrithm to find good hyperparameters for neural network training using pytorch.