Grant user the ability to choose number of mc iterations for calculating ExpectedImprovement and gradient EI seperately
jialeiwang opened this issue · comments
Motivation: While stochastic gradient descent algorithm has tolerance to the noise coming from monte carlo estimation of gradient, the noise from estimation of EI has great impact to the performance of the algorithm. To find a better balance between performance vs efficiency, we can set number of mc iterations for estimating gradient low, while number of mc iterations for estimating EI high.
If you have some results demonstrating the value/trade-off, I would love to see them :)