Line searches need to cache function values and gradients
bayerj opened this issue · comments
Justin Bayer commented
Currently, some line searches do not cache the function values at the last step. The callers thus have to evaluate those again if necessary (or if the user wants to inspect them) which is expensive in several cases, e.g. batch learning.
There should be a unified API on how to get the latest f and f' results.