关于一阶优化
hyqyoung opened this issue · comments
我想问下，对结构参数使用一阶优化有速度和精度方面的考量吗？
Sorry for the late reply. The main concern of using the first-order optimization is search cost (speed). Besides, we found that the second-order optimization helps little on the accuracy.