lucaionescu / gograd

Gograd is a small automatic differentiation framework written in Go.

gograd

Gograd is a small automatic reverse-mode differentiation framework written in Go.

Example

a := NewVar(4)
b := NewVar(3)
c := a.Mul(a.Add(b))

c.Backward()

fmt.Println(c.value)
// prints 28

fmt.Println(a.grad)
// prints 11

fmt.Println(b.grad)
// prints 4

Resources

• karpathy/micrograd
• geohot/tinygrad
• Automatic Differentiation in Machine Learning: a Survey
• From scratch: reverse-mode automatic differentiation (in Python)
• Reverse-mode automatic differentiation: a tutorial
• Calculus on Computational Graphs: Backpropagation