Goal
Enable gradient computation through a dynamic computation graph.
Tasks
Acceptance criteria
- Gradients match numerical differentiation on toy functions
- Inspired by micrograd / tinygrad design
References
- Andrej Karpathy's micrograd
- PyTorch autograd internals
Goal
Enable gradient computation through a dynamic computation graph.
Tasks
Variable/NodewrappingTensorwith gradient trackingbackward()that traverses the graph and accumulates.gradAcceptance criteria
References