Neural networks, transformers, evaluation and shipping a model.
1 lessons · about 0.8 hours of reading and exercises
Work the chain rule through a two-layer network with real numbers, code the backward pass in numpy, check it with finite differences, then watch PyTorch autograd produce the same gradients