Neural Network from Scratch (MNIST Digit Identifier)
Multilayer Perceptron & Hand-Derived Backpropagation
- Engineered and implemented a multilayer perceptron (784-16-16-10 structure, ~13K parameters) from scratch using NumPy with no machine learning libraries.
- Derived analytical matrix gradients by hand to train with a custom stochastic gradient descent (SGD) loop, achieving ~94.2% test accuracy.
- Designed a modular, object-oriented architecture supporting arbitrary layer dimensions and network depths.
- Profiled training bottlenecks between full-batch and stochastic gradient descent, discovering parameter update cadence to be the critical factor for rapid convergence.