Lab 1.4: Weight Sharing — From Position-Anchored Parts to Convolutional Features

Lab 1.4: Weight Sharing — From Position-Anchored Parts to Convolutional Features MNIST internals series. Lab 1.1 gave us class templates. Lab 1.2 watched them reorganize. Lab 1.3 added a hidden layer and the templates dissolved into shared, position-anchored stroke fragments. That last phrase is the loose thread. A fully connected hidden unit has a different weight for every pixel, so detecting the same short stroke at two locations costs two different sets of weights. Nothing in the architecture says that a useful pattern in the top-left corner should also be useful in the bottom-right. ...

November 21, 2026 · 22 min