Representation Extraction & Visualization

This exercise focuses on extracting and visualizing neural network representations using the MNIST dataset.

Key steps include:

  • Training a small MLP with three hidden layers.
  • Extracting hidden layer outputs.
  • Projecting those representations into 2D using UMAP or T-SNE.
  • Monitoring how the learned representations evolve over training.

The project provides insight into the learning dynamics of neural networks and highlights generalization by comparing train/test projection differences.