Drinking with Einstein

From Visualizations to Circuits: The Origins of the Glass Box (The Glass Box Pt. 2)

23 min · 9. feb. 2026
episode From Visualizations to Circuits: The Origins of the Glass Box (The Glass Box Pt. 2) cover

Description

Is AI just a "giant math soup" that happens to work, or is it a machine with parts we can understand? In Part 2 of The Glass Box series, we dig into the origin story of Mechanistic Interpretability. We trace the 7-year arc from the first "camera" that let us see inside a neural network (Zeiler & Fergus, 2013) to the "microscope" of Feature Visualization (Olah et al., 2017) and the eventual "blueprint" of Circuits (2020). We break down the four foundational papers that gave us the instruction manual for auditing AI and the plot twist (Superposition) that reminded us that the brain of these neural networks is a compression machine. Papers covered: * Visualizing and Understanding Convolutional Networks (2013) * Feature Visualization (2017) * The Building Blocks of Interpretability (2018) * Zoom In: An Introduction to Circuits (2020) Grab a drink. It’s time to see how the tools were built.

Comments

0

Be the first to comment

Sign up now and become a member of the Drinking with Einstein community!

Get Started

2 months for 19 kr.

Then 99 kr. / month · Cancel anytime.

  • Podcasts kun på Podimo
  • 20 lydbogstimer pr. måned
  • Gratis podcasts

All episodes

2 episodes

episode From Visualizations to Circuits: The Origins of the Glass Box (The Glass Box Pt. 2) artwork

From Visualizations to Circuits: The Origins of the Glass Box (The Glass Box Pt. 2)

Is AI just a "giant math soup" that happens to work, or is it a machine with parts we can understand? In Part 2 of The Glass Box series, we dig into the origin story of Mechanistic Interpretability. We trace the 7-year arc from the first "camera" that let us see inside a neural network (Zeiler & Fergus, 2013) to the "microscope" of Feature Visualization (Olah et al., 2017) and the eventual "blueprint" of Circuits (2020). We break down the four foundational papers that gave us the instruction manual for auditing AI and the plot twist (Superposition) that reminded us that the brain of these neural networks is a compression machine. Papers covered: * Visualizing and Understanding Convolutional Networks (2013) * Feature Visualization (2017) * The Building Blocks of Interpretability (2018) * Zoom In: An Introduction to Circuits (2020) Grab a drink. It’s time to see how the tools were built.

9. feb. 202623 min