Drinking with Einstein
Is AI just a "giant math soup" that happens to work, or is it a machine with parts we can understand? In Part 2 of The Glass Box series, we dig into the origin story of Mechanistic Interpretability. We trace the 7-year arc from the first "camera" that let us see inside a neural network (Zeiler & Fergus, 2013) to the "microscope" of Feature Visualization (Olah et al., 2017) and the eventual "blueprint" of Circuits (2020). We break down the four foundational papers that gave us the instruction manual for auditing AI and the plot twist (Superposition) that reminded us that the brain of these neural networks is a compression machine. Papers covered: * Visualizing and Understanding Convolutional Networks (2013) * Feature Visualization (2017) * The Building Blocks of Interpretability (2018) * Zoom In: An Introduction to Circuits (2020) Grab a drink. It’s time to see how the tools were built.
2 episodios
Comentarios
0Sé la primera persona en comentar
¡Regístrate ahora y forma parte de la comunidad de Drinking with Einstein!