Ouail Kitouni
Ouail Kitouni
Home
Posts
Publications
Contact
Light
Dark
Automatic
Posts
Reverse-engineering a Transformer Trained on Nuclear Physics
A mechanistic interpretability effort that aims to reverse-engineer NuCLR, which accurately predicts nuclear properties and demonstrates an understanding of basic nuclear theory, to potentially derive new insights in nuclear physics.
Ouail Kitouni
Jun 21, 2023
1 min read
The Physics of Deep Learning
Our theoretical understanding of deep learning is still in its infancy. And as we figure out what questions to even ask, perhaps it would be useful to draw inspiration from the field responsible for some of the most successful theories in science. This is a lazy repository of what we know about deep learning.
Ouail Kitouni
Jun 21, 2023
2 min read
Misc. Animations and Visualizations
A collection of visualization I made in various projects
Ouail Kitouni
Nov 18, 2022
1 min read
Some thoughts on Grokking
A short blog post on “Towards Understanding Grokking: an effective theory of representation learning”
Ouail Kitouni
Sep 21, 2022
2 min read
Cite
×