mechanistic-interpretability

I was recently looking for scenarios to try out some mechanistic interpretability methods available in the Neuronpedia tool. Neuronpedia has interactive implementations of the J-Lens, Oracle Lens, and Natural Language Autoencoders, among others. Here’s the prompt I landed on: Let’s play the animal guessing game. You pick a random animal. Then, the user can ask…