upvote
Mark Cubain had a good line, I don't know if he came up with it or who, but he reportedly said:

" There are 2 types of people using AI: Those who use it so they can know everything, and those who use it so they don't have to know anything. " :-

reply
I think probably the sweet spot is using them so you can focus on knowing only the things you care about or need to know about about.
reply
Not the intention at all. The part about mechanistic interpretability was meant to gesture at how building such systems can provide new tool kit for building further intuition and understanding.
reply
Might we ever distinguish what is complex and complicated? Probably not, but I guess the author argues that this gives us a way forward because we can try to distill large models.
reply