AI's vocabulary can help reverse-engineer the brain

Adam MarblestoneAdam Marblestone – AI is missing something fundamental about the brainat 1:03:00

From the conversation

But I don't know, it just feels like AI is really good fodder for computational neuroscience. Those might actually be pretty good models. We should look at that. I both think that there should be a part of the research portfolio that is totally bottom-up and not trying to apply our vocabulary that we learn from AI onto these systems, and that there should be another big part of this that's trying to reverse engineer it using that vocabulary or variant of that vocabulary. We should just be pursuing both. My guess is that the reverse engineering one is actually going to work-ish or something. Like we do see things like TD learning, which Sutton also invented separately. That must be a crazy feeling to just like— Yeah, that's crazy. This equation I wrote down is like in the brain. It seems like the dopamine is doing some of that, yeah. So let me ask you about this. You guys are funding different groups that are trying to figure out what's up in the brain. If we had a perfect representation, however you define it, of the brain, why think it would actually let us figure out the answer to these questions? We have neural networks which are way more interpretable, not just because we understand what's in the weight matrices, but because there are weight matrices. There are these boxes with numbers in them. Even then we can tell very basic things.…

Machine-generated transcript. The excerpt can include the interviewer and other voices, and the transcription may contain errors. The rest is in the episode →

Summary

AI systems serve as useful models for computational neuroscience, and their internal vocabulary and architecture can be applied to reverse-engineer biological neural systems. Research should pursue both a bottom-up approach that avoids imposing AI-derived concepts onto biological systems and a reverse-engineering approach that leverages that same vocabulary. Marblestone's intuition is that the reverse-engineering direction is likely more productive, though both tracks deserve resources.

Watch the clip on YouTubeStarts at 1:03:00

Concept

Internals

Related clips