How Dopamine & Serotonin Shape Decisions, Motivation & Learning: Beyond Reward to Continuous Expectation Updating

This episode features Dr. Read Montague, a pioneer in measuring neuromodulators in real-time, who fundamentally redefines the understanding of dopamine and serotonin. Moving beyond the simplistic view of dopamine as merely a pleasure or reward molecule, Dr. Montague explains its primary role as a crucial learning signal that drives motivation and persistence. He introduces the concept of 'temporal difference error,' an advanced form of reward prediction error, where dopamine continuously updates expectations based on successive predictions, not just final outcomes. This continuous updating mechanism is vital for navigating complex, multi-milestone scenarios common in life, work, relationships, and even foraging behaviors, allowing organisms to learn and adapt over long stretches without immediate reinforcement.

The discussion highlights the profound connection between these biological learning algorithms and artificial intelligence. Dr. Montague explains that the same temporal difference reinforcement learning algorithms, first theorized by Rich Sutton and Andy Barto, are installed in the brains of mobile creatures from honeybees to humans, and have been externalized and leveraged by AI systems like DeepMind's AlphaGo Zero to achieve unprecedented breakthroughs. This convergence underscores a fundamental, universal learning rule that governs both biological and artificial intelligence, demonstrating how our understanding of brain function can inform and be informed by computational models.

The podcast also delves into the interplay between dopamine and serotonin, revealing a nuanced, seesaw relationship. While dopamine drives forward-seeking motivation and learning from positive expectation updates, serotonin is primarily involved in teaching about unwanted outcomes. Dr. Montague provides a fascinating insight into SSRIs, explaining that while they increase serotonin levels, this can paradoxically reduce the rewarding properties of dopamine by acting at dopamine synapses. This offers a vastly different perspective on these neuromodulators than commonly understood, providing a deeper appreciation for their complex roles in shaping our internal states and behaviors.

Ultimately, the episode offers practical insights into leveraging this advanced knowledge for better motivation, decision-making, and social interactions. By understanding that our nervous system is designed for continuous forward-pushing drive—a perpetual 'foraging' mode—we can appreciate why systems like social media are so engaging. The concept of 'deliberate delays' and the potential use of AI tools are also discussed as ways to harness neuroplasticity and optimize our learning and motivational processes, emphasizing that the system is built to keep tracking and seeking new goals, rather than settling for a single achievement.

"If any goal that you achieved, whatever it is, taking a drug, eating a food, u getting a a partner or whatnot, um if that was enough for you, right, then you wouldn't keep living."

"Dopamine is involved in learning as well as persistence or lack of persistence."

"It's very clearly a learning signal number one. So dopamine fluctuations high and low control learning."

"The reward prediction error that people talk about dopamine representing is the prediction error that you get for every single step whether or not you've received reward."

"The insight I think of Sutton and Barto in their algorithm was well a better algorithm for learning continuously is to take successive predictions and to say that's a learning rule."

"The Deep Mind guys in London who beat the world go playing champion and made Alpha Fold and won Nobel prizes and I mean they're starting in 2015 they just had this unbelievable series of hits. They used the Sutton and Barto algorithm."

"It's the only thing I know of that's sort of crawled out of your mind into a program and now the program is doing things that we couldn't imagine before. And it matches the biology."

"Your nervous system keeps pushing you forward. That's what you're working for. You're working for this push forward drive."

"SSRIs increase levels of serotonin, but often that serotonin gets used at the dopamine synapses to reduce the rewarding properties of dopamine."

"This is why I don't like the phrase or the words dopamine hits because it implies it's like a reward that gets trickled into you."