<?xml version="1.0" encoding="UTF-8" ?><!-- generator=Zoho Sites --><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/"><channel><atom:link href="https://www.seekerofmeaning.in/blogs/neuroscience/feed" rel="self" type="application/rss+xml"/><title>Seeker - Blog , Neuroscience</title><description>Seeker - Blog , Neuroscience</description><link>https://www.seekerofmeaning.in/blogs/neuroscience</link><lastBuildDate>Tue, 01 Sep 2026 14:02:37 +0530</lastBuildDate><generator>http://zoho.com/sites/</generator><item><title><![CDATA[Depression, habenula, and the pitfalls of setting rigid goals]]></title><link>https://www.seekerofmeaning.in/blogs/post/depression-habenula-and-the-pitfalls-of-setting-rigid-goals</link><description><![CDATA[I recently visited my cousin after eons and had the fortune of spending some quality time. My cousin, who is about 17 years old, is full of life and q ]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_XTUnkDWQT-Wpdx2aKiDaOQ" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_m5ItqBlCTqe1D49xuY2zXw" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"></style><div data-element-id="elm_rf1fdBCdR5eMw8HK8vQ5DA" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"></style><div data-element-id="elm_2FLN6Z-PTO2V96E-d_JiSg" data-element-type="text" class="zpelement zpelem-text "><style></style><div class="zptext zptext-align-center zptext-align-mobile-center zptext-align-tablet-center " data-editor="true"><p></p><div><p></p><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">I recently visited my cousin after eons and had the fortune of spending some quality time. My cousin, who is about 17 years old, is full of life and quite chatty. Naturally, we discussed all sorts of things. During the conversation, he excitedly began sharing details about his fitness journey. He told me that he had started hitting the gym a few weeks ago and took great pride in the fact. While we were engaged in conversation, his mom interrupted us and began expressing her concerns over his behaviour.</span></div><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">My aunt told me that my cousin’s behaviour of late had been annoying her. When I asked what frustrated her, she remarked on how my cousin had refused to visit his grandmother on her birthday because he wouldn’t be able to meet his protein requirements, and how he had got riled up when she insisted that he join them.</span></div></span><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">Now, he interrupted his mom and started bragging about how consistent he had been. He told me that he did not want to skip his daily routine - which included going to the gym, walking a certain number of steps, eating a certain amount of protein, and so on - and that missing any of these things made him angry.</span></div></span><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-weight:inherit;font-style:inherit;">While I was genuinely happy for him - after all, he was trying to set higher standards and build healthier habits - his rigidity unsettled me. It reminded me of a pitfall that, based on my reading of Dr. Kyra Bobinet’s </span><em style="font-weight:inherit;">The Unstoppable Brain</em><span style="font-weight:inherit;font-style:inherit;">, he might be at risk of falling into, which is setting SMART goals (counting steps, calories, protein intake, tracking diet etc) that become unsustainable and defining success so narrowly that any deviation feels like failure.</span></div></span><div style="text-align:left;"><br/></div><p></p><p style="text-align:left;"><span style="font-style:inherit;font-weight:700;">Note:</span><span style="font-style:inherit;font-weight:inherit;"> This is not a preachy post, nor is it a recommendation. I’m merely sharing Dr. Bobinet’s views on the pitfalls of SMART approaches to behaviour change, because I echo her sentiment and believe it's useful to know her view.</span></p><p></p><div style="text-align:left;"><br/></div><div style="font-style:inherit;font-weight:inherit;text-align:left;"><span style="font-style:inherit;font-weight:inherit;">Before I continue, here's a quick intro of Dr. Bobinet taken from her website.</span></div><div style="text-align:left;"><br/></div><p></p><blockquote><p style="text-align:left;font-style:inherit;font-weight:inherit;"><span style="font-style:inherit;font-weight:inherit;">Kyra Bobinet, MD, MPH, has passionately pursued and studied the truth about behavior change for nearly three decades as a physician, public health leader, healthcare executive, and behavioral expert. An award-winning health innovator and thought leader, Dr. Bobinet has an MD from UCSF School of Medicine and an MPH from Harvard University. She belongs to the Stanford Medical School AIM lab, where she has taught on health behavior change, and is CEO/founder of Fresh Tri, a behavioral software company based on the latest neuroscience of habit formation and lasting change.</span></p></blockquote><p></p><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">Let's admit - building a new habit is difficult, because it requires consistency and&nbsp;</span></div></span><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-weight:inherit;font-style:inherit;">discipline. Setting SMART goals is usually considered a good way to develop these (we'll explore later why). But </span><a href="https://drkyrabobinet.com/" rel="noreferrer" target="_blank">Dr. Bobinet</a><span style="font-weight:inherit;font-style:inherit;"> draws on her decades of experience as a behaviour-change expert to argue otherwise. In Unstoppable Brain, she contends that SMART approaches to habit building are </span><a href="https://www.merriam-webster.com/dictionary/performative" rel="noreferrer" target="_blank">performative</a><span style="font-weight:inherit;font-style:inherit;"> in nature and argues that such approaches work only in the short term and can, in fact, be detrimental for long-term behaviour change.</span></div></span><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">To understand why they are not just ineffective, but often detrimental w.r.t long-term behaviour change, it's important to learn the neuroscience undergirding these approaches.</span></div></span><div style="text-align:left;"><br/></div><p></p><h3 style="text-align:left;font-weight:700;"><span style="font-style:inherit;">Dopamine &amp; behaviour change</span></h3><p></p><div style="text-align:left;"><span style="font-weight:inherit;font-style:inherit;">SMART goals are attractive because they are measurable, concrete, and directional. Pursuing these goals </span><a href="https://intoactionrecovery.com/blog/how-dopamine-drives-our-behavior/" rel="noreferrer" target="_blank">engages our reward system</a><span style="font-weight:inherit;font-style:inherit;"> - dopamine pathways.</span></div><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">You set a goal, move towards it, and experience a sense of reward upon achieving the goal. At the end, you feel good about yourself, which makes you &quot;learn&quot; the behaviour. Repeating this enough times is likely to turn the behaviour into a habit.</span></div></span><p></p><p style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">Much of the discussion around behaviour change and habit formation has therefore focused on rewards, incentives, and the anticipation of achieving a desired outcome as a way to motivate behaviour.</span></p><p></p><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">But what's likely to happen when you don't achieve the goal? In other words, what happens when you fail, or rather, &quot;perceive failure?&quot; That's the very question Dr. Bobinet draws our attention to. Let's understand this by looking at a gut-wrenching experiment conducted on dogs by psychologists in the 1960s.</span></div></span><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">&nbsp;</span></div></span><p></p><h3 style="text-align:left;font-weight:700;"><span style="font-style:inherit;">Learned helplessness&nbsp;</span><span style="font-style:inherit;font-weight:inherit;">&nbsp;</span></h3><p style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">In the 1960s, psychologists Martin Seligman and Steven Maier conducted a series of experiments in which dogs were enclosed in a kennel and given electric shocks. Initially, the dogs squealed in pain, frantically moving back and forth and attempting to escape the cage, but after multiple attempts, they eventually stopped trying. Later, the scientists made it possible for the dogs to escape. What surprised them was that despite being in a situation to escape, many of the dogs simply gave up. Their earlier experience seemed to have taught them that there was nothing they could do to change their situation.</span></p><p></p><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-weight:inherit;font-style:inherit;">The phenomenon came to be known as </span><a href="https://dictionary.apa.org/learned-helplessness?" rel="noreferrer" target="_blank">learned helplessness</a><span style="font-weight:inherit;font-style:inherit;">. In the above example, the dogs learned to be helpless. This occurs when an individual repeatedly faces a negative or uncontrollable situation and stops changing their circumstances, even when they seemingly can do so. Dr. Bobinet calls this the know-do gap, which takes the following form</span></div></span><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">&quot;I know what I should do, but I don't do it.&quot;</span></div></span><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">&quot;Nothing I do makes a difference.&quot; etc</span></div></span><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">This is one of the signs of depression.</span></div></span><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">What's driving this attitude? THE HABENULA</span></div></span><div style="text-align:left;"><br/></div><span style="font-style:inherit;"><div style="text-align:left;"><span style="font-weight:700;font-style:inherit;">Note: </span><span style="font-style:inherit;">She highlights multiple studies like </span><a href="https://www.nature.com/articles/npp2011193?" rel="noreferrer" target="_blank">this one</a><span style="font-style:inherit;"> that discuss the role of habenula in depression.</span></div></span><p></p><h3><div style="text-align:left;"><span style="font-weight:700;"><br/></span></div><span style="font-weight:700;font-style:inherit;"><div style="text-align:left;"><span style="font-style:inherit;">Habenula, the motivation kill switch (borrowing her term)</span></div></span></h3><p></p><div style="text-align:left;"><span style="font-weight:inherit;font-style:inherit;">Habenula is an ancient structure located in brain's </span><a href="https://pmc.ncbi.nlm.nih.gov/articles/PMC11081310/" rel="noreferrer" target="_blank">epithalamus</a><span style="font-weight:inherit;font-style:inherit;"> region. According to Dr. Bobinet, habenula is perhaps the most important controller of behaviour, and it's activated whenever we perceive failure. Since these ideas form the crux of my post,</span></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">I'd like to quote a few passages from the book in the sections that follow to convey Dr. Bobinet's message with fidelity.</span></div></span><p></p><blockquote><p></p><div style="font-style:inherit;font-weight:inherit;text-align:left;"><span style="font-style:inherit;font-weight:inherit;">&quot;A half-centimeter area of our brain's epithalamus, this potent neuro-anatomical mechanism activates whenever there's perceived failure and then, often subconsciously downregulates one's motivation to try again&quot;</span></div><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">PG 48</span></div></span><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">&quot;When activated, habenula is a kill switch for our motivation. We stop trying new experiences or building healthy habits whenever we think we failed at, say, sticking to a diet or even controlling our anxiety.&quot;</span></div></span><div style="text-align:left;"><br/></div><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">The below is perhaps the most important insight of all.</span></div></span><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">PG 48</span></div></span><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">&quot;Keep in mind that there is rarely absolute or terminal failure; mostly we experience perceived failure in terms of our behaviour change. But to habenula, they are the same thing.&quot;</span></div></span><p></p></blockquote><p></p><div style="text-align:left;"><br/></div><span style="font-style:inherit;"><div style="text-align:left;"><span style="font-weight:700;font-style:inherit;">Ex:</span><span style="font-weight:inherit;font-style:inherit;"></span><span style="font-style:inherit;">Assume you set your mind on completing 10k steps everyday of the week. Now, being able to complete only 7k on a particular day is not a failure in any absolute terms. It's a failure only in relation to your goal of completing 10k everyday.</span></div></span><div style="text-align:left;"><br/></div><p></p><h3 style="text-align:left;font-weight:700;"><span style="font-style:inherit;">Dopamine &amp; Habenula</span></h3><blockquote><p></p><div style="font-style:inherit;font-weight:inherit;text-align:left;"><span style="font-style:inherit;font-weight:inherit;">Pg 49,</span></div><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">&quot;The habenula's power over your behaviour is best illustrated by imagining that you are sitting in a car. The gas pedal represents your motivation and the concomitant dopamine that rewards you for pursuing goals. In fact, this &quot;gas pedal&quot; has been the focus of health improvement programs.............But what we all missed is - the brakes were on! The habenula acts like your brake pedal. And just like in a real car, you can floor the gas all you want, but if the brakes are on, you're not going anywhere. In other words, an activated habenula has more power over your behaviour than an activated reward system.&quot;</span></div></span><p></p></blockquote><p></p><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">Essentially, failures register more strongly and painfully than successes feel rewarding. As a result, repeated failure to achieve a goal can undermine motivation far more powerfully than sporadic success can sustain it.</span></div></span><div style="text-align:left;"><br/></div><span style="font-style:inherit;"><div style="text-align:left;"><span style="font-weight:700;font-style:inherit;">Note:</span><span style="font-style:inherit;"> Incidentally, I am reminded of Daniel Kahneman and Amos Tversky's </span><a href="https://www.spring.org.uk/2023/01/loss-aversion-bias.php?" rel="noreferrer" target="_blank">loss aversion theory</a><span style="font-style:inherit;">. Loss aversion is a psychological bias in which people prefer to avoid losses more than getting equivalent gains.</span></div></span><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">In her view, setting SMART goals often leads to relapse in behaviour because our environment can't be programmed to perfection every single day. Some days, you are sick. Another day, you have a commitment or a function to attend - as in my cousin's case. On some other day, you have less energy, etc. Therefore, a rigid mind that looks at success and failure as binary (10k steps success, anything less, I failed), is likely to suffer more - this can range from not pursuing the behaviour (lack of motivation) to becoming depressed (the detrimental bit).</span></div></span><p></p><p></p><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">Adapting to change, staying flexible, and iterating on our processes are key to long-term behaviour change, according to Dr. Bobinet. She has an entire chapter devoted to discussing these.</span></div><div style="text-align:left;"><br/></div><p></p><h3 style="text-align:left;font-weight:700;"><span style="font-style:inherit;">Conclusion</span></h3><p></p><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">We are complex creatures and our brains work in fantastically complex ways. Neuroscience is still an evolving field, with scientists constantly coming up with new theories, experiments, and models to unpack the mysteries of our brain. Whenever new theories with better explanatory power and experimental evidence relating to a phenomenon emerge, it's worth paying attention to them. This in no way implies that the newer theory has the final word w.r.t explaining the phenomenon.</span></div><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">This is not limited to Neuroscience, but rather to the scientific enterprise as a whole. [Atomic theory, standard model, big-bang cosmology, computational theory of mind etc]. You name it.</span></div></span><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">That's the spirit in which we must construe Dr. Bobinet's take about habit change and behaviour formation as well. And she's not even decrying SMART approaches in a blanket manner.</span></div></span><div style="text-align:left;"><br/></div><span style="font-style:inherit;font-weight:inherit;"><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">In her own words. The below quote captures the essence of her argument.</span></div></span><p></p><blockquote><p></p><div style="text-align:left;"><br/></div><div style="font-style:inherit;font-weight:inherit;text-align:left;"><span style="font-style:inherit;font-weight:inherit;">&quot;I personally have nothing against goals, awards, or performances. I celebrate incredible human achievements and breathtaking feats as much as the next person. But performance mindsets, if used inflexibly, for the same individual or organization, have been proven to cause harm eventually. This is because they are best for sprinting but not for marathoning.&quot;</span></div><div style="text-align:left;"><br/></div><p></p></blockquote><p style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;">If SMART approaches to building habits have worked for you, there's perhaps no reason for you to change. But if they have not worked, there's value in understanding Dr. Bobinet's view and developing an iterative mindset. At the end of the day, if we start enjoying the process, without having rigid definitions of success or failure, we are likely to develop healthier habits and foster long-term behaviour change.</span></p><div style="text-align:left;"><span style="font-style:inherit;font-weight:inherit;"><br/></span></div></div><p></p></div>
</div><div data-element-id="elm_591z6KMaRqm3yzoPOdqw7w" data-element-type="button" class="zpelement zpelem-button "><style></style><div class="zpbutton-container zpbutton-align-center zpbutton-align-mobile-center zpbutton-align-tablet-center"><style type="text/css"></style><a class="zpbutton-wrapper zpbutton zpbutton-type-primary zpbutton-size-md " href="javascript:;" target="_blank"><span class="zpbutton-content">Get Started Now</span></a></div>
</div></div></div></div></div></div> ]]></content:encoded><pubDate>Sun, 30 Aug 2026 22:17:59 +0530</pubDate></item><item><title><![CDATA[How experiments in AI influenced our understanding of the human brain]]></title><link>https://www.seekerofmeaning.in/blogs/post/manifestation-may-help-break-bad-habit-patterns1</link><description><![CDATA[I am currently reading Max Benett's &quot;A Brief History of Intelligence&quot; - which is profoundly engaging - in which Benett charts the major evol ]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_TPO-LeLXQ5eNfI4qF-IjVg" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_bwzm36aQRnSzCuxrTvq1NQ" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"></style><div data-element-id="elm_j3u-i3N6QCmbHz1hnRW5Ww" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"></style><div data-element-id="elm_EyhOxPewQwW58fsjLkhR4g" data-element-type="text" class="zpelement zpelem-text "><style></style><div class="zptext zptext-align-center zptext-align-mobile-center zptext-align-tablet-center " data-editor="true"><p style="text-align:left;"><span><span></span></span></p><p style="margin-bottom:12pt;"></p><div style="text-align:left;">I am currently reading Max Benett's &quot;A Brief History of Intelligence&quot; - which is profoundly engaging - in which Benett charts the major evolutionary breakthroughs in the development of intelligence. With each chapter, he offers fascinating insights on how intelligence, as we understand today, emerged over time, and in the process, draws parallels between human intelligence and that of AI. Consequently, he records the progress made so far with AI and highlights the pitfalls we may have fallen into in pursuit of achieving human-like intelligence.</div><span><div style="text-align:left;"><br/></div><div style="text-align:left;">The first breakthrough was steering - the ability to move towards a target (actively hunt), aided by bilateral symmetry. However, I'd like to discuss &quot;reinforcement learning&quot;, the second breakthrough in this post, because it underscores how experiments in AI have also influenced the study and understanding of the brain.</div><div style="text-align:left;"><br/></div><div style="text-align:left;">The relationship between AI and neuroscience is often imagined as a one-way street, where understanding the brain leads to the development of AI. But here is an example of how building machines helped scientists better understand the human brain. It’s an interesting story worth sharing.</div></span><p></p><h2 style="text-align:left;margin-bottom:8pt;"><span style="font-weight:700;">The second breakthrough : reinforcement learning</span></h2><p style="margin-bottom:12pt;"></p><div style="text-align:left;">After steering, the second breakthrough in our evolutionary history of intelligence was reinforcement learning, a capability developed by the first vertebrates. But first, what is RL?</div><span><div style="text-align:left;"><br/></div><div style="text-align:left;">You can define it in multiple ways, but at a basic level, reinforcement learning refers to an animal's tendency to pursue behaviors that lead to rewards and avoid behaviors that don’t based on <a href="https://www.21kschool.com/in/blog/trial-and-error-learning/"><span style="text-decoration:underline;">trial-and-error learning</span></a>. Scientists like Marvin Minsky and Edward Thorndike believed that this mechanism was fundamental to how humans and animals learn.</div></span><div style="text-align:left;"><br/></div><div style="text-align:left;">The hypothesis was simple - an animal is likely to repeat a behavior that produces a satisfying outcome, while not repeat a behavior that produces a discomforting outcome. Therefore, the behavior that leads to a reward gets reinforced (the animal learns to repeat it), while the behavior that doesn’t gets omitted.</div><p></p><p style="margin-bottom:12pt;"></p><div style="text-align:left;"><br/></div><span><div style="text-align:left;">As scientists developed AI systems, they believed they could rely on the same seemingly straightforward logic - an AI should strengthen behaviors that lead to rewards and weaken those that do not.</div><div style="text-align:left;"><br/></div><div style="text-align:left;">Minsky built SNARC, the world's&nbsp;<a href="https://medium.com/%40tharushi.cnnp/snarc-the-1951-machine-that-taught-itself-to-navigate-mazes-a5ddb6daddcc"><span style="text-decoration:underline;">first neural network</span></a> based on this principle. However, SNARC started failing miserably in completing even simple tasks or winning simple games. This left Minsky and other scientists of the day confused. Trial-and-error learning seemed intuitive and straightforward. Yet it was barely working in machines. However, they soon realized the problem.<br/><span style="color:rgb(17, 17, 17);font-family:&quot;Work Sans&quot;, sans-serif;font-size:28px;font-weight:700;">The temporal credit assignment problem</span><span style="color:rgb(17, 17, 17);font-family:&quot;Work Sans&quot;, sans-serif;font-size:28px;">&nbsp;</span></div></span><div style="text-align:left;">The challenge was in determining which behavior deserved credit or must be reinforced?</div><p></p><p style="text-align:left;margin-bottom:12pt;"><span><span style="font-weight:bold;">Note:</span> The author gives different examples in the book. I'll give a simple one.</span></p><p style="text-align:left;margin-bottom:12pt;"><span>Consider a dog that must perform a sequence of 7 actions before receiving a reward. It must first press a lever, then run through a tunnel, and perform several other actions before finally choosing the green ball over red to obtain a piece of chocolate.</span></p><p style="text-align:left;margin-bottom:12pt;"><span>Assume that the final action is reinforced - (dog picking the green ball over red), because it immediately preceded the reward. The dog would never have reached the final stage if it had not performed the earlier correctly.</span></p><p style="text-align:left;margin-bottom:12pt;"><span>For example, if the dog had not pressed the lever at the beginning, it might never have been able to enter the tunnel and complete the remaining steps. In that case, the first action was just as important as the last. If the first action is reinforced, then the dog will not learn the sequence of steps that led to the reward. Essentially, the reward is not the result of a single step executed correctly. It's the result of a sequence. So how should credit be distributed?</span></p><p style="text-align:left;margin-bottom:12pt;"><span>This became known as the temporal credit assignment problem: when a reward arrives after a long sequence of actions, how do we determine which actions deserve credit?</span></p><p style="text-align:left;margin-bottom:12pt;"><span>Scientists needed a way to assign value not only to the final behavior but also to the intermediary actions that made the reward possible.</span></p><h2 style="text-align:left;margin-bottom:8pt;"><span style="font-weight:700;">Richard Sutton's insight: temporal difference learning</span><span>&nbsp;</span></h2><p></p><div style="text-align:left;">To address this problem, Richard Sutton proposed a powerful idea that later became the foundation of reinforcement learning in AI.</div><span><div style="text-align:left;">Instead of reinforcing behaviors with actual rewards, what if you reinforced behaviors with predicted rewards?</div></span><p></p><p style="text-align:left;margin-bottom:12pt;"><span>In other words, an action should be rewarded not because it immediately produces a reward, but because it improves the system's prediction of a reward.</span></p><p style="text-align:left;margin-bottom:12pt;"><span>In the dog example, pressing the lever may not produce the chocolate directly. However, pressing the lever makes it possible for the dog to proceed to the next stage of the sequence. As a result, the probability of eventually obtaining the reward increases.</span></p><p style="text-align:left;margin-bottom:12pt;"><span style="font-style:italic;">Any action along the path that creates a positive change in the prediction of future reward should themselves be reinforced.</span></p><p style="text-align:left;margin-bottom:12pt;"><span>This was a significant departure from the prevailing view that rather than learning only from rewards, intelligent systems should learn from improvements in their expectations of future rewards.</span></p><h4 style="text-align:left;margin-bottom:4pt;"><span style="font-weight:700;">The actor-critic framework</span><span>&nbsp;</span></h4><p style="text-align:left;margin-bottom:12pt;"><span>To illustrate the point, Sutton alongside his colleague Andrew Barto and P. Anderson, proposed the modern computational actor-critic framework</span></p><p style="text-align:left;margin-bottom:12pt;"><span>In this framework, two components work together:</span></p><ul><li><p style="text-align:left;"><span>The actor selects actions.</span></p></li><li><p style="text-align:left;margin-bottom:12pt;"><span>The critic evaluates those actions and provides feedback.</span></p></li></ul><p style="text-align:left;margin-bottom:12pt;"><span>When an action improves the prediction of future reward, the critic generates positive feedback. The actor then becomes more likely to choose the same actions in the future (positive reinforcement).</span></p><p style="text-align:left;margin-bottom:12pt;"><span>Conversely, when an action reduces the likelihood of obtaining a reward, the critic generates negative feedback, causing the actor to avoid the same actions (negative reinforcement).This framework provided a practical solution to the credit assignment problem and became one of the foundational ideas in reinforcement learning in machines.</span></p><p style="text-align:left;margin-bottom:12pt;"><span>But the question remained: Is that how the human brain actually works? At the time, nobody knew the answer.</span></p><h2 style="text-align:left;margin-bottom:8pt;"><span style="font-weight:700;">Testing the theory: Dopamine and learning</span><span>&nbsp;</span></h2><p style="text-align:left;"><span>While Sutton had hoped there was a connection between his idea and the brain, it was Peter Dayan, one of his colleagues, who found it. Peter Dayan and his colleague Read Montague were convinced that the brain implemented some form of temporal difference learning mechanism.</span></p><p style="margin-bottom:12pt;"></p><div style="text-align:left;">To investigate this, they turned their attention to Dopamine.&nbsp;</div><span><div style="text-align:left;"><br/></div><div style="text-align:left;">At the time, even now in popular conversations, dopamine was generally understood as a reward or pleasure molecule. Researchers knew that dopamine activity increased when animals received rewards, so it seemed natural to associate dopamine with pleasure.</div></span><p></p><p style="text-align:left;margin-bottom:12pt;"><span>However, experiments revealed something much more interesting. Read wolfram </span><a href="https://gruber.yale.edu/recipient/wolfram-schultz#:%7E:text=In%20a%20series%20of%20experiments%2Ccells%20to%20release%20the%20neurotransmitter."><span style="text-decoration:underline;">schultz’s experiments</span></a><span> on macaque monkeys<br/></span></p><p style="text-align:left;margin-bottom:12pt;"><span><span style="font-weight:bold;">Note:</span> Again, not giving the example from the book my own example.</span></p><p style="text-align:left;margin-bottom:12pt;"><span>Consider a dog that hears a bell before receiving a piece of chocolate. Initially, the dog has not learned the association between the bell and the reward. When the dog receives the chocolate, dopamine neurons exhibit a strong burst of activity.</span></p><p style="text-align:left;margin-bottom:12pt;"><span>But after repeated trials, something unexpected happens.</span></p><p style="text-align:left;margin-bottom:12pt;"><span style="font-style:italic;">The dopamine burst gradually shifts from the reward itself to the cue that predicts the reward. Eventually, the strongest dopamine response occurs when the bell rings, not when the chocolate arrives.</span></p><p style="text-align:left;margin-bottom:12pt;"><span style="font-style:italic;">This led scientists to an important insight: dopamine is not merely a reward signal. Instead, it functions as a learning signal, encoding what researchers call a reward prediction error, the difference between expected and actual outcomes.</span></p><p style="margin-bottom:12pt;"></p><div style="text-align:left;">The dopamine responses align exactly with Sutton’s temporal difference learning signal. In other words, dopamine helps the brain learn whether the world is better or worse than expected.</div><span><div style="text-align:left;"><br/></div><div style="text-align:left;">Ok, the critic has been found. But who is the actor?</div><div style="text-align:left;"><br/></div></span><p></p><h2 style="text-align:left;"><span style="font-weight:700;">Dopamine as the Critic and the Basal Ganglia as the Actor</span></h2><span><div style="text-align:left;">The basal ganglia is the seat of habits, which are automated motor responses or myelin sheaths (proteins+lipids) . Through repeated feedback from dopamine-based learning signals, it gradually strengthens behaviors that increase the likelihood of future rewards and weaken behaviors that do not.</div></span><p></p><p style="text-align:left;margin-bottom:12pt;"><span>So in this framework:</span></p><ul><li><p style="text-align:left;"><span>Dopamine systems act as the critic, evaluating outcomes and generating learning signals when expectations change.</span></p></li><li><p style="text-align:left;margin-bottom:12pt;"><span>The basal ganglia acts as the actor, selecting and reinforcing actions based on those signals.</span></p></li></ul><h2 style="text-align:left;margin-bottom:4pt;"><span style="font-weight:700;">Conclusion</span></h2><p style="text-align:left;margin-bottom:12pt;"><span>There’s no larger purpose behind sharing this article. Like me, I am sure many of you get excited when you read something quite fascinating. The idea for this post stemmed from such a sense of fascination. With AI becoming such a central part of our everyday lives, I found it interesting to read a small part of the history behind its development.</span></p><p style="text-align:left;margin-bottom:12pt;"><span>We often think of neuroscience inspiring AI. In this case, however, AI research helped scientists formulate hypotheses about how the brain might solve a fundamental learning problem.</span></p><p style="text-align:left;margin-bottom:12pt;"><span>In other words, an idea developed to improve machines ended up revealing something about our brains. How exciting!!</span></p><p></p></div>
</div></div></div></div></div></div> ]]></content:encoded><pubDate>Mon, 29 Jun 2026 13:07:13 +0530</pubDate></item><item><title><![CDATA[Manifestation may help break bad habit patterns]]></title><link>https://www.seekerofmeaning.in/blogs/post/manifestation-may-help-break-bad-habit-patterns</link><description><![CDATA[I was listening to Raj Shamani's podcast with Dr. Vidita Vaidya , Neuroscientist, TIFR Mumbai,&nbsp;recently, and one particular segment where Raj ques ]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_KE19SRzLTDSOzgMnRNQJng" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_AvndnSbrQpmxDAtzeOcalA" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"></style><div data-element-id="elm_RP0cjliYQti_n6XnT-2ixg" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"></style><div data-element-id="elm_CVTjoQ7z39-0FCJR85HFKA" data-element-type="text" class="zpelement zpelem-text "><style></style><div class="zptext zptext-align-left zptext-align-mobile-left zptext-align-tablet-left " data-editor="true"><p></p><div><p>I was listening to Raj Shamani's podcast with <a href="https://en.wikipedia.org/wiki/Vidita_Vaidya" rel="noreferrer" target="_blank"><span style="font-style:inherit;font-weight:inherit;">Dr. Vidita Vaidya</span></a>, Neuroscientist, TIFR Mumbai,&nbsp;recently, <br/>and one particular segment where Raj questions Dr Vaidya on social media addiction stood out for me. <br/>I think it's somewhere around <a href="https://www.youtube.com/watch?v=lacFcgcHx6I" rel="noreferrer" target="_blank"><span style="font-style:inherit;font-weight:inherit;">1:37.25 to 1.45.<br/></span></a><br/>Raj asks a very relatable question: (paraphrasing) <br/><br/>&quot;Why do so many people scroll endlessly through social media, regret it before going to bed, and then repeat the same behavior the next day? What happened to their willpower?&quot;<br/><br/>Dr. Vaidya then goes on to explain that many addictive behaviors, whether social media scrolling, gambling, substance abuse, or even certain everyday compulsions, are driven by the brain's reward circuitry - same underlying circuits involved in food, sex etc - involving dopamine and the basal ganglia. <br/><br/>Raj subsequently asks how one can break away from such entrenched bad habit patterns. To that, her suggestion is that we learn new things, do the hard things, and delay gratification. In her view, novelty and hard work can help disrupt entrenched habit loops.<br/><br/>As I was listening, I couldn't help but be reminded of <br/>Max Benett's &quot;A Brief History of Intelligence&quot;, where Bennett discusses a wide array of topics from habit formation, goal-seeking behaviour, to exercising will-power and self-control.&nbsp;(BTW, it's a mind-blowing book that'll introduce you to an enormous range of concepts in <br/>biology, evolution, brain science, and AI. I found it extremely fascinating)<br/><br/>In one of the chapters, Bennett discusses the role of dopamine in affecting reward-seeking behaviours and basal ganglia in solidifying these behaviours into habits. <span style="font-style:inherit;font-weight:inherit;">In essence, habits are semi-automated behavioural programs formed through reinforcement (repeated actions), mediated by the basal ganglia and dopamine-based reward signaling. </span>Therefore, when a behaviour becomes a habit, it works on autopilot, in a way, requiring less effort/brain power. (That's when we call something a habit in the first place, right?)</p><p><br/>Now, circling back to Raj's question to Dr. Vaidya,<br/> when an addictive behaviour becomes a habit, how does one break away from it?<br/><br/>I mentioned Dr Vaidya's response above. However, Benett's discussion on self-control and willpower offers deeper insights into the above question. While he does not explicitly discuss addiction or breaking away from addictive behaviours, <em style="font-weight:inherit;">his explanation of the neuroscience of willpower and the role of the neocortex (a specialized region in mammals) and its relationship to basal ganglia and amygdala offers the clue.</em>&nbsp;<br/><br/></p><h2><span style="font-style:inherit;font-weight:700;"><span style="font-style:inherit;font-weight:inherit;">Neocortex, basal ganglia, amygdala</span></span></h2><span style="font-style:inherit;font-weight:inherit;">The neocortex (prefrontal cortex in particular) </span><a href="https://pmc.ncbi.nlm.nih.gov/articles/PMC8617292/" rel="noreferrer" target="_blank"><span style="font-style:inherit;font-weight:inherit;">functions as the brain's executive leader</span></a><span style="font-style:inherit;font-weight:inherit;">. </span><br/><span style="font-style:inherit;font-weight:inherit;">It regulates systems such as the basal ganglia, primarily responsible for habit formation, and the amygdala,&nbsp;primarily responsible for processing emotions. </span><br/><br/><span style="font-style:inherit;font-weight:inherit;">This relationship is similar to that of a boss and his team in a corporate setting. Routine tasks are handled by employees without constant / minimal supervision (amygdala &amp; basal ganglia). However, when an important strategic decision needs to be made, the boss steps in and </span><br/><span style="font-style:inherit;font-weight:inherit;">provides direction or </span><em style="font-weight:inherit;"><span style="font-style:inherit;font-weight:inherit;">has the power to change an established process.</span></em><span style="font-style:inherit;font-weight:inherit;">&nbsp;(Obviously, I am simplifying a lot; but the point is valid)</span><br/><br/>Now, carefully follow the line of thought.&nbsp;Benett argues that, <br/><span style="font-style:inherit;font-weight:bold;">Attention, Working Memory, Self-control (often referred to as willpower), Planning are all different applications of the brain and are triggered by neocortical stimulation.</span><span style="font-style:inherit;font-weight:700;"></span>The prefrontal cortex -particularly the agranular prefrontal cortex (aPFC), plays a key role in executing all of the above functions in mammals. <br/><br/><span style="font-style:inherit;font-weight:bold;">Here's the key point: <span style="font-style:inherit;">Internal simulation - through imagination, visualization, or manifestation - is a form of neocortical stimulation (activates the aPFC).</span></span><p></p><p>&nbsp;<br/><span style="font-style:inherit;font-weight:inherit;">What this proves is manifestation plays a key role in self-control and can influence behaviour.</span><br/><br/><span style="font-style:inherit;font-weight:inherit;">When people talk about manifestation, they often focus on outcomes - manifesting a house, a car, a job, or moving abroad etc. </span><br/><span style="font-style:inherit;font-weight:inherit;">Many tend to think that if one simply visualizes these outcomes, the universe will somehow conspire to make them happen.</span><br/><span style="font-style:inherit;font-weight:inherit;">I am not ridiculing those who practice manifestation in the above manner. </span><em style="font-weight:inherit;"><span style="font-style:inherit;font-weight:inherit;">But it appears to me that the true power of manifestation lies in its ability to direct behaviour not in promising outcomes. </span></em><br/><br/><span style="font-style:inherit;font-weight:inherit;">The question now is, </span><br/><span style="font-style:inherit;font-weight:inherit;">What does one manifest in the context of breaking away from an addictive behaviour? It's logical to manifest an &quot;alternate behaviour&quot;, which is perhaps optimised for dopamine. </span><br/><br/><span style="font-style:inherit;font-weight:inherit;">Here's a para from the book to support my hypothesis, </span></p><blockquote><p style="font-style:inherit;font-weight:inherit;"><br/><span style="color:rgb(234, 119, 4);"><span style="font-style:inherit;font-weight:inherit;">&quot;How does the aPFC &quot;control&quot; behaviour? The idea presented here is that it doesn't control behaviour per se; it tries to convince the basal ganglia of the right choice by </span><em style="font-weight:inherit;"><span style="font-style:inherit;font-weight:inherit;">&quot;vicariously showing&quot; it that one choice is better</span></em><span style="font-style:inherit;font-weight:inherit;"> and by filtering what information makes it to the basal ganglia. </span><em style="font-weight:inherit;"><span style="font-style:inherit;font-weight:inherit;">The aPFC controls behaviour not by telling but showing.&quot;</span></em><br/><span style="font-style:inherit;font-weight:inherit;">[emphasis added]&nbsp;</span><br/></span></p><p style="font-style:inherit;font-weight:inherit;"><span style="font-style:inherit;font-weight:inherit;color:rgb(234, 119, 4);">Pg 218 &quot;How Mammals Control Themselves: Attention, Working Memory, and Self-control&quot;</span></p></blockquote><p><br/><span style="font-style:inherit;font-weight:inherit;">From a neuroscience perspective, repeated visualisation of a behaviour </span><a href="https://www.aiu.edu/innovative/the-true-power-of-visualization/" rel="noreferrer" target="_blank"><span style="font-style:inherit;font-weight:inherit;">strengthens the neural representations</span></a><span style="font-style:inherit;font-weight:inherit;"> associated with those behaviours, making it easier for the brain to execute them in real life. </span><br/><br/></p><h2><span style="font-style:inherit;font-weight:700;"><span style="font-style:inherit;font-weight:inherit;">How could this potentially work - my hypothesis</span></span></h2>When the cue appears, eliciting a particular bad habit, manifesting the new behavior is the smart thing to do.<br/>It does not indicate it'd be possible to execute the new behavior initially, given that the old one has solidified into a habit. <br/>In fact, it's likely that one will fail many times at first. However, by repeatedly manifesting the new behavior, strengthening its neural representation, and gradually associating it with the cue, one can eventually enable the basal ganglia to express the new behavior. <p></p><p>I like to think of it as a vote. Every time the cue appears and you resist executing the old behavior, the brain negatively reinforces that old behavior. Every time you execute the new behavior, the brain positively reinforces it. As the new behavior accumulates enough &quot;votes,&quot; it eventually surpasses a certain threshold, making it more likely to be expressed whenever that particular cue appears.<br/><br/>G<span style="font-style:inherit;font-weight:inherit;">iven that the neocortex regulates systems such as the basal ganglia and the amygdala, I believe manifestation</span><br/><span style="font-style:inherit;font-weight:inherit;"> can help people break away from unhealthy habit patterns and develop healthier ones.</span><br/><br/><span style="font-style:inherit;font-weight:inherit;">As an aside, here's my picture, taken a few months ago, with Dr. Vidita Vaidya at IIT Madras, post her lecture on Neurobiology. After the session, she was kind enough to interact with me and a bunch of aspirig scientists from IIT Madras on various topics. She encouraged me </span><br/><span style="font-style:inherit;font-weight:inherit;">to start a podcast and even agreed to appear as a guest :) </span><br/><img src="/Vidita%20Vaidya.jpeg"/></p></div><p></p></div>
</div></div></div></div></div></div> ]]></content:encoded><pubDate>Mon, 29 Jun 2026 13:07:12 +0530</pubDate></item></channel></rss>