Skip to main content

Your Optimistic Bias won't Allow Your Estimate to Improve

When asked, many people wish to get better at estimation by tracking actuals and then assuming that some form of reflection upon those actuals will lead to better estimation.  I've long held a belief that it doesn't happen quite so simply in reality.  There are many assumptions in that proposal that are just glossed over.   Let's list a few (just for fun):  Actuals are accurate and precise representations, time will be allotted to reflections and learning,  people (teams of people) will all arrive at similar conclusions and learn from the reflection of estimate not equal to actual, future behavior will change significantly and quickly, among other assumptions.



Well finally science has something to say about this.  A study: "How unrealistic optimism is maintained in the face of reality" by Tali Sharot, Christoph W Korn & Raymond J Dolan published in Nature Neuroscience (2011) has some fMRI proof that these behaviors are hard to change.

In the study the authors find:
"Unrealistic optimism is a pervasive human trait that influences domains ranging from personal relationships to politics and finance. How people maintain unrealistic optimism, despite frequently encountering information that challenges those biased beliefs, is unknown. We examined this question and found a marked asymmetry in belief updating. Participants updated their beliefs more in response to information that was better than expected than to information that was worse. This selectivity was mediated by a relative failure to code for errors that should reduce optimism. Distinct regions of the prefrontal cortex tracked estimation errors when those called for positive update, both in individuals who scored high and low on trait optimism. However, highly optimistic individuals exhibited reduced tracking of estimation errors that called for negative update in right inferior prefrontal gyrus. These findings indicate that optimism is tied to a selective update failure and diminished neural coding of undesirable information regarding the future."
So, is this scientific challenge to your ability to get better at estimation enough for you to quit tracking actual time spent on stories/tasks?  The evidence is that your bias will keep you from learning except in the cases that prove you are faster/better/more awesome than you estimated you were.  Which leads many managers to decide that there teams are sand-bagging and just not as good as "we were in the older days," a different human behavior to study.

See Also:
Estimates? We Don’t Need No Stinking Estimates!
"How a hashtag (#NoEstimates) lit the nerdy world of project management aflame — or at least got it mildly worked up." A nice summary of the dust-up.  Imagine if the tag would have been #LeanEstimates?

The #NoEstimates blog by Woody Zuill

Your Brain won't allow you to Believe the Apocalypse could actually happen

Why your Agile Teams are Bad at Estimating - by Heidi Araya

The planning fallacy, first proposed by Daniel Kahneman and Amos Tversky in 1979, is a phenomenon in which predictions about how much time will be needed to complete a future task display an optimism bias (underestimate the time needed).





Comments

Most Popular on Agile Complexification Inverter

Exercise:: Definition of Ready & Done

Assuming you are on a Scrum/Agile software development team, then one of the first 'working agreements' you have created with your team is a 'Definition of Done' - right?



Oh - you don't have a definition of what aspects a user story that is done will exhibit. Well then, you need to create a list of attributes of a done story. One way to do this would be to Google 'definition of done' ... here let me do that for you: http://tinyurl.com/3br9o6n. Then you could just use someone else's definition - there DONE!

But that would be cheating -- right? It is not the artifact - the list of done criteria, that is important for your team - it is the act of doing it for themselves, it is that shared understanding of having a debate over some of the gray areas that create a true working agreement. If some of the team believes that a story being done means that there can be no bugs found in the code - but some believe that there can be some minor issues - well, then yo…

Do You Put “CSM” After Your Name?

I’ve noticed a new trend—people have been gaining titles. When I was younger, only doctors had initials (like MD) after their names. I always figured that was because society held doctors, and sometime priests (OFM) in such high regard that we wanted to point out their higher learning. I hope it was to encourage others to apply themselves in school and become doctors also. Could it have been boastful?

The Wikipedia describes these “post-nominal initials”:
Post-nominal letters, also called post-nominal initials, are letters placed after the name of a person to indicate that the individual holds a position, educational degree, accreditation, office, or honor. An individual may use several different sets of post-nominal letters. The order in which these are listed after a name is based on the order of precedence and category of the order. That’s good enough for me.
So I ask you: is the use of CSM or CSP an appropriate use of post-nominal initials?
If your not an agilista, you may wonder …

David's notes on "Drive"

- "The Surprising Truth about what Motivates Us" by Dan Pink.

Amazon book order
What I notice first and really like is the subtle implication in the shadow of the "i" in Drive is a person taking one step in a running motion.  This brings to mind the old saying - "there is no I in TEAM".  There is however a ME in TEAM, and there is an I in DRIVE.  And when one talks about motivating a team or an individual - it all starts with - what's in it for me.

Introduction

Pink starts with an early experiment with monkeys on problem solving.  Seems the monkeys were much better problem solver's than the scientist thought they should be.  This 1949 experiment is explained as the early understanding of motivation.  At the time there were two main drivers of motivation:  biological & external influences.  Harry F. Harlow defines the third drive in a novel theory:  "The performance of the task provided intrinsic reward" (p 3).  This is Dan Pink's M…

Agile Story Estimation via Dog Grooming Exercise

Practice story estimation techniques with this exercise in dog grooming.

Related Post:
Affinity Estimating: A How-To by Sterling Barton.
Dogfood David why I feel like an expert in the concept of eating one's own dogfood.
   Slideshare:  Affinity Estimation - Size 60 Stories in about 20 Minutes.
For each dog below, estimate the work effort (size) required to groom the dog.  Assuming that you have the tools and experience to groom dogs.  Grooming includes washing, drying, combing, nail clipping, and hair triming in some cases.


Start with the ever popular:
Golden Retriever (22-24 in, 50-90 lbs).




The short haired Dachshund (15-28 lbs).



The Standard Poodle (15-18in, 40-80 lbs).




Bernese Mountain Dog (25-28 in., 65-120 lbs).




German Shepherd (23-26 in, 50-90 lbs).



Yorkshire terrier (5 in, <10 lbs).




Beagle (13-16 in, 18-35 lbs).



Boxer (26-31 in, 55-110 lbs).




Bulldog (40-55 lbs).





Labrador Retriever (21-25 in, 55-130 lbs).





Great Dane (28-38 in, 120-200 lbs).




Komondor (25-32 in, 90-130 lbs).


Situational Leadership II Model & Theory

Have you ever been in a situation where you thought the technique needed to move forward was one thing, yet the person leading (your leader) assumed something else was what was needed?  Did you feel misaligned, unheard, marginalized?  Would you believe that 54% of all leaders only use ONE style of leadership - regardless of the situation?  Does that one style of leading work well for the many levels of development we see on a team?

Perhaps your team should investigate one of the most widely used leadership models in the world ("used to train over 5 million managers in the world’s most respected organizations").  And it's not just for the leaders.  The training is most effective when everyone receives the training and uses the model.  The use of a ubiquitous language on your team is a collaboration accelerator.  When everyone is using the same mental model, speaking the same vernacular hours of frustration and discussion may be curtailed, and alignment achieved, outcomes …