Editing 1827: Survivorship Bias

Jump to: navigation, search

Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
Latest revision Your text
Line 4: Line 4:
 
| title    = Survivorship Bias
 
| title    = Survivorship Bias
 
| image    = survivorship_bias.png
 
| image    = survivorship_bias.png
| titletext = They say you can't argue with results, but what kind of defeatist attitude is that? If you stick with it, you can argue with ANYTHING.
+
| titletext = They say you can't argue with results, but what kind of defeatest attitude is that? If you stick with it, you can argue with ANYTHING.
 
}}
 
}}
  
 
==Explanation==
 
==Explanation==
This comic is a parody of entrepreneurial speeches. Entrepreneurial speeches are talks, such as graduation commencements or motivational speeches. The idea behind graduation commencements is that the entrepreneur, having accumulated wisdom and experience in the process of becoming successful, will share his insights and experience to the students, in the hope that they learn lessons that will help them achieve success as well. Companies hire motivational speakers to motivate employees to work hard.
+
{{incomplete|More on SsB. Title text not explained.}}
 +
This comic is a parody of entrepreneurial speeches. Entrepreneurial speeches are talks, delivered by successful entrepreneurs to students during an important event, like graduation. The idea behind these talks is that the entrepreneur, having accumulated wisdom and experience in the process of becoming successful, will share his insights and experience to the students, in the hope that they learn lessons that will help them achieve success as well.
  
A common theme in these talks is that the entrepreneur succeeded by persisting through hardship, sometimes despite other people telling them they would be better off giving up. They advise students to do the same, and to keep pursuing their dreams even through subsequent failure. Their message can be highlighted by demonstrating such successes by visual props such as the medals they won, or images of their encounters with other notably famous people. While this isn't necessarily bad business advice, this can give students a biased vision of reality, and lead them to imagine that they will succeed as long as they keep trying.
+
A common theme in these talks is that the entrepreneur succeeded by persisting through hardship, sometimes despite other people telling them they would be better off giving up. They advise students to do the same, and to keep pursuing their dreams even through subsequent failure. While this isn't necessarily bad business advice, this can give students a biased vision of reality, and lead them to imagine that they will succeed as long as they keep trying.
  
As the title and caption both suggest, a major problem with these speeches is {{w|survivorship bias}}. Survivorship bias refers to an issue in statistical analysis where a significant portion of potential cases aren't available to be counted, and therefore aren't included in the statistics, which creates a data set which is biased toward the cases that are counted. In this case, the people who are invited to and willing to give such speeches are overwhelmingly people who achieved success. People who are unsuccessful tend not to be highlighted or publicized, even if they followed the same path and made the same efforts as those who became successful.  This is especially important because achieving success usually involves taking risks. If those risks pay off and result in success, a person will often be lauded as an example of achievement, but if the risk doesn't pay off, they'll often be ignored. This can result in a skewed view of how certain risks are to result in positive outcomes.  
+
This comic makes a joke about survivorship bias, hence the title. {{w|Survivorship bias}}, or survival bias, is the logical error of concentrating on the people or things that "survived" some process and inadvertently [[#Trivia|overlooking those]] that did not because of their lack of visibility. This can lead to false conclusions in several different ways. The survivors may be actual people, as in a medical study, or could be companies or research subjects or applicants for a job, or anything that must make it past some selection process to be considered further.
  
To parody this concept, the comic shows [[Hairy]] encouraging people to "never stop buying {{w|lottery}} tickets", and surrounded by bags of money to 'flex' their (eventual) financial success, This is an terribly unwise investment plan, because the chances of winning large jackpots are mathematically very low, even if a person buys huge numbers of tickets. With very few exceptions, people who play the lottery lose far more money than they win. But, because of the existence very large jackpots, a few people will win enough money to become genuinely wealthy. If our only exposure to lottery players is someone who won a major jackpot, it could give a false impression that continually buying tickets is a good strategy, when in reality, the odds are astronomical against making money that way. In the same way, talks from people who took risks and became successful can give us a false impression about the likelihood of success in any other field of endeavor.  
+
In this comic [[Hairy]] is giving a talk encouraging people to "never stop buying {{w|lottery}} tickets". This is an unwise investment plan, because the chances of winning the lottery are mathematically very low and the total payout is usually less than the total ticket sales, meaning the expected return from buying a lottery ticket is ([[#Trivia|almost]]) always negative. Survivorship bias applies in this situation since people who eventually win (and, presumably, win more than they've spent on lottery tickets in the time that it took them to win) are much more likely to give inspirational speeches than someone who never won or didn't win enough to make the "investment" worthwhile.
  
The title text continues the humor by taking two common aspects of inspirational speeches. One is the claim that "you can't argue with success", suggesting that advice from successful people must inherently be good. The other is that "if you stick with it, you can [do] anything". Randall plays those two off one another, since one is a claim of what you can't do, and the other insists that there's nothing you can't do.
+
The obvious bad strategy (keep buying lottery tickets) is a metaphor for strategies that successful entrepreneurs recommend (keep persisting and putting money into your start-up); these strategies may be bad on average, but people who pursued them and succeeded are much more likely to be invited and give speeches than people who pursued them and went bankrupt (or people who pursued safer strategies and kept their money), making it appear to students that taking high risks and persisting in the face of expensive failure is the optimal strategy.
 +
 
 +
[[Randall]] says in the caption below the panel that people should be informed about survivorship bias before hearing inspirational talks from successful people.
 +
 
 +
The title text says "They say you can't argue with results, but what kind of defeatist attitude is that?  If you stick with it, you can argue with ANYTHING."  In the comic, the speaker's "result" was winning the lottery. Pointing out the survivorship bias is Randall effectively arguing with results, by pointing out that they were obtained randomly, and that it ignores all the other people who may have (foolishly) followed this same process, but never won the lottery.  Taken a step further, one could use the survivorship bias to argue against the results of any process, be it research (Any given research process is bound to produce SOME good results, and since those are the only ones published, it is difficult to determine if the research process itself contributed to the good results), business decisions (Some businesses fail, and others succeed, but since only the successful ones stick around, it can be difficult to determine WHY they failed or succeeded), etc..
  
 
==Transcript==
 
==Transcript==
Line 29: Line 34:
 
==Trivia==
 
==Trivia==
 
*Lottery with '''positive return''':
 
*Lottery with '''positive return''':
**When item prizes are donated to a lottery (for charity or advertising purposes), sometimes the value of those items may actually be larger than the total price for all of the lottery tickets, if you otherwise would be willing to pay full price for all the prizes.
+
**When item prices are donated to a lottery (for charity or advertising purposes), sometimes the value of those items may actually be larger than the total price for all of the lottery tickets, if you otherwise would be willing to pay full price for all the prizes.
**In some lotteries, if the jackpot gets too big -- or goes for too many drawings -- without anyone winning it, the jackpot amount gets "rolled down" and distributed across the lower prize levels.  These can have a positive return on average -- but ''only'' on the drawings where the jackpot rolls down.  People have formed investment groups to buy hundreds of thousands of tickets to exploit these; several such groups repeatedly profited from Massachusetts's {{w|Massachusetts_Lottery#Cash Winfall|Cash WinFall}} game especially.  (The Massachusetts State Lottery has an official report ([http://www.mass.gov/ig/publications/reports-and-recommendations/2012/lottery-cash-winfall-letter-july-2012.pdf PDF, 144 KB]) on how such high-volume betting affected the game.)
 
 
*'''Examples''' of survivorship bias:
 
*'''Examples''' of survivorship bias:
**Diogenes was shown paintings of people who had escaped shipwreck: "Look, you who think the gods have no care of human things, what do you say to so many persons preserved from death by their especial favour?", to which he replied: "Why, I say that their pictures are not here who were cast away, who are by much the greater number."
+
**Almost {{w|Public Health Cigarette Smoking Act|everyone was smoking}} back in the 1930-70s,{{Citation needed}} thus everyone above 80 probably smoked cigarettes or was at least subjected to passive smoking. Thus anyone above that age could be claimed to prove that you can live a long life while smoking. But they consist of the small group of people that survived in spite of all the smoke, where large sections of those that would have been 80 today, died from cancer or heart disease caused by smoking, long ago, maybe even before they retired. But since these people are dead and gone many years ago, they do not speak up, and are thus the silent majority that is not heard, which is the problem with survivorship bias.
**Many people {{w|Public Health Cigarette Smoking Act|were smoking}} back in the 1930-70s, thus almost everyone above 80 either smoked cigarettes or was at least subjected to massive passive smoking during those years. Thus anyone above that age could be claimed to prove that you can live a long life while smoking. But they consist of the small group of people that survived in spite of all the smoke, where large sections of those that would have been 80 today, died from cancer or heart disease caused by smoking, long ago, maybe even before they retired. But since these people are dead and gone many years ago, they do not speak up,{{Citation needed}} and are thus the silent majority that is not heard, which is the problem with survivorship bias.
 
 
**During World War II, there was a study of the damage done to aircraft, and the recommendation was to add armor to the areas that showed the most damage. The statistician {{w|Abraham Wald}} noticed that the study didn't take into account aircraft that ''didn't'' return: the holes in the returning aircraft thus represented areas where a bomber could take damage and still return home safely.
 
**During World War II, there was a study of the damage done to aircraft, and the recommendation was to add armor to the areas that showed the most damage. The statistician {{w|Abraham Wald}} noticed that the study didn't take into account aircraft that ''didn't'' return: the holes in the returning aircraft thus represented areas where a bomber could take damage and still return home safely.
**Anything created by an Earth-human in this universe.  We think it's because we're special, rather than being special because we're here/we survived.
 
*In the title text, "defeatist" was originally misspelled as "defeatest". This was later corrected.
 
  
 
{{comic discussion}}
 
{{comic discussion}}
Line 43: Line 44:
 
[[Category:Science]]
 
[[Category:Science]]
 
[[Category:Public speaking]]
 
[[Category:Public speaking]]
[[Category:Cognitive Bias]]
 

Please note that all contributions to explain xkcd may be edited, altered, or removed by other contributors. If you do not want your writing to be edited mercilessly, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource (see explain xkcd:Copyrights for details). Do not submit copyrighted work without permission!

To protect the wiki against automated edit spam, we kindly ask you to solve the following CAPTCHA:

Cancel | Editing help (opens in new window)