Editing 1827: Survivorship Bias
Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.
The edit can be undone.
Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 8: | Line 8: | ||
==Explanation== | ==Explanation== | ||
− | This comic is a parody of entrepreneurial speeches. Entrepreneurial speeches are talks, | + | {{incomplete|More on SsB. Title text not explained.}} |
+ | This comic is a parody of entrepreneurial speeches. Entrepreneurial speeches are talks, delivered by successful entrepreneurs to students during an important event, like graduation. The idea behind these talks is that the entrepreneur, having accumulated wisdom and experience in the process of becoming successful, will share his insights and experience to the students, in the hope that they learn lessons that will help them achieve success as well. | ||
− | A common theme in these talks is that the entrepreneur succeeded by persisting through hardship, sometimes despite other people telling them they would be better off giving up. They advise students to do the same, and to keep pursuing their dreams even through subsequent failure | + | A common theme in these talks is that the entrepreneur succeeded by persisting through hardship, sometimes despite other people telling them they would be better off giving up. They advise students to do the same, and to keep pursuing their dreams even through subsequent failure. While this isn't necessarily bad business advice, this can give students a biased vision of reality, and lead them to imagine that they will succeed as long as they keep trying. |
− | + | This comic makes a joke about survivorship bias, hence the title. {{w|Survivorship bias}}, or survival bias, is the logical error of concentrating on the people or things that "survived" some process and inadvertently [[#Trivia|overlooking those]] that did not because of their lack of visibility. This can lead to false conclusions in several different ways. The survivors may be actual people, as in a medical study, or could be companies or research subjects or applicants for a job, or anything that must make it past some selection process to be considered further. | |
− | + | In this comic [[Hairy]] is giving a talk encouraging people to "never stop buying {{w|lottery}} tickets". This is an unwise investment plan, because the chances of winning the lottery are mathematically very low and the total payout is usually less than the total ticket sales, meaning the expected return from buying a lottery ticket is ([[#Trivia|almost]]) always negative. Survivorship bias applies in this situation since people who eventually win (and, presumably, win more than they've spent on lottery tickets in the time that it took them to win) are much more likely to give inspirational speeches than someone who never won or didn't win enough to make the "investment" worthwhile. | |
− | The | + | The obvious bad strategy (keep buying lottery tickets) is a metaphor for strategies that successful entrepreneurs recommend (keep persisting and putting money into your start-up); these strategies may be bad on average, but people who pursued them and succeeded are much more likely to be invited and give speeches than people who pursued them and went bankrupt (or people who pursued safer strategies and kept their money), making it appear to students that taking high risks and persisting in the face of expensive failure is the optimal strategy. |
+ | |||
+ | [[Randall]] says in the caption below the panel that people should be informed about survivorship bias before hearing inspirational talks from successful people. | ||
+ | |||
+ | The title text says "They say you can't argue with results, but what kind of defeatist attitude is that? If you stick with it, you can argue with ANYTHING." In the comic, the speaker's "result" was winning the lottery. Pointing out the survivorship bias is Randall effectively arguing with results, by pointing out that they were obtained randomly, and that it ignores all the other people who may have (foolishly) followed this same process, but never won the lottery. Taken a step further, one could use the survivorship bias to argue against the results of any process, be it research (Any given research process is bound to produce SOME good results, and since those are the only ones published, it is difficult to determine if the research process itself contributed to the good results), business decisions (Some businesses fail, and others succeed, but since only the successful ones stick around, it can be difficult to determine WHY they failed or succeeded), etc.. | ||
==Transcript== | ==Transcript== | ||
Line 29: | Line 34: | ||
==Trivia== | ==Trivia== | ||
*Lottery with '''positive return''': | *Lottery with '''positive return''': | ||
− | **When item | + | **When item prices are donated to a lottery (for charity or advertising purposes), sometimes the value of those items may actually be larger than the total price for all of the lottery tickets, if you otherwise would be willing to pay full price for all the prizes. |
− | **In some lotteries, if the jackpot gets too big -- or goes for too many drawings -- without anyone winning it, the jackpot amount gets "rolled down" and distributed across the lower prize levels. These can have a positive return on average -- but ''only'' on the drawings where the jackpot rolls down. People have formed investment groups to buy hundreds of thousands of tickets to exploit these; several such groups repeatedly profited from Massachusetts's {{w|Massachusetts_Lottery#Cash Winfall|Cash WinFall}} game especially. (The Massachusetts State Lottery has an official report ([http://www.mass.gov/ig/publications/reports-and-recommendations/2012/lottery-cash-winfall-letter-july-2012.pdf PDF, 144 KB]) on | + | **In some lotteries, if the jackpot gets too big -- or goes for too many drawings -- without anyone winning it, the jackpot amount gets "rolled down" and distributed across the lower prize levels. These can have a positive return on average -- but ''only'' on the drawings where the jackpot rolls down. People have formed investment groups to buy hundreds of thousands of tickets to exploit these; several such groups repeatedly profited from Massachusetts's {{w|Massachusetts_Lottery#Cash Winfall|Cash WinFall}} game especially. (The Massachusetts State Lottery has an official report ([http://www.mass.gov/ig/publications/reports-and-recommendations/2012/lottery-cash-winfall-letter-july-2012.pdf PDF, 144 KB]) on the latter.) |
*'''Examples''' of survivorship bias: | *'''Examples''' of survivorship bias: | ||
− | ** | + | **Almost {{w|Public Health Cigarette Smoking Act|everyone was smoking}} back in the 1930-70s,{{Citation needed}} thus everyone above 80 probably smoked cigarettes or was at least subjected to passive smoking. Thus anyone above that age could be claimed to prove that you can live a long life while smoking. But they consist of the small group of people that survived in spite of all the smoke, where large sections of those that would have been 80 today, died from cancer or heart disease caused by smoking, long ago, maybe even before they retired. But since these people are dead and gone many years ago, they do not speak up, and are thus the silent majority that is not heard, which is the problem with survivorship bias. |
− | |||
**During World War II, there was a study of the damage done to aircraft, and the recommendation was to add armor to the areas that showed the most damage. The statistician {{w|Abraham Wald}} noticed that the study didn't take into account aircraft that ''didn't'' return: the holes in the returning aircraft thus represented areas where a bomber could take damage and still return home safely. | **During World War II, there was a study of the damage done to aircraft, and the recommendation was to add armor to the areas that showed the most damage. The statistician {{w|Abraham Wald}} noticed that the study didn't take into account aircraft that ''didn't'' return: the holes in the returning aircraft thus represented areas where a bomber could take damage and still return home safely. | ||
**Anything created by an Earth-human in this universe. We think it's because we're special, rather than being special because we're here/we survived. | **Anything created by an Earth-human in this universe. We think it's because we're special, rather than being special because we're here/we survived. | ||
Line 43: | Line 47: | ||
[[Category:Science]] | [[Category:Science]] | ||
[[Category:Public speaking]] | [[Category:Public speaking]] | ||
− |