Editing 2560: Confounding Variables

Jump to: navigation, search

Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
Latest revision Your text
Line 8: Line 8:
  
 
==Explanation==
 
==Explanation==
 
+
{{incomplete|Created by a MISLEADING DATASET - Please change this comment when editing this page. Do NOT delete this tag too soon.}}
[[Miss Lenhart]] is teaching a course which apparently covers at least an overview of statistics.
 
 
 
 
In statistics, a ''confounding variable'' is a third variable that's related to the independent variable, and also causally related to the dependent variable. An example is that you see a correlation between sunburn rates and ice cream consumption; the confounding variable is temperature: high temperatures cause people go out in the sun and get burned more, and also eat more ice cream.
 
In statistics, a ''confounding variable'' is a third variable that's related to the independent variable, and also causally related to the dependent variable. An example is that you see a correlation between sunburn rates and ice cream consumption; the confounding variable is temperature: high temperatures cause people go out in the sun and get burned more, and also eat more ice cream.
  
One way to control for a confounding variable by restricting your data-set to samples with the same value of the confounding variable. But if you do this too much, your choice of that "same value" can produce results that don't generalize. Common examples of this in medical testing are using subjects of the same sex or race -- the results may only be valid for that sex/race, not for all subjects.
+
One way to control for a confounding variable by restricting your dataset to samples with the same value of the confounding variable. But if you do this too much, your choice of that "same value" can produce results that don't generalize. Common examples of this in medical testing are using subjects of the same sex or race -- the results may only be valid for that sex/race, not for all people.
  
There can also often be multiple confounding variables. It may be difficult to control for all of them without narrowing down your data-set so much that it's not useful. So you have to choose which variables to control for, and this choice biases your results.
+
There can also often be multiple confounding variables. It may be difficult to control for all of them without narrowing down your dataset so much that it's not useful. So you have to choose which variables to control for, and this choice biases your results.
  
In the final panel, Miss Lenhart suggests a sweet spot in the middle, where both confounding variables and your control impact the end result, thus making you "doubly wrong". "Doubly wrong" result would simultaneously display wrong correlations (not enough of controlled variables) and be too narrow to be useful (too many controlled variables), thus the 'worst of both worlds'.
+
In the final panel, Blondie suggests a sweet spot in the middle, where both confounding variables and your control impact the end result, thus making you "doubly wrong". "Doubly wrong" result would simultaineously display wrong correlations (not enough of controlled variables) and be too narrow to be useful (too many controlled variables), thus the 'worst of both worlds'.
  
Finally she admits that no matter what you do the results will be misleading, so statistics are useless. This would seem to be an unexpected declaration from someone supposedly trying to actually teach statistics{{Citation needed}}, and expecting her students to continue the course. Though there is a possibility that she is not there to purely educate this subject, but is instead running a course with a different purpose and it just happens that this week concluded with this particular targeted critique.
+
Finally she admits that no matter what you do the results will be misleading, so statistics are useless. This would seem to be an unexpected declaration from someone supposedly trying to actually teach Statistics, and expecting her students to continue the course. Though there is a possibility that she is not there to purely educate this subject, but is instead running a course with a {{w|MythBusters|different type of remit}} and it just happens that this week concluded with this particular targetted critique.
  
In the title text, the ''residual'' refers to the difference between any particular data point and the graph that's supposed to describe the overall relationship. The collection of all residuals is used to determine how well the line fits the data. If you control for this by including a variable that perfectly matches the discrepancies between the predicted and actual outcomes, you would have a perfectly-fitting model:  however, it is nigh impossible (especially in the social and behavioral sciences) to find a "final variable" that perfectly provides all the "missing pieces" of the prediction model.
+
In the title text, the ''residual'' refers to the difference between any particular data point and the graph that's supposed to describe the overall relationship. The collection of all residuals is used to determine how well the curve fits the data. If you control for this by selecting only points with the same residual you'll get a perfect correlation, but the results are meaningless because you're ignoring all the data points that don't agree with your hypothesis.
  
 
==Transcript==
 
==Transcript==
:[Miss Lenhart is holding a pointer and pointing at a board with a large heading with some unreadable text beneath it. Below this there are two graphs with scattered points. In the top graph the points are almost on a straight increasing line. In the bottom the data points seem to be more random. Mrs Lenhart covers most of the right side of the board, but there is more unreadable text to the right of her.]
+
{{incomplete transcript|Do NOT delete this tag too soon.}}
:Miss Lenhart: If you don't control for confounding variables, they'll mask the real effect and mislead you.
+
:[Blondie is holding a pointer and pointing at a board with the word Statistics and with some graphs]
:Heading: Statistics
+
:Blondie: If you don't control for confounding variables, they'll mask the real effect and mislead you.
 
+
:[Just Blondie, still holding the pointer, with her finger in the air]
:[Miss Lenhart is holding the pointer down in one hand while she holds a finger in the air with the other hand. The board is no longer shown.]
+
:Blondie: But if you control for too ''many'' variables, your choices will shape the data and you'll mislead yourself.
:Miss Lenhart: But if you control for too ''many'' variables, your choices will shape the data and you'll mislead yourself.
+
:[Blondie with the pointer to her side]
 
+
:Blondie: Somewhere in the middle is the sweet spot where you do both, making you doubly wrong.  
:[Miss Lenhart is holding both arms down, still with the pointer in her hand.]
+
:Blondie: Stats are a farce and truth is unknowable. See you next week!
:Miss Lenhart: Somewhere in the middle is the sweet spot where you do both, making you doubly wrong.  
 
:Miss Lenhart: Stats are a farce and truth is unknowable. See you next week!
 
 
 
 
{{comic discussion}}
 
{{comic discussion}}
 
+
[[Category: Statistics]]
[[Category:Comics featuring Miss Lenhart]]
+
[[Category:Comics featuring Blondie]]
[[Category:Statistics]]
 
[[Category:Charts]]
 

Please note that all contributions to explain xkcd may be edited, altered, or removed by other contributors. If you do not want your writing to be edited mercilessly, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource (see explain xkcd:Copyrights for details). Do not submit copyrighted work without permission!

To protect the wiki against automated edit spam, we kindly ask you to solve the following CAPTCHA:

Cancel | Editing help (opens in new window)