Difference between revisions of "Talk:3117: Replication Crisis"
Rtanenbaum (talk | contribs) m |
|||
| Line 6: | Line 6: | ||
: I favor the current explanation's interpretation. "Today's studies", I think, refers to 2025 primary research papers across fields of science, and the team finds issues with their reproducibility similar to those found with 2015 primary research papers. I argue that the headline appropriate for "falsifying the replication crisis" would be REPLICATION CRISIS DEBUNKED, not CRISIS SOLVED; the latter tacitly <em>accepts</em> the finding of a replication crisis. I argue further that the demons responsible for the replication crisis are legion, and include the sheer mass and rapid worldwide growth of 'the literature', the 'publish or perish' demands of employers and funders especially given the inadequate money and time granted by funders (<em>before</em> the currently unfolding catastrophe), the rules of (usually volunteer) print-journal editors desperate to save money and space, the collapse under multiple pressures of peer review, the devolution of most actual work to the least paid and least experienced, the disastrous consequences of replacing integrity with propaganda ("don't be such a scientist"), yada. Issues that won't be addressed by publication of null results (oh goody, yet <em>another</em> predatory for-profit journal opportunity!) or annoying results, even if that idea does stimulate a wry chuckle on first reading. Once upon a time, there <em>was</em> a {{w|Journal_of_Irreproducible_Results|<em>Journal of Irreproducible Results</em>}}. "So what {{w|Annals_of_Improbable_Research|happened to it?}}" "That's what they <em>all</em> are now." [[Special:Contributions/2605:59C8:160:DB08:C1B3:77CD:F0E3:3391|2605:59C8:160:DB08:C1B3:77CD:F0E3:3391]] 02:59, 19 July 2025 (UTC) | : I favor the current explanation's interpretation. "Today's studies", I think, refers to 2025 primary research papers across fields of science, and the team finds issues with their reproducibility similar to those found with 2015 primary research papers. I argue that the headline appropriate for "falsifying the replication crisis" would be REPLICATION CRISIS DEBUNKED, not CRISIS SOLVED; the latter tacitly <em>accepts</em> the finding of a replication crisis. I argue further that the demons responsible for the replication crisis are legion, and include the sheer mass and rapid worldwide growth of 'the literature', the 'publish or perish' demands of employers and funders especially given the inadequate money and time granted by funders (<em>before</em> the currently unfolding catastrophe), the rules of (usually volunteer) print-journal editors desperate to save money and space, the collapse under multiple pressures of peer review, the devolution of most actual work to the least paid and least experienced, the disastrous consequences of replacing integrity with propaganda ("don't be such a scientist"), yada. Issues that won't be addressed by publication of null results (oh goody, yet <em>another</em> predatory for-profit journal opportunity!) or annoying results, even if that idea does stimulate a wry chuckle on first reading. Once upon a time, there <em>was</em> a {{w|Journal_of_Irreproducible_Results|<em>Journal of Irreproducible Results</em>}}. "So what {{w|Annals_of_Improbable_Research|happened to it?}}" "That's what they <em>all</em> are now." [[Special:Contributions/2605:59C8:160:DB08:C1B3:77CD:F0E3:3391|2605:59C8:160:DB08:C1B3:77CD:F0E3:3391]] 02:59, 19 July 2025 (UTC) | ||
| + | |||
| + | : I agree with the interpretation of [[User:Justhalf|Justhalf]] since it is simpler and more direct to the punchline than what is written in the explanation. Here's the joke: 1. in the 2010's a study showed there were too many research results that could not be replicated. 2. in 2025 another study looking at current research results, also found that many could not be replicated. 3. This second study confirms the first study thereby replicating their results, 4. the newspaper then announces "replication crisis solved" basing that on the fact that the second paper replicated the first one. Of course the newspaper got it wrong, because simply replicating one study, doesn't solve the problem that all the other studies were never replicated. That's the joke. It's very simple. please don't over think it and make it more complicated [[User:Rtanenbaum|Rtanenbaum]] ([[User talk:Rtanenbaum|talk]]) 20:06, 19 July 2025 (UTC) | ||
Revision as of 20:06, 19 July 2025
I believe the current explanation is a bit missing the point. It's supposed to mean that the authors shown in the comic failed to reproduce the result of the papers claiming that there are replication crisis, and therefore the original claim that there is a replication crisis going on is unfounded (since the papers claiming it cannot be replicated), and comically the headline in the last panel takes this to the next level by saying that this means there was no replication crisis to begin with.
Justhalf (talk) 00:57, 19 July 2025 (UTC)
- I favor the current explanation's interpretation. "Today's studies", I think, refers to 2025 primary research papers across fields of science, and the team finds issues with their reproducibility similar to those found with 2015 primary research papers. I argue that the headline appropriate for "falsifying the replication crisis" would be REPLICATION CRISIS DEBUNKED, not CRISIS SOLVED; the latter tacitly accepts the finding of a replication crisis. I argue further that the demons responsible for the replication crisis are legion, and include the sheer mass and rapid worldwide growth of 'the literature', the 'publish or perish' demands of employers and funders especially given the inadequate money and time granted by funders (before the currently unfolding catastrophe), the rules of (usually volunteer) print-journal editors desperate to save money and space, the collapse under multiple pressures of peer review, the devolution of most actual work to the least paid and least experienced, the disastrous consequences of replacing integrity with propaganda ("don't be such a scientist"), yada. Issues that won't be addressed by publication of null results (oh goody, yet another predatory for-profit journal opportunity!) or annoying results, even if that idea does stimulate a wry chuckle on first reading. Once upon a time, there was a Journal of Irreproducible Results. "So what happened to it?" "That's what they all are now." 2605:59C8:160:DB08:C1B3:77CD:F0E3:3391 02:59, 19 July 2025 (UTC)
- I agree with the interpretation of Justhalf since it is simpler and more direct to the punchline than what is written in the explanation. Here's the joke: 1. in the 2010's a study showed there were too many research results that could not be replicated. 2. in 2025 another study looking at current research results, also found that many could not be replicated. 3. This second study confirms the first study thereby replicating their results, 4. the newspaper then announces "replication crisis solved" basing that on the fact that the second paper replicated the first one. Of course the newspaper got it wrong, because simply replicating one study, doesn't solve the problem that all the other studies were never replicated. That's the joke. It's very simple. please don't over think it and make it more complicated Rtanenbaum (talk) 20:06, 19 July 2025 (UTC)
