Search This Blog

De Omnibus Dubitandum - Lux Veritas

Showing posts with label Interpreting Scientific Claims. Show all posts
Showing posts with label Interpreting Scientific Claims. Show all posts

Friday, April 8, 2022

Scientific Computer Modeling Method 101

By Roy Tucker

Editor's Note - This another of those timeless pieces I come back to over and over again.  With permission, I published this in May of 2009, and in 2012, but with all the false information that has come out over the years regarding global warming, climate models and pandemic predictions, I think this is worth another look.  I've also added some verbiage  RK  

I'm a bit dismayed about how computer models have come to be more important than actual observations and so I offer a formal statement of the Scientific Computer Modeling Method.

The Scientific Method.  Data in Search of Conclusions

1. Observe a phenomenon carefully.
2. Develop a hypothesis that possibly explains the phenomenon.
3. Perform a test in an attempt to disprove or invalidate the hypothesis. If the hypothesis is disproven, return to steps 1 and 2.
4. A hypothesis that stubbornly refuses to be invalidated may be correct. Continue testing.

The Scientific Computer Modeling Method. Conclusions In Search of Data.
 
1. Observe a phenomenon carefully.
2. Develop a computer model that mimics the behavior of the phenomenon.
3. Select observations that conform to the model predictions and dismiss observations as of inadequate quality that conflict with the computer model.
4. In instances where all of the observations conflict with the model, "refine" the model with fudge factors to give a better match with pesky facts. Assert that these factors reveal fundamental processes previously unknown in association with the phenomenon. Under no circumstances willingly reveal your complete data sets, methods, or computer codes.
5. Upon achieving a model of incomprehensible complexity that still somewhat resembles the phenomenon, begin to issue to the popular media dire predictions of catastrophe that will occur as far in the future as possible, at least beyond your professional lifetime.
6. Continue to "refine" the model in order to maximize funding and the awarding of Nobel Prizes.
7. Dismiss as unqualified, ignorant, and conspiracy theorists all who offer criticisms of the model.

Repeat steps 3 through 7 indefinitely. 


 

Thursday, November 28, 2013

Policy: Twenty tips for interpreting scientific claims

William J. Sutherland, David Spiegelhalter & Mark Burgman, 20 November 2013
This list will help non-scientists to interrogate advisers and to grasp the limitations of evidence, say William J. Sutherland, David Spiegelhalter and Mark A. Burgman.
Calls for the closer integration of science in political decision-making have been commonplace for decades. However, there are serious problems in the application of science to policy — from energy to health and environment to education…….Of course, others will have slightly different lists. Our point is that a wider understanding of these 20 concepts by society would be a marked step forward.
1.      Differences and chance cause variation.
2.      No measurement is exact.
3.      Bias is rife.
4.      Bigger is usually better for sample size.
5.      Correlation does not imply causation.
6.      Regression to the mean can mislead.
7.      Extrapolating beyond the data is risky.
8.     Beware the base-rate fallacy.
9.      Controls are important.
10.  Randomization avoids bias.
11.   Seek replication, not pseudoreplication.
12.  Scientists are human..
13.  Significance is significant.
14.  Separate no effect from non-significance.
15.   Effect size matters.
16.  Study relevance limits generalizations.
17.   Feelings influence risk perception.,
18.  Dependencies change the risks.
19.  Data can be dredged or cherry picked.
20. Extreme measurements may mislead.
To Read More……