Is the Scientific Method Broken? Demand Characteristics and Shrinking Variation
(Essay found in Nesselroade & Grimm, 2019; pg. 115) Throughout the text a series of several “Boxes” are asking whether the scientific method is broken in light of the non-reproducibility problem currently plaguing the social, behavioral, and medical sciences. In Box 1.1 we looked at the “Wallpaper Effect” and the difficulty in identifying and controlling all extraneous variables. In Box 2.3 we looked at, among other things, different ways the collection of data may be biased through wording effects and order effects. In this box, let us explore some of the problems that occur in the data gathering process. Sometimes