In laboratory science-based fields, we are accustomed to performing research using the principles of the scientific method. To summarize, we form a hypothesis, conduct an experiment, collect data, analyze and interpret the data, and then draw conclusions that may or may not be aligned with the initial hypothesis. We then cycle back with a revised hypothesis and repeat the method. For this process to work, the experiments being performed must be designed to limit the number of possible conclusions, hence the need for appropriate controls. Finally, we try to use Occam’s Razor when drawing conclusions; the simplest, most assumption-free interpretation of the data should be explored first, before moving on to more complex explanations.
Recently I have been reading literature from various disciplines associated with obesity and heart disease, and the relationship between diet and those maladies. To be blunt, I have been amazed at what folks can get away with in the supposedly peer-reviewed literature. In my opinion, coming at it as an experimentalist, some of what I present below crosses the line from being poorly done to just plain irresponsible. For the sake of brevity, I will present these examples by linking to writers who have already gone through the process of dissecting the primary literature. I don’t think it is necessary for me to re-do analyses that have already been ably done. However, I want to make it clear that some of these writers have economic interest in the whole argument – they are selling books, are on lecture circuits, etc. By linking to those articles, I am not endorsing their products – I do however find some of what they have to say quite useful.
Continue reading “the importance of being self-critical”