Erik Cobo
Statistician and doctor at the Universitat Politècnica de Catalunya - BarcelonaTech (UPC)
A lot of caution in the face of an article which, on the other hand, says nothing that our ancients did not already know: mens sana in corpore sano.
The press release starts off well but then sells the method (Mendelian Randomization) as if it were equivalent to experimental randomization, which is everyone's wish, yet to be proven.
Regarding the article, as a statistician I should thoroughly review their methods, check that their programs work and actually do what they say they do. Ideally, I would have to access their data and see that I can reproduce their methods, which would obviously take more time than any reader has. Therefore, given the boldness of its title, I will explain why this study should be considered as a simple idea that is released to the community, not a scientifically proven result, which requires that others can reproduce the methods and replicate the results in new data. For the sake of brevity, I will focus on two aspects.
The title talks about effects, which is reserved for experimental articles that randomise an intervention and wait in time to collect all its possible effects, the desired positive ones, but also the unexpected ones. Inside they clarify that they are looking for causes, which is always tentative as it requires the statistical model to be complete (Draper). That is, it correctly includes all predictor variables (possible confounders) but no more, which could lead to selection bias (Hernan). Thus, the assumptions about causes are so bold that they require new studies on effects which, I insist, must randomly assign an intervention. That is, an action that can depend on the will of the researcher, always with the consent of the volunteer.
They abuse the p-value, a popular statistical tool, albeit a very fragile one since, among other things (ASA statement) it facilitates the horrible practice known as data dredging or p-hacking. But I do not have access to supplementary table 1 where the authors should detail in which section of their manuscript they report the 20 crucial items required by the STROBE-MR guideline that apply to ‘Mendelian randomisations based on observational data’. Your item 3 asks to specify which hypotheses were prior and which were not, which I have not been able to find in the text. If they are posterior, the results should be considered as suggestions rather than proven scientific results.
In short, a lot of caution with this article, which requires a very deep critical study.