The Organization for Human Brain Mapping has established an award that recognizes the best replication study, highlights OHBM’s commitment to reproducibility in neuroimaging research and incentives valuable replication research.
What is a Replication Study?
A replication study is a repetition of a published study procedure with minor changes to variables assumed not to be important for the measured phenomena (this depends on the experiment, but could include demographics, scanner model, visual stimuli delivery system, analysis strategy, etc.). Replication studies usually (but not always) have a larger sample size than the original study for appropriate statistical power, and are performed by a different team than the original study (but planning of a replication study can benefit from involvement of the original researchers). Even though minor changes between the original study and its replication are inevitable, they should be minimized as much as possible.
What Makes a Good Replication Study?
A good replication study is a study that addresses an important topic for the neuroimaging community. The study needs to show highest standards of experimental design, data collection and statistical analysis. Openness of experimental procedures, pre-registration, data processing and statistical analyses as well as public availability of collected data also speak in favor of a good replication study. Authors should also show maturity and thoughtfulness when discussing results of the replication and should give the original authors an appropriate platform to comment on the replication. It is also worth noting that a good replication study does not necessarily have to show the same effect as the original study. Both “successful” and “unsuccessful” replication attempts will be considered for the award. Methodological replication as well as replications that are part of a larger study will also be considered for the award.
The Award Committee will select the winner from the nominated papers while soliciting additional expertise from OHBM Membership reviewers as needed.
The recipient will receive a cash award of $2,500 USD along with an engraved plaque. Both are presented at the OHBM Annual Meeting. The awardee will be given the opportunity to give a brief remark during the Annual Meeting.
For more information about the award see our blog post.
Questions? Please direct them to the OHBM Executive Office at email@example.com.
Past Replication Award recipients include:
2021: OHBM Virtual II
Reproducibility of Functional Brain Alterations in Major Depressive Disorder: Evidence From a Multisite Resting-State Functional MRI Study with 1,434 Individuals
Mingrui Xia, China
Tianmei Sid, Xiaoyi Sun, Qing Ma, Bangshan Liu, Li Wang, Jie Meng, Miao Chang, Xiaoqi Huang, Ziqi Chen, Yanqing Tang, Ke Xu, Qiyong Gong, Fei Wang, Jiang Qiu, Peng Xie, Lingjiang Li, Yong He
2020: OHBM Virtual I
A Comprehensive Analysis of Methods for Assessing Polygenic Burden on Alzheimer’s Disease Pathology and Risk Beyond APOE
Andre Altmann, United Kingdom
Marzia Scelsi, Maryam Shoai, Eric de Silva, Leon Aksman, David Cash, John Hardy, Jonathan Schott
2019: Rome, Italy
Evaluating the Evidence for Biotypes of Depression: Attempted replication of Drysdale et.al. 2017
Richard Dinga, Netherlands
2018: Singapore, Singapore
Diagnostic Classification of Unipolar Depression Based on Resting-state Functional Connectivity MRI: Effects of generalization to a diverse sample
Benedikt Sundermann, Germany
Stephan Feder, Heike Wersching, Anja Teuber, Wolfram Schwindt, Harald Kugel, Walter Heindel, Volker Arolt, Klaus Berger, Bettina Pfleiderer
2017: Vancouver, Canada
A Purely Confirmatory Replication Study of Structural Brain-behavior Correlations
Wouter Boekel, Netherlands
Eric-Jan Wagenmakers, Luam Belay, Josine Verhagen, Scott Brown, Birte Forstmann