[en] Linking interindividual differences in psychological phenotype to variations in brain structure is an old dream for psychology and a crucial question for cognitive neurosciences. Yet, replicability of the previously-reported “structural brain behavior” (SBB)-associations has been questioned, recently. Here, we conducted an empirical investigation, assessing replicability of SBB among heathy adults. For a wide range of psychological measures, the replicability of associations with gray matter volume was assessed. Our results revealed that among healthy individuals 1) finding an association between performance at standard psychological tests and brain morphology is relatively unlikely 2) significant associations, found using an exploratory approach, have overestimated effect sizes and 3) can hardly be replicated in an independent sample. After considering factors such as sample size and comparing our findings with more replicable SBB-associations in a clinical cohort and replicable associations between brain structure and non-psychological phenotype, we discuss the potential causes and consequences of these findings.
Disciplines :
Neurosciences & behavior
Author, co-author :
Kharabian Masouleh, Shahrzad
Eickhoff, Simon
Hoffstaedter, Felix
Genon, Sarah ; Université de Liège - ULiège > Département des sciences cliniques > Neuroimagerie des troubles de la mémoire et revalid. cogn.
Language :
English
Title :
Empirical examination of the replicability of associations between brain structure and psychological variables
scite shows how a scientific paper has been cited by providing the context of the citation, a classification describing whether it supports, mentions, or contrasts the cited claim, and a label indicating in which section the citation was made.
Bibliography
Albers, C., Lakens, D., When power analyses based on pilot data are biased: Inaccurate effect size estimators and follow-up bias (2018) Journal of Experimental Social Psychology, 74, pp. 187-195. , https://doi.org/10.1016/j.jesp.2017.09.004
Anderson, M.L., Précis of after phrenology: Neural reuse and the interactive brain (2016) Behavioral and Brain Sciences, 39, p. e120. , https://doi.org/10.1017/S0140525X15000631, PMID: 26077688
Ashburner, J., A fast diffeomorphic image registration algorithm (2007) NeuroImage, 38, pp. 95-113. , https://doi.org/10.1016/j.neuroimage.2007.07.007, PMID: 17761438
Boekel, W., Wagenmakers, E.J., Belay, L., Verhagen, J., Brown, S., Forstmann, B.U., A purely confirmatory replication study of structural brain-behavior correlations (2015) Cortex, 66, pp. 115-133. , https://doi.org/10.1016/j.cortex.2014.11.019, PMID: 25684445
Bressler, S.L., Large-scale cortical networks and cognition (1995) Brain Research Reviews, 20, pp. 288-304. , https://doi.org/10.1016/0165-0173(94)00016-I, PMID: 7550362
Broca, P., Sur le siège de la facultéDu langage articulé (1865) Bulletins De La Sociétéd’anthropologie De Paris, 6, pp. 377-393. , https://doi.org/10.3406/bmsap.1865.9495
Button, K.S., Ioannidis, J.P., Mokrysz, C., Nosek, B.A., Flint, J., Robinson, E.S., Munafò, M.R., Power failure: Why small sample size undermines the reliability of neuroscience (2013) Nature Reviews Neuroscience, 14, pp. 365-376. , https://doi.org/10.1038/nrn3475, PMID: 23571845
Cremers, H.R., Wager, T.D., Yarkoni, T., The relation between statistical power and inference in fMRI (2017) PLOS ONE, 12, p. e0184923. , https://doi.org/10.1371/journal.pone.0184923, PMID: 29155843
De Boeck, P., Jeon, M., Perceived crisis and reforms: Issues, explanations, and remedies (2018) Psychological Bulletin, 144, pp. 757-777. , https://doi.org/10.1037/bul0000154, PMID: 29771554
Delis, D.C., Kaplan, E., Kramer, J.H., (2001) Delis-Kaplan Executive Function System (D-KEFS) Examiner’s Manual., , San Antonio: The Psychological Corporation
Draganski, B., Gaser, C., Busch, V., Schuierer, G., Bogdahn, U., May, A., Neuroplasticity: Changes in grey matter induced by training (2004) Nature, 427, pp. 311-312. , https://doi.org/10.1038/427311a, PMID: 14737157
Dwan, K., Gamble, C., Williamson, P.R., Kirkham, J.J., Systematic review of the empirical evidence of study publication bias and outcome reporting bias - an updated review (2013) PLOS ONE, 8, p. e66844. , https://doi.org/10.1371/journal.pone.0066844, PMID: 23861749
Eklund, A., Nichols, T.E., Knutsson, H., Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates (2016) PNAS, 113, pp. 7900-7905. , https://doi.org/10.1073/pnas.1602413113, PMID: 27357684
Fan, J., McCandliss, B.D., Sommer, T., Raz, A., Posner, M.I., Testing the efficiency and independence of attentional networks (2002) Journal of Cognitive Neuroscience, 14, pp. 340-347. , https://doi.org/10.1162/089892902317361886, PMID: 11970796
Fjell, A.M., Westlye, L.T., Grydeland, H., Amlien, I., Espeseth, T., Reinvang, I., Raz, N., Walhovd, K.B., Accelerating cortical thinning: Unique to dementia or universal in aging? (2014) Cerebral Cortex, 24, pp. 919-934. , https://doi.org/10.1093/cercor/bhs379, PMID: 23236213
Forstmeier, W., Schielzeth, H., Cryptic multiple hypotheses testing in linear models: Overestimated effect sizes and the winner’s curse (2011) Behavioral Ecology and Sociobiology, 65, pp. 47-55. , https://doi.org/10.1007/s00265-010-1038-5, PMID: 21297852
Gaser, C., Dahnke, R., (2016) CAT - A computational anatomy toolbox for the analysis of structural MRI data, , OHBM Conference 2016
Gelman, A., Loken, E., The garden of forking paths: Why multiple comparisons can be a problem, even when there is no ‘fishing expedition’ or ‘p-hacking’ and the research hypothesis was posited ahead of time (2014) Psychological Bulletin, 140, pp. 1272-1280
Genon, S., Bastin, C., Angel, L., Collette, F., Bahri, M.A., Salmon, E., A partial least squares analysis of the self reference effect in Alzheimer’s disease: A reply to Irish (2014) Cortex, 54, pp. 213-218. , https://doi.org/10.1016/j.cortex.2014.02.003, PMID: 24674099
Genon, S., Simon, J., Bahri, M.A., Collette, F., Souchay, C., Jaspar, M., Bastin, C., Salmon, E., Relating pessimistic memory predictions to Alzheimer’s disease brain structure (2016) Cortex, 85, pp. 151-164. , https://doi.org/10.1016/j.cortex.2016.09.014, PMID: 27773357
Genon, S., Wensing, T., Reid, A., Hoffstaedter, F., Caspers, S., Grefkes, C., Nickl-Jockschat, T., Eickhoff, S.B., Searching for behavior relating to grey matter volume in a-priori defined right dorsal premotor regions: Lessons learned (2017) NeuroImage, 157, pp. 144-156. , https://doi.org/10.1016/j.neuroimage.2017.05.053, PMID: 28552730
Genon, S., Reid, A., Langner, R., Amunts, K., Eickhoff, S.B., How to characterize the function of a brain region (2018) Trends in Cognitive Sciences, 22, pp. 350-364. , https://doi.org/10.1016/j.tics.2018.01.010, PMID: 29501326
Gorgolewski, K.J., Varoquaux, G., Rivera, G., Schwarz, Y., Ghosh, S.S., Maumet, C., Sochat, V.V., Margulies, D.S., NeuroVault.org: A web-based repository for collecting and sharing unthresholded statistical maps of the human brain (2015) Frontiers in Neuroinformatics, 9, p. e8. , https://doi.org/10.3389/fninf.2015.00008, PMID: 25914639
Habeck, C., Stern, Y., Multivariate data analysis for neuroimaging data: Overview and application to Alzheimer’s disease (2010) Cell Biochemistry and Biophysics, 58, pp. 53-67. , https://doi.org/10.1007/s12013-010-9093-0, PMID: 20658269
Ioannidis, J.P., Why most published research findings are false (2005) PLOS Medicine, 2, p. e124. , https://doi.org/10.1371/journal.pmed.0020124, PMID: 16060722
Ioannidis, J.P., Why most discovered true associations are inflated (2008) Epidemiology, 19, pp. 640-648. , https://doi.org/10.1097/EDE.0b013e31818131e7, PMID: 18633328
Ioannidis, J.P.A., Why replication has more scientific value than original discovery (2018) Behavioral and Brain Sciences, 41, p. e137. , https://doi.org/10.1017/S0140525X18000729
Ismaylova, E., Di Sante, J., Gouin, J.-P., Pomares, F.B., Vitaro, F., Tremblay, R.E., Booij, L., Associations between daily mood states and brain gray matter volume, Resting-State functional connectivity and Task-Based activity in healthy adults (2018) Frontiers in Human Neuroscience, 12, p. e168. , https://doi.org/10.3389/fnhum.2018.00168
Jeffreys, H., (1961) Theory of Probability., , Oxford: Oxford University Press
John, L.K., Loewenstein, G., Prelec, D., Measuring the prevalence of questionable research practices with incentives for truth telling (2012) Psychological Science, 23, pp. 524-532. , https://doi.org/10.1177/0956797611430953, PMID: 22508865
Kanai, R., Feilden, T., Firth, C., Rees, G., Political orientations are correlated with brain structure in young adults (2011) Current Biology, 21, pp. 677-680. , https://doi.org/10.1016/j.cub.2011.03.017, PMID: 21474316
Kanai, R., Open questions in conducting confirmatory replication studies: Commentary on Boekel (2016) Cortex, 74, pp. 343-347. , https://doi.org/10.1016/j.cortex.2015.02.020, PMID: 25868596
Kanai, R., Rees, G., The structural basis of inter-individual differences in human behaviour and cognition (2011) Nature Reviews Neuroscience, 12, pp. 231-242. , https://doi.org/10.1038/nrn3000, PMID: 21407245
Kharabian Masouleh, S., Arélin, K., Horstmann, A., Lampe, L., Kipping, J.A., Luck, T., Riedel-Heller, S.G., Witte, A.V., Higher body mass index in older adults is associated with lower gray matter volume: Implications for memory performance (2016) Neurobiology of Aging, 40, pp. 1-10. , https://doi.org/10.1016/j.neurobiolaging.2015.12.020, PMID: 26973099
Kim, E.J., Pellman, B., Kim, J.J., Stress effects on the hippocampus: A critical review (2015) Learning & Memory, 22, pp. 411-416. , https://doi.org/10.1101/lm.037291.114, PMID: 26286651
Kriegeskorte, N., Lindquist, M.A., Nichols, T.E., Poldrack, R.A., Vul, E., Everything you never wanted to know about circular analysis, but were afraid to ask (2010) Journal of Cerebral Blood Flow & Metabolism, 30, pp. 1551-1557. , https://doi.org/10.1038/jcbfm.2010.86, PMID: 20571517
Lilienfeld, S.O., Psychology’s Replication Crisis and the Grant Culture: Righting the Ship (2017) Perspectives on Psychological Science, 12, pp. 660-664. , https://doi.org/10.1177/1745691616687745, PMID: 28727961
Loken, E., Gelman, A., Measurement error and the replication crisis (2017) Science, 355, pp. 584-585. , https://doi.org/10.1126/science.aal3618
Luders, E., Kurth, F., Mayer, E.A., Toga, A.W., Narr, K.L., Gaser, C., The unique brain anatomy of meditation practitioners: Alterations in cortical gyrification (2012) Frontiers in Human Neuroscience, 6, p. e34. , https://doi.org/10.3389/fnhum.2012.00034
Luders, E., Kurth, F., Toga, A.W., Narr, K.L., Gaser, C., Meditation effects within the hippocampal complex revealed by voxel-based morphometry and cytoarchitectonic probabilistic mapping (2013) Frontiers in Psychology, 4, p. e398. , https://doi.org/10.3389/fpsyg.2013.00398
Matsuo, K., Nicoletti, M., Nemoto, K., Hatch, J.P., Peluso, M.A.M., Nery, F.G., Soares, J.C., A voxel-based morphometry study of frontal gray matter correlates of impulsivity (2009) Human Brain Mapping, 30, pp. 1188-1195. , https://doi.org/10.1002/hbm.20588
McCrae, R.R., Costa, P.T., A contemplated revision of the NEO Five-Factor inventory (2004) Personality and Individual Differences, 36, pp. 587-596. , https://doi.org/10.1016/S0191-8869(03)00118-1
McEwen, B.S., Nasca, C., Gray, J.D., Stress effects on neuronal structure: Hippocampus, Amygdala, and prefrontal cortex (2016) Neuropsychopharmacology, 41, pp. 3-23. , https://doi.org/10.1038/npp.2015.171, PMID: 26076834
McIntosh, A.R., Mišić, B., Multivariate statistical analyses for neuroimaging data (2013) Annual Review of Psychology, 64, pp. 499-525. , https://doi.org/10.1146/annurev-psych-113011-143804, PMID: 22804773
Miller, K.L., Alfaro-Almagro, F., Bangerter, N.K., Thomas, D.L., Yacoub, E., Xu, J., Bartsch, A.J., Matthews, P.M., Multimodal population brain imaging in the UK biobank prospective epidemiological study (2016) Nature Neuroscience, 19, pp. 1523-1536. , https://doi.org/10.1038/nn.4393, PMID: 27643430
Moeller, J.R., Habeck, C.G., Reciprocal Benefits of Mass-Univariate and Multivariate Modeling in Brain Mapping: Applications to Event-Related Functional MRI, H 2 15 O-, and FDG-PET (2006) International Journal of Biomedical Imaging, 2006, pp. 1-13. , https://doi.org/10.1155/IJBI/2006/79862
Moradi, E., Hallikainen, I., Hänninen, T., Tohka, J., Rey’s Auditory Verbal Learning Test scores can be predicted from whole brain MRI in Alzheimer’s disease (2017) NeuroImage: Clinical, 13, pp. 415-427. , https://doi.org/10.1016/j.nicl.2016.12.011, PMID: 28116234
Muhlert, N., Ridgway, G.R., Failed replications, contributing factors and careful interpretations: Commentary on Boekel (2016) Cortex, 74, pp. 338-342. , https://doi.org/10.1016/j.cortex.2015.02.019, PMID: 25843619
Munafò, M.R., Nosek, B.A., Bishop, D.V.M., Button, K.S., Chambers, C.D., Percie Du Sert, N., Simonsohn, U., Ioannidis, J.P.A., A manifesto for reproducible science (2017) Nature Human Behaviour, 1, pp. 0021-0029. , https://doi.org/10.1038/s41562-016-0021
Nooner, K.B., Colcombe, S.J., Tobe, R.H., Mennes, M., Benedict, M.M., Moreno, A.L., Panek, L.J., Adelsberg, S., The NKI-Rockland sample: A model for accelerating the pace of discovery science in psychiatry (2012) Frontiers in Neuroscience, p. 6. , https://doi.org/10.3389/fnins.2012.00152
Nostro, A.D., Müller, V.I., Reid, A.T., Eickhoff, S.B., Correlations between personality and brain structure: A crucial role of gender (2017) Cerebral Cortex, 27, pp. 3698-3712. , https://doi.org/10.1093/cercor/bhw191, PMID: 27390020
Estimating the reproducibility of psychological science (2015) Science, 349, p. aac4716. , https://doi.org/10.1126/science.aac4716, PMID: 26315443
Pessoa, L., Understanding brain networks and brain organization (2014) Physics of Life Reviews, 11, pp. 400-435. , https://doi.org/10.1016/j.plrev.2014.03.005, PMID: 24819881
Poldrack, R.A., Mapping mental function to brain structure: How can cognitive neuroimaging succeed? (2010) Perspectives on Psychological Science, 5, pp. 753-761. , https://doi.org/10.1177/1745691610388777, PMID: 25076977
Poldrack, R.A., Baker, C.I., Durnez, J., Gorgolewski, K.J., Matthews, P.M., Munafò, M.R., Nichols, T.E., Yarkoni, T., Scanning the horizon: Towards transparent and reproducible neuroimaging research (2017) Nature Reviews Neuroscience, 18, pp. 115-126. , https://doi.org/10.1038/nrn.2016.167, PMID: 28053326
Rajapakse, J.C., Giedd, J.N., Rapoport, J.L., Statistical approach to segmentation of single-channel cerebral MR images (1997) IEEE Transactions on Medical Imaging, 16, pp. 176-186. , https://doi.org/10.1109/42.563663, PMID: 9101327
Salat, D.H., Buckner, R.L., Snyder, A.Z., Greve, D.N., Desikan, R.S., Busa, E., Morris, J.C., Fischl, B., Thinning of the cerebral cortex in aging (2004) Cerebral Cortex, 14, pp. 721-730. , https://doi.org/10.1093/cercor/bhh032, PMID: 15054051
Schmidt, M., (1996) RAVLT - Rey Auditory Verbal Learning Test: A Handbook., , Western Psychological Services
Schönbrodt, F.D., Perugini, M., At what sample size do correlations stabilize? (2013) Journal of Research in Personality, 47, pp. 609-612. , https://doi.org/10.1016/j.jrp.2013.05.009
Scoville, W.B., Milner, B., Loss of recent memory after bilateral hippocampal lesions (1957) Journal of Neurology, Neurosurgery & Psychiatry, 20, pp. 11-21. , https://doi.org/10.1136/jnnp.20.1.11
Simmons, J.P., Nelson, L.D., Simonsohn, U., False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant (2011) Psychological Science, 22, pp. 1359-1366. , https://doi.org/10.1177/0956797611417632, PMID: 22006061
Smith, S.M., Nichols, T.E., Threshold-free cluster enhancement: Addressing problems of smoothing, threshold dependence and localisation in cluster inference (2009) NeuroImage, 44, pp. 83-98. , https://doi.org/10.1016/j.neuroimage.2008.03.061, PMID: 18501637
Smith, S.M., Nichols, T.E., Statistical challenges in ‘Big Data’ Human Neuroimaging (2018) Neuron, 97, pp. 263-268. , https://doi.org/10.1016/j.neuron.2017.12.018, PMID: 29346749
Spielberger, C.D., Gorsuch, R.L., Lushene, R.E., (1970) Manual for the State- Trait Anxiety Inventory., , Palo Alto: Consulting Psychologists Press
Taubert, M., Lohmann, G., Margulies, D.S., Villringer, A., Ragert, P., Long-term effects of motor training on resting-state networks and underlying brain structure (2011) NeuroImage, 57, pp. 1492-1498. , https://doi.org/10.1016/j.neuroimage.2011.05.078, PMID: 21672633
Tohka, J., Zijdenbos, A., Evans, A., Fast and robust parameter estimation for statistical partial volume models in brain MRI (2004) NeuroImage, 23, pp. 84-97. , https://doi.org/10.1016/j.neuroimage.2004.05.007, PMID: 15325355
Tononi, G., Edelman, G.M., Sporns, O., Complexity and coherency: Integrating information in the brain (1998) Trends in Cognitive Sciences, 2, pp. 474-484. , https://doi.org/10.1016/S1364-6613(98)01259-5, PMID: 21227298
Tukey, J.W., We need both eploratory and confirmatory we need both exploratory (1980) The American Statistician, 34, pp. 23-25. , https://doi.org/10.1080/00031305.1980.10482706
Turner, B.O., Paul, E.J., Miller, M.B., Barbey, A.K., Small sample sizes reduce the replicability of task-based fMRI studies (2018) Communications Biology, 1, p. 62. , https://doi.org/10.1038/s42003-018-0073-z, PMID: 30271944
Vanasse, T.J., Fox, P.M., Barron, D.S., Robertson, M., Eickhoff, S.B., Lancaster, J.L., Fox, P.T., BrainMap VBM: An environment for structural meta-analysis (2018) Human Brain Mapping, 39, pp. 3308-3325. , https://doi.org/10.1002/hbm.24078
Wagenmakers, E.J., Verhagen, J., Ly, A., Bakker, M., Lee, M.D., Matzke, D., Rouder, J.N., Morey, R.D., A power fallacy (2015) Behavior Research Methods, 47, pp. 913-917. , https://doi.org/10.3758/s13428-014-0517-4, PMID: 25271090
Wechsler, D., (1999) Wechsler Abbreviated Scale of Intelligence., , San Antonio: The Psychologica Corporation
Willette, A.A., Kapogiannis, D., Does the brain shrink as the waist expands? (2015) Ageing Research Reviews, 20, pp. 86-97. , https://doi.org/10.1016/j.arr.2014.03.007, PMID: 24768742
Van Essen, D.C., Smith, S.M., Barch, D.M., Behrens, T.E., Yacoub, E., Ugurbil, K., The WU-Minn human connectome project: An overview (2013) NeuroImage, 80, pp. 62-79. , https://doi.org/10.1016/j.neuroimage.2013.05.041, PMID: 23684880
Yarkoni, T., Big correlations in little studies: Inflated fMRI correlations reflect low statistical power-Commentary on Vul (2009) Perspectives on Psychological Science, 4, pp. 294-298. , https://doi.org/10.1111/j.1745-6924.2009.01127.x, PMID: 26158966
Yuan, P., Raz, N., Prefrontal cortex and executive functions in healthy adults: A meta-analysis of structural neuroimaging studies (2014) Neuroscience & Biobehavioral Reviews, 42, pp. 180-192. , https://doi.org/10.1016/j.neubiorev.2014.02.005, PMID: 24568942
Similar publications
Sorry the service is unavailable at the moment. Please try again later.
This website uses cookies to improve user experience. Read more
Save & Close
Accept all
Decline all
Show detailsHide details
Cookie declaration
About cookies
Strictly necessary
Performance
Strictly necessary cookies allow core website functionality such as user login and account management. The website cannot be used properly without strictly necessary cookies.
This cookie is used by Cookie-Script.com service to remember visitor cookie consent preferences. It is necessary for Cookie-Script.com cookie banner to work properly.
Performance cookies are used to see how visitors use the website, eg. analytics cookies. Those cookies cannot be used to directly identify a certain visitor.
Used to store the attribution information, the referrer initially used to visit the website
Cookies are small text files that are placed on your computer by websites that you visit. Websites use cookies to help users navigate efficiently and perform certain functions. Cookies that are required for the website to operate properly are allowed to be set without your permission. All other cookies need to be approved before they can be set in the browser.
You can change your consent to cookie usage at any time on our Privacy Policy page.
