decision-making; machine learning; middle temporal gyrus; neural data; Decisions makings; Machine-learning; Middle temporal gyrus; Neural correlate; Neural data; Random forest classifier; Semantic processing; Temporal gyrus; Visual information; Visual processing stream; Computer Science Applications; Information Systems; Control and Optimization; Artificial Intelligence; Signal Processing; Modeling and Simulation
Abstract :
[en] The ability to make good decisions is contingent upon extracting the most relevant information from one's contextual surroundings. The middle temporal gyrus lies at the nexus of visual processing streams and is hypothesized to play a crucial role in the semantic processing of visual information. In this study, stereoelectroencephalography measurements from the middle temporal gyrus were used to train random forest classifiers to decode betting behavior in a financial-decision making task for 10 subjects. Spectral features from the middle temporal gyrus were computed. The performance of these subject-specific classifiers ranged between 75% and 98% accuracy when predicting human betting behavior and provide evidence that the middle temporal gyrus encodes information related to decision-making. This study is the first to use stereoelectroencephalography to explore the functionality of the middle temporal gyrus in decision-making.
Disciplines :
Engineering, computing & technology: Multidisciplinary, general & others
Author, co-author :
Wang, Daniel; Johns Hopkins University, Department of Biomedical Engineering, Baltimore, United States
Sarma, Sridevi V.; Johns Hopkins University, Department of Biomedical Engineering, Baltimore, United States
Sampson, Aaron L.; Johns Hopkins University, Zanvyl Krieger Mind/Brain Institute, Department of Neuroscience, Baltimore, United States
Stuphorn, Veit; Johns Hopkins University, Zanvyl Krieger Mind/Brain Institute, Department of Neuroscience, Baltimore, United States
Niebur, Ernst; Johns Hopkins University, Zanvyl Krieger Mind/Brain Institute, Department of Neuroscience, Baltimore, United States
Sacré, Pierre ; Université de Liège - ULiège > Montefiore Institute of Electrical Engineering and Computer Science
Gonzalez-Martinez, Jorge; University of Pittsburgh, Department of Neurological Surgery, Pittsburgh, United States
Dorman, Daniel B.; Hope College, Department of Neuroscience, Holland, United States
Language :
English
Title :
Neural correlates from the middle temporal gyrus via machine learning decode decision making variables during gambling in humans
Publication date :
2025
Event name :
2025 59th Annual Conference on Information Sciences and Systems (CISS)
Event place :
Baltimore, Usa
Event date :
19-03-2025 => 21-03-2025
Main work title :
2025 59th Annual Conference on Information Sciences and Systems, CISS 2025
Publisher :
Institute of Electrical and Electronics Engineers Inc.
JHU - Johns Hopkins University IEEE - Institute of Electrical and Electronics Engineers
Funding text :
This work was supported by NIH IRACDA K12GM154720 awarded to D.D., NSF 1835202 awarded to S.V.S., A.S., V.S., E.N. and J.G.M.; CiSS; Department of Electrical and Computer Engineering at the Johns Hopkins University; Johns Hopkins Whiting School of Engineering
E. R. Kandel, J. D. Koester, S. H. Mack, and S. A. Siegelbaum, "High-level visual processing: From vision to cognition, " in Principles of Neural Science, 6th ed. McGraw Hill, 2021. [Online]. Available: neurology. mhmedical. com/content. aspx?aid=1180642113
M. Visser, E. Jefferies, and M. A. Lambon Ralph, "Semantic processing in the anterior temporal lobes: A meta-analysis of the functional neuroimaging literature, " Journal of Cognitive Neuroscience, vol. 22, no. 6, pp. 1083-1094, 2010. [Online]. Available: https://doi. org/10. 1162/jocn. 2009. 21309
M. Visser, E. Jefferies, K. V. Embleton, and M. A. Lambon Ralph, "Both the middle temporal gyrus and the ventral anterior temporal area are crucial for multimodal semantic processing: Distortion-corrected fMRI evidence for a double gradient of information convergence in the temporal lobes, " Journal of Cognitive Neuroscience, vol. 24, no. 8, pp. 1766-1778, 2012. [Online]. Available: https://doi. org/10. 1162/jocn a 00244
M. Mishkin, L. G. Ungerleider, and K. A. Macko, "Object vision and spatial vision: Two cortical pathways, " Trends in Neurosciences, vol. 6, pp. 414-417, 1983. [Online]. Available: https://www. sciencedirect. com/science/article/pii/016622368390190X
A. Ishai, L. G. Ungerleider, A. Martin, J. L. Schouten, and J. V. Haxby, "Distributed representation of objects in the human ventral visual pathway, " Proceedings of the National Academy of Sciences, vol. 96, no. 16, pp. 9379-9384, 1999, publisher: Proceedings of the National Academy of Sciences. [Online]. Available: https://www. pnas. org/doi/abs/10. 1073/pnas. 96. 16. 9379
T. Wei, X. Liang, Y. He, Y. Zang, Z. Han, A. Caramazza, and Y. Bi, "Predicting conceptual processing capacity from spontaneous neuronal activity of the left middle temporal gyrus, " Journal of Neuroscience, vol. 32, no. 2, pp. 481-489, 2012, publisher: Society for Neuroscience Section: Articles. [Online]. Available: https://www. jneurosci. org/content/32/2/481
J. Davey, P. L. Cornelissen, H. E. Thompson, S. Sonkusare, G. Hallam, J. Smallwood, and E. Jefferies, "Automatic and controlled semantic retrieval: TMS reveals distinct contributions of posterior middle temporal gyrus and angular gyrus, " Journal of Neuroscience, vol. 35, no. 46, pp. 15 230-15 239, 2015, publisher: Society for Neuroscience Section: Articles. [Online]. Available: https://www. jneurosci. org/content/35/46/15230
J. Davey, H. E. Thompson, G. Hallam, T. Karapanagiotidis, C. Murphy, I. De Caso, K. Krieger-Redwood, B. C. Bernhardt, J. Smallwood, and E. Jefferies, "Exploring the role of the posterior middle temporal gyrus in semantic cognition: Integration of anterior temporal lobe with executive processes, " NeuroImage, vol. 137, pp. 165-177, 2016. [Online]. Available: https://www. sciencedirect. com/science/article/pii/S1053811916301719
T. Larsen and J. P. O'Doherty, "Uncovering the spatio-temporal dynamics of value-based decision-making in the human brain: A combined fMRI-EEG study, " Philosophical Transactions of the Royal Society B: Biological Sciences, vol. 369, no. 1655, p. 20130473, 2014, publisher: Royal Society. [Online]. Available: https://royalsocietypublishing. org/doi/full/10. 1098/rstb. 2013. 0473
I. M. Balodis, C. M. Lacadie, and M. N. Potenza, "A preliminary study of the neural correlates of the intensities of self-reported gambling urges and emotions in men with pathological gambling, " Journal of Gambling Studies, vol. 28, no. 3, pp. 493-513, 2012. [Online]. Available: https://doi. org/10. 1007/s10899-011-9259-8
Y. Meng, W. Deng, H. Wang, W. Guo, and T. Li, "The prefrontal dysfunction in individuals with internet gaming disorder: A meta-analysis of functional magnetic resonance imaging studies, " Addiction Biology, vol. 20, no. 4, pp. 799-808, 2015, eprint: https://onlinelibrary. wiley. com/doi/pdf/10. 1111/adb. 12154. [Online]. Available: https://onlinelibrary. wiley. com/doi/abs/10. 1111/adb. 12154
N. K. Logothetis, J. Pauls, M. Augath, T. Trinath, and A. Oeltermann, "Neurophysiological investigation of the basis of the fMRI signal, " Nature, vol. 412, no. 6843, pp. 150-157, 2001, number: 6843 Publisher: Nature Publishing Group. [Online]. Available: https://www. nature. com/articles/35084005
S. P. Kelly and R. G. O'Connell, "The neural processes underlying perceptual decision making in humans: Recent progress and future directions, " Journal of Physiology-Paris, vol. 109, no. 1, pp. 27-37, 2015. [Online]. Available: https://www. sciencedirect. com/science/article/pii/S0928425714000370
M. Cossu, F. Cardinale, L. Castana, A. Citterio, S. Francione, L. Tassi, A. L. Benabid, and G. Lo Russo, "Stereoelectroencephalography in the presurgical evaluation of focal epilepsy: A retrospective analysis of 215 procedures, " Neurosurgery, vol. 57, no. 4, pp. 706-718; discussion 706-718, 2005.
P. Sacré, M. S. D. Kerr, K. Kahn, J. Gonzalez-Martinez, J. Bulacio, H.-J. Park, M. A. Johnson, S. Thompson, J. Jones, V. S. Chib, J. T. Gale, and S. V. Sarma, "Lucky rhythms in orbitofrontal cortex bias gambling decisions in humans, " Scientific Reports, vol. 6, no. 1, p. 36206, 2016, number: 1 Publisher: Nature Publishing Group. [Online]. Available: https://www. nature. com/articles/srep36206
P. Sacré, S. Subramanian, M. S. D. Kerr, K. Kahn, M. A. Johnson, J. Bulacio, J. A. González-Martínez, S. V. Sarma, and J. T. Gale, "The influences and neural correlates of past and present during gambling in humans, " Scientific Reports, vol. 7, no. 1, p. 17111, 2017, number: 1 Publisher: Nature Publishing Group. [Online]. Available: https://www. nature. com/articles/s41598-017-16862-9
P. Sacré, M. S. D. Kerr, S. Subramanian, Z. Fitzgerald, K. Kahn, M. A. Johnson, E. Niebur, U. T. Eden, J. A. González-Martínez, J. T. Gale, and S. V. Sarma, "Risk-taking bias in human decision-making is encoded via a right-left brain push-pull system, " Proceedings of the National Academy of Sciences, vol. 116, no. 4, pp. 1404-1413, 2019, publisher: Proceedings of the National Academy of Sciences. [Online]. Available: https://www. pnas. org/doi/10. 1073/pnas. 1811259115
C. Taylor, P. Greene, R. D'Aleo, M. S. Breault, C. Steinhardt, J. Gonzalez-Martinez, and S. V. Sarma, "Correlates of attention in the cingulate cortex during gambling in humans, " Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference, vol. 2020, pp. 2548-2551, 2020.
M. A. Johnson, S. Thompson, J. Gonzalez-Martinez, H.-J. Park, J. Bulacio, I. Najm, K. Kahn, M. Kerr, S. V. Sarma, and J. T. Gale, "Performing behavioral tasks in subjects with intracranial electrodes, " Journal of Visualized Experiments: JoVE, no. 92, p. 51947, 2014. [Online]. Available: https://www. ncbi. nlm. nih. gov/pmc/articles/PMC4672964/
M. Ter Wal, A. Platonov, P. Cardellicchio, V. Pelliccia, G. LoRusso, I. Sartori, P. Avanzini, G. A. Orban, and P. H. E. Tiesinga, "Human stereoEEG recordings reveal network dynamics of decision-making in a rule-switching task, " Nature Communications, vol. 11, no. 1, p. 3075, 2020, number: 1 Publisher: Nature Publishing Group. [Online]. Available: https://www. nature. com/articles/s41467-020-16854-w
B. H, A. P, K. Je, M. S, and M. Pp, "Chronux: A platform for analyzing neural signals, " PubMed, 2010. [Online]. Available: https://pubmed. ncbi. nlm. nih. gov/20637804/
G. Li, S. Jiang, S. E. Paraskevopoulou, M. Wang, Y. Xu, Z. Wu, L. Chen, D. Zhang, and G. Schalk, "Optimal referencing for stereo-electroencephalographic (SEEG) recordings, " NeuroImage, vol. 183, pp. 327-335, 2018. [Online]. Available: https://www. ncbi. nlm. nih. gov/pmc/articles/PMC6495648/
K. Fawagreh, M. M. Gaber, and E. Elyan, "Random forests: from early developments to recent advancements, " publisher: Taylor & Francis. [Online]. Available: https://www. Tandfonline. com/doi/abs/10. 1080/21642583. 2014. 956265
J. R. Binder, R. H. Desai, W. W. Graves, and L. L. Conant, "Where is the semantic system? a critical review and meta-analysis of 120 functional neuroimaging studies, " Cerebral Cortex, vol. 19, no. 12, pp. 2767-2796, 2009. [Online]. Available: https://doi. org/10. 1093/cercor/bhp055
C. Whitney, M. Kirk, J. O'Sullivan, M. A. Lambon Ralph, and E. Jefferies, "The neural organization of semantic control: TMS evidence for a distributed network in left inferior frontal and posterior middle temporal gyrus, " Cerebral Cortex, vol. 21, no. 5, pp. 1066-1075, 2011. [Online]. Available: https://doi. org/10. 1093/cercor/bhq180