Compression; Computational modeling; Similarity; TBRS; Working memory; Neuropsychology and Physiological Psychology; Developmental and Educational Psychology
Abstract :
[en] The ability to compress information is a fundamental cognitive function. It allows working memory (WM) to overcome its severely limited capacity. Recent evidence suggests that the similarity between items can be used to compress information, leading to a rich pattern of behavioral results. This work presents a series of simulations showing that this rich pattern of WM performance is captured using the principles of TBRS*, a decay and refreshing architecture. By assuming that similar items are compressed, the architecture can explain the beneficial effect of similarity on the items themselves. The architecture also explains the fact that when similar items are mixed with dissimilar items, this provides a proactive—but no retroactive—benefit on WM performance. In addition, the model captures fine-grained patterns of transposition errors recently reported. Several analyses are reported showing the robustness of the model’s predictions. We reached the conclusion that decay and refreshing theories provide a plausible explanation for compression effects in WM. These conclusions are discussed in light of recent experimental results. The importance of computational modeling for testing theories is emphasized.
Disciplines :
Theoretical & cognitive psychology
Author, co-author :
Kowialiewski, Benjamin ; Université de Liège - ULiège > Département de Psychologie ; Department of Psychology, Cognitive Psychology Unit, University of Zürich, Zurich, Switzerland
Lemaire, Benoît; Univ. Grenoble Alpes, CNRS, LPNC, Grenoble, France
Portrat, Sophie; Univ. Grenoble Alpes, CNRS, LPNC, Grenoble, France
Language :
English
Title :
Similarity-Based Compression in Working Memory: Implications for Decay and Refreshing Models
ANR - Agence Nationale de la Recherche UZH - University of Zürich
Funding text :
Open access funding provided by University of Zurich. This study was funded by the French National Research Agency (ANR) under the CHUNKED project #ANR-17-CE28-0013–03.
A.R. Albrecht B.J. Scholl Perceptually averaging in a continuous visual world: Extracting statistical summary representations over time Psychological Science 2010 21 4 560 567 10.1177/0956797610363543 20424102
G.A. Alvarez Representing multiple objects as an ensemble enhances visual cognition Trends in Cognitive Sciences 2011 15 3 122 131 10.1016/j.tics.2011.01.003 21292539
D. Ariely Seeing sets: Representation by statistical properties Psychological Science 2001 12 2 157 162 1:STN:280:DC%2BD3MzisFyrsQ%3D%3D 10.1111/1467-9280.00327 11340926
A.S. Atkins P.A. Reuter-Lorenz False working memories? Semantic distortion in a mere 4 seconds Memory & Cognition 2008 36 1 74 81 10.3758/MC.36.1.74
A.D. Baddeley Short-term memory for word sequences as a function of acoustic, semantic and formal similarity Quarterly Journal of Experimental Psychology 1966 18 4 362 365 1:STN:280:DyaF2s%2FotFahsw%3D%3D 10.1080/14640746608400055 5956080
P. Barrouillet V. Camos Interference: Unique source of forgetting in working memory? Trends in Cognitive Sciences 2009 13 4 145 146 10.1016/j.tics.2009.01.002 19285911
P. Barrouillet S. Bernardin V. Camos Time constraints and resource sharing in adults’ working memory spans Journal of Experimental Psychology: General 2004 133 1 83 100 10.1037/0096-3445.133.1.83 14979753
P. Barrouillet S. Portrat E. Vergauwe K. Diependaele V. Camos Further evidence for temporal decay in working memory: Reply to Lewandowsky and Oberauer (2009) Journal of Experimental Psychology: Learning, Memory, and Cognition 2011 37 5 1302 1317 10.1037/a0022933 21895395
Bays, P. M., Catalao, R. F Husain, M. (2009). The precision of visual working memory is set by allocation of a shared resource. Journal of Vision, 9 (10), 7.1–11.
M. Chekaf N. Cowan F. Mathy Chunk formation in immediate memory and how it relates to data compression Cognition 2016 155 96 107 10.1016/j.cognition.2016.05.024 27367593 4983232
Z. Chen N. Cowan Chunk limits and length limits in immediate recall: A reconciliation Journal of Experimental Psychology: Learning, Memory, and Cognition 2005 31 6 1235 1249 10.1037/0278-7393.31.6.1235 16393043
Z. Chen N. Cowan Core verbal working-memory capacity: The limit in words retained without covert articulation Quarterly Journal of Experimental Psychology 2009 62 7 1420 1429 10.1080/17470210802453977
N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity Behavioral and Brain Sciences 2001 24 1 87 114 1:STN:280:DC%2BD3MvntFSitA%3D%3D 10.1017/S0140525X01003922 11515286
N. Cowan J.S. Saults E.M. Elliott M.V. Moreno Deconfounding serial recall Journal of Memory and Language 2002 46 1 153 177 10.1006/jmla.2001.2805
N. Cowan E.M. Elliott J. Scott Saults C.C. Morey S. Mattox A. Hismjatullina A.R.A. Conway On the capacity of attention: Its estimation and its role in working memory and cognitive aptitudes Cognitive Psychology 2005 51 1 42 100 10.1016/j.cogpsych.2004.12.001 16039935 2673732
N. Cowan D. Guitard N.R. Greene S. Fiset Exploring the use of phonological and semantic representations in working memory Journal of Experimental Psychology: Learning, Memory, and Cognition. 2022 10.1037/xlm0001077 36006718
C. De Lillo Imposing structure on a Corsi-type task: Evidence for hierarchical organisation based on spatial proximity in serial-spatial memory Brain and Cognition 2004 55 3 415 426 10.1016/j.bandc.2004.02.071 15223184
A.B. Fallon K. Groves G. Tehan Phonological similarity and trace degradation in the serial recall task: When CAT International Journal of Psychology 1999 34 5–6 301 307 10.1080/002075999399602
S. Farrell S. Lewandowsky Computational models as aids to better reasoning in psychology Current Directions in Psychological Science 2010 19 5 329 335 10.1177/0963721410386677
R.M. French E.T. Kus KAMA: A temperature-driven model of mate choice using dynamic partner representations Adaptive Behavior 2008 16 1 71 95 10.1177/1059712307087598
P. Gupta J. Lipinski E. Aktunc Reexamining the phonological similarity effect in immediate serial recall: The roles of type of similarity, category cuing, and item recall Memory & Cognition 2005 33 6 1001 1016 10.3758/BF03193208
S. Ishiguro S. Saito The detrimental effect of semantic similarity in short-term memory tasks: A meta-regression approach Psychonomic Bulletin & Review 2020 10.3758/s13423-020-01815-7
A. Jalbert J. Saint-Aubin S. Tremblay Short article: Visual similarity in short-term recall for where and when Quarterly Journal of Experimental Psychology 2008 61 3 353 360 10.1080/17470210701634537
P. Jolicœur R. Dell’Acqua The demonstration of short-term consolidation Cognitive Psychology 1998 36 2 138 202 10.1006/cogp.1998.0684 9721199
S. Kirkpatrick C.D. Gelatt M.P. Vecchi Optimization by simulated annealing Science 1983 220 4598 671 680 702485 1:STN:280:DC%2BC3cvktFWjtw%3D%3D 10.1126/science.220.4598.671 17813860
B. Kowialiewski S. Gorin S. Majerus Semantic knowledge constrains the processing of serial order information in working memory Journal of Experimental Psychology: Learning, Memory, and Cognition. 2021 10.1037/xlm0001031 34410808
Kowialiewski, B., Lemaire, B., & Portrat, S. (2021b). How does semantic knowledge impact working memory maintenance? Computational and behavioral investigations. Journal of Memory and Language, 117, 104208. https://doi.org/10.1016/j.jml.2020.104208
Kowialiewski, B., Krasnoff, J., Mizrak, E., & Oberauer, K. (2022a). The semantic relatedness effect in serial recall: Deconfounding encoding and recall order. Journal of Memory and Language, 127. https://doi.org/10.1016/j.jml.2022.104377
B. Kowialiewski B. Lemaire S. Portrat Between-item similarity frees up working memory resources through compression: A domain-general property Journal of Experimental Psychology: General 2022 151 11 2641 2665 10.1037/xge0001235 35737529
B. Lemaire S. Portrat A computational model of working memory integrating time-based decay and interference Frontiers in Psychology 2018 9 416 10.3389/fpsyg.2018.00416 29666597 5891628
B. Lemaire A. Pageot G. Plancher S. Portrat What is the time course of working memory attentional refreshing? Psychonomic Bulletin & Review 2018 25 1 370 385 10.3758/s13423-017-1282-z
S. Lewandowsky Redintegration and response suppression in serial recall: A dynamic network model International Journal of Psychology 1999 34 5–6 434 446 10.1080/002075999399792
S. Lewandowsky K. Oberauer Rehearsal in serial recall: An unworkable solution to the nonexistent problem of decay Psychological Review 2015 122 4 674 699 10.1037/a0039684 26437148
S. Lewandowsky K. Oberauer G.D.A. Brown No temporal decay in verbal short-term memory Trends in Cognitive Sciences 2009 13 3 120 126 10.1016/j.tics.2008.12.003 19223224
P.-H. Lin S.J. Luck The influence of similarity on visual working memory representations Visual Cognition 2009 17 3 356 372 10.1080/13506280701766313 19430536 2678681
F. Mathy J. Feldman What’s magic about magic numbers? Chunking and data compression in short-term memory Cognition 2012 122 3 346 362 10.1016/j.cognition.2011.11.003 22176752
C. Monnier F. Bonthoux The semantic-similarity effect in children: Influence of long-term knowledge on verbal short-term memory: Semantic contribution to serial recall in children British Journal of Developmental Psychology 2011 29 4 929 941 10.1111/j.2044-835X.2010.02024.x 21995745
C.C. Morey Perceptual grouping boosts visual working memory capacity and reduces effort during retention British Journal of Psychology 2018 110 2 306 327 3819860 10.1111/bjop.12355 30345501
M.R. Nassar J.C. Helmers M.J. Frank Chunking as a rational strategy for lossy data compression in visual working memory Psychological Review 2018 125 4 486 511 10.1037/rev0000101 29952621 6026019
K. Neale G. Tehan Age and redintegration in immediate memory and their relationship to task difficulty Memory & Cognition 2007 35 8 1940 1953 10.3758/BF03192927
D.E. Nee J. Jonides Neural evidence for a 3-state model of visual short-term memory NeuroImage 2013 74 1 11 10.1016/j.neuroimage.2013.02.019 23435212
L.M. Nimmo S. Roodenrys Investigating the phonological similarity effect: Syllable structure and the position of common phonemes Journal of Memory and Language 2004 50 3 245 258 10.1016/j.jml.2003.11.001
D. Norris K. Kalm Chunking and data compression in verbal short-term memory Cognition 2021 208 104534 10.1016/j.cognition.2020.104534 33360054
D. Norris K. Kalm J. Hall Chunking and redintegration in verbal short-term memory Journal of Experimental Psychology: Learning, Memory, and Cognition 2020 46 5 872 893 10.1037/xlm0000762 31566390
Oberauer, K. (2009). Design for a working memory. In Ross, B.H. (ed.) The Psychology of Learning and Motivation, 51, 45–100.
K. Oberauer S. Lewandowsky Modeling working memory: A computational implementation of the time-based resource-sharing theory Psychonomic Bulletin & Review 2011 18 1 10 45 10.3758/s13423-010-0020-6
K. Oberauer S. Lewandowsky Evidence against decay in verbal working memory Journal of Experimental Psychology: General 2013 142 2 380 411 10.1037/a0029588 22866686
K. Oberauer S. Lewandowsky Further evidence against decay in working memory Journal of Memory and Language 2014 73 15 30 10.1016/j.jml.2014.02.003
M.P.A. Page D. Norris The primacy model: A new model of immediate serial recall Psychological Review 1998 105 4 761 1:STN:280:DyaK1M%2FkvVSksg%3D%3D 10.1037/0033-295X.105.4.761-781 9830378
F.B.R. Parmentier M.T. Maybery Equivalent effects of grouping by time, voice, and location on response timing in verbal serial memory Journal of Experimental Psychology: Learning, Memory, and Cognition 2008 34 6 1349 1355 10.1037/a0013258 18980399
F.B.R. Parmentier G. Elford M. Maybery Transitional information in spatial serial memory: Path characteristics affect recall performance Journal of Experimental Psychology: Learning, Memory, and Cognition 2005 31 3 412 427 10.1037/0278-7393.31.3.412 15910128
F.B.R. Parmentier P. Andrés G. Elford D.M. Jones Organization of visuo-spatial serial memory: Interaction of temporal order with spatial and temporal grouping Psychological Research Psychologische Forschung 2006 70 3 200 217 10.1007/s00426-004-0212-7 15844005
D.J. Peterson M.E. Berryhill The Gestalt principle of similarity benefits visual working memory Psychonomic Bulletin & Review 2013 20 6 1282 1289 10.3758/s13423-013-0460-x
L. Peterson M.J. Peterson Short-term retention of individual verbal items Journal of Experimental Psychology 1959 58 3 193 198 1:STN:280:DyaF3c7osV2ksg%3D%3D 10.1037/h0049234 14432252
M. Poirier J. Saint-Aubin Memory for related and unrelated words: Further evidence on the influence of semantic factors in immediate serial recall The Quarterly Journal of Experimental Psychology Section A 1995 48 2 384 404 1:STN:280:DyaK2MzjsVKjtw%3D%3D 10.1080/14640749508401396
S. Portrat P. Barrouillet V. Camos Time-related decay or interference-based forgetting in working memory? Journal of Experimental Psychology: Learning, Memory, and Cognition 2008 34 6 1561 1564 10.1037/a0013356 18980415
S. Portrat A. Guida T. Phénix B. Lemaire Promoting the experimental dialogue between working memory and chunking: Behavioral data and simulation Memory & Cognition 2016 44 3 420 434 10.3758/s13421-015-0572-9
P.T. Quinlan D.J. Cohen Grouping and binding in visual short-term memory Journal of Experimental Psychology: Learning, Memory, and Cognition 2012 38 5 1432 1438 10.1037/a0027866 22449133
H. Ramzaoui F. Mathy A compressibility account of the color-sharing bonus in working memory Attention, Perception, & Psychophysics. 2021 10.3758/s13414-020-02231-8
T.J. Ricker E. Vergauwe N. Cowan Decay theory of immediate memory: From brown (1958) to today (2014) Quarterly Journal of Experimental Psychology 2014 69 10 1969 1995 10.1080/17470218.2014.914546
S. Roodenrys D. Guitard L.M. Miller J. Saint-Aubin J.M. Barron Phonological similarity in the serial recall task hinders item recall, not just order British Journal of Psychology 2022 113 4 1100 1120 10.1111/bjop.12575 35692188 9796538
J. Saint-Aubin M. Poirier Semantic similarity and immediate serial recall: Is there a detrimental effect on order information? The Quarterly Journal of Experimental Psychology Section A 1999 52 2 367 394 1:STN:280:DyaK1MzksleisA%3D%3D 10.1080/713755814
J. Saint-Aubin K. Guérard C. Chamberland A. Malenfant Delineating the contribution of long-term associations to immediate recall Memory 2014 22 4 360 373 10.1080/09658211.2013.794242 23656367
J. Saint-Aubin J.M. Yearsley M. Poirier V. Cyr D. Guitard A model of the production effect over the short-term: The cost of relative distinctiveness Journal of Memory and Language 2021 118 104219 10.1016/j.jml.2021.104219
T. Sanocki N. Sulman Color relations increase the capacity of visual short-term memory Perception 2011 40 6 635 648 10.1068/p6655 21936293
G. Son B.-I. Oh M.-S. Kang S.C. Chong Similarity-based clusters are representational units of visual working memory Journal of Experimental Psychology: Learning, Memory, and Cognition 2020 46 1 46 59 10.1037/xlm0000722 31070398
L. Tan G. Ward Rehearsal in immediate serial recall Psychonomic Bulletin & Review 2008 15 3 535 542 10.3758/PBR.15.3.535
M. Thalmann A.S. Souza K. Oberauer How does chunking help working memory? Journal of Experimental Psychology: Learning, Memory, and Cognition 2019 45 1 37 55 10.1037/xlm0000578 29698045
E. Vergauwe K.O. Hardman J.N. Rouder E. Roemer S. McAllaster N. Cowan Searching for serial refreshing in working memory: Using response times to track the content of the focus of attention over time Psychonomic Bulletin & Review 2016 23 6 1818 1824 10.3758/s13423-016-1038-1
K.M. Visscher E. Kaplan M.J. Kahana R. Sekuler Auditory short-term memory behaves like visual short-term memory PLoS Biology 2007 5 3 e56 1:CAS:528:DC%2BD2sXjtleit74%3D 10.1371/journal.pbio.0050056 17311472 1800308
Z. Wei X.-J. Wang D.-H. Wang From distributed resources to limited slots in multiple-item working memory: A spiking network model with normalization Journal of Neuroscience 2012 32 33 11228 11240 1:CAS:528:DC%2BC38Xht1Ors7%2FF 10.1523/JNEUROSCI.0735-12.2012 22895707
W. Zhang S.J. Luck Discrete fixed-resolution representations in visual working memory Nature 2008 453 7192 233 235 1:CAS:528:DC%2BD1cXls12ms7o%3D 10.1038/nature06860 18385672 2588137