Working memory; Semantic knowledge; Computational models; TBRS
Abstract :
[en] It is now firmly established that long-term memory knowledge, such as semantic knowledge, supports the temporary maintenance of verbal information in Working Memory (WM). This support from semantic knowledge is well-explained by models assuming that verbal items are directly activated in long-term memory, and that this activation provides the representational basis for WM maintenance. However, the exact mechanisms underlying semantic influence on WM performance remain poorly understood. We manipulated the presence of between-item semantic relatedness in an immediate serial recall task, by mixing triplets composed of semantically related and unrelated items (e.g. leaf – tree – branch – wall – beer – dog; hand – father – truck – cloud – sky – rain). Compared to unrelated items, related items were better recalled, as had been classically observed. Critically, semantic relatedness also impacted WM maintenance in a complex manner, as observed by the presence of proactive benefit effects on subsequent unrelated items, and the absence of retroactive effects. The complexity of these interactions is well-captured by TBRS*-S, a decay-based computational architecture in which the activation occurring in long-term memory is described. The present study suggests that semantic knowledge can be used to free up WM resources that can be reallocated for maintenance purposes, and supports models postulating that long-term memory knowledge constrains WM maintenance processes.
Disciplines :
Theoretical & cognitive psychology
Author, co-author :
Kowialiewski, Benjamin ; Université de Liège - ULiège > Département de Psychologie > Département de Psychologie
Lemaire, Benoît
Portrat, Sophie
Language :
English
Title :
How Does Semantic Knowledge Impact Working Memory Maintenance? Computational and Behavioral Investigations
Abrahamse, E., van Dijck, J.-P., Majerus, S., Fias, W., Finding the answer in space: The mental whiteboard hypothesis on serial order in working memory. Frontiers in Human Neuroscience, 8, 2014, 10.3389/fnhum.2014.00932.
Acheson, D.J., MacDonald, M.C., Verbal Working Memory and Language Production: Common Approaches to the Serial Ordering of Verbal Information. Psychological Bulletin 135:1 (2009), 50–68, 10.1037/a0014411.
Acheson, D.J., Postle, B.R., MacDonald, M.C., The Interaction of Concreteness and Phonological Similarity in Verbal Working Memory. Journal of Experimental Psychology: Learning Memory and Cognition 36:1 (2010), 17–36, 10.1037/a0017679.
Baddeley, A.D., Short-term Memory for Word Sequences as a Function of Acoustic, Semantic and Formal Similarity. Quarterly Journal of Experimental Psychology 18:4 (1966), 362–365.
Baddeley, A.D., Thomson, N., Buchanan, M., Word length and the structure of short-term memory. Journal of Verbal Learning and Verbal Behavior 14:6 (1975), 575–589.
Baguley, T., Calculating and graphing within-subject confidence intervals for ANOVA. Behavior Research Methods 44:1 (2012), 158–175.
Barrouillet, P., Bernardin, S., Camos, V., Time constraints and resource sharing in adults’ working memory spans. Journal of Experimental Psychology: General 133:1 (2004), 83–100, 10.1037/0096-3445.133.1.83.
Barrouillet, P., Portrat, S., Camos, V., On the Law Relating Processing to Storage in Working Memory. Psychological Review 118:2 (2011), 175–192, 10.1037/a0022324.
Besner, D., Risko, E.F., Thinking outside the box when reading aloud: Between (localist) module connection strength as a source of word frequency effects. Psychological Review 123:5 (2016), 592–599, 10.1037/rev0000041.
Brener, R., An experimental investigation of memory span. Journal of Experimental Psychology 26:5 (1940), 467–482.
Burgess, N., Hitch, G.J., A revised model of short-term memory and long-term learning of verbal sequences. Journal of Memory and Language 55:4 (2006), 627–652.
Bürkner, P.-C., brms: An R Package for Bayesian Multilevel Models Using Stan. Journal of Statistical Software, 80(1), 2017 https://doi.org/10.18637/jss.v080.i01.
Camos, V., Johnson, M., Loaiza, V., Portrat, S., Souza, A., Vergauwe, E., What is attentional refreshing in working memory?. Annals of the New York Academy of Sciences 1424:1 (2018), 19–32, 10.1111/nyas.13616.
Campoy, G., Baddeley, A., Phonological and semantic strategies in immediate serial recall. Memory 16:4 (2008), 329–340.
Campoy, G., Castellà, J., Provencio, V., Hitch, G.J., Baddeley, A.D., Automatic semantic encoding in verbal short-term memory: Evidence from the concreteness effect. The Quarterly Journal of Experimental Psychology 68:4 (2015), 759–778, 10.1080/17470218.2014.966248.
Castellà, J., Campoy, G., The (lack of) effect of dynamic visual noise on the concreteness effect in short-term memory. Memory 26:10 (2018), 1355–1363.
Chekaf, M., Cowan, N., Mathy, F., Chunk formation in immediate memory and how it relates to data compression. Cognition 155 (2016), 96–107.
Chen, Q., Mirman, D., Competition and cooperation among similar representations: Toward a unified account of facilitative and inhibitory effects of lexical neighbors. Psychological Review 119:2 (2012), 417–430, 10.1037/a0027175.
Chubala, C., Surprenant, A.M., Neath, I., Quinlan, P.T., Does dynamic visual noise eliminate the concreteness effect in working memory?. Journal of Memory and Language 102:May (2018), 97–114, 10.1016/j.jml.2018.05.009.
Cousineau, D., Erratum to Cousineau (2005): Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method. Tutorials in Quantitative Methods for Psychology, 8(3), 2012, 182 10.20982/tqmp.08.3.p182.
Cowan, N., Attention and memory: An integrated framework. 1995, Oxford University Press, Oxford, England.
Cowan, N., The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences 24:1 (2001), 87–185, 10.1017/S0140525X01003922.
Cowan, N., Day, L., Saults, J.S., Keller, J., Johnson, T., Flores, L., The role of verbal output time in the effects of word length on immediate memory. Journal of Memory and Language 31:1 (1992), 1–17, 10.1016/0749-596X(92)90002-F.
Cowan, N., Elliott, E.M., Saults, J.S., Nugent, L.D., Bomb, P., Hismjatullina, A., Rethinking Speed Theories of Cognitive Development. Increasing the Rate of Recall Without Affecting Accuracy. Psychological Science 17:1 (2006), 67–73.
Cowan, N., Saults, J.S., Elliott, E.M., Moreno, M.V., Deconfounding Serial Recall. Journal of Memory and Language 46:1 (2002), 153–177.
Dagry, I., Barrouillet, P., The fate of distractors in working memory: No evidence for their active removal. Cognition 169 (2017), 129–138, 10.1016/j.cognition.2017.08.011.
Farrell, S., Lewandowsky, S., Modelling transposition latencies: Constraints for theories of serial order memory. Journal of Memory and Language 51:1 (2004), 115–135, 10.1016/j.jml.2004.03.007.
Farrell, S., Lewandowsky, S., Computational Models as Aids to Better Reasoning in Psychology. Current Directions in Psychological Science 19:5 (2010), 329–335.
Farrell, S., Oberauer, K., Greaves, M., Pasiecznik, K., Lewandowsky, S., Jarrold, C., A test of interference versus decay in working memory: Varying distraction within lists in a complex span task. Journal of Memory and Language 90 (2016), 66–87, 10.1016/j.jml.2016.03.010.
Gorin, S., Kowialiewski, B., Majerus, S., Domain-generality of timing-based serial order processes in short-term memory: New insights from musical and verbal domains. PLoS ONE 11:12 (2016), 1–25, 10.1371/journal.pone.0168699.
Guitard, D., Gabel, A.J., Saint-Aubin, J., Surprenant, A.M., Neath, I., Word length, set size, and lexical factors: Re-examining what causes the word length effect. Journal of Experimental Psychology: Learning, Memory, and Cognition 44:11 (2018), 1824–1844, 10.1037/xlm0000551.
Haarmann, H., Usher, M., Maintenance of semantic information in capacity-limited item short-term memory. Psychonomic Bulletin & Review 8:3 (2001), 568–578.
Haberlandt, K., Thomas, J.G., Lawrence, H., Krohn, T., Transposition asymmetry in immediate serial recall. Memory 13:3-4 (2005), 274–282.
Hanley, R.J., Bakopoulou, E., Irrelevant speech, articulatory suppression, and phonological similarity: A test of the phonological loop model and the feature model. Psychonomic Bulletin & Review 10:2 (2003), 435–444.
Hartley, T., Hurlstone, M.J., Hitch, G.J., Effects of rhythm on memory for spoken sequences: A model and tests of its stimulus-driven mechanism. Cognitive Psychology 87 (2016), 135–178, 10.1016/j.cogpsych.2016.05.001.
Henson, R.N.A., Short-term memory for serial order: The start-end model. Cognitive Psychology 36:2 (1998), 73–137.
Henson, R.N.A., Hartley, T., Burgess, N., Hitch, G., Flude, B., Selective interference with verbal short-term memory for serial order information: A new paradigm and tests of a timing-signal hypothesis. The Quarterly Journal of Experimental Psychology 56A:8 (2003), 1307–1334, 10.1080/02724980244000747.
Hofmann, M.J., Jacobs, A.M., Interactive activation and competition models and semantic context: From behavioral to brain data. Neuroscience and Biobehavioral Reviews 46:P1 (2014), 85–104, 10.1016/j.neubiorev.2014.06.011.
Hurlstone, M.J., Hitch, G.J., How is the serial order of a spatial sequence represented? Insights from transposition latencies. Journal of Experimental Psychology: Learning, Memory, and Cognition 41:2 (2015), 295–324, 10.1037/a0038223.
Jalbert, A., Neath, I., Bireta, T.J., Surprenant, A.M., When does length cause the word length effect?. Journal of Experimental Psychology: Learning, Memory, and Cognition 37:2 (2011), 338–353, 10.1037/a0021804.
Jefferies, E., Frankish, C.R., Lambon Ralph, M.A., Lexical and semantic binding in verbal short-term memory. Journal of Memory and Language 54:1 (2006), 81–98.
Jeffreys, H., The theory of probability. 1998, Oxford University Press, Oxford, UK.
Jolicœur, P., Dell'Acqua, R., The Demonstration of Short-Term Consolidation. Cognitive Psychology 36:2 (1998), 138–202.
Kowialiewski, B., Majerus, S., The non-strategic nature of linguistic long-term memory effects in verbal short-term memory. Journal of Memory and Language 101 (2018), 64–83.
Kowialiewski, B., Majerus, S., The varying nature of semantic effects in working memory. Cognition, 202, 2020, 104278, 10.1016/j.cognition.2020.104278.
Kuznetsova, A., Brockhoff, P.B., Christensen, R.H., lmerTest package: tests in linear mixed effects models. Journal of statistical software 82:13 (2017), 1–26.
Lemaire, B., Pageot, A., Plancher, G., Portrat, S., What is the time course of working memory attentional refreshing?. Psychonomic Bulletin & Review 25:1 (2018), 370–385.
Lemaire, B., Portrat, S., A Computational Model of Working Memory Integrating Time-Based Decay and Interference. Frontiers in Cognitive Psychology 9 (2018), 1–16, 10.3389/fpsyg.2018.00416.
Lewandowsky, S., Murdock, B.B., Memory for serial order. Psychological Review 96:1 (1989), 25–57.
Lewandowsky, S., Oberauer, K., The word-length effect provides no evidence for decay in short-term memory. Psychonomic Bulletin & Review 15:5 (2008), 875–888.
Logie, R.H., Della Sala, S., Laiacona, M., Chalmers, P., Wyn, V., Group aggregates and individual reliability: The case of verbal short-term memory. Memory & Cognition 24:3 (1996), 305–321, 10.3758/BF03213295.
Lovatt, P., Avons, S.E., Masterson, J., Output Decay in Immediate Serial Recall: Speech Time Revisited. Journal of Memory and Language 46:1 (2002), 227–243, 10.1006/jmla.2001.2806.
Majerus, S. (2009). Verbal short-term memory and temporary activation of language representations: The importance of distinguishing item and order information. In Interactions between short-term and long-term memory in the verbal domain (p. 244).
Majerus, S., Language repetition and short-term memory: An integrative framework. Frontiers in Human Neuroscience, 7, 2013, 357, 10.3389/fnhum.2013.00357.
Majerus, S., Verbal working memory and the phonological buffer: The question of serial order. Cortex, 1–12, 2019, 10.1016/j.cortex.2018.04.016.
Martin, N., Saffran, E.M., Dell, G.S., Recovery in deep dysphasia: Evidence for a relation between auditory–verbal STM capacity and lexical errors in repetition. Brain and Language 52:1 (1996), 83–113.
Mathôt, S., Schreij, D., Theeuwes, J., OpenSesame: An open-source, graphical experiment builder for the social sciences. Behavior Research Methods 44:2 (2012), 314–324, 10.3758/s13428-011-0168-7.
McClelland, J.L., Rumelhart, D.E., An interactive activation model of context effects in letter perception: Part 1. An account of basic findings. Psychological Review, 88(5), 1981, 375.
Miller, L.M., Roodenrys, S., The interaction of word frequency and concreteness in immediate serial recall. Memory & Cognition 37:6 (2009), 850–865.
Miller, L.M., Roodenrys, S., Serial recall, word frequency, and mixed lists: The influence of item arrangement. Journal of Experimental Psychology: Learning, Memory, and Cognition 38:6 (2012), 1731–1740, 10.1037/a0028470.
Monnier, C., Bonthoux, F., The semantic-similarity effect in children: Influence of long-term knowledge on verbal short-term memory. British Journal of Developmental Psychology 29:4 (2011), 929–941, 10.1111/j.2044-835X.2010.02024.x.
Morey, R.D., Confidence Intervals from Normalized Data: A correction to Cousineau (2005). Tutorial in Quantitative Methods for Psychology 4:2 (2008), 61–64.
Morey, R. D., & Rouder, J. N. (2014). BayesFactor: Computation of Bayes factors for common designs (Version 0.9.2+) (p. https://richarddmorey.github.io/BayesFactor/).
Neely, J.H., Semantic priming and retrieval from lexical memory: Roles of inhibitionless spreading activation and limited-capacity attention. Journal of Experimental Psychology: General 106:3 (1977), 226–254, 10.1037/0096-3445.106.3.226.
Norris, D. (2017). Short-Term Memory and Long-Term Memory are Still Different. Psychological Bulletin, 143(9), 992.
Norris, D., Even an activated long-term memory system still needs a separate short-term store: A reply to cowan (2019). Psychological Bulletin 145:8 (2019), 848–853, 10.1037/bul0000204.
Norris, D., Kalm, K., Hall, J., Chunking and redintegration in verbal short-term memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 46:5 (2020), 872–893, 10.1037/xlm0000762.
Oberauer, K., Access to information in working memory: Exploring the focus of attention. Journal of Experimental Psychology: Learning, Memory, and Cognition 28:3 (2002), 411–421, 10.1037//0278-7393.28.3.411.
Oberauer, K., Understanding serial position curves in short-term recognition and recall. Journal of Memory and Language 49:4 (2003), 469–483, 10.1016/S0749-596X(03)00080-9.
Oberauer, K. (2009). Design for a Working Memory. In The Psychology of Learning and Motivation (1re éd., Vol. 51, Numéro 09). Elsevier Inc. https://doi.org/10.1016/S0079-7421(09)51002-X.
Oberauer, K., Is Rehearsal an Effective Maintenance Strategy for Working Memory?. Trends in Cognitive Sciences 23:9 (2019), 798–809.
Oberauer, K., Awh, E., Sutterer, D.W., The role of long-term memory in a test of visual working memory: Proactive facilitation but no proactive interference. Journal of Experimental Psychology: Learning, Memory, and Cognition 43:1 (2017), 1–22, 10.1037/xlm0000302.
Oberauer, K., Farrell, S., Jarrold, C., Lewandowsky, S., What limits working memory capacity?. Psychological Bulletin 142:7 (2016), 758–799, 10.1037/bul0000046.
Oberauer, K., Farrell, S., Jarrold, C., Pasiecznik, K., Greaves, M., Interference between maintenance and processing in working memory: The effect of item-distractor similarity in complex span. Journal of Experimental Psychology: Learning Memory and Cognition 38:3 (2012), 665–685, 10.1037/a0026337.
Oberauer, K., Lewandowsky, S., Modeling working memory: A computational implementation of the Time-Based Resource-Sharing theory. Psychonomic Bulletin & Review 18:1 (2011), 10–45, 10.3758/s13423-010-0020-6.
Oberauer, K., Lewandowsky, S., Awh, E., Brown, G.D.A., Conway, A.R.A., Cowan, N., Ward, G., Benchmarks for models of short term and working memory. Psychological Bulletin, 1–154, 2018, 10.1037/h0021468.
Oberauer, K., Lewandowsky, S., Farrell, S., Jarrold, C., Greaves, M., Modeling working memory: An interference model of complex span. Psychonomic Bulletin & Review 19:5 (2012), 779–819, 10.3758/s13423-012-0272-4.
Patterson, K., Graham, N., Hodges, J.R., The Impact of Semantic Memory Loss on Phonological Representations. Journal of Cognitive Neuroscience 6:1 (1994), 57–69.
Poirier, M., Saint-Aubin, J., Memory for related and unrelated words: Further evidence on the influence of semantic factors in immediate serial recall. The Quarterly Journal of Experimental Psychology 48:2 (1995), 384–404, 10.1080/14640749508401396.
Poirier, M., Saint-Aubin, J., Immediate Serial Recall, Word Frequency, Item Identity and Item Position. Canadian Journal of Experimental Psychology 50:4 (1996), 408–412.
Popov, V., Reder, L.M., Frequency effects on memory: A resource-limited theory. Psychological Review 127:1 (2020), 1–46, 10.1037/rev0000161.
Portrat, S., Guida, A., Phénix, T., Lemaire, B., Promoting the experimental dialogue between working memory and chunking: Behavioral data and simulation. Memory and Cognition 44:3 (2016), 420–434, 10.3758/s13421-015-0572-9.
Python, G., Fargier, R., Laganaro, M., ERP evidence of distinct processes underlying semantic facilitation and interference in word production. Cortex 99 (2018), 1–12.
R Development Core Team, R: A language and environment for statistical computing. 2008, R Foundation for Statistical Computing, Vienna, Austria.
Ricker, T.J., Sandry, J., Vergauwe, E., Cowan, N., Do familiar memory items decay?. Journal of Experimental Psychology: Learning, Memory, and Cognition 46:1 (2020), 60–76, 10.1037/xlm0000719.
Ricker, T.J., Vergauwe, E., Cowan, N., Decay Theory of Immediate Memory: From Brown (1958) to Today (2014). Quarterly Journal of Experimental Psychology 69:10 (2016), 1969–1995, 10.1080/17470218.2014.914546.
Romani, C., McAlpine, S., Martin, R.C., Concreteness effects in different tasks: Implications for models of short-term memory. The Quarterly Journal of Experimental Psychology 61:2 (2008), 292–323, 10.1080/17470210601147747.
Roodenrys, S., Hulme, C., Lethbridge, A., Hinton, M., Nimmo, L.M., Word-frequency and phonological-neighborhood effects on verbal short-term memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 28:6 (2002), 1019–1034, 10.1037/0278-7393.28.6.1019.
Saint-Aubin, J., Ouellette, D., Semantic similarity and immediate serial recall: Is there an effect on all trials. Psychonomic Bulletin & Review 12 (2005), 171–177.
Savill, N., Metcalfe, T., Ellis, A.W., Jefferies, E., Semantic categorisation of a word supports its phonological integrity in verbal short-term memory. Journal of Memory and Language 84 (2015), 128–138.
Schönbrodt, F.D., Wagenmakers, E.-J., Zehetleitner, M., Perugini, M., Sequential Hypothesis Testing With Bayes Factors: Efficiently Testing Mean Differences. Psychological Methods, 22(2), 2017, 322, 10.1037/met0000061.
Slowiaczek, L.M., Semantic Priming in a Single-Word Shadowing Task. The American Journal of Psychology, 107(2), 1994, 245, 10.2307/1423039.
Tan, L., Ward, G., Rehearsal in immediate serial recall. Psychonomic Bulletin & Review 15:3 (2008), 535–542.
Thalmann, M., Souza, A.S., Oberauer, K., How Does Chunking Help Working Memory?. Journal of Experimental Psychology: Learning, Memory, and Cognition, 2018.
Tse, C.-S., The role of associative strength in the semantic relatedness effect on immediate serial recall. Memory 17:8 (2009), 874–891.
Tse, C.-S., Li, Y., Altarriba, J., The effect of semantic relatedness on immediate serial recall and serial recognition. Quarterly Journal of Experimental Psychology 64:12 (2011), 2425–2437.
Vandierendonck, A., A comparison of methods to combine speed and accuracy measures of performance: A rejoinder on the binning procedure. Behavior Research Methods 49:2 (2017), 653–673, 10.3758/s13428-016-0721-5.
Vergauwe, E., Cowan, N., Attending to items in working memory: Evidence that refreshing and memory search are closely related. Psychonomic Bulletin & Review 22:4 (2015), 1001–1006, 10.3758/s13423-014-0755-6.
Vergauwe, E., Hardman, K.O., Rouder, J.N., Roemer, E., Mcallaster, S., Cowan, N., Searching for serial refreshing in working memory: Using response times to track the content of the focus of attention over time. Psychonomic Bulletin & Review 23:6 (2016), 1818–1824, 10.3758/s13423-016-1038-1.
Vitevitch, M.S., Luce, P.A., Phonological Neighborhood Effects in Spoken Word Perception and Production. Annual Review of Linguistics 2:1 (2016), 75–94.
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., & van der Maas, H. L. J. (2011). Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011). https://doi.org/10.1037/a0022790.
Walker, I., Hulme, C., Concrete Words Are Easier to Recall Than Abstract Words: Evidence for a Semantic Contribution to Short-Term Serial Recall. Journal of Experimental Psychology: Learning, Memory, and Cognition 25:5 (1999), 1256–1271.
Xie, W., Zhang, W., Familiarity increases the number of remembered Pokémon in visual short-term memory. Memory & Cognition 45:4 (2017), 677–689.
Zevin, J.D., Seidenberg, M.S., Age of Acquisition Effects in Word Reading and Other Tasks. Journal of Memory and Language 47:1 (2002), 1–29.
Zwitserlood, P., The locus of the effects of sentential-semantic context in spoken-word processing. Cognition 32:1 (1989), 25–64.