Self-concept in reading: factor structure, cross-cultural invariance and relationships with reading achievement in an international context (PIRLS 2011)
[en] Using data from 48 countries, this study investigated the factorial structure and tested the cross-cultural invariance of the PIRLS 2011 reading self-concept scale and its relationships with reading achievement. The study showed that a two-factorial structure of the self-concept scale in reading had the best fit with the data. Configural invariance and metric invariance were achieved, scalar invariance was not. The two dimensions ‘Perception of competence’ and ‘Perception of difficulty’ showed robust within-country correlations with reading achievement, especially the second one. At the country level, the ‘Perception of competence’ was negatively related with reading, illustrating the attitudes-achievement paradox: countries in which students on average reported a more positive self-concept performed lower. On the contrary, for the ‘Perception of difficulty’, the sign of the correlation remained the same at the within-country and at the country level.
Disciplines :
Education & instruction
Author, co-author :
Lafontaine, Dominique ; Université de Liège - ULiège > Département des Sciences de l'éducation > Analyse des systèmes et pratiques d'enseignement
Dupont, Virginie ; Université de Liège - ULiège > Département des Sciences de l'éducation > Analyse des systèmes et pratiques d'enseignement
Jaegers, Doriane ; Université de Liège - ULiège > Département des Sciences de l'éducation > Analyse des systèmes et pratiques d'enseignement
Schillings, Patricia ; Université de Liège - ULiège > Département des Sciences de l'éducation > Analyse et accompagnement du dével. prof. des enseign.
Language :
English
Title :
Self-concept in reading: factor structure, cross-cultural invariance and relationships with reading achievement in an international context (PIRLS 2011)
Bandura, A., Guide for constructing self-efficacy scales. Pajares, F., Urdan, T., (eds.) Self-efficacy beliefs of adolescents, 2006, Information age., Greenwich, CT, 307–337.
Bong, M., Test of the internal/external frames of reference model with subject-specific academic self-efficacy and frame-specific academic self-concepts. Journal of Educational Psychology 90:s1 (1998), 102–110.
Brown, T.A., Confirmatory Factor Analysis for applied research. second edition, 2015, The Guilford Press, New-York.
Buckley, J., Cross-National response styles in international educational assessments: Evidence from PISA 2006. Retrieved from, 2009 https://edsurveys.rti.org/PISA/documents/Buckley_PISAresponsestyle.pdf.
Byrne, B.M., Shavelson, R.J., On the structure of adolescent self-concept. Journal of Educational Psychology 78 (1986), 474–481, 10.1037//0022-0663.78.6.474.
Cartwright, K.B., Marshall, T.R., Wray, E., A longitudinal study of the role of reading motivation in primary students’ reading comprehension: Implications for a less simple view of reading. Reading Psychology 37:1 (2016), 55–91, 10.1080/02702711.2014.991481.
Chapman, J.W., Tunmer, W.E., Development of young children's reading self-concepts: An examination of emerging subcomponents and their relationship with reading achievement. Journal of Educational Psychology 87 (1995), 154–167.
Chapman, J.W., Tunmer, W.E., Prochnow, J.E., Early reading-related skills and performance, reading self-concept and the development of academic self-concept: A longitudinal study. Journal of Educational Psychology 92:4 (2000), 703–708.
Chen, C., Lee, S., Stevenson, H.W., Response-style and cross-cultural comparisons of rating scales among East Asian and North American students. Psychological Sciences 6 (1995), 170–175, 10.1177/0146621697211001.
Cheung, G.W., Rensvold, R.B., Testing factorial invariance across groups: A reconceptualization and proposed new method. Journal of Management 25 (1999), 1–27, 10.1177/014920639902500101.
Conradi, K., Jang, B.G., McKenna, M.C., Motivation terminology in reading research: A conceptual review. Educational Psychology Review 26 (2014), 127–164, 10.1007/s10648-013-9245-z.
Costello, A.B., Osborne, J.W., Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Practical Assessment 10:7 (2005), 1–9.
Harzing, A.W., Response styles in cross-national survey research: A 26-country study. International Journal of Cross Cultural Management 6 (2006), 243–266, 10.1177/1470595806066332.
He, J., Buchholz, J., Klieme, E., Effects of anchoring vignettes on comparability and predictive validity of student self-reports in 64 cultures. Journal of Cross-cultural Psychology 48 (2017), 319–334, 10.1177/0022022116687395.
He, J., Van de Vijver, F.J.R., Bias and equivalence in cross-cultural research. Online Readings in Psychology and Culture, 2, 2012, 10.9707/2307-0919.1111.
He, J., Van de Vijver, F.J.R., A general response style factor: Evidence from a multi-ethnic study in the Netherlands. Personality and Individual Differences 55 (2013), 794–800, 10.1016/j.paid.2013.06.017.
He, J., Van de Vijver, F.J.R., The value of keeping an open eye for methodological issues in research on resilience and culture. Theron, L., Ungar, M., Liebenberg, L., (eds.) Youth resilience and culture. Commonalities and complexities, 2015, Springer, New York, NY, 189–201.
He, J., Van de Vijver, F.J.R., The motivation-achievement paradox in international educational achievement tests: Toward a better understanding. King, R.B., Bernardo, A.B.I., (eds.) The psychology of Asian learners. A festschrift in honor of David Watkins, 2016, Springer, Singapore, 253–268, 10.1007/978-981-287-576-1.
Heine, S.J., Kitayama, S., Lehman, D.R., Takata, T., Ide, E., Leung, C., et al. Divergent consequences of success and failure in Japan and North America: An investigation of self-improving motivations and malleable selves. Journal of Personality and Social Psychology 81 (2001), 599–615, 10.1037/0022-3514.81.4.599.
Heine, S.J., Lehman, D.R., Peng, K., Greenholtz, J., What's wrong with cross-cultural comparisons of subjective Likert scales: The reference-group problem. Journal of Personality and Social Psychology 82 (2002), 903–918, 10.1037/0022-3514.82.6.903.
Hu, L., Bentler, P.M., Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 6 (1999), 1–55, 10.1080/10705519909540118.
Klauda, S.L., Guthrie, J.T., Comparing relations of motivation, engagement, and achievement among struggling and advanced adolescent readers. Reading and Writing 28 (2014), 239–269.
Kline, R.B., Principles and practice of structural equation modeling. 2nd ed., 2005, Guilford Press, New York, NY.
Kobayashi, C., Greenwald, A.J., Implicit-explicit differences in self-enhancement for Americans and Japanese. Journal of Cross-cultural Psychology 34 (2003), 522–541, 10.1177/0022022103257855.
Kurman, J., Why is self-enhancement low in certain collectivist cultures? An investigation of two competing explanations. Journal of Cross-cultural Psychology 34 (2003), 496–510, 10.1177/0022022103256474.
Kyllonen, P., Bertling, J., Innovative questionnaire assessment methods to increase cross-cultural comparability. Rutkowski, L., von Davier, M., Rutkwoshi, D., (eds.) Handbook of International large-scale assessment: Background, technical issues and methods of data analysis, 2013, Chapman & Hall/CRC, Boca Raton, FL, 277–285.
Lee, C., Green, R.T., Cross-cultural examination of the fishbein behavioral intentions model. Journal of International Business Studies 22 (1991), 289–305, 10.1057/palgrave.jibs.8490304.
Lie, S., Turmo, A., Cross-country comparability of students’ self-reports evidence from PISA 2003. Internal working OECD/PISA document, TAG(0505)11, 2005.
Little, T.D., Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research 32 (1997), 53–76.
Lu, Y., Bolt, D., Examining the attitude-achievement paradox in PISA using a multilevel multidimensional IRT model for extreme response style. Large-scale Assessments in Education, 3, 2015, 10.1186/s40536-015-0012-0.
Marsh, H.W., Verbal and math self-concepts: An internal/external frame of reference model. American Research Journal 23 (1986), 129–149.
Marsh, H.W., Byrne, B.M., Shavelson, R.J., A multifaceted academic self-concept: Its hierarchical structure and its relations to academic achievement. Journal of Educational Psychology 80:3 (1988), 366–380, 10.1037/0022-0663.80.3.366.
Marsh, H.W., Hau, K.-T., Grayson, D., Goodness of fit evaluation in structural equation modelling. Maydeu-Olivares, A., McArdle, J., (eds.) Contemporary psychometrics: A festschrift for Roderick P. McDonald, 2005, Erlbaum, Mahwah, NJ, 275–340.
Marsh, H.W., Trautwein, U., Lüdtke, O., Köller, O., Baumert, J., Academic self-concept, interest, grades, and standardized test scores: Reciprocal effects models of causal ordering. Child Development vol. 76:March-April (2) (2005), 397–416.
Marsh, H.W., Scalas, L.F., Nagengast, B., Longitudinal test of competing factor structure for the Rosenberg self-esteem scale: Traits, ephemeral artifacts and stable response styles. Psychological Assessment 22:2 (2010), 366–381.
Meredith, W., Measurement invariance, factor analysis, and factorial invariance. Psychometrika 58 (1993), 525–542, 10.1007/BF02294825.
Morgan, P.L., Fuchs, D., Is there a bidirectional relationship between children's reading skills and reading motivation?. Exceptional Children 73:2 (2007), 165–183.
Mullis, I., Martin, M.O., Kennedy, A.M., Trong, K.L., Sainsbury, M., PIRLS 2011 assessment framework. 2013, IEA International Association for the Evaluation of Educational Achievement. Boston College.
Muthén, L., Muthén, B., Mplus user's guide. 2015, seventh edition, 1998, Muthén & Muthén, Los Angeles, CA.
Park, Y., How motivational constructs interact to predict elementary students’ reading performance: Examples from attitudes and self-concept in reading. Learning and Individual Differences 21 (2011), 347–358.
Paulhus, D.L., Measurement and control of response bias. Robinson, J.P., Shaver, P.R., Wrightsman, L.S., (eds.) Measures of personality and social psychological attitudes, 1991, Academic Press, Inc, San Diego, CA, 17–59.
Peng, K., Nisbett, R.E., Wong, N.Y., Validity problems comparing values cultures and possible solutions. Psychological Methods 2 (1997), 329–344, 10.1037/1082-989X.2.4.329.
Podsakoff, P.M., McKenzie, S.B., Lee, J.Y., Podsakoff, N.P., Common method biases in behavioural research: A critical review of the literature and recommended remedies. The Journal of Applied Psychology 88 (2003), 879–903, 10.1037/0021-9010.88.5.879.
Retelsdorf, J., Köller, O., Möller, J., Reading achievement and reading self-concept – Testing the reciprocal effects model. Learning and Instruction 29 (2014), 21–30.
Rutkowski, L., Svetina, D., Assessing the hypothesis of measurement invariance in the context of large-scale international surveys. Educational and Psychological Measurement 74 (2014), 31–57, 10.1177/0013164413498257.
Shen, C., Tam, H.P., The paradoxical relationship between student achievement and self-perception: a cross-national analysis based on three waves of TIMSS data. Educational Research and Evaluation 14 (2008), 87–100, 10.1080/13803610801896653.
Takahashi, K., Ohara, N., Antonucci, T.C., Akiyama, H., Commonalities and differences in close relationships among the Americans and Japanese: A comparison by the individualism/collectivism concept. International Journal of Behavioral Development 26 (2002), 453–465, 10.1080/01650250143000418.
Unrau, N.J., Rueda, R., Son, E., Polanin, J.R., Lundeen, R.J., Muraszewski, A.K., Can reading self-efficacy be modified? A meta-analysis of the impact of interventions on reading self-efficacy. Review of Educational Research 88:2 (2018), 167–204, 10.3102/00344654317743199.
Van de Gaer, E., Adams, R., The modeling of response-style bias: An Answer to the attitude-achievement paradox?. Paper Presented at the Annual Conference of the AERA, 2010.
Van de Gaer, E., Grisay, A., Schlutz, W., Gebhardt, E., The reference group effect: An explanation of the paradoxical relationship between academic achievement and self-confidence across countries. Journal of Cross-cultural Psychology 43 (2012), 1205–1228, 10.1177/0022022111428083.
Van de Vijver, F.J.R., He, J., Report on social desirability, midpoint and extreme responding in TALIS 2013. OECD education working papers, No. 107, 2014, OECD Publishing., Paris, France.
Van de Vijver, F.J.R., Poortinga, Y., Cross-Cultural generalization and universality. Journal of Cross-cultural Psychology 13 (1982), 387–408, 10.1177/0022002182013004001.
Van de Vijver, F.J.R., Tanzer, N.K., Bias and equivalence in cross-cultural assessment: An overview. Revue Européenne de Psychologie Appliquée/European Review of Applied Psychology 54 (2004), 119–135, 10.1016/j.erap.2003.12.004.
Van Herk, H., Poortinga, Y.H., Verhallen, T.M.M., Response styles in rating scales: Evidence of method bias in data from 6 EU countries. Journal of Cross-cultural Psychology 35 (2004), 346–360, 10.1177/0022022104264126.
Vieluf, S., Kunter, M., van de Vijver, F.J.R., Teacher self-efficacy in cross-national perspective. Teaching and Teacher Education 35 (2013), 92–103, 10.1016/j.tate.2013.05.006.
Yang, Y., Harkness, J.A., Chin, T.-Y., Villar, A., et al. Response styles and culture. Harkness, J.A., Braun, M., Edwards, B., Johnson, T.P., Lyberg, L., Mohler, P.P., (eds.) Survey methods in multinational, multiregional, and multicultural contexts, 2010, John Wiley & sons, USA, 203–223.
