international large scale assessments; reading literacy; response-styles; equity; opportunity to learn
Abstract :
[en] Using data from PISA 2009, the present study investigates firstly how equally students are exposed to opportunities to improve their reading skills (OTL) depending on the school they are enrolled in, and secondly the links between OTL in reading and achievement at the school level. A multidimensional within-item IRT is used to model the OTL. The intraclass correlation of both OTL dimensions issued from the IRT analysis – reading fiction and reading non-continuous tasks – is high, especially in differentiated education systems, showing an unequal exposure to OTL in reading according to the school. Robust correlations between the two OTL dimensions and reading achievement are observed at the school level. In addition, the results of a multilevel regression analysis show that a substantial proportion of the between-school variance in reading can be explained by OTL and by the school social intake. The proportion of between-school variance explained jointly by OTL and social intake is higher in differentiated education systems than in comprehensive ones.
Disciplines :
Education & instruction
Author, co-author :
Lafontaine, Dominique ; Université de Liège > Département Education et formation > Analyse des systèmes et pratiques d'enseignement
Baye, Ariane ; Université de Liège > Département Education et formation > Gest.div.& lutte ctre décroch.& l'excl.ds syst.d'ens.& form.
Vieluf, Svenja; German Institute for International Education Research - Germany
Monseur, Christian ; Université de Liège > Département Education et formation > Psychométrie et édumétrie
Language :
English
Title :
Equity in opportunity-to-learn and achievement in reading: A secondary analysis of PISA 2009 data
Adams R.J., Wilson M., Wang W.C. The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement 1997, 21:1-23.
Buckley J. Cross-national response styles in international educational assessments: Evidence from PISA 2006 2009, https://edsurveys.rti.org/PISA/documents/Buckley_PISAresponsestyle.pdf.
Cheung G.W., Rensvold R.B. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal 2002, 9:233-255. 10.1207/S15328007SEM0902_5.
Davidov E. A cross-country and cross-time comparison of the human values measurements with the second round of the European Social Survey. Survey Research Methods 2008, 2:33-46.
Dubet Les places et les chances. Repenser la justice sociale 2010, Le Seuil, Paris.
Duru-Bellat Le mérite contre la justice 2009, Presses de Sciences po, Paris.
EGREES Equity in European educational systems: A set of indicators. European Educational Research Journal 2005, 4(2):1-151.
Felouzis G. Les inégalités scolaires 2014, Presses Universitaires de France, Paris.
Floden R.E. The measurement of opportunity-to-learn. Methodological advances in cross-national surveys of educational achievement 2002, 231-267. National Academy Press, Washington, DC. A.C. Porter, A. Gamoran (Eds.).
Grisay A. Quels indicateurs pour quelle réduction des inégalités scolaires?. Revue de la Direction générale de l'organisation des études 1984, 9:3-14.
Grisay A. Opportunity to learn in grade 4 classes: Reading instruction. A view inside primary schools: A World Education Indicators (WEI) cross-national study 2008, 175-207. UNESCO Institute of Statistics, Montreal. Y. Zhang, T.N. Postlethwaite, A. Grisay (Eds.).
Guiton G., Oakes J. Opportunity to learn and conceptions of educational equality. Educational Evaluation and Policy Analysis 1995, 17(3):323-336.
Harzing A.W.K. Rating versus ranking: What is the best way to reduce response and language bias in cross-national research?. International Business Review 2009, 18(4):417-432. 26 collaborators.
Hattie J. Visible learning. A synthesis of over 800 meta-analyses relating to achievement 2009, Routledge, New York.
Johnson T.J., Kulesa P., Cho Y., Shavitt S. The relation between culture and styles: Evidence from 19 countries. Journal of Cross-Cultural Psychology 2005, 36(2):264-277.
Klieme E., Warwas J. Konzepte der Individuellen Förderung. Zeitschrift für Pädagogik 2011, 57(6):805-818.
Kyllonen P.C., Bertling J.P. Innovative questionnaire assessment methods to increase cross-country comparability. Handbook of international large-scale assessment data analysis 2014, Chapman and Hall/CRC, London. L. Rutkowski, M. von Davier, D. Rutkowski (Eds.).
Lankes E.-M. Leseunterricht in der Grundschule. Unterschiede zwischen Lehrkräften im Internationalen Vergleich. Zeitschrift für Erziehungswissenschaft 2004, 7:551-568.
Leinhardt G., Zigmond N., Cooley W.W. Reading instruction and its effects. American Educational Research Journal 1981, 18(3):343-361.
Lundberg I. The teaching of reading. The IEA study of reading literacy: Achievement and instruction in thirty-two school systems 1994, 149-193. Pergamon. W.B. Elley (Ed.).
Martinez F. Consequences of omitting the classroom level in multilevel models of schooling: An illustration using opportunity-to-learn and reading achievement. School Effectiveness and School Improvement 2012, 23(3):305-320.
Martinez F., Goldschmidt P. Comparing student and teacher reports on opportunity-to-learn and their relationship to student achievement: A multilevel analysis approach. Paper presented at the Annual meeting of the American Educational Research Association 2003.
McDonnell L.M. Opportunity to learn as a research concept and a policy instrument. Educational Evaluation and Policy Analysis 1995, 17(3):305-322.
Reading comprehension strategies: Theories, interventions and technologies 2007, L. Erlbaum, NJ. D.S. McNamara (Ed.).
Meuret D. Rawls, l'éducation et l'égalité des chances. La justice du système éducatif 1999, De Boeck Université, Bruxelles. D. Meuret (Ed.).
Mons N. Les nouvelles politiques éducatives 2007, PUF, Paris.
Monseur C., Lafontaine D. L'organisation des systèmes éducatifs: quel impact sur l'efficacité et l'équité?. L'efficacité en éducation, promesses et zones d'ombre 2009, 141-165. De Boeck, Brussels. V. Dupriez, X. Dumay (Eds.).
Monseur C., Lafontaine D. Structure des systèmes éducatifs et équité : un éclairage international. L'école peut-elle être juste et efficace 2012, 185-221. De Boeck, Brussels. M. Crahay (Ed.).
Monseur, C., Baye, A., Magis, D., Vieluf, S., & Lafontaine, D. (in preparation). Towards a more valid measure of reading opportunities-to-learn in international large-scale assessments.
Muthén B., Huang L.-C., Jo B., Khoo S.-T., Goff G.N., Novak J.R., et al. Opportunity-to-learn effects on achievement: Analytical aspects. Educational Evaluation and Policy Analysis 1995, 20(3):371-403.
Noortgate W., Opdenakker M.-C., Onghena P. The effects of ignoring a level in multilevel analysis. School Effectiveness and School Improvement 2005, 16(3):281-303.
Oakes J., Gamoran A., Page R.N. Curriculum differentiation: Opportunities, outcomes, and meanings. Handbook of research on curriculum 1992, 570-608. Macmillan, New York. P.W. Jackson (Ed.).
OECD PISA 2009 assessment framework. Key competencies in reading, mathematics and science 2009, OECD, Paris.
OECD PISA 2009 results: What students know and can do: Student performance in reading, mathematics and science 2010, OECD, Paris.
OECD PISA 2009 results: Overcoming social background. Equity in learning opportunities and outcomes 2010, OECD, Paris.
OECD PISA 2012 results: What makes schools successful? Resources, policies and practices 2013, OECD, Paris.
Paris S., Wasik B., Turner J. The development of strategic readers. Handbook of reading research 1991, Vol. I:609-640. L. Erlbaum, NJ.
Podsakoff P.M., MacKenzie S.B., Lee J.-Y., Podsakoff N.P. Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology 2003, 88(5):879-903.
Pressley M. What should comprehension instruction be the instruction of?. Handbook of reading research 2000, Vol. III:545-563. L. Erlbaum, NJ.
Rawls J. A theory of justice 1971, University Press, Oxford.
Rocereto J.F., Puzakova M., Anderson R.E., Kwak H. The role of response formats on extreme response style: A case of Likert-type vs. semantic differential scales. Measurement and research methods in international marketing (Advances in international marketing, Vol. 22) 2011, 53-71. Emerald Group Publishing Limited. M. Sarstedt, M. Schwaiger, C.R. Taylor (Eds.).
Rosenshine B., Meister C. Cognitive strategy instruction in reading. Instructional models in reading 1997, 85-107. L. Erlbaum, NJ. A. Stahl, A. Hayes (Eds.).
Schmidt W.H., Maier A. Opportunity to learn. Handbook of education policy research 2009, Routledge, New York. G. Sykes, B. Schneider, D.N. Plank (Eds.).
Schmidt W.H., McKnight C.C. Surveying educational opportunity in mathematics and science: An international perspective. Educational Evaluation and Policy Analysis 1995, 17(3):337-353.
Sen A. Inequality re-examined 1992, Oxford University Press, Oxford.
Shanahan T., Shanahan C. Teaching disciplinary literacy to adolescents: Rethinking content area literacy. Harvard Educational Review 2008, 78(1):40-60.
Steenkamp J.-B.E.M., Baumgartner H. Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research 1998, 25:78-90. 10.1086/209528.
Stevens F.I. Applying an opportunity-to-learn conceptual framework to the investigation of teaching practices via secondary analyses of multiple-case study summary data. Journal of Negro Education 1993, 62(3):232-248.
Van de Gaer E., Grisay A., Schlutz W., Gebhardt E. The reference group effect: An explanation of the paradoxical relationship between academic achievement and self-confidence across countries. Journal of Cross-cultural Psychology 2012, http://jcc.sagepub.com/content/early/2012/02/08/0022022111428083.
Van de Vijver F., Poortinga Y. Cross-cultural generalization and universality. Journal of Cross-Cultural Psychology 1982, 13:387-408.
Wang J. Opportunity to learn: The impacts and policy implications. Educational Evaluation and Policy Analysis 1998, 20(3):137-156.
Wu M.L., Adams R.J., Wilson M.R. Conquest®: Multi-aspect test software (computer program manual) 1997, Australian Council of Educational Research, Camberwell, VIC.
Yang Y., Harkness J.A., Chin T.-Y., Villar A. Response styles and cultures. Survey methods in multinational, multiregional and multicultural contexts 2010, 203-233. Wiley & Sons, Hoboken. J.A. Harkness, M. Braun, B. Edwards, T.P. Johnson, L. Lyberg, P. Mohler, P.-E. Pennell, T.W. Smith (Eds.).
