learning by comparing; postsecondary education; self-assessment; outcome space; qualitative research
Abstract :
[en] This paper explores, through a phenomenographic analysis, how higher education students experience learning-through-comparison processes embedded in self-assessment activities. By combining observations and interviews, the paper offers a threefold contribution: (1) it provides two in-depth narratives of self-assessment activities; (2) it develops a typology that distinguishes between explicit versus implicit and analogical versus analytical comparisons; and (3) it proposes an outcome space to illustrate how students perceive and engage with these contrasting assignments. The analysis detects a specific value of analogical comparisons for self-generated learning and of analytical comparisons for a better understanding of the course stakes. In both cases, making comparisons explicit is a way to foster cognitive and metacognitive benefits. Additionally, the findings indicate that comparisons with peer productions should receive special attention as students are less familiar with them than with traditional instructor feedback. Lastly, results suggest that consistency in self-grading should not always be interpreted as an indicator of powerful self-assessment. These insights hold implications for researchers and educators concerned with the ins and outs of self-assessment practice.
Research Center/Unit :
IFRES
Disciplines :
Education & instruction
Author, co-author :
Hoffelinck, Marie ; Université de Liège - ULiège > Centres généraux > Institut de formation et de recherche en enseignement supérieur (IFRES)
Detroz, Pascal ; Université de Liège - ULiège > Centres généraux > IFRES - SMART (Système Méthodologique d'Aide à la Réalisation de Tests)
Verpoorten, Dominique ; Université de Liège - ULiège > Centres généraux > IFRES : Pédagogie de l'Enseignement supérieur
Language :
English
Title :
Students’ Experience of Comparison-Based Learning in Self-Assessment: A Phenomenographic Study in Higher Education
Åkerlind, G. S., (2005). Variation and commonality in phenomenographic research methods. Higher Education Research & Development, 24(4), 321–334. https://doi.org/10.1080/07294360500284672
Åkerlind, G. S., (2023). Common misunderstandings of phenomenographic research in higher education. Higher Education Research & Development, 43(1), 1–16. https://doi.org/10.1080/07294360.2023.2218804
Alfieri, L., Nokes-Malach, T. J., & Schunn, C. D., (2013). Learning through case comparisons: A meta-analytic review. Educational Psychologist, 48(2), 87–113. https://doi.org/10.1080/00461520.2013.775712
Andrade, H. L., (2019). A critical review of research on student self-assessment. Frontiers in Education, 4, 1–12. https://doi.org/10.3389/feduc.2019.00087
Bartholomew, S. R., & Jones, M. D., (2022). A systematized review of research with adaptive comparative judgment (ACJ) in higher education. International Journal of Technology and Design Education, 32(2), 1159–1190. https://doi.org/10.1007/s10798-020-09642-6
Bartholomew, S. R., Mentzer, N., Jones, M., Sherman, D., & Baniya, S., (2022). Learning by evaluating (LbE) through adaptive comparative judgment. International Journal of Technology and Design Education, 32(2), 1191–1205. https://doi.org/10.1007/s10798-020-09639-1
Berger, J.-L., & Büchel, F., (2012). Métacognition et croyances motivationnelles: Un mariage de raison. Revue française de pédagogie. Recherches en éducation, 179, 179. https://doi.org/10.4000/rfp.3705
Boud, D., & Brew, A., (1995). Developing a typology for learner self-assessment practices. Research and Development in Higher Education, 18, 130–135.
Bransford, J. D., & Schwartz, D. L., (1999). Rethinking transfer: A simple proposal with multiple implications. Review of Research in Education, 24, 61–100. https://doi.org/10.2307/1167267
Brown, G. T. L., & Harris, L. R., (2013). Student self-assessment. In J. H., McMillan (Ed.), Sage handbook of research on classroom assessment (pp. 367–393). Sage Publications.
Butler, D. L., & Winne, P. H., (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65(3), 245. https://doi.org/10.2307/1170684
Charmaz, K., (2006). Constructing grounded theory. A practical guide through qualitative analysis (Reprinted 2009). Sage.
Cho, K., & MacArthur, C., (2011). Learning by reviewing. Journal of Educational Psychology, 103(1), 73–84. https://doi.org/10.1037/a0021950
Dewit, I., Rohaert, S., & Corradi, D., (2021). How can comparative judgement become an effective means toward providing clear formative feedback to students to improve their learning process during their product-service-system design project?Design and Technology Education: An International Journal, 26(3), 276–293.
Entwistle, N., (1997). Introduction: Phenomenography in higher education. Higher Education Research & Development, 16(2), 127–134. https://doi.org/10.1080/0729436970160202
Formasup. (n.d.). Retrieved 8 January 2024, from http://formasup.uliege.be/.
Hartell, E., & Buckley, J., (2021). Comparative judgment: An overview. In A., Marcus-Quinn, & T., Hourigan (Eds.), Handbook for online learning contexts: Digital, mobile and open (pp. 289–307). Springer International Publishing. https://doi.org/10.1007/978-3-030-67349-9_20
Jones, I., & Alcock, L., (2014). Peer assessment without assessment criteria. Studies in Higher Education, 39(10), 1774–1787. https://doi.org/10.1080/03075079.2013.821974
Jones, I., & Wheadon, C., (2015). Peer assessment using comparative and absolute judgement. Studies in Educational Evaluation, 47, 93–101. https://doi.org/10.1016/j.stueduc.2015.09.004
Kaufman, J. H., & Schunn, C. D., (2011). Students’ perceptions about peer assessment for writing: Their origin and impact on revision work. Instructional Science, 39(3), 387–406.
Lai, E. R., (2011). Metacognition: A literature review (p. 40) [Research Report]. Pearson.
Leclercq, D., & Poumay, M., (2004). Une défintion opérationnelle de la métacognition et ses mises en oeuvre. L’AIPU : 20 ans de Recherches et d’Actions Pédagogiques ; bilans et perspectives. 21ème congrès de l’AIPU, Marrakech, Maroc.
Lejeune, C., (2019). Manuel d’analyse qualitative. De Boeck.
Lin-Siegler, X., Shaenfield, D., & Elder, A. D., (2015). Contrasting case instruction can improve self-assessment of writing. Educational Technology Research and Development, 63(4), 517–537. https://doi.org/10.1007/s11423-015-9390-9
Marton, F., (1981). Phenomenography–Describing conceptions of the world around us. Instructional Science, 10(2), 177–200. https://doi.org/10.1007/BF00132516
Marton, F., (2015). Necessary conditions of learning. Routledge.
Marton, F., & Booth, S., (1997). Learning and awareness. L. Erlbaum Associates.
Naud, S., Sander, E., & Benetos, K., (2023). Usage pédagogique des analogies dans l’enseignement supérieur. Revue internationale de pédagogie de l’enseignement supérieur, 39(2), 1–22. https://doi.org/10.4000/ripes.4866.
Nicol, D., (2021). The power of internal feedback: Exploiting natural comparison processes. Assessment & Evaluation in Higher Education, 46(5), 756–778. https://doi.org/10.1080/02602938.2020.1823314
Panadero, E., Brown, G. T. L., & Strijbos, J.-W., (2016). The future of student self-assessment: A review of known unknowns and potential directions. Educational Psychology Review, 28(4), 803–830. https://doi.org/10.1007/s10648-015-9350-2
Panadero, E., & Romero, M., (2014). To rubric or not to rubric? The effects of self-assessment on self-regulation, performance and self-efficacy. Assessment in Education: Principles, Policy & Practice, 21(2), 133–148. https://doi.org/10.1080/0969594X.2013.877872
Panadero, E., Tapia, J. A., & Huertas, J. A., (2012). Rubrics and self-assessment scripts effects on self-regulation, learning and self-efficacy in secondary education. Learning and Individual Differences, 22(6), 806–813. https://doi.org/10.1016/j.lindif.2012.04.007
Potter, T., Englund, L., Charbonneau, J., MacLean, M. T., Newell, J., & Roll, I., (2017). ComPAIR: A new online tool using adaptive comparative judgement to support learning with peer feedback. Teaching & Learning Inquiry, 5(2), 89–113.
Ruchniewicz, H., & Barzel, B., (2019). Technology supporting student self-assessment in the field of functions–A design-based research study. In G., Aldon, & J., Trgalová (Eds.), Technology in mathematics teaching (pp. 49–74). Springer International Publishing. https://doi.org/10.1007/978-3-030-19741-4_3
Sargeant, J., Armson, H., Chesluk, B., Dornan, T., Eva, K., Holmboe, E., Lockyer, J., Loney, E., Mann, K., & Van Der Vleuten, C., (2010). The processes and dimensions of informed self-assessment: A conceptual model. Academic Medicine, 85(7), 1212–1220. https://doi.org/10.1097/ACM.0b013e3181d85a4e
Sidney, P. G., Hattikudur, S., & Alibali, M. W., (2015). How do contrasting cases and self-explanation promote learning? Evidence from fraction division. Learning and Instruction, 40, 29–38. https://doi.org/10.1016/j.learninstruc.2015.07.006
St-Pierre, L., (2004). L’habileté d’autoévaluation: Pourquoi et comment la développer?Pédagogie collégiale, 18(1), 33–38.
Svensson, L., (1997). Theoretical foundations of phenomenography. Higher Education Research & Development, 16(2), 159–171. https://doi.org/10.1080/0729436970160204
Taras, M., (2010). Student self-assessment: Processes and consequences. Teaching in Higher Education, 15(2), 199–209. https://doi.org/10.1080/13562511003620027
Yan, Z., (2020). Self-assessment in the process of self-regulated learning and its relationship with academic achievement. Assessment & Evaluation in Higher Education, 45(2), 224–238. https://doi.org/10.1080/02602938.2019.1629390
Yan, Z., & Brown, G. T. L., (2017). A cyclical self-assessment process: Towards a model of how students engage in self-assessment. Assessment & Evaluation in Higher Education, 42(8), 1247–1262. https://doi.org/10.1080/02602938.2016.1260091
Yan, Z., Lao, H., Panadero, E., Fernández-Castilla, B., Yang, L., & Yang, M., (2022). Effects of self-assessment and peer-assessment interventions on academic performance: A meta-analysis. Educational Research Review, 37, 100484. https://doi.org/10.1016/j.edurev.2022.100484
Yan, Z., Panadero, E., Wang, X., & Zhan, Y., (2023). A systematic review on students’ perceptions of self-assessment: Usefulness and factors influencing implementation. Educational Psychology Review, 35(3), 81. https://doi.org/10.1007/s10648-023-09799-1
