Assessing Graphical Loop Invariant Based Programming Performance in a CS1 Course

Brieven, Géraldine; Donnet, Benoît

doi:10.15388/infedu.2507.010

Download

Article (Scientific journals)

Assessing Graphical Loop Invariant Based Programming Performance in a CS1 Course

Brieven, Géraldine; Donnet, Benoît

2026 • In Informatics in Education, p. 1-38

Peer Reviewed verified by ORBi

Permalink
https://hdl.handle.net/2268/346172

DOI
10.15388/infedu.2507.010

Files (1)Send to Details Statistics Bibliography Similar publications

Files

Full Text

paper.pdf

Author postprint (5.92 MB)

Creative Commons License - Public Domain Dedication

Download

All documents in ORBi are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

Graphical Loop Invariant Based Programming; CS1; A/B Testing; Diagrammatic Reasoning; Student Difficulties

Abstract :

[en] We investigate the pedagogical impact of Graphical Loop Invariant Based Programming (GLIBP) in an introductory programming course. This approach encourages students to visually model the objects and variables handled in the loop, before implementing it. To evaluate the efficiency of this GLI model, a four-condition A/B/C/D test was conducted across two problems, with students receiving varying levels of scaffolding (from no support to a fully constructed GLI). Analysis of students’ code showed that a well-designed GLI reduced errors related to the loop guard and the update of variables. However, many students struggled to understand or represent a GLI. The fill-in-the-blank GLI version, in particular, often added cognitive load rather than reducing it. Three recommendations emerged: train students to interpret a provided GLI when writing code; second, teach students to sketch their own model by recognizing similarities to previously solved problems; finally, guide students with questions to ensure all necessary variables and relationships are properly identified.

Disciplines :

Computer science

Author, co-author :

Brieven, Géraldine ; Université de Liège - ULiège > Montefiore Institute of Electrical Engineering and Computer Science

Donnet, Benoît ; Université de Liège - ULiège > Département d'électricité, électronique et informatique (Institut Montefiore) > Algorithmique des grands systèmes

Language :

English

Title :

Assessing Graphical Loop Invariant Based Programming Performance in a CS1 Course

Publication date :

22 May 2026

Journal title :

Informatics in Education

ISSN :

1648-5831

eISSN :

2335-8971

Publisher :

Vilnius University Press

Pages :

1-38

Peer reviewed :

Peer Reviewed verified by ORBi

Additional URL :

https://infedu.vu.lt/journal/INFEDU/article/859/text

Name of the research project :

CyberExcellence

Funders :

Région wallonne

Funding number :

2110186

Available on ORBi :

since 18 June 2026

Statistics

Number of views

57 (0 by ULiège)

Number of downloads

75 (0 by ULiège)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenAlex citations

Bibliography

Al-Barakati, N.M., Al-Aama, A.Y. (2009). The Effect of Visualizing Roles of Variables on Student Performance in an Introductory Programming Course. In: Proc. ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE). https://doi.org/10.1145/1562877.156294 9.
Anderson, M., Meyer, B., Olivier, P. (Eds.) (2002). Diagrammatic Representation and Reasoning. Springer London. https://doi.org/10.1007/978-1-4471-0109-3.
Astrachan, O. (1991). Pictures as Invariants. In: Proc. ACM Technical Symposium on Computer Science Education (SIGCSE). https://doi.org/10.1145/107004.107026.
Back, R.-J. (2009). Invariant Based Programming: Basic Approach and Teaching Experiences. Formal Aspects of Computing, 21(3), 227-244. https://doi.org/10.1007/s00165-008-0070-y.
Brieven, G., Malcev, L., Donnet, B. (2024). Practicing Abstraction Skills Through Diagrammatic Reasoning Over CAFÉ 2.0. In: Proc. IEEE Global Engineering Education Conference (EDUCON). https://doi.org/10.1109/EDUCON60312.2024.10578665.
Brieven, G., Malcev, L., Donnet, B. (2025). How to Automate Feedback on Diagrammatic Reasoning with a Relevant Degree of Freedom? In: Proc. IEEE Global Engineering Education Conference (EDUCON). https://doi.org/10.1109/EDUCON62633.2025.11016495.
Brieven, G., Liénardy, S., Malcev, L., Donnet, B. (2023). Graphical Loop Invariant Based Programming. In: Proc. Formal Method Teaching Workshop (FMTea). https://doi.org/10.1007/978- 3-031-27534-0_2.
Broy, M., Brucker, A.D., Fantechi, A., Gleirscher, M., Havelund, K., Kuppe, M.A., Mendes, A., Platzer, A., Ringert, J.O., Sullivan, A. (2024). Does Every Computer Scientist Need to Know Formal Methods? Formal Aspects of Computing, 37(1), 1-17. https://doi.org/10.1145/3670795.
Castro, F.E.V., Fisler, K. (2020). Qualitative Analyses of Movements Between Task-level and Code-level Thinking of Novice Programmers. In: Proc. ACM Technical Symposium on Computer Science Education (SIGCSE). https://doi.org/10.1145/3328778.3366847.
Cetin, I. (2020). Teaching Loops Concept through Visualization Construction. Informatics in Education, 19(4), 589-609. https://doi.org/10.15388/infedu.2020.26.
Cherenkova, Y., Zingaro, D., Petersen, A. (2014). Identifying challenging CS1 concepts in a large problem dataset. In: Proc. ACM Technical Symposium on Computer Science Education (SIGCSE). https://doi.org/10.1145/2538862.2538966.
Cormen, T.H., Leiserson, C.E., Rivest, R.L., Stein, C. (2009). Introduction to Algorithms. MIT Press. 978-0262-03384-8.
Corney, M., Teague, D., Ahadi, A., Lister, R. (2012). Some Empirical Results for Neo-Piagetian Reasoning in Novice Programmers and the Relationship to Code Explanation Questions. In: Proc. ACM Australasian Computing Education Conference (ACE). https://doi.org/10.5555/2483716.2483726.
Dijkstra, E.W. (1976). A Discipline of Programming. Prentice-Hall, Inc. 978-0132158718.
Dongol, B., Dubois, C., Hallerstede, S., Hehner, E., Morgan, C., Müller, P., Ribeiro, L., Silva, A., Smith, G., de Vink, E. (2024). On Formal Methods Thinking in Computer Science Education. Formal Aspects of Computing, 37(1), 1-23. https://doi.org/10.1145/3670419.
Eriksson, J., Parsa, M., Back, R.-J. (2018). A Precise Pictorial Language for Array Invariants. In: Proc. International Conference on Integrated Formal Methods (IFM). https://doi.org/10.1007/978-3-319- 98938-9_9.
Fernández Alemán, J.L., Oufaska, Y. (2010). SAMtool, a Tool for Deducing and Implementing Loop Patterns. In: Proc. ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE). https://doi.org/10.1145/1822090.1822111.
Fowler, M., Kraemer, E., Sitaraman, M., Hollingsworth, J.E. (2021). Tool-Aided Loop Invariant Development: Insights into Student Conceptions and Difficulties. In: Proc. ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE). https://doi.org/10.1145/3430665.345 6351.
Gomes, A., Ke, W., Lam, C.-T., Teixeira, A.R., Correia, F.B., Marcelino, M.J., Mendes, A.J. (2019). Understanding Loops: A Visual Methodology. In: Proc. IEEEInternational Conference on Engineering, Technology and Education (TALE). https://doi.org/10.110 9/TALE4 80 0 0.2 019.9225951.
Gries, D. (1987). The Science of Programming. Springer. 978-0387906416.
Grover, S., Basu, S. (2017).MeasuringStudentLearning inIntroductoryBlock-Based Programming: Examining Misconceptions of Loops, Variables, and Boolean Logic. In: Proc. ACM Technical Symposium on Computer Science Education (SIGCSE). https://doi.org/10.1145/3017680.3017723.
Hoare, C.A.R. (1969). An Axiomatic Basis for Computer Programming. Communications of the ACM, 12(10), 576—580. https://doi.org/10.1145/363235.363259.
Iyer, V., Zilles, C. (2021). Pattern Census: A Characterization of Pattern Usage in Early Programming Courses. In: Proc. ACM Technical Symposium on Computer Science Education (SIGCSE). SIGCSE’21. Association for Computing Machinery, New York, NY, USA, pp. 45-51. 97814503 80621. https://doi.org/10. 1145/3408877.3432442.
Kamburjan, E., Grätz, L. (2021). Increasing Engagement with Interactive Visualization: Formal Methods as Serious Games. In: Proc. Formal Method Teaching Workshop (FMTea). https://doi.org/10.1007/978-3-030-91550-6_4.
Kao, Y., Matlen, B., Weintrop, D. (2022). From One Language to the Next: Applications of Analogical Transfer for Programming Education. ACM Transactions on Computing Education (TOCE), 22(4), 1-21. https://doi.org/10.1145/3487051.
Kumar, A.N., Raj, R.K., Aly, S.G., Anderson, M.D., Becker, B.A., Blumenthal, R.L., Eaton, E., Epstein, S.L., Goldweber, M., Jalote, P., Lea, D., Oudshoorn, M., Pias, M., Reiser, S., Servin, C., Simha, R., Winters, T., Xiang, Q. (2024). Computer Science Curricula 2023. Association for Computing Machinery. https://doi.org/10.1145/3664191.
Luxton-Reilly, A., Albluwi, I., Becker, B.A., Giannakos, M., Kumar, A.N., Ott, L., Paterson, J., Scott, M.J., Sheard, J., Szabo, C. (2018). Introductory Programming: A Systematic Literature Review. In: Proc. ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE). https://doi.org/10.1145/3293881.3295779.
Mannila, L. (2010). Invariant Based Programming in Education - An Analysis of Student Difficulties. Informatics in Education, 9(1), 115-132. #ttps://doi.örg/10.15388/infedu.2010.07.
Mirolo, C., Izu, C., Lonati, V., Scapin, E. (2022). Abstraction in Computer Science Education: An Overview. Informatics in Education, 20(4), 615-639. https://doi.org/10.15 3 8 8/infedu.2021.2 7.
Morazán, M. (2020). How to Design While Loops. Electronic Proceedings in Theoretical Computer Science, 321(13), 1-18. https://doi.org/10.4204/EPTCS.321.1.
Morgan, C. (1990). Programming from Specifications. Prentice-Hall. 978-0131232747.
Morrison, B.B., Margulieux, L.E., Guzdial, M. (2015). Subgoals, Context, and Worked Examples in Learning Computing Problem Solving. In: Proc. ACM International Computing Education Research (ICER). https://doi.org/10.1145/2787622.2787733.
Plass, J.L., Moreno, R., Brünken, R. (2010). Cognitive load theory. Cambridge University Press. 9780521677585.
Reed, J., Sinclair, J. (2004). Motivating Study of Formal Methods in the Classroom. In: Proc. Teaching Formal Methods. https://doi.org/10.1007/978-3-540- 30472-2_3.
Rodrigues, G., Monteiro, A.F., Osório, A. (2022). Introductory Programming in Higher Education: A Systematic Literature Review. In: Proc. International Computer Programming Education Conference (ICPEC). https://doi.org/10.4230/OASTcs.TCPEC.2022.4.
Saxena, P., Singh, S.K., Gupta, G. (2021). Analogy-based Instruction forEffective Teaching ofAbstract Concepts in Computer Science. In: Proc. International Conference on Higher Education Advances (HEAd). https://doi.org/10.4995/HEAd21.2021.13115.
Scapin, E., Mirolo, C. (2019). An Exploration of Teachers’ Perspective About the Learning of Iteration-Control Constructs. In: Pozdniakov, S.N., Dagiene, V. (Eds.), Proc. Informatics in Schools. New Ideas in School Informatics. https://doi.org/10.1007/978-3-030-33759-9_2.
Sfard, A. (1991). On the Dual Nature of Mathematical Conceptions: Reflections on Processes and Objects as Different Sides of the Same Coin. Educational Studies in Mathematics, 22(1), 1-36. https://doi.org/10.1007/BF00302715.
Sooriamurthi, R. (2009). Introducing abstraction and decomposition to novice programmers. ACM SIGCSE Bulletin, 41(3), 196-200. https://doi.org/10.1145/15954 9 6.15 6293 9.
Tam, W.C. (1992). Teaching Loop Invariants to Beginners by Examples. In: Proc. ACM Technical Symposium on Computer Science Education (SIGCSE). https://doi.org/10.1145/135250.134530.
Walker, H. (1998). Modules to introduce assertions and loop invariants informally within CS1: Experiences and observations. ACMSIGCSEBulletin, 30(2), 31-35.https://doi.org/10.1145/292422.2t2437.
Walker, H.M. (2023). Curricular Syncopations: Where/How Do Loop Invariants Fit? ACM Inroads, 14(1), 6-13. https://doi.org/10.1145/3583089.
Zhang, J., Atay, M., Caldwell, E.R., Jones, E.J. (2013). Visualizing Loops Using a Game-Like Instructional Module. In: Proc. IEEE International Conference on Advanced Learning Technologies. https://doi.org/10.1109/ICALT.2013.137.
Zhumagambetov, R. (2021). Teaching Formal Methods in Academia: A Systematic Literature Review. In: Proc. Formal Methods - Fun for Everybody. https://doi.,org/10.100 7/97 8-3-03 0-7137 4-4_12.