DiGAP; game analysis; Transparency; Reporting; Protocol; Methodology; Guidelines
Abstract :
[en] The analysis of digital games is a widely used method in the field of game studies and an important instrument to study games and game-related topics. However, existing methodological work showcases a divergency of perspectives on game analyses, hindering the development of clear guidelines on how to actually conduct them. This lack of methodological consensus is fueled further by several complexities when analyzing games, such as the active participation that is required on the part of the researchers. Therefore, the current paper proposes the Digital Game Analysis Protocol (DiGAP), a methodological toolkit that, compared to existing methodological frameworks, provides researchers with sufficient flexibility and adaptability in order to cater to a game analysis’ specific focus and needs. DiGAP’s goal is twofold: to make researchers reflect on the potential impact of their methodological choices on the analysis and interpretation of game content, and to promote the transparent reporting of game analyses in academic manuscripts. Based on previous methodological scholarship, the authors’ prior game analysis experience and brainstorm meetings between members of our interdisciplinary author team, DiGAP consists of 31 items categorized in seven sections: (1) Rationale & objectives, (2) Researcher background, (3) Game selection, (4) Boundaries, (5) Analysis approach, (6) Coding techniques & data extraction and (7) Reporting & transparency. Due to its comprehensive setup and its reflexive nature, DiGAP may be used as a (didactic) checklist to make insights from the field of game studies regarding game analyses accessible to a broader range of research fields (e.g., communication and human-computer interaction). This, in turn, makes it equally valuable for (student) researchers unfamiliar with the method of game analysis as well as more experienced game scholars.
Research Center/Unit :
Mintlab
Disciplines :
Communication & mass media Arts & humanities: Multidisciplinary, general & others
Author, co-author :
Daneels, Rowan
Denoo, Maarten; KU Leuven - Katholieke Universiteit Leuven > Institute for Media Studies
Vandewalle, Alexander; UA - Université d'Anvers > Communication Sciences
Dupont, Bruno ; Université de Liège - ULiège > Département de langues modernes : linguistique, littérature et traduction > Langue et littérature allemandes modernes ; KU Leuven - Katholieke Universiteit Leuven > Institute for Media Studies
Malliet, Steven; UA - Université d'Anvers > Communication Sciences
Language :
English
Title :
The Digital Game Analysis Protocol (DiGAP): Introducing a Guide for Reflexive and Transparent Game Analyses
Aarseth, E. (2003). Playing research: Methodological approaches to game analysis. Proceedings of the 5th International Digital Arts and Culture Conference (pp. 1-7).
Aarseth, E. (2007). I fought the law: Transgressive play and the implied player. Proceedings of the 2007 DiGRA International Conference: Situated Play (pp. 130-133). http://www.digra.org/digital-library/publications/i-fought-the-law-transgressive-play-and-the-implied-player/
Aarseth, E. (2021). Two decades of Game Studies. Game Studies, 21(1). http://gamestudies.org/2101/articles/aarseth_anniversary
Backe, H.-J., & Aarseth, E. (2013). Ludic Zombies: An Examination of Zombieism in Games. Proceedings of the 2013 DiGRA International Conference: DeFragging Game Studies (pp. 1-16). http://www.digra.org/digital-library/publications/ludic-zombies-an-examination-of-zombieism-in-games/
Barr, P. (2008). Video game values: Play as human-computer interaction. [Unpublished doctoral dissertation]. Victoria University of Wellington.
Bartle, R. (1996). Hearts, clubs, diamonds, spades: Players who suit MUDs. Retrieved from https://mud.co.uk/richard/hcds.htm
Belgian Gaming Commission. (2018). Research report on loot boxes. Retrieved from https://gamingcommission.paddlecms.net/sites/default/files/2021-08/onderzoeksrapport-loot-boxen-Engels-publicatie.pdf
Bethesda Game Studios. (2002). The Elder Scrolls III: Morrowind [Microsoft Windows]. Digital game directed by Todd Howard, published by Bethesda Softworks.
Blizzard Entertainment. (2004). World of Warcraft [Microsoft Windows]. Digital game directed by Ion Hazzikostas, published by Blizzard Entertainment.
Blom, J. (2020). The dynamic game character: Definition, construction, and challenges in character ecology [Doctoral dissertation, IT University of Copenhagen]. https://pure.itu.dk/portal/files/85357319/PhD_Thesis_Final_Version_Joleen_Blom.pdf
Boellstorff, T. (2008). Coming of age in Second Life: An anthropologist explores the virtually human. Princeton University Press.
Bogost, I. (2007). Persuasive games: The expressive power of videogames. MIT Press.
Bourgonjon, J., Rutten, K., Soetaert, R., & Valcke, M. (2011). From Counter-Strike to Counter-Statement: Using Burke's pentad as a tool for analysing video games. Digital Creativity, 22(2), 91-102. https://doi.org/10.1080/14626268.2011.578577
Bowman, N.D., & Keene, J.R. (2018). A layered framework for considering open science practices. Communication Research Reports, 35(4), 363-372. https://doi.org/10.1080/08824096.2018.1513273
Bowman, N.D., & Spence, P.R. (2020). Challenges and best practices associated with sharing research materials and research data for communication scholars. Communication Studies, 71(4), 708-716. https://doi.org/10.1080/10510974.2020.1799488
Breuer, J., Festl, R., & Quandt, T. (2011). In the army now-Narrative elements and realism in military first-person shooters. Proceedings of the 2011 DiGRA International Conference: Think Design Play (pp. 1-19). http://www.digra.org/digital-library/publications/in-the-army-now-narrative-elements-and-realism-in-military-first-person-shooters/
Breuer, J., Festl, R., & Quandt, T. (2012). Digital war: An empirical analysis of narrative elements in military first-person shooters. Journal of Gaming & Virtual Worlds, 4(3), 215-237. https://doi.org/10.1386/jgvw.4.3.215_1
Burridge, S., Gilbert, M., & Fox, J. (2019, May 24). On analyzing game content [Conference presentation]. 69th Annual International Communication Association (ICA) pre-conference ‘Games + Communication Ante-Conference’, Washington D.C., USA.
Carr, D. (2019). Methodology, representation, and games. Games and Culture, 14(7-8), 707-723. https://doi.org/10.1177/1555412017728641
Cayatte, R. (2017). Idéologie et jeux vidéo: Enquête et méthode. Les cahiers de la SFSIC, 13, 173-182.
Chapman, A. (2019). Playing the historical fantastic: Zombies, mecha-Nazis and making meaning about the past through metaphor. In P. Hammond & H. Pötzsch (Eds.), War games: Memory, militarism and the subject of play (pp. 91-111). Bloomsbury.
Consalvo, M. (2017). When paratexts become texts: De-centering the game-as-text. Critical Studies in Media Communication, 34(2), 177-183. https://doi.org/10.1080/15295036.2017.1304648
Consalvo, M., & Dutton, N. (2006). Game analysis: Developing a methodological toolkit for the qualitative study of games. Game Studies, 6(1). http://gamestudies.org/06010601/articles/consalvo_dutton
Creative Assembly. (2013). Total War: Rome II [Microsoft Windows]. Digital game published by Sega.
Cremin, C. (2012). The formal qualities of the video game: An exploration of Super Mario Galaxy with Gilles Deleuze. Games and Culture, 7(1), 72-86. https://doi.org/10.1177/1555412012440309
Croucher, S.M., & Cronn-Mills, D. (2018a). Content analysis-Qualitative. In S.M. Croucher & D. Cronn-Mills (Eds.), Understanding communication research methods: A theoretical and practical approach (pp. 161-174). Routledge.
Croucher, S.M., & Cronn-Mills, D. (2018b). Content analysis-Quantitative. In S.M. Croucher & D. Cronn-Mills (Eds.), Understanding communication research methods: A theoretical and practical approach (pp. 175-185). Routledge.
Cuttell, J. (2015). Arguing for an immersive method: Reflexive meaning-making, the visible researcher, and moral responses to gameplay. Journal of Comparative Research in Anthropology and Sociology, 6(1), 55-75. https://doaj.org/article/77796a63d0a249929665770fcdef32e3
Daneels, R., Denoo, M., Vandewalle, A., & Malliet, S. (2022). The Digital Game Analysis Protocol (DiGAP): Facilitating transparency in games research. Proceedings of the 2022 DiGRA International Conference: Bringing Worlds Together (pp. 1-4).
Daneels, R., Malliet, S., Geerts, L., Denayer, N., Walrave, M., & Vandebosch, H. (2021). Assassins, gods, and androids: How narratives and game mechanics shape eudaimonic game experiences. Media and Communication, 9(1), 49-61. https://doi.org/10.17645/mac.v9i1.3205
Daneels, R., Malliet, S., Walrave, M., & Vandebosch, H. (2019, May 24). Playing the Analysis: Qualitative Game Content Analysis [Conference presentation]. 69th Annual International Communication Association (ICA) pre-conference ‘Games + Communication Ante-Conference’, Washington D.C., USA.
Denoo, M., Malliet, S., Grosemans, E., & Zaman, B. (2021, February 4-5). Dark design patterns in video games: A content analysis of monetization and gambling-like mechanics in pay-to-play, free-to-play and social casino games [Conference presentation]. Etmaal van de Communicatiewetenschap, virtual conference.
de Wildt, L. (2020). Playing at religion: Encoding/decoding religion in videogames [Unpublished doctoral dissertation]. KU Leuven.
de Wildt, L., & Aupers, S.D. (2020). Eclectic religion: The flattening of religious cultural heritage in videogames. International Journal of Heritage Studies, 27(3), 312-330. https://doi.org/10.1080/13527258.2020.1746920
Dienlin, T., Johannes, N., Bowman, N.D., Masur, P.K., Engesser, S., Kümpel, A.S., Lukito, J., Bier, L.M., Zhang, R., Johnson, B.K., Huskey, R., Schneider, F.M., Breuer, J., Parry, D.A., Vermeulen, I., Fisher, J.T., Banks, J., Weber, R., Ellis, D.A., … de Vreese, C. (2021). An agenda for open science in communication. Journal of Communication, 71(1), 1-26. https://doi.org/10.1093/joc/jqz052
Dupont, B. (2015). Le rythme vidéoludique comme movement: Second Sight et la ritournelle. Interval(le)s, 7, 142-160. http://www.cipa.ulg.ac.be/intervalles7/dupont.pdf
Egenfeldt-Nielsen, S., Smith, J. H., & Tosca, S. P. (2019). Understanding video games: The essential introduction. Routledge.
El-Nasr, M.S., Al-Saati, M., Niedenthal, S., & Milam, D. (2008). Assassin’s Creed: A multi-cultural read. Loading… The Journal of the Canadian Game Studies Association, 2(3), 1-32. https://journals.sfu.ca/loading/index.php/loading/article/view/51
Fernández-Vara, C. (2019). Introduction to game analysis, second edition. Routledge.
Ford, D. (2021). The haunting of ancient societies in the Mass Effect trilogy and The Legend of Zelda: Breath of the Wild. Game Studies, 21(4). http://gamestudies.org/2104/articles/dom_ford
Fox, J., Gilbert, M., & Tang, W.Y. (2018). Player experiences in a massively multiplayer online game: A diary study of performance, motivation, and social interaction. New Media & Society, 20(11), 4056-4073. https://doi.org/10.1177/1461444818767102
Free Radical Design. (2004). Second Sight [PlayStation 2]. Digital game directed by Rob Letts, published by Codemasters.
Funcom. (2012). The Secret World [Microsoft Windows]. Digital game directed by Ragnar Tørnquist, published by Electronic Arts.
Gilbert, M., Lynch, T., Burridge, S., & Archipley, L. (2021). Formidability of male video game characters over 45 years. Information, Communication & Society. Advance online publication. https://doi.org/10.1080/1369118X.2021.2013921
Guerilla Games. (2017). Horizon Zero Dawn [PlayStation 4]. Digital game directed by Mathijs de Jonge, published by Sony Interactive Entertainment.
Hartmann, T., Krakowiak, K.M., & Tsay-Vogel, M. (2014). How violent video games communicate violence: A literature review and content analysis of moral disengagement factors. Communication Monographs, 81(3), 310-332. https://doi.org/10.1080/03637751.2014.922206
Haven, T.L., & Van Grootel, L. (2019). Preregistering qualitative research. Accountability in Research, 26(3), 229-244. https://doi.org/10.1080/08989621.2019.1580147
Hitchens, M. (2011). A survey of first-person shooters and their avatars. Game Studies, 11(3). http://gamestudies.org/1103/articles/michael_hitchens
Hunicke, R., LeBlanc, M., & Zubek, R. (2004). MDA: A formal approach to game design and game research. In Proceedings of the AAAI Workshop on Challenges in Game AI (pp. 1-5). https://users.cs.northwestern.edu/~hunicke/MDA.pdf
Juul. (2005). Half-real: Video games between real rules and fictional worlds. MIT press.
Karlsen, F. (2008). Quests in context: A comparative analysis of Discworld and World of Warcraft. Game Studies, 8(1). http://gamestudies.org/0801/articles/karlsen
Keogh, B. (2013). Spec Ops: The Line’s conventional subversion of the military shooter. Proceedings of the 2013 DiGRA International Conference: DeFragging Game Studies (pp. 1-17). http://www.digra.org/digital-library/publications/spec-ops-the-lines-conventional-subversion-of-the-military-shooter/
Konzack, L. (2002). Computer game criticism: A method for computer game analysis. Computer Games and Digital Cultures Conference Proceedings (pp. 89-100). http://www.digra.org/digital-library/publications/computer-game-criticism-a-method-for-computer-game-analysis/
Kringiel, D. (2012). Learning to play: Video game literacy in the classroom. In J. Fromme & A. Unger (Eds.), Computer games and new media cultures: A handbook of digital game studies (pp. 633-646). Springer, Dordrecht.
Krippendorff, K. (2004). Content analysis: An introduction to its methodology. Sage.
Lankoski, P., & Björk, S. (2015). Formal analysis of gameplay. In P. Lankoski and S. Björk (Eds.), Game research methods (pp. 23-35). ETC Press.
Lankoski, P., Heliö, S., & Ekman, I. (2003). Character in computer games: Toward understanding interpretation and design. Proceedings of the 2003 DiGRA International Conference: Level Up (pp. 1-12). http://www.digra.org/digital-library/publications/characters-in-computer-games-toward-understanding-interpretation-and-design/
Leino, O.T. (2012). Death loop as a feature. Game Studies, 12(2). http://gamestudies.org/1202/articles/death_loop_as_a_feature
Linares, K. (2009). Discovering Super Mario Galaxy: A textual analysis. Proceedings of the 2009 DiGRA International Conference: Breaking New Ground: Innovation in Games, Play, Practice and Theory (pp.1-2). http://www.digra.org/digital-library/publications/discovering-super-mario-galaxy-a-textual-analysis/
Linden Lab. (2003). Second Life [Microsoft Windows]. Digital game published by Linden Lab. https://secondlife.com/
Looking Glass Studios. (2000). Thief II: The Metal Age [Microsoft Windows]. Digital game directed by Steve Pearsall, published by Eidos Interactive.
Lynch, T., Tompkins, J.E., van Driel, I.I., & Fritz, N. (2016). Sexy, strong, and secondary: A content analysis of female characters in video games across 31 years. Journal of Communication, 66, 564-584. https://doi.org/10.1111/jcom.12237
Machado, D. (2020). Battle narratives from ancient historiography to Total War: Rome II. In C. Rollinger (Ed.), Classical antiquity in video games: Playing with the ancient world (pp. 93-105). Bloomsbury Academic.
MacPhail, C., Khoza, N., Abler, L., & Ranganathan, M. (2016). Process guidelines for establishing intercoder reliability in qualitative studies. Qualitative research, 16(2), 198-212. https://doi.org/10.1177/1468794115577012
Malliet, S. (2007). Adapting the principles of ludology to the method of video game content analysis. Game Studies, 7(1). http://www.gamestudies.org/0701/articles/malliet
Masso, I. C. (2009). Developing a methodology for corpus-based computer game studies. Journal of Gaming and Virtual Worlds, 1(2), 143-169. https://doi.org/10.1386/jgvw.1.2.143/7
Mäyrä, F. (2008). An introduction to game studies. SAGE Publications.
Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L.A., & PRISMA-P Group (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews, 4(1). https://doi.org/10.1186/2046-4053-4-1
Munafò, M.R., Nosek, B.A., Bishop, D.V.M, Button, K.S., Chambers, C.D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E-J., Ware, J.J., & Ioannidis, J.P.A. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1, Article number 0021. https://doi.org/10.1038/s41562-016-0021
Nintendo. (2007). Super Mario Galaxy [Nintendo Wii]. Digital game directed by Yoshiaki Koizumi, published by Nintendo.
Nintendo. (2017). The Legend of Zelda: Breath of the Wild [Nintendo Switch]. Digital game directed by Hidemaro Fujibayashi, published by Nintendo.
Nolden, N. (2020). Playing with an ancient veil: Commemorative culture and the staging of ancient history within the playful experience of the MMORPG, The Secret World. In C. Rollinger (Ed.), Classical antiquity in video games: Playing with the ancient world (pp. 157-175). Bloomsbury Academic.
O’Connor, C., & Joffe, H. (2020). Intercoder reliability in qualitative research: Debates and practical guidelines. International Journal of Qualitative Methods, 19, 1-13. https://doi.org/10.1177/1609406919899220
Pacek, T. (forthcoming). A qualitative content analysis of predatory video game monetization [Unpublished master’s thesis]. KU Leuven.
Pérez-Latorre, O. & Oliva, M. (2019). Video games, dystopia, and neoliberalism: The case of BioShock Infinite. Games & Culture, 14(7-8), 781-800. https://doi.org/10.1177/1555412017727226
Pérez-Latorre, O., Oliva, M., & Besalú, R. (2017). Videogame analysis: A social-semiotic approach. Social Semiotics, 27(5), 586-603. https://doi.org/10.1080/10350330.2016.1191146
Perreault, M.F., Perreault, G.P., Jenkins, J. & Morrison, A. (2018). Depictions of female protagonists in digital games: A narrative analysis of 2013 DICE award-winning digital games. Games & Culture, 13(8), 843-860. https://doi.org/10.1177/1555412016679584
Pulos, A. (2013). Confronting heteronormativity in online games: A critical discourse analysis of LGBTQ sexuality in World of Warcraft. Games and Culture, 8(2), 77-97. https://doi.org/10.1177/1555412013478688
Quantic Dream. (2018). Detroit: Become Human [PlayStation 4]. Digital game directed by David Cage, published by Sony Interactive Entertainment.
Rapley, T. (2014). Sampling strategies in qualitative research. In U. Flick (Ed.), The SAGE handbook of qualitative data analysis (pp. 49-63). SAGE Publications.
Ribbens, W., & Steegen, R. (2012). A qualitative inquiry and a quantitative exploration into the meaning of game reviews. Journal of Applied Journalism & Media Studies, 1(2), 209-229. https://doi.org/10.1386/ajms.1.2.209_1
Ruberg, B. (2020). Empathy and its alternatives: Deconstructing the rhetoric of “empathy” in video games. Communication, Culture and Critique, 13(1), 54-71. https://doi.org/10.1093/ccc/tcz044
Santa Monica Studios. (2018). God of War [PlayStation 4]. Digital game directed by Cory Barlog, published by Sony Interactive Entertainment.
Schmierbach, M. (2009). Content analysis of video games: Challenges and potential solutions. Communication Methods and Measures, 3(3), 147-172. https://doi.org/10.1080/19312450802458950
Slater, M.D. (2013). Content analysis as a foundation for programmatic research in communication. Communication Methods & Measures, 7(2), 85-93. https://doi.org/10.1080/19312458.2013.789836
Švelch, J., & Švelch, J. (2020). “Definitive playthrough”: Behind-the-scenes narratives in let’s plays and streaming content by video game voice actors. New Media & Society. Advance online publication. https://doi.org/10.1177/1461444820971778
Tondello, G.F., & Nacke, L.E. (2019). Player characteristics and video game preferences. Proceedings of the 2019 Annual Symposium on Computer-Human Interaction in Play (pp. 365-378). https://doi.org/10.1145/3311350.3347185
Treyarch. (2008). Call of Duty: World at War [Microsoft Windows]. Digital game directed by Corky Lehmkuhl and Cesar Stastny, published by Activision.
Ubisoft Montreal. (2007). Assassin’s Creed [PlayStation 3]. Digital game directed by Patrice Désilets, published by Ubisoft.
Ubisoft Quebec. (2018). Assassin’s Creed Odyssey [Microsoft Windows]. Digital game directed by Jonathan Dumont and Scott Phillips, published by Ubisoft.
Valve. (1998). Half-Life [Microsoft Windows]. Digital game published by Valve.
Vandewalle, A. (2021, March 5-6). Playing with Plato: The presentation of Socrates in Assassin's Creed Odyssey [Conference presentation]. IMAGINES VII-Playful Classics Conference, Online.
Vandewalle, A. & Malliet, S. (2020). Ergodic characterization: A methodological framework for analyzing games set in classical antiquity. Proceedings of the 2020 DiGRA International Conference: Play Everywhere (pp. 1-4). http://www.digra.org/digital-library/publications/ergodic-characterization-a-methodological-framework-for-analyzing-games-set-in-classical-antiquity/
Waern, A. (2013). Game analysis as a signature pedagogy of game studies. Proceedings of the 8th International Conference on the Foundations of Digital Games (pp. 275-282). http://www.fdg2013.org/program/papers/paper36_waern.pdf
Willumsen, E.C., & Jaćević, M. (2018). Avatar-kinaesthetics as characterisation statements in Horizon: Zero Dawn. Proceedings of the 2018 DiGRA International Conference: The Game is the Message (pp. 1-4).. http://www.digra.org/digital-library/publications/avatar-kinaesthetics-as-characterisation-statements-in-horizon-zero-dawn/
Yager Development. (2012). Spec Ops: The Line [Microsoft Windows]. Digital game directed by Cory Davis and Francois Coulon, published by 2K Games.
Yee, N. (2006). Motivations for play in online games. CyberPsychology & Behavior, 9(6), 772-775. https://doi.org/10.1089/cpb.2006.9.772
Zendle, D., Meyer, R., Cairns, P., Waters, S., & Ballou, N. (2020). The prevalence of loot boxes in mobile and desktop games. Addiction, 115(9), 1768-1772. https://doi.org/10.1111/add.14973
Zhu, F. (2015). The implied player: Between the structural and the fragmentary. Proceedings of the 2015 DiGRA International Conference: Diversity of Play: Games-Cultures-Identities (pp. 1-3).
