[en] Purpose – This study aims to uncover the constraints of automation and the affordances of augmentation related to implementing artificial intelligence (AI)-powered systems across different task types: mechanical, thinking and feeling.
Design/methodology/approach – Qualitative study involving 45 interviews with various stakeholders in artistic gymnastics, for which AI-powered systems for the judging process are currently developed and tested. Stakeholders include judges, gymnasts, coaches and a technology vendor.
Findings – We identify perceived constraints of automation, such as too much mechanization, preciseness and inability of the system to evaluate artistry or to provide human interaction. Moreover, we find that the complexity and impreciseness of the rules prevent automation. In addition, we identify affordances of augmentation such as speedier, fault-less, more accurate and objective evaluation. Moreover, augmentation affords to provide an explanation, which in turn may decrease the number of decision disputes.
Research limitations/implications – While the unique context of our study is revealing, the generalizability of our specific findings still needs to be established. However, the approach of considering task types is readily applicable in other contexts.
Practical implications – Our research provides useful insights for organizations that consider implementing AI for evaluation in terms of possible constraints, risks and implications of automation for the organizational practices and human agents while suggesting augmented AI-human work as a more beneficial approach in the long term. Originality/value – Our granular approach provides a novel point of view on AI implementation, as our findings challenge the notion of full automation of mechanical and partial automation of thinking tasks. Therefore, we put forward augmentation as the most viable AI implementation approach. In addition, we developed a rich understanding of the perception of various stakeholders with a similar institutional background, which responds to recent calls in socio-technical research.
Research Center/Unit :
HEC Liège Research - ULiège
Disciplines :
Management information systems
Author, co-author :
Mazurova, Elena ; Université de Liège - ULiège > HEC Liège : UER > UER Management : Marketing and Strategy
Standaert, Willem ; Université de Liège - ULiège > HEC Liège : UER > UER Management : Marketing and Strategy
Language :
English
Title :
Implementing artificial intelligence across task types: constraints of automation and affordances of augmentation
scite shows how a scientific paper has been cited by providing the context of the citation, a classification describing whether it supports, mentions, or contrasts the cited claim, and a label indicating in which section the citation was made.
Bibliography
Ågerfalk, P.J., Conboy, K., Crowston, K., Eriksson Lundström, J., Jarvenpaa, S.L., Ram, S. and Mikalef, P. (2022), “Artificial intelligence in information systems: state of the art and research roadmap”, Communications of the Association for Information Systems, Vol. 50 No. 1, pp. 420-438, doi: 10.17705/1cais.05017.
Agrawal, A., Gans, J.S. and Goldfarb, A. (2017), “What to expect from artificial intelligence”, MIT Sloan Management Review, Vol. 58 No. 3, pp. 23-26.
Asatiani, A., Malo, P., Nagbøl, P.R., Penttinen, E., Rinta-Kahila, T. and Salovaara, A. (2021), “Sociotechnical envelopment of artificial intelligence: an approach to organizational deployment of inscrutable artificial intelligence systems”, Journal of the Association for Information Systems, Vol. 22 No. 2, pp. 325-352, doi: 10.17705/1jais.00664.
Autio, E., Nambisan, S., Thomas, L.D.W. and Wright, M. (2018), “Digital affordances, spatial affordances, and the genesis of entrepreneurial ecosystems”, Strategic Entrepreneurship Journal, Vol. 12 No. 1, pp. 72-95, doi: 10.1002/sej.1266.
Baer, I., Waardenburg, L. and Huysman, M. (2022), “What are we augmenting? A multidisciplinary analysis of AI- based augmentation for the future of work”, International Conference on Information Systems, pp. 1-17.
Balasubramanian, N., Ye, Y. and Xu, M. (2022), “Substituting human decision-making with machine learning: implications for organizational learning”, Academy of Management Review, Vol. 47 No. 3, pp. 448-465, doi: 10.5465/amr.2019.0470.
Benbya, H., Pachidi, S. and Jarvenpaa, S.L. (2021), “Special issue editorial: artificial intelligence in organizations: implications for information systems research”, Journal of the Association for Information Systems, Vol. 22 No. 2, pp. 281-303, doi: 10.17705/1jais.00662.
Berente, N., Gu, B., Recker, J. and Santhanam, R. (2021), “Managing artificial intelligence”, MIS Quarterly, Vol. 45 No. 3, pp. 1433-1450.
Bogner, A., Littig, B. and Menz, W. (2018), “Generating qualitative data with experts and elites”, The SAGE Handbook of Qualitative Data Collection, SAGE Publications, pp. 652-667.
Brooks, L.A. and Saveri, A. (2017), “Expanding imagined affordance with futuretypes: challenging algorithmic power with collective 2040 imagination”, Proceedings of the 50th Hawaii International Conference on System Sciences (2017), pp. 1765-1774, doi: 10.24251/hicss.2017.215.
Brynjolfsson, E., Rock, D. and Syverson, C. (2017), “Artificial intelligence and the modern productivity paradox: a clash of expectations and statistics”, doi: 10.3386/w24001, NBER Working Paper, Vol. Publisher.
Constantinides, P., Monteiro, E. and Mathiassen, L. (2024), “Human-AI joint task performance: learning from uncertainty in autonomous driving systems”, Information and Organization, Vol. 34 No. 2, 100502, Elsevier Ltd, doi: 10.1016/j.infoandorg.2024.100502.
Crawford, K. and Whittaker, M. (2016), The AI Now Report. The Social and Economic Implication of Artificial Intelligence Technologies in the Near-Term, White House and New York University’s Information Law Institute.
Daugherty, P.R. and Wilson, H.J. (2018), Human + Machine: Reimagining Work in the Age of AI, Harvard Business Press, Boston, MA.
Davenport, B.Y.T.H. and Ronanki, R. (2018), “Artificial intelligence for the real world”, Harvard Business Review, No. 1, pp. 108-116.
Day, D.V., Gordon, S. and Fink, C. (2012), “The sporting life: exploring organizations through the lens of sport”, The Academy of Management Annals, Vol. 6, pp. 1-37, doi: 10.5465/19416520.2012.678697.
Dellermann, D., Calma, A., Lipusch, N., Weber, T., Weigel, S. and Ebel, P. (2019a), “The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systems”, Proceedings of the 52nd Hawaii International Conference on System Sciences, doi: 10.24251/hicss.2019.034.
Dellermann, D., Ebel, P., Söllner, M. and Leimeister, J.M. (2019b), “Hybrid intelligence”, Business Information Systems Engineering, Vol. 61 No. 5, pp. 637-643, doi: 10.1007/s12599-019-00595-2.
Du, W.(D.), Pan, S.L., Leidner, D.E. and Ying, W. (2019), “Affordances, experimentation and actualization of FinTech: a blockchain implementation study”, Journal of Strategic Information Systems, Vol. 28 No. 1, pp. 50-65, doi: 10.1016/j.jsis.2018.10.002.
Ebel, P., Söllner, M., Leimeister, J.M., Crowston, K. and de Vreede, G.J. (2021), “Hybrid intelligence in business networks”, Electronic Markets, Vol. 31 No. 2, pp. 313-318, doi: 10.1007/s12525-021-00481-4.
Emirbayer, M. and Mische, A. (1998), “What is agency?”, The American Journal of Sociology, Vol. 103 No. 4, pp. 962-1023, doi: 10.1086/231294.
Essén, A. and Värlander, S.W. (2019), “How technology-afforded practices at the micro-level can generate change at the field level: theorizing the recursive mechanism actualized in Swedish rheumatology 2000-2014”, MIS Quartely, Vol. 43 No. 4, pp. 1155-1176.
Felin, T., Kauffman, S., Mastrogiorgio, A. and Mastrogiorgio, M. (2016), “Factor markets, actors, and affordances”, Industrial and Corporate Change, Vol. 25 No. 1, pp. 133-147, doi: 10.1093/icc/dtv049.
Fonti, F., Ross, J. and Aversa, P. (2023), “Using sports data to advance management research: a review and a guide for future studies”, Journal of Management, Vol. 49 No. 1, pp. 325-362, doi: 10.1177/01492063221117525.
Fujiwara, H. and Ito, K. (2018), “ICT-based judging support system for artistic gymnastics and intended new world created through 3D sensing technology”, Fujitsu Scientific and Technical Journal, Vol. 54 No. 4, pp. 66-72.
Godé, C., Brion, S. and Bohas, A. (2020), “The affordance-actualization process in a predictive policing context: insights from the French military police”, Twenty-Eighth European Conference on Information Systems (ECIS2020).
Goebeler, L., Standaert, W. and Xiao, X. (2021), “Hybrid sport configurations: the intertwining of the physical and the digital”, Proceedings of the 54th Hawaii International Conference on System Sciences, doi: 10.24251/hicss.2021.708.
Huang, M.H. and Rust, R.T. (2018), “Artificial intelligence in service”, Journal of Service Research, Vol. 21 No. 2, pp. 155-172, doi: 10.1177/1094670517752459.
Huang, M.-H. and Rust, R.T. (2024), “EXPRESS: the caring machine: feeling AI for customer care”, Journal of Marketing, No. Forthcoming, doi: 10.1177/00222429231224748.
Huang, M.H., Rust, R. and Maksimovic, V. (2019), “The feeling economy: managing in the next generation of artificial intelligence (AI)”, California Management Review, Vol. 61 No. 4, pp. 43-65, doi: 10.1177/0008125619863436.
Jarvenpaa, S.L. and Standaert, W. (2018), “Digital probes as opening possibilities of generativity”, Journal of the Association for Information Systems, Vol. 19 No. 10, pp. 982-1000, doi: 10.17705/1jais.00516.
Jia, N., Luo, X., Fang, Z. and Liao, C. (2024), “When and how artificial intelligence augments employee creativity”, Academy of Management Journal, Vol. 67 No. 1, pp. 5-32, Vol. In-Press, doi: 10.5465/amj.2022.0426.
Keller, R., Stohr, A., Fridgen, G., Lockl, J. and Rieger, A. (2019), “Affordance-experimentation-actualization theory in artificial intelligence research - a predictive maintenance story”, 40th International Conference on Information Systems, pp. 1-17.
Lebovitz, S., Levina, N. and Lifshitz-Assaf, H. (2021), “Is AI ground truth really true? The dangers of training and evaluating AI tools based on experts' know-what”, MIS Quarterly, Vol. 45 No. 3, pp. 1501-1525, doi: 10.25300/misq/2021/16564.
Lee, A.S. and Baskerville, R.L. (2003), “Generalizing generalizability in information systems research”, Information Systems Research, Vol. 14 No. 3, pp. 221-243, doi: 10.1287/isre.14.3.221.16560.
Leidner, D.E., Gonzalez, E. and Koch, H. (2018), “An affordance perspective of enterprise social media and organizational socialization”, Journal of Strategic Information Systems, Vol. 27 No. 2, pp. 117-138, doi: 10.1016/j.jsis.2018.03.003.
Leonardi, P. (2023), “Affordances and agency: toward the clarifiation and integration of fractured concepts”, MIS Quartely, Vol. 47 No. 4, pp. ix-xx.
Luo, X., Tong, S., Fang, Z. and Qu, Z. (2019), “Frontiers: machines vs humans: the impact of artificial intelligence chatbot disclosure on customer purchases”, Marketing Science is an Institute for Operations Research and the Management Sciences (INFORMS), Vol. 38 No. 6, pp. 937-947.
Luo, X., Qin, M.S., Fang, Z. and Qu, Z. (2021), “Artificial intelligence coaches for sales agents: caveats and solutions”, Journal of Marketing, Vol. 85 No. 2, pp. 14-32, doi: 10.1177/0022242920956676.
Marino, A., Aversa, P., Mesquita, L.F. and Anand, J. (2015), “Driving performance via exploration in changing environments: evidence from formula one racing”, Organization Science, Vol. 26 No. 4, pp. 1079-1100, doi: 10.1287/orsc.2015.0984.
Mazurova, E., Standaert, W., Penttinen, E. and Tan, F.T.C. (2022), “Paradoxical Tensions Related to AI-Powered Evaluation Systems in Competitive Sports”, Information Systems Frontiers, Vol. 24, pp. 897-922, doi: 10.1007/s10796-021-10215-8.
Nagy, P. and Neff, G. (2015), “Imagined affordance: reconstructing a keyword for communication theory”, Social Media and Society, Vol. 1 No. 2, pp. 1-9, doi: 10.1177/2056305115603385.
Patton, M.Q. (2002), Qualitative Research and Evaluation Methods, 3rd ed., Sage Publications, Thousand Oaks, CA.
Rai, A., Constantinides, P. and Sarker, S. (2019), “Next-generation digital platforms: toward human-AI hybrids”, MIS Quarterly, Vol. 43 No. 1, pp. iii-ix.
Raisch, S. and Krakowski, S. (2021), “Artificial intelligence and management: the automation–augmentation paradox”, Academy of Management Review, Vol. 46 No. 1, pp. 192-210, doi: 10.5465/amr.2018.0072.
Rinta-Kahila, T., Penttinen, E., Salovaara, A., Soliman, W. and Ruissalo, J. (2023), “The vicious circles of skill erosion: a case study of cognitive automation”, Journal of the Association for Information Systems, Vol. 24 No. 5, pp. 1378-1412, doi: 10.17705/1jais.00829.
Rosemann, M. and Vessey, I. (2008), “Toward improving the relevance of information systems research to practice: the role of applicability checks”, MIS Quarterly, Vol. 32 No. 1, pp. 1-22, doi: 10.2307/25148826.
Sarker, S., Xiao, X., Beaulieu, T. and Lee, A.S. (2018), “Learning from first-generation qualitative approaches in the IS discipline: an evolutionary view and some implications for authors and evaluators (Part 2/2)”, Journal of the Association for Information Systems, Vol. 19 No. 9, pp. 909-923, doi: 10.17705/1jais.00512.
Sarker, S., Chatterjee, S., Xiao, X. and Elbanna, A. (2019), “The sociotechnical axis of cohesion for the IS discipline: its historical legacy and its continued relevance”, MIS Quarterly: Management Information Systems, Vol. 43 No. 3, pp. 695-719, doi: 10.25300/misq/2019/13747.
Seidel, S., Berente, N., Lindberg, A., Lyytinen, K. and Nickerson, J.V. (2018), “Autonomous tools and design”, Communications of the ACM, Vol. 62 No. 1, pp. 50-57, doi: 10.1145/3210753.
Seidel, S., Berente, N., Lindberg, A., Lyytinen, K. and Nickerson, J.V. (2019), “Autonomous tools and design: a triple-loop approach to human-machine learning”, Communications of the ACM, Vol. 62 No. 1, pp. 50-57, doi: 10.1145/3210753.
Song, X., Xu, B. and Zhao, Z. (2022), “Can people experience romantic love for artificial intelligence? An empirical study of intelligent assistants”, Information and Management, Vol. 59 No. 2, pp. 1-10, doi: 10.1016/j.im.2022.103595.
Stoeckli, E., Dremel, C., Uebernickel, F. and Brenner, W. (2019), “How affordances of chatbots cross the chasm between social and traditional enterprise systems”, Electronic Markets, Vol. 30 No. 2, pp. 369-403, Electronic Markets, doi: 10.1007/s12525-019-00359-6.
Stremersch, S., Gonzalez, J., Valenti, A. and Villanueva, J. (2022), “The value of context-specific studies for marketing”, Journal of the Academy of Marketing Science, Vol. 51 No. 1, pp. 50-65, doi: 10.1007/s11747-022-00872-9.
Strong, D.M., Volkoff, O., Johnson, S.A., Pelletier, L.R., Tulu, B., Bar-on, I., Trudel, J. and Garber, L. (2014), “A theory of organization-EHR affordance actualization”, Journal of the Association for Information Systems, Vol. 15 No. 2, pp. 53-85, doi: 10.17705/1jais.00353.
Tong, S., Jia, N., Xueming, L. and Fang, Z. (2021), “The Janus face of artificial intelligence feedback: deployment versus disclosure effects on employee performance”, Strategic Management Journal, Vol. 42 No. 9, pp. 1600-1631, doi: 10.1002/smj.3322.
van den Broek, E., Sergeeva, A. and Huysman, M. (2021), “When the machine meets the expert: an ethnography of developing AI for hiring”, MIS Quarterly, Vol. 45 No. 3, pp. 1557-1580, doi: 10.25300/misq/2021/16559.
Volkoff, O. and Strong, D.M. (2013), “Critical realism and affordances: theorizing IT-associated organizational change processes”, MIS Quarterly: Management Information Systems, Vol. 37 No. 3, pp. 819-834, doi: 10.25300/misq/2013/37.3.07.
Volkoff, O. and Strong, D.M. (2017), “Affordance theory and how to use it in is research”, in The Routledge Companion to Management Information Systems, pp. 232-246.
von Krogh, G. (2018), “Artificial intelligence in organizations: new opportunities for phenomenon-based theorizing”, Academy of Management Discoveries, Vol. 4 No. 4, pp. 404-409, doi: 10.5465/amd.2018.0084.
Waizenegger, L., Seeber, I., Dawson, G. and Desouza, K. (2020), “Conversational agents - exploring generative mechanisms and second-hand effects of actualized technology affordances”, Proceedings of the 53rd Hawaii International Conference on System Sciences, Vol. 3, pp. 5180-5189, doi: 10.24251/hicss.2020.636.
Walsham, G. (2006), “Doing interpretive research”, European Journal of Information Systems, Vol. 15 No. 3, pp. 320-330, doi: 10.1057/palgrave.ejis.3000589.
Wang, W., Gao, G. and Agarwal, R. (2024), “Friend or foe? Teaming between artificial intelligence and workers with variation in experience”, Management Science, No. Forthcoming, available at: http://pubsonline.informs.org/journal/mnsc, doi: 10.1287/mnsc.2021.00588.
Wilson, H.J., Daugherty, P.R. and Morini-Bianzino, N. (2017), “The jobs that artificial intelligence will create”, MIT Sloan Management Review, Vol. 58 No. 4, pp. 14-16.
Xiao, X., Hedman, J., Tan, F.T.C., Tan, C.-W., Lim, E.T.K., Clemmensen, T., Henningsson, S., Mukkamala, R.R., Vatrapu, R. and Hillegersberg, J.V. (2017), “Sports digitalization: an overview and A research agenda”, 38th International Conference on Information Systems, AIS Electronic Library (AISeL), pp. 1-21.
Yang, J., Marrone, M. and Amrollahi, A. (2023), “What makes AI different? Exploring affordances and constraints - the case of auditing”, European Conference on Information Systems, p. 265.
Yin, R.K. (2014), Case Study Research: Design and Methods, 5th ed., SAGE Publications, Thousand Oaks, CA.
Yu, X., Xu, S. and Ashton, M. (2023), “Antecedents and outcomes of artificial intelligence adoption and application in the workplace: the socio-technical system theory perspective”, Information Technology and People, Vol. 36 No. 1, pp. 454-474, doi: 10.1108/itp-04-2021-0254.
Similar publications
Sorry the service is unavailable at the moment. Please try again later.
This website uses cookies to improve user experience. Read more
Save & Close
Accept all
Decline all
Show detailsHide details
Cookie declaration
About cookies
Strictly necessary
Performance
Strictly necessary cookies allow core website functionality such as user login and account management. The website cannot be used properly without strictly necessary cookies.
This cookie is used by Cookie-Script.com service to remember visitor cookie consent preferences. It is necessary for Cookie-Script.com cookie banner to work properly.
Performance cookies are used to see how visitors use the website, eg. analytics cookies. Those cookies cannot be used to directly identify a certain visitor.
Used to store the attribution information, the referrer initially used to visit the website
Cookies are small text files that are placed on your computer by websites that you visit. Websites use cookies to help users navigate efficiently and perform certain functions. Cookies that are required for the website to operate properly are allowed to be set without your permission. All other cookies need to be approved before they can be set in the browser.
You can change your consent to cookie usage at any time on our Privacy Policy page.