Effective creative crowdsourcing: A multi-dimensional evaluation framework

creative crowdsourcing; effectiveness; idea selection and implementation; performance indicators; Strategy and Management; Management of Technology and Innovation

Abstract :

[en] Effective creative crowdsourcing has mainly been investigated based on effective idea generation and selection management, but other dimensions of effective crowdsourcing (i.e., successful implementation and communication of ideas) have gained little attention so far. While most research has focused on idea generation as an outcome, this research highlights the outcome variety of using creative crowdsourcing techniques. The results present an evaluative framework of effective crowdsourcing and identify its drivers at each stage of the crowdsourcing process. The results contribute to an extended evaluation framework of creative crowdsourcing practices.

Research Center/Unit :

PRISME - Pôle de Recherche Interdisciplinaire en Sciences du Management et de l'Économie

Disciplines :

Marketing

Author, co-author :

Steils, Nadia ; Université de Liège - ULiège > Ecole de Gestion de l'Université de Liège ; IAE Lille (University of Lille), LUMEN LAB (ULR 4999), Lille, France

Hanine, Salwa; Toulouse Business School Casablanca Campus, Casablanca, Morocco

Language :

English

Title :

Effective creative crowdsourcing: A multi-dimensional evaluation framework

Publication date :

June 2022

Journal title :

Creativity and Innovation Management

ISSN :

0963-1690

eISSN :

1467-8691

Publisher :

Life Science Publishing Co. Ltd

Volume :

Issue :

Pages :

223 - 235

Peer reviewed :

Editorial Reviewed verified by ORBi

Available on ORBi :

since 20 January 2023

Statistics

Number of views

51 (6 by ULiège)

Number of downloads

1 (0 by ULiège)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

Bibliography

Afuah, A., & Tucci, C. L. (2012). Crowdsourcing as a solution to distant search. Academy of Management Review, 37, 355–375. https://doi.org/10.5465/amr.2010.0146
Allen, B. J., Chandrasekaran, D., & Basuroy, S. (2018). Design crowdsourcing: The impact on new product performance of sourcing design solutions from the “crowd”. Journal of Marketing, 82(2), 106–123. https://doi.org/10.1509/jm.15.0481
Antons, D., & Piller, F. T. (2015). Opening the black box of “not invented here”: Attitudes, decision biases, and behavioral consequences. Academy of Management Executive, 29(2), 193–217. https://doi.org/10.5465/amp.2013.0091
Barrett, G., Dooley, L., & Bogue, J. (2021). Open innovation within high-tech SMEs: A study of the entrepreneurial founders influence on open innovation practices. Technovation, 103, 102232. https://doi.org/10.1016/j.technovation.2021.102232
Bayus, B. (2013). Crowdsourcing new product ideas over time: An analysis of the Dell IdeaStorm community. Management Science, 59, 226–244. https://doi.org/10.1287/mnsc.1120.1599
Berreta, M. (2019). Idea selection in web-enabled ideation systems. Journal of Product Innovation Management, 36(1), 5–23. https://doi.org/10.1111/jpim.12439
Blazevic, V., Hammedi, W., Gamefeld, I., Rust, R. T., Jeububgham, T., Andreassen, T. W., & Walter, C. (2013). Beyond traditional word-of-mouth: An expanded model of customer-driven influence. Journal of Service Management, 24, 294–313. https://doi.org/10.1108/09564231311327003
Blohm, I., Leimeister, J. M., & Krcmar, H. (2013). Crowdsourcing: How to benefit from (too) many great ideas. MIS Quarterly Executive, 12(4), 199–211.
Brabham, D. C. (2010). Moving the crowd at Threadless. Information, Communication & Society, 13(8), 1122–1145. https://doi.org/10.1080/13691181003624090
Camacho, N., Nam, H., Kannan, P. K., & Stermersch, S. (2019). Tournaments to crowdsource innovation: The role of moderator feedback and participation intensity. Journal of Marketing, 83(2), 138–157. https://doi.org/10.1177/0022242918809673
Chan, K. W., Li, S. Y., & Zhu, J. J. (2015). Fostering customer ideation in crowdsourcing community: The role of peer-to-peer and peer-to-firm interactions. Journal of Interactive Marketing, 31, 42–62. https://doi.org/10.1016/j.intmar.2015.05.003
Chan, K. W., Li, S. Y., & Zhu, J. J. (2018). Good to be novel? Understanding how idea feasibility affects idea adoption decision making in crowdsourcing. Journal of Interactive Marketing, 43, 52–68. https://doi.org/10.1016/j.intmar.2018.01.001
Chang, W., & Taylor, S. A. (2016). The effectiveness of customer participation in new product development: A Meta-analysis. Journal of Marketing, 80(1), 47–64. https://doi.org/10.1509/jm.14.0057
Claudy, M. C., Garcia, R., & O'Driscoll, A. (2015). Consumer resistance to innovation - a behavioral reasoning perspective. Journal of the Academy of Marketing Science, 43(4), 528–544. https://doi.org/10.1007/s11747-014-0399-0
Dahlander, L., & Piezunka, H. (2020). Why crowdsourcing fails. Journal of Organization Designs, 24, 9–24. https://doi.org/10.1186/s41469-020-00088-7
Djelassi, S., & Decoopman, I. (2013). Customers participation in product development through crowdsourcing: Issues and implications. Industrial Marketing Management, 42, 683–692. https://doi.org/10.1016/j.indmarman.2013.05.006
Eigenraam, A. W., Eelen, J., van Lin, A., & Verlegh, P. W. J. (2018). A consumer-based taxonomy of digital customer engagement practices. Journal of Interactive Marketing, 44, 102–121. https://doi.org/10.1016/j.intmar.2018.07.002
Faullant, R., & Knudson, M.P. (2017). The day after crowdsourcing: Do crowdsourced ideas become innovations? Proceedings of the 17th International CINet Conference, 17.
Finkelstein, S. R., & Fishbach, A. (2012). Tell me what I did wrong: Experts seek and respond to negative feedback. Journal of Consumer Research, 39(1), 22–38. https://doi.org/10.1086/661934
Flatten, T. C., Engelen, A., Zahra, S., & Brettel, M. (2011). A measure of absorptive capacity: Scale development and validation. European Management Journal, 29, 98–116. https://doi.org/10.1016/j.emj.2010.11.002
Fombelle, P. W., Bone, S. A., & Lemon, K. N. (2016). Responding to the 98%: Face-enhancing strategies for dealing with rejected customer ideas. Journal of the Academy of Marketing Science, 44(6), 685–706. https://doi.org/10.1007/s11747-015-0469-y
Frey, K., Lühtje, C., & Haag, S. (2011). Whom should firms attract to open innovation platforms? The role of knowledge diversity and motivation. Long Range Planning, 44(5), 397–420. https://doi.org/10.1016/j.lrp.2011.09.006
Gebauer, J., Füller, J., & Pezzei, E. R. (2013). The dark and the bright side of co-creation: How to deal with angry community members? Journal of Business Research, 66, 1516–1527. https://doi.org/10.1016/j.jbusres.2012.09.013
Gillier, T., Chaffois, C., Belkhoujaa, M., Roth, Y., & Bayus, B. L. (2018). The effects of task instructions in crowdsourcing innovative ideas. Technological Forecasting and Social Change, 134, 35–44. https://doi.org/10.1016/j.techfore.2018.05.005
Girotra, K., Terwiesch, C., & Ulrich, K. T. (2010). Idea generation and the quality of the best idea. Management Science, 56(4), 734–743. https://doi.org/10.1287/mnsc.1090.1144
Glaser, B. G., & Strauss, A. (1967). The discovery of grounded theory. Adline.
Graebner, M. E., Martin, J. A., & Roundy, P. T. (2012). Qualitative data: Cooking without a recipe. Strategic Organization, 10(3), 276–284. https://doi.org/10.1177/1476127012452821
Hanine, S., & Steils, N. (2019). Ideation contests: Crowd management and valorisation to avoid negative feelings of participants. Journal Creativity and Innovation Management, 28(4), 425–435. https://doi.org/10.1111/caim.12325
Hoyer, W. D., Chandy, R., Dorotic, M., Krafft, M., & Singh, S. S. (2010). Consumer cocreation in new product development. Journal of Service Research, 13(3), 283–296. https://doi.org/10.1177/1094670510375604
Jansen, J. J. P., van den Bosch, F. A. J., & Volberda, H. (2005). Managing potential and realized absorptive capacity: How do organizational antecedents matter. Academy of Management Journal, 48(6), 999–1015. https://doi.org/10.5465/amj.2005.19573106
Katz, R., & Allen, T. J. (1982). Investigating the not invented here (NIH) syndrome: A look at the performance, tenure, and communication patterns of 50 R & D project groups. R&D Management, 12(1), 7–20. https://doi.org/10.1111/j.1467-9310.1982.tb00478.x
Kim, B., Kim, E., & Foss, N. J. (2016). Balancing absorptive capacity and inbound open innovation for sustained innovative performance: An attention-based view. European Management Journal, 34(1), 80–90. https://doi.org/10.1016/j.emj.2015.10.002
Koelsch, L. E. (2013). Reconceptualizing the member check interview. International Journal of Qualitative Methods, 12, 168–238. https://doi.org/10.1177/160940691301200105
Kohler, T., Matzler, K., & Füller, J. (2009). Avatar-based innovation: Using virtual worlds for real-world innovation. Technovation, 29(6–7), 395–407. https://doi.org/10.1016/j.technovation.2008.11.004
Lebraty, J. F. (2009). Externalisation ouverte et pérennité. Revue Française de Gestion, 192(2), 151–165. https://doi.org/10.3166/rfg.192.151-165
Natalicchio, A., Petruzzelli, M. A., & Garavelli, C. (2017). Innovation problems and search for solutions in crowdsourcing platforms – A simulation approach. Technovation, 64–65, 28–42. https://doi.org/10.1016/j.technovation.2017.05.002
Nishikawa, H., Schreier, M., Fuchs, C., & Ogawa, S. (2017). The value of marketing crowdsourced new products as such: Evidence from two randomized field experiments. Journal of Marketing Research, 54(4), 525–539. https://doi.org/10.1509/jmr.15.0244
Payne, A. F., Storbacka, K., & Frow, P. (2008). Managing the co-creation of value. Journal of the Academy of Marketing Science, 36(1), 83–96. https://doi.org/10.1007/s11747-007-0070-0
Poetz, M. K., & Schreier, M. (2012). The value of crowdsourcing: Can users really compete with professionals in generating new product ideas? Journal of Product Innovation Management, 29(2), 245–256.
Ranjan, K. R., & Read, S. (2016). Value co-creation: Concept and measurement. Journal of the Academy of Marketing Science, 44(3), 290–315. https://doi.org/10.1007/s11747-014-0397-2
Schenk, E., & Guittard, C. (2011). Towards a characterization of crowdsourcing practices. Journal of Innovation Economics & Management, 7, 93–107. https://doi.org/10.3917/jie.007.0093
Schreier, M., Fuchs, C., & Dahl, D. W. (2012). The innovation effect of user design: Exploring consumers innovation perceptions of firms selling products designed by users. Journal of Marketing, 76(5), 18–32. https://doi.org/10.1509/jm.10.0462
Steils, N., & Hanine, H. (2016). Creative contests: Knowledge generation and underlying learning dynamics for idea generation. Journal of Marketing Management, 32(17–18), 1647–1669. https://doi.org/10.1080/0267257X.2016.1251956
Steils, N., Hanine, S., Rochdane, H., & Hamdani, S. (2021). Urban crowdsourcing: Stakeholder selection and dynamic knowledge flows in high and low complexity projects. Industrial Marketing Management, 94, 164–173. https://doi.org/10.1016/j.indmarman.2021.02.011
Sukhov, A., Sihvonen, A., Netz, J., Magnusson, P., & Olsson, L. E. (2021). How experts screen ideas: The complex interplay of intuition, analysis and sensemaking. Journal of Product Innovation Management, 38, 248–270. https://doi.org/10.1111/jpim.12559
Terwiesch, C., & Ulrich, K. T. (2009). Innovation tournaments: Creating and selecting exceptional opportunities. Harvard Business School Press.
Terwiesch, C., & Xu, Y. (2008). Innovation contests, open innovation, and multiagent problem solving. Management Science, 54(9), 1674–1683. https://doi.org/10.1287/mnsc.1080.0884
Torres, L. H. (2007). Citizen sourcing in the public interest. Knowledge Management for Development Journal, 3(1), 134–145.
Troy, L. C., Hirunyawipada, T., & Paswan, A. K. (2008). Cross-functional integration and new product success: An empirical investigation of the findings. Journal of Marketing, 72(6), 132–146. https://doi.org/10.1509/jmkg.72.6.132
van Dijk, J., Antonides, G., & Schillewaert, N. (2014). Effects of co-creation claim on consumer brand perceptions and behavioural intentions. International Journal of Consumer Studies, 38(1), 110–118. https://doi.org/10.1111/ijcs.12071
West, J., & Bogers, M. (2014). Leveraging external sources of innovation: A review of research on open innovation. Journal of Product Innovation Management, 31(4), 814–831. https://doi.org/10.1111/jpim.12125
Yin, R. K. (2011). Qualitative research from start to finish. Guilford Press.
Zahra, S. H., & George, G. (2002). Absorptive capacity: A review, reconceptualization, and extension. Academy of Management Review, 27(2), 185–203. https://doi.org/10.5465/amr.2002.6587995