An implicit research methodology to evaluate advertising effectiveness in Esports streaming based on viewers’ gaze, cognitive and emotional responses.
Abstract
It is difficult to assess the real effectiveness of the sponsorship of esports for a brand. An initial approach would be to calculate the visibility of the brands’ ads during a broadcast, which is usually characterized in terms of exposition time. Classically, this time was computed manually by visual inspection, but computer vision algorithms have recently automated this process, providing some sort of cost effectiveness parameter. This study goes a step further by proposing a new and complementary research methodology to assess the effectiveness of ads in esports, based on implicit research techniques such as electroencephalogram, galvanic skin response, eye-tracking, and analysis of the gaze behavior of the viewers, along with their emotional and cognitive states. Although there is no scarcity of studies on market investigation and advertising employing these research methodologies, these have not been applied to esports research yet. This study reports the implementation of this methodology in a case study with 48 participants during a given esports match. It is also demonstrated how these new metrics, which capture the non-conscious states of viewers, can be used to assess the performance of ads (in this case, brand logos). Additionally, it is shown how ad exposition time (widely accepted metric to assess ad effectiveness) presents an error of 60.18% with respect to real visualization, and how the methodology presented herein can be used to find the best placements for ad/brand exposure during esports broadcast.
Downloads
References
Arafat, S., Husain, S., Niaz, I, and Saleem, M. (2010) Logo detection and recognition in video stream. In 2010 Fifth International Conference on Digital Information Management (ICDIM), IEEE. 163-168. https://doi.org/10.1109/ICDIM.2010.5664211
Ariely, D., and Berns, G. S (2010), Neuromarketing: the hope and hype of neuroimaging in business. Nature reviews neuroscience, 11(4), 284-292. https://doi.org/10.1038/nrn2795
Bashore, A. (2018) “Twitch stats”, available at: http://stats.twitchapps.com (accessed 05 May 2019).
Belanche, D., Flavián, C., and Pérez-Rueda, A. (2014), The influence of arousal on advertising effectiveness. Measuring Behavior, 32-36.
Benedek, M., and Kaernbach, C. (2010), Decomposition of skin conductance data by means of nonnegative deconvolution, Psychophysiology, 47(4), 647-658. https://doi.org/10.1111/j.1469-8986.2009.00972.x
Berlyne, D. (1970) Novelty, complexity, and hedonic value, Perception & psychophysics, 8(5), 279-286. https://doi.org/10.3758/BF03212593
Boucsein, W. (2012) Electrodermal activity, Springer Science & Business Media. https://doi.org/100.1007/978-1-4614-1126-0
Butler, R. (1953) Discrimination learning by rhesus monkeys to visual-exploration motivation, Journal of Comparative and Physiological Psychology, 46(2), 95. https://doi.org/10.1037/h0061616
Bylinskii, Z., Borkin, M., Kim, N., Pfister, H., and Oliva, A. (2015) Eye fixation metrics for large scale evaluation and comparison of information visualizations. In Workshop on Eye Tracking and Visualization, Springer, Cham, 235-255. https://doi.org/10.1007/978-3-319-47024-5_14
Cartocci, G., Caratù, M., Modica, E., Maglione, A. G., Rossi, D., Cherubino, P., and Babiloni, F. (2017). Electroencephalographic, heart rate, and galvanic skin response assessment for an advertising perception study: application to antismoking public service announcements, Journal of visualized experiments, 126. https://doi.org/10.3791/55872
Casado-Aranda, L., Dimoka, A., and Sánchez-Fernández, J. (2019) Consumer processing of online trust signals: a neuroimaging stud. Journal of Interactive Marketing, 47, 159-180. https://doi.org/10.1016/j.intmar.2019.02.006
Martinez-Costa, S. and Sanjuan-Pérez, A. (2011), La percepción del “product Placement” de marcas locales en las series de ficción regionales. Miguel Hernández Communication Journal, 2, 197-2012. https://dialnet.unirioja.es/servlet/articulo?codigo=3771089
Coulter, K., Bruhn, M., Schoenmueller, V., and Schäfer, D. (2012) Are social media replacing traditional media in terms of brand equity creation? Management research review, 35(9). 770–790. https://doi.org/10.1108/01409171211255948
De Luca, R., & Botelho, D. (2020) Olfactory priming on consumer categorization, recall, and choice. Psychology & Marketing, 37(8), 1101-1117. https://doi.org/10.1002/mar.21342
Djamasbi, S., Siegel, M., and Tullis, T. (2010) Generation Y, web design, and eye tracking, International journal of human-computer studies, 68(5), 307-323. https://doi.org/10.1016/j.ijhcs.2009.12.006
Faust, K., Meyer, J., and Griffiths, M. (2013) Competitive and professional gaming: Discussing potential benefits of scientific study, International Journal of Cyber Behavior, Psychology and Learning, 3(1), 67-77. https://doi.org/10.4018/ijcbpl.2013010106
Gevins, A., Smith, M., Leong, H., McEvoy, L., Whitfield, S., Du, R., and Rush, G. (1998) Monitoring working memory load during computer-based tasks with EEG pattern recognition methods, Human Factors, 40(1), 79-91. https://doi.org/10.1518/001872098779480578
Golland, Y., Keissar, K., and Levit‐Binnun, N. (2014) Studying the dynamics of autonomic activity during emotional experience, Psychophysiology, 51(11), 1101-1111. https://doi.org/10.1111/psyp.12261
Grao, L. (2017), Los E-Sports como fenómeno de comunicación y de masas, working paper, Universidad de Valladolid. Facultad de Filosofía y Letras, Spain. https://uvadoc.uva.es/handle/10324/27936
Greenwald, A., McGhee, D. and Schwartz, J. (1998) Measuring individual differences in implicit cognition: the implicit association test, Journal of personality and social psychology, 74(6), 1464. https://doi.org/10.1037/0022-3514.74.6.1464
Gómez Nieto, B., and Puentes Sánchez, B. (2010), Publicidad exterior. Del papel al LED. Telos, 82(1-16).
Hamari, J., and Sjöblom, M. (2017) What is eSports and why do people watch it? Internet research, 27(2), 122-232. https://doi.org/10.1108/IntR-04-2016-0085
Harris, J., Ciorciari, J., and Gountas, J. (2018) Consumer neuroscience for marketing researchers. Journal of consumer behaviour, 17(3), 239-252. https://doi.org/10.1002/cb.1710
Hyvarinen, A. (1999) Fast and robust fixed-point algorithms for independent component analysis. IEEE transactions on Neural Networks, 10(3), 626-634. https://doi.org/10.1109/72.761722
Johar, G., Maheswaran, D., and Peracchio, L. (2006) Mapping the Frontiers: Theoretical Advances in Consumer Research on Memory, Affect, and Persuasion, Journal of Consumer Research, 33(1), 139-149. https://doi.org/10.1086/500493
Johnson, M, and Woodcock, J. (2019), It’s like the gold rush’: the lives and careers of professional video game streamers on Twitch. Tv, Information, Communication & Society, 22(3), 336-351. https://doi.org/10.1080/1369118X.2017.1386229
Kareinen, K., Knutas, A. and Kasurinen, J. (2019) Analysis of advertising in e-sports broad- casts. In CEUR Workshop Proceedings-Proceedings of GHItaly193rd International Workshop on Games-Human Interaction. http://ceur-ws.org/Vol-2480/GHItaly19_paper_01.pdf
Keller, K. (1993) Conceptualizing, measuring, and managing customer-based brand equity, Journal of Marketing, 57(1), 1-22. https://doi.org/10.1177/002224299305700101
Keller, K. (2003) Brand synthesis: The multidimensionality of brand knowledge, Journal of Consumer Research, 29(4), 595-600. https://doi.org/10.1086/346254
Kim, K., Bang, S., and Kim, S. (2004) Emotion recognition system using short-term monitoring of physiological signals, Medical and biological engineering and computing, 42(3), 419-427. https://doi.org/10.1007/BF02344719
Klimesch, W. (1999) EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis, Brain Research Reviews, 29(2-3), 169-195. https://doi.org/10.1016/S0165-0173(98)00056-3
Klimesch, W., and Doppelmayr, M. (1996) Theta band power in the human scalp EEG and the encoding of new information, Neuroreport, 7, 1235-1240. https://doi.org/10.1097/00001756-199605170-00002
Koc, E., and Boz, H. (2018), How can consumer science be used for gaining information about consumers and the market? The role of psychophysiological and neuromarketing research. In Case studies in the traditional food sector, Woodhead Publishing, 129-152. https://doi.org/10.1016/B978-0-08-101007-5.00013-0
La Ferle, C., and Edwards, S. (2006) Product placement: How brands appear on television. Journal of Advertising, 35(4), 65-86. https://doi.org/10.2753/JOA0091-3367350405
Liao, Y., Lu, X., Zhang, C., Wang, Y., and Tang, Z. (2017) Mutual enhancement for detection of multiple logos in sports videos. In Proceedings of the IEEE International Conference on Computer Vision. 4846-4855. https://openaccess.thecvf.com/content_ICCV_2017/papers/Liao_Mutual_Enhancement_for_ICCV_2017_paper.pdf
Loh, H., Gaur, S., and Sharma, P. (2021) Demystifying the link between emotional loneliness and brand loyalty: Mediating roles of nostalgia, materialism, and self‐brand connections. Psychology & Marketing, 38(3), 537-552. https://doi.org/10.1002/mar.21452
Long, N., Burke, J., and Kahana, M. (2014) Subsequent memory effect in intracranial and scalp EEG, Neuroimage, 84, 488-494. https://doi.org/10.1016/j.neuroimage.2013.08.052
Mirón, S., and Lago, B. (2017), Interrelaciones entre el medio televisivo y los videojuegos: historias continuadas, historias conectadas. Redmarka: revista académica de marketing aplicado, 19, 5-31. https://doi.org/10.17979/redma.2017.01.019.4848
Monge-Benito, S., Olabarri-Fernández, E., Usin-Enales, S., Etxebarria-Gangoiti, J., Horna-Prat, E., and Mínguez, J. (2019) Publicidad dirigida a sujetos bilingües: ¿Producen la misma respuesta las dos lenguas? El caso del español y el euskera en la sociedad vasca”, Revista Latina de Comunicación Social, 74, 457-476. https://doi.org/10.4185/RLCS-2019-1340
Moreno, J., and Martín, R. (2016) La capacidad de lograr el efecto que se desea o se espera. Un estudio sobre la desigual efectividad de los medios de acceso al empleo de los jóvenes en España, Mundos emergentes: cambios, conflictos y expectativas, 636-648.
Mullen, T., Kothe, C., Chi, Y., Ojeda, A., Kerth, T., Makeig, S., and Cauwenberghs, G. (2015) Real-time neuroimaging and cognitive monitoring using wearable dry EEG, IEEE Transactions on Biomedical Engineering, 62(11), 2553-2567. https://doi.org/10.1109/TBME.2015.2481482
Namahn (2001) Use eye tracking for usability testing. Research Document, TechGig, Bussels, 1–12.
Newzoo (2019) Global games market report, available al: https://newzoo.com/insights/trend-reports/newzoo-global-games-market-report-2019-light-version/ (accessed 15 January 2020)
Peyró, C., González-Oñate, C., and Peña-Hernández, P. (2019) La influencia de los jugadores de videojuegos online en las estrategias publicitarias de las marcas. Comparativa entre España y Corea. Comunicar, 27(58), 105-114. https://doi.org/10.3916/C58-2019-10
Picard, R. W., Vyzas, E., and Healey, J. (2001) Toward machine emotional intelligence: Analysis of affective physiological state, IEEE transactions on pattern analysis and machine intelligence, 23(10), 1175-1191. https://doi.org/10.1109/34.954607
Sánchez-Fernández, J., Casado-Aranda, L. A., and Bastidas-Manzano, A. B. (2021) Consumer neuroscience techniques in advertising research: A bibliometric citation analysis. Sustainability, 13(3), 1589. https://doi.org/10.3390/su13031589
Seo, Y., Kim, M., Lee, D., and Jung, Y. (2018) Attention to eSports advertisement: effects of ad animation and in-game dynamics on viewers’ visual attention. Behaviour & Information Technology, 37(12), 1194-1202. https://doi.org/10.1080/0144929X.2018.1488993
Smith, R., and Swinyard, W. (1983) Attitude-behavior consistency: The impact of product trial versus advertising, Journal of Marketing Research, 20(3), 257-267. https://doi.org/10.1177/002224378302000304
Sobrino, M., and Ruiz, F. (2014) Publicidad dinámica y plataformas digitales: Brand placement en espacios públicos y transmisiones deportivas en televisión. Telos: Revista de pensamiento sobre comunicación, tecnología y sociedad, 99, 1-8. https://eprints.ucm.es/id/eprint/31467/
Stikic, M., Berka, C., Levendowski, D., Rubio, R., Tan, V., Korszen, S., and Wurzer, D. (2014) Modeling temporal sequences of cognitive state changes based on a combination of EEG-engagement, EEG-workload, and heart rate metrics. Frontiers in neuroscience, 8, 342. https://doi.org/10.3389/fnins.2014.00342
Valenza, G., Citi, L., Lanatá, A., Scilingo, E., and Barbieri, R. (2014), “Revealing real-time emotional responses: a personalized assessment based on heartbeat dynamics”. Scientific reports, Vol. 4, No. 1, pp. 1-13. https://doi.org/10.1038/srep04998
Williams, A., Davids, K., Burwitz, L., and Williams, J. (1992) Perception and action in sport. Journal of Human Movement Studies, 22(4), 147-204.
Wright, A., and Lynch, J. (1995) Communication effects of advertising versus direct experience when both search and experience attributes are present, Journal of Consumer Research, 21(4), 708–718. https://doi.org/10.1086/209429
Wolf, J. (2016) Team huma sold and rebranded as Paris Saint-Germain Esports, available at: https://www.espn.com/esports/story/_/id/17770456/team-huma-branded-paris-saint-germain-name-webedia-bang-bang-management (accesed 28 November 2019)
Zajonc, R. (1968) Attitudinal effects of mere exposure. Journal of personality and social psychology, 9(2), 1. https://doi.org/10.1037/h0025848
The works and papers that are published in this Journal are subject to the following terms:
1. The Publication Service of the University of Murcia (the publisher) has the Publication Rights (Copyright) to the published papers and works, and favors and permits the reusing of the same under the license indicated in point 2.
© Servicio de Publicaciones, Universidad de Murcia, 2013
2. The papers and works are to be published in the digital edition of the Journal under the license Creative Commons Reconocimiento-No Comercial-Sin Obra Derivada 3.0 España (legal text). The copying, using, spreading, transmitting and publicly displaying of the papers, works or publication are permitted as long as: i) the authors and original sources (Journal, publisher and URL of the publication) are quoted; ii) it is not used for commercial benefit; iii) the existence and specifications of this users license are mentioned.
3. Conditions of Self-Archiving. It is permitted and encouraged that the authors spread electronically the pre-print (before printing) and/or post-print (the revised, evaluated and accepted) versions of their papers or works before their publication since this favors their circulation and early diffusion and therefore can help increase their citation and quotation, and also there reach through the academic community.
The works and papers that are published in this Journal are subject to the following terms:
1. The Publication Service of the University of Murcia (the publisher) has the Publication Rights (Copyright) to the published papers and works, and favors and permits the reusing of the same under the license indicated in point 2.
© Servicio de Publicaciones, Universidad de Murcia, 2013
2. The papers and works are to be published in the digital edition of the Journal under the license Creative Commons Reconocimiento-No Comercial-Sin Obra Derivada 3.0 España (legal text). The copying, using, spreading, transmitting and publicly displaying of the papers, works or publication are permitted as long as: i) the authors and original sources (Journal, publisher and URL of the publication) are quoted; ii) it is not used for commercial benefit; iii) the existence and specifications of this users license are mentioned.
3. Conditions of Self-Archiving. It is permitted and encouraged that the authors spread electronically the pre-print (before printing) and/or post-print (the revised, evaluated and accepted) versions of their papers or works before their publication since this favors their circulation and early diffusion and therefore can help increase their citation and quotation, and also there reach through the academic community.
