EVALUATION OF THE ATTRIBUTES OF THE CHATBOTS THAT MOST EFFECTIVELY INTERACT WITH THE TOURIST: CASE STUDY OF THE CHATBOT "VICTORIA LA MALAGUEÑA”
Abstract
Chatbots are transforming tourism communication and have been quickly adopted in the tourism industry. But despite its implementation in the sector, there are no studies that analyze the effectiveness of its use in the organization of trips. For this reason, this study measures the tourists’ perceptions during the use of the chatbot "Victoria la Malagueña" through the attributes: informatividad, empathy, accessibility and interactivity. In data processing, exploratory and confirmatory factor analysis were used. The findings suggest that informatividad and empathy are the chatbot attributes most valued by users.
Downloads
References
ALAM, F., DANIELI, M. y RICCARDI, G. (2018): «Annotating and modeling empathy in spoken conversations». Computer Speech y Language, vol. 50, pp. 40-61.
ALBA, J., LYNCH, J., WEITZ, B., JANISZEWSKI, C., LUTZ, R., SAWYER, A. y WOOD, S. (1997): Interactive home shopping: consumer, retailer, and manufacturer incentives to participate in electronic marketplaces. Journal of Marketing, vol. 61 (3), pp. 38-53.
ANDERSON, J. y GERBING, D. (1988): « Structural equation modeling in practice: A review and recommended two-step approach» Psychological Bulletin, vol. 103 (3), pp. 411-423.
ARTEAGA, D., ARENAS, J., PAZ, F., TUPIA, M. y BRUZZA, M. (2019, June): «Design of information system architecture for the recommendation of tourist sites in the city of Manta, Ecuador through a Chatbot». In: 2019 14th Iberian Conference on Information Systems and Technologies (CISTI): IEEE. pp. 1-6.
ASHFAQ, M., YUN, J., YU, S. y LOUREIRO, S.M.C. (2020): «I, Chatbot: Modeling the determinants of users’ satisfaction and continuance intention of AI-powered service agents», Telematics and Informatics, vol. 54, pp. 101473.
BERTHON, P., PITT, L.F. y WATSON, R.T. (1996): «The World Wide Web as an advertising medium» Journal of advertising research, vol. 36 (1), pp. 43-54.
BOES, K., BUHALIS, D. e INVERSINI, A. (2016): «Smart tourism destinations: ecosystems for tourism destination competitiveness». International Journal of Tourism Cities, vol.2 (2), pp. 108-124.
BRANDTZAEG, P.B. y FØLSTAD, A. (2018): «Chatbots: changing user needs and motivations». Interactions, vol. 25 (5), pp. 38-43.
BRAVE, S., NASS, C. y HUTCHINSON, K. (2005): «Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent». International journal of human-computer studies, vol. 62 (2), pp. 161-178.
BUHALIS, D. y AMARANGGANA, A. (2013): "Smart tourism destinations", en Information and communication technologies in tourism 2014». Springer, Cham. pp. 553-564.
BUHALIS, D. y YEN, E.C.S. (2020): «Exploring the use of chatbots in hotels: technology providers’ perspective», en Information and Communication Technologies in Tourism 2020. Springer, Cham, pp. 231-243.
CHAVES, A.P. y GEROSA, M.A. (2021): «How should my chatbot interact? A survey on human-chatbot interaction design», International Journal of Human–Computer Interaction, vol. 37 (8), pp. 729-758.
CHUNG, N., LEE, H., LEE, S.J. y KOO, C. (2015): «The influence of tourism website on tourists' behavior to determine destination selection: A case study of creative economy in Korea», Technological Forecasting and Social Change, vol. 96, pp. 130-143.
CARDONE, K. y FU, X. (2019): «Empathy in Leadership, Life, and the Hospitality Industry»
shorturl.at/duCV5
CLARIZIA, F., COLACE, F., DE SANTO, M., LOMBARDI, M., PASCALE, F. y SANTANIELLO, D. (2019, November): «A Context-Aware Chatbot for Tourist Destinations», en 2019 15th International Conference on Signal-Image Technology y Internet-Based Systems (SITIS) IEEE. pp. 348-354
DANIEL, F., MATERA, M., ZACCARIA, V. y DELL'ORTO, A. (2018, May): «Toward truly personal chatbots: on the development of custom conversational assistants», en Proceedings of the 1st International Workshop on Software Engineering for Cognitive Services, pp. 31-36.
DE LA ROSA, J.M. (2019): «Amanda, el chatbot de Amadeus, llega a España». https://www.hosteltur.com/127469_amanda-el-chatbot-de-amadeus-llega-a-espana.html.
DE WAAL, F.B. y PRESTON, S.D. (2017): «Mammalian empathy: behavioral manifestations and neural basis», Nature Reviews Neuroscience, vol. 18 (8) pp. 498-509.
FØLSTAD, A. y BRANDTZÆG, P.B. (2017): «Chatbots and the new world of HCI.», Interactions. vol. 24 (4), pp. 38-42.
FORD, J.K. MACCALLUM, R.C., y TAIT, M. (1986): «The application of exploratory factor analysis in applied psychology: A critical review and analysis», Personnel Psychology, vol. 39 (2), pp. 291-314.
FORNELL, C. y LARCKER, D.F. (1981): «Evaluating Structural Equation Models with Unobservable Variables and Measurement Error». Journal of Marketing Research, vol. 18 (1), pp. 39-50.
GRETZEL, U. (2021) «Smart tourism development», en Dieke, P. King, B. y Sharpley, R. (Eds.) Tourism in Development: Reflective Essays, pp. 159-168
GRETZEL, U. y KOO, C. (2021): «Smart tourism cities: a duality of place where technology supports the convergence of touristic and residential experiences», Asia Pacific Journal of Tourism Research, vol. 26 (4), pp. 352-364.
GRETZEL, U., SIGALA, M., XIANG, Z. y KOO, C. (2015): «Smart tourism: foundations and developments», Electronic Markets, vol. 25 (3), pp. 179-188.
GRETZEL, U., WERTHNER, H., KOO, C. y LAMSFUS, C. (2015): «Conceptual foundations for understanding smart tourism ecosystems», Computers in Human Behavior, vol. 50, pp. 558-563.
HAIR, J.F., BLACK, W.C., BABIN, B.J., ANDERSON, R.E. y TATHAM, R.L. (1998): «Multivariate data analysis», Upper Saddle River, NJ, Prentice hall. vol. 5 (3), pp. 207-219.
HAIR, J., BLACK, B., BABIN, R., ANDERSON, R. y TATHAM, R. (2006): «Multivariate data analysis», (6th ed.): New York, Prentice Hall.
HAIR, J.F., BLACK, W.C., BABIN, B.J. y ANDERSON, R.E. (2010): Multivariate Data Analysis: A Global Perspective (Seventh). Pearson Education.
HAMED, R.A. (2021): «Egyptian Millennial Travellers' Willingness to Adopt and Use Travel Chatbots: An Exploratory Study». Journal of Association of Arab Universities for Tourism and Hospitality, vol. 21 (1), pp. 49-69.
HEW, J.J., LEONG, L.Y., TAN, G.W.H., LEE, V.H. y OOI, K.B. (2018): «Mobile social tourism shopping: A dual-stage analysis of a multi-mediation model». Tourism Management, vol. 66, pp. 121-139.
HOFFMAN, M.L. (2008): «Empathy and prosocial behavior», en Handbook of emotions, vol. 3, pp. 440-455.
HO, A., HANCOCK, J. y MINER, A.S. (2018): «Psychological, relational, and emotional effects of self-disclosure after conversations with a chatbot», Journal of Communication, vol. 68 (4), pp. 712-733.
HSU, P., ZHAO, J., LIAO, K., LIU, T. y WANG, C. (2017, MAY): «AllergyBot: A Chatbot technology intervention for young adults with food allergies dining out», en Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems, pp. 74-79.
HU, T., XU, A., LIU, Z., YOU, Q., GUO, Y., SINHA, V., LUO, J. y AKKIRAJU, R. (2018): «Touch your heart: A tone-aware chatbot for customer care on social media», en Proceedings of the 2018 CHI conference on human factors in computing systems pp. 1-12.
HUANG, C.D., GOO, J., NAM, K. y YOO, C.W. (2017): «Smart tourism technologies in travel planning: The role of exploration and exploitation», Information y Management, vol. 54 (6), pp. 757-770.
HUANG, M.H. y RUST, R.T. (2018): «Artificial intelligence in service», Journal of Service Research, vol. 21 (2), pp. 155-172.
HUANG, T.H., CHANG, J.C. y BIGHAM, J.P. (2018): «Evorus: A crowd-powered conversational assistant built to automate itself over time», en Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 295, pp. 1-13.
HUBSPOT INC. RESEARCH (2017): Interest in buying from a chatbot.
HUERTAS, A. y MARINE-ROIG, E. (2016): «User reactions to destination brand contents in social media», Information Technology y Tourism, vol. 15 (4), pp. 291-315.
IVANOV, S. H. y WEBSTER, C. (2017): «Adoption of robots, artificial intelligence and service automation by travel, tourism and hospitality companies–a cost-benefit analysis». en International Scientific Conference “Contemporary tourism – traditions and innovations”, 19- 21 October 2017, (pp. 1-9) Sofia University.
IVARS-BAIDAL, J.A. (2019): «Smart destinations and the evolution of ICTs: a new scenario for destination management? », Current Issues in Tourism, vol. 22 (13), pp. 1.581-1.600.
JOHARI, N.M. y NOHUDDIN, P.N. (2021): «Quality attributes for a good chatbot: a literature review», International Journal of Electrical Engineering and Technology (IJEET), vol. 12 (7), pp. 109-119.
JOHNSON, G.J., BRUNER II, G.C. y KUMAR, A. (2006): «Interactivity and its facets revisited: Theory and empirical test», Journal of Advertising, vol. 35 (4), pp. 35-52.
JEONG, M. y SHIN, H.H. (2020): «Tourists’ experiences with smart tourism technology at smart destinations and their behavior intentions», Journal of Travel Research, vol. 59 (8), pp. 1464-1477.
KAISER, H.F. (1970): «A second generation little jiffy». Psychometrika, vol. 35 (4), pp. 401-415.
KHAN, R. y DAS, A. (2018): «Introduction to chatbot», en Build Better Chatbots: A complete guide to getting started with chatbots, pp. 1-11.
KAPLANIDOU, K. y VOGT, C. (2006): «A structural analysis of destination travel intentions as a function of web site features», Journal of Travel Research, vol. 45 (2), pp. 204-216.
KIM, S. y GARRISON, G. (2009): «Investigating mobile wireless technology adoption: An extension of the technology acceptance model», Information Systems Frontiers, vol. 11 (3), pp. 323-333.
KIM, H., SON, J.Y. y SUH, K.S. (2012): «Following firms on twitter: Determinants of continuance and word-of-mouth intentions», Asia Pacific Journal of Information Systems, vol. 22, (3), pp. 1-27.
KLEIN, L.R. (2003): «Creating virtual product experiences: The role of telepresence», Journal of Interactive Marketing, vol. 17, (1), pp. 41-55.
LASEK, M. y JESSA, S. (2013): «Chatbots for customer service on hotels’ websites», Information Systems in Management, vol. 2 (2), pp. 146-158.
LAW, R., QI, S. y BUHALIS, D. (2010): «Progress in tourism management: A review of website evaluation in tourism research», Tourism Management, vol. 31 (3), pp. 297-313.
LEAHU, L. y SENGERS, P. (2014, JUNE): «Freaky: performing hybrid human-machine emotion», en Proceedings of the 2014 conference on Designing interactive systems, pp. 607-616: ACM.
LEE, H., LEE, J., CHUNG, N. y KOO, C. (2018): «Tourists’ happiness: are there smart tourism technology effects? », Asia Pacific Journal of Tourism Research, vol. 23 (5), pp. 486-501.
LEE, L. (2010): «Fostering reflective writing and interactive exchange through blogging in an advanced language course», ReCALL, vol. 22 (2), pp. 212-227.
LEITE, I., CASTELLANO, G., PEREIRA, A., MARTINHO, C. y PAIVA, A. (2014): «Empathic robots for long-term interaction», International Journal of Social Robotics, vol. 6, (3), pp. 329-341.
LI, L., LEE, K. Y., EMOKPAE, E. y YANG, S.B. (2021): «What makes you continuously use chatbot services? Evidence from Chinese online travel agencies», Electronic Markets, vol. 31 (3), pp. 575-599.
LIU, B. y SUNDAR, S.S. (2018): «Should machines express sympathy and empathy? Experiments with a health advice chatbot», Cyberpsychology, Behavior, and Social Networking, vol. 21, (10), pp. 625-636.
LUO, X. (2002): « Uses and gratifications theory and e-consumer behaviors: a structural equation modeling study», Journal of Interactive Advertising, vol. 2, (2), pp. 34-41.
MALHOTRA N.K. y DASH, S. (2011): Marketing Research an Applied Orientation. Londres, Pearson Publishing.
MARKETANDMARKET. (2021): «Chatbot Market Report» « Chatbot Market by Component, Type (Rule Based y AI Based), Applications (Customer service, Customer Engagement y Retention), Channel Integration, Business Function (ITSM, Finance), Vertical and Region-Global Forescast to 2026»Chatbot Market. Disponible en: shorturl.at/exOY5
MATSUMOTO, K., REN, F., KUROIWA, S. y TSUCHIYA, S. (2007, NOVEMBER): «Emotion estimation algorithm based on interpersonal emotion included in emotional dialogue sentences», en Mexican International Conference on Artificial Intelligence. Springer, Berlin, Heidelberg, pp. 1.035-1.045.
MEERSCHMAN, H. y VERKEYN, J. (2019): Towards a better understanding of service quality attributes of a chatbot. Doctoral dissertation, Master’s dissertation. Ghent University Ghent University.
MELIÁN-GONZÁLEZ, S., GUTIÉRREZ-TAÑO, D. y BULCHAND-GIDUMAL, J. (2021): «Predicting the intentions to use chatbots for travel and tourism», Current Issues in Tourism, vol. 24 (2) pp. 192-210.
MUHTASEB, R., LAKIOTAKI, K. y MATSATSINIS, N. (2012): «Applying a multicriteria satisfaction analysis approach based on user preferences to rank usability attributes in e-tourism websites», Journal of Theoretical and Applied Electronic Commerce Research, vol. 7 (3), pp. 28-48.
MURRAY, J., ELMS, J. y CURRAN, M. (2019): «Examining empathy and responsiveness in a high-service context», International Journal of Retaily Distribution Management, vol. 47 (12), pp. 1364-1378.
NEGI, S., JOSHI, S., CHALAMALLA, A.K. y SUBRAMANIAM, L.V. (2009, December): «Automatically extracting dialog models from conversation transcripts», en 2009 Ninth IEEE International Conference on Data Mining. IEEE, pp. 890-895.
NEUHOFER, B., BUHALIS, D. y LADKIN, A. (2015): «Smart technologies for personalized experiences: a case study in the hospitality domain», Electronic Markets, vol. 25 (3), pp. 243-254.
NO, E. y KIM, J.K. (2015): «Comparing the attributes of online tourism information sources», Computers in Human Behavior, vol. 50, pp. 564-575.
PAI, C.K., LIU, Y., KANG, S. y DAI, A. (2020): «The role of perceived smart tourism technology experience for tourist satisfaction, happiness and revisit intention», Sustainability, vol. 12 (16), pp. 6592.
PAIVA, A., LEITE, I., BOUKRICHA, H. y WACHSMUTH, I. (2017): «Empathy in virtual agents and robots: A survey», ACM Transactions on Interactive Intelligent Systems (TiiS), vol. 7 (3), pp. 1-40.
PARASURAMAN, A., ZEITHAML, V.A. y BERRY, L.L. (1994): «Alternative scales for measuring service quality: a comparative assessment based on psychometric and diagnostic criteria». Journal of retailing, vol. 70 (3), pp. 201-230.
PARK, Y.A., GRETZEL, U. y SIRAKAYA-TURK, E. (2007): «Measuring web site quality for online travel agencies». Journal of Travel y Tourism Marketing, vol. 23 (1), pp. 15-30.
PARTALA, T. y SURAKKA, V. (2004): «The effects of affective interventions in human–computer interaction». Interacting with computers, vol. 16 (2), pp. 295-309.
PAVLOU, P.A., LIANG, H. y XUE, Y. (2007): «Understanding and mitigating uncertainty in online exchange relationships: A principal-agent perspective». MIS quarterly, vol. 31 (1), pp. 105-136.
PORTELA, M. y GRANELL-CANUT, C. (2017, September): «A new friend in our smartphone? Observing Interactions with Chatbots in the Search of Emotional Engagement». In: Proceedings of the XVIII International Conference on Human Computer Interaction (pp. 1-7):
PRENDINGER, H. e ISHIZUKA, M. (2005): «The empathic companion: a character-based interface that addresses users' affective states» Applied artificial intelligence, vol. 19 (3-4), pp. 267-285.
RUECKERT, L. y NAYBAR, N. (2008): « Gender differences in empathy: The role of the right hemisphere». Brain and cognition, vol. 67 (2), pp. 162-167.
SANO, A.V.D., IMANUEL, T.D., CALISTA, M.I., NINDITO, H. y CONDROBIMO, A.R. (2018, September): «The application of AGNES algorithm to optimize knowledge base for tourism chatbot». In: 2018 International Conference on Information Management and Technology (ICIMTech) (pp. 65-68): IEEE.
SEDARATI, P., SERRA, F.M.D. y JAKULIN, T.J. (2022): «systems approach to model smart tourism ecosystems». International Journal for Quality Research, vol16 (1), pp. 285-306
SHAWAR, B.A. y ATWELL, E. (2007, January): «Chatbots: are they really useful?», Ldv forum, vol. 22 (1), pp. 29-49.
SIGALA, M. (2017): «Collaborative commerce in tourism: implications for research and industry». Current Issues in Tourism, vol. 20 (4), pp. 346-355.
SIGALA, M. (2018): «New technologies in tourism: From multi-disciplinary to anti-disciplinary advances and trajectories». Tourism management perspectives, vol. 25, pp. 151-155.
SPICER, J. (2005): «Making sense of multivariate data analysis: An intuitive approach». Sage.
THE CONTENT WRANGLER (2018): «2018 Chatbot adoption report» The Content Wrangler and Precision Content Authoring Solutions. Disponible en:
TORRES, C., FRANKLIN, W. y MARTINS, L. (2018): «Accessibility in chatbots: the state of the art in favor of users with visual impairment», en International Conference on Applied Human Factors and Ergonomics. Springer, Cham. pp. 623-635.
UKPABI, D.C., ASLAM, B. y KARJALUOTO, H. (2019): «Chatbot adoption in tourism services: A conceptual exploration», en Robots, artificial intelligence, and service automation in travel, tourism and hospitality. Emerald Publishing Limited.
WANG, K. y LIN, C.L. (2012): «The adoption of mobile value‐added services: Investigating the influence of IS quality and perceived playfulness», Managing Service Quality: An International Journal, vol. 22 (2), pp. 184-208.
WINKLER, R. y SÖLLNER, M. (2018): «Unleashing the potential of chatbots in education: A state-of-the-art analysis», en Academy of Management Annual Meeting (AOM).
WORLDHOTELS (2018): «Chatbots: The impact on the hotel industry.» https://www.worldhotels.com/articles/chatbots-the-impact-on-the-hotel-industry.
XIANG, Z., MAGNINI, V.P. y FESENMAIER, D.R. (2015a): «Information technology and consumer behavior in travel and tourism: Insights from travel planning using the internet», Journal of retailing and consumer services, vol. 22, pp. 244-249.
XIANG, Z., WANG, D., O’LEARY, J.T. y FESENMAIER, D.R. (2015b): «Adapting to the internet: trends in travelers’ use of the web for trip planning», Journal of Travel Research, vol. 54 (4), pp. 511-527.
YALCIN, Ӧ.N. y DIPAOLA, S. (2018): «A computational model of empathy for interactive agents», Biologically inspired cognitive architectures. vol. 26, pp. 20-25.
YEN, C. y CHIANG, M.C. (2020): «Trust me, if you can: a study on the factors that influence consumers’ purchase intention triggered by chatbots based on brain image evidence and self-reported assessments», Behaviour & Information Technology, vol. 40 (11), pp. 1.177-1.194.
YOO, C.W., KIM, Y.J. y SANDERS, G.L. (2015): «The impact of interactivity of electronic word of mouth systems and E-Quality on decision support in the context of the e-marketplace», Information y Management, vol. 52 (4), pp. 496-505.
YOO, C.W., GOO, J., HUANG, C.D., NAM, K. y WOO, M. (2017): «Improving travel decision support satisfaction with smart tourism technologies: A framework of tourist elaboration likelihood and self-efficacy». Technological Forecasting and Social Change, vol. 123, pp. 330-341.
ZALAMA, E., GARCÍA-BERMEJO, J.G., MARCOS, S., DOMÍNGUEZ, S., FELIZ, R., PINILLOS, R. y LÓPEZ, J. (2014): «Sacarino, a service robot in a hotel environment», en ROBOT2013: First Iberian robotics conference. Springer, Cham, pp. 3-14.
ZHOU, L., GAO, J., LI, D. y SHUM, H.Y. (2020): «The design and implementation of xiaoice, an empathetic social chatbot», Computational Linguistics, vol. 46, (1), pp. 53-93.
ZUMSTEIN, D., y HUNDERTMARK, S. (2017): «Chatbots--an interactive technology for personalized communication, transactions and services», IADIS International Journal on WWW/Internet, vol.15 (1), pp. 96-109.
Las obras que se publican en esta revista están sujetas a los siguientes términos:
1. El Servicio de Publicaciones de la Universidad de Murcia (la editorial) conserva los derechos patrimoniales (copyright) de las obras publicadas, y favorece y permite la reutilización de las mismas bajo la licencia de uso indicada en el punto 2.
2. Las obras se publican en la edición electrónica de la revista bajo una licencia Creative Commons Reconocimiento-NoComercial-SinObraDerivada 3.0 España (texto legal). Se pueden copiar, usar, difundir, transmitir y exponer públicamente, siempre que: i) se cite la autoría y la fuente original de su publicación (revista, editorial y URL de la obra); ii) no se usen para fines comerciales; iii) se mencione la existencia y especificaciones de esta licencia de uso.
3. Condiciones de auto-archivo. Se permite y se anima a los autores a difundir electrónicamente las versiones pre-print (versión antes de ser evaluada) y/o post-print (versión evaluada y aceptada para su publicación) de sus obras antes de su publicación, ya que favorece su circulación y difusión más temprana y con ello un posible aumento en su citación y alcance entre la comunidad académica. Color RoMEO: verde.