Developing multimodal communicative competence in emerging academic and professional genres

Keywords: product pitches, research pitches, semiotic modes, genre awareness, multimodal literacy, genre pedagogy

Abstract

In this paper, we propose a pedagogical approach for teaching and learning multimodal literacy, specifically, the application of multimodal discourse analysis for genre awareness. The mastery of specific oral genres is seen as desirable to help students become competent professionals. This is the case of Product Pitches (PPs) in the business field and Research Pitches (RPs) in the academic field. The former are short presentations that introduce a product to the market, the latter constitute an emerging way of disseminating ongoing research to the general public. A salient characteristic of both is their multimodal nature, which has raised an increasing interest in multimodal approaches to genre pedagogy. Our aim is to develop students’ analytical skills to make them aware of the variety of semiotic modes and the importance of using them coherently. The pedagogical approach is facilitated by specialised software that supports the systematic teaching and learning of multimodal genres.

Author Biography

Julia Valeiras-Jurado , Universiy of Ghent

Julia Valeiras-Jurado holds a Doctor’s Degree in Linguistics from Jaume I University and Ghent University. She lectures Business and Scientific English at Ghent University. Her research interests include oral discourse and genres, multimodality, intonation, gestures and head movements as semiotic modes, and persuasive language. Her publications have appeared in Ibérica and Discourse Studies, among others.​

References

Airey, J. (2016, December). Undergraduate teaching with multiple semiotic resources: Disciplinary affordance vs pedagogical affordance. Unpublished presentation at The 8th International Conference on Multimodality. Multimodal Landscapes: Designing, changing, shaping, University of Cape Town.

Ajayi, L. (2009). English as a second language learners' exploration of multimodal texts in a junior high school. Journal of Adolescent & Adult Literacy, 52(7), 585-595.

Anderson-Hsieh, J. & Koehler, K. (1988). The Effect of Foreign Accent and Speaking Rate on Native Speaker Comprehension. Language Learning, 38 (4), 561-613.

Argyle M., Ingham, R., Alkema, F. & McCallin, M. (1981). The different functions of gaze. In A. Kendon (Ed.), Nonverbal Communication, Interaction and Gesture (pp. 283-295). Paris/New York, NY: Mouton.

Bonsignori, V. (2018). Using films and TV series for ESP teaching: A multimodal perspective. System, https://doi.org/10.1016/j.system. 2018.01.005.

Bonsignori, V. (2019). A multimodal analysis of spoken medical English in expert-to-expert interaction in TV programmes. Ibérica, 37, 115-140.

Brazil, D. (1997). The Communicative Value of Intonation in English (2nd ed). Cambridge: Cambridge University Press.

Busà, M. G. (2010). Sounding Natural: Improving Oral Presentation Skills. Language Value, 2(1), 51–67.

Campoy Cubillo, M.C. & Querol Julián, M. (2015). Assessing multimodal listening. In B. Crawford & I. Fortanet Gómez (Eds.), Multimodal Analysis in Academic Settings: From Research to Teaching (193 -212). London/ New York, NY: Routledge.

Cestero-Mancera, A. (2017). La comunicación no verbal. In A. M. Cestero & I. Penadés (Eds.), Manual del profesor de ELE (pp. 1051-1122). Alcalá de Henares: Universidad de Alcalá.

Cestero-Mancera, A. (2018). Recursos no verbales en comunicación persuasiva: Imagen, proxémica y paralenguaje. Lengua y Habla, 22, 135-159.

Chang, Y. J. & Huang H. T. (2015). Exploring TED talks as a pedagogical resource for oral presentations: A corpus-based move analysis. English Teaching & Learning, 39, 29-62.

Clarke, J. S., Cornelissen, J. P. & Healey, M. P. (2019). Actions speak louder than words: how figurative language and gesturing in entrepreneurial pitches influences investment judgments. Academy of Management Journal, 62(2), 335-360.

Coccetta, F. (2018). Developing university students’ multimodal communicative competence: Field research into multimodal text studies in English. System, 77, 19-27.

Crawford-Camiciottoli, B. & Campoy-Cubillo, M.C. (2018) (Eds.) Special Issue: Multimodal Perspectives on English Language Teaching in Higher Education. System, 77.

ELAN (Version 5.2) [Computer software]. 2018, April 04. Nijmegen: Max Planck Institute for Psycholinguistics. Retrieved from https://tla.mpi.nl/tools/tla-tools/elan/

Forey, G., & Feng, D. (2016). Interpersonal Meaning and Audience Engagement in Academic Presentations: A Multimodal Discourse Analysis Perspective. In K. Hyland and P. Shaw (Eds), The Routledge Handbook of English for Academic Purposes (pp. 416-430). London: Routledge.

Fortanet-Gómez I. & Bernard-Mechó, E. (Eds). (2019). Multimodal Analysis of Specialized Discourse. Special Issue. Ibérica, 37.

Fuertes-Olivera, P., Velasco-Sacristan, M., Arribas-Baño, A. & Samaniego-Fernandez, E. (2001). Persuasion and advertising English: Metadiscourse in slogans and headlines. Journal of pragmatics, 33(8), 1291-1307.

Hincks, R. (2005). Measuring Liveliness in Presentation Speech. Proceedings of Interspeech 2005, Lisbon (pp. 765-768).

Hincks, R. (2009). Speaking rate and information content in English lingua franca oral presentations. English for Specific Purposes. Advance online publication. doi:10.1016/j.esp.2009.05.004

Hood, S. & Forey, G. (2005). Introducing a conference paper: Getting interpersonal with your audience. Journal of English for Academic Purposes, 4(4), 291–306.

Hu, G. & Liu, Y. (2018). Three minute thesis presentations as an academic genre: across disciplinary study of genre moves. Journal of English for Academic Purposes, 35, 16-30.

Huang & Pearce (2015). Managing the Unknowable: The Effectiveness of Early-stage Investor Gut Feel in Entrepreneural Investment Decisions. The ASQ blog. Retrieved 22 August, 2019 from https://asqblog.com/2016/02/04/huang-and-pearce-2015-managing-the-unknowable-the-effectiveness-of-early-stage-investor-gut-feel-in-entrepreneurial-investment-decisions/

Hyland, K. (2005). Metadiscourse. London: Continuum.

Iedema (2003). Multimodality, Resemiotization: Extending the Analysis of Discourse as Multi-Semiotic Practice. Visual Communication, 2(1), 29–57.

Jewitt, C. & Kress, G. (Eds.) (2003). Multimodal Literacy. New York, NY: Peter Lang.

Jiménez-Muñoz, A. (2019). Beyond language: a multimodal analysis of success in non-native Business English pitches. Ibérica, 37, 65-86.

Kendon, A. (2004). Gesture. Visible action as utterance. Cambridge: Cambridge University Press.

Kress, G. (2003). Literacy in the New Media Age. London: Routledge.

Kress, G. (2010). Multimodality: A Social Semiotic Approach to Contemporary Communication. London: Routledge.

Lemke, J.L. (1998). Multiplying Meaning: Visual and Verbal Semiotics in Scientific Text. In J. R. Martin & R. Veel (Eds.), Reading & Science (pp. 87- 113). London: Routledge.

Levis J. & Pickering, L. (2004). Teaching intonation in discourse using speech visualization technology. System, 32 (4), 505-524.

Morell, T. (2015). International Conference Paper Presentations: A Multimodal Analysis to Determine Effectiveness. English for Specific Purposes, 37, 137–50.

Morell, T. (2018). Multimodal competence and effective interactive lecturing. System, 77, 19-27.

Norris, S. (2004). Analysing Multimodal Interaction: A Methodological Framework. London & New York, NY: Continuum.

The New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard educational review, 66(1), 60-93.

Niebuhr O., Voße, J. & Brem, A. (2016). What makes a charismatic speaker? A computer-based acoustic-prosodic analysis of Steve Jobs tone of voice. Computers in Human Behaviour, 64, 366-382.

O'Halloran, K., Tan, S. & Marissa K.L. (2015). Multimodal analysis for critical thinking. Learning, Media and Technology.

O'Halloran, K., Tan, S. & Smith, B. (2016). Multimodal Approaches to English for Academic Purposes. In K. Hyland & P. Shaw (Eds.), The Routledge Handbook of English for Academic Purposes (pp. 256-269). London: Routledge.

Palmer-Silveira, J. C. (2015). Multimodality in Business Communication: Body Language as a Visual Aid in Student Presentations. In B. Crawford Camiciottoli & I. Fortanet-Gómez (Eds.), Multimodal Analysis in Academic Settings: From Research to Teaching (pp. 171–192). London: Routledge.

Poyatos, F. (2002). Nonverbal Communication across Disciplines. Volume II. Paralanguage, Kinesics, Silence, Personal and Environmental Interaction. Amsterdam: John Benjamins.

Querol-Julián, M., & Fortanet-Gómez, I. (2019). Collaborative teaching and learning of interactive multimodal spoken academic genres for doctoral students. International Journal of English Studies, 19(2), 61-82.

Rendle-Short, J. (2006). The Academic Presentation: Situated Talk in Action. Aldershot: Ashgate.

Ruiz-Madrid, N. & Fortanet-Gómez, I. (2016). Exploring research pitches from a multimodal discourse analysis perspective: the role of multimodal ensembles in their generic definition. Oral presentation at the 8th Conference on Multimodality: Multimodal landscapes. Cape Town, South Africa, 2016.

Ruiz-Madrid, N. & Fortanet-Gómez, I. (2019). A Multimodal Discourse Analysis (MDA) approach for EMI teachers training: The Case of Pedagogical Affordances in the Mechanical Engineering Field. In A.C. Lahuerta- Martínez & A. Jiménez- Muñoz (Eds.), Empirical Studies in Multilingualism. Analysing Contexts and Outcomes.

Stein, P. (2000). Rethinking resources in the ESL Classroom: multimodal pedagogies in the ESL classroom. TESOL Quaterly, 34(2), 333-336.

Querol-Julián, M. & Fortanet Gómez, I. (2012). Multimodal evaluation in academic discussion sessions: how do presenters act and react? English for Specific Purposes, 31(4), 271-283.

Valeiras-Jurado, J. & Ruiz-Madrid, M.N. (2019). Multimodal enactment of characters in conference presentations. Discourse Studies, 21(5), 561-583.

Valeiras-Jurado, J. (2019). Modal coherence in specialised discourse. A case study of persuasive oral presentations in business and academia. Iberica, 37, 87-114.

Published
27-06-2020
How to Cite
Ruiz-Madrid, N., & Valeiras-Jurado , J. (2020). Developing multimodal communicative competence in emerging academic and professional genres. International Journal of English Studies, 20(1), 27-50. https://doi.org/10.6018/ijes.401481
Section
Articles