Multimodal Engagement through a Transmedia Storytelling Project for Undergraduate Students

Melissa Shamini Perry


Transmedia storytelling has great potential in the field of education and research on its applications and benefits in teaching and learning is growing. This paper explores the use of transmedia storytelling as a multimodal pedagogical tool for tertiary students. This paper explicates the design and application of a transmedia storytelling project in increasing multimodal engagement for undergraduate students from various faculties. A case study of a transmedia storytelling campaign conceptualised and produced by undergraduate students from a Malaysian public university was analysed for evidence of multimodal engagement. Students’ project output including campaign pitches, campaign designs and artefacts such as  scripts, storyboards, posters, photos and videos submitted via digital formats were collated and analysed using a multimodal framework. Post-assessment reflections submitted by students were also analysed. The findings of the case study revealed that the conceptualisation and production of a transmedia storytelling campaign consisting of a short film, book and social media page enabled students to engage with multiple modalities and develop various skills and competencies. Analysis of campaign artefacts and student reflections found that the use of this novel pedagogy enabled students to engage with visual and spatial, linguistic, audio, gestural and technical digital modes of meaning as well as develop literary competencies and creative thinking skills through this project. This paper paves the way for further exploration of the use of transmedia storytelling as a multimodal pedagogical tool to develop various literacies, educational competencies as well as 21st century skills amongst tertiary students.


multimodality; transmedia; storytelling; pedagogy; higher education

Full Text:



Álvarez, J. (2016). Meaning making and communication in the multimodal age: Ideas for language teachers. Colomb. Appl.Linguist.J. 18(1), 98-115.

Arola, K., Sheppard, J. & Ball, C.E. (2014). Writer/Designer: A guide to making multimodal projects. Boston: Bedford /St Martins.

Baškarada, S. (2014). Qualitative Case Study Guidelines. The Qualitative Report, 19(40), 1-18. Retrieved June 22, 2020 from

Bidarra, J. & Rodrigues, P. (2018). Transmedia storytelling as a framework for effective blended learning design. In Ubachs, G. & Konings, L. The envisioning report for empowering

universities, 31-33. Maastricht: EADTUD. Retrieved April 21, 2020 from

Bowen, T. (2017). Assessing visual literacy: a case study of developing a rubric for identifying and applying criteria to undergraduate student learning. Teaching in Higher Education.

(6), 705-719. https://doi:10.1080/13562517.2017.1289507

Chan, B.S.K., Churchill, D. & Chiu, T.K.F. (2017). Digital literacy learning in higher education through digital storytelling approach. Journal of International Education Research. 13(1),


Colley, B., Bilics, A., & Lerch, C. (2012). Reflection: A key component to thinking critically. The Canadian Journal for the Scholarship of Teaching and Learning. 3(1), 1-19.

Cope, B., & Kalantzis, M. (2009). A grammar of multimodality. The International Journal of Learning. 16(2), 361-423.

Darke, P. and Shanks, G. (2002). Case Study Research. In Williamson, K. Research methods for students, academics and professionals: Information management and systems. 111-

(2nd ed.). Centre for Information Studies.

Dingli, A. and Seychell, D. (2015). The new digital natives: Cutting the cord. Heidelberg: Springer.

Fleming, L. (2013). Expanding learning opportunities with transmedia practices: Inanimate Alice as an exemplar. Journal of Media Literacy Education. 5(2), 366-369. Retrieved, April

, 2020 from

Gambarato, R.R. & Dabagian, L. (2016). Transmedia dynamics in education: the case of robot heart stories. Educational Media International. 53(4), 229-243.

Herr-Stephenson, B., Alper, M., Reilly, E., & Jenkins, H. (2013). T is for transmedia: Learning through transmedia play. Journal of Media Literacy Education. 5(2), 366-369. Retrieved

April 22, 2020 from

Jewitt, C. (2008). Multimodality and literacy in school classrooms. Review of Research in Education. 32, 241-267. https://doi:10.3102/0091732X07310586.

Jewitt, C., & Kress, G. (Eds.) (2003). Multimodal literacy. New York: Peter Lang.

Kalogeras, S. (2014). Transmedia storytelling and the new era of media convergence in higher education. Houndmills: Palgrave Macmillan.

Kress, G. & Van Leeuwen, T. (2002). Colour as a semiotic mode: notes for a grammar of colour. Visual Communication. 1(3), 343-368.

Kress, G., Jewitt, C., Ogborn, J., & Tsatsarelis, C. (2001). Multimodal teaching and learning. The rhetorics of the science classroom. London: Continuum.

Lee, Y. & Ertmer, P.A. (2006). Examining the effects of small group discussions and question prompts on vicarious learning outcomes. Journal of Research on Technology in

Education. 39(1), 66-80.

Lim, Fei & Tan, Serene. (2018). Developing multimodal literacy through teaching the critical viewing of films in Singapore. Journal of Adolescent & Adult Literacy. 62(1), 291-300

Nouri, J. (2018) Students’ multimodal literacy and design of learning during self-studies in higher education. Tech Know Learn. 24, 683–698.


Pence, H.E. (2012). Teaching with transmedia. Journal of Educational Technology System. 40(2), 131-140.

Periasamy, M.S, Gruba, P. Subramaniam, G. (2015). A multimodal literary analysis of a television commercial. 3L: The Southeast Asian Journal of English Language Studies. 24(4),


Perry, M.S. (2018). 21st century skills through film production in tertiary education: A transformative assessment in a literature and media course. 3L: Language, Linguistics and

Literature, The Southeast Asian Journal of English Language Studies. 21(3), 51-164.

Pratten, R. (2015). Getting started in transmedia storytelling: A practical guide for beginners. (2nd ed.). CreateSpace Independent Publishing Platform.

Rodrigues, P. & Bidara, J. (2016). Transmedia storytelling as an educational strategy: A prototype for learning English as a second language. International Journal of Creative

Interfaces and Computer Graphics. 7(2), 56-67. https://doi: 10.4018/IJCICG.2016070105.

Sánchez-Martínez, J. & Albaladejo-Ortega, S. (2018). Transmedia storytelling and teaching experience in higher education. International Journal of Contemporary Education. 1(1),


Serafini, F. (2014). Reading the visual: An introduction to teaching multimodal literacy. New York: Teachers College Press.

Shima Yahya (2018, May 20) Hope & Home by Le’Bien UKM. [Video] YouTube. Retrieved May 4, 2020 from

Suraini Mohd-Ali, Haliza Harun, Normazla Ahmad Mahir, Norhaili Massari, Noor Sazaai Mat Saad & Simkin, K. (2018). Meeting the demands of the 21st century English language

learning through PBL-LcCRAFT. GEMA Online® Journal of Language Studies. 18(2), 255-266.

Tang, Shaofeng. (2016). Digital storytelling approach in a multimedia feature writing course. Journal of Language Teaching and Research. 7(3),572-578.

The New London Group. (2000). A pedagogy of Multiliteracies designing social futures. In B. Cope, B. and Kalantzis, M. (Eds.), Multiliteracies: Literacy Learning and the Design of

Social Futures (pp. 9-38). South Yarra: MacMillan.

Toohey, K., D. Dagenais, A. Fodor, L. Hof, O., Nuñez, A. Singh, & Schulze, L. (2015). “That sounds so cooool”: Entanglements of children, digital tools, and literacy practices. TESOL

Quarterly. 49(3), 461-485.

Wong, L-H., Chen, W. & Jan, M. (2012). How artefacts mediate small-group co-creation activities in a mobile – assisted seamless language learning environment? Journal of

Computer Assisted Learning. 28(5), 411-424.

Zammit, K. (2010). The New Learning Environments framework: Scaffolding the development of multiliterate students. Pedagogies: An International Journal. 5(4), 325-337.




  • There are currently no refbacks.




eISSN : 2550-2131

ISSN : 1675-8021