Multimodal and Its Elements

​Learning Objectives

At the end of the lesson, the student will be able to:

ØIdentify the elements of multimodal

ØTranscode emojis into plain text: and

ØCreate instructional video/script for presentation using animated image

​Picture/Movie Interpretation

Directions: Give the proper meaning or interpretation of the given emojis.

Multiple Choice

• running late

• working late

• late activity

• running time

Multiple Choice

• hand sign

• left hand

• good luck

• lucky thumb

Multiple Choice

• cross monkey bag

• no monkey business

• cross monkey business

• I saw no monkey

Multiple Choice

• see you soon

• I know right

• I see you there

• I have point right?

Multiple Choice

• look, girl

• you go, girl,

• Thumb right girl

• stop right there

​ Communication is not only relaying messages through voice and letters. It does not limit its purpose to written and verbal text. Communication uses multimodal.

Many texts are multimodal where meaning is communicated through combinations of two or more modes. Modes include written language, spoken language, and patterns of meaning that are visual, audio, gestural, tactile and spatial.

​Multimodal texts include picture books, text books, graphic novels, comics, and posters, where meaning is conveyed to the reader through varying combinations of visual (still image), written language, and spatial modes.

​Digital multimodal texts, such as film, animation, slideshows, e-posters, digital stories, and web pages, convey meaning through combinations of written and spoken language, visual (still and moving image), audio, gestural and spatial modes.

​Live multimodal texts, for example, dance, performance, and oral storytelling, convey meaning through combinations of modes such as gestural, spatial, spoken language, and audio.

​In a visual text, for example, representation of people, objects, and places can be conveyed using choices of visual semiotic resources such as line, shape, size, line and symbols, while written language would convey this meaning through sentences using noun groups and adjectives which are written or typed on paper or a screen

​1. What is the material all about?

2. What elements make up the given material? Do you see pure text? Are there photos and elements?

3. What do you think is the purpose of combining several elements when presenting information?

4. What do you think will happen if an element (or two) is (are) omitted? Will removing an element (like an image) affect the way someone perceives information?

​Simple Multimodal Texts involve a combination of spoken language and audio modes. It includes comics, graphic novels, brochures, newspapers, picture books, e-books, print advertisements, poster, slide presentations, e-posters, social media

​Complex Digital Multimodal Texts convey meaning through dynamic combinations of various modes across written and spoken language, visual, audio, gesture and spatial semiotic resources. It includes animations, digital stories, web pages, documentaries, book trailers, live action films, video games.

Multiple Choice

Newspaper

• Simple

• Complex

Multiple Choice

Picture Books

• Simple

• Complex

Multiple Choice

Digital Stories

• Simple

• Complex

Multiple Choice

Slide Presentation

• Simple

• Complex

Multiple Choice

Video Games

• Simple

• Complex

Multiple Choice

Animation

• Simple

• Complex

Multiple Choice

Book Trailers

• Simple

• Complex

​Directions:

Identify the mode of communication of the identified features.

Multiple Choice

volume of voice

• audio/aural

• linguistic

• visual

• gestural

Multiple Choice

organization of objects in space

• visual

• spatial

• audio/aural

• linguistic

Multiple Choice

vocabulary structure

• gestural

• spatial

• visual

• linguistic

Multiple Choice

rhythm of music

• spatial

• audio/aural

• gestural

• linguistic

Multiple Choice

grammar or oral/written language

• visual

• linguistic

• spatial

• gestural

Multiple Choice

facial expression

• gestural

• visual

• spatial

• linguistic

Multiple Choice

colors and vectors

• linguistic

• gestural

• spatial

• visual

Multiple Choice

position of layout

• gestural

• visual

• spatial

• aural/audio

Multiple Choice

viewpoint in moving images

• visual

• linguistic

• gestural

• spatial

Multiple Choice

sound effects

• visual

• spatial

• gestural

• audio/aural