title: Chapter 3. Where do we look, what do we see, what do we talk about
metadata.name: dc.contributor.author
metadata.value: Chernigovskaya, Tatiana
metadata.lang: -
metadata.name: dc.contributor.author
metadata.value: Alexeeva, Svetlana
metadata.lang: -
metadata.name: dc.contributor.author
metadata.value: Dubasava, Anzhalika
metadata.lang: -
metadata.name: dc.contributor.author
metadata.value: Petrova, Tatiana
metadata.lang: -
metadata.name: dc.contributor.author
metadata.value: Prokopenya, Veronika
metadata.lang: -
metadata.name: dc.contributor.author
metadata.value: Chernova, Daria
metadata.lang: -
metadata.name: dc.date.accessioned
metadata.value: 2020-12-02T15:43:35Z
metadata.lang: -
metadata.name: dc.date.available
metadata.value: 2020-12-02T15:43:35Z
metadata.lang: -
metadata.name: dc.date.issued
metadata.value: 2018
metadata.lang: -
metadata.name: dc.identifier.other
metadata.value: https://doi.org/10.21638/11701/9785288059292.05
metadata.lang: -
metadata.name: dc.identifier.uri
metadata.value: http://hdl.handle.net/11701/21210
metadata.lang: -
metadata.name: dc.description.abstract
metadata.value: In Сhapter 3 we compare how verbal and non-verbal visual information is processed. The questions we addresses are: How do the readers integrate text-figure information when reading and understanding verbal and non-verbal patterns, namely one and the same text in verbal for- mat and infographics? How the way humans perceive visual information determines the way they express it in natural language? How the verbalization affects the oculomotor behavior in visual processing? Our results support the assumption of the Cognitive Theory of Multimedia Learning that integration of verbal and pictural information with each other (a polycode text) helps the learners to understand and memorize the text and makes the comprehension easier. We demonstrate the advantages and disadvantages of the infographics (graphical visual repre- sentations of complex information) and verbal text. Also we discuss the relationship between visual processing of images and their verbalization. On one hand, the characteristics of eye movements when looking at the image determine its subsequent verbal description: the more fixations are made and the longer the gaze is directed to the certain area of the image, the more words are dedicated to this area in the following description. On the other hand, verbalization of the previously seen image affects the parameters of eye movements when re-viewing the same image, resulting with the appearance of the ambient processing pattern (short fixations and long saccades), while the re-viewing without verbalization results with the focal processing pattern (longer fixations and shorter saccades). The results obtained open up prospects for fur- ther research on visual perception and can also be used for computer vision models.
metadata.lang: en_GB
metadata.name: dc.language.iso
metadata.value: ru
metadata.lang: en_GB
metadata.name: dc.publisher
metadata.value: St Petersburg State University
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: text type
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: text format
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: verbal and non-verbal elements
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: polycode text
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: infographics
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: visual perception
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: image processing
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: verbalization
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: verbal description
metadata.lang: en_GB
metadata.name: dc.title
metadata.value: Chapter 3. Where do we look, what do we see, what do we talk about
metadata.lang: en_GB
metadata.name: dc.type
metadata.value: Book chapter
metadata.lang: en_GB
resources.filename: 129-173.pdf
resources.url: https://dspace.spbu.ru/bitstream/11701/21210/1/129-173.pdf
resources.format: Adobe PDF
resources.size: 2,94 MB