title: Construction of an Emotional Image of a Person Based on the Analysis of Key Points in Consecutive Frames of a Video Sequence
metadata.name: dc.contributor.author
metadata.value: Averianov, Dmitry Dmitriyevich
metadata.lang: -
metadata.name: dc.contributor.author
metadata.value: Zheludev, Mikhail Valerievich
metadata.lang: -
metadata.name: dc.contributor.author
metadata.value: Kiyaev, Vladimir Ilyich
metadata.lang: -
metadata.name: dc.date.accessioned
metadata.value: 2023-10-06T14:28:23Z
metadata.lang: -
metadata.name: dc.date.available
metadata.value: 2023-10-06T14:28:23Z
metadata.lang: -
metadata.name: dc.date.issued
metadata.value: 2023-09
metadata.lang: -
metadata.name: dc.identifier.other
metadata.value: https://doi.org/10.21638/11701/spbu35.2023.306
metadata.lang: -
metadata.name: dc.identifier.uri
metadata.value: http://hdl.handle.net/11701/44141
metadata.lang: -
metadata.name: dc.description.abstract
metadata.value: The work is devoted to the development of an algorithm for classifying human behavior in the context of detecting the truthfulness or falsity of statements presented in video file format. The analysis of the video file was carried out within the time window, in which both changes in the micromotility of the facial muscles and speech signs were analyzed. In our case, facial expressions are represented by a mathematical representation in the form of a vector containing the necessary digital information about the state of the face, which is characterized by the positions of special points (key points of the nose, eyebrows, eyes, eyelids, etc.). The mimic vector is formed as a result of training non-linear models. The speech characterizing vector is formed on the basis of the heuristic characteristics of the audio signal. The temporal aggregation of vectors for the final classification of behavior is performed by a separate neural network. The paper presents the results of the accuracy and speed of the algorithm, which show that the new approach is competitive with respect to existing methods.
metadata.lang: en_GB
metadata.name: dc.language.iso
metadata.value: ru
metadata.lang: en_GB
metadata.name: dc.publisher
metadata.value: St Petersburg State University
metadata.lang: en_GB
metadata.name: dc.relation.ispartofseries
metadata.value: Differential Equations and Control Processes;Issue 3
metadata.lang: -
metadata.name: dc.subject
metadata.value: audio analysis
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: facial landmarks
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: lie detector
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: machine and deep learning
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: speech signal
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: transformers
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: video analytics
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: video classification
metadata.lang: en_GB
metadata.name: dc.title
metadata.value: Construction of an Emotional Image of a Person Based on the Analysis of Key Points in Consecutive Frames of a Video Sequence
metadata.lang: en_GB
metadata.name: dc.type
metadata.value: Article
metadata.lang: en_GB
resources.filename: 99-112.pdf
resources.url: https://dspace.spbu.ru/bitstream/11701/44141/1/99-112.pdf
resources.format: Adobe PDF
resources.size: 819,94 kB