title: Chapter 1. Graphematical analysis
metadata.name: dc.contributor.author
metadata.value: Kuznetsov, Sergey A.
metadata.lang: -
metadata.name: dc.contributor.author
metadata.value: Skrebtsova, Tatiana G.
metadata.lang: -
metadata.name: dc.contributor.author
metadata.value: Suvorov, Sergey G.
metadata.lang: -
metadata.name: dc.contributor.author
metadata.value: Klementyeva, Anna V.
metadata.lang: -
metadata.name: dc.date.accessioned
metadata.value: 2020-12-02T10:20:45Z
metadata.lang: -
metadata.name: dc.date.available
metadata.value: 2020-12-02T10:20:45Z
metadata.lang: -
metadata.name: dc.date.issued
metadata.value: 2019
metadata.lang: -
metadata.name: dc.identifier.other
metadata.value: https://doi.org/10.21638/11701/9785288059278.02
metadata.lang: -
metadata.name: dc.identifier.uri
metadata.value: http://hdl.handle.net/11701/21174
metadata.lang: -
metadata.name: dc.description.abstract
metadata.value: Graphematical analysis marks the first stage of text processing. However, prior to it, basic text structuring takes place, resulting in the identification of paragraphs and their
  types, e.g. title, subtitle, author name(s), chapter and section titles, footnotes, endnotes,
  figures, appendices, epigraphs, etc. After that, graphematical analysis proper begins. Its
  aim is to decompose the flow of letter and non-letter graphemes into character strings
  such as individual words, abbreviations, numbers, and hybrid strings (e.g. mathematical
  formulae). The procedure implies an iterative process of unit assembling, from individual
  characters to what is called atoms, next to tokens (roughly equivalent to word occurrences), sentence parts and finally, a whole sentence. At every stage, each unit is assigned
  its type. Assembling relies on the rules based solely on a thorough structural analysis of
  context. No formal models or statistical methods are applied, this being a central principle of the linguistic analyzer, inherent in all its algorithms. At this stage, complications
  arise primarily through the ambiguity of punctuation marks. They are discussed at length
  throughout the chapter.
metadata.lang: en_GB
metadata.name: dc.language.iso
metadata.value: ru
metadata.lang: en_GB
metadata.name: dc.publisher
metadata.value: St Petersburg State University
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: grapheme
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: letter grapheme
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: non-letter grapheme
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: character string
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: punctuation mark
metadata.lang: en_GB
metadata.name: dc.title
metadata.value: Chapter 1. Graphematical analysis
metadata.lang: en_GB
metadata.name: dc.type
metadata.value: Book chapter
metadata.lang: en_GB
resources.filename: 16-26.pdf
resources.url: https://dspace.spbu.ru/bitstream/11701/21174/1/16-26.pdf
resources.format: Adobe PDF
resources.size: 626,03 kB