title: About an algorithm for consistent weights initialization of deep Neural Networks and Neural Networks ensemble learning
metadata.name: dc.contributor.author
metadata.value: Drokin, Ivan S.
metadata.lang: -
metadata.name: dc.date.accessioned
metadata.value: 2017-02-09T09:21:56Z
metadata.lang: -
metadata.name: dc.date.available
metadata.value: 2017-02-09T09:21:56Z
metadata.lang: -
metadata.name: dc.date.issued
metadata.value: 2016-12
metadata.lang: -
metadata.name: dc.identifier.citation
metadata.value: Drokin I. S. About an algorithm for consistent weights initialization of deep Neural Networks and Neural Networks ensemble learning. Vestnik of Saint Petersburg University. Series 10. Applied mathematics. Computer science. Control processes, 2016, issue 4, pp. 66–74.
metadata.lang: en_GB
metadata.name: dc.identifier.other
metadata.value: 10.21638/11701/spbu10.2016.406
metadata.lang: -
metadata.name: dc.identifier.uri
metadata.value: http://hdl.handle.net/11701/5997
metadata.lang: -
metadata.name: dc.description.abstract
metadata.value: Using of the pretraining of multilayer perceptrons mechanism has greatly improved the quality
  and speed of training deep networks. In this paper we propose another way of the weights
  initialization using the principles of supervised learning, self-taught learning approach and
  transfer learning, tests showing performance approach have been carried out and further steps
  and directions for the development of the method presented have been suggested. In this
  paper we propose an iterative algorithm of weights initialization based on the rectification
  of the hidden layers of weights of the neural network through the resolution of the original
  problem of classification or regression, as well as the method for constructing a neural
  network ensemble that naturally results from the proposed learning algorithm, tests showing
  performance approach have been carried out. Refs 14. Figs 5. Tables 2.
metadata.lang: en_GB
metadata.name: dc.language.iso
metadata.value: ru
metadata.lang: en_GB
metadata.name: dc.publisher
metadata.value: St Petersburg State University
metadata.lang: en_GB
metadata.name: dc.relation.ispartofseries
metadata.value: Vestnik of Saint Petersburg University. Series 10. Applied Mathematics. Computer Science. Control Processes;Issue 4
metadata.lang: -
metadata.name: dc.subject
metadata.value: deep learning
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: neural networks weights initialization
metadata.lang: en_GB
metadata.name: dc.subject
metadata.value: ensemble of neural networks
metadata.lang: en_GB
metadata.name: dc.title
metadata.value: About an algorithm for consistent weights initialization of deep Neural Networks and Neural Networks ensemble learning
metadata.lang: en_GB
metadata.name: dc.type
metadata.value: Article
metadata.lang: en_GB
resources.filename: 06-Drokin.pdf
resources.url: https://dspace.spbu.ru/bitstream/11701/5997/1/06-Drokin.pdf
resources.format: Adobe PDF
resources.size: 928,49 kB