uu.seUppsala University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Probabilistic Feature Learning Using Gaussian Process Auto-Encoders
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Systems and Control.
2016 (English)Independent thesis Advanced level (professional degree), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

The focus of this report is the problem of probabilistic dimensionality reduction and feature learning from high-dimensional data (images). Extracting features and being able to learn from high-dimensional sensory data is an important ability in a general-purpose intelligent system. Dimensionality reduction and feature learning have in the past primarily been done using (convolutional) neural networks or linear mappings, e.g. in principal component analysis. However, these methods do not yield any error bars in the features or predictions. In this report, theory and a model for how dimensionality reduction and feature learning can be done using Gaussian process auto-encoders (GP-AEs) are presented. By using GP-AEs, the variance in the feature space is computed, thus, yielding a measure of the uncertainty in the constructed model. This measure is useful in order to avoid making over-confident system predictions. Results show that GP-AEs are capable of dimensionality reduction and feature learning, but that they suffer from scalability issues and problems with weak gradient signal propagation. Results in reconstruction quality are not as good as those achieved by state-of-the-art methods, and it takes very long to train the model. The model has potential though, since it can scale to large inputs.

Place, publisher, year, edition, pages
2016.
Series
UPTEC F, ISSN 1401-5757 ; 16027
National Category
Computer Systems
Identifiers
URN: urn:nbn:se:uu:diva-297752OAI: oai:DiVA.org:uu-297752DiVA: diva2:943480
External cooperation
Imperial College London
Educational program
Master Programme in Engineering Physics
Presentation
2016-06-20, Uppsala, 00:44 (English)
Supervisors
Examiners
Available from: 2016-06-29 Created: 2016-06-28 Last updated: 2016-06-29Bibliographically approved

Open Access in DiVA

fulltext(4317 kB)253 downloads
File information
File name FULLTEXT01.pdfFile size 4317 kBChecksum SHA-512
b99e0ba9c9faff65b6a2ffd11d2630f8c921ca2a7a31f3b0c13ea3d08c3802808b4f3df3c56a62ae12fb40b4a42a6c7dff164beb6ea4023364d82c33ae376a61
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Olofsson, Simon
By organisation
Division of Systems and Control
Computer Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 253 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 1102 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf