uu.seUppsala University Publications

CiteExport$(function(){PrimeFaces.cw("TieredMenu","widget_formSmash_upper_j_idt144",{id:"formSmash:upper:j_idt144",widgetVar:"widget_formSmash_upper_j_idt144",autoDisplay:true,overlay:true,my:"left top",at:"left bottom",trigger:"formSmash:upper:exportLink",triggerEvent:"click"});}); $(function(){PrimeFaces.cw("OverlayPanel","widget_formSmash_upper_j_idt145_j_idt147",{id:"formSmash:upper:j_idt145:j_idt147",widgetVar:"widget_formSmash_upper_j_idt145_j_idt147",target:"formSmash:upper:j_idt145:permLink",showEffect:"blind",hideEffect:"fade",my:"right top",at:"right bottom",showCloseIcon:true});});

Machine learning with state-space models, Gaussian processes and Monte Carlo methodsPrimeFaces.cw("AccordionPanel","widget_formSmash_some",{id:"formSmash:some",widgetVar:"widget_formSmash_some",multiple:true}); PrimeFaces.cw("AccordionPanel","widget_formSmash_all",{id:"formSmash:all",widgetVar:"widget_formSmash_all",multiple:true});
function selectAll()
{
var panelSome = $(PrimeFaces.escapeClientId("formSmash:some"));
var panelAll = $(PrimeFaces.escapeClientId("formSmash:all"));
panelAll.toggle();
toggleList(panelSome.get(0).childNodes, panelAll);
toggleList(panelAll.get(0).childNodes, panelAll);
}
/*Toggling the list of authorPanel nodes according to the toggling of the closeable second panel */
function toggleList(childList, panel)
{
var panelWasOpen = (panel.get(0).style.display == 'none');
// console.log('panel was open ' + panelWasOpen);
for (var c = 0; c < childList.length; c++) {
if (childList[c].classList.contains('authorPanel')) {
clickNode(panelWasOpen, childList[c]);
}
}
}
/*nodes have styleClass ui-corner-top if they are expanded and ui-corner-all if they are collapsed */
function clickNode(collapse, child)
{
if (collapse && child.classList.contains('ui-corner-top')) {
// console.log('collapse');
child.click();
}
if (!collapse && child.classList.contains('ui-corner-all')) {
// console.log('expand');
child.click();
}
}
2018 (English)Doctoral thesis, comprehensive summary (Other academic)
##### Abstract [en]

##### Place, publisher, year, edition, pages

Uppsala: Acta Universitatis Upsaliensis, 2018. , p. 74
##### Series

Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology, ISSN 1651-6214 ; 1709
##### Keywords [en]

Machine learning, State-space models, Gaussian processes
##### National Category

Signal Processing Probability Theory and Statistics
##### Research subject

Electrical Engineering with specialization in Automatic Control
##### Identifiers

URN: urn:nbn:se:uu:diva-357611ISBN: 978-91-513-0417-5 (print)OAI: oai:DiVA.org:uu-357611DiVA, id: diva2:1240418
##### Public defence

2018-10-12, ITC 2446, Lägerhyddsvägen 2, Uppsala, 10:15 (English)
##### Opponent

PrimeFaces.cw("AccordionPanel","widget_formSmash_j_idt434",{id:"formSmash:j_idt434",widgetVar:"widget_formSmash_j_idt434",multiple:true});
##### Supervisors

PrimeFaces.cw("AccordionPanel","widget_formSmash_j_idt440",{id:"formSmash:j_idt440",widgetVar:"widget_formSmash_j_idt440",multiple:true});
#####

PrimeFaces.cw("AccordionPanel","widget_formSmash_j_idt446",{id:"formSmash:j_idt446",widgetVar:"widget_formSmash_j_idt446",multiple:true}); Available from: 2018-09-18 Created: 2018-08-21 Last updated: 2018-10-02
##### List of papers

Numbers are present everywhere, and when they are collected and recorded we refer to them as data. Machine learning is the science of learning mathematical models from data. Such models, once learned from data, can be used to draw conclusions, understand behavior, predict future evolution, and make decisions. This thesis is mainly concerned with two particular statistical models for this purpose: the state-space model and the Gaussian process model, as well as a combination thereof. To learn these models from data, Monte Carlo methods are used, and in particular sequential Monte Carlo (SMC) or particle filters.

The thesis starts with an introductory background on state-space models, Gaussian processes and Monte Carlo methods. The main contribution lies in seven scientific papers. Several contributions are made on the topic of learning nonlinear state-space models with the use of SMC. An existing SMC method is tailored for learning in state-space models with little or no measurement noise. The SMC-based method particle Gibbs with ancestor sampling (PGAS) is used for learning an approximation of the Gaussian process state-space model. PGAS is also combined with stochastic approximation expectation maximization (EM). This method, which we refer to as particle stochastic approximation EM, is a general method for learning parameters in nonlinear state-space models. It is later applied to the particular problem of maximum likelihood estimation in jump Markov linear models. An alternative and non-standard approach for how to use SMC to estimate parameters in nonlinear state-space models is also presented.

There are also two contributions not related to learning state-space models. One is how SMC can be used also for learning hyperparameters in Gaussian process regression models. The second is a method for assessing consistency between model and data. By using the model to simulate new data, and compare how similar that data is to the observed one, a general criterion is obtained which follows directly from the model specification. All methods are implemented and illustrated, and several are also applied to various real-world examples.

1. A flexible state–space model for learning nonlinear dynamical systems$(function(){PrimeFaces.cw("OverlayPanel","overlay1060732",{id:"formSmash:j_idt495:0:j_idt499",widgetVar:"overlay1060732",target:"formSmash:j_idt495:0:partsLink",showEvent:"mousedown",hideEvent:"mousedown",showEffect:"blind",hideEffect:"fade",appendToBody:true});});

2. Data Consistency Approach to Model Validation$(function(){PrimeFaces.cw("OverlayPanel","overlay1239823",{id:"formSmash:j_idt495:1:j_idt499",widgetVar:"overlay1239823",target:"formSmash:j_idt495:1:partsLink",showEvent:"mousedown",hideEvent:"mousedown",showEffect:"blind",hideEffect:"fade",appendToBody:true});});

3. Learning dynamical systems with particle stochastic approximation EM$(function(){PrimeFaces.cw("OverlayPanel","overlay1239526",{id:"formSmash:j_idt495:2:j_idt499",widgetVar:"overlay1239526",target:"formSmash:j_idt495:2:partsLink",showEvent:"mousedown",hideEvent:"mousedown",showEffect:"blind",hideEffect:"fade",appendToBody:true});});

4. Identification of jump Markov linear models using particle filters$(function(){PrimeFaces.cw("OverlayPanel","overlay756540",{id:"formSmash:j_idt495:3:j_idt499",widgetVar:"overlay756540",target:"formSmash:j_idt495:3:partsLink",showEvent:"mousedown",hideEvent:"mousedown",showEffect:"blind",hideEffect:"fade",appendToBody:true});});

5. Learning of state-space models with highly informative observations: A tempered sequential Monte Carlo solution$(function(){PrimeFaces.cw("OverlayPanel","overlay1206003",{id:"formSmash:j_idt495:4:j_idt499",widgetVar:"overlay1206003",target:"formSmash:j_idt495:4:partsLink",showEvent:"mousedown",hideEvent:"mousedown",showEffect:"blind",hideEffect:"fade",appendToBody:true});});

6. Learning nonlinear state-space models using smooth particle-filter-based likelihood approximations$(function(){PrimeFaces.cw("OverlayPanel","overlay1239520",{id:"formSmash:j_idt495:5:j_idt499",widgetVar:"overlay1239520",target:"formSmash:j_idt495:5:partsLink",showEvent:"mousedown",hideEvent:"mousedown",showEffect:"blind",hideEffect:"fade",appendToBody:true});});

7. Marginalizing Gaussian process hyperparameters using sequential Monte Carlo$(function(){PrimeFaces.cw("OverlayPanel","overlay866347",{id:"formSmash:j_idt495:6:j_idt499",widgetVar:"overlay866347",target:"formSmash:j_idt495:6:partsLink",showEvent:"mousedown",hideEvent:"mousedown",showEffect:"blind",hideEffect:"fade",appendToBody:true});});

isbn
urn-nbn$(function(){PrimeFaces.cw("Tooltip","widget_formSmash_j_idt1156",{id:"formSmash:j_idt1156",widgetVar:"widget_formSmash_j_idt1156",showEffect:"fade",hideEffect:"fade",showDelay:500,hideDelay:300,target:"formSmash:altmetricDiv"});});

CiteExport$(function(){PrimeFaces.cw("TieredMenu","widget_formSmash_lower_j_idt1209",{id:"formSmash:lower:j_idt1209",widgetVar:"widget_formSmash_lower_j_idt1209",autoDisplay:true,overlay:true,my:"left top",at:"left bottom",trigger:"formSmash:lower:exportLink",triggerEvent:"click"});}); $(function(){PrimeFaces.cw("OverlayPanel","widget_formSmash_lower_j_idt1210_j_idt1212",{id:"formSmash:lower:j_idt1210:j_idt1212",widgetVar:"widget_formSmash_lower_j_idt1210_j_idt1212",target:"formSmash:lower:j_idt1210:permLink",showEffect:"blind",hideEffect:"fade",my:"right top",at:"right bottom",showCloseIcon:true});});