Logo: to the web site of Uppsala University

uu.sePublications from Uppsala University
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Robust and integrative Bayesian neural networks for likelihood-free parameter inference
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Scientific Computing. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computational Science.ORCID iD: 0000-0002-9417-6618
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Scientific Computing. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computational Science.
University of California, Santa Barbara.
University of California, Santa Barbara.
Show others and affiliations
2022 (English)In: 2022 International Joint Conference on Neural Networks (IJCNN), Institute of Electrical and Electronics Engineers (IEEE), 2022, p. 1-10Conference paper, Published paper (Refereed)
Abstract [en]

State-of-the-art neural network-based methods for learning summary statistics have delivered promising results for simulation-based likelihood-free parameter inference. Existing approaches for learning summarizing networks are mainly based on deterministic neural networks, and do not take network prediction uncertainty into account. This work proposes a robust integrated approach that learns summary statistics using Bayesian neural networks, and produces a proposal posterior density using categorical distributions. An adaptive sampling scheme selects simulation locations to efficiently and iteratively refine the predictive proposal posterior of the network conditioned on observations. This allows for more efficient and robust convergence on comparatively large prior spaces. The approximated proposal posterior can then either be processed through a correction mechanism, or be used in conjunction with a density estimator to arrive at the true posterior. We demonstrate our approach on benchmark examples.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2022. p. 1-10
Series
IEEE International Joint Conference on Neural Networks (IJCNN), ISSN 2161-4393, E-ISSN 2161-4407
Keywords [en]
Approximate Bayesian inference, Bayesian neural network, Summary statistics, Adaptive sampling, Classification
National Category
Computational Mathematics
Research subject
Scientific Computing
Identifiers
URN: urn:nbn:se:uu:diva-439780DOI: 10.1109/IJCNN55064.2022.9892800ISI: 000867070907037ISBN: 978-1-6654-9526-4 (print)ISBN: 978-1-7281-8671-9 (electronic)OAI: oai:DiVA.org:uu-439780DiVA, id: diva2:1543276
Conference
2022 International Joint Conference on Neural Networks (IJCNN), 18-23 July 2022, Padua, ITALY
Projects
eSSENCE
Funder
eSSENCE - An eScience CollaborationScience for Life Laboratory, SciLifeLabAvailable from: 2021-04-10 Created: 2021-04-10 Last updated: 2023-01-12Bibliographically approved
In thesis
1. Large-scale simulation-based experiments with stochastic models using machine learning-assisted approaches: Applications in systems biology using Markov jump processes
Open this publication in new window or tab >>Large-scale simulation-based experiments with stochastic models using machine learning-assisted approaches: Applications in systems biology using Markov jump processes
2021 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Discrete and stochastic models in systems biology, such as biochemical reaction networks, can be modeled as Markov jump processes. The chemical master equation describes how the probability distribution of a biochemical system's states evolves. Unfortunately, solutions to the chemical master equation only exist for trivial problems. However, the stochastic simulation algorithm (SSA) can generate exact sample paths. Large-scale simulation-based experiments involving variations to the model's parameters are computationally intensive and hinder modelers from exploring and inferring their models due to high-dimensional models.

This thesis proposes methodologies and tools for model exploration and approximate parameter inference of high-dimensional stochastic models simulated via the SSA.  We propose a smart computational workflow using machine learning-assisted approaches to enable model exploration of gene regulatory networks where the objective is to assess different qualitative behaviors present in the model. 

An artificial neural network is proposed for learning summary statistics used in approximate parameter inference.  The neural network can find distinct local features from multivariate time series, enabling more complex models involving several biological species. By introducing epistemic uncertainty, we further explore Bayesian neural networks for approximate parameter inference. A classification approach is introduced, which learns the proposal posterior by an adaptive sampling scheme, ultimately reducing the number of simulations required for the inference task. 

We have also developed the software package Sciope to support modelers with machine learning-assisted techniques for model exploration and parameter inference. Sciope also comes with various features, such as experimental designs, traditional ABC algorithms, and a parallel backend to scale large simulation-based experiments from laptops to the cloud.

Finally, to reduce the gap between modelers and biologists, StochSS Live! has been developed. StochSS Live! is a user-friendly web-based platform that enables any practitioners to build biochemical reaction models and perform simulation by ensemble analysis, model exploration, and approximate parameter inference. 

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2021. p. 68
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology, ISSN 1651-6214 ; 2035
Keywords
bioinformatics, systems biology, stochastic simulation, model exploration, approximate parameter inference, machine learning, distributed computing
National Category
Bioinformatics (Computational Biology) Computational Mathematics
Research subject
Scientific Computing
Identifiers
urn:nbn:se:uu:diva-439782 (URN)978-91-513-1194-4 (ISBN)
Public defence
2021-06-04, 2446 ITC, Lägerhyddsvägen 2, Uppsala, 10:15 (English)
Opponent
Supervisors
Projects
eSSENCE
Funder
NIH (National Institute of Health)Göran Gustafsson Foundation for promotion of scientific research at Uppala University and Royal Institute of Technology
Available from: 2021-05-11 Created: 2021-04-12 Last updated: 2022-10-31

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records

Wrede, FredrikEriksson, RobinEngblom, StefanHellander, AndreasSingh, Prashant

Search in DiVA

By author/editor
Wrede, FredrikEriksson, RobinEngblom, StefanHellander, AndreasSingh, Prashant
By organisation
Division of Scientific ComputingComputational ScienceScience for Life Laboratory, SciLifeLab
Computational Mathematics

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 219 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf