Logo: to the web site of Uppsala University

uu.sePublications from Uppsala University
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Global Parameter Optimization for Multimodal Biomedical Image Registration
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction.ORCID iD: 0000-0003-0253-9037
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction.ORCID iD: 0000-0002-0544-8272
(English)Manuscript (preprint) (Other academic)
Abstract [en]

Multimodal image registration and fusion is a highly relevant problem in a variety of application domains, from biomedical imaging and remote sensing to computer vision. However, combining images originating from different sources (e.g. microscopes or scanners) is challenging as they are in different coordinate systems, and their content may vary greatly. To align underlying structures in multiple modalities and fuse their complementary information, image registration is required. Methods for registration generally rely on a similarity or distance function between images and an optimization algorithm to find the geometric transformation between two images -- translation and rotation for rigid registration. Global optimization can be applied to multimodal image registration such that the best transformation is guaranteed to be discovered given a large enough computational budget, eliminating failure cases of local optimization algorithms converging to a local optimum. Recently, several methods for global multimodal image registration were developed, however relying on a grid or random search to find the best orientation. We propose a framework using Bayesian optimization to find the optimal orientation between images, which combines the favorable properties of global optimization with the sophisticated parameter search of Bayesian optimization to accelerate the convergence rate. This manuscript presents preliminary results on the faster convergence rate of the Bayesian optimizer in comparison to random search on a small set of multimodal image pairs of brains acquired by positron emission tomography and magnetic resonance imaging.

National Category
Computer Systems Medical Imaging
Research subject
Bioinformatics
Identifiers
URN: urn:nbn:se:uu:diva-497142OAI: oai:DiVA.org:uu-497142DiVA, id: diva2:1739161
Available from: 2023-02-23 Created: 2023-02-23 Last updated: 2025-02-09
In thesis
1. Learning-based prediction, representation, and multimodal registration for bioimage processing
Open this publication in new window or tab >>Learning-based prediction, representation, and multimodal registration for bioimage processing
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Microscopy and imaging are essential to understanding and exploring biology. Modern staining and imaging techniques generate large amounts of data resulting in the need for automated analysis approaches. Many earlier approaches relied on handcrafted feature extractors, while today's deep-learning-based methods open up new ways to analyze data automatically.

Deep learning has become popular in bioimage processing as it can extract high-level features describing image content (Paper III). The work in this thesis explores various aspects and limitations of machine learning and deep learning with applications in biology. Learning-based methods have generalization issues on out-of-distribution data points, and methods such as uncertainty estimation (Paper II) and visual quality control (Paper V) can provide ways to mitigate those issues. Furthermore, deep learning methods often require large amounts of data during training. Here the focus is on optimizing deep learning methods to meet current computational capabilities and handle the increasing volume and size of data (Paper I). Model uncertainty and data augmentation techniques are also explored (Papers II and III).

This thesis is split into chapters describing the main components of cell biology, microscopy imaging, and the mathematical and machine-learning theories to give readers an introduction to biomedical image processing. The main contributions of this thesis are deep-learning methods for reconstructing patch-based segmentation (Paper I) and pixel regression of traction force images (Paper II), followed by methods for aligning images from different sensors in a common coordinate system (named multimodal image registration) using representation learning (Paper III) and Bayesian optimization (Paper IV). Finally, the thesis introduces TissUUmaps 3, a tool for visualizing multiplexed spatial transcriptomics data (Paper V). These contributions provide methods and tools detailing how to apply mathematical frameworks and machine-learning theory to biology, giving us concrete tools to improve our understanding of complex biological processes.

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2023. p. 79
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology, ISSN 1651-6214 ; 2244
Keywords
Deep learning, Multimodal image registration, bayesian optimization, Bioimage processing
National Category
Bioinformatics (Computational Biology)
Research subject
Computerized Image Processing
Identifiers
urn:nbn:se:uu:diva-497143 (URN)978-91-513-1725-0 (ISBN)
Public defence
2023-04-14, Sonja Lyttkens 101121, Ångströmlaboratoriet, Lägerhyddsvägen 1, Uppsala, 09:15 (English)
Opponent
Supervisors
Available from: 2023-03-22 Created: 2023-02-23 Last updated: 2023-03-22

Open Access in DiVA

No full text in DiVA

Authority records

Pielawski, NicolasÖfverstedt, JohanWetzer, Elisabeth

Search in DiVA

By author/editor
Pielawski, NicolasÖfverstedt, JohanWetzer, Elisabeth
By organisation
Computerized Image Analysis and Human-Computer Interaction
Computer SystemsMedical Imaging

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 522 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf