Logo: to the web site of Uppsala University

uu.sePublications from Uppsala University
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
INSPIRE: Intensity and Spatial Information-Based Deformable Image Registration
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division Vi3.ORCID iD: 0000-0003-0253-9037
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division Vi3.ORCID iD: 0000-0001-7312-8222
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division Vi3.ORCID iD: 0000-0002-6041-6310
2023 (English)In: PLOS ONE, E-ISSN 1932-6203, Vol. 18, no 3, article id e0282432Article in journal (Refereed) Published
Abstract [en]

We present INSPIRE, a top-performing general-purpose method for deformable image registration. INSPIRE brings distance measures which combine intensity and spatial information into an elastic B-splines-based transformation model and incorporates an inverse inconsistency penalization supporting symmetric registration performance. We introduce several theoretical and algorithmic solutions which provide high computational efficiency and thereby applicability of the proposed framework in a wide range of real scenarios. We show that INSPIRE delivers highly accurate, as well as stable and robust registration results. We evaluate the method on a 2D dataset created from retinal images, characterized by presence of networks of thin structures. Here INSPIRE exhibits excellent performance, substantially outperforming the widely used reference methods. We also evaluate INSPIRE on the Fundus Image Registration Dataset (FIRE), which consists of 134 pairs of separately acquired retinal images. INSPIRE exhibits excellent performance on the FIRE dataset, substantially outperforming several domain-specific methods. We also evaluate the method on four benchmark datasets of 3D magnetic resonance images of brains, for a total of 2088 pairwise registrations. A comparison with 17 other state-of-the-art methods reveals that INSPIRE provides the best overall performance. Code is available at github.com/MIDA-group/inspire

Place, publisher, year, edition, pages
Public Library of Science (PLoS), 2023. Vol. 18, no 3, article id e0282432
Keywords [en]
Image registration, splines (mathematics), deformable models, set distance, gradient methods, optimization, cost function, iterative methods, fuzzy sets
National Category
Computer graphics and computer vision Medical Imaging
Research subject
Computerized Image Processing
Identifiers
URN: urn:nbn:se:uu:diva-429025DOI: 10.1371/journal.pone.0282432ISI: 000945993100007PubMedID: 36867617OAI: oai:DiVA.org:uu-429025DiVA, id: diva2:1511350
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)Vinnova, 2017-02447Vinnova, 2020-03611Vinnova, 2021-01420Available from: 2020-12-18 Created: 2020-12-18 Last updated: 2025-02-09Bibliographically approved
In thesis
1. Methods for Reliable Image Registration: Algorithms, Distance Measures, and Representations
Open this publication in new window or tab >>Methods for Reliable Image Registration: Algorithms, Distance Measures, and Representations
2022 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Much biomedical and medical research relies on the collection of ever-larger amounts of image data (both 2D images and 3D volumes, as well as time-series) and increasingly from multiple sources. Image registration, the process of finding correspondences between images based on the affinity of features of interest, is often required as a vital step towards the final analysis, which may consist of a comparison of images, measurement of movement, or fusion of complementary information. The contributions in this work are centered around reliable image registration methods for both 2D and 3D images with the aim of wide applicability: similarity and distance measures between images for image registration, algorithms for efficient computation of these, and other commonly used measures for both local and global optimization frameworks, and representations for multimodal image registration where the appearance and structures present in the images may vary dramatically.

The main contributions are: (i) distance measures for affine symmetric intensity image registration, combining intensity and spatial information based on the notion of alpha-cuts from fuzzy set theory; (ii) the extension of the affine registration method to more flexible deformable transformation models, leading to the framework Intensity and Spatial Information-Based Deformable Image Registration (INSPIRE); (iii) two efficient algorithms for computing the proposed distances and their spatial gradients and thereby enabling local gradient-based optimization; (iv) a contrastive representation learning method, Contrastive Multimodal Image Representation for Registration (CoMIR), utilizing deep learning techniques to obtain common representations that can be registered using methods designed for monomodal scenarios; (v) efficient algorithms for global optimization of mutual information and similarities of normalized gradient fields; (vi) a comparative study exploring the applicability of modern image-to-image translation methods to facilitate multimodal registration; (vii) the Stochastic Distance Transform, using the theory of discrete random sets to offer improved noise-insensitivity to distance computations; (viii) extensive evaluation of the proposed image registration methods on a number of different datasets mainly from (bio)medical imaging, where they exhibit excellent performance, and reliability, suggesting wide utility.

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2022. p. 110
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology, ISSN 1651-6214 ; 2107
Keywords
Image registration, alignment, local optimization, global optimization, mutual information, normalized gradient fields, representation learning
National Category
Computer graphics and computer vision Medical Imaging
Research subject
Computerized Image Processing
Identifiers
urn:nbn:se:uu:diva-463393 (URN)978-91-513-1382-5 (ISBN)
Public defence
2022-02-25, 101195, Ångström, Lägerhyddsvägen 1, Uppsala, 13:00 (English)
Opponent
Supervisors
Available from: 2022-02-03 Created: 2022-01-10 Last updated: 2025-02-09

Open Access in DiVA

fulltext(2146 kB)544 downloads
File information
File name FULLTEXT01.pdfFile size 2146 kBChecksum SHA-512
5f1ffc9c60b9aa7c5a0387bb8fa4997b556c250bc0ef30d2f33aa6d6e44fc72b6ca86331b6c362b52a0c1707ccbb1d0a351002ab626f8bcd244cf320b3a4caf8
Type fulltextMimetype application/pdf

Other links

Publisher's full textPubMedPre-print i arXiv

Authority records

Öfverstedt, JohanLindblad, JoakimSladoje, Nataša

Search in DiVA

By author/editor
Öfverstedt, JohanLindblad, JoakimSladoje, Nataša
By organisation
Computerized Image Analysis and Human-Computer InteractionDivision Vi3
In the same journal
PLOS ONE
Computer graphics and computer visionMedical Imaging

Search outside of DiVA

GoogleGoogle Scholar
Total: 544 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 401 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf