Logo: to the web site of Uppsala University

uu.sePublications from Uppsala University
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Contrastive Learning of Equivariant Image Representations for Multimodal Deformable Registration
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division Vi3. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction. (MIDA)ORCID iD: 0009-0003-8075-1313
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division Vi3.ORCID iD: 0000-0003-0253-9037
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division Vi3.ORCID iD: 0000-0001-7312-8222
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division Vi3.ORCID iD: 0000-0002-6041-6310
2023 (English)In: 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI), Institute of Electrical and Electronics Engineers (IEEE), 2023Conference paper, Published paper (Refereed)
Abstract [en]

We propose a method for multimodal deformable image registration which combines a powerful deep learning approach to generate CoMIRs, dense image-like representations of multimodal image pairs, with INSPIRE, a robust framework for monomodal deformable image registration. We introduce new equivariance constraints to improve the consistency of CoMIRs under deformation. We evaluate the method on three publicly available multimodal datasets, one remote sensing, one histological, and one cytological. The proposed method demonstrates general applicability and consistently outperforms state-of-the-art registration tools \elastixname and VoxelMorph. We share source code of the proposed method and complete experimental setup as open-source at: https://github.com/MIDA-group/CoMIR_INSPIRE.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2023.
Series
International Symposium on Biomedical Imaging, ISSN 1945-7928, E-ISSN 1945-8452
Keywords [en]
image alignment, correlative imaging, representation learning, equivariance
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:uu:diva-510266DOI: 10.1109/ISBI53787.2023.10230465ISI: 001062050500143ISBN: 978-1-6654-7358-3 (electronic)ISBN: 978-1-6654-7359-0 (print)OAI: oai:DiVA.org:uu-510266DiVA, id: diva2:1791743
Conference
IEEE 20th International Symposium on Biomedical Imaging, Cartagena, Colombia, 18-21 April, 2023
Funder
Vinnova, 2017-02447Vinnova, 2020-03611Vinnova, 2021-01420Swedish Research Council, 2017-04385Swedish National Infrastructure for Computing (SNIC)Swedish Research Council, 2018-05973Available from: 2023-08-25 Created: 2023-08-25 Last updated: 2023-11-14Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records

Nordling, LoveÖfverstedt, JohanLindblad, JoakimSladoje, Nataša

Search in DiVA

By author/editor
Nordling, LoveÖfverstedt, JohanLindblad, JoakimSladoje, Nataša
By organisation
Division Vi3Computerized Image Analysis and Human-Computer Interaction
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 189 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf