Logo: to the web site of Uppsala University

uu.sePublications from Uppsala University
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Transcriptome-Supervised Classification of Tissue Morphology Using Deep Learning
Uppsala University, Science for Life Laboratory, SciLifeLab. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Visual Information and Interaction. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction.
Uppsala University, Science for Life Laboratory, SciLifeLab. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Visual Information and Interaction. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction.ORCID iD: 0000-0002-4482-3119
Uppsala University, Science for Life Laboratory, SciLifeLab. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Visual Information and Interaction. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction.ORCID iD: 0000-0001-8658-6417
Uppsala University, Science for Life Laboratory, SciLifeLab. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Visual Information and Interaction. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction.ORCID iD: 0000-0002-4139-7003
2020 (English)In: IEEE 17th International Symposium on Biomedical Imaging (ISBI), 2020, p. 1630-1633Conference paper, Published paper (Refereed)
Abstract [en]

Deep learning has proven to successfully learn variations in tissue and cell morphology. Training of such models typically relies on expensive manual annotations. Here we conjecture that spatially resolved gene expression, e.i., the transcriptome, can be used as an alternative to manual annotations. In particular, we trained five convolutional neural networks with patches of different size extracted from locations defined by spatially resolved gene expression. The network is trained to classify tissue morphology related to two different genes, general tissue, as well as background, on an image of fluorescence stained nuclei in a mouse brain coronal section. Performance is evaluated on an independent tissue section from a different mouse brain, reaching an average Dice score of 0.51. Results may indicate that novel techniques for spatially resolved transcriptomics together with deep learning may provide a unique and unbiased way to find genotype phenotype relationships

Place, publisher, year, edition, pages
2020. p. 1630-1633
Series
IEEE International Symposium on Biomedical Imaging (ISBI), ISSN 1945-7928, E-ISSN 1945-8452
Keywords [en]
In situ sequencing, Gene expression, Tissue classification, Deep learning
National Category
Bioinformatics and Computational Biology
Research subject
Bioinformatics
Identifiers
URN: urn:nbn:se:uu:diva-420376DOI: 10.1109/ISBI45749.2020.9098361ISI: 000578080300341ISBN: 978-1-5386-9330-8 (electronic)ISBN: 978-1-5386-9331-5 (print)OAI: oai:DiVA.org:uu-420376DiVA, id: diva2:1470478
Conference
2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), Iowa City, 3-7 april
Projects
TissUUmaps
Funder
EU, European Research Council, 682810Available from: 2020-09-24 Created: 2020-09-24 Last updated: 2025-02-07Bibliographically approved
In thesis
1. Computational Methods for Image-Based Spatial Transcriptomics
Open this publication in new window or tab >>Computational Methods for Image-Based Spatial Transcriptomics
2024 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Why does cancer develop, spread, grow, and lead to mortality? To answer these questions, one must study the fundamental building blocks of all living organisms — cells. Like a well-calibrated manufacturing unit, cells follow precise instructions by gene expression to initiate the synthesis of proteins, the workforces that drive all living biochemical processes.

Recently, researchers have developed techniques for imaging the expression of hundreds of unique genes within tissue samples. This information is extremely valuable for understanding the cellular activities behind cancer-related diseases.  These methods, collectively known as image-based spatial transcriptomics (IST) techniques,  use fluorescence microscopy to combinatorically label mRNA species (corresponding to expressed genes) in tissue samples. 

Here, automatic image analysis is required to locate fluorescence signals and decode the combinatorial code. This process results in large quantities of points, marking the location of expressed genes. These new data formats pose several challenges regarding visualization and automated analysis.

This thesis presents several computational methods and applications related to data generated from IST methods. 

Key contributions include: (i) A decoding method that jointly optimizes the detection and decoding of signals, particularly beneficial in scenarios with low signal-to-noise ratios or densely packed signals;  (ii) a computational method for automatically delineating regions with similar gene compositions — efficient, interactive, and scalable for exploring patterns across different scales;  (iii) a software enabling interactive visualization of millions of gene markers atop Terapixel-sized images (TissUUmaps);  (iv) a tool utilizing signed-graph partitioning for the automatic identification of cells, independent of the complementary nuclear stain;  (v) A fast and analytical expression for a score that quantifies co-localization between spatial points (such as located genes);  (vi) a demonstration that gene expression markers can train deep-learning models to classify tissue morphology.

In the final contribution (vii), an IST technique features in a clinical study to spatially map the molecular diversity within tumors from patients with colorectal liver metastases, specifically those exhibiting a desmoplastic growth pattern. The study unveils novel molecular patterns characterizing cellular diversity in the transitional region between healthy liver tissue and the tumor. While a direct answer to the initial questions remains elusive, this study sheds illuminating insights into the growth dynamics of colorectal cancer liver metastases, bringing us closer to understanding the journey from development to mortality in cancer.

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2024. p. 62
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology, ISSN 1651-6214 ; 2371
Keywords
Spatial omics, Spatial transcriptomics, Spatial biology, In Situ Sequencing, Visualization, Spatial statistics, Fluorescence microscopy
National Category
Computer Sciences
Research subject
Computerized Image Processing
Identifiers
urn:nbn:se:uu:diva-524009 (URN)978-91-513-2052-6 (ISBN)
Public defence
2024-04-16, Polhemsalen, Ångströmlaboratoriet, Lägerhyddsvägen 1, Uppsala, 09:15 (English)
Opponent
Supervisors
Projects
TissUUmaps
Available from: 2024-03-25 Created: 2024-02-28 Last updated: 2024-03-25

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records

Andersson, AxelPartel, GabrieleSolorzano, LeslieWählby, Carolina

Search in DiVA

By author/editor
Andersson, AxelPartel, GabrieleSolorzano, LeslieWählby, Carolina
By organisation
Science for Life Laboratory, SciLifeLabDivision of Visual Information and InteractionComputerized Image Analysis and Human-Computer Interaction
Bioinformatics and Computational Biology

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 364 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf