Open this publication in new window or tab >>Imperial Coll London, Natl Heart & Lung Inst, London, England..
Imperial Coll London, Natl Heart & Lung Inst, London, England..
Imperial Coll London, Natl Heart & Lung Inst, London, England..
Imperial Coll London, Natl Heart & Lung Inst, London, England.;Chelsea & Westminster Hosp NHS Fdn Trust, Dept Cardiol, London, England..
Imperial Coll London, Natl Heart & Lung Inst, London, England..
Imperial Coll London, Natl Heart & Lung Inst, London, England.;Fudan Univ, Shanghai Inst Cardiovasc Dis, Natl Clin Res Ctr Intervent Med, Dept Cardiol,Zhongshan Hosp, Shanghai, Peoples R China..
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Systems and Control. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Automatic control.
Vanderbilt Univ, Med Ctr, Vanderbilt Inst Clin & Translat Res, Nashville, TN USA.;Vanderbilt Univ, Med Ctr, Ctr Digital Genom Med, Dept Med, Nashville, TN USA.;Vanderbilt Univ, Med Ctr, Div Cardiovasc Med, Nashville, TN USA..
Univ Fed Minas Gerais, Fac Med, Dept Internal Med, Belo Horizonte, Brazil.;Univ Fed Minas Gerais, Hosp Clin, Telehlth Ctr, Belo Horizonte, Brazil.;Univ Fed Minas Gerais, Hosp Clin, Cardiol Serv, Belo Horizonte, Brazil..
Fudan Univ, Shanghai Inst Cardiovasc Dis, Natl Clin Res Ctr Intervent Med, Dept Cardiol,Zhongshan Hosp, Shanghai, Peoples R China..
Harvard Med Sch, Richard A & Susan F Smith Ctr Outcomes Res Cardiol, Beth Israel Deaconess Med Ctr, Boston, MA USA..
Harvard Med Sch, Harvard Thorndike Electrophysiol Inst, Beth Israel Deaconess Med Ctr, Boston, MA USA..
Vanderbilt Univ, Med Ctr, Vanderbilt Inst Clin & Translat Res, Nashville, TN USA.;Vanderbilt Univ, Med Ctr, Ctr Digital Genom Med, Dept Med, Nashville, TN USA..
Imperial Coll London, Natl Heart & Lung Inst, London, England..
Imperial Coll London, Natl Heart & Lung Inst, London, England.;Imperial Coll Healthcare NHS Trust, Dept Cardiol, London, England..
Imperial Coll London, Natl Heart & Lung Inst, London, England.;Imperial Coll Healthcare NHS Trust, Dept Cardiol, London, England..
Show others...
2026 (English)In: PLOS Digital Health, E-ISSN 2767-3170, Vol. 5, no 9, article id e0001623Article in journal (Refereed) Published
Abstract [en]
Contrastive learning is a widely adopted self-supervised pretraining strategy, yet its dependence on cohort composition remains underexplored. We present Contrasting by Augmented Patient Electrocardiograms (CAPE) foundation model and pretrain on four cohorts (n = 5,203,269), from diverse populations across three continents (North America, South America, Asia). We systematically assess how cohort demographics, health status, and population diversity influence the downstream performance for prediction tasks also including two additional cohorts from another continent (Europe). We find that downstream performance depends on the distributional properties of the pretraining cohort, including demographics and health status. Moreover, while pretraining with a multi-centre, demographically diverse cohort improves in-distribution accuracy, it reduces out-of-distribution (OOD) generalisation of our contrastive approach by encoding cohort-specific artifacts. To address this, we propose the In-Distribution Batch (IDB) strategy, which preserves intra-cohort consistency during pretraining, discourages learning of spurious cohort-specific features, and instead promotes clinically meaningful variability within cohorts. This leads to improved out-of-distribution robustness, with gains of 9-40% in downstream label prediction performance. This work provides insights into pretraining strategies for more clinically deployable and generalisable foundation models.
Place, publisher, year, edition, pages
Public Library of Science (PLoS), 2026
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:uu:diva-598854 (URN)10.1371/journal.pdig.0001623 (DOI)001867414300002 ()42685022 (PubMedID)2-s2.0-105050156687 (Scopus ID)
2026-09-212026-09-212026-09-21Bibliographically approved