Logo: to the web site of Uppsala University

uu.sePublications from Uppsala University
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Unimodal vs. Multimodal Prediction of Antenatal Depression from Smartphone-based Survey Data in a Longitudinal Study
Uppsala University, WoMHeR (Centre for Women’s Mental Health during the Reproductive Lifespan). Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division Vi3. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction. (Social robotik)ORCID iD: 0000-0002-6740-1111
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Systems and Control. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Automatic control. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computer Systems.ORCID iD: 0000-0002-3017-0874
Uppsala University, WoMHeR (Centre for Women’s Mental Health during the Reproductive Lifespan). Uppsala University, Disciplinary Domain of Medicine and Pharmacy, Faculty of Medicine, Department of Medical Sciences, Psychiatry.ORCID iD: 0000-0002-7349-8765
Uppsala University, Disciplinary Domain of Medicine and Pharmacy, Faculty of Medicine, Department of Medical Sciences, Psychiatry.ORCID iD: 0000-0002-8692-3652
Show others and affiliations
2022 (English)In: ICMI '22: Proceedings of the 2022 International Conference on Multimodal Interaction / [ed] Raj Tumuluri; Nicu Sebe; Gopal Pingali; Dinesh Babu Jayagopi; Abhinav Dhall; Richa Singh; Lisa Anthony; Albert Ali Salah, Association for Computing Machinery (ACM), 2022, p. 455-467Conference paper, Published paper (Refereed)
Abstract [en]

Antenatal depression impacts 7-20% of women globally, and can have serious consequences for both the mother and the infant. Preventative interventions are effective, but are cost-efficient only among those at high risk. As such, being able to predict and identify those at risk is invaluable for reducing the burden of care and adverse consequences, as well as improving treatment outcomes. While several approaches have been proposed in the literature for the automatic prediction of depressive states, there is a scarcity of research on automatic prediction of perinatal depression. Moreover, while there exist some works on the automatic prediction of postpartum depression using data collected in clinical settings and applied the model to a smartphone application, to the best of our knowledge, no previous work has investigated the automatic prediction of late antenatal depression using data collected via a smartphone app in the first and second trimesters of pregnancy. This study utilizes data measuring various aspects of self-reported psychological, physiological and behavioral information, collected from 915 women in the first and second trimesters of pregnancy using a smartphone app designed for perinatal depression. By applying machine learning algorithms on these data, this paper explores the possibility of automatic early detection of antenatal depression (i.e., during week 36 to week 42 of pregnancy) in everyday life without the administration of healthcare professionals. We compare uni-modal and multi-modal models and identify predictive markers related to antenatal depression. With multi-modal approach the model reaches a BAC of 0.75, and an AUC of 0.82.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2022. p. 455-467
Keywords [en]
Antenatal depression, multimodal markers, mobile surveys, longitudinal study, machine learning
National Category
Health Sciences Computer Systems Psychiatry
Identifiers
URN: urn:nbn:se:uu:diva-488966DOI: 10.1145/3536221.3556605ISI: 001074464500050ISBN: 9781450393904 (print)OAI: oai:DiVA.org:uu-488966DiVA, id: diva2:1713283
Conference
24th ACM International Conference on Multimodal Interaction, Bangalore, Indien, November 7-11, 2022
Funder
Uppsala UniversityAvailable from: 2022-11-24 Created: 2022-11-24 Last updated: 2025-04-24Bibliographically approved
In thesis
1. The Space Between: Bridging Emotion and Data in Mental Health Research
Open this publication in new window or tab >>The Space Between: Bridging Emotion and Data in Mental Health Research
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Smartphone apps offer new opportunities to study mental health in real-world settings through a combination of passive sensor data and active self-report. This thesis explores how digital mental health research tools can be designed to collect meaningful, ecologically valid data while respecting user experience, motivation, and autonomy. Across four interrelated studies, I examine two app-based cohort studies targeting perinatal women (Mom2B) and young people (UPIC) in Sweden.

The first study presents the technical and ethical foundations of the Mom2B platform, including its integration of digital phenotyping methods. The second study applies machine learning techniques to self-reported data to assess the potential for early prediction of antenatal depression. The third study investigates user attitudes toward data sharing and task engagement, revealing the nuanced balance between research goals and participant comfort. The fourth study follows a user-centered design and usability testing process in the development of the UPIC app, highlighting how early user involvement can improve design, trust, and engagement.

Together, the findings demonstrate the importance of aligning technological possibilities with thoughtful, user-informed design. The thesis contributes to the growing field of digital mental health research by offering practical and ethical insights into the design and evaluation of emotion- and experience-aware research tools.

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2025. p. 73
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Medicine, ISSN 1651-6206 ; 2153
Keywords
digital phenotyping, mhealth, user-centered design, perinatal mental health, youth mental health, app-based research, prediction, usability testing.
National Category
Human Computer Interaction Psychology
Research subject
Human-Computer Interaction; Psychology
Identifiers
urn:nbn:se:uu:diva-554749 (URN)978-91-513-2491-3 (ISBN)
Public defence
2025-06-11, H:son Holmdahl, Akademiska sjukhuset, Entrance 100, Uppsala, 12:00 (English)
Opponent
Supervisors
Available from: 2025-05-21 Created: 2025-04-15 Last updated: 2025-05-21
2. Bridging Technology and Mental Health: Challenges and Opportunities in Robot-assisted Perinatal Depression Screening
Open this publication in new window or tab >>Bridging Technology and Mental Health: Challenges and Opportunities in Robot-assisted Perinatal Depression Screening
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Perinatal depression (PND), affecting up to 20% of individuals during the perinatal period, presents serious risks to both maternal and child health. Despite the availability of effective interventions, many PND cases remain undiagnosed, highlighting the need for more accessible screening methods. This thesis explores the potential of machine learning, mobile health (mHealth), and socially assistive robots (SARs) to enhance PND screening and diagnosis. It focuses on three objectives: (1) to develop predictive machine learning models for PND prediction using app data; (2) to explore stakeholder perspectives on SARs in PND care; and (3) to design an SAR prototype for PND screening and diagnosis and evaluate user acceptance and ethical concerns.

The first part of the research employed machine learning, which demonstrated that the occurrence of PND in the third trimester can be predicted using ecologically collected data. This highlights the potential of mHealth platforms for scalable early prediction of PND. The study also found that psychological health factors are the most predictive indicators for early PND.

The second part of the research explored the integration of SARs into PND screening and diagnosis through qualitative interviews with psychiatrists, PND experts, gender scholars, and mothers. The findings revealed diverse perspectives on the efficiency, acceptability, and design of SARs. Ethical concerns, like data privacy and informed consent, were also raised. While participants generally welcomed the potential of SARs to support PND screening, they consistently emphasized the need for human oversight. 

To translate high-level ethical guidelines into design practice, an exploratory case study developed SAR prototypes focusing on transparency and anthropomorphism. An online study examined how these traits influence the perception and efficacy of SARs. Results indicated that participants were more likely to agree with the transparent robot's recommendations. Findings from these studies, along with insights from subsequent participatory design sessions with mothers, informed the development of a real-world SAR prototype. User evaluations indicated that SARs are mostly welcomed in PND screening and can facilitate nonjudgmental interactions and emotional disclosure.

This thesis shows how machine learning, mHealth, and SARs can complement clinical care, offering effective, scalable, ethical tools to address gaps in perinatal mental healthcare.

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2025. p. 87
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology, ISSN 1651-6214 ; 2549
Keywords
human-robot interaction, socially assistive robots, mHealth, machine learning, perinatal depression.
National Category
Human Computer Interaction
Research subject
Computer Science with specialization in Human-Computer Interaction
Identifiers
urn:nbn:se:uu:diva-555233 (URN)978-91-513-2502-6 (ISBN)
Public defence
2025-06-13, Häggsalen Ång 10132, Ångströmlaboratoriet, hus 10, Regementsvägen 10, Uppsala, 09:00 (English)
Opponent
Supervisors
Available from: 2025-05-22 Created: 2025-04-24 Last updated: 2025-06-03

Open Access in DiVA

fulltext(2287 kB)390 downloads
File information
File name FULLTEXT02.pdfFile size 2287 kBChecksum SHA-512
001891d6f5058bf7782b72917932cad0f714b6e4aba06ddbb6ec001c99cbcc98c84e87cab707008f1a0d3a98cf8d556812afb717b9cbf46913e507c2ef8b1af6
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Authority records

Zhong, Mengyuvan Zoest, VeraBilal, Ayesha MaePapadopoulos, Fotios C.Castellano, Ginevra

Search in DiVA

By author/editor
Zhong, Mengyuvan Zoest, VeraBilal, Ayesha MaePapadopoulos, Fotios C.Castellano, Ginevra
By organisation
WoMHeR (Centre for Women’s Mental Health during the Reproductive Lifespan)Division Vi3Computerized Image Analysis and Human-Computer InteractionDivision of Systems and ControlAutomatic controlComputer SystemsPsychiatry
Health SciencesComputer SystemsPsychiatry

Search outside of DiVA

GoogleGoogle Scholar
Total: 391 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 155 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf