Logo: to the web site of Uppsala University

uu.sePublications from Uppsala University
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Bridging Technology and Mental Health: Challenges and Opportunities in Robot-assisted Perinatal Depression Screening
Uppsala University, WoMHeR (Centre for Women’s Mental Health during the Reproductive Lifespan). Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division Vi3. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction.ORCID iD: 0000-0002-6740-1111
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Perinatal depression (PND), affecting up to 20% of individuals during the perinatal period, presents serious risks to both maternal and child health. Despite the availability of effective interventions, many PND cases remain undiagnosed, highlighting the need for more accessible screening methods. This thesis explores the potential of machine learning, mobile health (mHealth), and socially assistive robots (SARs) to enhance PND screening and diagnosis. It focuses on three objectives: (1) to develop predictive machine learning models for PND prediction using app data; (2) to explore stakeholder perspectives on SARs in PND care; and (3) to design an SAR prototype for PND screening and diagnosis and evaluate user acceptance and ethical concerns.

The first part of the research employed machine learning, which demonstrated that the occurrence of PND in the third trimester can be predicted using ecologically collected data. This highlights the potential of mHealth platforms for scalable early prediction of PND. The study also found that psychological health factors are the most predictive indicators for early PND.

The second part of the research explored the integration of SARs into PND screening and diagnosis through qualitative interviews with psychiatrists, PND experts, gender scholars, and mothers. The findings revealed diverse perspectives on the efficiency, acceptability, and design of SARs. Ethical concerns, like data privacy and informed consent, were also raised. While participants generally welcomed the potential of SARs to support PND screening, they consistently emphasized the need for human oversight. 

To translate high-level ethical guidelines into design practice, an exploratory case study developed SAR prototypes focusing on transparency and anthropomorphism. An online study examined how these traits influence the perception and efficacy of SARs. Results indicated that participants were more likely to agree with the transparent robot's recommendations. Findings from these studies, along with insights from subsequent participatory design sessions with mothers, informed the development of a real-world SAR prototype. User evaluations indicated that SARs are mostly welcomed in PND screening and can facilitate nonjudgmental interactions and emotional disclosure.

This thesis shows how machine learning, mHealth, and SARs can complement clinical care, offering effective, scalable, ethical tools to address gaps in perinatal mental healthcare.

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2025. , p. 87
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology, ISSN 1651-6214 ; 2549
Keywords [en]
human-robot interaction, socially assistive robots, mHealth, machine learning, perinatal depression.
National Category
Human Computer Interaction
Research subject
Computer Science with specialization in Human-Computer Interaction
Identifiers
URN: urn:nbn:se:uu:diva-555233ISBN: 978-91-513-2502-6 (print)OAI: oai:DiVA.org:uu-555233DiVA, id: diva2:1954205
Public defence
2025-06-13, Häggsalen Ång 10132, Ångströmlaboratoriet, hus 10, Regementsvägen 10, Uppsala, 09:00 (English)
Opponent
Supervisors
Available from: 2025-05-22 Created: 2025-04-24 Last updated: 2025-06-03
List of papers
1. Unimodal vs. Multimodal Prediction of Antenatal Depression from Smartphone-based Survey Data in a Longitudinal Study
Open this publication in new window or tab >>Unimodal vs. Multimodal Prediction of Antenatal Depression from Smartphone-based Survey Data in a Longitudinal Study
Show others...
2022 (English)In: ICMI '22: Proceedings of the 2022 International Conference on Multimodal Interaction / [ed] Raj Tumuluri; Nicu Sebe; Gopal Pingali; Dinesh Babu Jayagopi; Abhinav Dhall; Richa Singh; Lisa Anthony; Albert Ali Salah, Association for Computing Machinery (ACM), 2022, p. 455-467Conference paper, Published paper (Refereed)
Abstract [en]

Antenatal depression impacts 7-20% of women globally, and can have serious consequences for both the mother and the infant. Preventative interventions are effective, but are cost-efficient only among those at high risk. As such, being able to predict and identify those at risk is invaluable for reducing the burden of care and adverse consequences, as well as improving treatment outcomes. While several approaches have been proposed in the literature for the automatic prediction of depressive states, there is a scarcity of research on automatic prediction of perinatal depression. Moreover, while there exist some works on the automatic prediction of postpartum depression using data collected in clinical settings and applied the model to a smartphone application, to the best of our knowledge, no previous work has investigated the automatic prediction of late antenatal depression using data collected via a smartphone app in the first and second trimesters of pregnancy. This study utilizes data measuring various aspects of self-reported psychological, physiological and behavioral information, collected from 915 women in the first and second trimesters of pregnancy using a smartphone app designed for perinatal depression. By applying machine learning algorithms on these data, this paper explores the possibility of automatic early detection of antenatal depression (i.e., during week 36 to week 42 of pregnancy) in everyday life without the administration of healthcare professionals. We compare uni-modal and multi-modal models and identify predictive markers related to antenatal depression. With multi-modal approach the model reaches a BAC of 0.75, and an AUC of 0.82.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2022
Keywords
Antenatal depression, multimodal markers, mobile surveys, longitudinal study, machine learning
National Category
Health Sciences Computer Systems Psychiatry
Identifiers
urn:nbn:se:uu:diva-488966 (URN)10.1145/3536221.3556605 (DOI)001074464500050 ()9781450393904 (ISBN)
Conference
24th ACM International Conference on Multimodal Interaction, Bangalore, Indien, November 7-11, 2022
Funder
Uppsala University
Available from: 2022-11-24 Created: 2022-11-24 Last updated: 2025-04-24Bibliographically approved
2. Psychiatrists’ Views on Robot-Assisted Diagnostics of Peripartum Depression
Open this publication in new window or tab >>Psychiatrists’ Views on Robot-Assisted Diagnostics of Peripartum Depression
2021 (English)In: Social Robotics: 13th International Conference, ICSR 2021Singapore, Singapore, November 10–13, 2021Proceedings / [ed] Haizhou Li, Shuzhi Sam Ge, Yan Wu, Agnieszka Wykowska, Hongsheng He, Xiaorui Liu, Dongyu Li, Jairo Perez-Osorio, Cham: Springer Nature, 2021, p. 464-474Conference paper, Published paper (Refereed)
Abstract [en]

Social robots are rising to prominence as tools in healthcare and mental healthcare. In this paper, we investigate robot-assisted diagnostics of peripartum depression (PPD) in women. To design robots that are accepted by users and comply with trustworthy Artificial Intelligence principles, we use semi-structured interviews to explore the views of potential stakeholders - psychiatrists. We aim to answer three research questions regarding 1) the usefulness of robots in the diagnosis of PPD, 2) potential ethical issues, and 3) the roles that robots and clinicians may play in the diagnostic process. Results show that psychiatrists are only willing to let robots take minor responsibilities, and feel that robots may be more useful in situations where there is a shortage of clinicians.

Place, publisher, year, edition, pages
Cham: Springer Nature, 2021
Series
Lecture Notes in Computer Science, ISSN 0302-9743, E-ISSN 1611-3349 ; 13086
National Category
Robotics and automation Human Computer Interaction
Identifiers
urn:nbn:se:uu:diva-467228 (URN)10.1007/978-3-030-90525-5_40 (DOI)000776504300040 ()978-3-030-90524-8 (ISBN)978-3-030-90525-5 (ISBN)
Conference
13th International Conference, ICSR 2021, Singapore, Singapore, November 10–13, 2021
Available from: 2022-02-08 Created: 2022-02-08 Last updated: 2025-04-24Bibliographically approved
3. Gender Fairness in Social Robotics: Exploring a Future Care of Peripartum Depression
Open this publication in new window or tab >>Gender Fairness in Social Robotics: Exploring a Future Care of Peripartum Depression
Show others...
2022 (English)In: Proceedings of the 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI '22), Institute of Electrical and Electronics Engineers (IEEE), 2022, p. 598-607Conference paper, Published paper (Refereed)
Abstract [en]

In this paper we investigate the possibility of socially assistive robots (SARs) supporting diagnostic screening for peripartum depression (PPD) within the next five years. Through a HRI/socio-legal collaboration, we explore the gender norms within PPD in Sweden, to inform a gender-sensitive approach to designing SARs in such a setting, as well as governance implications. This is achieved through conducting expert interviews and qualitatively analysing the data. Based on the results, we conclude that a gender-sensitive approach is a necessity in relation to the design and governance of SARs for PPD screening.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2022
Series
ACM IEEE International Conference on Human-Robot Interaction, ISSN 2167-2121, E-ISSN 2167-2148
Keywords
gender norms, socially assistive robots, peripartum depression, governance, gender fairness, socio-legal robotics
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:uu:diva-490912 (URN)10.1109/HRI53351.2022.9889468 (DOI)000869793600065 ()978-1-6654-0731-1 (ISBN)978-1-6654-0732-8 (ISBN)
Conference
17th Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI), MAR 07-10, 2022, ELECTR NETWORK
Funder
Marianne and Marcus Wallenberg FoundationUppsala UniversityMarcus and Amalia Wallenberg Foundation
Available from: 2022-12-19 Created: 2022-12-19 Last updated: 2025-04-24Bibliographically approved
4. Exploring Mothers' Perspectives on Socially Assistive Robots in Peripartum Depression Screening
Open this publication in new window or tab >>Exploring Mothers' Perspectives on Socially Assistive Robots in Peripartum Depression Screening
2023 (English)In: HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction / [ed] Ginevra Castellano; Laurel Riek; Maya Cakmak; Iolanda Leite, Association for Computing Machinery (ACM), 2023, p. 486-490Conference paper, Published paper (Refereed)
Abstract [en]

Peripartum Depression (PPD) affects 8-15 percent of new mothers in Sweden every year; a majority of PPD cases go undetected, and only a small percentage receives adequate care. Social Assistive Robots (SARs) bring great potential for healthcare applications. Using SARs in healthcare tasks, for example PPD Screening, could reduce healthcare professionals' strain, by supporting them, without replacing them, in key roles. However, studies that investigate the possibility to utilize SARs in PPD screening are scarce. In this paper, we present an interview study with ten mothers with prior experience of PPD in relation to their pregnancy. The contributions from this work are twofold. First, we elicited participants' opinions and attitudes towards utilizing SARs in PPD screening. Second, we explored participants' expressed needs in PPD screening. From the participants' statements, we discovered potential scenarios which could address future patients' needs. These insights could be used as a foundation for the development of SARs in PPD screening and other mental healthcare applications, thus helping address PPD in women.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2023
Keywords
Peripartum Depression, HRI Design, Socially Assistive Robots
National Category
Human Computer Interaction Public Health, Global Health and Social Medicine Gynaecology, Obstetrics and Reproductive Medicine
Identifiers
urn:nbn:se:uu:diva-514148 (URN)10.1145/3568294.3580132 (DOI)001054975700095 ()2-s2.0-85150476679 (Scopus ID)978-1-4503-9970-8 (ISBN)
Conference
18th Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI), March 13-16, 2023, Stockholm, Sweden
Funder
Marianne and Marcus Wallenberg FoundationMarcus and Amalia Wallenberg FoundationUppsala University
Available from: 2023-10-16 Created: 2023-10-16 Last updated: 2025-04-24Bibliographically approved
5. A case study in designing trustworthy interactions: implications for socially assistive robotics
Open this publication in new window or tab >>A case study in designing trustworthy interactions: implications for socially assistive robotics
2023 (English)In: Frontiers in Computer Science, E-ISSN 2624-9898, Vol. 5, article id 1152532Article in journal (Refereed) Published
Abstract [en]

This work is a case study in applying recent, high-level ethical guidelines, specifically concerning transparency and anthropomorphisation, to Human-Robot Interaction (HRI) design practice for a real-world Socially Assistive Robot (SAR) application. We utilize an online study to investigate how the perception and efficacy of SARs might be influenced by this design practice, examining how robot utterances and display manipulations influence perceptions of the robot and the medical recommendations it gives. Our results suggest that applying transparency policies can improve the SAR's effectiveness without harming its perceived anthropomorphism. However, our objective measures suggest participant understanding of the robot's decision-making process remained low across conditions. Furthermore, verbal anthropomorphisation does not seem to affect the perception or efficacy of the robot.

Place, publisher, year, edition, pages
Frontiers Media S.A., 2023
Keywords
human-robot interaction, trustworthy HRI, transparent robots, anthropomorphic robots, ethics, mental healthcare, explainable AI
National Category
Human Computer Interaction Robotics and automation
Identifiers
urn:nbn:se:uu:diva-506725 (URN)10.3389/fcomp.2023.1152532 (DOI)001027588300001 ()
Funder
EU, Horizon Europe, 101070802Uppsala UniversityMarianne and Marcus Wallenberg FoundationSwedish Research Council, 2020-03167Marcus and Amalia Wallenberg FoundationWallenberg AI, Autonomous Systems and Software Program (WASP)
Note

De två första författarna delar förstaförfattarskapet

Available from: 2023-06-29 Created: 2023-06-29 Last updated: 2025-04-24Bibliographically approved
6. Designing Socially Assistive Robots for Perinatal Depression Screening: Insights and Ethical Considerations from Two Exploratory Studies
Open this publication in new window or tab >>Designing Socially Assistive Robots for Perinatal Depression Screening: Insights and Ethical Considerations from Two Exploratory Studies
Show others...
2026 (English)In: ACM Transactions on Human-Robot Interaction, E-ISSN 2573-9522, Vol. 15, no 3, article id 61Article in journal (Refereed) Published
Abstract [en]

Perinatal depression (PND) is a common mental health disorder associated with childbirth, which has high societal costs affecting up to 10% of individuals during pregnancy or postpartum. Whilst socially assistive robots (SARs) have recently proven to be useful tools in mental healthcare, and our previous work has investigated different stakeholders’ perspectives on SARs in PND screening through interview studies, gaps remain in understanding how primary users (i.e., prospective patients) perceive and interact with such technologies. In this article, we use a participatory design methodology with semi-structured interviews of women in Sweden with previous experience of PND to explore the roles that SARs could play in addressing PND challenges and identify design factors for SARs in PND screening. We design and evaluate in a user study a robot prototype in two new interaction contexts for SARs with different levels of human oversight. The results show that SARs are welcomed by most participants, who appreciated the potentially faster assessment process and felt more comfortable opening up with a robot versus a human clinician. However, we found that there is no single solution that fits all, as other participants preferred the flexibility of self-reported digital surveys or interaction with a human clinician. Moreover, results show that transparency and human oversight are crucial requirements to consider when implementing robot-delivered PND screening questionnaires and diagnostic interviews. We reflect on ethical considerations, provide design recommendations and urge HRI designers to carefully consider whom SARs benefit, whom they may not, and which safeguarding factors are necessary to prevent potential negative outcomes.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2026
National Category
Human Computer Interaction
Research subject
Computer Science with specialization in Human-Computer Interaction
Identifiers
urn:nbn:se:uu:diva-555624 (URN)10.1145/3797257 (DOI)001793198600001 ()
Funder
Marianne and Marcus Wallenberg FoundationMarcus and Amalia Wallenberg FoundationEU, Horizon Europe
Available from: 2025-04-29 Created: 2025-04-29 Last updated: 2026-06-30Bibliographically approved

Open Access in DiVA

UUThesis_Zhong,M-2025(2453 kB)367 downloads
File information
File name FULLTEXT01.pdfFile size 2453 kBChecksum SHA-512
6e3e46c496366a0fb7e12611d52a7a53fceaa3573ce5d68409ed679dded6153fb4442c4850c01a0f30f8bc2cbd7a584b3560a1a9d01629f1c68bc66411c58e89
Type fulltextMimetype application/pdf

Authority records

Zhong, Mengyu

Search in DiVA

By author/editor
Zhong, Mengyu
By organisation
WoMHeR (Centre for Women’s Mental Health during the Reproductive Lifespan)Division Vi3Computerized Image Analysis and Human-Computer Interaction
Human Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar
Total: 372 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 3447 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf