Original Paper
Abstract
Background: The ever-increasing pressure on health care systems has resulted in the underrecognition of perinatal mental disorders. Digital mental health tools such as apps could provide an option for accessible perinatal mental health screening and assessment. However, there is a lack of information regarding the availability and features of perinatal app options.
Objective: This study aims to evaluate the current state of diagnostic and screening apps for perinatal mental health available on the Google Play Store (Android) and Apple App Store (iOS) and to review their features following the mHealth Index and Navigation Database framework.
Methods: Following a scoping review approach, the Apple App Store and Google Play Store were systematically searched to identify perinatal mental health assessment apps. A total of 14 apps that met the inclusion criteria were downloaded and reviewed in a standardized manner using the mHealth Index and Navigation Database framework. The framework comprised 107 questions, allowing for a comprehensive assessment of app origin, functionality, engagement features, security, and clinical use.
Results: Most apps were developed by for-profit companies (n=10), followed by private individuals (n=2) and trusted health care companies (n=2). Out of the 14 apps, 3 were available only on Android devices, 4 were available only on iOS devices, and 7 were available on both platforms. Approximately one-third of the apps (n=5) had been updated within the last 180 days. A total of 12 apps offered the Edinburgh Postnatal Depression Scale in its original version or in rephrased versions. Engagement, input, and output features included reminder notifications, connections to therapists, and free writing features. A total of 6 apps offered psychoeducational information and references. Privacy policies were available for 11 of the 14 apps, with a median Flesch-Kincaid reading grade level of 12.3. One app claimed to be compliant with the Health Insurance Portability and Accountability Act standards and 2 apps claimed to be compliant with General Data Protection Regulation. Of the apps that could be accessed in full (n=10), all appeared to fulfill the claims stated in their description. Only 1 app referenced a relevant peer-reviewed study. All the apps provided a warning for use, highlighting that the mental health assessment result should not be interpreted as a diagnosis or as a substitute for medical care. Only 3 apps allowed users to export or email their mental health test results.
Conclusions: These results indicate that there are opportunities to improve perinatal mental health assessment apps. To this end, we recommend focusing on the development and validation of more comprehensive assessment tools, ensuring data protection and safety features are adequate for the intended app use, and improving data sharing features between users and health care professionals for timely support.
doi:10.2196/30724
Keywords
Introduction
Background
Perinatal mental health disorders are among the most common complications of childbearing. Recent systematic reviews have reported a prevalence of 17% for postnatal depression [
] and 15% to 20% and 10% for antenatal and postnatal anxiety disorders [ , ], respectively. These numbers are comparable with the prevalence rates of gestational diabetes (14.5%) [ ] and preterm birth (11%) [ ]. Critically, pregnancy can be a triggering event; 10% to 20% of pregnant individuals with bipolar disorder experience a relapse during or after pregnancy, often culminating in a severe mental illness episode (ie, postpartum psychosis and mania) requiring hospitalization [ - ]. In some individuals, postpartum psychosis can also be the first manifestation of bipolar disorder [ , ]. If left untreated, perinatal mental illnesses can lead to poorer maternal quality of life, emotional suffering, and an increased risk of suicide and infanticide. Mental health disorders throughout the perinatal period have also been found to diminish mother–infant bonding [ ], impair breast feeding [ , ], and, in some cases, predict poor outcomes in social-emotional and cognitive development of children [ ]. In addition to considerable maternal and infant morbidity, perinatal mental disorders carry substantial health and social care costs to society. For instance, in the United Kingdom alone, perinatal depression, anxiety, and psychosis cost approximately £8.10 (US $10.90) billion for each 1-year cohort of births, with £1.20 (US $1.60) billion falling directly on the National Health Service and social services [ ]. In Australia, overall costs of perinatal mental illness were estimated to reach Aus $7.30 (US $ 5.30) billion, with Aus $643 (US $466) million loss in productivity and Aus $227 (US $164) million incurred in health costs within the first year of perinatal mental illness [ ]. In the United States, it was projected that untreated perinatal mood and anxiety disorders costed US $14 billion for the 2017 birth cohort from conception to 5 years postpartum, with the average cost per affected mother–child averaging at US $31,800 [ ].The ever-increasing pressure on health care systems and lack of time and resources have resulted in a staggering underrecognition of postnatal depression and other perinatal disorders [
, ], with approximately 50% of cases of postnatal depression being undiagnosed [ ]. This is likely because of an array of individual-level and organizational-level barriers, including negative attitudes and stigma regarding diagnosis; a lack of understanding of perinatal mental health disorders among pregnant individuals, their partners, and health care professionals; and fear of consequences [ ]. Other challenges include cultural and language factors, resource fragmentation, and poor policy implementation [ ].In this regard, digital mental health services such as web-based assessments and apps could help alleviate some of the pressure put on in-person health care services and overcome barriers to help seeking, providing an alternative or complementary option for widespread perinatal mental health care provision. Indeed, mobile technology is rapidly expanding into the field of well-being and health care, with mobile health (mHealth) being among the fastest growing sectors with a compound annual growth rate of 32.5% [
]. Immediacy, accessibility, and affordability are among the potential benefits of using digital tools to identify perinatal mental health concerns. In the field of perinatal mental health, recent studies have highlighted that new mothers and those with postnatal depression are interested in using health apps [ ], and recent studies have highlighted a growing research effort in the implementation of mHealth tools for psychoeducation and prevention of perinatal mental health concerns [ - ]. The COVID-19 pandemic has fueled interest in digital mental health solutions, as elevated levels of stress coupled with reduced in-person care prompted changes in mental health care provisions [ , ]. As a result, telemedicine services have been widely and successfully adopted in everyday perinatal care and mental health care [ - ] paving the way for the uptake of other digital health innovations such as apps.Objectives
Importantly, there still exists a large gap between interest in mental health digital tools [
] and a comprehensive understanding of the scientific integrity, clinical validity, and features of digital assessment tools for mental health [ - ]. In fact, 1 of the top 10 research priorities recently identified by the James Lind Alliance Priority Setting Partnership for digital technology in mental health care is to identify the best methods to evaluate and endorse mental health apps [ ]. To this end, the objectives of this study are to identify apps that offer mental health screening or assessments for perinatal mental health available on the Google Play Store (Android) and the Apple App Store (iOS) and to review their features, including accessibility, privacy and security, clinical evidence, engagement style, and interoperability. Available apps were assessed using the mHealth Index and Navigation Database (MIND) framework [ , ]. The framework was developed by Lagan et al [ , ] in collaboration with the app evaluation model of the American Psychiatric Association (APA) [ ], reflecting consensus from various stakeholders such as service users, social workers, psychiatrists, and data scientists to derive a ready-to-use resource for patients and clinicians alike [ , , ]. The initial 38 open questions from the APA model served as the basis for the development of 107 questions that required binary (yes or no) or numeric responses covering app origin, functionality, security, engagement features, and clinical use. In the MIND framework, broad open questions from the APA model, for example, “What are the main engagement styles of the app?” were operationalized into 11 different types of engagement features. Similarly, the APA question “Is there a transparent privacy policy that is clear and accessible before use?” was operationalized into 2 objective questions: one regarding the presence of the privacy policy requiring a binary (yes or no) answer and the other prompting the rater to measure the reading level of the privacy policy (numeric response) to evaluate clarity. Thus, using defined and discrete evaluative questions, the MIND framework aims to be more objective and reproducible than the APA model.The findings from this timely appraisal of perinatal diagnostic and screening apps have important implications for clinical practice and for the development of innovative ways to provide mental health care provisions throughout this complex time.
Methods
Overview
The objectives of this scoping review are to identify apps that offer perinatal mental health screening or assessments and to review their features against the MIND framework [
, ]. The scope comprised apps whose intended user populations specifically included adults in the perinatal period (ie, pregnant or had recently given birth) or health care professionals operating in perinatal health care. In consultation with a practicing psychiatrist (SB), interventions of interest included apps presenting questions and answers based digital screening and diagnostic tools completed by an individual or a health care professional on behalf of the individual, used for mental health screening, or as an aid in clinical decision-making.We reported the review following the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines (
) [ ].Search Strategy
Search terms to identify apps developed specifically for perinatal mental health were identified through a preliminary search of the Apple App Store and Google Play Store. Relevant synonyms and layperson alternatives were also included in the search. Layperson alternatives were included to capture app results as searched by consumers who may not use technical terminology. As a result, the following keyword combinations were used: moms mental health, moms mental health screening, moms mental health assessment, mums mental health, mums mental health assessment, mums mental health screening, pregnancy mental health, maternal mental health, pregnancy mental health assessment, pregnancy mental health screening, perinatal, perinatal mental health, perinatal mental health assessment, perinatal mental health screening, postpartum, postpartum mental health, postpartum mental health assessment, mental health screening, and mental health assessment.
These terms were used to search the 2 most widely used smartphone app stores, Apple App Store and Google Play Store, between January and February 2021, to identify publicly available apps.
Inclusion Criteria
Apps were then shortlisted using the following inclusion criteria defined in consultation with a general adult psychiatrist (SB) and a practicing specialist perinatal psychiatrist:
- Intended users of the app included at least 1 of the following groups: perinatal population and perinatal health care professionals.
- The app offered a screening tool for any of the following conditions: bipolar disorder, major depressive disorder, postnatal depression, obsessive compulsive disorder, antenatal or postnatal anxiety, generalized anxiety disorder, agoraphobia, tokophobia, social phobia, panic disorder, insomnia, schizophrenia, (postpartum) psychosis, eating disorders (bulimia nervosa and anorexia nervosa), emotionally unstable personality disorder, alcohol abuse, substance abuse, (complex) posttraumatic stress disorder (PTSD), birth trauma, acute stress disorder, and adjustment disorder.
- The app was available for download through the official Google Play or Apple App stores, and its description was available on the store.
Exclusion Criteria
Apps that were not intended specifically for use by the perinatal population or health care professionals operating in the perinatal health field were excluded. Apps presenting screening or assessment tools designed solely for any type of health care professional training and examination preparation purposes were also excluded.
Screening and App Selection
As the searches were performed on the Google Play Store and the Apple App Store, app names and links to the app stores were recorded on a Microsoft Excel spreadsheet. Duplicate apps retrieved using multiple search terms were then removed. A total of 2 independent reviewers (BS and NAMK) performed a blinded screening of the descriptions of all the identified apps. To decide whether the apps should be examined further, the independent reviewers assessed their eligibility against the inclusion criteria. Apps were labeled as exclude, include, or maybe. Any disagreements among the reviewers were discussed until a consensus was reached. The included apps were then analyzed and scored against the MIND framework [
].Assessment
Apps meeting the inclusion criteria were downloaded onto either a Pixel 5 (Android version 11) or an iPhone X (iOS version 14.2) for complete assessment. One reviewer (BS) transferred the MIND framework questions from the supplementary materials in Lagan et al into Microsoft Excel spreadsheets for data extraction and assessment of app features. Two independent reviewers (BS and NAMK) extracted the relevant information on separate spreadsheets. The 2 reviewers (BS and NAMK) independently performed the assessment of each app following the MIND framework as outlined by Lagan et al [
]. The extracted data and assessment results were then compared, and any discrepancies or disagreements were resolved by consensus discussion between those 2 authors.The MIND framework comprised 107 questions on features related to the following app characteristics: (1) app origin including developer characteristics; (2) app functionality, which includes platform, number of downloads, average user-scored star rating, need for network connectivity, language, and price; (3) inputs and outputs, such as the presence of surveys, reminders, access to camera and microphone; (4) privacy and security features, including presence of an accessible privacy policy, data sharing policies and opt-outs, the presence of a crisis management feature; (5) evidence and clinical foundations, including adherence to app description claims, availability of evidence from feasibility studies, and compliance to clinical guidelines; (6) features and engagement style, which comprises characteristics such as the presence of tracking features, journaling, educational material, and peer support; (7) app use characteristics such as target audience and whether it is a self-managed tool or it is used together with a clinician; and (8) interoperability and data sharing matters, such as data ownership and interoperability with electronic medical records systems.
Reading level of the privacy policies of apps was calculated using an automatic text readability checker [
], as indicated in the MIND framework, resulting in a Flesh-Kincaid grade level [ ], indicating a readability score corresponding to the US education grade level required for the reader to understand the text.The MIND framework questions were designed to be answerable by any trained rater—clinician, peer, end user—and inform the identically titled public-facing database: the MIND [
, ]. The database was designed and implemented by the Division of Digital Psychiatry, a collaborative research group at the Beth Israel Deaconess Medical Center, a Harvard Medical School affiliate in Boston (MA, United States) that strives to create a comprehensive, easily searchable and updatable app database where apps are reviewed by trained raters following the MIND framework [ ], and users can view app attributes and compare ratings. Hence, after performing the assessment of each of the apps following the MIND framework [ ], we (BS and NAMK) searched the MIND database to compare our results with those of independent raters ( ).Results
Search Overview
After removing all duplicates, a total of 1189 unique apps were identified, with 801 apps from the Google Play Store and 388 apps from the Apple App Store. Duplicate apps retrieved using multiple search terms were removed. After reviewing the description of the apps, a total of 1175 apps were excluded as they were of no relevance (
and ). A total of 14 apps were included for the analysis and scored against the MIND framework [ ] ( ). Overall, only 4 apps could be partially assessed on the basis of the information extracted from the app description on the Google Play Store and Apple App Store. Of these, 2 required a referral by a health care provider, and 2 apps repeatedly crashed; hence, the content could not be assessed.App category | Category description | Frequencies,a n (%) |
Mental health screening and tracking (not perinatal) | Mental health screening apps not targeted to the perinatal population and mood tracking apps. | 95 (7.99) |
Mental health information and interventions | Apps offering mindfulness, meditation, journaling, and sleep help, apps offering mental health coaching (eg, panic attack management and suicide prevention) as well as cognitive behavioral therapy features, and apps offering mental-health information and psychoeducation. | 399 (33.56) |
Perinatal physical health and well-being | Apps offering information about physical changes occurring over pregnancy and postpartum as well as information on breastfeeding and well-being during the perinatal period. | 102 (8.58) |
Physical health information and tracking | Apps providing information on neonatal care and physical health, female and reproductive health, general physical health, and health tracking features (eg, heart rate). | 99 (8.33) |
Educational and reference material for health care professionals | Apps providing revision material for medical school and nursing exams as well as information for health care professionals on care pathways, and apps for scientific conferences and journals. | 120 (10.09) |
Telemedicine | Apps acting as platforms for video consultations, remote patient monitoring and care. | 43 (3.62) |
Fitness | Apps offering workouts and, in some cases, nutritional advice for pregnant individuals and mothers, and also fitness apps targeted to the general population. | 147 (12.36) |
Other | Miscellaneous apps eg, apps for audiobooks, music, shopping, traveling, games, brain training or logic games, cuisine, social media, and personality tests | 170 (14.30) |
aTotal sample size includes all unique apps identified in the search (N=1189).
App Origin and Functionality
Most apps were developed by for-profit providers (n=10) or private individuals (n=2), followed by trusted health care companies (n=2). Of the apps developed by trusted health care companies, 1 was developed in collaboration with an academic institution.
Of the 14 included apps, 3 were only available on Android devices, 4 were available only on Apple iOS devices, and 7 had versions for both platforms. Approximately one-third of the apps (n=5) had been updated within the last 180 days, with 11 apps updated within the last 13 months.
Most apps did not have sufficient reviews to display the average review rating. Of the apps that could be accessed, over half could work offline (n=7), not requiring an internet connection after downloading, and 2 apps could not function in the absence of an internet connection or required connectivity for some of their features. None of the apps presented accessibility features such as text size adjustment, a text-to-voice option, or color-blind color scheme options.
Examining costs, 8 apps were free, 1 was free to download, but it is unknown if it offered in-app purchases, 2 offered in-app purchases, or redirected the user to paid services for psychotherapy, whereas 2 apps were priced at US $0.99, and 1 was priced at US $1.09.
Inputs and Outputs
All the apps offered self-assessment questionnaires to screen for perinatal depression. A total of 12 apps offered the Edinburgh Postnatal Depression Scale (EPDS) in its original version [
] or in slightly adapted versions. In addition to the EPDS, 1 app included the Patient Health Questionnaire–8-item scale [ ], the Generalized Anxiety Disorder 7-item scale [ ], the Insomnia Severity Index [ , ], the Perceived Stress Index [ ], and questions about PTSD from the Mini-International Neuropsychiatric Interview [ ] with attribution to original sources. A total of 3 apps offered the EPDS as well as additional tests not specifically targeted to the perinatal population such as tests for anxiety disorders, attention deficit hyperactivity disorder, PTSD, alcohol and substance use disorders, other various forms of addiction, eating disorders, personality disorders, bipolar disorder, and schizophrenia.Most of the apps (n=8) provided the user with mental health screening scores and short summaries of their clinical significance. In addition, 2 apps provided a graphical depiction of the assessment results over time. A total of 3 apps offered the option of receiving reminder notifications to prompt the user to complete mental health screenings regularly.
Upon informing the user of their test scores, 8 apps recommended discussing results with a health care professional, 1 displayed the EPDS score without duty-of-care messaging, and the remaining 5 apps could not be viewed in full; therefore, it could not be determined whether users were advised to consult a health care professional. A total of 5 apps displayed duty-of-care messages and provided the user with crisis hotlines; in 4 cases, these were US-based hotlines and in 1 case, these were UK-based hotline; therefore, crisis advice was not personalized to the location of the user. Only 3 apps instantly displayed a duty-of-care message referring the user to clinical support and crisis hotlines if symptoms regarding suicidal ideation or self-harm were endorsed.
In addition to the screening tools, 2 apps presented a free writing, diary-like feature, and 1 app allowed the user to add notes after having taken the screening test. A total of 6 apps offered psychoeducation information or references to psychoeducational materials. An additional app presented psychoeducation videos that could not be viewed, and another app reported a link to psychoeducation information that was not functioning.
Features and Engagement Style
Aside from screeners, assessments, reminders, and basic psychoeducation information, the apps did not include the great majority of engagement features listed in the MIND framework [
]. One app offered the user the possibility to connect with therapists online, whereas another app redirected users to BetterHelp, a web-based portal providing mental health services. One app allowed users to join a community on Facebook to share experiences and advice on mental health concerns. An additional app had a safety plan feature, allowing users to save motivational sentences and the details of up to 5 contacts to call in case of suicidal thoughts. None of the apps presented gamification features, such as gaining points or prizes for completing mental health assessments.Privacy and Security
Privacy policies were available either as a link from the app store description or in the app for 11 of the 14 apps. Overall, 1 app claimed to be compliant with the Health Insurance Portability and Accountability Act standards, and 2 additional apps claimed to be compliant with General Data Protection Regulation. Data use and purpose was declared in all the available privacy policies: in 2 cases data use was not detailed and in a further case, the information seemed to be related to the website of the developer and not specific to the app. A description of measures aimed at secure data collection and sharing was present in 6 of the 11 policies available. A total of 5 apps stated in their privacy policies that personal health information (PHI), including name, birthday, and mental health information would not leave the app, whereas PHI was shared in the other 6 apps. One-third of the apps in which PHI was shared did not report measures aimed at secure data collection and sharing. Deidentified data were shared by 7 apps, 5 of which also shared anonymized or aggregated user data. Only 2 apps of those that collected and shared data specifically stated in their privacy policies that the user could opt out of data collection. Three apps offered the option to delete all data related to the user upon request, whereas 2 apps allowed only for partial deletion of personal data. Out of the 11 privacy policies considered, 6 mentioned a crisis management feature (eg, a hotline number was included at the end of the mental health assessment). However, as discussed above, only 3 apps presented the user with an instant duty-of-care message upon presentation of suicidal ideation or self-harm. Finally, the median reading level of the privacy policies as measured using the Flesch-Kincaid reading grade level was 12.3, which corresponds to 12th grade, the final year of secondary school in the United States.
Evidence, Clinical Foundations, Use, and Interoperability
Of the apps that could be accessed (n=10), all appeared to fulfill the claims stated in their descriptions. Importantly, the remaining 4 apps could not be evaluated on this criterion because they either crashed upon app launch or could not be accessed. All the assessed apps were patient-facing, with 3 of them being designed for use by both clinicians and patients.
One app referenced a relevant study conducted to test the app [
], where the usability of the app as a screening and management tool for perinatal depression was explored by gathering feedback from women in interviews. However, the study did not assess the efficacy of the diagnostic tool or psychoeducation content. One additional app referred to published, peer-reviewed studies, but it was unclear if the app tested in those studies corresponded to the current app version and the studies were not performed in perinatal populations.All the apps provided a warning for use, highlighting that the mental health assessment result should not be interpreted as a diagnosis and that the app was not a substitute for medical care.
As a result, the apps were all regarded as reference apps and not as self-help tools. In the MIND framework, self-help apps are defined as providing activities that can be used for self-help and self-management, such as mood or symptom tracking or mindfulness exercises, whereas reference apps are defined as providing information and references but not necessarily activities. Although completing self-assessment questionnaires is a valuable activity, none of the apps that could be viewed in full offered activities that could help the user to manage the mental health concerns identified through the self-assessment activity.
The 3 apps allowed users to export or email their mental health test results. None of the apps seemed to have the necessary interoperability features to allow the sharing of app-gathered data to a medical record. The only app that offered an in-built connection with mental health therapists also allowed users to share their data with the therapist only after booking a therapy session.
Discussion
Principal Findings
Early mental health assessment strategies hold promise in supporting pregnant individuals and new mothers, but strategies vary widely among countries, with screening recommendations being subject to debates [
- ] and systematic reviews attempting to collect evidence to inform policy makers [ ]. To date, access to mental health care is restricted to only a small proportion of pregnant individuals in need of mental health support [ ]. During the COVID-19 pandemic, the increase in mental health concerns in the perinatal population has urged health care systems to expand care modalities [ , ]. As a result, guidelines compiled for perinatal care during the pandemic recommended asking pregnant individuals about their mental health at every antenatal and postnatal appointment and encouraged the use of digital means to deliver support [ ].Telemedicine has been the main digital tool used by health care professionals transitioning to remote care models, but apps have also started to be featured in mental health programs offered by health care providers and universities [
, ]. In a recent study conducted by our group, women, partners, and midwives expressed a strong interest in using a digital mental health assessment to screen, diagnose, and triage perinatal mental concerns [ ]. This finding resonates with previous evidence showing that pregnant individuals are increasingly using digital tools as a source of health information during pregnancy and to enhance their understanding and involvement in pregnancy-related decision-making [ ]. Moreover, studies also support the view that individuals are open to mental health discussions at perinatal visits and that delivery modality (eg, paper vs tablet) does not affect acceptability [ , ].The interest in perinatal digital tools set a solid stepping stone for apps looking to meet the growing demand for accessible mental health screens and assessments. However, in contrast to this positive outlook, our results revealed an unsatisfactory landscape of existing app options for perinatal mental health screening and assessment. First, 14.3% (170/1189) of the results from the keyword search were completely unrelated to mental health and the perinatal period (Other;
), which may be disheartening for users looking for help and relevant tools. Moreover, 12.36% (147/1189) of the excluded apps offered fitness programs, including workouts and weight loss (Fitness; ), with such a focus on body image being potentially deleterious and triggering in the perinatal mental health context. A similar prevalence of apps targeting physical appearance and fitness was also reported by a recent systematic review specific to mHealth interventions for peripartum mood disorders [ ].In summary, of the included apps, several had not been recently updated, lacked accessibility features (eg, text size adjustments, text-to-voice options), and often presented functionality issues that could be deleterious and disheartening to users referring to the app for support. The screening tool most frequently encountered in this review was the EPDS. The EPDS can be used to screen for depression and anxiety [
]. However, most app descriptions and EPDS results reports focused heavily on perinatal depression. Only 1 app presented a more comprehensive screening pathway using questions and validated screening tools for depression, anxiety, insomnia, and PTSD symptoms. None of the apps acted as a diagnostic tool, instead they acted as screening tools. Indeed, the tools used by the apps such as the EPDS, Generalized Anxiety Disorder 7-item scale, Insomnia Severity Index, Patient Health Questionnaire–8-item scale, and Perceived Stress Index are screening tools aimed at identifying individuals who may benefit from further assessment. Screening tools are designed to have high sensitivity, whereas diagnostic tools are designed to have good content validity, test–retest reliability, good interrater reliability, and high specificity [ ]. Using self-report inventories designed for screening purposes as a single means of deriving a diagnosis is inadequate and must be avoided. An in-depth interview with a clinician following the diagnostic criteria defined by the Diagnostic and Statistical Manual of Mental Disorders, fifth edition or the International Classification of Diseases, eleventh edition remains the gold standard for diagnostic assessment. Therefore, apps using self-reported inventories are far from being comprehensive enough to act as diagnostic tools, whereas they may be useful as a first-step screening tool that alerts individuals of the need for further assessment.Indeed, if the screening result is positive, guiding app users toward a full diagnostic assessment is critical. Our review highlighted that, in some cases, the apps failed to provide clear, instant, and geographically relevant duty-of-care messages to users, even upon disclosure of self-harm or suicidality. Compliance with data security statutes and regulations (eg, Health Insurance Portability and Accountability Act and General Data Protection Regulation) has rarely been mentioned, and with a median Flesch-Kincaid reading grade level of 12.3, privacy policies were often above the suggested readability grade level (9-10) for the public [
]. Importantly, sharing of results with clinicians was enabled only by 3 apps, which allowed users to export or email their screening reports.Strengths and Limitations
The search strategy used to identify perinatal mental health assessment apps was comprehensive, and a completely blinded dual review process was used to ensure all relevant apps were included and to decrease the risk of reviewer bias.
The assessment was conducted using the MIND framework developed in collaboration with the APA [
]. In a recent review, the MIND framework operationalized by Lagan et al [ ] showed significant overlap with other 70 app evaluation frameworks, highlighting its comprehensiveness and flexibility as a consolidated framework for app assessments. However, it should be noted that the framework does not include questions about ease of use, visual appeal, layout, and graphics. These are arguably subjective app features and are probably best assessed within the relevant clinical context and user population.Critically, assessment of the apps strongly depended on the information disclosed by app developers in the app description, privacy policies, and functionality of the app itself. Our search did not include web or proprietary digital platforms that are not commercially available as apps on consumer-facing platforms. Recent literature shows that proprietary digital tools options exist and are offered by perinatal care providers [
], and there is also a disconnect between commercially available apps and academically available apps for perinatal mental health, which have been reviewed elsewhere [ ].Unlike electronic journal databases, app stores are not designed for systematic search and export of data [
]. For instance, there are challenges in removing duplicates directly in app store searches, and search results may be inconsistent given the nature of search algorithms and personalized app content of commercial app stores. Thus, it is challenging to replicate the search strategy reliably [ ]. Currently, no guidelines exist for the conduct and reporting of systematic searches of app stores, but efforts are being made to reach a consensus [ ].Finally, our analysis aimed to analyze apps specifically designed and targeted to the perinatal population. However, our search revealed that there is a plethora of mental health screening, tracking, and interventions that do not specifically target the perinatal population (
). The use of such tools may be helpful in identifying underlying mental health conditions but may not be able to capture dimensions that are specific to the perinatal period. Moreover, cutoffs, specificity, and sensitivity parameters of tools strongly depend on the population used for validation. Thus, the reliability of screening tools in a setting or population different from that in which the tool was developed cannot be guaranteed [ ].Conclusions
This review of apps for perinatal mental health assessment following the MIND framework supports the view that there are gaps in the current app space. As a result, we recommend 3 areas of focus for app developers and clinicians in designing and evaluating apps for perinatal mental health assessments.
First, development of more comprehensive digital screening tools is required. Critically, although the identification of perinatal depression is facilitated by validated questionnaires such as the EPDS, there is less consensus on screening tools for other disorders with significant prevalence, including perinatal anxiety and substance use disorder. Systematic reviews of mental health screening tools [
- ] may be used to inform the development and assessment of digital questionnaires that aim to provide a more comprehensive screening. Formal validation against a gold standard is then required to establish the reliability and accuracy parameters of screening tools in the setting and population of interest.Second, the importance of safety features cannot be overstated. Any developer aiming to design a mental health screening tool should be responsible for keeping PHI safe and providing adequate information about sources of help in case of disclosure of self-harm or suicidality. To this end, following data security statutes and keeping apps up-to-date with geographically relevant sources of help and crisis hotlines represent the very first steps toward a more secure and responsible development of mental health apps.
Third, app developers and clinicians should strive to increase interoperability and data sharing. Digital self-reported screening tools can increase access to mental health support and aid triage only if the user is encouraged to share their screening results with a health care professional. To this end, data sharing must be easy for users and clinicians alike. With only 3 apps of the reviewed apps allowing to export screening results in some form (email or PDF), we believe there exists an opportunity to develop tools that better integrate with current medical records systems. Enhancing data sharing in a secure manner is likely to increase the use of mental health screening apps and contribute to a better therapeutic alliance between app users, developers, and clinicians.
Acknowledgments
This study was funded by the Stanley Medical Research Institute (grant number 07R-1888). We are grateful to perinatal psychiatrist Dr Nikolett Kabacs for the valuable input.
Conflicts of Interest
SB is a director of Psynova Neurotech Ltd and Psyomics Ltd and has financial interests in Psyomics Ltd. The other authors have no conflicts to declare.
PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist.
DOC File , 123 KB
Comparison of authors’ assessment with ratings available in the mHealth Index and Navigation Database sorted by rating category (platform, developer type, etc).
DOC File , 183 KB
Results of the assessment of the included apps (n=14) following the questions (n=107) of the mHealth Index and Navigation Database framework.
XLSX File (Microsoft Excel File), 28 KBReferences
- Shorey S, Chee CY, Ng ED, Chan YH, Tam WW, Chong YS. Prevalence and incidence of postpartum depression among healthy mothers: a systematic review and meta-analysis. J Psychiatr Res 2018 Sep;104:235-248. [CrossRef] [Medline]
- Fawcett EJ, Fairbrother N, Cox ML, White IR, Fawcett JM. The prevalence of anxiety disorders during pregnancy and the postpartum period: a multivariate bayesian meta-analysis. J Clin Psychiatry 2019 Jul 23;80(4):18r12527 [FREE Full text] [CrossRef] [Medline]
- Micali N, Treasure J, Simonoff E. Eating disorders symptoms in pregnancy: a longitudinal study of women with recent and past eating disorders and obesity. J Psychosom Res 2007 Sep;63(3):297-303. [CrossRef] [Medline]
- Egan A, Dunne F. Epidemiology of gestational and pregestational diabetes mellitus. In: Lapolla A, Metzger BE, editors. Gestational Diabetes. A Decade After the HAPO Study. Basel: Karger; 2020:1-10.
- Walani SR. Global burden of preterm birth. Int J Gynaecol Obstet 2020 Jul 10;150(1):31-33. [CrossRef] [Medline]
- Stevens AW, Goossens PJ, van der Klein EA, Draisma S, Honig A, Kupka RW. Risk of recurrence of mood disorders during pregnancy and the impact of medication: a systematic review. J Affect Disord 2019 Apr 15;249:96-103. [CrossRef] [Medline]
- Wesseloo R, Kamperman AM, Munk-Olsen T, Pop VJ, Kushner SA, Bergink V. Risk of postpartum relapse in bipolar disorder and postpartum psychosis: a systematic review and meta-analysis. Am J Psychiatry 2016 Feb 01;173(2):117-127. [CrossRef] [Medline]
- Taylor CL, Broadbent M, Khondoker M, Stewart RJ, Howard LM. Predictors of severe relapse in pregnant women with psychotic or bipolar disorders. J Psychiatr Res 2018 Sep;104:100-107 [FREE Full text] [CrossRef] [Medline]
- Sharma V, Bergink V, Berk M, Chandra PS, Munk-Olsen T, Viguera AC, et al. Childbirth and prevention of bipolar disorder: an opportunity for change. Lancet Psychiatry 2019 Sep;6(9):786-792. [CrossRef] [Medline]
- Jones I, Chandra PS, Dazzan P, Howard LM. Bipolar disorder, affective psychosis, and schizophrenia in pregnancy and the post-partum period. Lancet 2014 Nov 15;384(9956):1789-1799. [CrossRef] [Medline]
- Nonnenmacher N, Noe D, Ehrenthal JC, Reck C. Postpartum bonding: the impact of maternal depression and adult attachment style. Arch Womens Ment Health 2016 Dec;19(5):927-935. [CrossRef] [Medline]
- Hoff CE, Movva N, Vollmar AK, Pérez-Escamilla R. Impact of maternal anxiety on breastfeeding outcomes: a systematic review. Adv Nutr 2019 Sep 01;10(5):816-826 [FREE Full text] [CrossRef] [Medline]
- Figueiredo B, Canário C, Field T. Breastfeeding is negatively affected by prenatal depression and reduces postpartum depression. Psychol Med 2014 Apr;44(5):927-936. [CrossRef] [Medline]
- Bauer A, Parsonage M, Knapp M, Lemmi V, Adelaja B. The costs of perinatal mental health problems. LSE Centre Mental Health. 2014. URL: https://www.centreformentalhealth.org.uk/sites/default/files/2018-09/costsofperinatalsummary.pdf [accessed 2021-12-27]
- The cost of perinatal depression and anxiety in Australia. PwC Consulting Australia. 2019. URL: https://www.perinatalwellbeingcentre.org.au/Handlers/Download.ashx?IDMF=53aab8d3-c748-4818-abab-32a58d3c510f [accessed 2021-12-27]
- Luca DL, Margiotta C, Staatz C, Garlow E, Christensen A, Zivin K. Financial toll of untreated perinatal mood and anxiety disorders among 2017 births in the United States. Am J Public Health 2020 Jun;110(6):888-896. [CrossRef] [Medline]
- Gavin N, Meltzer-Brody S, Glover V, Gaynes B. Is population-based identification of perinatal depression and anxiety desirable?: a public health perspective on the perinatal depression care continuum. In: Identifying Perinatal Depression and Anxiety. Hoboken, New Jersey, United States: John Wiley & Sons; 2014:11-31.
- Ford E, Shakespeare J, Elias F, Ayers S. Recognition and management of perinatal depression and anxiety by general practitioners: a systematic review. Fam Pract 2017 Feb;34(1):11-19. [CrossRef] [Medline]
- Hewitt CE, Gilbody SM. Is it clinically and cost effective to screen for postnatal depression: a systematic review of controlled clinical trials and economic evidence. Br J Obstet Gynaecol 2009 Jul;116(8):1019-1027. [CrossRef] [Medline]
- Smith M, Lawrence V, Sadler E, Easter A. Barriers to accessing mental health services for women with perinatal mental illness: systematic review and meta-synthesis of qualitative studies in the UK. BMJ Open 2019 Jan 24;9(1):e024803 [FREE Full text] [CrossRef] [Medline]
- Bayrampour H, Hapsari AP, Pavlovic J. Barriers to addressing perinatal mental health issues in midwifery settings. Midwifery 2018 Apr;59:47-58. [CrossRef] [Medline]
- mHealth economics 2016 - current status and trends of the mHealth app market. Research 2 Guidance. 2016. URL: https://research2guidance.com/product/mhealth-app-developer-economics-2016/ [accessed 2021-02-23]
- Osma J, Barrera AZ, Ramphos E. Are pregnant and postpartum women interested in health-related apps? Implications for the prevention of perinatal depression. Cyberpsychol Behav Soc Netw 2016 Jun;19(6):412-415. [CrossRef] [Medline]
- Hussain-Shamsy N, Shah A, Vigod SN, Zaheer J, Seto E. Mobile health for perinatal depression and anxiety: scoping review. J Med Internet Res 2020 Apr 13;22(4):e17011 [FREE Full text] [CrossRef] [Medline]
- Sprenger M, Mettler T, Osma J. Health professionals' perspective on the promotion of e-mental health apps in the context of maternal depression. PLoS One 2017;12(7):e0180867 [FREE Full text] [CrossRef] [Medline]
- Martin-Key NA, Spadaro B, Schei TS, Bahn S. Proof-of-concept support for the development and implementation of a digital assessment for perinatal mental health: mixed methods study. J Med Internet Res 2021 Jun 04;23(6):e27132 [FREE Full text] [CrossRef] [Medline]
- Osborne LM, Kimmel MC, Surkan PJ. The crisis of perinatal mental health in the age of Covid-19. Matern Child Health J 2021 Mar;25(3):349-352 [FREE Full text] [CrossRef] [Medline]
- Examples of alternate or reduced prenatal care schedules. American College of Obstetrics and Gynecology. 2020. URL: https://www.acog.org/clinical-information/physician-faqs/-/media/287cefdb936e4cda99a683d3cd56dca1.ashx [accessed 2021-12-27]
- Kimmel M. Maternal mental health matters. N C Med J 2020;81(1):45-50 [FREE Full text] [CrossRef] [Medline]
- Torous J, Myrick K, Rauseo-Ricupero N, Firth J. Digital mental health and COVID-19: using technology today to accelerate the curve on access and quality tomorrow. JMIR Ment Health 2020 Mar 26;7(3):e18848 [FREE Full text] [CrossRef] [Medline]
- Chandrashekar P. Do mental health mobile apps work: evidence and recommendations for designing high-efficacy mental health mobile apps. Mhealth 2018;4:6 [FREE Full text] [CrossRef] [Medline]
- Powell AC, Torous J, Chan S, Raynor GS, Shwarts E, Shanahan M, et al. Interrater reliability of mHealth app rating measures: analysis of top depression and smoking cessation apps. JMIR Mhealth Uhealth 2016;4(1):e15 [FREE Full text] [CrossRef] [Medline]
- Yasini M, Marchand G. Toward a use case based classification of mobile health applications. Stud Health Technol Inform 2015;210:175-179. [Medline]
- Carpenter-Song E, Noel VA, Acquilano SC, Drake RE. Real-world technology use among people with mental illnesses: qualitative study. JMIR Ment Health 2018 Nov 23;5(4):e10652 [FREE Full text] [CrossRef] [Medline]
- Hollis C, Sampson S, Simons L, Davies EB, Churchill R, Betton V, et al. Identifying research priorities for digital technology in mental health care: results of the James Lind Alliance Priority Setting Partnership. Lancet Psychiatry 2018 Oct;5(10):845-854. [CrossRef] [Medline]
- Lagan S, Aquino P, Emerson MR, Fortuna K, Walker R, Torous J. Actionable health app evaluation: translating expert frameworks into objective metrics. NPJ Digit Med 2020;3:100 [FREE Full text] [CrossRef] [Medline]
- Lagan S, Sandler L, Torous J. Evaluating evaluation frameworks: a scoping review of frameworks for assessing health apps. BMJ Open 2021 Mar 19;11(3):e047001 [FREE Full text] [CrossRef] [Medline]
- The app evaluation model. American Psychiatric Association. URL: https://www.psychiatry.org/psychiatrists/practice/mental-health-apps/the-app-evaluation-model [accessed 2021-12-27]
- Henson P, David G, Albright K, Torous J. Deriving a practical framework for the evaluation of health apps. Lancet Digit Health 2019 Jun;1(2):52-54 [FREE Full text] [CrossRef] [Medline]
- Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med 2018 Oct 02;169(7):467-473. [CrossRef] [Medline]
- Automatic Readability Checker, a free readability formula consensus calculator. Readability Formulas. URL: https://readabilityformulas.com/free-readability-formula-tests.php [accessed 2021-12-27]
- Flesch R. A new readability yardstick. J Appl Psychol 1948 Jun;32(3):221-233. [CrossRef] [Medline]
- M-health Index and Navigation Database (MIND). URL: https://apps.digitalpsych.org/ [accessed 2021-12-27]
- Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. Br J Psychiatry 1987 Jun;150:782-786. [CrossRef] [Medline]
- Kroenke K, Strine TW, Spitzer RL, Williams JB, Berry JT, Mokdad AH. The PHQ-8 as a measure of current depression in the general population. J Affect Disord 2009 Apr;114(1-3):163-173. [CrossRef] [Medline]
- Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006 May 22;166(10):1092-1097. [CrossRef] [Medline]
- Bastien CH, Vallières A, Morin CM. Validation of the Insomnia Severity Index as an outcome measure for insomnia research. Sleep Med 2001 Jul;2(4):297-307. [CrossRef] [Medline]
- Morin CM, Belleville G, Bélanger L, Ivers H. The Insomnia Severity Index: psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep 2011 May 01;34(5):601-608 [FREE Full text] [CrossRef] [Medline]
- Hewitt PL, Flett GL, Mosher SW. The Perceived Stress Scale: factor structure and relation to depression symptoms in a psychiatric sample. J Psychopathol Behav Assess 1992 Sep;14(3):247-257. [CrossRef]
- Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59 Suppl 20:22-34. [Medline]
- Dyurich A, Oliver M. Use of the veedamom electronic app as a pregnancy treatment companion. J Feminist Fam Ther 2020 Jul 17;32(1-2):38-56. [CrossRef]
- Chaudron LH, Wisner KL. Perinatal depression screening: let's not throw the baby out with the bath water!. J Psychosom Res 2014 Jun;76(6):489-491. [CrossRef] [Medline]
- Gemmill AW. The long gestation of screening programmes for perinatal depressive disorders. J Psychosom Res 2014 Sep;77(3):242-243. [CrossRef] [Medline]
- Thombs BD, Saadat N, Riehm KE, Karter JM, Vaswani A, Andrews BK, et al. Consistency and sources of divergence in recommendations on screening with questionnaires for presently experienced health problems or symptoms: a comparison of recommendations from the Canadian Task Force on Preventive Health Care, UK National Screening Committee, and US Preventive Services Task Force. BMC Med 2017 Aug 09;15(1):150 [FREE Full text] [CrossRef] [Medline]
- Hamel C, Lang E, Morissette K, Beck A, Stevens A, Skidmore B, et al. Screening for depression in women during pregnancy or the first year postpartum and in the general adult population: a protocol for two systematic reviews to update a guideline of the Canadian Task Force on Preventive Health Care. Syst Rev 2019 Jan 19;8(1):27 [FREE Full text] [CrossRef] [Medline]
- Byatt N, Xu W, Levin LL, Simas TA. Perinatal depression care pathway for obstetric settings. Int Rev Psychiatry 2019 May;31(3):210-228. [CrossRef] [Medline]
- Lebel C, MacKinnon A, Bagshawe M, Tomfohr-Madsen L, Giesbrecht G. Elevated depression and anxiety symptoms among pregnant individuals during the COVID-19 pandemic. J Affect Disord 2020 Dec 01;277:5-13 [FREE Full text] [CrossRef] [Medline]
- Poon LC, Yang H, Kapur A, Melamed N, Dao B, Divakar H, et al. Global interim guidance on coronavirus disease 2019 (COVID-19) during pregnancy and puerperium from FIGO and allied partners: information for healthcare professionals. Int J Gynaecol Obstet 2020 Jun;149(3):273-286. [CrossRef] [Medline]
- Melcher J, Torous J. Smartphone apps for college mental health: a concern for privacy and quality of current offerings. Psychiatr Serv 2020 Nov 01;71(11):1114-1119. [CrossRef] [Medline]
- Mordecai D, Histon T, Neuwirth E, Heisler WS, Kraft A, Bang Y, et al. How Kaiser permanente created a mental health and wellness digital ecosystem. NEJM Catalyst 2021 Jan;2(1). [CrossRef]
- Lagan BM, Sinclair M, Kernohan WG. Internet use in pregnancy informs women's decision making: a web-based survey. Birth 2010 Jun;37(2):106-115. [CrossRef] [Medline]
- Kingston D, Biringer A, van Zanten S, Giallo R, McDonald S, MacQueen G, et al. Pregnant women's perceptions of the risks and benefits of disclosure during web-based mental health e-screening versus paper-based screening: randomized controlled trial. JMIR Ment Health 2017 Oct 20;4(4):e42 [FREE Full text] [CrossRef] [Medline]
- Yapp E, Howard LM, Kadicheeni M, Telesia LA, Milgrom J, Trevillion K. A qualitative study of women's views on the acceptability of being asked about mental health problems at antenatal booking appointments. Midwifery 2019 Jul;74:126-133. [CrossRef] [Medline]
- Feldman N, Back D, Boland R, Torous J. A systematic review of mHealth application interventions for peripartum mood disorders: trends and evidence in academia and industry. Arch Womens Ment Health 2021 Apr 30:1-12 [FREE Full text] [CrossRef] [Medline]
- Mazzoni SE, Bott NL, Hoffman MC. Screening for perinatal anxiety. Am J Obstet Gynecol 2021 Jun;224(6):628-629. [CrossRef] [Medline]
- Anderson J, Michalak E, Lam R. Depression in primary care: tools for screening, diagnosis, and measuring response to treatment. BC Med J 2002;44(8):415-419 [FREE Full text]
- Krumay B, Klar J. Readability of privacy policies. In: Singhal A, Vaidya J, editors. Data and Applications Security and Privacy. Cham: Springer; 2020:388-399.
- Highet N, Gamble J, Creedy D. Perinatal mental health and psychosocial risk screening in a community maternal and child health setting: evaluation of a digital platform. Prim Health Care Res Dev 2018 May 18;20:1-7. [CrossRef]
- Grundy QH, Wang Z, Bero LA. Challenges in assessing mobile health app quality: a systematic review of prevalent and innovative methods. Am J Prev Med 2016 Dec;51(6):1051-1059. [CrossRef] [Medline]
- Grainger R, Devan H, Sangelaji B, Hay-Smith J. Issues in reporting of systematic review methods in health app-focused reviews: a scoping review. Health Informatics J 2020 Sep 11:2930-2945 [FREE Full text] [CrossRef] [Medline]
- Fellmeth G, Harrison S, Opondo C, Nair M, Kurinczuk JJ, Alderdice F. Validated screening tools to identify common mental disorders in perinatal and postpartum women in India: a systematic review and meta-analysis. BMC Psychiatry 2021 Apr 20;21(1):200 [FREE Full text] [CrossRef] [Medline]
- Sinesi A, Maxwell M, O'Carroll R, Cheyne H. Anxiety scales used in pregnancy: systematic review. BJPsych Open 2019 Jan;5(1):e5 [FREE Full text] [CrossRef] [Medline]
- Levis B, Negeri Z, Sun Y, Benedetti A, Thombs BD, DEPRESsion Screening Data (DEPRESSD) EPDS Group. Accuracy of the Edinburgh Postnatal Depression Scale (EPDS) for screening to detect major depression among pregnant and postpartum women: systematic review and meta-analysis of individual participant data. Br Med J 2020 Nov 11;371:m4022 [FREE Full text] [CrossRef] [Medline]
- Pritchett R, Kemp J, Wilson P, Minnis H, Bryce G, Gillberg C. Quick, simple measures of family relationships for use in clinical practice and research. A systematic review. Fam Pract 2011 Apr;28(2):172-187. [CrossRef] [Medline]
Abbreviations
APA: American Psychiatric Association |
EPDS: Edinburgh Postnatal Depression Scale |
MIND: mHealth Index and Navigation Database |
PHI: personal health information |
PRISMA-ScR: Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews |
PTSD: posttraumatic stress disorder |
Edited by L Buis; submitted 26.05.21; peer-reviewed by N Feldman, B Chaudhry, N Hussain-Shamsy; comments to author 01.08.21; revised version received 06.09.21; accepted 19.11.21; published 17.01.22
Copyright©Benedetta Spadaro, Nayra A Martin-Key, Erin Funnell, Sabine Bahn. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 17.01.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.