Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, March 11, 2019 at 4:00 PM to 4:30 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 03.11.19 in Vol 7, No 11 (2019): November

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/15648, first published Jul 25, 2019.

This paper is in the following e-collection/theme issue:

    Original Paper

    Characteristics and Usage Patterns Among 12,151 Paid Subscribers of the Calm Meditation App: Cross-Sectional Survey

    1College of Health Solutions, Arizona State University, Phoenix, AZ, United States

    2Integrated Brain Health Clinical and Research Program, Massachusetts General Hospital, Boston, MA, United States

    3Harvard Medical School, Boston, MA, United States

    4Department of Psychology, Ryerson University, Toronto, ON, Canada

    5Mindworks, LLC, Manhattan Beach, CA, United States

    6Behavioral Research and Analytics, LLC, Salt Lake City, UT, United States

    Corresponding Author:

    Jennifer Huberty, PhD

    College of Health Solutions

    Arizona State University

    550 3rd St

    Phoenix, AZ, 85004

    United States

    Phone: 1 6028272456

    Email: jhuberty@asu.edu


    ABSTRACT

    Background: Meditation has become increasingly popular due to its health benefits; however, barriers to delivering meditation programs in traditional group-based formats limit the accessibility of these benefits. Smartphone-based meditation may increase the availability of these programs to larger, more diverse audiences; however, research on subscriber characteristics and usage patterns in meditation mobile apps is lacking.

    Objective: This study aimed to describe the demographics, clinical characteristics, and usage patterns of a convenience sample of Calm subscribers and explore the relationship between self-reported app usage and changes in health, stress, and sleep.

    Methods: Participants were 12,151 paying Calm subscribers (response rate=12.08%, 12,151/100,594) who completed an anonymous Web-based survey with 11 quantitative questions related to user engagement, reasons for starting Calm, and changes after using the app. Demographic characteristics, chronic health diagnoses, and sleep difficulties were also assessed. Chi-square tests were used to examine differences in app usage. Logistic regression models were used to examine demographic and health characteristics that may predict changes in health, stress, and sleep.

    Results: Respondents were 18-96 years old (mean 48.57 [SD 13.79]), primarily female (79.94%, 8778/10,981), white (81.41%, 8959/11,005), and most reported a chronic health diagnosis (56.86%, 6289/11,061). Mental health diagnoses (41.13%, 4549/11,061) were more common than physical health diagnoses (32.19%, 3560/11,061). Most respondents (76.31%, 8684/11,360) reported difficulties falling or staying asleep. On average, respondents had been using Calm for 11.49 months (SD 10.49), and 60.03% (7281/12,129) used it 5 or more times per week. Meditations (used by 80.02%, 9497/11,841) and Sleep Stories (55.66%, 6591/11,841) were the most popular components. The frequency of using Calm was associated with incremental increases in the likelihood of noticing changes in mental health (χ22=136.8; P<.001), physical health (χ22=102.8; P<.001), stress (χ22=128.1; P<.001), and sleep (χ22=141.4; P<.001). Respondents who had used Calm longer were also more likely to notice changes in mental health (OR 1.06 [95% CI 1.05 to 1.06]), physical health (OR 1.01 [95% CI 1.01 to 1.02]), stress (OR 1.04 [95% CI 1.04 to 1.05]), and sleep (OR 1.004 [95% CI 1.00 to 1.01]). Subscribers with sleep difficulties used Calm more frequently (χ82=11.5; P=.003), were more likely to use Sleep Stories (χ12=1590.2; P<.001), and were more likely to notice changes in their physical health (χ12=49.2; P<.001) and sleep (χ12=2391.1; P<.001).

    Conclusions: Results highlight important demographic characteristics and usage patterns among a self-selected sample of Calm subscribers. Mental health concerns and sleep appear to be top reasons for downloading Calm. Sleep Stories and meditations are the most popular app components. The frequency of using Calm was associated with incremental changes in outcomes. Findings support future randomized controlled trials testing the efficacy of Calm for health, stress, and sleep. Studies should also explore strategies to attract a more diverse sample of subscribers.

    JMIR Mhealth Uhealth 2019;7(11):e15648

    doi:10.2196/15648

    KEYWORDS



    Introduction

    Meditation Benefits

    Meditation is a technique for resting the mind and attaining a state of consciousness that is different from the waking state [1]. Mindfulness meditation is the process of openly attending, with nonjudgmental awareness, to one’s present moment experience [2]. Over the last 30 years, mindfulness meditation has become increasingly popular in Western society owing to its documented mental and physical health benefits [3]. Mindfulness meditation has been linked to reductions in depressive symptoms, stress, anxiety [4,5], and improved sleep [6], through biopsychosocial mechanisms such as alterations in brain structure, improved attention, increased emotional regulation, and better immune function [4]. Given these benefits, mindfulness meditation has been incorporated routinely in psychotherapy, school-based programs, corporate settings, prisons, and military and is an important part of hospital preventative or disease management programs [3].

    Meditation Accessibility

    Although the evidence for the use of mindfulness meditation is slowly growing, there are multiple barriers to its delivery in traditional group-based formats [7], thus limiting its reach and its potential to be used by individuals seeking to manage mood, stress, or symptoms of a chronic illness. First, participation requires people to travel to a public location with a trained meditation instructor at a specific time of day [5]. This is often not feasible for individuals with diagnoses such as depression, anxiety, or posttraumatic stress for whom attrition rates are as high as 50% [7,8]. Caregivers, parents, and individuals with multiple responsibilities and high stress have busy schedules and may not be able to prioritize lengthy (eg, 60-90 min) weekly classes for extended period [7]. Individuals who live in rural areas or those with chronic disease may find travel to clinics for meditation sessions burdensome [9-11]. To overcome these barriers to participation, we need novel methods to deliver mindfulness meditation.

    Meditation and Smartphone Apps

    Smartphone apps may be an effective way to deliver mindfulness meditation to geographically diverse and dispersed individuals that bypasses barriers associated with the traditional format of mindfulness meditation programs [5]. Meditation delivered on a smartphone app may retain the elements of traditional meditation programs (ie, a trained instructor delivering high-quality meditation), while allowing participants to tailor the type and length of meditations, use behavioral components to increase adherence (eg, trackers, reminders, and social support communities), and choose when and where to engage with the app. Furthermore, there is relatively less cost associated with meditation delivered on an app. Approximately 81% of US adults report having a smartphone [12] and, around the world, smartphone usage is rapidly increasing [13]. In a cross-sectional survey of 1604 mobile phone users in the United States, 58% had downloaded a health-related mobile app that they used daily.

    Despite their promise, the growing popularity of mindfulness-based apps, and efforts that are currently being made to evaluate and improve the science behind these apps, knowledge gaps remain [14]. To date, efficacy studies have had small samples, inadequate control groups, and short follow-up periods [5,15]. More importantly, data related to usage patterns of mindfulness meditation apps, demographics, clinical characteristics of users, reasons for downloading health apps, barriers to use, and consistency of use are lacking [16]. Furthermore, we do not know which personal characteristics predispose one to benefit more from specific app content [14]; this information is pivotal to building content and determining the app’s effects. Unfortunately, app developers do not publish information on their users or the extent to which consumers continue to use apps over time [14]. When reports are available to nonindustry audiences, they are accompanied by fees, making them less accessible to the general public and researchers.

    Study Aims

    The aim of this study was 2-fold. First, we reported demographics, clinical characteristics, and usage patterns in a self-selected sample of paying Calm subscribers. Second, we explored the relationship between the self-reported frequency of Calm use and the app’s individual components with self-reported changes in health (mental and physical), stress, and sleep. We hypothesized that subscribers who use Calm more frequently will be more likely to report changes in their health, stress, and sleep.


    Methods

    Ethics Approval

    The Institutional Review Board at Arizona State University (STUDY00009725) approved the study. All participants provided electronic consent before participating in the survey. The datasets generated or analyzed during the study are available from the corresponding author upon request.

    Study Design/Recruitment

    This study was cross-sectional. Participants were paying subscribers to the mobile app, Calm (see Multimedia Appendix 1 for screenshots). We used the mobile app, Calm, owing to its popularity. According to a 2015 systematic review of mindfulness apps, there are a total of 700 apps in Apple and Google Play app stores [17]. Calm was the number 1 downloaded health and fitness app between June 2018 and 2019 [18]. In an August 2019 review, CNET (a top website for technology news and editorials) confirmed that Calm was among the most highly rated meditation apps in the Apple and Google Play app stores (all above 4 stars) [19].

    Calm guides users through mindfulness meditation. The 7 Days of Calm (ie, introductory course) introduces the user to mindfulness meditation and provides education about beginning a meditation practice. Users receive a new 10-min daily meditation (ie, The Daily Calm) and have access to a variety of meditation content (eg, reducing anxiety and depression, increasing compassion and gratitude) that ranges from 3 to 35 min. Calm offers a variety of meditations for sleep similar to other mindfulness-based apps [20]; however, unlike other apps, Calm offers Sleep Stories. Sleep Stories are narrated fictional stories using traditional storytelling methods, helping to immerse the user in their senses to improve sleep. Other content that Calm offers includes Calm Breathe (breathing training exercises), Calm Music (relaxing, soothing music and nature sounds), Calm Masterclass (monthly series of in-depth audio classes, delivered by experts that teach skills to deal with common stressors and improve well-being), and Calm Body (video lessons on slow, mindful movement routines). Calm also offers a variety of theory-based behavioral strategies to help the user be successful at regular participation including reminders to meditate, ability to track time spent meditating, and opportunities to share progress on social media.

    Participants were recruited in April 2019. Calm subscribers were eligible if they were at least 18 years of age, their subscription expiration was at least two months away, they had opened at least two emails from Calm in the last 30 days, and they had completed at least two Calm sessions in the last 30 days.

    Subscribers received an email inviting them to answer a series of quantitative and qualitative questions related to their usage of Calm and were informed that their answers would help improve their experience with the app, and results of this study may be used in reports, presentations, or publications. Approximately, 4744 subscribers were contacted on April 9, 54,193 were contacted on April 10, and 41,657 were contacted on April 11. Of the 100,594 subscribers who were contacted, 12,151 (12.08%, 12,151/100,594) participated in the survey. At the end of the survey, participants had the option of providing an email address to be contacted for future studies or to be entered into a draw to win 1 of 2 US $99 Amazon gift cards. No other identifying information was collected, and responses were not linked to in-app usage data.

    Survey

    The survey was developed by 3 doctoral-level researchers/clinicians in the field of behavior change, complementary approaches, and sleep. The survey was Web-based (delivered using Qualtrics) and took most participants between 5 and 10 min to complete (median=6.9; interquartile range=5.7). All responses were anonymous. Participants completed 11 multiple choice quantitative questions (not including demographics) about (1) their engagement with the Calm app (4 questions), (2) why they started using Calm (1 question), (3) clinical characteristics at the time they downloaded the app (2 questions), (4) their connections with other Calm users (3 questions), and (5) whether they noticed changes in their mental health, physical health, stress, or sleep after using Calm (1 yes or no question, separated into 4 subquestions about mental and physical health, stress, and sleep; Textbox 1). Questions varied slightly based on answers to frequency of use (see Multimedia Appendix 2 for all quantitative/multiple choice questions). At the end of the survey, participants completed 4 questions about demographic characteristics. Although the survey included 3 additional open-ended questions, the scope of this paper was limited to discussion of findings from the quantitative data; qualitative analyses will be included in future publications.


    Textbox 1. App usage questions from the Calm user survey.
    View this box

    Statistical Analysis

    Data were analyzed using IBM SPSS 25.0. All variables were categorical, with the exception of age. For questions about health diagnoses, sleep difficulties, reasons for starting Calm, the components of Calm used, and tools used to support engagement, participants were able to endorse multiple items from a list of options; selected options were treated as endorsements (eg, used meditations), and unselected options were treated as nonendorsements (eg, did not use meditations). As not all participants answered every question, sample sizes differed across analyses. Usage frequency was categorized as ordinal, reflecting use of the app or component of the app as nonendorsed, 1 to 2 times per week, 3 to 4 times per week, or 5 or more times per week. Variables for noticing changes in health, stress, and sleep were dichotomous.

    Chi-square tests were used to evaluate differences in the use of tools for engagement and frequency of using Calm. To examine the relationships between demographic characteristics and the frequency of using Calm and its components, and we used chi-square tests (sex differences) and binomial logistic regressions (age). Differences in the frequency of using Sleep Stories were further explored using ordinal logistic regressions controlling for sleep difficulties. Chi-square tests were used to analyze differences in the frequency of using Calm and the components of Calm used based on health diagnoses and sleep difficulties. We also used chi-square tests to investigate the relationship between the frequency of using Calm and noticing changes in health, stress, sleep and the relationship between sleep difficulties and noticing changes in health, stress, and sleep. In all cases, significant chi-square tests were followed up with z tests of column proportions. P values were adjusted for multiple comparisons using the Bonferroni correction.


    Results

    Demographic Characteristics

    A total of 12,151 subscribers participated in the survey. Sample demographics are presented in Table 1.

    Table 1. Demographics of Calm subscribers (N=12,151).
    View this table

    Clinical Characteristics

    More than half (56.86%, 6289/11,061) of respondents had a chronic health diagnosis. Mental health diagnoses (ie, depression, anxiety, or posttraumatic stress disorder; 41.13%, 4549/11,061) were more common than physical health diagnoses (ie, high blood pressure, pain, high cholesterol, asthma, arthritis, cancer, heart disease, emphysema or chronic obstructive pulmonary disease, or other lung disease; 32.19%, 3560/11,061). The most commonly reported mental health diagnosis was anxiety (33.22%, 3675/11,061), and the most common physical health diagnosis was high blood pressure (12.68%, 1402/11,061; Table 2).

    Most respondents (76.49%, 8704/11,380) reported sleep difficulties (ie, difficultly falling or staying asleep; Table 3), and 13.90% (1537/11,061) reported insomnia diagnoses (Table 2). Sleep difficulties were significantly more common in females (80.09%, 7009/8751) than in males (61.77%, 1336/2163; χ21=355.9; P<.001).

    Table 2. Self-reported mental and physical health diagnoses in Calm subscribers (N=11,061).
    View this table
    Table 3. Self-reported sleep difficulties in Calm subscribers (N=11,380).
    View this table

    Usage Patterns

    The most common reasons for starting to use Calm were to improve sleep (62.97%, 7475/11,870) and to improve stress (62.11%, 7373/11,870), followed by reducing depression or anxiety (54.47%, 6465/11,870) and improving overall health (40.05%, 4754/11,870; see Multimedia Appendix 3 for less frequently reported reasons).

    Overall Usage of Calm and Its Components

    Respondents had been using Calm for an average of 11.49 months (SD 10.49), with 55.89% (6042/10,810) having used the app for less than 1 year. Most of them used Calm 5 or more times per week (60.03%, 7281/12,129), with 27.45% (3330/12,129) using 3 to 4 times per week and 12.52% (1518/12,129) using 1 to 2 times per week. Meditations were the most popular components (80.20%, 9497/11,841), followed by Sleep Stories (55.66%, 6591/11,841; see Multimedia Appendix 4 for usage of less popular components).

    Approximately, half (51.09%, 6111/11,962) of respondents used at least one tool to help, motivate, or encourage themselves to use Calm. Tracking (36.62%, 4380/11,962) and reminders (15.81%, 1891/11,962) were the most common tools. The least common tools were the Calm Facebook community (3.33%, 398/11,962) and sharing app usage on social media (2.40%, 287/11,962).

    Low-frequency users (ie, using Calm 1 or 2 times per week) were significantly more likely to use the reminders (χ21=84.2; P<.001), whereas high-frequency users (ie, using Calm at least three times per week) were more likely to use meditation tracking (χ21=56.2; P<.001) and the Calm Facebook community (χ21=7.5; P=.01). When asked what encouraged or motivated high-frequency users to use the app, 42.34% (4493/10,611) reported that they used Calm before bed, and 53.33% (5659/10,611) were committed to using Calm.

    A total of 40% (4500/11,249) of respondents had friends or family members that also used Calm, and, of those, 75.00% (3375/4500) talked with their friends or family about using the app. However, when participants in the overall sample were asked whether they would like to be connected with other Calm users, 81.59% (9178/11,249) declined. Respondents with mental health diagnoses were significantly more likely to want to connect with other Calm users (22.37%, 961/4295) than those without mental health diagnoses (15.24%, 1051/6895; χ21=91.3; P<.001). Desire to connect with other Calm users was not related to physical health diagnoses (18.35%, 622/3390 vs 17.82%, 1390/7800 without; χ21=0.4; P=.50).

    Differences in Usage by Demographics

    There were no significant gender differences in how often respondents used Calm (χ22=4.3; P=.12). Males were significantly more likely to use meditations (88.38%, 1924/2177) than females (77.87%, 6835/8778; χ21=120.3; P<.001), whereas females (60.42%, 5304/8778) were more likely to use Sleep Stories than males (35.42%, 771/2177; χ21=441.6; P<.001). Females also used Sleep Stories more frequently, even when controlling for sleep difficulties (OR 0.56 [95% CI 0.49 to 0.63]; P<.001). Older users tended to use the app more frequently (OR 1.02 [95% CI 1.01 to 1.02]) and were more likely to use Sleep Stories (OR 1.01 [95% CI 1.0106 to 1.011]); younger respondents were more likely to use meditations (OR 0.99 [95% CI 0.98 to 0.99]).

    Calm Usage Based on Health Diagnoses

    Participants were separated into 4 groups based on diagnoses when they downloaded Calm: (1) mental health diagnoses only (ie, no comorbid physical health diagnoses), (2) physical health diagnoses only (ie, no comorbid mental health diagnoses), (3) both physical and mental health diagnoses, and (4) no chronic health diagnoses (Table 4).

    Respondents with physical health diagnoses only or with both mental and physical health diagnoses used Calm more frequently (ie, 5 or more times per week) than respondents with only mental health diagnoses or with no chronic health diagnoses (χ26=77.3; P<.001; Table 5). Respondents with only mental health diagnoses were most likely to use meditations, followed by those with no chronic health diagnoses (χ23=38.9; P<.001); conversely, those with no chronic health diagnoses were least likely to use Sleep Stories, whereas those with physical health and mental health diagnoses were most likely to use Sleep Stories (χ23=52.0; P<.001).

    Subscribers with sleep difficulties used Calm more frequently (ie, 5 or more times per week; χ28=11.5; P=.003) and were significantly more likely to use Sleep Stories (χ21=1590.2; P<.001; Table 6). Those without sleep difficulties were more likely to use meditations (χ21=273.2; P<.001).

    Table 4. Types of self-reported health diagnoses in Calm subscribers (N=11,061).
    View this table
    Table 5. Differences in the frequency of using Calm based on health diagnoses (N=11,061).
    View this table
    Table 6. Differences in the frequency of using Calm, frequency of using meditations and Sleep Stories, and reasons for starting to use Calm based on reported sleep difficulties (N=11,360).
    View this table
    Relationship Between Frequency of Calm Use and Noticing Changes in Health, Stress, and Sleep

    The frequency of using Calm was associated with incremental increases in the likelihood of noticing changes in mental health (χ22=136.8; P<.001), physical health (χ22=102.8; P<.001), stress (χ22=128.1; P<.001), and sleep (χ22=141.4; P<.001; Table 7). In addition, participants who had been using Calm longer were more likely to notice changes in mental health (OR 1.06 [95% CI 1.05 to 1.06]; P<.001), physical health (OR 1.01 [95% CI 1.01 to 1.02]; P<.001), stress (OR 1.04 [95% CI 1.04 to 1.05]; P<.001), and sleep (OR 1.004 [95% CI 1.00 to 1.01]; P=.03).

    Table 7. Differences in noticing changes in mental health, physical health, stress, and sleep based on frequency of using Calm.
    View this table

    Frequency of using meditations was associated with significant, incremental increases in the percentage of respondents who noticed changes in their physical health (χ23=130.9; P<.001), mental health (χ23=1325.0; P<.001), and stress (χ23=1100.5; P<.001; Table 7). The frequency of using meditation was not associated with changes in sleep (OR 1.04 [95% CI 0.99 to 1.01]; P=.12) after controlling for sleep difficulties.

    Frequency of using Sleep Stories was associated with significant, incremental increases in the percentage of respondents who noticed changes in their sleep (χ23=1665.3; P<.001; Table 7), and respondents who used Sleep Stories 5 or more times per week were significantly more likely to notice changes in physical health (χ23=27.2; P<.001). However, there were significant negative associations between the frequency of using Sleep Stories and noticing changes in mental health (χ23=197.3; P<.001) and stress (χ23=199.0; P<.001). Specifically, Sleep Stories users were less likely to notice changes in their mental health and stress, and low-frequency users (ie, 1-2 times per week) were more likely to notice changes in mental health and stress than more frequent users; see Multimedia Appendix 5 for changes associated with other Calm components.

    Relationship Between Sleep Difficulties and Noticing Changes in Health, Stress, and Sleep

    Respondents with sleep difficulties were more likely to notice changes in their physical health (χ21=49.2; P<.001) and sleep (χ21=2391.1; P<.001) after using Calm (Table 8), whereas those without sleep difficulties were more likely to notice changes in their mental health (χ21=33.1; P<.001) and stress (χ21=17.0; P<.001).

    Table 8. Differences in noticing changes in mental health, physical health, stress, and sleep based on reported sleep difficulties (N=11,131).
    View this table

    Discussion

    Summary

    The aim of this paper was to report demographic characteristics, clinical characteristics, and usage patterns in a self-selected sample of paying subscribers of a consumer-based mobile app (ie, Calm). In addition, we explored the relationship between self-reported frequency of using Calm and its components and noticing changes in health (mental and physical), stress, and sleep disturbance. This is the first paper to report the characteristics of Calm subscribers in addition to the relationship between Calm use and reported changes in health, stress, and sleep.

    Respondents were mostly white and mostly female. More than half reported a mental or physical health diagnosis, and approximately three-fourth reported sleep difficulties. The most common reason for starting to use Calm was for sleep, followed by stress and depression. Most respondents used Calm 5 or more times per week.

    Meditations and Sleep Stories were the most commonly used components. It is not surprising that meditation was the most frequently used Calm component as Americans are more consistently including meditation as part of their lifestyle [21]. Meditation is the fifth most common type of complementary approach to health practiced by adults [22]. In addition, Calm was originally marketed as a mindfulness meditation app, and after many iterations and changes to the app over time, it now offers added components such as Sleep Stories.

    Gender Differences

    Even though our sample was mostly women, men were slightly more likely to use meditation. Historically, women report higher use of meditation when compared with men. In a 2019 analysis of 2012 data from the National Health Interview Survey [21], 5.7 million men reported using meditation as compared with 12.2 million women. Both men and women reported meditation being helpful to reduce stress. In future studies, it would be interesting to know why men use the meditations more than the many other components of the app. This information may impact the way in which consumer-based meditation apps consider marketing content based on gender. For example, advertising Calm with pictures of men meditating may help to encourage men to subscribe to the app.

    Women were more likely than men to use the Sleep Stories. This may be partially attributed to women reporting higher levels of sleep difficulties. It is well known that women have a higher frequency of sleep disturbance as compared with men owing to hormonal changes over the life span [23]. Sleep meditations may represent a manageable, nonpharmacological strategy for women (and men) to improve sleep. However, further analyses suggest that sleep difficulties do not fully account for women’s more frequent use of Sleep Stories. Future research using surveys and qualitative data from consumers (both men and women) about what they specifically enjoy about the Sleep Stories would be useful information for future content development, consumer engagement, and clinical trials.

    Tools for Engagement

    Tracking and reminders were the most common in-app tools used to support engagement, and using the app at bedtime (using Calm at bedtime) appeared to be the most effective adherence strategy to maintain engagement with the app over time. Research on the efficacy of mobile apps in impacting behavior shows that tracking behavior and feedback are among the most successful strategies for behavior change [24]. Tracking is also one of the most popular technology strategies used by mobile apps for health and wellness [25]. Almost 40% of our sample reported using tracking as a tool to help them continue to engage in using Calm. Currently, Calm tracks how many sessions and minutes the user has participated in over time. Recent evidence suggests that tracking plus feedback may be more impactful for improvements in behavior change as compared with tracking alone [26-28]. For example, in a randomized clinical trial testing the effects of an automated tracking-texting intervention on physical activity (mActive), coupling text messages containing automated personalized feedback with physical activity tracking led to twice as many participants achieving their daily step goal as compared with other groups [26]. Providing the subscriber feedback, based on the use of the app, could thus be an effective strategy for consumer-based mindfulness meditation apps to keep subscribers engaged once they sign up as a paying member. In addition, finding other ways to track and provide feedback outside of sessions and minutes of meditation could provide more value to a meditation app. For example, the users’ perception of their stress, mindfulness, or happiness after a session could be tracked in conjunction with patterns of use. Providing this information as feedback would allow users to observe the relationship between using Calm and changes in their moods, thoughts, and behaviors. Future research in this area is warranted.

    When we asked those who engaged in the app more often (more than 3 times per week) precisely how they stay engaged, many reported that using Calm at bedtime (eg, Sleep Stories, Daily Calm, and other sleep meditations) contributed to adherence. It is well known that there are barriers to beginning and maintaining health behaviors (eg, physical activity, diet, and meditation) [29]. However, using Calm (and other mindfulness-based apps) at bedtime/for sleep may have fewer barriers (eg, time and motivation) than participating in another health behavior. For example, Calm Sleep Stories require the user to begin the Sleep Story by lying in bed and assuming a comfortable position with the goal of helping the user to fall asleep. This does not require added time or motivation (beyond starting the Sleep Story) and may be an easier task, thus users reported using Calm at bedtime/for sleep as a way of using the app more consistently.

    An interesting finding from our survey was that almost half of our sample had friends or family that used Calm, and many talked with their friends or family about Calm. However, overall, respondents reported not wanting to be connected with other Calm users. When exploring mental or physical health diagnoses and the relationship to reporting the desire to be connected to other Calm users, those with mental health diagnoses wanted to connect with other Calm users. Recent research suggests that individuals with mental health problems are increasingly turning to online communities for social support [30,31]. Although more than half of the survey sample started using Calm for mental health reasons (ie, anxiety and depression), and almost half reported a mental health diagnoses (ie, anxiety, depression, and posttraumatic stress); only 3% used the Calm Facebook community to maintain app engagement. This is surprising given the strong presence of Calm on Facebook and other social media platforms. It may be that this convenience sample of highly engaged users already felt well connected in terms of social support, and thus, their feedback on additional support might not be generalizable. It is also possible that concerns related to privacy and stigma deter users with mental health diagnoses from disclosing personal or emotional information to a larger community [32]. These individuals may prefer to connect specifically with other users who share common difficulties [33,34]. Future investigation is necessary to determine what the best way is to connect users and to facilitate social support for subscribers of these apps.

    Changes in Health, Stress, and Sleep

    Participants using Calm more frequently were incrementally more likely to notice changes in both mental and physical health, stress, and sleep, as were those who reported using Calm for a longer duration. This is not surprising. Participants are likely becoming more mindful and reap the benefits associated with mindfulness [35,36]. Present literature on the amount of meditation practice needed to observe changes in a range of health outcomes is varied and limited [37]. However, there is promising evidence for greater effects on health, stress, and sleep as time spent (eg duration, frequency) increases [37,38]. This information is important because regardless of the component (ie, general use of Calm, specifically meditation, and specifically Sleep Stories), participants who used the app more frequently clearly noticed changes in their health. It is well known that individuals are more likely to participate in a behavior if they enjoy it or if they believe it benefits them [39,40]. However, it is important to note that survey questions about changes in all aspects of health were nondirectional, and respondents’ reports of noticing changes were interpreted with the assumption that changes reflect improvements. In addition, future research should explore the correlation between self-reported noticing changes and directional changes on validated outcome measures. It is possible that, retrospectively, users believe that there have been changes, but when completing a fully validated measure, scores remain the same over time. The relationship between actual and perceived outcomes and time spent (duration in minutes and length of membership) using the app would also be worth exploring in future research. Future research should also explore the optimal dose of mindfulness meditation on a mobile app to improve health outcomes. For example, it is possible that total time spent using a meditation app is less important than frequency of use it (eg, 10 min a day for 3 days could be better than 50 min in 1 day).

    Respondents who used the Sleep Stories more frequently were more likely to report noticing changes in their sleep and physical health. Consumer sleep technologies have become quite popular to help individuals improve or self-monitor their sleep [20]. In a review by Ko in 2015 on consumer sleep technologies, a number of the top-rated sleep apps helped users track their sleep trends (movements that represent presence or absence of sleep), recorded ambient sounds (sleep talking and snoring), alerted users when to go to bed, and tracked their sleep habits over time. Although some of the apps were developed to facilitate sleep onset using visual graphics, relaxing music, and nature sounds, none incorporated Sleep Stories. Uniquely, Calm has Sleep Stories, similar to meditation, that help the user to practice moment-to-moment awareness, experience greater attentional control, and decrease ruminating thoughts, which may lead to less anxiety about sleeplessness [41,42]. The stories bring listeners focus into the present moment, helping them to disengage with negative thoughts/beliefs about sleeplessness, and provide cognitive distraction, which may lower presleep anxiety or arousal and help users sleep better.

    It is important to note that those who used the Sleep Stories more frequently reported noticing changes in their sleep and physical health only, whereas those using meditations more frequently noticed changes in their mental and physical health, as well as stress. Although there is a large body of research demonstrating the relationship between sleep and physical health [43], many studies observe similar or stronger relationships between sleep and mental health [44,45]. Given this, it is surprising that using Sleep Stories was not associated with changes in mental health or stress. There may be more varying long-term benefits of using Calm for meditation as compared with sleep. Little research has been conducted to determine the effects of sleep components of mindfulness-based apps, and no studies have specifically assessed the effects of Calm Sleep Stories in improving sleep and health outcomes. Considering the increases in sleep components to mindfulness meditation apps, future research on the extent to which these components impact sleep is warranted.

    Limitations

    There were a number of limitations, inherent in descriptive, survey-based studies. First, although this was a convenience sample of Calm users that opened an email from Calm and decided to complete the survey, engagement was still varied (60.03% of respondents used the app 5 or more times per week, 27.45% used 3-4 times per week, and 12.52% used only once or twice weekly), and there may be a viable sample of individuals who vary in their use of Calm. In addition, individuals who use Calm more frequently may have more favorable opinions of the app and have benefitted more from using it. Those who do not find Calm beneficial may have elected not to participate. In addition, the survey did not include the option to endorse using Calm less often than 1 to 2 times per week, which may have decreased participation rates of infrequent users. Finally, our sample is mostly white, female, and with higher income. Future studies should use stratified recruitment strategies to engage a more diverse sample in terms of age, gender, income, race/ethnicity, and pattern of usage. Second, as this was a cross-sectional, nonexperimental study, we cannot infer causality with regard to the impact of Calm; rather, analyses rely on subscribers’ recollections of app usage, perceptions of changes over time, and their beliefs about how Calm has impacted them. Future studies should explore these relationships prospectively, and randomized clinical trials are needed to determine extent to which changes can be attributed to Calm usage. Third, the survey items were designed specifically for this study, and thus, there is no previous research on their validity. In addition, questions asking participants to notice changes in their health, stress, and sleep after using Calm were dichotomous (yes/no), and results were interpreted with the assumption that changes reflect improvements. Future studies should extend the findings of this report by using validated questionnaires to assess directional changes in mental health, physical health, stress, and sleep outcomes. Finally, as many respondents used both meditations and Sleep Stories, it is difficult to disentangle the unique effects of those components. Future dismantling studies could randomize participants to only use 1 component of the app and look at the benefits of each component on its own. In addition, future surveys should collect more detailed information regarding the specific aspects of meditations and Sleep Stories that users enjoy, and this information should be presented alongside qualitative data, as such data could inform future experimental studies.

    Conclusions

    This is the first study to report the demographic and clinical characteristics and patterns of usage among a large sample of paid subscribers to a top-rated health and fitness app, Calm. Results showed that most subscribers used meditation and Sleep Stories at least three to four times per week, and more frequent use was associated with perceived changes in their physical and mental health, stress, and sleep. We have also identified the most popular tools within the app preferred by subscribers. This paper provides information for Calm and other mindfulness-based apps about strategies to tailor content and features (eg, emphasize benefits for sleep, provide tracking with feedback, and incorporate social support that is private/anonymous) and potentially increase subscribers and retention rates. From a scientific perspective, these strategies can help participants engage in studies and facilitate feasibility. This study sets the stage for future clinical trials aimed at determining the efficacy of Calm in improving physical and mental health, stress, and sleep.

    Conflicts of Interest

    JH is currently the Director of Science at Calm. JH has been conducting research with Calm as a partner almost 5 years before becoming the Director of Science and the Scientific Advisory Board (SAB). A-MV, CC, and MB are members of Calm’s SAB and are independent from Calm leadership. Their role is to ensure the quality of Calm’s science. There are no financial incentives from the growth of Calm to any author.

    Multimedia Appendix 1

    Screenshots of the home screen and meditation screen in Calm app.

    PNG File , 3981 KB

    Multimedia Appendix 2

    Questions from Calm user engagement survey.

    PDF File (Adobe PDF File), 60 KB

    Multimedia Appendix 3

    Additional details on statistical analyses of reasons for starting Calm.

    PDF File (Adobe PDF File), 49 KB

    Multimedia Appendix 4

    Additional details on statistical analyses of Calm component usage.

    PDF File (Adobe PDF File), 66 KB

    Multimedia Appendix 5

    Additional details on statistical analyses of changes in health stress and sleep after using Calm.

    PDF File (Adobe PDF File), 73 KB

    References

    1. Kabat-Zinn J, Hanh TN. Full Catastrophe Living: Using the Wisdom of Your Body and Mind to Face Stress, Pain, and Illness. United States: Bantam Books; 2009.
    2. Kabat-Zinn J. Mindfulness-based interventions in context: past, present, and future. Clin Psychol 2003;10(2):144-156. [CrossRef]
    3. Burke A, Lam CN, Stussman B, Yang H. Prevalence and patterns of use of mantra, mindfulness and spiritual meditation among adults in the United States. BMC Complement Altern Med 2017 Jun 15;17(1):316 [FREE Full text] [CrossRef] [Medline]
    4. Creswell JD. Mindfulness Interventions. Annu Rev Psychol 2017 Jan 3;68:491-516. [CrossRef] [Medline]
    5. Flett JAM, Hayne H, Riordan BC, Thompson LM, Conner TS. Mobile mindfulness meditation: a randomised controlled trial of the effect of two popular apps on mental health. Mindfulness 2019;10(5):863-876. [CrossRef]
    6. Rusch HL, Rosario M, Levison LM, Olivera A, Livingston WS, Wu T, et al. The effect of mindfulness meditation on sleep quality: a systematic review and meta-analysis of randomized controlled trials. Ann N Y Acad Sci 2019 Jun;1445(1):5-16. [CrossRef] [Medline]
    7. Wahbeh H, Svalina MN, Oken BS. Group, one-on-one, or internet? Preferences for mindfulness meditation delivery format and their predictors. Open Med J 2014;1:66-74 [FREE Full text] [CrossRef] [Medline]
    8. Kracen AC, Mastnak JM, Loaiza KA, Matthieu MM. Group therapy among OEF/OIF veterans: treatment barriers and preferences. Mil Med 2013 Jan;178(1):e146-e149. [CrossRef] [Medline]
    9. Huberty J, Eckert R, Larkey L, Kurka J, de Jesús SA, Yoo W, et al. Smartphone-based meditation for myeloproliferative neoplasm patients: feasibility study to inform future trials. JMIR Form Res 2019 Apr 29;3(2):e12662 [FREE Full text] [CrossRef] [Medline]
    10. Lau DT, Kirby JB. The relationship between living arrangement and preventive care use among community-dwelling elderly persons. Am J Public Health 2009 Jul;99(7):1315-1321 [FREE Full text] [CrossRef] [Medline]
    11. Mohr DC, Burns MN, Schueller SM, Clarke G, Klinkman M. Behavioral intervention technologies: evidence review and recommendations for future research in mental health. Gen Hosp Psychiatry 2013;35(4):332-338 [FREE Full text] [CrossRef] [Medline]
    12. Silver L, Smith A, Johnson C, Taylor K, Jiang J, Anderson M, et al. Pew Research Center. 2019 Mar 7. Mobile Connectivity in Emerging Economies   URL: https:/​/www.​pewinternet.org/​wp-content/​uploads/​sites/​9/​2019/​03/​PI_2019.​03.​07_Mobile-Connectivity_FINAL.​pdf [accessed 2019-09-25]
    13. Taylor K, Silver L. Pew Research Center. 2019 Feb 5. Smartphone Ownership is Growing Rapidly Around the World, but Not Always Equally   URL: https:/​/www.​pewresearch.org/​global/​wp-content/​uploads/​sites/​2/​2019/​02/​Pew-Research-Center_Global-Technology-Use-2018_2019-02-05.​pdf [accessed 2019-09-25]
    14. Elavsky S, Smahel D, Machackova H. Who are mobile app users from healthy lifestyle websites? Analysis of patterns of app use and user characteristics. Transl Behav Med 2017 Dec;7(4):891-901 [FREE Full text] [CrossRef] [Medline]
    15. Plaza I, Demarzo MM, Herrera-Mercadal P, García-Campayo J. Mindfulness-based mobile applications: literature review and analysis of current features. JMIR Mhealth Uhealth 2013 Nov 1;1(2):e24 [FREE Full text] [CrossRef] [Medline]
    16. Krebs P, Duncan DT. Health app use among us mobile phone owners: a national survey. JMIR Mhealth Uhealth 2015 Nov 4;3(4):e101 [FREE Full text] [CrossRef] [Medline]
    17. Mani M, Kavanagh DJ, Hides L, Stoyanov SR. Review and evaluation of mindfulness-based iPhone apps. JMIR Mhealth Uhealth 2015 Aug 19;3(3):e82 [FREE Full text] [CrossRef] [Medline]
    18. Chan J. SensorTower. 2019 Jul 8. Top Health & Fitness Apps in the US for June 2019 by Downloads   URL: https://sensortower.com/blog/top-health-and-fitness-apps-us-june-2019-downloads [accessed 2019-09-25]
    19. Capritto A. CNET: Product reviews, how-tos, deals and the latest tech news. 2019 Oct 10. 11 Meditation Apps for Better Sleep and Less Stress   URL: https://www.cnet.com/how-to/10-best-meditation-apps-of-2019/ [accessed 2019-09-25]
    20. Ko PT, Kientz JA, Choe EK, Kay M, Landis CA, Watson NF. Consumer sleep technologies: a review of the landscape. J Clin Sleep Med 2015 Dec 15;11(12):1455-1461 [FREE Full text] [CrossRef] [Medline]
    21. Upchurch DM, Johnson PJ. Gender differences in prevalence, patterns, purposes, and perceived benefits of meditation practices in the United States. J Womens Health (Larchmt) 2019 Feb;28(2):135-142. [CrossRef] [Medline]
    22. Clarke TC, Black LI, Stussman BJ, Barnes PM, Nahin RL. Trends in the use of complementary health approaches among adults: United States, 2002-2012. Natl Health Stat Report 2015 Feb 10(79):1-16 [FREE Full text] [Medline]
    23. Pengo MF, Won CH, Bourjeily G. Sleep in women across the life span. Chest 2018 Jul;154(1):196-206 [FREE Full text] [CrossRef] [Medline]
    24. Fitzgerald M, McClelland T. What makes a mobile app successful in supporting health behaviour change? Health Educ J 2017;76(3):373-381. [CrossRef]
    25. Orji R, Moffatt K. Persuasive technology for health and wellness: state-of-the-art and emerging trends. Health Informatics J 2018 Mar;24(1):66-91. [CrossRef] [Medline]
    26. Martin SS, Feldman DI, Blumenthal RS, Jones SR, Post WS, McKibben RA, et al. mActive: A randomized clinical trial of an automated mHealth intervention for physical activity promotion. J Am Heart Assoc 2015 Nov 9;4(11) [FREE Full text] [CrossRef] [Medline]
    27. Norman GJ, Zabinski MF, Adams MA, Rosenberg DE, Yaroch AL, Atienza AA. A review of eHealth interventions for physical activity and dietary behavior change. Am J Prev Med 2007 Oct;33(4):336-345 [FREE Full text] [CrossRef] [Medline]
    28. Rabbi M, Pfammatter A, Zhang M, Spring B, Choudhury T. Automated personalized feedback for physical activity and dietary behavior change with mobile phones: a randomized controlled trial on adults. JMIR Mhealth Uhealth 2015 May 14;3(2):e42 [FREE Full text] [CrossRef] [Medline]
    29. Kelly S, Martin S, Kuhn I, Cowan A, Brayne C, Lafortune L. Barriers and facilitators to the uptake and maintenance of healthy behaviours by people at mid-life: a rapid systematic review. PLoS One 2016;11(1):e0145074 [FREE Full text] [CrossRef] [Medline]
    30. Naslund JA, Aschbrenner KA, McHugo GJ, Unützer J, Marsch LA, Bartels SJ. Exploring opportunities to support mental health care using social media: a survey of social media users with mental illness. Early Interv Psychiatry 2019 Jun;13(3):405-413. [CrossRef] [Medline]
    31. Ridout B, Campbell A. The use of social networking sites in mental health interventions for young people: systematic review. J Med Internet Res 2018 Dec 18;20(12):e12244 [FREE Full text] [CrossRef] [Medline]
    32. Zhang X, Liu S, Chen X, Wang L, Gao B, Zhu Q. Health information privacy concerns, antecedents, and information disclosure intention in online health communities. Inform Manag 2018 Jun;55(4):482-493. [CrossRef]
    33. de Choudhury M, De S. Mental Health Discourse on Reddit: Self-Disclosure, Social Support, and Anonymity. In: Proceedings of the Eighth International AAAI Conference on Weblogs and Social Media. 2014 Presented at: ICWSM'14; June 1-4, 2014; Ann Arbor, Michigan, USA p. 71-80   URL: https://pdfs.semanticscholar.org/2db7/15a479c8961d3020fe906f7bedfa0311b937.pdf
    34. Kingod N, Cleal B, Wahlberg A, Husted GR. Online peer-to-peer communities in the daily lives of people with chronic illness: a qualitative systematic review. Qual Health Res 2017 Jan;27(1):89-99. [CrossRef] [Medline]
    35. Grossman P, Niemann L, Schmidt S, Walach H. Mindfulness-based stress reduction and health benefits. A meta-analysis. J Psychosom Res 2004 Jul;57(1):35-43. [CrossRef] [Medline]
    36. Victorson D, Kentor M, Maletich C, Lawton RC, Kaufman VH, Borrero M, et al. Mindfulness meditation to promote wellness and manage chronic disease: a systematic review and meta-analysis of mindfulness-based randomized controlled trials relevant to lifestyle medicine. Am J Lifestyle Med 2015;9(3):185-211. [CrossRef]
    37. Zeng X, Chio FH, Oei TP, Leung FY, Liu X. A systematic review of associations between amount of meditation practice and outcomes in interventions using the four immeasurables meditations. Front Psychol 2017;8:141 [FREE Full text] [CrossRef] [Medline]
    38. Schoormans D, Nyklíček I. Mindfulness and psychologic well-being: are they related to type of meditation technique practiced? J Altern Complement Med 2011 Jul;17(7):629-634. [CrossRef] [Medline]
    39. Jekauc D. Enjoyment during exercise mediates the effects of an intervention on exercise adherence. Psychol 2015;6(1):48-54. [CrossRef]
    40. Lewis BA, Williams DM, Frayeh A, Marcus BH. Self-efficacy versus perceived enjoyment as predictors of physical activity behaviour. Psychol Health 2016;31(4):456-469 [FREE Full text] [CrossRef] [Medline]
    41. Harris K, Spiegelhalder K, Espie CA, MacMahon KM, Woods HC, Kyle SD. Sleep-related attentional bias in insomnia: a state-of-the-science review. Clin Psychol Rev 2015 Dec;42:16-27. [CrossRef] [Medline]
    42. Lee CW, Ree MJ, Wong MY. Effective insomnia treatments: investigation of processes in mindfulness and cognitive therapy. Behav Change 2018;35(2):71-90. [CrossRef]
    43. Itani O, Jike M, Watanabe N, Kaneita Y. Short sleep duration and health outcomes: a systematic review, meta-analysis, and meta-regression. Sleep Med 2017 Apr;32:246-256. [CrossRef] [Medline]
    44. Hays RD, Spritzer KL, Schalet BD, Cella D. PROMIS-29 v2.0 profile physical and mental health summary scores. Qual Life Res 2018 Jul;27(7):1885-1891 [FREE Full text] [CrossRef] [Medline]
    45. Lallukka T, Sivertsen B, Kronholm E, Bin YS, Øverland S, Glozier N. Association of sleep duration and sleep quality with the physical, social, and emotional functioning among Australian adults. Sleep Health 2018 Apr;4(2):194-200. [CrossRef] [Medline]


    Abbreviations

    SAB: Scientific Advisory Board


    Edited by G Eysenbach; submitted 25.07.19; peer-reviewed by Z Ma, K Kaipainen, V Rocío, A Enrique, DJ Dutcher; comments to author 19.08.19; revised version received 05.09.19; accepted 28.09.19; published 03.11.19

    ©Jennifer Huberty, Ana-Maria Vranceanu, Colleen Carney, Michael Breus, Michael Gordon, Megan Elizabeth Puzia. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 03.11.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.