This paper is in the following e-collection/theme issue:

mHealth for Symptom and Disease Monitoring, Chronic Disease Management (1301) Mobile Health (mhealth) (2748) Depression and Mood Disorders; Suicide Prevention (1271)

Published on in Vol 4, No 1 (2016): Jan-Mar

This is a member publication of ORCAS Inc., Eugene, OR, USA

MoodHacker Mobile Web App With Email for Adults to Self-Manage Mild-to-Moderate Depression: Randomized Controlled Trial

MoodHacker Mobile Web App With Email for Adults to Self-Manage Mild-to-Moderate Depression: Randomized Controlled Trial

MoodHacker Mobile Web App With Email for Adults to Self-Manage Mild-to-Moderate Depression: Randomized Controlled Trial

Authors of this article:

Amelia J Birney1 Author Orcid Image ;   Rebecca Gunn1 Author Orcid Image ;   Jeremy K Russell1 Author Orcid Image ;   Dennis V Ary1 Author Orcid Image
Article Authors Cited by (102) Tweetations (20) Metrics

    Original Paper

    ORCAS, Eugene, OR, United States

    Corresponding Author:

    Amelia J Birney, MPH, MCHES

    ORCAS

    P.O. Box 1226

    Eugene, OR, 97440

    United States

    Phone: 1 541 349 4826

    Fax:1 541 342 4270

    Email: abirney@orcasinc.com


    Background: Worldwide, depression is rated as the fourth leading cause of disease burden and is projected to be the second leading cause of disability by 2020. Annual depression-related costs in the United States are estimated at US $210.5 billion, with employers bearing over 50% of these costs in productivity loss, absenteeism, and disability. Because most adults with depression never receive treatment, there is a need to develop effective interventions that can be more widely disseminated through new channels, such as employee assistance programs (EAPs), and directly to individuals who will not seek face-to-face care.

    Objective: This study evaluated a self-guided intervention, using the MoodHacker mobile Web app to activate the use of cognitive behavioral therapy (CBT) skills in working adults with mild-to-moderate depression. It was hypothesized that MoodHacker users would experience reduced depression symptoms and negative cognitions, and increased behavioral activation, knowledge of depression, and functioning in the workplace.

    Methods: A parallel two-group randomized controlled trial was conducted with 300 employed adults exhibiting mild-to-moderate depression. Participants were recruited from August 2012 through April 2013 in partnership with an EAP and with outreach through a variety of additional non-EAP organizations. Participants were blocked on race/ethnicity and then randomly assigned within each block to receive, without clinical support, either the MoodHacker intervention (n=150) or alternative care consisting of links to vetted websites on depression (n=150). Participants in both groups completed online self-assessment surveys at baseline, 6 weeks after baseline, and 10 weeks after baseline. Surveys assessed (1) depression symptoms, (2) behavioral activation, (3) negative thoughts, (4) worksite outcomes, (5) depression knowledge, and (6) user satisfaction and usability. After randomization, all interactions with subjects were automated with the exception of safety-related follow-up calls to subjects reporting current suicidal ideation and/or severe depression symptoms.

    Results: At 6-week follow-up, significant effects were found on depression, behavioral activation, negative thoughts, knowledge, work productivity, work absence, and workplace distress. MoodHacker yielded significant effects on depression symptoms, work productivity, work absence, and workplace distress for those who reported access to an EAP, but no significant effects on these outcome measures for those without EAP access. Participants in the treatment arm used the MoodHacker app an average of 16.0 times (SD 13.3), totaling an average of 1.3 hours (SD 1.3) of use between pretest and 6-week follow-up. Significant effects on work absence in those with EAP access persisted at 10-week follow-up.

    Conclusions: This randomized effectiveness trial found that the MoodHacker app produced significant effects on depression symptoms (partial eta2 = .021) among employed adults at 6-week follow-up when compared to subjects with access to relevant depression Internet sites. The app had stronger effects for individuals with access to an EAP (partial eta2 = .093). For all users, the MoodHacker program also yielded greater improvement on work absence, as well as the mediating factors of behavioral activation, negative thoughts, and knowledge of depression self-care. Significant effects were maintained at 10-week follow-up for work absence. General attenuation of effects at 10-week follow-up underscores the importance of extending program contacts to maintain user engagement. This study suggests that light-touch, CBT-based mobile interventions like MoodHacker may be appropriate for implementation within EAPs and similar environments. In addition, it seems likely that supporting MoodHacker users with guidance from counselors may improve effectiveness for those who seek in-person support.

    Trial Registration: ClinicalTrials.gov NCT02335554; https://clinicaltrials.gov/ct2/show/NCT02335554 (Archived by WebCite at http://www.webcitation.org/6dGXKWjWE)

    JMIR mHealth uHealth 2016;4(1):e8

    doi:10.2196/mhealth.4231

    Keywords

    depression; cognitive behavioral therapy; behavioral activation; positive psychology; mobile apps; Internet; computers 


    Background

    Major depressive disorder is one of the most prevalent mental conditions to afflict adults in the United States, with estimates in the United States for major depression of 16.6% for lifetime occurrence and 6.7% for a 1-year period [1,2]. Worldwide, depression is rated as the fourth leading cause of disease burden, and the World Health Organization projects that by 2020 depression will rank as the second leading cause of disability [3,4]. The prevalence of mild-to-moderate or subclinical depression is equal to, or greater than, major depressive disorder, with lifetime rates up to 26% and annual prevalence of 5-10% [5,6]. Subclinical depression is associated with substantial functional impairment, including poor work performance [3,7-9]. Further, subclinical depression is associated with a two- to five-fold increased risk of full-syndrome depressive disorders [10-13].

    Based on data from 2010, depression-related costs in the United States exceeded US $210.5 billion, with employers incurring US $102 billion in losses due to presenteeism (US $78.7 billion), absenteeism (US $23.3 billion), and disability, and another US $98.9 billion incurred as direct medical costs [14]. Each year, US employers lose approximately 32 workdays per depressed employee to presenteeism [14]. Approximately 40% of direct medical costs are due to major depressive disorder, 10-11% are due to other depressive conditions, and roughly half of costs (48-51%) are due to comorbid physical or psychiatric conditions, such as pain and sleep disorders [14]. In addition, the economic costs of subclinical depression are considerable, approximately two-thirds the per capita costs of major depression [15-18].

    Because most adults who suffer from depression never receive treatment [19], there is a need to develop interventions that can be more widely disseminated, such as through channels like employee assistance programs (EAPs) and directly to individuals who will not seek face-to-face care. Interventions that reduce the performance-impairing symptoms of subclinical depression and prevent the onset of major depression can improve employee well-being, while reducing health care costs and improving productivity [20]. EAPs offer services specifically designed to improve and/or maintain workplace productivity, including individual mental and behavioral health services offered to employees and family members experiencing personal difficulties, like depression. With wide reach into medium-to-large US employers and rapidly growing reach worldwide, EAPs offer a meaningful channel for delivering effective interventions as part of a larger population health management strategy.

    Cognitive Behavioral Therapy for Depression

    The Coping with Depression (CWD) cognitive behavioral therapy (CBT) skills-training program [21,22] is based on behavioral [23,24] as well as cognitive formulations of depression [25-27]. The CWD skills-training program combines cognitive and behavioral strategies aimed at ameliorating problems common to depressed individuals (eg, pessimism; internal, global, and stable attributions for failure; low self-esteem; low engagement in pleasant activities; poor social skills; anxiety and tension; low social support; and increased conflict) with a focus on awareness of specific and current actions and cognitions as targets for change. CWD-based interventions are based on the premise that activating a variety of coping skills and strategies allows depressed individuals to effectively address the diverse personal and environmental triggers that underlie their depressive symptoms.

    The CWD approach has been validated for use with a variety of age, gender, and race/ethnic groups and using a variety of delivery methods, including as a guided self-help intervention [28]. Based on a meta-analysis of 18 CWD-based intervention studies, the approach has been associated with clinically significant effects ranging from d=0.28 to 0.62, depending on the outcome measure used [28]. In trials that targeted adults with subthreshold depression, CWD participants were 38% less likely to escalate to full-syndrome depression [28].

    Positive Psychology Interventions for Depression

    Cognitive and behavioral approaches to mood have evolved from a focus on treating disorders to including an emphasis on promoting positive emotion and experiences. Positive psychology interventions (PPIs), such as mindful self-awareness, gratitude expression, and identifying and utilizing strengths, have been shown to impact both well-being and depressive symptoms [29-31]. Mindfulness and acceptance are increasingly integrated in CBT approaches to depression self-management, drawing attention to both increasing positive cognitions and experiences, and accepting or releasing negative cognitions. Mindfulness-based interventions are particularly effective for managing stressors and enhancing positive emotions, resulting in psychological and social benefits and reducing depression symptoms [31-35]. PPIs that focus on building conscious awareness and expression of gratitude increase positive emotion and yield a wide variety of physical and affective benefits [31,36-38]. Identifying and using one’s strengths has been shown to have robust emotional effects, and setting strength-based goals and plans has been shown to increase optimism and reduce depression, with long-lasting effects [31,39-41].

    Web and Mobile Delivery of Depression Interventions: Efficacy

    Internet-delivered CBT-based programs for depression symptom management have been shown to be effective both for adults with major depressive disorder and those with elevated, but subthreshold, depression symptoms, although one recent review identified concerns with dropout and lack of long-term effects [42-45]. Traditional computer- and Internet-based CBT programs typically involve four to 12 lessons or modules delivered in sequence, either weekly or self-paced [43,46]. Effect sizes have been estimated at d=0.44-1.90 for clinician-supported, and d=0.21-0.70 for self-guided, interventions [42-45,47,48]. One review reports somewhat larger effects in studies targeting populations with clinically significant depression symptoms (d=0.42-0.65) than for populations with mild-to-moderate symptoms (d=0.30-0.53) [43].

    To date, very few randomized clinical trials of mobile apps targeting depression have been published in the peer-reviewed literature [49]. We found only one such study specifically targeting adults with mild-to-moderate depression [50,51]. In this study, participants who used the CBT-based myCompass app, delivered via mobile phone and Internet, reported improvements in depression and anxiety at 7-week post-test compared to an attention control intervention and a waiting list condition. Treatment gains were maintained at 3-month follow-up, and improvements in the attention control condition matched those of the myCompass group [50].

    The SuperBetter mobile Web app was evaluated in a three-arm randomized controlled trial, with results showing the original, “general” version of SuperBetter—with activities focused on self-esteem and social support—more effective at reducing depressive symptoms over both a combined SuperBetter-plus-CBT and positive psychology strategies condition and the waiting list condition. Ly et al [52] found no between-group effects between mobile-based behavioral activation and mindfulness apps for depression. Kauer et al [53] and Reid et al [54] found no differences in the Depression, Anxiety, and Stress Scale scores between a mobile app with ecological momentary assessment (EMA)-based emotional self-awareness training and feedback and an attention control condition. Watts et al [55] reported statistically significant large within-group effect sizes for depression symptoms in a nonrandomized study of their CBT-based Get Happy mobile app, which was derived from, and evaluated against, its Web-based predecessor, The Sadness Program. Burns et al [56] conducted a single-group pre/post pilot of Mobilyze!, a website with a mobile EMA component, finding large within-group effect sizes on depressive symptomatology.

    The CWD-based Overcoming Depression on the Internet program provided early evidence that a Web-based program with reminders was effective in reducing depression symptoms, particularly among individuals with mild-to-moderate depression [57,58]. Spek et al [59] found similar improvements among individuals over 50 years old with subthreshold depressive symptoms from a CWD-based, self-administered Internet treatment program and those receiving CWD-based group therapy, both significantly greater than the improvement seen in waiting list controls. Treatment effects for the Internet-based group were maintained 1 year following treatment [60].

    Web and Mobile Delivery of Depression Interventions: Access

    Internet delivery of mental health interventions offers individuals with online technology broad access to evidence-based treatment. Mobile apps offer an additional channel to increase access further, both as self-guided tools and as those supported by counseling professionals, such as EAPs. Globally, use of mobile and broadband mobile services is rising, while fixed broadband service is slowing, especially in developing countries [61]. Worldwide penetration of broadband mobile services doubled between 2011 and 2014 to an estimated 32% (84% in developed countries and 21% in developing countries) [61]. In 2014, there were nearly 7 billion active mobile subscriptions worldwide, with 2.3 billion using broadband services [61]. In 2015, 64% of Americans owned a mobile phone and 19% used it for their only or primary access to the Internet [62]. Mobile phone-dependent Americans tend to be younger, nonwhite, and have low income and education [62]. Capitalizing on mobile Internet access as a delivery channel for evidence-based mental health interventions is critical.

    Mobile interventions offer the potential for anytime, anywhere convenience and the ability to promote regular use of behavioral and cognitive self-management strategies known to impact mood. Consumers express high interest in, and willingness to use, mobile phones and short message service (SMS) text messaging to monitor and manage symptoms and cite essential considerations such as ease of use, privacy, and security [63-66]. Proven mobile apps can provide a tool for clinical professionals to use with help-seeking clients, while also increasing access and retention over in-person mental health services [67,68]. Unfortunately, although the consumer app stores offer over 200 depression-specific apps, judging the credibility and efficacy of those apps is difficult without clinical validation [69].

    MoodHacker Mobile Intervention

    The MoodHacker mobile intervention is one of few clinically validated CBT-based depression self-management mobile apps currently available. MoodHacker is designed to directly activate key cognitive and behavioral skills from the validated CWD program [21] and positive psychology strategies [70] (eg, mood and positive activity planning and tracking, cognitive restructuring, mindful self-awareness, gratitude expression, and identifying and utilizing strengths). In contrast to the more common lessons-based structure of many online and mobile CBT programs, MoodHacker is optimized for a brief daily interaction with the high-quality production value and mobile user experience common in consumer mobile apps.

    Objectives

    To demonstrate the efficacy of this light-touch, mobile, Web CBT-based experience, we compared MoodHacker as a fully self-guided intervention to an alternative-treatment control group that received an email with links to vetted online information about depression. It was hypothesized that MoodHacker users would experience reduced depression symptoms and negative cognitions, and increased behavioral activation, knowledge of depression, and functioning in the workplace. This study of the MoodHacker intervention extends the evidence base for CBT-based mobile interventions for adults with mild-to-moderate depressive symptoms. Because the MoodHacker mobile Web app was designed primarily to target employees who present with depression through their EAP, the extent to which the program effects generalize to users with and without access to EAP support was an important research question.


    Research Design

    The efficacy of the MoodHacker mobile Web app intervention was assessed with a randomized controlled trial (ClinicalTrials.gov NCT02335554) with two factors: condition and EAP access (ie, subjects who had access to an EAP versus those who did not). See Multimedia Appendix 1 for the CONSORT-EHEALTH checklist for the trial [71]. There were three assessments: baseline, follow-up at 6 weeks after baseline, and follow-up at 10 weeks after baseline. After screening into the study, agreeing to the online informed consent, and submitting the baseline assessment, participants were blocked on race/ethnicity and randomized within block into either (1) treatment intervention group (n=150), which used the MoodHacker intervention for 6 weeks, or (2) alternative care group (n=150), which received links to six websites with information about depression. All study protocols, the consent process, and subject communications were reviewed and approved by the ORCAS Institutional Review Board (IRB) for protection of human subjects. There were no changes to the trial design after the trial commenced.

    Participants

    Inclusion criteria for participation were defined as follows: (1) 18 years or older, (2) mild-to-moderate depressive symptoms as measured by the Patient Health Questionnaire-9 (PHQ-9) (score of 10-19), (3) not currently suicidal or meeting criteria for bipolar or schizoaffective disorder, (4) employed at least part time, (5) English speaking, and (6) have access to a high-speed Internet connection. Eligibility was assessed using a two-stage screening protocol. In total, 3064 individuals completed an online screening survey, which included questions on demographics, technology access, and depression symptoms (using the Patient Health Questionnaire-2 [PHQ-2]), as well as brief screening for bipolar and schizoaffective disorders. Of those, 856 (27.94%) qualified for secondary telephonic screening to more fully assess their depression symptoms with the PHQ-9 and to confirm their assessments for bipolar and schizoaffective disorders. Of those 856 who qualified, 294 (34.3%) individuals failed to complete the secondary screening, 205 (23.9%) did not meet the PHQ-9 criteria, 44 (5.1%) endorsed suicidal ideation or showed symptoms of bipolar or schizoaffective disorder, and 13 (1.5%) were dropped due to suspicion of fraud (see below). A total of 300 individuals out of 856 (35.0%) from 37 US states completed the online baseline assessment and were randomly assigned to one of two conditions: treatment or alternative care. See Figure 1 for a CONSORT diagram describing study enrollment and allocation.

    Study Setting and Data Collection

    Participants were recruited from August 2012 through April 2013 in partnership with several organizations, including Chestnut Global Partners EAP as our primary recruitment partner. Non-EAP recruitment partners included Hope to Cope, Esperanza, Mental Health America, National Alliance on Mental Illness, LIVESTRONG, eHow, other eHealth websites, Chamber of Commerce offices, employee support organizations, and Craigslist. Outreach was conducted via the Chestnut EAP call center, print ads, online postings and ads, email listservs, and flyers. All interested potential participants were directed to an informational website that described the broad characteristics of the study’s purpose, activities, and compensation, concluding with an online screening survey.

    All subjects participated fully online from the location(s) of their choice, using their own Internet-capable computers and mobile devices. All self-report, online screening and assessment data were collected via encrypted websites. Upon prequalification based on the initial screening survey, research staff conducted telephone interviews with potential participants to determine eligibility per the inclusion criteria referenced above. Potential participants who reported current suicidal ideation and/or bipolar or schizoaffective disorder during screening were offered appropriate resources according to an IRB-approved crisis protocol and were excluded from the study. The number of participants who self-identified with bipolar disorder symptoms in the initial screening survey was elevated due to suspected fraudulent individuals attempting to qualify with severe symptoms.

    Throughout the study, individuals who reported current suicidal ideation and/or severe depression symptoms (PHQ-9 > 19) were contacted by telephone and offered appropriate resources according to an IRB-approved crisis protocol. Calls were made to 114 individuals (50 treatment, 64 control) and all remained in the study. No subjects reported suicide risk severe enough to transfer to a suicide hotline. Nor did any subjects report any adverse events related to the use of the MoodHacker app via email or during follow-up calls. Although research assistants were aware of group assignment, all other interactions with subjects were delivered by emails that were standardized across groups and fully automated to avoid differential interactions by group assignment. All other research team members were blinded and, aside from crisis calls, no research team members had direct interaction with subjects after randomization.

    ‎
    Figure 1. CONSORT diagram for the MoodHacker randomized trial.
    View this figure

    Lack of direct contact with study participants in a fully online study lends itself to potential participants self-reporting false information to qualify (eg, same name or IP address shows inconsistent age, gender, race, and/or ethnicity across multiple attempted screenings). To identify these individuals, demographic and contact data were cross-checked for fraudulent information against other individuals in the study database, as well as in our database of over 20,000 records of previous Internet study applicants. Those suspected of submitting fraudulent data were dropped from the study prior to randomization.

    To enhance sample representativeness in each experimental condition, qualified participants were blocked on race/ethnicity and then randomly assigned within each race/ethnicity block to condition—treatment or alternative care—using the random number function in our subject database. Emails indicating group assignment and linking participants to the online informed consent form were auto-generated in the database and sent to participants by a research assistant. Upon completion of the consent form, they were immediately linked to the online baseline self-assessment. Participants also completed online follow-up self-assessments at 6 weeks and 10 weeks after baseline. Participants were compensated US $50 per completed assessment.

    Study Conditions

    Overview

    After completing the baseline assessment, participants in the treatment condition were emailed a link to the MoodHacker mobile Web app and instructed to use the app for the next 6 weeks. Participants in the alternative care condition were sent an email with links to credible online resources about depression and instructed to review it on their own schedule for the next 6 weeks. Alternative care participants were offered use of the MoodHacker app upon completion of the 10-week assessment.

    Treatment: MoodHacker App Intervention

    The MoodHacker responsive mobile Web app was designed to educate users about depression and the benefits of CBT-based strategies to improve mood self-management and to activate (1) daily mood and activity monitoring, (2) increased engagement in positive behavioral activities, (3) decreased negative thinking and increased positive thinking, (4) increased practice of gratitude, mindfulness, and strength-based cognitions and behaviors, and (5) daily practice of these skills to improve depression symptoms and increase resilience to future mood disturbances.

    The 6-week MoodHacker intervention is structured around the key learning and behavioral objectives above. Content was adapted from the CWD group therapy course [21], and enhanced with mindfulness-based [33] and other evidence-based positive psychology strategies [29,31,36]. Content is sequenced to follow the enhanced CWD approach and delivered through daily emails, in-app messaging, and in the Articles & Videos library. Daily emails (see Figure 2) are sent to engage users in program content, provide sequenced guidance through the learning objectives in the articles and whiteboard-style videos, give tips for getting the most out of MoodHacker, and prompt the user to track their mood and activities daily. Users are encouraged to view the articles and videos as ordered, but viewing is not restricted, and users can view content according to their interests. The emails, articles, and videos promote daily use of the featured cognitive and behavioral skills outside the app experience.

    Users are encouraged to monitor their mood and positive cognitive and behavioral activities daily via mobile and/or desktop access to MoodHacker. The tracker shows daily (Figure 3), weekly (Figure 4), and monthly views to highlight progress over time and patterns between positive activities and mood ratings. A customizable list of positive activities is presented by domain and promotes the types of activities known to have the highest impact (ie, social, physical, and success). The tracker includes a journaling feature for users to note mood triggers, experiences with the suggested activities, or personal information about their day. A goal-setting feature allows the user to set a goal for the number of positive activities they want to accomplish each day.

    Participants in the treatment arm accessed the password-protected MoodHacker app with unique usernames and passwords provided for the study. Although daily app use was recommended in the app content, participants were not required to achieve any app use milestones to advance through the app experience. Participants received no clinical support as part of the study.

    Development of the MoodHacker app was undertaken by a multidisciplinary team of researchers and developers at ORCAS; input was incorporated from experts with extensive experience in CBT-based self-management interventions for adults with depression and the benefits of positive psychology. Additional program modifications were made based on data from individual interviews and iterative user testing with the population of interest during the formative and production phases of the project. The randomized trial was conducted with the first version of the MoodHacker app. No changes were made to the app during the study period.

    ‎
    Figure 2. Sample MoodHacker daily email.
    View this figure
    ‎
    Figure 3. MoodHacker daily mood and activity tracking page.
    View this figure
    ‎
    Figure 4. MoodHacker weekly mood and activity graph page.
    View this figure
    Alternative Care: Vetted Websites

    Alternative care participants received an email with links to vetted online information about depression from Help Guide [72], the Mayo Clinic, Mental Health America [73], and the National Institute of Mental Health [74]; they were encouraged to browse these sites on their own schedule for 6 weeks. The educational links were emailed after the baseline assessment. Participants in the alternative care group were then given access to the MoodHacker program after the 10-week assessment.

    Outcome Measures

    Overview

    Online surveys were used to assess the following: (1) depression symptoms, (2) behavioral activation, (3) negative cognitions, (4) worksite outcomes, (5) knowledge, and (6) user satisfaction and program usability. The primary outcome measure was depression symptoms, which was the target of the intervention. Secondary or exploratory measures included the following: (1) potential mediators (ie, behavioral activation, negative cognitions, and knowledge) and (2) potential worksite outcomes that may be influenced by improvement in worker depression. Participants completed self-report assessments at each of the assessment points: baseline, 6 weeks, and 10 weeks.

    Demographics

    Demographic data were collected during the screening process, including the following: (1) gender, (2) age, (3) race/ethnicity, (4) marital status, (5) highest completed education, (6) household income, and (7) employment status.

    Depression Symptoms

    Depressive symptomatology was assessed at each assessment point using the self-reported PHQ-9 (alpha = .71) [75] to assess the nine symptoms of major depression, based on the Diagnostic and Statistical Manual of Mental Disorders, 4th edition (DSM-IV). The PHQ-9 has been shown to be a reliable and valid brief depression assessment tool [76]. Scores are summed, with higher scores indicating higher dysfunction.

    Behavioral Activation

    How actively individuals are taking care of themselves, including making positive life choices, was expected to increase as a result of the intervention. Behavioral activation was measured using the Behavioral Activation for Depression Scale (BADS) Short Form [77,78]. This scale consists of nine items (alpha = .67). Items are summed, with lower scores indicating higher dysfunction.

    Negative Thinking

    Change in negative thinking was assessed using the Automatic Thoughts Questionnaire-Revised (ATQ-R) scale Short Form [79]. A 12-item adaptation of the ATQ-R instrument asked respondents to rate how many times over the past week they have had thoughts that are consistent with 12 negative self-statements (alpha = .92). Items are summed, with higher scores indicating higher dysfunction.

    Knowledge

    Participants were assessed for increase in knowledge about depression. The scale consisted of 14 multiple-choice items developed for this study based on the 12 learning objectives addressed in the MoodHacker articles and videos. Higher scores indicate higher knowledge. Test/retest reliability over a 6-week interval for this scale was .65.

    Worksite Outcomes

    Worker productivity was assessed using the Work Limitations Questionnaire (WLQ) (alpha = .87) [80-82]. The WLQ Short Form consists of eight items divided into four subscales measuring the degree to which a person was limited in their job’s (1) time demands, (2) physical demands, (3) mental demands, and (4) output demands. Work productivity loss was calculated using methods outlined by Lerner and colleagues [83], with higher scores indicating greater loss in worker productivity.

    Productivity loss due to work absence was assessed using the two-item WLQ Work Absence Module, which asks about the number of full days and part days missed in the last 2 weeks due to health problems or medical care [84]. The percentage of productivity lost due to absences is the ratio of total missed hours to total usual work hours in a 2-week time frame [85]. Higher scores indicate greater work loss due to absence from work.

    Worksite outcomes were also assessed using the Workplace Outcome Suite (WOS) (alpha = .74-.88) [86]. This instrument is designed as an open-access instrument to facilitate empirical research on EAP interventions. The suite contains five scales, with five items each, that assess workplace distress, absenteeism, presenteeism, work engagement, and life satisfaction. Each scale is summed separately, with three scales—workplace distress, absenteeism, and presenteeism—indicating dysfunction, and two scales—work engagement and life satisfaction—indicating positive workplace outcomes.

    User Satisfaction and Program Usability

    At 6 weeks, treatment participants completed the System Usability Scale, which is a quantitative measure of program ease of use [87]. The scale includes 10 items, and users were asked to what degree they agreed or disagreed with program use and satisfaction statements on a 6-point scale from 1 (strongly disagree) to 6 (strongly agree). Items were scored using methods outlined by Bangor and colleagues [88], with a higher score indicating higher usability.

    Statistical Analysis

    Statistical power calculations for the analysis of covariance (ANCOVA) indicated that a sample size of 300 yielded sufficient power (>.80) to detect a condition effect of Cohen’s d=0.34 or larger (moderately small effect size). A recent meta-analysis of Internet-based CBT interventions for depression [59] had found a mean effect size of d=0.32 for change in depressive symptoms and the mean effect size obtained in a randomized pilot study evaluating an abbreviated prototype of this app was d=1.05. Thus, this sample size provided adequate statistical power to detect the anticipated effects for the primary outcomes of interest.

    Univariate effects of intervention condition, EAP access, and their interaction on outcome measures were examined using between-subjects ANCOVA, adjusting for pretest outcomes. These analyses were conducted to evaluate effects on outcome measures assessed at both 6-week and 10-week follow-up. If the condition by EAP access interaction was significant for an outcome measure, separate subpopulation ANCOVA analyses were conducted on that outcome measure for subjects with and without EAP access. We explored dose-response relationships and self-monitoring participation within the treatment group by correlating process indicants with change in outcome measures. All subjects were included in intent-to-treat (ITT) analyses at each follow-up. Prior to conducting these analyses, we employed the single imputation procedure available in SPSS, version 21.0 (IBM Corp) to account for missing data. Alpha was set to P<.05, two-tailed, for all tests.


    Baseline Equivalency and Attrition

    The expectation of baseline equivalency due to random assignment of groups was examined. The treatment and alternative care groups were compared on demographic characteristics and outcome measures collected at pretest. Contingency table analyses and t tests were conducted on categorical and continuous measures, respectively. The groups did not significantly differ on any demographic characteristics or pretest outcome measures. See Table 1 for demographic descriptive data.

    Table 1. Demographic characteristics by condition.
    Demographic characteristicsTreatment
    (n=150)    		Alternative care
    (n=150)
    Age in years, mean (SD)40.6 (11.5)40.7 (11.2)
    Number of children, mean (SD)2.0 (1.2)2.0 (1.2)
    Ethnicity, n (%)


    		Hispanic/Latino22 (14.6)21 (14.0)

    		Non-Hispanic/Latino128 (85.3)127 (84.7)
    Race, n (%)


    		Asian3 (2.0)6 (4.0)

    		Hawaiian1 (0.7)0 (0)

    		African American32 (21.3)25 (16.7)

    		Caucasian102 (68.0)105 (70.0)

    		Mixed9 (6.0)9 (6.0)
    Gender, n (%)


    		Female112 (74.6)118 (78.7)

    		Male37 (24.7)32 (21.3)
    Employment status, n (%)


    		Full time84 (56.0)92 (61.3)

    		Part time53 (35.3)46 (30.7)

    		Self-employed13 (8.7)12 (8.0)
    Marital status, n (%)


    		Married/living with partner78 (52.0)72 (48.0)

    		Divorced22 (14.7)23 (15.3)

    		Widowed3 (2.0)2 (1.3)

    		Separated5 (3.3)5 (3.3)

    		Single42 (28.0)47 (31.3)
    Education, n (%)


    		High school diploma or GEDa9 (6.0)20 (13.3)

    		Some college, associates, trade school, military54 (36.0)47 (31.3)

    		College degree (ie, BAb or BSc)60 (40.0)54 (36.0)

    		Graduate school/professional training27 (18.0)28 (18.7)
    Annual household income (US $), n (%)


    		$19,999 or less21 (14.0)22 (14.6)

    		$20,000-$39,99946 (30.7)42 (28.0)

    		$40,000-$59,99925 (16.7)29 (19.3)

    		$60,000-$79,99930 (20.0)29 (19.3)

    		$80,000-$99,99912 (8.0)14 (9.3)

    		$100,000 or more16 (10.7)13 (8.7)
    EAPdaccess, n (%)


    		Yes46 (30.6)45 (30.0)

    		No99 (66.0)100 (66.7)

    aGED: General Educational Development.

    bBA: Bachelor of Arts.

    cBS: Bachelor of Science.

    dEAP: employee assistance program.

    The extent to which attrition threatened the internal and external validity of the study was evaluated using contingency table analyses and analysis of variance (ANOVA). Participants who completed each of the follow-up assessments were compared to those who did not complete that follow-up with respect to demographic characteristics and pretest outcome measures. We also conducted analyses to test whether outcome variables were differentially affected across conditions by attrition. These latter analyses examined the effects of condition, attrition status, and their interaction on pretest outcomes. Examination of attrition between pretest and 6-week follow-up revealed only 10 out of 150 (6.7%) treatment participants did not complete the assessment compared to 4 out of 150 (2.7%) alternative care participants. Only 10 out of 150 (6.7%) treatment participants did not complete the 10-week follow-up assessment compared to 5 out of 150 (3.3%) alternative care participants. Attrition rates did not significantly differ by condition. Moreover, we found no statistically significant differences in demographic characteristics or baseline outcomes by attrition status, nor did we find any statistically significant interactions between attrition and condition predicting baseline outcomes, suggesting that attrition was not systematic.

    Analyses compared baseline demographic data of subjects with EAP access versus those without EAP access. Subjects with EAP access had significantly more children (P=.003), consisted of fewer Hispanics (P=.01), were more likely to have full-time employment (P=.001), had a higher level of education (P=.047), and had a greater income (P=.001).

    Intervention Effects

    Table 2 provides ANCOVA results for all outcome measures at 6-week and 10-week follow-up. Multimedia Appendix 2 provides means and standard deviations for each outcome by assessment time and condition, along with pretest to 6-week follow-up and pretest to 10-week follow-up outcome analyses.

    Primary Outcome: Depression Symptoms

    From pretest to 6-week follow-up, the ANCOVA with the full sample found statistically significant program effects on depression symptoms (PHQ-9) (P=.01, partial eta2 = .021). However, a statistically significant condition-by-user-EAP-access interaction effect was also obtained (P=.05, partial eta2 = .013), indicating differential program effects depending upon subjects’ access to an EAP. Separate subpopulation analyses indicated significant positive program effects for subjects with EAP access (P=.004, partial eta2 = .093) and no program effects for subjects without EAP access (P=.66, partial eta2 = .001). From pretest to 10-week follow-up, the condition-by-EAP-access interaction effect was not statistically significant (P=.21, partial eta2 = .005), so subpopulation analyses were not indicated. The ANCOVA with the full sample found that there were no program effects (P=.17, partial eta2 = .006) at 10-week follow-up.

    Mediator Outcomes: Behavioral Activation, Negative Thoughts, and Knowledge

    From pretest to 6-week follow-up, the ANCOVA with the full sample found statistically significant positive effects for the program on each mediator measure: BADS (P=.004, partial eta2 = .027), ATQ-R (P=.01, partial eta2 = .020), and knowledge (P=.02, partial eta2 = .017). The condition-by-EAP-access interaction effects were not statistically significant on any of the mediator measures, indicating that there was no need for subpopulation analyses. From pretest to 10-week follow-up, the condition-by-EAP-access interaction effects were not statistically significant on any of the mediator measures. The ANCOVA with the full sample found statistically significant program effects on BADS (P=.01, partial eta2 = .021), but not on ATQ-R (P=.34, partial eta2 = .003) or knowledge (P=.55, partial eta2 = .001).

    Worksite Outcomes

    From pretest to 6-week follow-up, the condition-by-EAP-access interaction effects were statistically significant on the WLQ productivity loss measure (P=.048, partial eta2 = .016), the WLQ work absence measure (P=.048, partial eta2 = .016), and the workplace distress measure (P=.03, partial eta2 = .017). Consequently, subpopulation analyses were carried out for these measures only. The ANCOVA with the full sample at 6-week follow-up found statistically significant program effects on WLQ work absence (P=.003, partial eta2 = .032). No statistically significant program effects were found on the following: WLQ productivity loss (P=.20, partial eta2 = .007), WOS absenteeism (P=.16, partial eta2 = .007), WOS presenteeism (P=.09, partial eta2 = .010), WOS engagement (P=.75, partial eta2 = .001), or WOS life satisfaction (P=.12, partial eta2 = .008). However, separate subpopulation analyses at 6-week follow-up on the WLQ productivity loss measure indicated significant positive effects of the program for subjects with EAP access (P=.047, partial eta2 = .052) and no program effects for subjects without EAP access (P=.60, partial eta2 = .002). Similarly, subpopulation analyses at 6-week follow-up on the WLQ work absence measure indicated significant positive effects of the program for subjects with EAP access (P=.02, partial eta2 = .070) and no program effects for subjects without (P=.51, partial eta2 = .002). Lastly, the WOS workplace distress measure indicated significant positive effects of the program for subjects with EAP access (P=.007, partial eta2 = .080) and no program effects for subjects without (P=.64, partial eta2 = .001).

    From pretest to 10-week follow-up, the condition-by-EAP-access interaction effects were statistically significant on the WLQ work absence measure (P=.04, partial eta2 = .016). Consequently, subpopulation analyses were carried out for this measure only. The ANCOVA with the full sample at 10-week follow-up found statistically significant program effects only on the WLQ work absence measure (P=.02, partial eta2 = .022). Separate subpopulation analyses at 10-week follow-up on the WLQ work absence measure indicated significant positive effects of the program for subjects with EAP access (P=.03, partial eta2 = .060) and no program effects for subjects without EAP access (P=.78, partial eta2 = 0).

    Program Utilization, Satisfaction, and Usability

    On average, participants in the treatment arm logged into the MoodHacker app 16.0 times (SD 13.3, range 1-49) for a total duration of 1.3 hours (SD 1.3, range 0-6.5) between pretest and 6-week follow-up. The average rating of program satisfaction was 4.6 (SD 1.0) on a 6-point scale, indicating that the participants were mostly satisfied with the intervention. Participants also completed the System Usability Scale [87] at the 6-week follow-up, which provides a quantitative measure of program ease of use. The average System Usability Scale score was 79.7 (SD 17.1), corresponding to a usability grade of B+ for the intervention program.

    Table 2. ANCOVAa,b results for all outcome measures at 6-week and 10-week follow-up.
    Outcome measure/conditionPretest to 6-week follow-up condition effectPretest to 10-week follow-up condition effect

    		FPPartial eta2FPPartial eta2
    Depression symptoms, PHQ-9c,d






    		All subjects (n=300)6.20.01e.0210.93.34.003

    		EAPf (n=91)9.00.004.093N/AgN/AN/A

    		Non-EAP (n=209)0.20.66.001N/AN/AN/A
    Mediator outcomes






    		BADSh,i (n=300)8.26.004.0276.39.01.021

    		ATQ-Rd,j (n=300)6.09.01.0201.90.17.006

    		Knowledgei (n=300)5.15.02.0170.37.55.001
    Worksite outcomes






    		WLQkproductivity lossd







    		All subjects (n=300)1.66.20.0071.02.31.004


    		EAP (n=91)4.09.047.0522.14.15.027


    		Non-EAP (n=209)0.28.60.0020.10.76.001

    		WLQ work absenced







    		All subjects (n=300)8.69.003.0325.92.02.022


    		EAP (n=91)6.13.02.0705.19.03.060


    		Non-EAP (n=209)0.44.51.0020.08.780

    		WOSlworkplace distressd







    		All subjects (n=300)N/AN/AN/A1.32.25.004


    		EAP (n=91)7.63.007.080N/AN/AN/A


    		Non-EAP (n=209)0.22.64.001N/AN/AN/A

    		WOS absenteeismd (n=300)1.97.16.0071.24.27.004

    		WOS presenteeismd (n=300)2.92.09.0101.40.24.005

    		WOS engagementi (n=300)0.10.75.0010.01.99.001

    		WOS life satisfactioni (n=300)2.50.12.0080.65.42.002

    aANCOVA: analysis of covariance.

    bIntent-to-treat model: missing data were addressed via a single imputation procedure.

    cPHQ-9: Patient Health Questionnaire-9.

    dA higher score represents more dysfunction.

    eValues in italics represent significant results, P<.05.

    fEAP: employee assistance program.

    gN/A: not applicable.

    hBADS: Behavioral Activation for Depression Scale.

    iA lower score represents more dysfunction.

    jATQ-R: Automatic Thoughts Questionnaire-Revised.

    kWLQ: Work Limitations Questionnaire.

    lWOS: Workplace Outcome Suite.


    Principal Findings

    This randomized effectiveness trial examined the effect of the MoodHacker mobile Web app on depression symptoms, important cognitive and behavioral mediators, and workplace outcomes among employed adults with and without access to EAP services. The MoodHacker app produced significant effects from pretest to 6-week follow-up for all subjects compared to alternative care subjects on (1) the clinical outcome measure (ie, depression symptoms), with much stronger results among those with EAP access, (2) all three mediating outcome measures (ie, behavioral activation, negative thoughts, and depression knowledge), and (3) one of the worksite outcome measures (ie, work absence). Among subjects with EAP access, larger effects were found on depression symptoms, productivity loss, work absence, and workplace distress. Significant effects were maintained at 10-week follow-up for work absence for all subjects, with much stronger results among those with EAP access. The effect sizes on depression symptoms in this study (partial eta2 = .021 for the full population and partial eta2 = .093 for those with EAP access, which convert to approximately Cohen’s d=0.30 and 0.64, respectively) are comparable to those reported for previous meta-analyses of self-guided, Internet-based CBT programs (Cohen’s d=0.21-0.31) [42,44].

    These findings suggest that the approach used to activate CBT-based skills in MoodHacker was effective and begin to build an evidence base for light-touch, CBT-based mobile apps for depression self-management. Because program effects were small-to-medium size, modifications to increase the potency of the intervention are warranted. Evidence from prior online CBT-based programs suggests that supporting the mobile intervention with counselors, such as those working in EAPs, is likely to increase both adherence to the app and efficacy in reducing depression symptoms [42,43,47,89].

    At the 10-week assessment, only effects on work absence remained significant. Effects on depression symptoms were no longer significant, possibly because the daily emails ended after 6 weeks; the emails included prompts to view content, introduction of key concepts and skills, tips to optimize use of the program, and encouragement to track mood and activities. Although our results are consistent with a recent meta-analysis of computerized CBT programs showing that results of computer-based CBT programs typically attenuate over time [45], evidence from other studies suggests that app adherence and, thus, efficacy might be improved by extending program prompts and psychoeducational messaging beyond the original 6-week intervention period and/or providing mobile-friendly prompts (eg, text messages and app notifications) in addition to the emails utilized here [65,90]. More research is needed to determine the optimal level and type of program contact that is needed to retain program efficacy.

    Employee Assistance Program Participants Versus Non-Employee Assistance Program Participants

    The inclusion of subjects without access to EAP services provided an important opportunity to evaluate program efficacy with this population and to compare program efficacy for subjects with and without EAP access. It was expected that the subjects with access to EAP services who chose to participate in this study were likely to be quite similar to real-world individuals who might elect to use a mobile or online program in conjunction with those services. Thus, these subjects provided a “real-world” effectiveness trial. The effect sizes found on depression symptoms, work absence, and productivity loss among the targeted EAP population are quite encouraging and suggest that EAPs offering use of the MoodHacker app may reasonably expect to find significant depression-related improvements in their employee populations. Conclusions regarding program effects for non-EAP individuals are less clear.

    In many cases, the subjects without EAP access were recruited without the endorsement of a trusted partner, most notably when recruitment was through entities such as eHow, Chambers of Commerce, eHealth websites, and especially Craigslist. This raises questions regarding the motivation of these subjects for participation. For example, participants who presented to their EAP with depression symptoms and were willing to use a behavior-change program might reasonably be expected to be motivated to change their depression. In contrast, participants recruited from the other entities listed above might have been more motivated by the financial compensation offered, rather than a desire to improve their depression symptoms. Further evidence of skewed motivations in this recruitment group is indicated in the very high numbers of individuals who were screened out by reporting much higher than expected rates of mania, and to a lesser extent, depressive symptoms during the online screening.

    Analyses of baseline data indicated that the non-EAP subjects had lower incomes, were less likely to be fully employed, and had less education. Since these three factors are also related to poorer outcomes in depression, these factors may at least partially explain why the program was not as effective for individuals with no EAP access [91,92]. While the veracity of such attributions regarding motivation for participation is difficult to ascertain, the lack of program effects on depression symptoms in the non-EAP participants is consistent with this notion.

    Study Limitations

    We acknowledge several limitations in this initial efficacy trial and offer some caution in interpreting the findings. First, although random assignment was used, all the participants volunteered for the study and thus represent a convenience sample of interested individuals and cannot be considered representative of the general population. Second, participants completed self-report surveys, the validity and reliability of which may be somewhat suspect. Third, the reliability of some measures is only moderate and this may have attenuated the effect size of the intervention effects found in the study. Fourth, while the attrition rates in the study were relatively low, subjects were compensated for completing assessments. Thus, it cannot be concluded that the subject completion rate found here would occur at the same rate without compensation for participation. Lastly, attenuation of outcomes at 10-week follow-up suggests a need for more potent activation of CBT-based skills or a need for extended app contacts to drive continued engagement. Future research will explore the frequency and type of app contacts to optimize extended engagement and improve both short- and long-term efficacy of this light-touch, mobile approach to activating use of CBT skills to self-manage depressive symptomatology.

    Summary

    Given the high prevalence of depression and the fact that most adults with depression never receive treatment, there is a critical need for effective interventions that can be widely and cost-effectively disseminated through multiple delivery channels. The MoodHacker mobile Web app has demonstrated potential for dissemination (1) as a self-guided intervention for individuals unwilling or unable to seek in-person depression services and (2) through EAP and similar health and wellness organizations supporting employed adults and their families. Ideally, exposure to MoodHacker needs to be extended beyond the 6-week time frame to maintain user engagement and improve longer-term efficacy. Further, the implementation and integration of MoodHacker within EAPs and similar organizations that can provide guidance from counselors seems likely to augment the effectiveness of the MoodHacker app.

    Acknowledgments

    This research was funded by a grant from the US National Institutes of Health, National Institute of Mental Health (R44MH073280). The project required the efforts of a multidisciplinary research and development team including Jasmine Freese, Amanda Perez, Beth Machamer, Percy Perez, Brad Pitcher, Nick Martini, Diana Robson, Dave Merwin, James Madson, Liana Herman, and Theresa Mulvihill. We would also like to thank the team at Chestnut Global Partners EAP for their help with participant recruitment. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institute of Mental Health or the National Institutes of Health.

    Conflicts of Interest

    Amelia Birney was the study Principal Investigator. She is employed as a Behavioral Scientist at ORCAS, a health innovation and technology company that creates self-management programs to improve physical and emotional well-being. Software development was funded with a Small Business Innovation Research grant, which was designed to stimulate research and product development. Thus, improved versions of MoodHacker are being marketed. Ms Gunn and Mr Russell are no longer employed by ORCAS; they will derive no financial benefit from sales of the MoodHacker app or from publication of this research. Ms Birney and Dr Ary remain employees of ORCAS with some potential for financial benefit from sales of the MoodHacker app.

    ‎

    Multimedia Appendix 1

    CONSORT-EHEALTH checklist V1.6.1 [71].

    PDF File (Adobe PDF File), 968KB
    ‎

    Multimedia Appendix 2

    Pretest, 6-week follow-up, and 10-week follow-up descriptive statistics and ANCOVA results for all outcome measures.

    PDF File (Adobe PDF File), 126KB
    1. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry 2005 Jun;62(6):593-602. [CrossRef] [Medline]
    2. Kessler RC, Chiu WT, Demler O, Merikangas KR, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry 2005 Jun;62(6):617-627 [FREE Full text] [CrossRef] [Medline]
    3. Kessler RC. The costs of depression. Psychiatr Clin North Am 2012 Mar;35(1):1-14 [FREE Full text] [CrossRef] [Medline]
    4. Moussavi S, Chatterji S, Verdes E, Tandon A, Patel V, Ustun B. Depression, chronic diseases, and decrements in health: Results from the World Health Surveys. Lancet 2007 Sep 8;370(9590):851-858. [CrossRef] [Medline]
    5. Cuijpers P, de Graaf R, van Dorsselaer S. Minor depression: Risk profiles, functional disability, health care use and risk of developing major depression. J Affect Disord 2004 Apr;79(1-3):71-79. [CrossRef] [Medline]
    6. Lewinsohn PM, Shankman SA, Gau JM, Klein DN. The prevalence and co-morbidity of subthreshold psychiatric conditions. Psychol Med 2004 May;34(4):613-622. [CrossRef] [Medline]
    7. Druss BG, Schlesinger M, Allen HM. Depressive symptoms, satisfaction with health care, and 2-year work outcomes in an employed population. Am J Psychiatry 2001 May;158(5):731-734. [Medline]
    8. Lewinsohn PM, Solomon A, Seeley JR, Zeiss A. Clinical implications of "subthreshold" depressive symptoms. J Abnorm Psychol 2000 May;109(2):345-351. [Medline]
    9. Rapaport MH, Judd LL. Minor depressive disorder and subsyndromal depressive symptoms: Functional impairment and response to treatment. J Affect Disord 1998 Mar;48(2-3):227-232. [Medline]
    10. Gotlib IH, Lewinsohn PM, Seeley JR. Symptoms versus a diagnosis of depression: Differences in psychosocial functioning. J Consult Clin Psychol 1995 Feb;63(1):90-100. [Medline]
    11. Fergusson DM, Horwood LJ, Ridder EM, Beautrais AL. Subthreshold depression in adolescence and mental health outcomes in adulthood. Arch Gen Psychiatry 2005 Jan;62(1):66-72. [CrossRef] [Medline]
    12. Keenan K, Hipwell A, Feng X, Babinski D, Hinze A, Rischall M, et al. Subthreshold symptoms of depression in preadolescent girls are stable and predictive of depressive disorders. J Am Acad Child Adolesc Psychiatry 2008 Dec;47(12):1433-1442 [FREE Full text] [CrossRef] [Medline]
    13. Shankman SA, Lewinsohn PM, Klein DN, Small JW, Seeley JR, Altman SE. Subthreshold conditions as precursors for full syndrome disorders: A 15-year longitudinal study of multiple diagnostic classes. J Child Psychol Psychiatry 2009 Dec;50(12):1485-1494 [FREE Full text] [CrossRef] [Medline]
    14. Greenberg PE, Fournier A, Sisitsky T, Pike CT, Kessler RC. The economic burden of adults with major depressive disorder in the United States (2005 and 2010). J Clin Psychiatry 2015 Feb;76(2):155-162 [FREE Full text] [CrossRef] [Medline]
    15. Birnbaum HG, Kessler RC, Kelley D, Ben-Hamadi R, Joish VN, Greenberg PE. Employer burden of mild, moderate, and severe major depressive disorder: Mental health services utilization and costs, and work performance. Depress Anxiety 2010;27(1):78-89. [CrossRef] [Medline]
    16. Cuijpers P, Smit F, Oostenbrink J, de Graaf R, Ten Have M, Beekman A. Economic costs of minor depression: A population-based study. Acta Psychiatr Scand 2007 Mar;115(3):229-236. [CrossRef] [Medline]
    17. Ekman M, Granström O, Omérov S, Jacob J, Landén M. The societal cost of depression: Evidence from 10,000 Swedish patients in psychiatric care. J Affect Disord 2013 Sep 25;150(3):790-797. [CrossRef] [Medline]
    18. Tomonaga Y, Haettenschwiler J, Hatzinger M, Holsboer-Trachsler E, Rufer M, Hepp U, et al. The economic burden of depression in Switzerland. Pharmacoeconomics 2013 Mar;31(3):237-250. [CrossRef] [Medline]
    19. Kessler RC, Zhao S, Katz SJ, Kouzis AC, Frank RG, Edlund M, et al. Past-year use of outpatient services for psychiatric problems in the National Comorbidity Survey. Am J Psychiatry 1999 Jan;156(1):115-123. [Medline]
    20. Wang PS, Simon GE, Avorn J, Azocar F, Ludman EJ, McCulloch J, et al. Telephone screening, outreach, and care management for depressed workers and impact on clinical and work productivity outcomes: A randomized controlled trial. JAMA 2007 Sep 26;298(12):1401-1411 [FREE Full text] [CrossRef] [Medline]
    21. Lewinsohn PM, Antonuccio DO, Steinmetz JL, Teri L. The Coping With Depression Course: A Psychoeducational Intervention for Unipolar Depression. Eugene, OR: Castalia Publishing Company; 1984.
    22. Rohde P, Lewinsohn PM, Clarke GN, Hops H, Seeley JR. The Adolescent Coping With Depression Course: A cognitive-behavioral approach to the treatment of adolescent depression. In: Hibbs ED, Jensen PS, editors. Psychosocial Treatments for Child and Adolescent Disorders: Empirically Based Strategies for Clinical Practice. 2nd edition. Washington, DC: American Psychological Association; 2005:219-237.
    23. Ferster CB. Animal behavior and mental illness. Psychol Rec 1966 Jul 01;16:345-356.
    24. Lewinsohn P, Weinstein M, Shaw D. Depression: A clinical-research approach. In: Rubin RD, Frank M, editors. Advances in Behavior Therapy. New York, NY: Academic Press; 1969:231-240.
    25. Beck AT. Depression: Clinical, Experimental, and Theoretical Aspects. New York, NY: Harper & Row; 1967.
    26. Ellis A, Harper RA. A Guide to Rational Living. Hollywood, CA: Wilshire Book Co; 1961.
    27. Seligman MEP. Helplessness: On Depression, Development, and Death. San Francisco, CA: WH Freeman and Company; 1975.
    28. Cuijpers P, Muñoz RF, Clarke GN, Lewinsohn PM. Psychoeducational treatment and prevention of depression: The "Coping with Depression" course thirty years later. Clin Psychol Rev 2009 Jul;29(5):449-458. [CrossRef] [Medline]
    29. Sin NL, Lyubomirsky S. Enhancing well-being and alleviating depressive symptoms with positive psychology interventions: A practice-friendly meta-analysis. J Clin Psychol 2009 May;65(5):467-487. [CrossRef] [Medline]
    30. Karwoski L, Garratt GM, Ilardi SS. On the integration of cognitive-behavioral therapy for depression and positive psychology. J Cogn Psychother 2006;20(2):159-170. [CrossRef]
    31. Seligman ME, Steen TA, Park N, Peterson C. Positive psychology progress: Empirical validation of interventions. Am Psychol 2005 Aug;60(5):410-421. [CrossRef] [Medline]
    32. Hayes SC, Strosahl KD, Wilson KG. Acceptance and Commitment Therapy: An Experiential Approach to Behavior Change. New York, NY: The Guilford Press; 2003.
    33. Teasdale JD, Segal ZV, Williams JM, Ridgeway VA, Soulsby JM, Lau MA. Prevention of relapse/recurrence in major depression by mindfulness-based cognitive therapy. J Consult Clin Psychol 2000 Aug;68(4):615-623. [Medline]
    34. Bedard M, Felteau M, Gibbons C, Klein R, Mazmanian D, Fedyk K, et al. A mindfulness-based intervention to improve quality of life among individuals who sustained traumatic brain injuries: One-year follow-up. J Cogn Rehabil 2005;23(1):8-13.
    35. Feldman G, Greeson J, Senville J. Differential effects of mindful breathing, progressive muscle relaxation, and loving-kindness meditation on decentering and negative reactions to repetitive thoughts. Behav Res Ther 2010 Oct;48(10):1002-1011 [FREE Full text] [CrossRef] [Medline]
    36. Wood AM, Froh JJ, Geraghty AW. Gratitude and well-being: A review and theoretical integration. Clin Psychol Rev 2010 Nov;30(7):890-905. [CrossRef] [Medline]
    37. Sheldon KM, Lyubomirsky S. How to increase and sustain positive emotion: The effects of expressing gratitude and visualizing best possible selves. J Posit Psychol 2006 Apr;1(2):73-82. [CrossRef]
    38. Emmons RA, McCullough ME. Counting blessings versus burdens: An experimental investigation of gratitude and subjective well-being in daily life. J Pers Soc Psychol 2003 Feb;84(2):377-389. [Medline]
    39. Lopez SJ, Floyd RK, Ulven JC, Snyder CR. Hope therapy: Helping clients build a house of hope. In: Snyder CR, editor. Handbook of Hope: Theory, Measures, and Applications. San Diego, CA: Academic Press; 2000:123-150.
    40. Lopez S, Snyder C, Magyar-Moe J, Edwards L, Pedrotti J, Janowski K, et al. Strategies for accentuating hope. In: Linley PA, Joseph S, editors. Positive Psychology in Practice. Hoboken, NJ: John Wiley & Sons; 2004:388-404.
    41. Sheldon KM, Lyubomirsky S. Is it possible to become happier? (And if so, how?). Soc Personal Psychol Compass 2007 Nov;1(1):129-145. [CrossRef]
    42. Johansson R, Andersson G. Internet-based psychological treatments for depression. Expert Rev Neurother 2012 Jul;12(7):861-869; quiz 870. [CrossRef] [Medline]
    43. Richards D, Viganó N. Online counseling: A narrative and critical review of the literature. J Clin Psychol 2013 Sep;69(9):994-1011. [CrossRef] [Medline]
    44. Cuijpers P, Donker T, Johansson R, Mohr DC, van Straten A, Andersson G. Self-guided psychological treatment for depressive symptoms: A meta-analysis. PLoS One 2011;6(6):e21274 [FREE Full text] [CrossRef] [Medline]
    45. So M, Yamaguchi S, Hashimoto S, Sado M, Furukawa TA, McCrone P. Is computerised CBT really helpful for adult depression? A meta-analytic re-evaluation of CCBT for adult depression in terms of clinical implementation and methodological validity. BMC Psychiatry 2013;13:113 [FREE Full text] [CrossRef] [Medline]
    46. Renton T, Tang H, Ennis N, Cusimano MD, Bhalerao S, Schweizer TA, et al. Web-based intervention programs for depression: A scoping review and evaluation. J Med Internet Res 2014;16(9):e209 [FREE Full text] [CrossRef] [Medline]
    47. Saddichha S, Al-Desouki M, Lamia A, Linden IA, Krausz M. Online interventions for depression and anxiety - A systematic review. Health Psychol Behav Med 2014 Jan 1;2(1):841-881 [FREE Full text] [CrossRef] [Medline]
    48. Griffiths KM, Farrer L, Christensen H. The efficacy of Internet interventions for depression and anxiety disorders: A review of randomised controlled trials. Med J Aust 2010 Jun 7;192(11 Suppl):S4-S11. [Medline]
    49. Donker T, Petrie K, Proudfoot J, Clarke J, Birch M, Christensen H. Smartphones for smarter delivery of mental health programs: A systematic review. J Med Internet Res 2013;15(11):e247 [FREE Full text] [CrossRef] [Medline]
    50. Proudfoot J, Clarke J, Birch M, Whitton AE, Parker G, Manicavasagar V, et al. Impact of a mobile phone and Web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: A randomised controlled trial. BMC Psychiatry 2013;13:312 [FREE Full text] [CrossRef] [Medline]
    51. Whitton AE, Proudfoot J, Clarke J, Birch M, Parker G, Manicavasagar V, et al. Breaking open the black box: Isolating the most potent features of a Web and mobile phone-based intervention for depression, anxiety, and stress. JMIR Ment Health 2015;2(1):e3 [FREE Full text] [CrossRef] [Medline]
    52. Ly KH, Trüschel A, Jarl L, Magnusson S, Windahl T, Johansson R, et al. Behavioural activation versus mindfulness-based guided self-help treatment administered through a smartphone application: A randomised controlled trial. BMJ Open 2014;4(1):e003440 [FREE Full text] [CrossRef] [Medline]
    53. Kauer SD, Reid SC, Crooke AH, Khor A, Hearps SJ, Jorm AF, et al. Self-monitoring using mobile phones in the early stages of adolescent depression: Randomized controlled trial. J Med Internet Res 2012 Jun;14(3):e67 [FREE Full text] [CrossRef] [Medline]
    54. Reid SC, Kauer SD, Hearps SJ, Crooke AH, Khor AS, Sanci LA, et al. A mobile phone application for the assessment and management of youth mental health problems in primary care: A randomised controlled trial. BMC Fam Pract 2011;12:131 [FREE Full text] [CrossRef] [Medline]
    55. Watts S, Mackenzie A, Thomas C, Griskaitis A, Mewton L, Williams A, et al. CBT for depression: A pilot RCT comparing mobile phone vs. computer. BMC Psychiatry 2013;13:49 [FREE Full text] [CrossRef] [Medline]
    56. Burns MN, Begale M, Duffecy J, Gergle D, Karr CJ, Giangrande E, et al. Harnessing context sensing to develop a mobile intervention for depression. J Med Internet Res 2011;13(3):e55 [FREE Full text] [CrossRef] [Medline]
    57. Clarke G, Reid E, Eubanks D, O'Connor E, DeBar LL, Kelleher C, et al. Overcoming depression on the Internet (ODIN): A randomized controlled trial of an Internet depression skills intervention program. J Med Internet Res 2002 Dec;4(3):e14 [FREE Full text] [CrossRef] [Medline]
    58. Clarke G, Eubanks D, Reid E, Kelleher C, O'Connor E, DeBar LL, et al. Overcoming Depression on the Internet (ODIN) (2): A randomized trial of a self-help depression skills program with reminders. J Med Internet Res 2005;7(2):e16 [FREE Full text] [CrossRef] [Medline]
    59. Spek V, Nyklícek I, Smits N, Cuijpers P, Riper H, Keyzer J, et al. Internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years old: A randomized controlled clinical trial. Psychol Med 2007 Dec;37(12):1797-1806. [CrossRef] [Medline]
    60. Spek V, Cuijpers P, Nyklícek I, Smits N, Riper H, Keyzer J, et al. One-year follow-up results of a randomized controlled clinical trial on Internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years. Psychol Med 2008 May;38(5):635-639. [CrossRef] [Medline]
    61. Sanou B. ICT Facts and Figures. Geneva, Switzerland: International Telecommunication Union; 2014 Apr. Mobile-broadband uptake continues to grow at double-digit rates   URL: http://www.itu.int/en/ITU-D/Statistics/Documents/facts/ICTFactsFigures2014-e.pdf [accessed 2015-05-27] [WebCite Cache]
    62. Smith A. Pew Research Center. Washington, DC: Pew Internet & American Life Project; 2015 Apr 01. US smartphone use in 2015   URL: http://www.pewinternet.org/2015/04/01/us-smartphone-use-in-2015/ [accessed 2015-05-04] [WebCite Cache]
    63. Heron KE, Smyth JM. Ecological momentary interventions: Incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol 2010 Feb;15(Pt 1):1-39 [FREE Full text] [CrossRef] [Medline]
    64. Proudfoot J, Parker G, Hadzi PD, Manicavasagar V, Adler E, Whitton A. Community attitudes to the appropriation of mobile phones for monitoring and managing depression, anxiety, and stress. J Med Internet Res 2010;12(5):e64 [FREE Full text] [CrossRef] [Medline]
    65. Aguilera A, Muñoz RF. Text messaging as an adjunct to CBT in low-income populations: A usability and feasibility pilot study. Prof Psychol Res Pr 2011 Dec 1;42(6):472-478 [FREE Full text] [CrossRef] [Medline]
    66. Dennison L, Morrison L, Conway G, Yardley L. Opportunities and challenges for smartphone applications in supporting health behavior change: Qualitative study. J Med Internet Res 2013;15(4):e86 [FREE Full text] [CrossRef] [Medline]
    67. Depp CA, Mausbach B, Granholm E, Cardenas V, Ben-Zeev D, Patterson TL, et al. Mobile interventions for severe mental illness: Design and preliminary data from three approaches. J Nerv Ment Dis 2010 Oct;198(10):715-721 [FREE Full text] [CrossRef] [Medline]
    68. Aguilera A, Muench F. There's an app for that: Information technology applications for cognitive behavioral practitioners. Behav Ther (N Y N Y) 2012 Apr;35(4):65-73 [FREE Full text] [Medline]
    69. Shen N, Levitan M, Johnson A, Bender JL, Hamilton-Page M, Jadad AA, et al. Finding a depression app: A review and content analysis of the depression app marketplace. JMIR Mhealth Uhealth 2015;3(1):e16 [FREE Full text] [CrossRef] [Medline]
    70. Snyder CR, Lopez SJ. The Oxford Handbook of Positive Psychology. 2nd edition. New York, NY: Oxford University Press; 2011.
    71. Eysenbach G. CONSORT-EHEALTH: Implementation of a checklist for authors and editors to improve reporting of Web-based and mobile randomized controlled trials. Stud Health Technol Inform 2013;192:657-661. [Medline]
    72. Smith M, Segal R, Segal J. Help Guide. 2014 Nov. Dealing with depression   URL: http://www.helpguide.org/articles/depression/dealing-with-depression.htm [accessed 2015-01-09] [WebCite Cache]
    73. Mental Health America. Depression   URL: http://www.mentalhealthamerica.net/conditions/depression [accessed 2015-01-09] [WebCite Cache]
    74. National Institute of Mental Health. Depression   URL: http://www.nimh.nih.gov/health/topics/depression/index.shtml [accessed 2015-12-26] [WebCite Cache]
    75. Kroenke K, Spitzer RL. The PHQ-9: A new depression diagnostic and severity measure. Psychiatr Ann 2002 Sep;32(9):509-515.
    76. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: Validity of a brief depression severity measure. J Gen Intern Med 2001 Sep;16(9):606-613 [FREE Full text] [Medline]
    77. Kanter JW, Mulick PS, Busch AM, Berlin KS, Martell CR. The Behavioral Activation for Depression Scale (BADS): Psychometric properties and factor structure. J Psychopathol Behav Assess 2006 Oct 25;29(3):191-202. [CrossRef]
    78. Manos RC, Kanter JW, Luo W. The behavioral activation for depression scale-short form: Development and validation. Behav Ther 2011 Dec;42(4):726-739. [CrossRef] [Medline]
    79. Kendall PC, Howard BL, Hays RC. Self-referent speech and psychopathology: The balance of positive and negative thinking. Cognit Ther Res 1989 Dec;13(6):583-598. [CrossRef]
    80. Lerner D, Amick BC, Rogers WH, Malspeis S, Bungay K, Cynn D. The Work Limitations Questionnaire. Med Care 2001 Jan;39(1):72-85. [Medline]
    81. Lerner D, Amick BC, Lee JC, Rooney T, Rogers WH, Chang H, et al. Relationship of employee-reported work limitations to work productivity. Med Care 2003 May;41(5):649-659. [CrossRef] [Medline]
    82. Sanderson K, Tilse E, Nicholson J, Oldenburg B, Graves N. Which presenteeism measures are more sensitive to depression and anxiety? J Affect Disord 2007 Aug;101(1-3):65-74. [CrossRef] [Medline]
    83. Lerner D, Rogers W, Chang H. Technical Report: Scoring the Short Form of the Work Limitations Questionnaire (WLQ-SF). Boston, MA: The Health Institute of the Tufts-New England Medical Center; 2009.
    84. Lerner D. WLQ-2 Question Time Loss Module. Boston, MA: The Health Institute of the Tufts-New England Medical Center; 2002.
    85. Computing the Productivity Loss Due to Work Absences. Boston, MA: The Health Institute of the Tufts-New England Medical Center; 2005.
    86. Lennox RD, Sharar D, Schmitz E, Goehner DB. Development and validation of the Chestnut Global Partners Workplace Outcome Suite. J Workplace Behav Health 2010 May 11;25(2):107-131. [CrossRef]
    87. Sauro J. A Practical Guide to the System Usability Scale: Background, Benchmarks, and Best Practices. Denver, CO: Measuring Usability LLC; 2011.
    88. Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: Adding an adjective rating scale. J Usability Stud 2009;4(3):114-123 Determining what individual SUS scores mean: Adding an adjective rating scale [FREE Full text] [WebCite Cache]
    89. Mohr DC, Cuijpers P, Lehman K. Supportive accountability: A model for providing human support to enhance adherence to eHealth interventions. J Med Internet Res 2011;13(1):e30 [FREE Full text] [CrossRef] [Medline]
    90. Kok G, Bockting C, Burger H, Smit F, Riper H. Mobile cognitive therapy: Adherence and acceptability of an online intervention in remitted recurrently depressed patients. Internet Interv 2014;1(2):65-73.
    91. Wang JL, Schmitz N, Dewa CS. Socioeconomic status and the risk of major depression: The Canadian National Population Health Survey. J Epidemiol Community Health 2010 May;64(5):447-452. [CrossRef] [Medline]
    92. Santiago CD, Wadsworth ME, Stump J. Socioeconomic status, neighborhood disadvantage, and poverty-related stress: Prospective effects on psychological syndromes among diverse low-income families. J Econ Psychol 2011 Mar;32(2):218-230. [CrossRef]

    ‎
    ANCOVA: analysis of covariance
    ANOVA: analysis of variance
    ATQ-R: Automatic Thoughts Questionnaire-Revised
    BA: Bachelor of Arts
    BADS: Behavioral Activation for Depression Scale
    BS: Bachelor of Science
    CBT: cognitive behavioral therapy
    CWD: Coping with Depression
    DSM-IV: Diagnostic and Statistical Manual of Mental Disorders, 4th edition
    EAP: employee assistance program
    EMA: ecological momentary assessment
    GED: General Educational Development
    IRB: Institutional Review Board
    ITT: intent to treat
    N/A: not applicable
    PHQ-2: Patient Health Questionnaire-2
    PHQ-9: Patient Health Questionnaire-9
    SMS: short message service
    WLQ: Work Limitations Questionnaire
    WOS: Workplace Outcome Suite

    Edited by G Eysenbach; submitted 13.01.15; peer-reviewed by M Välimäki, A Aguilera; comments to author 25.02.15; revised version received 27.05.15; accepted 07.10.15; published 26.01.16

    Copyright

    ©Amelia J Birney, Rebecca Gunn, Jeremy K Russell, Dennis V Ary. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 26.01.2016.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.