Published on in Vol 13 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/50006, first published .
An App-Based Cognitive Behavioral Therapy Program Tailored for College Students: Randomized Controlled Trial

An App-Based Cognitive Behavioral Therapy Program Tailored for College Students: Randomized Controlled Trial

An App-Based Cognitive Behavioral Therapy Program Tailored for College Students: Randomized Controlled Trial

Authors of this article:

Min Hee Kim1 Author Orcid Image ;   Yeon-kug Moon2 Author Orcid Image ;   Kyong-Mee Chung1 Author Orcid Image

1Department of Psychology, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul, Republic of Korea

2Department of Artificial Intelligence and Data Science, Sejong University, Seoul, Republic of Korea

Corresponding Author:

Kyong-Mee Chung, PhD


Background: Technology-based cognitive behavioral therapy programs are accessible interventions to address mental health challenges, particularly among college students. Despite their potential, low adherence rates remain a key challenge.

Objective: This study aims to assess the effects of the tailored content and gamification elements of the Mind Booster Green program on reducing depressive symptoms and improving college life adjustment.

Methods: A randomized, unblinded controlled trial was conducted among college students. All study procedures were conducted remotely using web-based tools. The participants were randomly assigned to the intervention or waitlist control groups. The intervention group used Mind Booster Green, an app-based self-help cognitive behavioral therapy program for 1 month. The program included tailored case stories and gamification elements, such as point and level systems, to enhance user engagement and adherence. Outcomes were self-assessed using web-based questionnaires and included changes in depressive symptoms, college life adjustment, and negative and positive automatic thoughts. The usability of the app was also evaluated. Outcomes were measured at 3 time points: preintervention, postintervention, and at a 2-month follow-up (F/U), using validated and standardized tools.

Results: A total of 170 individuals (mean age 22.60, SD 3.37 years; 136/170, 80% female) participated in the study. A chi-square analysis revealed no significant differences between the two groups at baseline in terms of age, sex, or class year (P>.05). A generalized estimating equation analysis revealed significant time×group interactions for all variables. Compared to the control group, the intervention group showed greater improvements across all outcomes, with between-group effect sizes ranging from -0.78 to 0.49. For derpessive symptoms, large within-group effect size were observed (Patient Health Questionnaire-9: pre to post, Cohen d=1.12; pre to F/U, Cohen d=1.15; Beck Depression Inventory-II: pre to post, Cohen d=0.90; pre to F/U, Cohen d=1.04). Large within-group effect size was also found for adjustment to college life (Student Adaptation to College Questionnaire–Revised: pre to post, Cohen d=–0.87; pre to F/U, Cohen d=-0.85), and moderate effect for negative automatic thoughts (Automatic Thought Questionnaire–Negative, Short Form: pre to post, Cohen d=0.36; pre to F/U, Cohen d=0.58) and positive automatic thoughts (Automatic Thought Questionnaire—Positive, Short Form: pre to post, Cohen d=–0.45; pre to F/U, Cohen d=-0.44). Adherence rates were 89% and 99% for the intervention and control groups, respectively. The usability test results, assessed using the Mobile App Rating Scale, showed an overall score of 3.88, with scores above the medium level in the engagement, functionality, aesthetics, and information quality categories.

Conclusions: Mind Booster Green demonstrated substantial potential as a complementary interventio to traditional psychological services for college students, providing a cost-effective and scalable solution for mental health issues. Future research should explore the applicability of this program in diverse populations.

Trial Registration: Korean Clinical Trial Registry (Clinical Research Information Service) KCT0009758 (retrospectively registered); https://cris.nih.go.kr/cris/search/detailSearch.do?seq=27868&search_page=L

JMIR Mhealth Uhealth 2025;13:e50006

doi:10.2196/50006

Keywords



Cognitive behavioral therapy (CBT) is an evidence-based treatment with substantial evidence supporting its effectiveness in alleviating depressive symptoms [1]. However, delivery constraints, such as requiring 12‐16 weeks of face-to-face treatment by a professional, have hindered its widespread dissemination [2]. Recent advances in digital technology, including smartphones, have led to the development of technology-based CBT (t-CBT) programs that use digital tools. Several studies have demonstrated the effectiveness of these programs in reducing depressive symptoms [3-6]. With its advantages, such as high accessibility, low cost, and minimal stigmatization, t-CBT is gaining attention as an innovative treatment delivery method that can supplement or even provide an alternative to traditional face-to-face CBT [7].

However, participation in t-CBT interventions relies on users’ willingness and motivation, resulting in the need to address issues such as low engagement and high dropout rates. For example, meta-analyses have reported user adherence rates of only 17%‐26% [8,9], and usage surveys of real-world open-access unguided programs have reported much lower rates of approximately 4% [10]. The degree of adherence to an intervention program can be linked to its effectiveness [11]; therefore, the need to consider and research strategies to improve usability, user engagement, and adherence is increasing [12].

Tailoring has recently been proposed as a strategy for enhancing user engagement and adherence. This strategy involves personalizing an intervention’s content and layout based on users’ demographic and psychological characteristics and use context [13]. Tailoring is particularly suitable for diagnostic groups with heterogeneous symptoms or demographic factors, such as individuals with depression, and is achieved by clearly defining the treatment target group based on specific factors (eg, age, occupation, socioeconomic status, and ethnicity) and developing appropriate treatment strategies accordingly [14,15]. Tailored content can provide personally relevant information directly to users, thereby increasing the initial uptake and use of an app and facilitating changes in user attitudes or behaviors [16]. In the context of t-CBT, tailoring strategies can be approached in several ways, including (1) providing content that reflects the characteristics and experiences of the target population [17-20], (2) developing personalized treatment plans according to individuals’ diagnoses or symptoms [21,22], and (3) enabling users to customize features such as menus, tools, and notifications [23]. Tailored mental health intervention programs have been generally reported to positively affect user adherence, thereby enhancing program effectiveness and user satisfaction [16,24,25].

Among the aspects of tailoring, providing content that reflects the characteristics and experiences of the target population is suggested to facilitate users’ acquisition of emotional, cognitive, and behavioral skills without expert assistance [26,27]. In practice, t-CBT uses targeted audience-specific examples, language, and various multimedia formats (eg, text, video, and pictures) to deliver psychoeducational content, providing the necessary information and modeling of skills they need to learn to be delivered to users more effectively [24]. For example, Strecher et al [20] found that providing tailored fictional success stories reflecting user demographics such as sex, age, race, marital status, and smoking-related factors increased long-term engagement in a smoking cessation program, which was linked to program effectiveness.

Gamification, which involves applying game elements to nongame digital platforms (such as web- or app-based systems) [28], is another strategy for encouraging user engagement and adherence. Gamification has been reported to increase user motivation and engagement, make interactions with app-based programs enjoyable, and positively influence behavioral changes related to physical health and psychological well-being [29,30]. In technology-based mental health interventions, gamification is suggested to play a role in increasing app use and user engagement and supporting the delivery of the intervention’s active ingredients, thereby enhancing therapeutic outcomes [31]. In a previous meta-analysis, Cheng and Ebrahimi [32] showed that gamified interventions are more effective than nongamified ones in reducing depressive and anxiety symptoms. In the context of t-CBT for mental health, gamification has been implemented using avatars [33,34], storytelling, and reward systems [35,36]. Specifically, several self-management program studies have shown that positive reinforcement such as points, badges, digital rewards, and tangible prizes have been shown to effectively promote health-related target behaviors [37]. These strategies must be considered for active applications in t-CBT to encourage users to log in regularly, use the app, and complete in-app activities [38].

Although t-CBT has primarily been developed and deployed in populations with specific psychiatric conditions, interest in its application in younger populations, particularly college students, is growing. Depression is a common mental health concern among college students [39,40] and can interfere with academic retention [41], career development [42], and social relationships [43], ultimately affecting their overall quality of life [44]. The increasing prevalence of depression among college students has become a social concern for clinicians and mental health professionals [45,46]. Institutional efforts, such as student counseling services, aim to address students’ mental health needs; however, actual usage rates are low because of long wait times and concerns about social stigma [47-50]. In this context, t-CBT may serve as a useful means of addressing such difficulties. Given college students’ high smartphone penetration and favorable attitudes toward app-based programs [51,52], t-CBT holds significant potential for improving access to mental health care and addressing the unmet needs of this population.

Building on the existing research, two strategies can be applied to t-CBT programs aimed at reducing depressive symptoms among college students. First, programs should be tailored to the cognitive, behavioral, and emotional characteristics of depressive symptoms experienced by college students, as well as stressors related to college life. Second, positive reinforcement strategies should be incorporated through gamification to encourage college students to use t-CBT programs voluntarily. This is based on research findings that younger digital natives [53], such as current college students, are more likely to find gamified products useful and enjoyable [54]; moreover, achievement-related gamification features, including badges and upgrades, have a more positive impact on this group than on older groups [55].

Despite its potential, relatively few studies have focused on developing and validating t-CBT programs that incorporate tailoring or gamification to alleviate depression among college students. While several studies have adapted interventions originally designed for the general adult populations [56-58], such efforts often lack sufficient consideration for the distinctive psychological and contextual needs of college students. Nevertheless, some studies have indicated the potential of tailored t-CBT programs for this population. Mullin et al [18] demonstrated significant reductions in depressive and anxiety symptoms among college students using a tailored therapist-guided CBT program (UniWellbeing). Similarly, Lattie et al [59] reported increased mental health literacy and high use rates among students who used a tailored, unguided CBT program (IntelliCare). Recent evidence from an Asian context supports the effectiveness of internet-based CBT programs tailored for local college students, further suggesting their broader applicability [60]. In Korea, some CBT programs originally developed for adults have been evaluated among college students [61]; however, such studies remain limited. Furthermore, studies incorporating gamification elements that are explicitly designed to enhance voluntary engagement and sustained use are scarce, indicating a notable gap and underscoring the need for additional research.

To address this gap, this study developed and evaluated the effectiveness of Mind Booster Green, a tailored, app-based self-help CBT program for reducing depressive symptoms among college students. Changes in depressive symptoms and adaptation to college life were assessed to verify the effectiveness of the program. Additionally, changes in negative and positive automatic thoughts were examined to verify the applicability of CBT mechanisms to students. App usability was evaluated using standardized measures of engagement, functionality, aesthetics, and information quality.


Recruitment

Participants were recruited through advertisements on social media (eg, Facebook and Naver) and web-based communities popular among college students and young adults (eg, Everytime and job search cafés). Individuals had to meet the following inclusion criteria: (1) undergraduate or graduate students; (2) native Korean speakers with no difficulty using smartphones; (3) used a smartphone with iOS 12 or higher or Android 8 or higher; (4) scored 5 or higher on the Patient Health Questionnaire-9 (PHQ-9), indicating mild depression, and less than 1 on the suicide item, indicating a low risk of suicide; and (5) were not currently receiving other mental health services (eg, medication, psychotherapy, or counseling). The participants received an explanation of the study through a video posted on the study website and signed an electronic consent form. Additionally, under institutional review board (IRB) approval, they submitted a copy of their ID to verify their identity.

Study Setting

The study was conducted remotely using web-based tools in South Korea from June 2021 to March 2022. All study procedures, including recruitment, screening, consent, intervention delivery, and outcome assessments, were conducted remotely owing to the impact of COVID-19. Data were collected through Qualtrics (Qualtrics), and survey links were delivered individually via a dedicated social networking service (SNS) channel. All participant communications, including survey timing notifications, survey links, reminders, inquiries, and risk issues, were managed through this channel. All procedures were performed by trained researchers as listed in the IRB-approved protocol.

Measures

PHQ-9

The Korean version of the PHQ-9, developed by Kroenke et al [62] and validated by Park et al [63], was used to screen participants and measure changes in depression severity. The PHQ-9 consists of 9 items that assess depressive symptoms experienced over the past 2 weeks, rated on a 4-point Likert scale from 0=not at all to 3=nearly every day. It was administered during the screening to identify participants with mild or higher levels of depression (PHQ-9≥5) and no moderate or higher suicidal ideation (PHQ-9 item 9≤1). Given the time gap between screening and baseline assessments, the PHQ-9 was also included in the pre, post, and follow-up assessments. The internal consistency (Cronbach ɑ) in the Korean standardization study [64] was 0.95, and in this study, it was 0.79.

Korean Beck Depression Inventory-II

The Korean version of the Beck Depression Inventory-II (BDI-II), developed by Beck et al [65] and validated by Kim et al [66], was used to assess changes in depression severity. The BDI-II is a 21-item standardized questionnaire that is widely used to evaluate depressive symptoms. Participants rated their level of difficulty with depressive symptoms such as sadness, lethargy, feelings of worthlessness, and changes in sleep and appetite over the past 2 weeks on a 4-point Likert scale ranging from 0=not at all to 3=severely. Regarding internal consistency, Cronbach ɑ was 0.83 in the Korean standardization study [67] and 0.89 in this study.

Automatic Thought Questionnaire—Negative/Positive, Short Form

The Automatic Thought Questionnaire—Negative, Short Form (ATQN-SF) and the Automatic Thought Questionnaire—Positive, Short Form (ATQP-SF) were used to assess participants’ patterns of automatic thoughts—both negative and positive. The ATQN-SF, developed by Hollon and Kendall [68], adapted into Korean by Kwon and Yoon [69], and further refined by Heo and Kim [70], comprises 9 items rated on a 5-point Likert scale (0=not at all to 4=always). It measures negative automatic thoughts associated with depression and assesses changes in thought patterns in alignment with CBT mechanisms. The ATQP-SF, a 10-item scale adapted and validated in Korean by Heo and Kim [71] from the original Automatic Thought Questionnaire-Revised by Kendall et al [72], evaluates the frequency of positive automatic thoughts, which are often lacking in individuals vulnerable to depression. Both subscales demonstrated excellent internal consistency, with Cronbach ɑ values of 0.96 (ATQN-SF) and 0.93 (ATQP-SF) reported in previous studies and 0.89 (ATQN-SF) and 0.91 (ATQP-SF) in this study.

Student Adaptation to College Questionnaire—Revised

The Student Adaptation to College Questionnaire—Revised (SACQ-R) was used to measure participants’ adaptation to college life. Developed by Baker and Siryk [73] and revised and adapted into Korean by Lee [74], the SACQ-R assesses academic, social, emotional, and physical adjustment, as well as attachment to the institution. The 25-item measure is rated on a 5-point Likert scale ranging from 1=not at all to 5=very much. Regarding internal consistency, Cronbach ɑ was 0.85 in previous research [74] and in this study.

Mobile App Rating Scale

To evaluate the usability of the app, the Mobile App Rating Scale (MARS) developed by Stoyanov et al [75] was translated into Korean and used according to the guidelines of the International Test Commission [76]. The scale comprises 33 items across five factors: engagement, functionality, aesthetics, information quality, and app-specific items (subjective satisfaction). Participants rated each item on a 5-point Likert scale ranging from 1=not at all to 5=very much. Additionally, an open-ended question was included to gather unstructured subjective feedback: “What did you like about using the app?” Usability was assessed postintervention in the intervention group (n=80).

Design and Procedure

Overview

All study procedures were conducted in accordance with the CONSORT-EHEALTH (Consolidated Standards of Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth) guidelines. This was a two-arm, parallel-group, randomized controlled trial with a waitlist control (WLC) design. An a priori power analysis was conducted using a linear multiple regression model (F test) in G*Power (Heinrich Heine University Düsseldorf), as no standardized procedure is available for power analysis in generalized estimating equation (GEE). The analysis indicated that a minimum sample size of 42 participants was required to detect a medium effect size (F2=0.25) with P=.05 and power=0.80, assuming two predictors (df1=2, df2=39), based on prior t-CBT efficacy studies.

Participants who provided informed consent were randomly assigned to the intervention or WLC group. Randomization was conducted using a pregenerated random number table created in Excel (Microsoft Corp) by a research assistant registered in the IRB-approved protocol. The assistant used the =RAND() function to generate random values, which were sorted to assign the participants to groups. As this was an open-label trial, both the participants and investigators were aware of the group assignments.

Participants who met the inclusion criteria underwent the following steps: (1) preintervention assessment, (2) intervention or waiting period depending on group assignment, (3) postintervention assessment, and (4) follow-up assessment. The preintervention assessment was conducted immediately after participants provided informed consent. The postintervention assessment was conducted after the intervention group completed the 28-session Mind Booster Green training and 30 days postbaseline for the WLC group. A follow-up assessment was conducted 2 months after the postintervention assessment. Both groups completed the PHQ-9, BDI-II, SACQ-R, ATQN-SF, and ATQP-SF at all the assessment points. Additionally, the MARS was administered to the intervention group during the postintervention assessment for usability evaluation.

After completing the 2-month follow-up assessment, participants in the WLC group were granted access to the app. App access was provided only after all required assessments were completed. No symptom data or app use records were collected from the WLC group following the intervention, and postintervention data were not included in the outcome analyses.

Intervention Condition: Mind Booster Green Group

Participants assigned to the intervention group downloaded and installed the app from Apple’s app store (iOS) or the Google Play store (Android) via a URL provided by the researchers. Upon registration, the researchers approved the use of the app on the admin page. The participants began training independently without additional guidance or support and were advised to complete one session per day, with the researchers monitoring their progress via the admin page. Participants who did not log in or complete sessions for more than 3 days received prompt SMS text messages, and those who did not engage for more than 10 days were considered withdrawn. Other than the SMS text message prompts to resume the use of the app, participants received no feedback on their performance from the researchers, who were only available to answer questions about the study via an SNS channel.

Mind Booster Green

Mind Booster Green is a self-help CBT app adapted from “HaruToday,” a CBT app initially developed for patients with cancer [17,77] with the support of the Korean Ministry of Health and Welfare (HA16C0021). HaruToday has three modules (depression or anxiety, sleep, and pain issues) and has been validated for its effectiveness on depression or anxiety [17] and sleep [77]. The Mind Booster Green program was modified to address depression in undergraduate and graduate students by reducing the number of sessions from 48 to 28 based on user feedback. Tailored CBT content was developed through focus group interviews with undergraduate and graduate students to gather specific case stories related to their experiences with depression. A pilot test involving CBT experts and college students was conducted, and the final version was completed through revision and supplementation. The program used in this study was not updated during the experimental period [78].

The main training program comprises 5 zones with 28 sessions targeting effective CBT techniques for managing depressive symptoms: (1) psychoeducation, (2) cognitive restructuring, (3) behavioral activation, (4) relaxation training, and (5) problem-solving. Each zone includes 4‐10 sessions, each lasting approximately 10‐15 minutes and consisting of 50‐70 illustrated slides with pages where users can input answers, complete quizzes, or fill out worksheets. Audio narration is available for each slide and can be customized by the user.

Six characters representing college students are featured in the story and the text and illustrations detail how they work with experts to explore their depressive symptoms, learn cognitive-behavioral skills to manage their symptoms, and overcome challenges (Figure 1). Users also engage in self-guided tasks such as quizzes and activity planning to apply learned skills. Table 1 summarizes the specific characteristics of each zone. The app includes mood-monitoring features, allowing users to track their mood visually and providing thought records and relaxation audio or video to apply the learned techniques in real life.

Figure 1. Example screen from Mind Booster Green.
Table 1. Session outline of Mind Booster Green.
Training zoneNumber of sessionsContent
Psychoeducation4
  • Characteristics of depressive symptoms
  • Core principles of CBTa
  • Self-monitoring techniques
Behavioral activation5
  • Pleasant activities exploration
  • Pleasant activities planning
Cognitive restructuring10
  • Automatic thoughts and cognitive distortions
  • Cognitive restructuring techniques
  • Thought record
Problem-solving5
  • Five-step problem-solving approach
  • Time management
  • Assertiveness skills
  • Anger management strategies
Relaxation4
  • Progressive muscle relaxation
  • Guided imagery techniques

aCBT: cognitive behavioral therapy.

Mind Booster Green uses point-and-level systems based on positive reinforcement. Participants earned points for attendance and completion of mood checks, sessions, training zones, and thought records. Accumulating points led to leveling, with 5 levels requiring progressively more points. As the participants leveled up, the main character’s potted plant grew, providing encouragement and emotional support.

WLC Condition

Participants in the WLC group were instructed to maintain their usual activities for 30 days without additional guidance or support from the researchers. Similar to the intervention group, they were able to contact the research team through the SNS channel for study-related inquiries.

Statistical Analysis

The analyses included data from 91 participants in the intervention group, 79 participants in the control group for the intention-to-treat (ITT) analysis, and 78 participants in both groups for the per-protocol (PP) analysis. One-way ANOVAs and chi-square analyses were conducted to examine demographic characteristics and ensure group homogeneity in the preassessment. To evaluate the effectiveness of the intervention, an ITT analysis [79] was performed using the entire dataset, including dropouts, and a PP analysis was conducted with participants who completed all procedures. A GEE was used to test for group differences in changes over time [80]. As all dependent variables were nonnormally distributed, the GEE analysis used an unstructured working correlation structure and gamma distribution with a log-link response scale. Time and group were the predictor variables, and the dependent variables included the PHQ-9, BDI-II, SACQ-R, ATQN-SF, and ATQP-SF, with preassessment scores as covariates. Statistical analyses were performed using SPSS (version 27; IBM Corp). Within- and between-group effect sizes (Cohen d) were calculated using absolute scores at each time point.

Ethical Considerations

This study was reviewed and approved by the IRB of Yonsei University (IRB 7001988‐202202HR-1127-10) in accordance with the institutional and national ethical guidelines for research involving human participants. All participants were fully informed about the purpose, procedures, and voluntary nature of the study through a video explanation posted on the study website and provided written informed consent by electronically signing a digital consent form prior to participation. They were also informed of their right to withdraw from the study at any time, without penalty. All collected data were deidentified to ensure the participants’ privacy and confidentiality. No personally identifiable information was stored, and all data were securely managed on encrypted servers with access limited to authorized research staff. Participants received monetary compensation equivalent to 50,000 KRW (approximately US $40) after completing the follow-up assessment, with prorated compensation for partial participation. Participants in the WLC group were granted access to the app after the follow-up assessment, along with compensation. These measures were implemented to ensure fairness and acknowledge the participants’ time and contributions to the study.

Trial Registration

This study was approved by the IRB prior to its initiation. However, the clinical trial was retrospectively registered in the Korean Clinical Trial Registry (Clinical Research Information Service) under registration number KCT0009758. At the time of the study, the necessity of prospective clinical trial registration was not fully recognized, particularly because trial registration is not a legal requirement in Korea. However, we promptly addressed this oversight and retrospectively completed the registration. The research procedures reported in the registration are fully consistent with the protocol approved by the IRB. It was ensured that all research procedures adhered to the ethical standards approved by the IRB and that retrospective registration did not impact the integrity or outcomes of the study.


Participant Flow and Sample Description

Of the 506 undergraduate and graduate students who volunteered to participate, 172 met the inclusion criteria and were enrolled. A pregenerated random number table in Excel was used to randomly assign participants to the intervention (n=91) or WLC (n=81) group. Before the baseline assessment, 2 participants in the WLC group ceased contact and were excluded from the study. During the intervention period, 11 participants were excluded owing to loss of contact (intervention group, n=9) or voluntary withdrawal (intervention group, n=2). Between the postintervention and follow-up assessments, contact with 2 participants from the intervention group was lost, and 1 participant from the WLC group was excluded because they used other psychological services. Consequently, 156 participants (78 in each group) completed all three assessments. For the ITT analysis, data from 91 and 79 participants in the intervention and control groups, respectively, were included. For the PP analysis, data from 78 participants in both groups were included. Figure 2 presents a detailed flowchart of the participant selection process.

Figure 2. CONSORT diagram of participant flow. CONSORT: Consolidated Standards of Reporting Trials; ITT: intention-to-treat; PHQ-9: Patient Health Questionnaire-9.

The mean age of the study participants (n=170) was 22.60 (SD 3.37, median 22, IQR 18‐38) years, with 80% (136/170) female and 20% (34/170) male participants. Of the total participants, 17.1% (29/170) were freshmen, 17.6% (30/170) sophomores, 24.1% (41/170) juniors, 22.9% (39/170) seniors or above, and 18.2% (31/170) graduate students. Table 2 shows the demographic characteristics of participants in both groups. The chi-square analysis showed no differences between the intervention and WLC groups in terms of age, sex, or class year (Table 2; all P>.05).

Table 2. Participant characteristics by group.
CharacteristicsIntervention (n=91)Control
(n=79)
Chi-square (df)P value
Age (years), mean (SD)22.31 (3.34)22.91 (3.41)1.31a (1, 168).25
Sex, n (%)0.0 (1).94
Female73 (80.2)63 (79.7)
Male18 (19.8)16 (20.3)
Year, n (%)3.3 (4).51
Freshman14 (15.4)15 (19.0)
Sophomore20 (22.0)10 (12.7)
Junior19 (20.9)22 (27.8)
Senior level or above21 (23.1)18 (22.8)
Graduate student17 (18.7)14 (17.7)

aFor age, F test value is provided.

Table 3 presents the observed means and standard deviations of the PHQ-9, BDI-II, SACQ-R, ATQP-SF, and ATQN-SF scores by group at preassessment and the results of the between-group analyses of variance. No significant differences were observed between the groups for any variable at preassessment (P>.05).

Table 3. Observed means and SDs for scores of each variable by group.
Measures and timeIntervention (Pre n=91; Post n=80; F/Ua n=78), mean (SD)Control (Pre n=79; Post n=79; F/U n=78), mean (SD)F test (df)P value
PHQ-9b0.98 (1, 168).40
Pre10.75 (4.12)10.13 (4.00)
Post6.09 (4.19)8.51 (4.57)
F/U5.81 (4.43)7.46 (4.68)
BDI-IIc2.55 (1, 168).14
Pre22.59 (9.51)20.23 (9.01)
Post13.38 (10.80)17.90 (9.73)
F/U12.26 (10.65)16.21 (10.62)
SACQ-Rd0.84 (1, 168).33

Pre
68.13 (12.40)69.91 (12.97)
Post79.16 (13.05)71.76 (16.98)
F/U79.38 (14.17)73.27 (16.83)
ATQP-SFe1.40 (1, 168).40
Pre12.67 (6.23)13.85 (6.76)
Post15.85 (7.83)14.28 (7.56)
F/U16.18 (9.52)14.71 (9.36)
ATQN-SFf2.49 (1, 168).10
Pre11.51 (7.77)9.75 (6.60)
Post8.66 (7.89)9.75 (8.48)
F/U7.24 (6.99)9.42 (7.98)

aF/U: follow-up.

bPHQ-9: Patient Health Questionnaire-9.

cBDI-II: Beck Depression Inventory-II.

dSACQ-R: Student Adaptation to College Questionnaire—Revised.

eATQP-SF: Automatic Thought Questionnaire—Positive, Short Form.

fATQN-SF: Automatic Thought Questionnaire—Negative, Short Form.

Effectiveness of Mind Booster Green

ITT Analysis

The estimated marginal means and SEs of the PHQ-9, BDI-II, SACQ-R, ATQP-SF, and ATQN-SF scores at the pre, post, and follow-up assessments are presented in Table 4, and the trends in score changes across time points are illustrated in Figure 3. The GEE analysis revealed a significant time×group interaction for all variables, and the main effects of group and time were significant for all 5 variables. These findings indicated significant differences between the intervention and control groups in terms of changes in depressive symptoms, adjustment to college life, and positive and negative automatic thoughts over time. The paired comparisons showed that the intervention group had lower scores for depressive symptoms (PHQ-9 and BDI-II) and negative automatic thoughts (ATQN-SF) and higher scores for adjustment to college life (SACQ-R) and positive automatic thoughts (ATQP-SF) after the intervention than before the use of Mind Booster Green. An examination of the effect size of the change from pre- to postassessment and follow-up assessment scores in the intervention group showed a large decrease in depressive symptom scores after using the app (pre to post Cohen d: PHQ-9 1.12, BDI-II 0.90), followed by a small but sustained decrease in scores up to 2 months after the postassessment (pre to F/U Cohen d: PHQ-9 1.15, BDI-II 1.04). Negative automatic thoughts followed a pattern similar to that of depressive symptoms; however, the magnitude of change was smaller (pre to post Cohen d=0.36; pre to F/U Cohen d=0.58). Although scores for adjustment to college life and positive automatic thoughts increased at postassessment compared with preassessment (pre to post Cohen d: SACQR –0.87, ATQP-SF –0.45), little difference was found in these scores between the post and follow-up assessments (pre to F/U Cohen d: SACQ-R –0.85, ATQP-SF –0.44). Table 5 presents the effect sizes of the mean score changes at each time point.

Table 4. Results of the GEEa analysis with covariate adjustment for the preassessment scores of each variableb.
MeasuresIntention-to-treatPer protocol
Wald chi-square (df)P valueWald chi-square (df)P value
PHQ-9c
Group×Time28.7 (2)<.00129.5 (2)<.001
Group17.0 (1)<.00118.1 (1)<.001
Time118.1 (2)<.001118.0 (2)<.001
BDI-IId
Group×Time28.5 (2)<.00135.8 (2)<.001
Group23.1 (1)<.00130.6 (1)<.001
Time81.8 (2)<.00196.0 (2)<.001
SACQ-Re
Group×Time30.9 (2)<.00132.0 (2)<.001
Group26.2 (1)<.00127.5 (1)<.001
Time93.3 (2)<.00194.9 (2)<.001
ATQP-SFf
Group×Time7.6 (2).027.8 (2).02
Group6.0 (1).025.9 (1).02
Time35.9 (2)<.00135.8 (2)<.001
ATQN-SFg
Group×Time9.3 (2).019.0 (2).01
Group10.3 (1).00110.0 (1).002
Time2.8 (2).242.8 (2).25

aGEE: generalized estimating equation.

bIntervention pre n=91, post n=80, F/U n=78; Control pre n=79, post n=79, F/U n=78.

cPHQ-9: Patient Health Questionnaire-9.

dBDI-II: Beck Depression Inventory-II.

eSACQ-R: Student Adaptation to College Questionnaire—Revised.

fATQP-SF: Automatic Thought Questionnaire—Positive, Short Form.

gATQN-SF: Automatic Thought Questionnaire—Negative, Short Form.

Figure 3. Means and 95% intervals for the groups across the assessment time points. APP: ____; ATQN-SF: Automatic Thought Questionnaire—Negative, Short Form; ATQP-SF: Automatic Thought Questionnaire—Positive, Short Form; BDI-II: Beck Depression Inventory-II; PHQ-9: Patient Health Questionnaire-9; SACQ-R: Student Adaptation to College Questionnaire—Revised.
Table 5. Estimated marginal means and effect size.
Preintervention (n=91), Control (n=79)Postintervention (n=80), Control (n=79)F/Ua intervention (n=78), Control (n=78)Within-group effect size from prescoresBetween-group effect size
PostF/UPostF/U
Mean (SEb)95% CIcMean
(SE)
95% CIMean
(SE)
95% CICohen d95% CICohen d95% CICohen d95% CICohen d95% CI
PHQ-9d–0.78–1.22 to –0.34–0.36–0.68 to –0.05
Intervention9.84
(0.08)
9.68 to 10.005.68
(0.32)
5.09 to 6.345.96
(0.49)
5.08 to 7.001.120.82 to 1.421.150.85 to 1.46
Control9.71
(0.10)
9.51 to 9.918.32
(0.42)
7.53 to 9.207.38
(0.41)
6.61 to 8.230.380.07 to 0.690.610.30 to 0.93
BDI-IIe–0.44–0.75 to –0.13–0.37–0.69 to –0.06
Interventio19.87
(0.18)
19.52 to 20.2311.87
(0.80)
10.4 to 13.5511.18
(0.89)
9.57 to 13.060.900.60 to 1.21.040.71 to 1.37
Control19.66
(0.32)
19.04 to 20.2917.62
(0.75)
16.21 to 19.1616.26
(0.90)
14.60 to 18.120.25–0.06 to 0.560.410.10 to 0.72
SACQ-Rf0.490.18 to 0.800.390.08 to 0.71
Intervention67.64
(0.28)
67.09 to 68.2079.54
(1.31)
77.01 to 82.1480.21
(1.57)
77.2 to 83.34–0.87–1.17 to –0.57–0.85–1.15 to –0.54
Control67.82
(0.33)
67.17 to 68.4870.68
(0.93)
68.87 to 72.5371.94
(1.55)
68.96 to 75.05–0.12–0.43 to 0.19–0.22–0.54 to 0.09
ATQP-SFg0.20–0.11 to 0.510.16–0.16 to 0.47
Intervention11.81
(0.22)
11.39 to 12.2515.68
(0.68)
14.4 to 17.0816.04
(0.86)
14.43 to 17.81–0.45–0.75 to –0.15–0.44–0.74 to –0.13
Control11.83
(0.21)
11.42 to 12.2413.00
(0.73)
11.64 to 14.5213.52
(0.82)
12.01 to 15.21–0.06–0.37 to 0.25–0.10–0.42 to 0.21
ATQN-SFh–0.13–0.44 to 0.18–0.29–0.60 to 0.02
Intervention9.01
(0.26)
8.51 to 9.557.56
(0.55)
6.55 to 8.716.86
(0.64)
5.72 to 8.230.360.06 to 0.660.580.28 to 0.88
Control9.04
(0.27)
8.53 to 9.589.41
(0.59)
8.33 to 10.639.85
(0.76)
8.46 to 11.470.00–0.31 to 0.310.04–0.27 to 0.36

aF/U: follow-up.

bSE: Standard Error

cCI: Confidence Interval

dPHQ-9: Patient Health Questionnaire-9.

eBDI-II: Beck Depression Inventory-II.

fSACQ-R: Student Adaptation to College Questionnaire–Revised.

gATQP-SF: Automatic Thought Questionnaire—Positive, Short Form.

hATQN-SF: Automatic Thought Questionnaire–Negative, Short Form.

The control group showed a decrease in depressive symptoms from pre- to postassessment and follow-up; however, the magnitude was smaller than that in the intervention group, and the group mean scores were higher than those in the intervention group when comparing the PHQ-9 and BDI-II scores for the post and follow-up assessments (Table 5). When comparing scores for the pre, post, and follow-up assessments, the effect sizes (Cohen d) for changes in adjustment to college life and positive and negative automatic thoughts ranged from −0.22 to 0.04, indicating negligible or a small change.

PP Analysis

A PP analysis was conducted on the data of participants who completed all 28 sessions of the Mind Booster Green training program and all three assessments. Adherence rates were 89% and 99% in the intervention and WLC groups, respectively. The analysis was conducted using the GEE, as in the ITT analysis. The results showed significant time×group interactions for the PHQ-9, BDI-II, SACQ-R, ATQP-SF, and ATQN-SF scores and significant main effects of group and time for all variables. These findings were consistent with those of the ITT analysis. The results of the PP analysis are presented in Table 4.

Usability Test Results

The usability test was conducted using the MARS in the intervention group (n=80). The average usability score for Mind Booster Green was 3.88. Across domains, the mean scores were 3.57 (SD 0.66) for engagement, 4.17 (SD 0.76) for functionality, 3.40 (SD 0.75) for aesthetic quality, 4.36 (SD 0.56) for information quality, and 3.92 (SD 0.67) for app-specific features. All domain scores were above the medium level.


Principal Findings

Mind Booster Green is an app-based CBT program designed to alleviate depressive symptoms in college students. To enhance the program’s effectiveness and encourage continuous and independent use, the following strategies were applied: (1) tailoring the content using case stories reflecting the experiences college students are likely to have and (2) incorporating gamification elements, such as point and level systems, to promote app use. To verify the effectiveness of the program, we examined the reduction in depressive symptoms and improvement in college life adjustment and assessed the app’s usability using a standardized measure. The key findings and implications of this study were as follows.

First, the self-help t-CBT program Mind Booster Green was found to be effective in alleviating depressive symptoms in college students immediately after completing the training provided by the app, and the effect was sustained for at least 2 months postintervention. Additionally, the intervention group that used Mind Booster Green reported improved academic, social, emotional, and health-related adjustment to college life. These results are encouraging as they demonstrate that app-based CBT programs can effectively reduce depressive symptoms through cognitive-behavioral skills training and extend these improvements to students’ real-life functioning. The results of this study suggest that Mind Booster Green can complement or serve as an alternative to existing psychological counseling services, providing a cost-effective and efficient solution to mental health issues among college students.

Second, based on a detailed examination of the program’s effectiveness, the intervention group exhibited reductions in depressive symptoms and changes in automatic thoughts, specifically a decrease in negative automatic thoughts and an increase in positive thoughts. Although this study did not conduct a formal mediation analysis to determine whether changes in thought patterns directly mediated symptom improvement, these findings are consistent with the theoretical underpinnings of CBT that emphasize the role of cognitive restructuring in alleviating emotional distress. CBT assumes that emotions and behaviors are influenced by individuals’ cognitive appraisals and seeks to reduce psychological symptoms by identifying and modifying negatively biased thoughts through cognitive and behavioral strategies [81]. Acquiring skills to challenge and replace maladaptive automatic thoughts is considered a core component of CBT treatment [82,83]. Researchers have emphasized the importance of embedding these core mechanisms into digital CBT interventions and delivering them in ways that maintain therapeutic integrity [12]. The observed changes in automatic thoughts suggest that the program successfully incorporated the key elements of CBT and may have contributed to symptom improvement. Although relatively few studies have directly examined therapeutic mechanisms in t-CBT interventions, existing evidence reflects cognitive changes that are in line with CBT theory, suggesting potential applicability across different interventions [84-87]. These findings support the fundamental theoretical model of CBT and demonstrate its effectiveness across digital formats. They also provide empirical support for the active implementation of t-CBT as a practical and scalable approach for treating depression.

Third, despite being a self-help program, Mind Booster Green showed a relatively high adherence rate. Mind Booster Green was designed for students to use independently without the help of therapists or experts. Although self-help programs maximize the economic and accessibility advantages of t-CBT programs, low adherence rates remain a challenge. The adherence rate of 89% in the intervention group was significantly higher than the reported adherence rate of approximately 26% for technology-based self-help interventions but similar to the 85% adherence rate reported for traditional face-to-face interventions [9]. Although adherence rates in randomized controlled trials are generally higher than those in observational studies [88,89], the rate observed in this study is notable. Enhancing user engagement and participation in intervention programs is closely linked to effectiveness [11], making adherence an important issue to address when developing self-help t-CBT programs. Thus, this study actively applied two strategies—tailoring and gamification—and the high adherence rate indirectly suggests their effectiveness.

The tailoring strategy in Mind Booster Green was designed based on social learning theory and intended to effectively model the cognitive and behavioral strategies of CBT. Although tailoring can be broadly applied to provide information that fits user characteristics and needs, the tailoring strategy in Mind Booster Green focuses on program content composition. The program features college students who share their experiences related to depression and learn CBT skills to overcome their problems, thereby modeling how users in similar situations can apply these skills in their lives. Specific narratives reflecting the characteristics of a particular population facilitate effective modeling, a technique widely used in various psychological therapy contexts [90] and reported to enhance user engagement [91]. The changes in automatic thoughts observed alongside the reduction in depressive symptoms in this study indicated that the cognitive skills targeted by the program were appropriately conveyed to the participants. Additionally, approximately 20% of the study participants mentioned that “real college student cases” in the content helped them relate to the program and learn CBT skills.

The gamification strategy in Mind Booster Green was designed based on behavioral theory to ensure that users continuously engaged in and completed the app’s treatment activities. Mind Booster Green clarified the tasks that the participants needed to accomplish each day (goal setting), provided feedback on progress (progress and feedback), and implemented point and level systems (rewards) based on task completion. These are the key gamification strategies used in technology-based mental health interventions [92]. Notably, the gamification strategy used in this study was based on behavioral theory and aimed to help users learn and engage in new behaviors. Specifically, we analyzed the tasks that users needed to complete in Mind Booster Green and designed positive reinforcement strategies to increase the performance of those tasks. Points were awarded for engaging in and completing the training tasks, and a level system was introduced that showed the main character evolving as the points accumulated. Behavioral theory scientifically explores the factors that elicit and maintain human behavior, and strategies based on this theory have been reported to be effective in increasing app use behaviors [30,93]. As demonstrated in this study, using task analysis and reinforcement schedules based on established behavioral theories in app-based mental health programs can effectively encourage and teach desired behaviors.

The usability evaluation results for Mind Booster Green also reflected the effectiveness of these strategies. In this study, the MARS [75], a standardized assessment tool, was used to measure usability, allowing for comparisons with other programs. Lau et al [94] used MARS to assess the released app-based mental health interventions and reported average overall scores of 3.52 (SD 0.71). The overall score for Mind Booster Green was 3.88, which was slightly higher than the previously reported results obtained using MARS, with notably higher scores for functionality (4.17) and information quality (4.36). These positive user evaluations suggested that the intervention program development strategy, which considers user characteristics and preferences, positively influenced the user experience. This study clearly defined the target behaviors that users need to acquire to alleviate depressive symptoms and guided these behaviors by developing specific elements of tailoring and gamification based on psychological theory. The effectiveness of Mind Booster Green, the high adherence rate, and positive usability evaluation results highlight the importance of developing theoretically grounded strategies for therapeutic mechanisms and app-use behavior.

Limitations and Future Directions

This study was limited to one country, the Republic of Korea, and primarily included students from 4-year universities in Seoul, despite recruiting participants from various universities and graduate schools nationwide. The participant demographics showed a sex imbalance, with significantly fewer male participants than female participants. Additionally, the study included a broad range of participants, from freshmen to graduate students. Future studies should include a more diverse range of school types and recruit a larger number of participants of different sexes and class-year groups for repeated verification. Expanding the verification to an international scope to explore whether the program’s effectiveness can be generalized to college students in other countries could also provide valuable data for developing tailored t-CBT programs for the target population.

This study applied tailoring and gamification features based on behavioral theories such as social learning and positive reinforcement to a t-CBT program and showed positive results in reducing depressive symptoms and improving adherence rates and usability. However, future research must investigate how the individual factors of tailoring and gamification mediate these positive outcomes. Existing studies analyzing the impact of these features on program effectiveness and adherence have produced conflicting results [95] owing to the limited number of studies and differences in how these features are defined. Thus, the continuous development of t-CBT programs incorporating tailoring and gamification is needed, along with research on how these effects are mediated by the specific designs and theoretical underpinnings of these strategies.

Conclusions

This study found that the self-help t-CBT program Mind Booster Green can be effective in reducing depressive symptoms and improving adjustment to college life among college students. These results suggested the potential of self-help t-CBT programs in alleviating and preventing depression in this target group. Future research should test the effectiveness and usability of the strategies applied in this study, including tailoring and gamification, across diverse populations.

Acknowledgments

This work was supported by the Technology Innovation Program (RS-2024‐00487049, Development and Demonstration of Complex Emotion Recognition On-device AI Technology for In-vehicle Driver Emotional Services) funded by the Ministry of Trade, Industry and Energy (Korea) and by a Yonsei University Research Grant (2021).

Conflicts of Interest

KMC is the founder of the company that commercializes the intervention described in this manuscript.

Editorial Notice

This randomized study was only retrospectively registered. The editor granted an exception from ICMJE rules mandating prospective registration of randomized trials because the risk of bias appears low. However, readers are advised to carefully assess the validity of any potential explicit or implicit claims related to primary outcomes or effectiveness, as retrospective registration does not prevent authors from changing their outcome measures retrospectively.

Checklist 1

CONSORT-EHEALTH (Consolidated Standards of Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth) checklist.

PDF File, 831 KB

  1. Cuijpers P, Smit F, Bohlmeijer E, Hollon SD, Andersson G. Efficacy of cognitive–behavioural therapy and other psychological treatments for adult depression: meta-analytic study of publication bias. Br J Psychiatry. Mar 2010;196(3):173-178. [CrossRef]
  2. Williams C, Martinez R. Increasing access to CBT: stepped care and CBT self-help models in practice. Behav Cogn Psychother. Nov 2008;36(6):675-683. [CrossRef]
  3. Firth J, Torous J, Nicholas J, et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry. Oct 2017;16(3):287-298. [CrossRef] [Medline]
  4. Karyotaki E, Riper H, Twisk J, et al. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms. JAMA Psychiatry. Apr 1, 2017;74(4):351. [CrossRef]
  5. Saad A, Bruno D, Camara B, D’Agostino J, Bolea-Alamanac B. Self-directed technology-based therapeutic methods for adult patients receiving mental health services: systematic review. JMIR Ment Health. Nov 26, 2021;8(11):e27404. [CrossRef] [Medline]
  6. Edge D, Watkins ER, Limond J, Mugadza J. The efficacy of self-guided internet and mobile-based interventions for preventing anxiety and depression—a systematic review and meta-analysis. Behav Res Ther. May 2023;164:104292. [CrossRef] [Medline]
  7. Webb CA, Rosso IM, Rauch SL. Internet-based cognitive-behavioral therapy for depression: current progress and future directions. Harv Rev Psychiatry. 2017;25(3):114-122. [CrossRef] [Medline]
  8. Karyotaki E, Kleiboer A, Smit F, et al. Predictors of treatment dropout in self-guided web-based interventions for depression: an “individual patient data” meta-analysis. Psychol Med. Oct 2015;45(13):2717-2726. [CrossRef] [Medline]
  9. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. Jun 2012;32(4):329-342. [CrossRef] [Medline]
  10. Baumel A, Edan S, Kane JM. Is there a trial bias impacting user engagement with unguided e-mental health interventions? A systematic comparison of published reports and real-world usage of the same programs. Transl Behav Med. Nov 25, 2019;9(6):1020-1033. [CrossRef] [Medline]
  11. Donkin L, Christensen H, Naismith SL, Neal B, Hickie IB, Glozier N. A systematic review of the impact of adherence on the effectiveness of e-therapies. J Med Internet Res. Aug 5, 2011;13(3):e52. [CrossRef] [Medline]
  12. Mohr DC, Burns MN, Schueller SM, Clarke G, Klinkman M. Behavioral intervention technologies: evidence review and recommendations for future research in mental health. Gen Hosp Psychiatry. 2013;35(4):332-338. [CrossRef] [Medline]
  13. Dugas M, Gao GG, Agarwal R. Unpacking mHealth interventions: a systematic review of behavior change techniques used in randomized controlled trials assessing mHealth effectiveness. Digital Health. 2020;6:2055207620905411. [CrossRef] [Medline]
  14. Cuijpers P, Karyotaki E, Eckshtain D, et al. Psychotherapy for depression across different age groups: a systematic review and meta-analysis. JAMA Psychiatry. Jul 1, 2020;77(7):694-702. [CrossRef] [Medline]
  15. Toyomoto R, Sakata M, Yoshida K, et al. Prognostic factors and effect modifiers for personalisation of internet-based cognitive behavioural therapy among university students with subthreshold depression: a secondary analysis of a factorial trial. J Affect Disord. Feb 1, 2023;322:156-162. [CrossRef] [Medline]
  16. Morrison LG. Theory-based strategies for enhancing the impact and usage of digital health behaviour change interventions: a review. Digital Health. 2015;1:2055207615595335. [CrossRef] [Medline]
  17. Ham K, Chin S, Suh YJ, et al. Preliminary results from a randomized controlled study for an app-based cognitive behavioral therapy program for depression and anxiety in cancer patients. Front Psychol. 2019;10:1592. [CrossRef] [Medline]
  18. Mullin A, Dear BF, Karin E, et al. The UniWellbeing course: a randomised controlled trial of a transdiagnostic internet-delivered cognitive behavioural therapy (CBT) programme for university students with symptoms of anxiety and depression. Internet Interventions. May 2015;2(2):128-136. [CrossRef]
  19. Weaver A, Zhang A, Xiang X, Felsman P, Fischer DJ, Himle JA. Entertain Me Well: an entertaining, tailorable, online platform delivering CBT for depression. Cogn Behav Pract. Feb 2023;30(1):96-115. [CrossRef] [Medline]
  20. Strecher VJ, McClure JB, Alexander GL, et al. Web-based smoking-cessation programs: results of a randomized trial. Am J Prev Med. May 2008;34(5):373-381. [CrossRef] [Medline]
  21. Karyotaki E, Klein AM, Ciharova M, et al. Guided internet-based transdiagnostic individually tailored cognitive behavioral therapy for symptoms of depression and/or anxiety in college students: a randomized controlled trial. Behav Res Ther. Mar 2022;150:104028. [CrossRef] [Medline]
  22. Batterham PJ, Calear AL, Farrer L, McCallum SM, Cheng VWS. FitMindKit: randomised controlled trial of an automatically tailored online program for mood, anxiety, substance use and suicidality. Internet Interventions. Jun 2018;12:91-99. [CrossRef] [Medline]
  23. Balaskas A, Schueller SM, Cox AL, Doherty G. The functionality of mobile apps for anxiety: systematic search and analysis of engagement and tailoring features. JMIR Mhealth Uhealth. Oct 6, 2021;9(10):e26712. [CrossRef] [Medline]
  24. Mukhiya SK, Wake JD, Inal Y, Pun KI, Lamo Y. Adaptive elements in internet-delivered psychological treatment systems: systematic review. J Med Internet Res. Nov 27, 2020;22(11):e21066. [CrossRef] [Medline]
  25. Stawarz K, Preist C, Tallon D, Wiles N, Coyle D. User experience of cognitive behavioral therapy apps for depression: an analysis of app functionality and user reviews. J Med Internet Res. Jun 6, 2018;20(6):e10120. [CrossRef] [Medline]
  26. Cuijpers P, Muñoz RF, Clarke GN, Lewinsohn PM. Psychoeducational treatment and prevention of depression: the “Coping with Depression” course thirty years later. Clin Psychol Rev. Jul 2009;29(5):449-458. [CrossRef] [Medline]
  27. Rigabert A, Motrico E, Moreno-Peral P, et al. Effectiveness of online psychological and psychoeducational interventions to prevent depression: systematic review and meta-analysis of randomized controlled trials. Clin Psychol Rev. Dec 2020;82:101931. [CrossRef] [Medline]
  28. Deterding S, Dixon D, Khaled R, Nacke L, editors. From game design elements to gamefulness: defining “gamification". Association for Computing Machinery; 2011. Presented at: The 15th International Academic MindTrek Conference: Envisioning Future Media Environments; Sep 28-30, 2011:9-15. [CrossRef] [Medline]
  29. Cheng VWS, Davenport T, Johnson D, Vella K, Hickie IB. Gamification in apps and technologies for improving mental health and well-being: systematic review. JMIR Ment Health. Jun 26, 2019;6(6):e13717. [CrossRef] [Medline]
  30. Sardi L, Idri A, Fernández-Alemán JL. A systematic review of gamification in e-Health. J Biomed Inform. Jul 2017;71:31-48. [CrossRef] [Medline]
  31. Cheng VWS. Recommendations for implementing gamification for mental health and wellbeing. Front Psychol. 2020;11:586379. [CrossRef] [Medline]
  32. Cheng C, Ebrahimi OV. A meta-analytic review of gamified interventions in mental health enhancement. Comput Human Behav. Apr 2023;141:107621. [CrossRef]
  33. Six SG, Byrne KA, Aly H, Harris MW. The effect of mental health app customization on depressive symptoms in college students: randomized controlled trial. JMIR Ment Health. Aug 9, 2022;9(8):e39516. [CrossRef] [Medline]
  34. Fleming TM, Stasiak K, Moselen E, et al. Revising computerized therapy for wider appeal among adolescents: youth perspectives on a revised version of SPARX. Front Psychiatry. 2019;10:802. [CrossRef] [Medline]
  35. Bakker D, Kazantzis N, Rickwood D, Rickard N. Development and pilot evaluation of smartphone-delivered cognitive behavior therapy strategies for mood- and anxiety-related problems: MoodMission. Cogn Behav Pract. Nov 2018;25(4):496-514. [CrossRef]
  36. Miloff A, Marklund A, Carlbring P. The challenger app for social anxiety disorder: new advances in mobile psychological treatment. Internet Interventions. Nov 2015;2(4):382-391. [CrossRef]
  37. Devan H, Farmery D, Peebles L, Grainger R. Evaluation of self-management support functions in apps for people with persistent pain: systematic review. JMIR Mhealth Uhealth. Feb 12, 2019;7(2):e13080. [CrossRef] [Medline]
  38. Mullins JK, Sabherwal R. Gamification: a cognitive-emotional view. J Bus Res. Jan 2020;106:304-314. [CrossRef]
  39. Auerbach RP, Mortier P, Bruffaerts R, et al. WHO World Mental Health Surveys International College Student Project: prevalence and distribution of mental disorders. J Abnorm Psychol. Oct 2018;127(7):623-638. [CrossRef] [Medline]
  40. Chang JJ, Ji Y, Li YH, Pan HF, Su PY. Prevalence of anxiety symptom and depressive symptom among college students during COVID-19 pandemic: a meta-analysis. J Affect Disord. Sep 1, 2021;292:242-254. [CrossRef] [Medline]
  41. Awadalla S, Davies EB, Glazebrook C. A longitudinal cohort study to explore the relationship between depression, anxiety and academic performance among Emirati university students. BMC Psychiatry. Dec 2020;20(1):1-10. [CrossRef]
  42. Saunders DE, Peterson GW, Sampson JP, Reardon RC. Relation of depression and dysfunctional career thinking to career indecision. J Vocat Behav. Apr 2000;56(2):288-298. [CrossRef]
  43. Whitton SW, Whisman MA. Relationship satisfaction instability and depression. J Fam Psychol. 2010;24(6):791-794. [CrossRef]
  44. Mahmoud JSR, Staten RT, Hall LA, Lennie TA. The relationship among young adult college students’ depression, anxiety, stress, demographics, life satisfaction, and coping styles. Issues Ment Health Nurs. Feb 28, 2012;33(3):149-156. [CrossRef]
  45. Lipson SK, Lattie EG, Eisenberg D. Increased rates of mental health service utilization by U.S. college students: 10-year population-level trends (2007-2017). Psychiatr Serv. Jan 1, 2019;70(1):60-63. [CrossRef] [Medline]
  46. Copeland WE, McGinnis E, Bai Y, et al. Impact of COVID-19 pandemic on college student mental health and wellness. J Am Acad Child Adolesc Psychiatry. Jan 2021;60(1):134-141. [CrossRef] [Medline]
  47. Auerbach RP, Alonso J, Axinn WG, et al. Mental disorders among college students in the World Health Organization World Mental Health Surveys. Psychol Med. Oct 2016;46(14):2955-2970. [CrossRef] [Medline]
  48. Xiao H, Carney DM, Youn SJ, et al. Are we in crisis? National mental health and treatment trends in college counseling centers. Psychol Serv. Nov 2017;14(4):407-415. [CrossRef] [Medline]
  49. Hunt J, Eisenberg D. Mental health problems and help-seeking behavior among college students. J Adolesc Health. Jan 2010;46(1):3-10. [CrossRef] [Medline]
  50. Raunic A, Xenos S. University counselling service utilisation by local and international students and user characteristics: a review. Int J Adv Counselling. Dec 2008;30(4):262-267. [CrossRef]
  51. Poushter J. Smartphone ownership and internet usage continues to climb in emerging economies. Pew Research Center; 2016:1-44. URL: https:/​/www.​pewresearch.org/​global/​2016/​02/​22/​smartphone-ownership-and-internet-usage-continues-to-climb-in-emerging-economies [Accessed 2025-05-25]
  52. Batterham PJ, Calear AL. Preferences for internet-based mental health interventions in an adult online sample: findings from an online community survey. JMIR Ment Health. Jun 30, 2017;4(2):e26. [CrossRef] [Medline]
  53. Creighton TB. Digital natives, digital immigrants, digital learners: an international empirical integrative review of the literature. Educ Leadersh Rev. 2018;19(1):132-140. URL: https://eric.ed.gov/?id=EJ1200802 [Accessed 2025-06-05]
  54. Bittner JV, Shipper J. Motivational effects and age differences of gamification in product advertising. J Consum Mark. Aug 11, 2014;31(5):391-400. [CrossRef]
  55. Zhang L, Shao Z, Li X, Feng Y. Gamification and online impulse buying: the moderating effect of gender and age. Int J Inf Manage. Dec 2021;61:102267. [CrossRef]
  56. Powell J, Hamborg T, Stallard N, et al. Effectiveness of a web-based cognitive-behavioral tool to improve mental well-being in the general population: randomized controlled trial. J Med Internet Res. 2013;15(1):e2. [CrossRef]
  57. Fitzpatrick KK, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Ment Health. Jun 6, 2017;4(2):e19. [CrossRef] [Medline]
  58. Twomey C, O’Reilly G. Effectiveness of a freely available computerised cognitive behavioural therapy programme (MoodGYM) for depression: meta-analysis. Aust N Z J Psychiatry. Mar 2017;51(3):260-269. [CrossRef] [Medline]
  59. Lattie E, Cohen KA, Winquist N, Mohr DC. Examining an app-based mental health self-care program, intellicare for college students: single-arm pilot study. JMIR Ment Health. Oct 10, 2020;7(10):e21075. [CrossRef] [Medline]
  60. Pan JY, Carlbring P, Lu L. Efficacy of internet-based cognitive behavioral therapy for Hong Kong university students: a randomized controlled trial. Res Soc Work Pract. 2024:10497315241252054. [CrossRef]
  61. Ha SW, Kim J. Designing a scalable, accessible, and effective mobile app based solution for common mental health problems. Int J Hum-Comput Interact. Aug 26, 2020;36(14):1354-1367. [CrossRef]
  62. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. Sep 2001;16(9):606-613. [CrossRef] [Medline]
  63. Park SJ, Choi HR, Choi JH, Kim KW, Hong JP. Reliability and validity of the Korean version of the Patient Health Questionnaire-9 (PHQ-9). Anxiety Mood. 2010;6(2):119-124. URL: https://koreascience.kr/article/JAKO201025247234261.page [Accessed 2025-06-05]
  64. An JY, Seo ER, Lim KH, Shin JH, Kim JB. Standardization of the Korean version of screening tool for depression (Patient Health Questionnaire-9, PHQ-9). J Korean Soc Biol Ther Psychiatry. 2013;19(1):47-56. URL: https:/​/www.​kci.go.kr/​kciportal/​ci/​sereArticleSearch/​ciSereArtiView.​kci?sereArticleSearchBean.​artiId=ART001766067 [Accessed 2025-06-05]
  65. Beck AT, Steer RA, Depression B. Inventory—2nd Edition Manual. The Psychological Corporation; 1996.
  66. Kim JH, Lee EH, Hwang ST, Hong SH. Korean Version of the Beck Depression Inventory-II Manual. Korean Psychology Co., Ltd; 2015. ISBN: 979-11-85662-12-1
  67. Sung HM, Kim JB, Park YN, Bae DS, Lee SH, Ahn HY. A study on the reliability and the validity of Korean version of the Beck Depression Inventory-II (BDI-II). J Korean Soc Biol Psychiatry. 2008;14(2):201-212. URL: https://www.scienceopen.com/document?vid=57731595-25fd-452d-8a05-a52fd5995cf2 [Accessed 2025-06-05]
  68. Hollon SD, Kendall PC. Cognitive self-statements in depression: development of an automatic thoughts questionnaire. Cogn Ther Res. Dec 1980;4(4):383-395. [CrossRef]
  69. Kwon SM, Yoon HK. Development and application of the Korean version of the Automatic Thoughts Questionnaire. Stud Res. 1994;29(1):10-25.
  70. Heo S, Kim J. Development and validation of short form of the Korean version of the Automatic Thoughts Questionnaire-Negative. HSS21. Jun 30, 2020;11(3):783-796. [CrossRef]
  71. Heo S, Kim J. A validation of the Korean Version of the Positive Subscale of the Automatic Thoughts Questionnaire-Revised (K-ATQ-RP). HSS21. Oct 30, 2020;11(5):751-764. [CrossRef]
  72. Kendall PC, Howard BL, Hays RC. Self-referent speech and psychopathology: the balance of positive and negative thinking. Cogn Ther Res. Dec 1989;13(6):583-598. [CrossRef]
  73. Baker RW, Siryk B. Measuring adjustment to college. J Couns Psychol. 1984;31(2):179-189. [CrossRef]
  74. Lee YJ. The Non-Residential Students’ Adaptation to College Life and Career Plans. Ewha Womans University; 1999.
  75. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile App Rating Scale: a new tool for assessing the quality of health mobile apps. JMIR mHealth uHealth. 2015;3(1):e27. [CrossRef]
  76. Gregoire J. ITC guidelines for translating and adapting tests (second edition). Int J Test. Apr 3, 2018;18(2):101-134. [CrossRef]
  77. Chung KM, Suh YJ, Chin S, et al. A pilot study testing the efficacy of dCBT in patients with cancer experiencing sleep problems. Front Psychol. 2022;13:699168. [CrossRef] [Medline]
  78. Mind booster green. iApp Store. URL: https://apps.apple.com/kr/app/id1557176314 [Accessed 2025-05-20]
  79. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol. Feb 1991;59(1):12-19. [CrossRef] [Medline]
  80. Hubbard AE, Ahern J, Fleischer NL, et al. To GEE or not to GEE: comparing population average and mixed models for estimating the associations between neighborhood risk factors and health. Epidemiology. Jul 2010;21(4):467-474. [CrossRef] [Medline]
  81. Beck JS. Cognitive Behavior Therapy: Basics and Beyond. Guilford Press; 2020. ISBN: 1462544193
  82. Cristea IA, Kok RN, Cuijpers P. Efficacy of cognitive bias modification interventions in anxiety and depression: meta-analysis. Br J Psychiatry. Jan 2015;206(1):7-16. [CrossRef]
  83. Forand NR, Barnett JG, Strunk DR, Hindiyeh MU, Feinberg JE, Keefe JR. Efficacy of guided iCBT for depression and mediation of change by cognitive skill acquisition. Behav Ther. Mar 2018;49(2):295-307. [CrossRef] [Medline]
  84. Mogoaşe C, David D, Koster EHW. Clinical efficacy of attentional bias modification procedures: an updated meta-analysis. J Clin Psychol. Dec 2014;70(12):1133-1157. [CrossRef] [Medline]
  85. Wu A, Scult MA, Barnes ED, Betancourt JA, Falk A, Gunning FM. Smartphone apps for depression and anxiety: a systematic review and meta-analysis of techniques to increase engagement. NPJ Digital Med. Feb 2021;4(1). [CrossRef]
  86. Domhardt M, Steubl L, Boettcher J, et al. Mediators and mechanisms of change in internet- and mobile-based interventions for depression: a systematic review. Clin Psychol Rev. Feb 2021;83:101953. [CrossRef]
  87. Mogoașe C, Cobeanu O, David O, Giosan C, Szentagotai A. Internet-based psychotherapy for adult depression: what about the mechanisms of change? J Clin Psychol. Jan 2017;73(1):5-64. [CrossRef] [Medline]
  88. Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res. Apr 24, 2009;11(2):e13. [CrossRef] [Medline]
  89. Kelders SM, Kok RN, Ossebaard HC, Van Gemert-Pijnen JEWC. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res. Nov 14, 2012;14(6):e152. [CrossRef] [Medline]
  90. Hamid A, Arshad R, Shahid S. What are you thinking? using CBT and storytelling to improve mental health among college students. 2022. Presented at: CHI ’22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems; Apr 30 to May 5, 2022; New Orleans, USA. [CrossRef]
  91. Busselle R, Bilandzic H. Measuring narrative engagement. Media Psychol. Nov 23, 2009;12(4):321-347. [CrossRef]
  92. Brown M, O’Neill N, van Woerden H, Eslambolchilar P, Jones M, John A. Gamification and adherence to web-based mental health interventions: a systematic review. JMIR Ment Health. Aug 24, 2016;3(3):e39. [CrossRef] [Medline]
  93. Xu L, Shi H, Shen M, et al. The effects of mHealth-based gamification interventions on participation in physical activity: systematic review. JMIR Mhealth Uhealth. Feb 3, 2022;10(2):e27794. [CrossRef] [Medline]
  94. Lau N, O’Daffer A, Yi-Frazier JP, Rosenberg AR. Popular evidence-based commercial mental health apps: analysis of engagement, functionality, aesthetics, and information quality. JMIR Mhealth Uhealth. Jul 14, 2021;9(7):e29689. [CrossRef] [Medline]
  95. Six SG, Byrne KA, Tibbett TP, Pericot-Valverde I. Examining the effectiveness of gamification in mental health apps for depression: systematic review and meta-analysis. JMIR Ment Health. Nov 29, 2021;8(11):e32199. [CrossRef] [Medline]


ATQN-SF: Automatic Though Questionnaire—Negative, Short Form
ATQP-SF: Automatic Though Questionnaire—Positive, Short Form
BDI-II: Beck Depression Inventory-II
CBT: cognitive behavioral therapy
CONSORT-EHEALTH: Consolidated Standards of Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth
GEE: generalized estimating equation
IRB: institutional review board
ITT: intention-to-treat
MARS: Mobile App Rating Scale
PHQ-9: Patient Health Questionnaire-9
PP: per-protocol
SACQ-R: Student Adaptation to College Questionnaire-Revised
SNS: social networking service
t-CBT: technology-based cognitive behavioral therapy
WLC: waitlist control


Edited by Lorraine Buis; submitted 12.09.24; peer-reviewed by Jia-Yan Pan; final revised version received 15.04.25; accepted 29.04.25; published 19.06.25.

Copyright

©Min Hee Kim, Yeon-kug Moon, Kyong-Mee Chung. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 19.6.2025.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.