This paper is in the following e-collection/theme issue:

Ecological Momentary Assessment (EMA) (321) Digital Health Reviews (1326) Behavior Change (723) Mobile Health (mhealth) (2982) mHealth for Wellness, Behavior Change and Prevention (2922) Methods and New Tools in Mental Health Research (463) Substance Abuse (428)

Published on in Vol 9, No 11 (2021): November

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/22890, first published .
Smartphone-Delivered Ecological Momentary Interventions Based on Ecological Momentary Assessments to Promote Health Behaviors: Systematic Review and Adapted Checklist for Reporting Ecological Momentary Assessment and Intervention Studies

Smartphone-Delivered Ecological Momentary Interventions Based on Ecological Momentary Assessments to Promote Health Behaviors: Systematic Review and Adapted Checklist for Reporting Ecological Momentary Assessment and Intervention Studies

Smartphone-Delivered Ecological Momentary Interventions Based on Ecological Momentary Assessments to Promote Health Behaviors: Systematic Review and Adapted Checklist for Reporting Ecological Momentary Assessment and Intervention Studies

Authors of this article:

Kim Phuong Dao1, 2 Author Orcid Image ;   Katrien De Cocker3 Author Orcid Image ;   Huong Ly Tong1 Author Orcid Image ;   A Baki Kocaballi4 Author Orcid Image ;   Clara Chow1 Author Orcid Image ;   Liliana Laranjo1 Author Orcid Image
Article Authors Cited by (51) Tweetations (24) Metrics

    Review

    1Westmead Applied Research Centre, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia

    2Capital Health Network, Canberra, Australia

    3Institute for Resilient Regions, Centre for Health Research, University of Southern Queensland, Springfield Central, Australia

    4School of Computer Science, Faculty of Engineering & Information Technology, University of Technology Sydney, Sydney, Australia

    *these authors contributed equally

    Corresponding Author:

    Liliana Laranjo, MD, MPH, PhD

    Westmead Applied Research Centre

    Faculty of Medicine and Health

    The University of Sydney

    Rm No 2041, Research & Education Network, Westmead Hospital

    Cnr Darcy and Hawkesbury Roads

    Sydney, 2145

    Australia

    Phone: 61 413461852

    Email: liliana.laranjo@sydney.edu.au


    Background: Healthy behaviors are crucial for maintaining a person’s health and well-being. The effects of health behavior interventions are mediated by individual and contextual factors that vary over time. Recently emerging smartphone-based ecological momentary interventions (EMIs) can use real-time user reports (ecological momentary assessments [EMAs]) to trigger appropriate support when needed in daily life.

    Objective: This systematic review aims to assess the characteristics of smartphone-delivered EMIs using self-reported EMAs in relation to their effects on health behaviors, user engagement, and user perspectives.

    Methods: We searched MEDLINE, Embase, PsycINFO, and CINAHL in June 2019 and updated the search in March 2020. We included experimental studies that incorporated EMIs based on EMAs delivered through smartphone apps to promote health behaviors in any health domain. Studies were independently screened. The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were followed. We performed a narrative synthesis of intervention effects, user perspectives and engagement, and intervention design and characteristics. Quality appraisal was conducted for all included studies.

    Results: We included 19 papers describing 17 unique studies and comprising 652 participants. Most studies were quasi-experimental (13/17, 76%), had small sample sizes, and great heterogeneity in intervention designs and measurements. EMIs were most popular in the mental health domain (8/17, 47%), followed by substance abuse (3/17, 18%), diet, weight loss, physical activity (4/17, 24%), and smoking (2/17, 12%). Of the 17 studies, the 4 (24%) included randomized controlled trials reported nonstatistically significant effects on health behaviors, and 4 (24%) quasi-experimental studies reported statistically significant pre-post improvements in self-reported primary outcomes, namely depressive (P<.001) and psychotic symptoms (P=.03), drinking frequency (P<.001), and eating patterns (P=.01). EMA was commonly used to capture subjective experiences as well as behaviors, whereas sensors were rarely used. Generally, users perceived EMIs to be helpful. Common suggestions for improvement included enhancing personalization, multimedia and interactive capabilities (eg, voice recording), and lowering the EMA reporting burden. EMI and EMA components were rarely reported and were not described in a standardized manner across studies, hampering progress in this field. A reporting checklist was developed to facilitate the interpretation and comparison of findings and enhance the transparency and replicability of future studies using EMAs and EMIs.

    Conclusions: The use of smartphone-delivered EMIs using self-reported EMAs to promote behavior change is an emerging area of research, with few studies evaluating efficacy. Such interventions could present an opportunity to enhance health but need further assessment in larger participant cohorts and well-designed evaluations following reporting checklists. Future research should explore combining self-reported EMAs of subjective experiences with objective data passively collected via sensors to promote personalization while minimizing user burden, as well as explore different EMA data collection methods (eg, chatbots).

    Trial Registration: PROSPERO CRD42019138739; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=138739

    JMIR Mhealth Uhealth 2021;9(11):e22890

    doi:10.2196/22890

    Keywords

    ecological momentary assessment; ecological momentary intervention; behavior change; health behavior; mHealth; mobile health; smartphone apps; mobile phone 


    Background

    Mobile technologies have become popular approaches to promote behavior change and improve health outcomes, offering the ability to reach large populations in an easy, rapid, and low-cost manner [1,2]. Until recently, mobile behavior change interventions were limited to providing automated and predefined generic or minimally tailored messages, mainly based on estimates of baseline or usual behaviors and their determinants [3]. As people’s behaviors are driven by individual and contextual factors that vary across time [4,5], there is a need to make behavior change interventions that are more adaptive to the users’ evolving needs and context. Such an adaptive and dynamic intervention approach might help maintain participant engagement, sustain and support continued behavior change for longer durations, and thereby achieve greater health benefits [4-6].

    Ecological momentary interventions (EMIs) are behavior change interventions that deliver support in real time, when most needed [7], for example, when the user is most likely to engage in unhealthy behaviors. To provide the information or treatment in real time and in real settings, EMIs are often based on repeated user reports collected via questionnaires, that is, ecological momentary assessments (EMAs) [8]. These EMA self-reports are usually real time or near real time and can focus on behaviors, contexts, emotional states, beliefs, attitudes, perceptions, exposures, events, or experiences in naturalistic settings (eg, “How are you feeling right now?”, “What are you doing right now?”, and “Are you near anyone smoking?”) [9]. EMAs originated in psychology a few decades ago, when these self-reports were primarily paper-based [8,9].

    It has been suggested that tailoring EMIs based on EMAs may lead to higher user engagement and intervention effectiveness [7,10,11]. Given the ubiquity of smartphones [12,13], researchers are starting to explore the use of these mobile technologies to collect EMAs and deliver EMIs [14-17]. Previous systematic reviews of EMAs have focused on sedentary behavior, physical activity, and diet, mixing different EMA media for data collection, such as smartphones, PDAs (precursors of smartphones, now discontinued), and paper-and-pencil diaries [18-22]. The few existing systematic reviews on EMIs have focused on mental health and have also included studies with mixed media for EMIs, such as telephone, SMS text messaging, in-person counseling, computers, PDAs, and smartphones (a minority of included studies) [23-25]. To date, no studies have synthesized the current evidence on the use of smartphone-delivered EMIs using EMAs and their impact on health behaviors, user perspectives, or engagement.

    Objective

    The overall objective of this study is to systematically review the evidence and characteristics of smartphone-delivered EMIs to promote behavior change, using self-reported EMAs, specifically (1) their effects on health behaviors in any health domain, (2) user engagement, and (3) user perspectives. Although not the original aim of this systematic review, another objective arose upon data extraction and analysis—developing a reporting checklist (adapted from an existing checklist [22]) to facilitate interpretation and comparison of findings and enhance transparency and replicability of future studies using EMAs and EMIs.


    The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were used when conducting and reporting this systematic review. The protocol was registered in PROSPERO (International Prospective Register of Systematic Reviews; CRD42019138739).

    Search Strategy for Identification of Studies

    A literature search was conducted in June 2019 (and updated in March 2020) using MEDLINE (via PubMed interface), Embase, PsycINFO, and CINAHL. Search strings included a combination of free terms and controlled vocabulary when supported (complete search strategy available in Multimedia Appendix 1). The reference lists of relevant articles were also screened to ensure that all eligible studies were included. The authors were contacted if there was a need for any additional information about the included studies.

    Study Selection Criteria

    The eligibility criteria were developed using the PICO (Participants, Intervention, Comparator, Outcomes; Multimedia Appendix 2). Participants included healthy individuals or patients with chronic conditions. We included all experimental studies that incorporated EMIs to improve health behaviors in any health domain. For the purposes of this review, an EMI must have been delivered in real time through smartphone apps and must have been based on data collected from users’ repeated reports in their natural context (ie, EMAs) and also via smartphone apps. Outcomes included any measures that illustrated the effects on health behavior changes (eg, changes in step counts and diet changes). Secondary outcomes included perspectives on EMIs and user engagement behaviors with different types of EMIs, including retention rate. No limiting criteria were used regarding comparison groups. Peer-reviewed studies published in English were included, and no restrictions were set regarding publication dates.

    We excluded protocols, reviews, opinion pieces, and design and development papers without user evaluation of EMIs. Studies that used EMAs only for the purpose of data collection or outcome measurement were also excluded. Other exclusion criteria included interventions that relied solely on the automated data collected (eg, only through sensors and no user-reported EMAs) and interventions that were not based on data submitted by the participants (ie, EMAs) via smartphone apps or wearable devices.

    Screening, Data Extraction, and Synthesis

    A pilot screening of the studies was completed before the actual screening process began. The title and abstract screening and full-text screening were conducted by 2 independent investigators. A third researcher resolved disagreements. Cohen κ was applied to measure the intercoder agreement in each screening phase.

    An investigator extracted the information from the included studies into a standardized form, and another researcher reviewed the form for consistency. The data collected from each study included the first author, year of publication, location, health domain, intervention aim, study design and duration, participants’ settings and characteristics, EMA data collection characteristics (eg, type of information collected from participants, prompting design and frequency—following the CREMAS [Checklist for Reporting EMA Studies] reporting checklist [22]), intervention components (eg, app, website, and therapy sessions), smartphone-based EMI characteristics (eg, frequency), health-related outcomes, user’s perspectives regarding EMIs and EMAs, and user engagement. Behavior change techniques (BCTs) were coded by 2 researchers using the BCT taxonomy [26]. Included randomized controlled trials (RCTs) were appraised by 2 researchers using the Cochrane risk of bias tool [27]. Nonrandomized studies were appraised by 2 researchers using the Risk Of Bias In Non-randomized Studies of Interventions tool [28]. A narrative synthesis was conducted for all included studies.


    Description of Included Studies

    The search returned 2824 results (Figure 1). Of the 2824 studies, after removing duplicates, 2162 (76.56%) studies underwent title and abstract screening. Of the 2162 studies, there were 81 (3.75%) studies for full-text screening; of the 81 studies, 66 (81%) were excluded for not meeting the inclusion criteria (reasons for exclusion are presented in Multimedia Appendix 3). Cohen κ scores were 0.3 and 0.5 for abstract and full-text screening, respectively. We included 15 papers from the original search and 4 additional papers from other sources (reference lists of included studies and database search updates), corresponding to 19 articles, describing 17 unique studies (Table 1).

    The 17 included studies (19 papers) involved a total of 652 participants [29-47] (Table 1). Most studies (13/17, 76%; 15/19, 79% papers) were conducted in the United States [29-32,34,37-45,47]. Publication years ranged from 2011 to 2020 (13/17, 76% studies were published from 2016 onward). Study duration ranged from 2-15 weeks, and the average duration was 4 weeks. Sample size varied from 7-121 participants (mean 35.2, SD 33.3; 67% women). The health domains covered were: mental health [29-36], smoking cessation [37-39], and substance abuse control [40-42], as well as diet, weight loss, and physical activity [43,44,46,47]. Studies in the mental health domain mostly recruited patients from outpatient clinics diagnosed with a mental health problem (major depressive disorder [29], schizophrenia [34,36], bipolar disorder [31], and other conditions [30,32,35]), and only 1 study focusing on mood and anxiety management recruited participants without a diagnosis [33]. Studies focusing on smoking recruited participants from smoking cessation clinics [37-39]. Studies on substance abuse control recruited individuals currently in treatment for an alcohol disorder from the community [40], college students with problematic drinking [41], and marijuana users from primary care clinics [42]. Finally, studies on diet, weight loss, and physical activity recruited obese individuals undergoing assessment for bariatric surgery [43], overweight or obese participants from the community [44,45], university students interested in well-being [46], and African American women after breast cancer treatment, recruited from the community [47].

    Of the 17 studies, there were 4 (24%; 5/19, 26% papers) RCTs [39,42,44,45,47] and 12 (71%; 13/19, 68% papers) quasi-experimental studies (all with a single-arm design [29-35,37,38,40,41,43,46] except for one with 2 arms [36]). Of the 17 studies, participant retention was reported in 14 (82%; 16/19, 84% papers) studies, ranging from 62.1%-100% in the intervention arm [29-31,34,36-47], with 11 (65%; 13/19, 68% papers) studies having retention rates >75% [29-31,34,36-38,40,41,44-47]. The risk of bias of the 4 RCTs was assessed as unclear for most of the risk of bias tool categories (Multimedia Appendix 4). Overall risk of bias in nonrandomized studies was assessed as serious for most studies (Multimedia Appendix 5).

    ‎
    Figure 1. Flowchart of included studies.
    View this figure
    Table 1. Characteristics of included studies.
    Author, year, locationIntervention aimStudy designDuration (weeks); Sample size (Ia;Cb); Age (years), mean (SD); Women (%);CharacteristicsStudy retention rate (%)Intervention componentsHealth-related outcomesP value
    Mental health

    		Burns, 2011, United States [29]Mood disorders managementQuasi-experimental, 1 arm7; 8 (N/Ac); 37.4 (12.2); 87%; Adults with major depressive disorder recruited on the web87App, website, phone coaching, emails, and sensorsDepressive symptoms decreased postintervention<.001

    		Bush, 2014, United States [30]Mood and anxiety disorders managementQuasi-experimental, 1 arm2; 8 (N/A); NRd; 37%; Military personnel under treatment for behavioral health issues100AppNR—e

    		Wenze, 2016, United States [31]Bipolar disorder managementQuasi-experimental, 1 arm12; 8 (N/A); 44 (11.6); 65%; Patients with bipolar disorder from a psychiatric hospital (inpatient and outpatient)100App and therapy sessions (4 weekly during 1 month)NSf Change in symptoms or adherence—

    		Shrier, 2017, United States [32]Impulse control disorder managementQuasi-experimental, 1 arm4; 16 (N/A); 19.6 (NR); 100%; Primary care patients with depressive symptoms and at increased HIV riskNRApp and therapy sessionsNR—

    		Bakker, 2018, Australia [33]Mood and anxiety disorders managementQuasi-experimental, 1 arm4; 44 (N/A); 36 (13); 82%; Participants recruited on the web (no diagnosis needed)NRAppNR—

    		Kreyenbuhl, 2019, United States [34]Promote antipsychotic medication adherenceQuasi-experimental, 1 arm2; 7 (N/A); 47.6 (10.4); 0%; African American men with schizophrenia from an outpatient mental health clinic100App and clinician appointmentParticipants reported taking their antipsychotic medication in 100% of the adherence EMAsg to which they responded—

    		Vaessen, 2019, The Netherlands [35]Psychotic disorders managementQuasi-experimental, 1 armResults for intervention arm of randomized controlled trial; 16 (N/A); NR; NR; First episode psychosis in the past 3 years, recruited from mental health clinicsNRApp and acceptance and commitment therapy sessions (weekly)NR—

    		Hanssen, 2020, The Netherlands [36]Schizophrenia spectrum disorders managementQuasi-experimental, 2 arms3; 64 (NR; NR); 37.9 (8.6); 33%; Patients with schizophrenia spectrum disorder, recruited from hospitals and clinics78AppPsychotic symptoms significantly decreased postintervention in the intervention group compared with control (b=−0.005; 95% CI −0.01 to −0.0006).03
    Smoking cessation

    		Businelle, 2016, and Hebert, 2018, United States [37,38]Smoking cessation and relapse preventionQuasi-experimental 1 arm13; 59 (N/A); 52 (7); 54%; Individuals attending a first visit at a smoking cessation clinic78App, group counseling, and cessation pharmacotherapyAbstinence rate decreased over time (41% in week 1 and 20% in week 12)—

    		Hebert, 2020, United States [39]Smoking cessation and relapse preventionRandomized controlled trial, 3 arms13; 81 (28; 28; 28); 49.6 (11.9); 50%; Individuals referred to a smoking cessation clinic66App, group counseling, and cessation pharmacotherapyAbstinence rate NS between groups—
    Substance abuse control

    		Dulin, 2014, United States [40]Alcohol abuse treatmentQuasi-experimental 1 arm5; 28 (N/A); 33.6 (6.5); 46%; Individuals currently in treatment for an alcohol disorder, recruited from the community100App and sensorDecrease in percentage of heavy drinking days postintervention (56% vs 25%; Cohen d=1.0)<.001

    		Leonard, 2017, United States [41]Alcohol abuse prevention and managementQuasi-experimental, 1 arm3; 10 (N/A); 20.7 (NR); 100%; College students with problematic drinking not under treatment100App, two counseling sessions, and sensorNR—

    		Shrier, 2018, United States [42]Marijuana use cessationRandomized controlled trial, 3 arms12; 70 (NR; NR; NR); 20.7 (NR); 60%; Marijuana users from primary care clinics66App and counseling sessionsPercentage of days abstinent, NS between arms—
    Diet and physical activity

    		Mundi, 2015, United States [43]Promote healthy lifestyles to prepare for bariatric surgeryQuasi-experimental, 1 arm15; 30 (N/A); 41.3 (11.4); 90%; Patients with obesity undergoing assessment for bariatric surgery67AppNutrition knowledge and engagement with healthy lifestyles: NS improvements—

    		Goldstein, 2018 and 2020, United States [44,45]Diet adherenceRandomized controlled trial, 2 arms10; 121 (62; 59); 47.2 (13.4); 100%; BMI ≥25 kg/m2 recruited from the community84.3App and Weight Watchers programWeight loss: NS improvements; Lapse frequency: NS improvements—

    		Pentikäinen, 2019, Finland [46]Diet adherenceQuasi-experimental, 1 arm4; 74 (N/A); 36.2 (12.5); 61%; Individuals interested in well-being, recruited from universities79AppThe average interval between meals increased; the number of daily eating occasions decreased.003; .01

    		Allicock, 2020, United States [47]Promote physical activity and diet adherenceRandomized controlled trial, 2 arms8; 22 (13;9); 52 (9); 100%; African American women post breast cancer treatment, recruited from the community100AppReduced sedentary time by 4.37 (SD 7.14) hours/day versus controls; waist circumference, BMI change, physical activity, diet: NS improvements<.05

    aI: intervention.

    bC: control

    cN/A: not applicable.

    dNR: not reported.

    eNot available.

    fNS: not supported.

    gEMA: ecological momentary assessment.

    Intervention Characteristics

    The commonly collected types of EMA data were affect-related (eg, emotions, feelings, and mood; 12/17, 71% studies; 14/19, 74% papers) [29-33,35-39,41,42,44,45], related to behaviors (eg, self-reported diet, physical activity, alcohol use, and medication adherence; 12/17, 71% studies; 14/19, 74% papers) [31-39,42-47], related to cognitions (eg, reasons for nonadherence and reasons to quit alcohol; 10/17, 59% studies; 12/19, 63% papers) [29,31,33-39,42-45], and related to social and environmental context (eg, distractions while eating and interaction with someone smoking; 9/17, 53% studies; 11/19, 58% papers; Table 2) [29,36-45]. In addition to user-reported EMAs, 18% (3/17) of studies also had sensor-collected data (eg, GPS and accelerometer) [40,48,49]. User-reported data collection was initiated either by the app (user would be prompted by the app to provide certain data) [29,31,32,34-39,41-45] or by the user (eg, as users saw fit; after a certain event, such as a meal) [29,30,33,37-41,44-46], sometimes with more than one modality in the same study [37-39,41,44,45,47]. The daily frequency of EMA prompts in app-initiated data collection was reported in 11 (65%; 13/19, 68% papers) studies [29,31,32,35-39,42-45,47], ranging from 2-8 times, with the most common being 4 to 5 times daily [29,32,37-39,42,43]. In 12% (2/17) of studies, the daily frequency was variable, depending on the number of times the participant needed to take medication daily [34] and depending on a trigger from a sensor [41]. The time window allowed for responding to EMA prompts was reported in 29% (5/17) of studies and varied between 1 and 130 minutes (Multimedia Appendix 6) [31,36-38,43,44].

    EMIs consisted mostly of suggesting coping strategies (eg, use of cognitive-behavioral skills) [29,31-33,35-45,47], followed by motivational feedback (eg, positive reinforcement and supportive messages) [29,32,34,37-43,47] and informational feedback (eg, user-tailored graphs; Table 2) [30,31,44-47]. EMI characteristics were poorly reported and were not described in a standardized manner across studies, rarely detailing the decision mechanism (eg, algorithm). The EMI mechanism was not reported in 7 (41%, 8/19, 42% papers) studies [31-33,35-39], predetermined in 8 (47%) studies [30,34,40-43,46,47], and adaptive in 2 (12%; 3/19, 16% papers) studies [29,44,45]. The delivery format was in the form of text in most studies [29,31-34,36-45,47]; approximately 12% (2/17) of studies used tailored graphs [30,46], and 6% (1/17) of studies used texts and images [35]. Most interventions used other components in addition to the app, the most common one being counseling sessions with a therapist, either face-to-face or by telephone [29,31,34,35,37-39,41,42].

    There were 35 BCTs identified across the studies (Multimedia Appendices 7 and 8). The most popular BCTs were social support (unspecified; 13/17, 76% studies; 15/19, 79% papers) [29,31,32,34,35,37-45,47], followed by prompt or cue (10/17, 59% studies; 11/19, 58% papers) [29,30,32,34-36,40,43-45,47], problem solving (9/17, 53% studies; 11/19, 58% papers) [29,31,33,36-41,44,45], feedback on behavior (6/17, 35% studies) [31,34,36,41,43,46], self-monitoring of behavior (7/17, 41% studies) [29,31,34,40,42,46,47], and social support (emotional; 6/17, 35% studies) [31-33,40-42]. The most commonly mentioned theories, frameworks, or models were cognitive behavioral therapy [31,33,41,42] and motivational interviewing [40-42].

    Table 2. Characteristics of EMAa data collection and EMIb in included studiesc.
    Author, year, locationEMA data collectionEMI

    		Type of user-reported dataMechanismdFormat (input mode)SensorseType of intervention contentMechanismdFormat (delivery mode)
    Mental health

    		Burns, 2011, United States [29]Affect-related (mood), cognitions, social and environmental context, and motivational statesApp-initiated (predetermined, ≥5 times daily at random times between 7 AM and 10 PM, depending on participant preference) and user-initiated (frequency as users see fit)Likert scales and multiple choice38 sensors (eg, GPS and accelerometer)Coping strategies (suggested activities) and motivational feedback (message to reinforce improvement)App-initiated and adaptive (eg, suggested activities when a user’s self-reported mood was outside their typical range, based on a machine-learning algorithm built from EMA and sensor data); frequency, interval, and time allowed: NRfText

    		Bush, 2014, United States [30]Affect-related and mental health-related symptoms and events (stress, head injury, depression, anxiety, well-being)User-initiated (frequency as users see fit)Slide bar to rate emotions and states—gInformational feedback (access to customized reports of mood data and personalized graphs of EMA data)App-initiated; predetermined; frequency, interval, and time allowed: N/AhGraph

    		Wenze, 2016, United States [31]Affect-related, behaviors (daily medications and appointments and adherence behaviors), cognitions (risk factors for nonadherence), and bipolar disorder symptoms (eg, sleep)App-initiated (time-contingent; 2/day, 9 AM and 9 PM; time allowed: 12 min)Likert scale and multiple choices—Coping strategies and informational feedbackApp-initiated; NRText

    		Shrier, 2017, United States [32]Affect-related, behaviors (sexual behavior), and self-efficacy for safer sex behaviorApp-initiated (predetermined, at random times, 4 times daily; time allowed: NR)NR—Coping strategies and motivational feedback (provided supportive messages and prompted use of cognitive-behavioral skills)App-initiated; NRText

    		Bakker, 2018, Australia [33]Affect-related (mood), cognitions, and physiological responseUser-initiated (frequency as users see fit)Multiple choice and sliding bars—Coping strategies; upon completion of activities, gamified rewards were issuedNRText

    		Kreyenbuhl, 2019, United States [34]Behaviors (medication adherence at scheduled times throughout the day) and cognitions (reasons for nonadherence)App-initiated (predetermined, event-contingent and dependent on the number of times the participant needs to take medication daily)Multiple choice—Motivational feedback based on self-reported adherenceApp-initiated and predetermined (If-Then, depending on individual responses); frequency and interval dependent on EMA; time allowed: NRText

    		Vaessen, 2019, Netherlands [35]Affect-related (current mood), behaviors (activity), and symptomsApp-initiated (predetermined, random times, 8 times daily); time allowed: NRNR—Coping strategies (suggested exercise to train general acceptance and commitment therapy principles)App-initiated; NRImage and text

    		Hanssen, 2020, Netherlands [36]Affect-related (feelings and moods), thoughts, behaviors, cognitions, social and environmental context, and symptomsApp-initiated (predetermined, random, 6 times daily between 10 AM and 10 PM, intervals >130 min; time allowed: NR)Likert scale, multiple choices, and yes/no answers—Coping strategies (provided suggestions for a certain activity or behavior change based on previous EMA answers in the following categories: psychotic symptoms, social engagement, health behavior, and mood and emotion)App-initiated; mechanism NR; frequency: 2 prompts/day; interval and time allowed: NRText
    Smoking cessation

    		Businelle, 2016 [37] and Hebert, 2018, United States [38]Affect-related, behaviors (recent alcohol consumption), cognitions (motivation to quit), social and environmental context (eg, cigarette availability and interaction with someone smoking), and urge to smokesThree types of EMA with three different frequencies: Daily diary (app-initiated; once daily, 30 min after waking; time allowed: 60 seconds); Random sampling (app-initiated; predetermined, random, 4 times daily; time allowed: NR); Event sampling (user-initiated; precessation smoking, urge, and postcessation lapse)Click buttons to report smoking incidents—Coping strategies (provided risk-tailored messages to help participants cope with lapse triggers) and motivational feedbackApp-initiated; mechanism NR; frequency and interval: NR; time allowed: NRText

    		Hebert, 2020, United States [39]Affect-related, behaviors (recent alcohol consumption), cognitions (motivation to quit), social and environmental context (eg, cigarette availability and interaction with someone smoking), and urge to smokeThree types of EMA with three different frequencies: Daily diary (app-initiated; 1/day, 30 min after waking); Random sampling (app-initiated; predetermined, random, 4 times daily; time allowed: NR); Event sampling (user-initiated; precessation smoking, urge, and postcessation lapse)Click buttons to report smoking incidents—Coping strategies (provided risk-tailored messages to help participants cope with lapse triggers) and motivational feedbackApp-initiated; mechanism NR; frequency and interval: NR; time allowed: NRText
    Substance abuse control

    		Dulin, 2014, United States [40]Social and environmental context (user-identified high-risk locations); cravingsUser-initiated (frequency as users see fit)NRGPSCoping strategies (provided audible alert and suggestions for maintaining control of drinking when a boundary was crossed around a GPS-triggered high-risk location) and motivational feedbackApp-initiated; predetermined; frequency and interval: based on EMA and sensor data; time allowed: NRText

    		Leonard, 2017, United States [41]Affect-related (current emotions and level of intensity) and social and environmental contextApp-initiated (event-contingent; frequency and interval: based on trigger from sensor; time allowed: NR) and user-initiatedMultiple choiceElectrodermal activity and accelerometerCoping strategies (based on cognitive behavioral therapy) and motivational feedbackApp-initiated; predetermined; frequency and interval based on EMA and sensor data; time allowed: NRText

    		Shrier, 2018, United States [42]Affect-related, behaviors (use of marijuana), cognitions (personal top three triggers for use and effort to avoid use), social and environmental context, and marijuana desireApp-initiated (random; 4-6 times daily; time allowed: NR)NR—Motivational feedback (provided messages designed to support self-efficacy)App-initiated; predetermined; frequency and interval based on EMA responses; time allowed: NRText
    Diet and physical activity

    		Mundi, 2015, United States [43]Behaviors (frequency of eating or snacking and use of calorie-containing beverages, meal planning, frequency of foods not prepared at home, rate of eating, and quantity of physical activity), cognitions (barriers to physical activity), and social and environmental context (distractions while eating)App-initiated (predetermined, time-contingent; five times daily; time allowed: 60 min)NR—Coping strategies and motivational feedback; upon a study subject’s response to the given EMA message, a tailored EMI message was electronically generated (if a patient endorsed a healthy lifestyle, they were sent a congratulatory and supportive message, and if a patient was struggling to make a positive lifestyle modification, they were sent a supportive message outlining some alternative behavioral strategies)App-initiated; predetermined; frequency and interval based on EMA responses; time allowed: NRText

    		Goldstein, 2018 and 2020, United States [44,45]Affect-related, behaviors (dietary lapse), cognitions, and social and environmental context (variables known to predict lapses)App-initiated (predetermined, six times daily; time allowed: 90 min) and user-initiated (after a lapse)Likert scales and yes or no answers—Coping strategies and informational feedback (alert was issued when the algorithm classified a user to be at risk for lapsing, communicating (a) top three factors contributing to level of risk (context-awareness) and (b) strategies to cope with each specific risk factor)App-initiated; adaptive; frequency and interval based on EMA responses; time allowed: NRText

    		Pentikäinen, 2019, Finland [46]Behaviors (eating rhythm)User-initiated (when participant had meal)Two buttons to record types of eating occasion—Informational feedback (graphs of EMA data)App-initiated; predetermined; frequency and interval based on EMA responses; time allowed: N/ATailored graph

    		Allicock, 2020, United States [47]Behaviors (diet and physical activity)Three types: Daily diary (app-initiated; 1/day, 30 min after waking; time allowed: NR); Random sampling (app-initiated; predetermined, random, 2 times daily; time allowed: NR); User-initiated (before and after meals or exercise)NR—Informational, coping strategies, and motivational feedback (providing behavioral cues or prompting, increasing self-efficacy, building behavioral capability, and providing positive reinforcements to behaviors)App-initiated; predetermined; frequency and interval based on EMA responses); time allowed: NRText

    aEMA: ecological momentary assessment.

    bEMI: ecological momentary intervention.

    cEMA and EMI characteristics reported according to items specified in Table 3 based on information reported in the included studies.

    dInitiative, mechanism, frequency and interval, and time allowed.

    eAdditional components for data collection.

    fNR: not reported.

    gNot available.

    hN/A: not applicable.

    Incentives, Adherence, Reported Outcome Measures, and User Perspectives

    Participants in 64% (11/17) studies (13/19, 68% papers) received material (eg, movie tickets) or monetary compensations for participating in the study [31,32,36-42,44-47]. Of those 11 studies, 6 (55%) studies (8/13, 62% papers) had incentives associated with EMA completion [31,37-39,42,44,45,47]. Adherence to EMA prompts (ie, to self-reporting data) was mentioned in 59% (10/17) studies (12/19, 63% papers) [31,34,36-39,41-45,47], most often in the form of response rate (Multimedia Appendix 6). The response rate varied from 30.7%-87% (9/17, 53% studies; 11/19, 58% papers; average 64.7%) [31,34,36-39,42-45,47]. Studies with a time limit to respond to EMA (4/17, 24% studies; 5/19, 26% papers) had lower response rates (30.7%, 58%, 62.9%) [31,43-45], except for 6% (1/17) of studies (2/19, 11% papers), with a response rate of 87% and with a high financial incentive for participants (those who completed 50%-74% of assessments received a US $40 gift card; 75-89% completion, US $80 gift card; and >90%, US $120 gift card) [37,38]. Of the 17 studies, 2 (12%) studies (3/19, 16% papers) reported the average time spent on each EMA prompt (ie, time spent self-reporting data), which varied from 2-6 minutes [31,37,38]. Adherence to EMI was reported in 24% (4/17) of studies (6/19, 32% papers) [36-38,44-46], with different measurements in each study (Multimedia Appendix 6).

    Of the 17 studies, health-related outcomes were reported in 12 (71%) studies (14/19, 74% papers) [29,31,34,36-40,42-47]. Of the 17 studies, the 4 (24%) included RCTs reported nonstatistically significant improvements in substance abstinence, diet, weight loss, and sedentary time compared with the control group [39,42,44,47], and only 4 (24%) quasi-experimental studies reported statistically significant pre-post improvements in self-reported primary outcomes, namely depressive (P<.001) [29] and psychotic symptoms (P=.03) [36], drinking frequency (P<.001) [40], and eating patterns (P=.01) [46].

    Regarding user perspectives (Multimedia Appendix 9), all apps were perceived as useful in supporting behavior change, although to varying degrees. In half of the studies, apps’ ease of use was assessed, with users rating the apps favorably [30-34,36,40-42]. The most helpful aspect of the apps, according to participants, was increasing awareness of their own behavior patterns [29,31-33,36-42,44-46]. The preferred and desirable features of the apps included personalization (eg, tailored prompts, tailored content, and feedback based on user responses) [29,31,32,35-40,44,45], communication with clinicians or coaches [29,30,47], multimedia and interactive capabilities, including voice recording [29,30,32,47], and an appealing design of the graphical user interface [30,32,33,36,40]. Common negative perspectives included EMA prompts being too frequent (more than five times daily), inopportune or tedious to complete [33,35,36,41-45], technical issues (eg, battery drainage and connectivity problems) [29-32,34,40-42], and repetitive content and feedback [31,32,42,44,45]. Of the 17 studies, 2 (12%) studies mentioned the potential negative impacts of momentary prompts on users’ mental well-being, including increased anxiety and stress because of prompts being too frequent or too sudden [41], or prompts giving users an unpleasant degree of self-awareness [35].

    Checklist for Reporting EMA- and EMI-Specific Aspects in Behavior Change Experiments

    EMI and EMA components were rarely reported and were not described in a standardized manner across studies. We found that half of the studies failed to report EMA adherence rates, and this was even lower for EMIs. In addition, the mechanism details for EMAs and EMIs and incentives to complete EMAs and adhere to EMIs have been infrequently reported. On the basis of our findings and on an existing CREMAS [22], we developed a set of reporting items to include in the methods and results sections of EMA and EMI experiments (CREMAIs [Checklist for Reporting EMA- and EMI-specific aspects]; Table 3).

    Table 3. Adapted checklist for reporting smartphone-delivered EMAa- and EMIb-specific aspects in behavior change experiments (CREMAIsc)d.
    Paper section and itemDescriptionEMAEMI
    Methods

    		TypeDetails about the type of EMA and EMIType of data collected (eg, affect-related, behaviors, cognitions, and social and environmental context)Intervention content (eg, coping strategies, motivational feedback, informational feedback, and other behavior change techniques)

    		MechanismInitiativeSystem (eg, app) and/or user-initiated EMASystem (eg, app) and/or user-initiated EMI


    		Mechanism responsible for triggering the EMA/EMIPredetermined (event-contingent, time-contingent and/or random) or adaptive (eg, using statistical/machine learning methods to adapt EMA prompting based on user data)Predetermined (eg, IF X EMA response, THEN Y EMI) or adaptive (eg, using statistical/machine learning methods to adapt EMI based on previous EMA responses and other user data)


    		Frequency and intervalNumber of EMA prompts/day and time between each EMANumber of EMI prompts/day and time between each EMI


    		Time allowedTotal time allowed to answer/receive/perform EMAs before prompt expiresTotal time allowed to answer/receive/perform EMIs before prompt expires

    		FormatDetails about how EMAs/EMIs are deliveredInput mode (eg, Likert scales, yes/no answers, multiple choice, voice, free-text, and image)Delivery mode (eg, voice, text, and image)

    		Additional componentsOther components used in conjunction with the app (eg, sensors; face-to-face behaviors; and website)Other components used in conjunction with the app (eg, sensors; face-to-face behaviors; and website)Other components used in conjunction with the app (eg, sensors; face-to-face behaviors; and website)

    		Behavior change rationaleTheories/frameworks/models to inform the design of the interventionTheories/frameworks/models to inform the design of the interventionTheories/frameworks/models to inform the design of the intervention

    		IncentivesIncentives provided for EMA/EMI adherenceIncentives provided for EMA adherenceIncentives provided for EMI adherence
    Results

    		Response latencyAverage time to respond to EMA/EMI promptAverage time to respond to EMA promptAverage time to respond to EMI prompt

    		Time spent per promptAverage time spent per EMA/EMI promptAverage time spent per EMA promptAverage time spent per EMI prompt

    		Adherence rateResponse or adherence rate for EMA/EMI prompts, detailing the total number of prompts answered/EMI suggestions implemented, and the total number of prompts deliveredResponse or adherence rate for EMA prompts, detailing the total number of prompts answered/EMI suggestions implemented, and the total number of prompts deliveredResponse or adherence rate for EMI prompts, detailing the total number of prompts answered/EMI suggestions implemented, and the total number of prompts delivered

    		Missing dataReport whether EMA/EMI adherence is related to demographic or other variables (eg, prompt relevance)Report whether EMA adherence is related to demographic or other variables (eg, prompt relevance)Report whether EMI adherence is related to demographic or other variables (eg, prompt relevance)

    aEMA: ecological momentary assessment.

    bEMI: ecological momentary intervention.

    cCREMAIs: checklist for reporting EMA and EMI-specific aspects.

    dAdapted from Liao et al [22].


    Principal Findings

    Although the potential for EMIs that build on EMA data for behavior change in the smartphone era seems promising, research on this approach is lacking. We identified 17 studies (only 4 RCTs), all with small sample sizes, short follow-up, and limited evaluation of efficacy. EMIs described were predominantly in mental health management, with a few addressing smoking cessation, substance abuse, diet, weight loss, and physical activity. The most common type of EMA data collected were related to subjective experiences, namely affective states and cognitions, indicating the usefulness of EMAs for this purpose. Behaviors were also often collected via EMAs, with sensors rarely being used. Adherence to collection of EMA data was a common barrier to implementation, with participants disliking the high frequency and tedious nature of EMA data collection. This suggests that EMAs could be gathered via other methods preferred by users (eg, voice). In addition, EMAs could be coupled with passively collected sensor data whenever possible to decrease user burden while still enabling the collection of subjective experiences relevant to user-desired personalization.

    Description of interventions and reporting of evaluation measures were heterogeneous in each health domain, and there were few studies per health domain, limiting any conclusion being made on their efficacy on health behaviors, engagement, and outcomes.

    Comparison With Existing Literature

    To our knowledge, this is the first systematic review of smartphone-delivered EMIs based on self-reported EMAs to support behavioral changes. Existing reviews of EMIs in the treatment of psychotic disorders [24], major depressive disorder [50], alcohol use [51], and eating disorders [14] found that most interventions were in the early stages of development, which aligns with the findings of this review. Notably, the present findings show that most uses of EMIs based on EMAs to date seem to be in the field of mental health, where emotional and cognitive states can vary considerably throughout the day and influence behaviors. Previous systematic reviews on EMIs have all focused on mental health, used mostly older technologies, and did not tailor EMIs based on EMAs, having found mixed results (2 meta-analyses [23,25] showing small but positive effect sizes and another systematic review demonstrating acceptability and feasibility [24]).

    Our review found that EMI and EMA components were rarely reported and were not described in a standardized manner across studies, hampering progress in this field. EMA- and EMI-specific aspects, such as the triggering mechanism and incentives, are important determinants of intervention uptake, retention, and efficacy. Hence, this poor reporting makes it difficult to synthesize and replicate existing evidence. Thus, we developed a set of reporting items—a checklist for reporting EMA- and EMI-specific aspects in behavior change experiments (CREMAIs)—based on an existing reporting checklist for EMA studies (CREMAS) [22]. Given that our adapted checklist focuses exclusively on EMA and EMI aspects, it should be used in conjunction with other reporting guidelines, depending on the type of experimental study design [52-55]. Our findings extend on previous systematic reviews in the field and add to the CREMAS checklist [22] by providing a detailed description of both EMI and EMA components (not just EMA) and specifically with respect to interventions that use smartphones.

    EMI users had negative feedback regarding technical issues, inopportune and repetitive alerts, and prompts not being tailored enough, which may decrease participant engagement. The most common recommendations for intervention design were to make the intervention more personalized and engaging (eg, personalized coping strategies) and to tailor data collection and reduce reporting burden and invasiveness. These perspectives expand on existing literature by showing that for sustained efficacy of behavior change interventions, user engagement is paramount [4,6,56]. Personalization has been commonly suggested as a way to make interventions more engaging, effective, and better received by users [57-60]. One example includes just-in-time adaptive interventions, which are system-triggered interventions that aim to provide the right type/amount of support, at the right time, by adapting to an individual’s changing internal and contextual state (usually based on sensor-collected data) [61].

    Strengths and Limitations

    This review has several strengths. We developed and followed a protocol that was registered in the PROSPERO database at the start of the study. Intervention components were characterized in detail, including the coding of BCTs. However, the results of this review need to be interpreted in the context of certain limitations. Owing to the small number of RCTs, a meta-analysis was not conducted, and thus it was not possible to provide an estimation of preliminary efficacy. There was low to moderate agreement in screening, which reflects the difficulty in establishing whether a study met the inclusion criteria. Screening was complicated by incomplete intervention descriptions, particularly with regard to EMI and EMA reporting. Finally, the definitions of EMI and EMA are not consensual in the literature. Thus, the studies included in this review reflect the predefined definitions we adopted.

    Implications for Future Studies

    The use of smartphone-delivered EMIs based on EMAs in behavior change interventions is a novel area of research, where more RCTs are needed to determine efficacy. Given the ubiquity of smartphones, these interventions have the potential to support behavioral changes at scale. Nevertheless, it is still uncertain which populations may find the use of EMIs based on EMAs most acceptable and which populations and settings may benefit the most. So far, studies have focused on mental health, smoking, substance abuse, diet, weight loss, and physical activity, with mixed results. Appropriately powered clinical trials are needed to examine the use of EMIs tailored by EMAs in a range of populations and settings and to examine the impact on health outcomes and the longevity of these benefits.

    Future studies should explore the combination of EMAs and sensor data to deliver more personalized and minimally burdensome EMIs. EMA involves manual data collection at several points in time, which can be burdensome for users, but remains important to gather individual data that sensors are currently unable to capture, such as subjectively perceived cognitive and affective states [62]. Capturing subjective experiences (eg, cravings, pain, and loneliness) enables a richer and deeper insight into a person’s behavior and can foster the tailoring of an intervention to a person’s needs, which in turn may increase the perceived relevance of EMIs. By combining self-reported EMAs of subjective experiences with additional objective data passively collected via sensors (eg, physical activity patterns and heart rate) [63,64], there is potential to promote a more engaging personalized intervention, as minimally burdensome as possible. Novel machine learning algorithms can further explore these different types of data to increase the precision of personalized interventions [65].

    A more seamless EMA and EMI experience is crucial for engagement. User burden associated with data entry is the most reported reason why people stop using mobile health apps [66]. In addition to using sensors whenever possible, another possibility to reduce user burden is to optimize the design of data collection modes. For instance, faster methods, such as speech-based data entry, may be used instead of requiring users to type in response [67]. Another option would be the use of a chatbot to enable data collection in a conversational and more engaging way. Other feasible options include data entry templates, such as dropdown menus, and the use of personalization to autopopulate some data fields [68] based on previous entries or other data sources [33]. Co-designing interventions with users may offer insights into the best options for data collection in each particular case, regarding the types and amount of data, and the mode, frequency, and timing of data collection [69].

    Future research in this area should adhere to existing reporting standards, namely, what concerns the detailing of EMA- and EMI-specific characteristics. Reporting guidelines are essential in facilitating the evaluation of study validity and allowing for comparisons across interventions. Consistency and detail in reporting intervention characteristics enable replication efforts and allow for meta-analyses and meta-regression to explore the features associated with the highest user engagement and intervention efficacy. Advancements in the field of EMAs and EMIs and the higher scientific impact of published studies in this area are dependent on the consistent use of reporting guidelines.

    Conclusions

    This is the first systematic review of smartphone-delivered EMIs based on self-reported EMAs promoting health behaviors. The use of this approach in behavior change is an emerging area of research, with few studies evaluating efficacy and most interventions focusing on mental health management. EMAs were commonly used to capture subjective experiences, as well as behaviors, whereas sensors were rarely used. Future research should explore combining self-reported EMAs of subjective experiences with objective data passively collected via sensors to promote personalization. Studies should also explore the effects of different EMA data collection methods (eg, chatbots) on user burden, engagement, and efficacy. A reporting checklist was developed with the goal of facilitating interpretation and comparison of findings and enhancing transparency and replicability in future studies using EMAs and EMIs.

    Acknowledgments

    The authors thank Michelle Italiano, Ali Reza, Eddisson Munoz, and Jacqueline Maroon for their help with title, abstract, and full-text screening. The authors also thank Agustina Briatore for her input during the early discussion of the protocol.

    Authors' Contributions

    The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted. Conception and design of the work were done by LL, KPD, HLT, and ABK; database search was conducted by KPD and HLT; title, abstract, and full-text screening was done by KPD, LL, and HLT; outcome data extraction was done by KPD, ABK, and HLT; the first draft was produced by KPD, LL, and KDC; data interpretation and critical revision of drafts for important intellectual content were made by KPD, LL, CC, KDC, ABK, and HLT; and final approval of the version to be published was given by KPD, LL, CC, KDC, ABK, and HLT.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Search strings.

    DOCX File , 17 KB
    ‎
    Multimedia Appendix 2

    Inclusion and exclusion criteria.

    DOCX File , 16 KB
    ‎
    Multimedia Appendix 3

    List of articles excluded after full-text review for not meeting inclusion criteria regarding the population, intervention, outcome or study design.

    DOCX File , 22 KB
    ‎
    Multimedia Appendix 4

    Risk of bias of included randomized controlled trial.

    DOCX File , 16 KB
    ‎
    Multimedia Appendix 5

    Risk of bias of nonrandomized studies.

    DOCX File , 18 KB
    ‎
    Multimedia Appendix 6

    Ecological momentary assessment adherence, ecological momentary intervention adherence, and incentives used.

    DOCX File , 19 KB
    ‎
    Multimedia Appendix 7

    Behavior change techniques present in the interventions of included studies.

    DOCX File , 18 KB
    ‎
    Multimedia Appendix 8

    Behaviour change techniques used in each study and excerpts.

    DOCX File , 30 KB
    ‎
    Multimedia Appendix 9

    User perspectives and suggestions.

    DOCX File , 26 KB
    1. Romeo A, Edney S, Plotnikoff R, Curtis R, Ryan J, Sanders I, et al. Can smartphone apps increase physical activity? Systematic review and meta-analysis. J Med Internet Res 2019 Mar 19;21(3):e12053 [FREE Full text] [CrossRef] [Medline]
    2. Burke LE, Ma J, Azar KM, Bennett GG, Peterson ED, Zheng Y, American Heart Association Publications Committee of the Council on Epidemiology and Prevention‚ Behavior Change Committee of the Council on Cardiometabolic Health‚ Council on Cardiovascular and Stroke Nursing‚ Council on Functional Genomics and Translational Biology‚ Council on Quality of Care and Outcomes Research‚ and Stroke Council. Current science on consumer use of mobile health for cardiovascular disease prevention: a scientific statement from the American Heart Association. Circulation 2015 Sep 22;132(12):1157-1213 [FREE Full text] [CrossRef] [Medline]
    3. Neubeck L, Lowres N, Benjamin EJ, Freedman SB, Coorey G, Redfern J. The mobile revolution--using smartphone apps to prevent cardiovascular disease. Nat Rev Cardiol 2015 Jun;12(6):350-360. [CrossRef] [Medline]
    4. Kwasnicka D, Dombrowski SU, White M, Sniehotta F. Theoretical explanations for maintenance of behaviour change: a systematic review of behaviour theories. Health Psychol Rev 2016 Sep;10(3):277-296 [FREE Full text] [CrossRef] [Medline]
    5. Conner M, Norman P. Health behaviour: current issues and challenges. Psychol Health 2017 Aug;32(8):895-906. [CrossRef] [Medline]
    6. Müller-Riemenschneider F, Reinhold T, Nocon M, Willich SN. Long-term effectiveness of interventions promoting physical activity: a systematic review. Prev Med 2008 Oct;47(4):354-368. [CrossRef] [Medline]
    7. Heron K, Smyth J. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol 2010 Feb;15(Pt 1):1-39 [FREE Full text] [CrossRef] [Medline]
    8. Stone A, Shiffman S. Ecological momentary assessment (EMA) in behavorial medicine. Ann Behav Med 1994 Sep 01;16(3):199-204. [CrossRef]
    9. Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008;4:1-32. [CrossRef] [Medline]
    10. Beckjord E, Shiffman S. Background for real-time monitoring and intervention related to alcohol use. Alcohol Res 2014;36(1):9-18. [Medline]
    11. Schueller SM, Aguilera A, Mohr DC. Ecological momentary interventions for depression and anxiety. Depress Anxiety 2017 Jun;34(6):540-545. [CrossRef] [Medline]
    12. Global mobile consumer survey US edition. Deloitte. 2018.   URL: https:/​/www2.​deloitte.com/​tr/​en/​pages/​technology-media-and-telecommunications/​articles/​global-mobile-consumer-survey-us-edition.​html [accessed 2021-09-22]
    13. Global mobile consumer survey: UK cut - Plateauing at the peak: the state of the smartphone. Deloitte. 2019.   URL: https:/​/www2.​deloitte.com/​content/​dam/​Deloitte/​uk/​Documents/​technology-media-telecommunications/​deloitte-uk-plateauing-at-the-peak-the-state-of-the-smartphone.​pdf [accessed 2021-09-22]
    14. Smith KE, Juarascio A. From ecological momentary assessment (EMA) to ecological momentary intervention (EMI): past and future directions for ambulatory assessment and interventions in eating disorders. Curr Psychiatry Rep 2019 Jun 04;21(7):53. [CrossRef] [Medline]
    15. Schlicht W, Ebner-Priemer UW, Kanning M. Ecological momentary assessment and intervention in physical activity and well-being: affective reactions, social-cognitive factors, and behaviors as determinants of physical activity and exercise. Front Psychol 2013 Dec 06;4:916 [FREE Full text] [CrossRef] [Medline]
    16. Miller CK. Adaptive intervention designs to promote behavioral change in adults: what is the evidence? Curr Diab Rep 2019 Jan 25;19(2):7. [CrossRef] [Medline]
    17. Parmar A, Sharma P. Ecological momentary interventions delivered by smartphone apps: applications in substance use treatment in indian scenario. Indian J Psychol Med 2017;39(1):102-103 [FREE Full text] [CrossRef] [Medline]
    18. Schembre SM, Liao Y, O'Connor SG, Hingle MD, Shen S, Hamoy KG, et al. Mobile ecological momentary diet assessment methods for behavioral research: systematic review. JMIR Mhealth Uhealth 2018 Nov 20;6(11):e11170 [FREE Full text] [CrossRef] [Medline]
    19. Romanzini CL, Romanzini M, Batista MB, Barbosa CC, Shigaki GB, Dunton G, et al. Methodology used in ecological momentary assessment studies about sedentary behavior in children, adolescents, and adults: systematic review using the checklist for reporting ecological momentary assessment studies. J Med Internet Res 2019 May 15;21(5):e11967 [FREE Full text] [CrossRef] [Medline]
    20. Mason TB, Do B, Wang S, Dunton GF. Ecological momentary assessment of eating and dietary intake behaviors in children and adolescents: a systematic review of the literature. Appetite 2020 Jan 01;144:104465 [FREE Full text] [CrossRef] [Medline]
    21. Degroote L, DeSmet A, De Bourdeaudhuij I, Van Dyck D, Crombez G. Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review. Int J Behav Nutr Phys Act 2020 Mar 10;17(1):35 [FREE Full text] [CrossRef] [Medline]
    22. Liao Y, Skelton K, Dunton G, Bruening M. A systematic review of methods and procedures used in ecological momentary assessments of diet and physical activity research in youth: an adapted STROBE checklist for reporting EMA studies (CREMAS). J Med Internet Res 2016 Jun 21;18(6):e151. [CrossRef] [Medline]
    23. Versluis A, Verkuil B, Spinhoven P, van der Ploeg MM, Brosschot JF. Changing mental health and positive psychological well-being using ecological momentary interventions: a systematic review and meta-analysis. J Med Internet Res 2016 Jun 27;18(6):e152 [FREE Full text] [CrossRef] [Medline]
    24. Bell IH, Lim MH, Rossell SL, Thomas N. Ecological momentary assessment and intervention in the treatment of psychotic disorders: a systematic review. Psychiatr Serv 2017 Nov 01;68(11):1172-1181. [CrossRef] [Medline]
    25. Loo Gee B, Griffiths K, Gulliver A. Effectiveness of mobile technologies delivering ecological momentary interventions for stress and anxiety: a systematic review. J Am Med Inform Assoc 2016 Jan;23(1):221-229. [CrossRef] [Medline]
    26. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med 2013 Aug;46(1):81-95. [CrossRef] [Medline]
    27. Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M, et al, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 6. New Jersey, United States: Wiley-Blackwell; 2019.
    28. Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. Br Med J 2016 Oct 12;355:i4919 [FREE Full text] [CrossRef] [Medline]
    29. Burns MN, Begale M, Duffecy J, Gergle D, Karr CJ, Giangrande E, et al. Harnessing context sensing to develop a mobile intervention for depression. J Med Internet Res 2011 Aug 12;13(3):e55 [FREE Full text] [CrossRef] [Medline]
    30. Bush NE, Ouellette G, Kinn J. Utility of the T2 mood tracker mobile application among army warrior transition unit service members. Mil Med 2014 Dec;179(12):1453-1457. [CrossRef] [Medline]
    31. Wenze SJ, Armey MF, Weinstock LM, Gaudiano BA, Miller IW. An open trial of a smartphone-assisted, adjunctive intervention to improve treatment adherence in bipolar disorder. J Psychiatr Pract 2016 Nov;22(6):492-504 [FREE Full text] [CrossRef] [Medline]
    32. Shrier LA, Spalding A. "Just take a moment and breathe and think": young women with depression talk about the development of an ecological momentary intervention to reduce their sexual risk. J Pediatr Adolesc Gynecol 2017 Feb;30(1):116-122. [CrossRef] [Medline]
    33. Bakker D, Kazantzis N, Rickwood D, Rickard N. Development and pilot evaluation of smartphone-delivered cognitive behavior therapy strategies for mood- and anxiety-related problems: moodmission. Cogn Behav Pract 2018 Nov 23;25(4):496-514 [FREE Full text] [CrossRef]
    34. Kreyenbuhl J, Record EJ, Himelhoch S, Charlotte M, Palmer-Bacon J, Dixon LB, et al. Development and feasibility testing of a smartphone intervention to improve adherence to antipsychotic medications. Clin Schizophr Relat Psychoses 2019;12(4):152-167 [FREE Full text] [CrossRef] [Medline]
    35. Vaessen T, Steinhart H, Batink T, Klippel A, Van Nierop M, Reininghaus U, et al. ACT in daily life in early psychosis: an ecological momentary intervention approach. Psychosis 2019 Mar 19;11(2):93-104. [CrossRef]
    36. Hanssen E, Balvert S, Oorschot M, Borkelmans K, van Os J, Delespaul P, et al. An ecological momentary intervention incorporating personalised feedback to improve symptoms and social functioning in schizophrenia spectrum disorders. Psychiatry Res 2020 Feb;284:112695 [FREE Full text] [CrossRef] [Medline]
    37. Businelle MS, Ma P, Kendzor DE, Frank SG, Vidrine DJ, Wetter DW. An ecological momentary intervention for smoking cessation: evaluation of feasibility and effectiveness. J Med Internet Res 2016 Dec 12;18(12):e321 [FREE Full text] [CrossRef] [Medline]
    38. Hébert ET, Stevens EM, Frank SG, Kendzor DE, Wetter DW, Zvolensky MJ, et al. An ecological momentary intervention for smoking cessation: the associations of just-in-time, tailored messages with lapse risk factors. Addict Behav 2018 Mar;78:30-35 [FREE Full text] [CrossRef] [Medline]
    39. Hébert ET, Ra CK, Alexander AC, Helt A, Moisiuc R, Kendzor DE, et al. A mobile just-in-time adaptive intervention for smoking cessation: pilot randomized controlled trial. J Med Internet Res 2020 Mar 09;22(3):e16907 [FREE Full text] [CrossRef] [Medline]
    40. Dulin PL, Gonzalez VM, Campbell K. Results of a pilot test of a self-administered smartphone-based treatment system for alcohol use disorders: usability and early outcomes. Subst Abus 2014;35(2):168-175. [CrossRef] [Medline]
    41. Leonard NR, Silverman M, Sherpa DP, Naegle MA, Kim H, Coffman DL, et al. Mobile health technology using a wearable sensorband for female college students with problem drinking: an acceptability and feasibility study. JMIR Mhealth Uhealth 2017 Jul 07;5(7):e90 [FREE Full text] [CrossRef] [Medline]
    42. Shrier LA, Burke PJ, Kells M, Scherer EA, Sarda V, Jonestrask C, et al. Pilot randomized trial of MOMENT, a motivational counseling-plus-ecological momentary intervention to reduce marijuana use in youth. Mhealth 2018 Jul 30;4:29 [FREE Full text] [CrossRef] [Medline]
    43. Mundi MS, Lorentz PA, Grothe K, Kellogg TA, Collazo-Clavell ML. Feasibility of smartphone-based education modules and ecological momentary assessment/intervention in pre-bariatric surgery patients. Obes Surg 2015 Oct;25(10):1875-1881. [CrossRef] [Medline]
    44. Goldstein S. Comparing effectiveness and user behaviors of two versions of a just-in-time adaptive weight loss smartphone app. Drexel University 2018:A. [CrossRef]
    45. Goldstein SP, Thomas JG, Foster GD, Turner-McGrievy G, Butryn ML, Herbert JD, et al. Refining an algorithm-powered just-in-time adaptive weight control intervention: a randomized controlled trial evaluating model performance and behavioral outcomes. Health Informatics J 2020 Dec;26(4):2315-2331 [FREE Full text] [CrossRef] [Medline]
    46. Pentikäinen S, Tanner H, Karhunen L, Kolehmainen M, Poutanen K, Pennanen K. Mobile phone app for self-monitoring of eating rhythm: field experiment. JMIR Mhealth Uhealth 2019 Mar 27;7(3):e11490 [FREE Full text] [CrossRef] [Medline]
    47. Allicock M, Kendzor D, Sedory A, Gabriel KP, Swartz MD, Thomas P, et al. A pilot and feasibility mobile health intervention to support healthy behaviors in african american breast cancer survivors. J Racial Ethn Health Disparities 2021 Feb;8(1):157-165. [CrossRef] [Medline]
    48. Burns MN, Begale M, Duffecy J, Gergle D, Karr CJ, Giangrande E, et al. Harnessing context sensing to develop a mobile intervention for depression. J Med Internet Res 2011 Aug 12;13(3):e55 [FREE Full text] [CrossRef] [Medline]
    49. Leonard NR, Silverman M, Sherpa DP, Naegle MA, Kim H, Coffman DL, et al. Mobile health technology using a wearable sensorband for female college students with problem drinking: an acceptability and feasibility study. JMIR Mhealth Uhealth 2017 Jul 07;5(7):e90 [FREE Full text] [CrossRef] [Medline]
    50. Colombo D, Fernández-Álvarez J, Patané A, Semonella M, Kwiatkowska M, García-Palacios A, et al. Current state and future directions of technology-based ecological momentary assessment and intervention for major depressive disorder: a systematic review. J Clin Med 2019 Apr 05;8(4):465 [FREE Full text] [CrossRef] [Medline]
    51. Beckjord E, Shiffman S. Background for real-time monitoring and intervention related to alcohol use. Alcohol Res 2014;36(1):9-18. [Medline]
    52. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. Gesundheitswesen 2016 Mar;78(3):175-188. [CrossRef] [Medline]
    53. Des Jarlais DC, Lyles C, Crepaz N, TREND Group. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. Am J Public Health 2004 Mar;94(3):361-366. [CrossRef] [Medline]
    54. Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of web-based and mobile health interventions. J Med Internet Res 2011 Dec 31;13(4):e126 [FREE Full text] [CrossRef] [Medline]
    55. Agarwal S, LeFevre AE, Lee J, L'Engle K, Mehl G, Sinha C, WHO mHealth Technical Evidence Review Group. Guidelines for reporting of health interventions using mobile phones: mobile health (mHealth) evidence reporting and assessment (mERA) checklist. Br Med J 2016 Mar 17;352:i1174. [CrossRef] [Medline]
    56. Ory M, Smith ML, Mier N, Wernicke MM. The science of sustaining health behavior change: the health maintenance consortium. Am J Health Behav 2010;34(6):647-659 [FREE Full text] [CrossRef] [Medline]
    57. Tong HL. Can personalised mobile technology increase physical activity and healthy diet? A systematic review and meta-analysis. International Society of Behavioral Nutrition and Physical Activity, Auckland, NZ. 2020.   URL: https:/​/venuewest.​eventsair.com/​QuickEventWebsitePortal/​isbnpa2020annualmeeting/​eventinfo/​Agenda/​AgendaItemDetail?id=2be6426d-3c89-4c46-b959-9e8e0692aa88 [accessed 2021-10-01]
    58. Lustria ML, Noar SM, Cortese J, Van Stee SK, Glueckauf RL, Lee J. A meta-analysis of web-delivered tailored health behavior change interventions. J Health Commun 2013;18(9):1039-1069. [CrossRef] [Medline]
    59. Lustria ML, Cortese J, Gerend MA, Schmitt K, Kung YM, McLaughlin C. A model of tailoring effects: a randomized controlled trial examining the mechanisms of tailoring in a web-based STD screening intervention. Health Psychol 2016 Nov;35(11):1214-1224. [CrossRef] [Medline]
    60. Krebs P, Prochaska JO, Rossi JS. A meta-analysis of computer-tailored interventions for health behavior change. Prev Med 2010;51(3-4):214-221 [FREE Full text] [CrossRef] [Medline]
    61. Nahum-Shani I, Smith S, Spring B, Collins LM, Witkiewitz K, Tewari A, et al. Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Ann Behav Med 2018 May 18;52(6):446-462 [FREE Full text] [CrossRef] [Medline]
    62. Boehner K, DePaula R, Dourish P, Sengers P. Affect: from information to interaction. In: Proceedings of the 4th decennial conference on Critical computing: between sense and sensibility. 2005 Presented at: Aarhus05: 4th Aarhus Conference 2005 - Critical Computing; between Sense and Sensibility; August 20 - 24, 2005; Aarhus Denmark p. 59-68. [CrossRef]
    63. Insel TR. Digital phenotyping: technology for a new science of behavior. J Am Med Assoc 2017 Oct 03;318(13):1215-1216. [CrossRef] [Medline]
    64. Bertz JW, Epstein DH, Preston KL. Combining ecological momentary assessment with objective, ambulatory measures of behavior and physiology in substance-use research. Addict Behav 2018 Aug;83:5-17 [FREE Full text] [CrossRef] [Medline]
    65. Wongvibulsin S, Martin SS, Saria S, Zeger SL, Murphy SA. An individualized, data-driven digital approach for precision behavior change. Am J Lifestyle Med 2019 Apr 25;14(3):289-293 [FREE Full text] [CrossRef] [Medline]
    66. Krebs P, Duncan DT. Health app use among US mobile phone owners: a national survey. JMIR Mhealth Uhealth 2015 Nov 04;3(4):e101 [FREE Full text] [CrossRef] [Medline]
    67. Ruan S, Wobbrock JO, Liou K, Ng A, Landay JA. Comparing speech and keyboard text entry for short messages in two languages on touchscreen phones. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2017 Jan 08 Presented at: ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies; December 2017; - p. 1-23. [CrossRef]
    68. Sarkar U, Gourley GI, Lyles CR, Tieu L, Clarity C, Newmark L, et al. Usability of commercially available mobile applications for diverse patients. J Gen Intern Med 2016 Dec;31(12):1417-1426 [FREE Full text] [CrossRef] [Medline]
    69. Druce KL, Dixon WG, McBeth J. Maximizing engagement in mobile health studies: lessons learned and future directions. Rheum Dis Clin North Am 2019 May;45(2):159-172 [FREE Full text] [CrossRef] [Medline]

    ‎
    BCT: behavior change technique
    CREMAIs: checklist for reporting ecological momentary assessment and ecological momentary intervention-specific aspects
    CREMAS: checklist for reporting ecological momentary assessment studies
    EMA: ecological momentary assessment
    EMI: ecological momentary intervention
    PICO: Participants, Intervention, Comparator, Outcomes
    PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
    PROSPERO: International Prospective Register of Systematic Reviews
    RCT: randomized controlled trial

    Edited by G Eysenbach; submitted 26.07.20; peer-reviewed by S Dick, Y Huang, C Simons; comments to author 11.09.20; revised version received 06.11.20; accepted 26.07.21; published 06.11.21

    Copyright

    ©Kim Phuong Dao, Katrien De Cocker, Huong Ly Tong, A Baki Kocaballi, Clara Chow, Liliana Laranjo. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 21.11.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.