This paper is in the following e-collection/theme issue:

mHealth for Wellness, Behavior Change and Prevention (2922) Mobile Health (mhealth) (2982) Usability of Apps and User Perceptions of mHealth (993) Alcohol Abuse, Alcoholism Prevention and Recovery (303)

Published on in Vol 9, No 4 (2021): April

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/25927, first published .
Usability and Acceptability of a Mobile App for the Self-Management of Alcohol Misuse Among Veterans (Step Away): Pilot Cohort Study

Usability and Acceptability of a Mobile App for the Self-Management of Alcohol Misuse Among Veterans (Step Away): Pilot Cohort Study

Usability and Acceptability of a Mobile App for the Self-Management of Alcohol Misuse Among Veterans (Step Away): Pilot Cohort Study

Authors of this article:

Carol A Malte1, 2 Author Orcid Image ;   Patrick L Dulin3 Author Orcid Image ;   John S Baer1, 2, 4 Author Orcid Image ;   John C Fortney2, 5 Author Orcid Image ;   Anissa N Danner1, 2 Author Orcid Image ;   Aline M K Lott1, 2 Author Orcid Image ;   Eric J Hawkins1, 2, 5 Author Orcid Image
Article Authors Cited by (15) Tweetations (1) Metrics

    Original Paper

    1Center of Excellence in Substance Addiction Treatment and Education (CESATE), Veterans Affairs Puget Sound Health Care System, Seattle, WA, United States

    2Health Services Research & Development Seattle Center of Innovation for Veteran-Centered and Value-Driven Care, Veterans Affairs Puget Sound Health Care System, Seattle, WA, United States

    3Department of Psychology, University of Alaska Anchorage, Anchorage, AK, United States

    4Department of Psychology, University of Washington, Seattle, WA, United States

    5Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, United States

    Corresponding Author:

    Carol A Malte, MSW

    Center of Excellence in Substance Addiction Treatment and Education (CESATE)

    Veterans Affairs Puget Sound Health Care System

    1660 S Columbian Way, MS 116 ATC

    Seattle, WA, 98108

    United States

    Phone: 1 206 277 3780

    Email: carol.malte@va.gov


    Background: Alcohol misuse is common among Operation Enduring Freedom and Operation Iraqi Freedom veterans, yet barriers limit treatment participation. Mobile apps hold promise as means to deliver alcohol interventions to veterans who prefer to remain anonymous, have little time for conventional treatments, or live too far away to attend treatment in person.

    Objective: This pilot study evaluated the usability and acceptability of Step Away, a mobile app designed to reduce alcohol-related risks, and explored pre-post changes on alcohol use, psychological distress, and quality of life.

    Methods: This single-arm pilot study recruited Operation Enduring Freedom and Operation Iraqi Freedom veterans aged 18 to 55 years who exceeded National Institute on Alcohol Abuse and Alcoholism drinking guidelines and owned an iPhone. Enrolled veterans (N=55) completed baseline and 1-, 3-, and 6-month assessments. The System Usability Scale (scaled 1-100, ≥70 indicating acceptable usability) assessed the effectiveness, efficiency, and satisfaction dimensions of usability, while a single item (scaled 1-9) measured the attractiveness of 10 screenshots. Learnability was assessed by app use during week 1. App engagement (proportion of participants using Step Away, episodes of use, and minutes per episode per week) over 6 months measured acceptability. Secondary outcomes included pre-post change on heavy drinking days (men: ≥5 drinks per day; women: ≥4 drinks per day) and Short Inventory of Problems–Revised, Kessler-10, and brief World Health Organization Quality of Life Questionnaire scores.

    Results: Among the 55 veterans enrolled in the study, the mean age was 37.4 (SD 7.6), 16% (9/55) were women, 82% (45/55) were White, and 82% (45/55) had an alcohol use disorder. Step Away was used by 96% (53/55) of participants in week 1, 55% (30/55) in week 4, and 36% (20/55) in week 24. Step Away use averaged 55.1 minutes (SD 57.6) in week 1 and <15 minutes per week in weeks 2 through 24. Mean System Usability Scale scores were 69.3 (SD 19.7) and 71.9 (SD 15.8) at 1 and 3 months, respectively. Median attractiveness scores ranged from 5 to 8, with lower ratings for text-laden screens. Heavy drinking days decreased from 29.4% (95% CI 23.4%-35.4%) at baseline to 16.2% (95% CI 9.9%-22.4%) at 6 months (P<.001). Likewise, over 6 months, Short Inventory of Problems–Revised scores decreased from 6.3 (95% CI 5.1-7.5) to 3.6 (95% CI 2.4-4.9) (P<.001) and Kessler-10 scores decreased from 18.8 (95% CI 17.4-20.1) to 17.3 (95% CI 15.8-18.7) (P=.046). Changes were not detected on quality of life scores.

    Conclusions: Operation Enduring Freedom and Operation Iraqi Freedom veterans found the usability of Step Away to be acceptable and engaged in the app over the 6-month study. Reductions were seen in heavy drinking days, alcohol-related problems, and Kessler-10 scores. A larger randomized trial is warranted to confirm our findings.

    JMIR Mhealth Uhealth 2021;9(4):e25927

    doi:10.2196/25927

    Keywords

    mobile apps; alcohol misuse; smartphone; veterans; access 


    Alcohol misuse, which is associated with a number of adverse social, economic, and health-related consequences [1,2], is one of the most common conditions among Operation Enduring Freedom (OEF) and Operation Iraqi Freedom (OIF) service members and veterans, with estimates ranging from 22% to 40% [3-5]. Previous reports suggest the rate of alcohol misuse among OEF and OIF veterans is 2 times the rate observed for similarly aged veterans who did not serve in OEF and OIF and much higher among men (22%) than women (5%) [5]. Despite high rates of use, many OEF and OIF veterans with alcohol-related problems do not receive alcohol-related care or only receive care after significant delay [6-8]. The large gap between those who need and those who receive treatment is thought to be due in part to barriers to using available services [9].

    OEF and OIF veterans have reported several impediments to seeking mental health care, including stigma-related barriers, such as beliefs that they will be perceived as weak for seeking help, and logistical barriers, such as insufficient time, burdensome paperwork, and long distances to the nearest treatment facility [3,10,11]. Mobile apps, delivered on smartphones, have the potential to address the majority of these barriers, as they can deliver alcohol interventions to those who are interested in help but prefer to remain anonymous, have little time for traditional therapy, or must travel too far to attend treatment in person [12]. Unlike traditional alcohol interventions that rely on patient-to-provider encounters, mobile apps deliver timely interventions to individuals in their natural settings at crucial moments when the need for intervention is high and repeatedly over time [13]. Further, smartphone ownership in the United States is common, particularly among persons aged 18 to 49 years [14], and there is considerable interest in tools that allow for self-management of alcohol use [15].

    While mobile apps to manage alcohol use have proliferated in recent years, they vary greatly in quality, and many are narrow in scope (ie, limited to tracking of alcohol consumed, estimating blood alcohol content [15]) or lack key evidence-based intervention components associated with behavior change (ie, normative feedback, use of social support [16]). While data on the effect of apps, particularly those aimed at young adults, on drinking outcomes are growing [17,18], limited information exists on their acceptability and usability, particularly among OEF and OIF veterans [19,20]. The importance of collecting this type of information is highlighted by a recent qualitative study of rural veterans [21], which found that these veterans held more negative views of apps relative to urban veterans and expressed that apps were hard to navigate, hard to access due to connectivity issues, and opposed to their values (impersonal, lacking connection to community). App acceptability and usability are closely related to engagement, a key issue in app development, with several studies finding that app participation drops off steeply after 1 week, with only the most at-risk and motivated individuals remaining engaged (eg, Drinkaware [22]). The relationship between app engagement and drinking outcomes is not well established. A small study of an app (InDEx) developed for British ex-service members showed promise in engaging participants over the 4-week study course, with modest reductions in drinking [23]. A second study found that age, gender, and education rather than baseline drinking levels were associated with app (Drink Less) engagement in a nonveteran sample; however, engagement with the app was not associated with drinking outcomes [24].

    Two of the most studied and comprehensive smartphone-based interventions are the Location-Based Monitoring and Intervention System for Alcohol Use Disorders (LBMI-A) and the Addiction Comprehensive Health Enhancement Support System (A-CHESS). Designed to provide stand-alone treatment, LBMI-A has been evaluated among a small community sample who met Diagnostic and Statistical Manual of Mental Disorders, Fifth Revision (DSM-5) criteria for an alcohol use disorder (AUD). Results suggest a significant reduction in the percentage of heavy drinking days (HDD) from 56% at baseline to 25% at 6 weeks [25,26]. A substantial barrier to engagement with LBMI-A was the reported difficulty in simultaneously using a personal and LBMI-A–enabled phone in the pilot study (prior to mobile apps’ emergence). In contrast to LBMI-A, A-CHESS was designed to prevent relapse to heavy drinking among patients who completed residential treatment for an AUD [27]. A-CHESS patient-generated data are accessed by treatment providers to monitor patent progress; as such, it is not anonymous or independent of traditional treatment.

    Step Away, the next iteration of LBMI-A, is an iOS-based mobile app designed to help people self-manage drinking and alcohol-related problems and thus is an alternative for those who do not want or have access to traditional treatment [12]. A recent systematic review of eHealth interventions for alcohol identified several recommendations [20], such as addressing the spectrum of alcohol use (at-risk drinking to AUD), including cognitive behavioral coping strategies and access to timely interventions for skill development and navigation of high-risk situations, and using mobile technologies such as push notifications to promote engagement. Step Away complies with many of these recommendations by addressing a range of severity of alcohol-related problems; providing education, advice, and goal setting related to alcohol use; soliciting participant data on drinking, craving, and mood through push notifications; and compiling these data in regular feedback reports.

    This mixed methods pilot study was designed to evaluate the usability and acceptability of Step Away among OEF and OIF veterans with alcohol misuse who are not involved in traditional alcohol treatment. The primary aim of this project was to assess the usability of Step Away among OEF and OIF veterans. According to the International Organization for Standardization Guidance on Usability [28], key dimensions of usability are efficiency, effectiveness, and satisfaction. Further, a recent review of mobile health (mHealth) apps [29] recommends the assessment of attractiveness and learnability, important usability dimensions that are infrequently evaluated in the literature. A second aim was to assess the acceptability of the app, which was measured by engagement. Exploratory aims were to evaluate change in alcohol use, psychological distress, and health-related quality of life outcomes associated with the use of Step Away over the 6-month study course and to examine associations between app engagement, baseline characteristics, and drinking outcomes.


    This single-arm prospective cohort study involving a national sample of OEF and OIF veterans (n=55) occurred between September 2017 and December 2018. The study was approved by the Veteran Affairs (VA) Puget Sound Institutional Review Board.

    Study Participants

    OEF and OIF veterans were eligible to participate if they (1) were aged 18 to 55 years, (2) screened positive for alcohol misuse (≥5 standard drinks on any day or ≥15 standard drinks per week for men and ≥4 standard drinks on any day or ≥8 standard drinks per week for women) in the prior 4 weeks, and (3) owned an iPhone. Exclusion criteria included (1) participation in substance use treatment, including Alcoholics Anonymous, in the past 30 days; (2) pregnancy; and (3) satisfaction of DSM-5 criteria for a drug use disorder (nicotine use disorders and drug disorders in remission allowed) or psychotic disorder.

    Procedures

    The planned strategy of recruiting participants using social media advertisements proved unsuccessful, with advertisements yielding no contacts from interested participants after 3 months. Subsequently, investigators used the VA Corporate Data Warehouse, a data repository of patient-level data from the VA electronic medical record, to identify OEF and OIF veterans with Alcohol Use Disorders Identification Test–Consumption [30] scores of 5 or greater (indicating alcohol misuse) who used VA care in the past 6 months (n=13,266) for recruitment by letters and follow-up contacts. Potentially eligible veterans were randomly selected and, in blocks of 100, mailed recruitment letters introducing the study as an evaluation of an app designed to improve the health of individuals who drink alcohol. A total of 10% of letters were sent to women to ensure adequate sampling. Research staff then attempted to contact veterans weekly for up to 3 weeks via telephone and conducted brief telephone screens to assess eligibility with those who were reached and interested in participation. Eligible and interested veterans were mailed a consent form and completed informed consent procedures by telephone. Following consent, veterans completed a baseline research assessment and then received instructions on how to download Step Away to their smartphone. Follow-up assessments occurred at 1, 3, and 6 months. A subset of veterans completed qualitative interviews during the initial 3 months (data to be reported separately). All assessments were completed by telephone, with secure messaging (SMS) used to schedule and remind participants about appointments. Participants were compensated US $40 for completing baseline and 3- and 6-month follow-up assessments and US $5 for completing a usability questionnaire at the 1- and 3-month follow-up.

    Intervention: Step Away Mobile App Content and Features

    A version of the Step Away app similar to the one used by this study has been described in detail elsewhere [31]. Briefly, Step Away is a comprehensive intervention for alcohol misuse based on the evidence-based principles of motivational enhancement therapy (MET) [32], relapse prevention [33], and community reinforcement [34,35]. Consistent with a harm reduction approach that supports motivation to change in a nonjudgmental, facilitative manner, Step Away supports both reductions in and abstinence from drinking. Step Away incorporates relapse prevention strategies to identify and cope with situations that increase the risk of relapsing or drinking inconsistently with goals as well as community reinforcement strategies that encourage involvement of supportive others in setting drinking goals and participating in nondrinking activities.

    In total, Step Away consists of 10 modules: drinking profile, goal setting, rewards, cravings, strategies, supportive others, reminders, high-risk times, moods, and new activities. Taken together, these modules encompass assessment, normative feedback, goal setting, behavioral strategies tailored to the goals of moderation or abstinence, involvement of supportive others, and replacement activities. Users can personalize the app through the use of reminders about reasons for changes, high-risk times, and scheduled activities. It is anticipated that app users will spend more time in the app during the initial session to review content and set up goals and personal preferences.

    Using push notifications, Step Away prompts users daily to complete a brief self-monitoring questionnaire on current mood, drinking behaviors, and alcohol cravings and triggers for alcohol use during the prior 24 hours. Step Away provides weekly feedback, highlighting progress toward goals, ongoing cravings and triggers, and moods experienced throughout the prior week. Feedback includes strategies for managing common alcohol cravings and triggers and a feature for users to enter future high-risk events that might negatively influence drinking goals. Step Away provides real-time intervention options, including strategies for managing cravings or negative emotions, requests for help (eg, to manage anxiety or alcohol cravings), and working through a problem via a problem-solving algorithm [36]. Veterans are provided with an option to contact the Veterans Crisis Line if in crisis and VA or non-VA addiction programs if more traditional treatment services are desired.

    Measures and Outcomes

    Study data included both patient self-report and data generated automatically through the use of Step Away. Assessments are detailed below. Step Away use data were automatically generated and stored on secure Step Away servers. Data included date and time of session start and end, specific screen views, time spent per screen view, use of Step Away features, and completion of daily brief assessments.

    Eligibility and Patient Characteristics

    The brief telephone screen assessed age, iPhone ownership, OEF or OIF service, pregnancy, current participation in VA or non-VA addiction treatment, recent alcohol and drug use, and potential psychotic symptoms. Positive screens for drug use or psychotic symptoms were followed up with the appropriate modules of the Mini International Neuropsychiatric Interview (MINI) modified for the DSM-5 [37]. At baseline, demographics and the MINI depressive, bipolar, anxiety, alcohol use, and posttraumatic stress disorders modules were completed.

    Primary Outcomes

    The main study outcome was app usability, comprised of effectiveness, efficiency, satisfaction, learnability, and attractiveness. Effectiveness measures the ability of users to perform a given task, efficiency describes the resources (eg, time) expended to perform the task after it has been learned, and satisfaction represents users’ assessments of how well the device met their needs. These 3 dimensions of usability were assessed at the 1- and 3-month follow-up using the System Usability Scale (SUS; scaled 1 to 100), a 10-item, well-validated questionnaire [38] with scores of ≥70 considered acceptable [39]. Learnability represents users’ abilities to accomplish a task on their first attempt, which is an important determinant of engagement. The learnability of Step Away was measured by the total time spent in the app on the first episode of use and the first week of use. Further, an analysis of the SUS validated a 2-factor structure capturing learnability and usability [40]. Similar to the full SUS, both components are scaled from 0 to 100. Additionally, the attractiveness of Step Away was assessed at 1 month using a validated 9-point Likert scale item (scaled 1=low to 9=high) designed to assess the visual appeal of web pages [41]. Median scores on the 1-item questionnaire measured attractiveness of 10 distinct Step Away screenshots.

    Acceptability was measured through app engagement [42] and included the following measures derived from Step Away use data: proportion of participants who used Step Away, number of episodes of use, and episode length (time between opening and closing of app) overall and by week during the 6 months after baseline assessment. We also calculated the number of times each module was viewed and the number of times daily questionnaires were completed by each participant. Means (standard deviations) and medians (interquartile ranges) were used to calculate these measures.

    Secondary Outcomes

    Secondary outcomes included change in alcohol use, psychological distress, and health-related quality of life from baseline to month 6. Assessments collected at baseline and 3- and 6-month follow-up included (1) the Timeline Followback (TLFB) [43] to assess alcohol use in the prior 30 days and number of standard drinks (14 grams of alcohol) per day; (2) the Short Inventory of Problems–Revised (SIP-R) [44] to assess drinking-related consequences; (3) the Kessler-10, a reliable and valid 10-item psychological distress measure (with scores ranging from 10 to 50), to asses distress over the prior month [45,46]; and (4) the abbreviated World Health Organization Quality of Life (WHOQOL-BREF), a 26-item measure derived from the WHOQOL-100 quality of life measure, to assess 4 domains related to quality of life, that is, physical health, psychological health, social relationships, and environment [47].

    Alcohol use outcomes were defined as changes in the percentage of HDD (≥5 drinks per day for men; ≥4 drinks per day for women) in the prior 30 days and the proportion of patients drinking below the recommended limits, defined as <15 drinks per week and <5 drinks per day for men and <8 drinks per week and <4 drinks per day for women, as determined by TLFB data. Change in heavy drinking days was selected because it is a marker of alcohol misuse, associated with long-term health outcomes, and frequently used as an outcome in the alcohol treatment literature [48,49]. Alcohol consequences were measured by change in the SIP-R total score. Changes in the Kessler-10 total score and 4 domain scores of the WHOQOL-BREF measured psychological distress and health-related quality of life outcomes, respectively.

    Analyses

    Usability, learnability, attractiveness, and engagement outcomes as well as participant characteristics are presented using descriptive statistics, including means with standard deviations and medians with interquartile ranges. Associations between app engagement (total weeks and minutes of use) and demographics, baseline alcohol use, drug use, and mental health diagnoses were examined using unadjusted linear regression. Responses at baseline and 3 and 6 months represent repeated measures of clinical outcomes over time. Longitudinal analyses using multilevel mixed models were used to estimate the percent change in HDD between baseline and month 6, with a fixed effect for time and a unique patient identifier included as a random effect. Gender, age, and binary measures of AUD, any drug use, and mental health disorders as per the MINI (major depression, generalized anxiety, and posttraumatic stress disorder) at baseline were included as covariates to determine their associations with changes in the percentage of HDD. A similar approach was used to estimate changes in alcohol consequences (SIP-R), distress (Kessler-10), and quality of life (WHOQOL-BREF) outcomes. The proportion of participants drinking below guideline limits at follow-up was examined using a Pearson chi-square test. Associations between change over time in alcohol-related outcomes (HDD, SIP-R) and app engagement were explored using multilevel mixed models that included time, a measure of app engagement (total weeks or minutes of use), and the interaction between time and app engagement, with a patient identifier included as a random effect. All analyses were conducted with Stata MP (version 15; StataCorp).


    Participants

    As shown in Figure 1, over 140 days, 1000 potentially eligible veterans were invited to participate by mail. Of this group, 621 (62.1%) veterans did not respond or were unable to be contacted by telephone (418/1000, 41.8%) or declined to participate (157/1000, 15.7%), and 324 (32.4%) screened ineligible (eg, did not own an iPhone). Of the remaining 101 veterans, 55 enrolled in the study. Completion rates of follow-up assessments were over 85% at all time points. Participants’ mean age was 37.4 (SD 7.6), 16% (9/55) were women, and 82% (45/55) were White (Table 1). A total of 82% (45/55) of participants met DSM-5 criteria for an alcohol use disorder and 33% (18/55) had received treatment for a substance use disorder in the past.

    ‎
    Figure 1. CONSORT diagram.
    View this figure
    Table 1. Participant characteristics (N=55).
    CharacteristicValue
    Age, mean (SD)37.4 (7.6)
    Female, n (%)9 (16.4)
    Race, n (%)

    		White45 (81.8)

    		Black4 (7.3)

    		Asian or Pacific Islander3 (5.5)

    		American Indian3 (5.5)

    		Hispanica10 (18.5)
    Education (years), mean (SD)

    		1211 (20.0)

    		13-1518 (32.7)

    		16+26 (47.3)
    Marital status, n (%)

    		Married or living with partner36 (65.4)

    		Divorced or separated8 (14.6)

    		Never married11 (20.0)
    Currently employed, n (%)43 (78.2)
    Income (US $), n (%)

    		0 to 10,0002 (3.6)

    		10,000 to 50,00025 (45.5)

    		50,000 to 100,00021 (38.2)

    		>100,0007 (12.7)
    Prior substance use disorder treatment, n (%)18 (32.7)
    Any drug use, n (%)2 (3.6)
    Mental health conditions, n (%)

    		Current major depressive disorder4 (7.3)

    		Generalized anxiety disorder3 (5.5)

    		Posttraumatic stress disorder5 (9.1)

    		Alcohol use disorder45 (81.8)

    aN=54.

    Usability of Step Away

    Participants’ mean SUS scores, which assess effectiveness, efficiency, and satisfaction, were 69.3 (SD 19.7) and 71.9 (SD 15.8) at the 1- and 3-month follow-up, respectively, with 62% (31/50) and 77% (36/47) of participants scoring ≥70 points at the 2 time points. Learnability was assessed by time taken to complete modules the first time. Participants spent an average 19.2 (SD 25.1) minutes in Step Away for the first episode of use compared to an average of 11.9 (SD 10.6) minutes per episode during all of week 1 and less than a minute per episode at week 24. Mean scores on the learnability component of the SUS were 80.0 (SD 22.9) at 1 month and 79.0 (SD 17.3) at 3 months. Of the 10 screenshots that participants evaluated, attractiveness scores ranged from a median of 5 to 8 (out of 9), with lower ratings given to text-laden screens.

    Acceptability of Step Away

    As seen in Figure 2, nearly all participants accessed Step Away in week 1, with the percentage dropping to 62% (34/55) in week 2 and 36% (20/55) by week 24. All 55 participants accessed the app at least once over the 6-month course of the study. A total of 24 of the 55 (44%) participants accessed the app every week during weeks 1 through 4, and 12 (22%) accessed the app every week during weeks 1 through 12. Time spent in the app dropped off considerably after week 1, with participants spending close to 60 minutes (mean 55.1, SD 57.6) in Step Away in week 1 and less than 15 minutes in weeks 2 to 24. However, episodes of Step Away use per week remained at 3 to 4 over the course of the study among participants accessing the app at least once in the given week. The majority of app modules were accessed by ≥60% of participants, and consumption- and tracking-focused modules such as daily feedback were accessed most frequently (median times accessed: 12, IQR 2-52) and by the largest proportion of participants (>80%) (Table 2).

    ‎
    Figure 2. Step Away app engagement by week. App users are defined as study participants who used the app in a given week.
    View this figure
    Table 2. Participants’ use of Step Away by module from baseline to month 6.
    Feature and activityEver accessed, n (%)Number of times accessed


    		Mean (SD)Median (IQR)
    General overview



    		Overview and setup55 (100)2.3 (1.5)2 (1-3)
    Drinking profile module



    		Initial drinking profile53 (96.4)2.9 (2.0)2 (2-4)

    		Maximum drinks53 (96.4)1.6 (1.2)1 (1-2)

    		Peak BACa53 (96.4)1.4 (0.7)1 (1-2)

    		Dependency and SADQb49 (89.1)0.9 (0.4)1 (1-1)

    		Money and total cost47 (85.5)0.9 (0.4)1 (1-1)
    Goals module



    		Goals step43 (78.2)2.2 (2.2)2 (1-3)

    		Goals path (abstinence and moderation)42 (76.4)0.9 (0.7)1 (1-1)
    Rewards module



    		Rewards41 (74.5)1.3 (1.7)1 (0-2)
    Craving module



    		Craving35 (63.6)1.0 (1.0)1 (0-2)
    Supportive others module



    		Supportive person34 (61.8)1.4 (1.7)1 (0-2)
    Strategies module



    		Strategies33 (60.0)1.1 (1.3)1 (0-2)
    Reminders module



    		Reminder33 (60.0)0.8 (0.9)1 (0-1)
    Moods module



    		Mood34 (61.8)1.0 (1.3)1 (0-1)

    		Depression level33 (60.0)0.6 (0.6)1 (0-1)

    		Stress level33 (60.0)0.6 (0.6)1 (0-1)
    High-risk times module



    		High-risk accessed33 (60.0)0.9 (1.1)1 (0-1)
    New activities module



    		Activities step accessed33 (60.0)1.0 (1.1)1 (0-2)

    		Activities entered32 (58.2)0.8 (0.8)1 (0-1)
    Ongoing assessment and feedback



    		Daily feedback finished45 (81.8)36.9 (51.7)12 (2-52)

    		Weekly feedback finished35 (63.6)7.3 (9.1)3 (0-14)

    		Weekly feedback drink total34 (61.8)5.8 (7.8)2 (0-11)
    In-the-moment tools



    		Get help accessed46 (83.6)2.6 (2.5)2 (1-3)

    		Help type selected (anxious, craving, down, problem, other call)15 (27.3)0.4 (0.8)0 (0-1)

    aBAC: blood alcohol concentration.

    bSeverity of Alcohol Dependence Questionnaire.

    Associations with app engagement, as measured by total weeks and minutes of app use over 24 weeks, are shown in Table 3. Total weeks of use was positively associated with female gender, whereas total minutes of app use was positively associated with age, years of education, and income. Associations were not detected between engagement and baseline alcohol use severity, drug use, or mental health comorbidity.

    Table 3. Associations between participant characteristics and Step Away engagement.
    CharacteristicWeeks of useTotal minutes of use
     β (95% CI)P valueβ (95% CI)P value
    Age0.16 (–0.12 to 0.45).256.46 (1.44 to 11.47).01
    Female7.58 (2.42 to 12.74).00550.79 (–63.66 to 165.24).38
    Person of color1.00 (–3.72 to 5.73).6730.54 (–56.47 to 117.55).49
    Education




    		12 yearsRefaN/AbRefN/A

    		13-15 years3.94 (–1.23 to 9.11).1356.02 (–14.31 to 126.35).12

    		16+ years5.12 (–0.08 to 10.32).05109.89 (40.28 to 179.49).003
    Income >$50,000 (US)1.00 (–3.55 to 5.55).6688.20 (14.93 to 161.48).02
    Baseline characteristics




    		Count AUDc criteria–0.61 (–1.33 to 0.10).09–12.07 (–25.74 to 1.59).08

    		Percent heavy drinking days–0.01 (–0.08 to 0.06).76–0.26 (–1.41 to 0.89).65

    		Average drinks per day–0.35 (–1.18 to 0.48).41–3.39 (–16.08 to 9.30).59

    		SIP-Rd score–0.10 (–0.49 to 0.29).62–2.33 (–8.42 to 3.76).45

    		Drug use–2.01 (–13.09 to 9.07).72–71.88 (–152.04 to 8.28).08

    		Mental health condition–0.04 (–6.03 to 5.94).9957.50 (–66.80 to 181.81).36

    aRef: reference category.

    bN/A: not applicable.

    cAUD: alcohol use disorder.

    dSIP-R: Short Inventory of Problems–Revised.

    Alcohol Use, Psychological Distress, and Health-Related Quality of Life

    The percentage of participants drinking above recommended limits dropped from 100% (55/55) at baseline to 88% (42/48) at 3 months and 80% (39/49) at 6 months (P=.003). Participants’ scores over time are presented in Table 4 and visually displayed in Figure 3. Following adjustment for covariates, decreases were seen in participants’ percentage of HDD in the past 30 days from 29.4% at baseline to 21.8% at 3 months (β=–7.6, 95% CI –13.6 to –1.6; P=.01) and 16.2% at 6 months (β=–13.2, 95% CI –19.2 to –7.2; P<.001). Likewise, drinking consequences as per the SIP-R decreased from 6.3 at baseline to 4.4 at 3 months (β=–1.9, 95% CI –2.8 to –0.9; P<.001) and 3.6 at 6 months (β=–2.7, 95% CI –3.6 to –1.7; P<.001). Psychological distress as per the Kessler-10 scores decreased from baseline an estimated –1.9 (95% CI –3.3 to –0.4; P=.01) points at 3 months and –1.5 (95% CI –2.9 to 0.0; P=.046) points at 6 months. Changes were not detected in any of the WHOQOL-BREF domain scores over the study course. No associations were detected between changes in alcohol-related outcomes and app engagement (total weeks and minutes of app use over 24 weeks).

    Table 4. Estimated alcohol use, psychological distress, and health-related quality of life scores over time.a
    MeasureEstimated mean (95% CI)
    Heavy drinking days, %

    		Baseline29.4 (23.4-35.4)

    		Month 321.8 (15.5-28.0)

    		Month 616.2 (9.9-22.4)
    SIP-Rb score

    		Baseline6.3 (5.1-7.5)

    		Month 34.4 (3.2-5.7)

    		Month 63.6 (2.4-4.9)
    Kessler-10

    		Baseline18.8 (17.4-20.1)

    		Month 316.9 (15.4-18.3)

    		Month 617.3 (15.8-18.7)
    WHOQOL-BREFc, physical health

    		Baseline59.5 (57.1-61.9)

    		Month 359.1 (56.5-61.6)

    		Month 660.2 (57.7-62.8)
    WHOQOL-BREF, mental health

    		Baseline67.9 (64.8-71.0)

    		Month 367.5 (64.3-70.7)

    		Month 668.0 (64.8-71.2)
    WHOQOL-BREF, social relationships

    		Baseline72.6 (67.4-77.8)

    		Month 375.4 (70.0-80.8)

    		Month 673.7 (68.3-79.0)
    WHOQOL-BREF, environment

    		Baseline79.9 (76.7-83.1)

    		Month 378.2 (74.9-81.5)

    		Month 680.1 (76.7-83.4)

    aAdjusted for gender, age, and binary measures of alcohol use disorder, any drug use, and mental health disorders (major depression, generalized anxiety, and posttraumatic stress disorder) at baseline.

    bSIP-R: Short Inventory of Problems–Revised.

    cWHOQOL-BREF: abbreviated World Health Organization Quality of Life.

    ‎
    Figure 3. Estimated alcohol use and psychological distress scores over time, adjusted for gender, age, and binary measures of alcohol use disorder, any drug use, and mental health disorder (major depression, generalized anxiety, and posttraumatic stress disorder). HDD: heavy drinking days; SIP-R: Short Inventory of Problems–Revised.
    View this figure

    Principal Findings

    The low rates of and delays in accessing treatment for alcohol-related problems among OEF and OIF veterans can detrimentally affect their health, long-term functioning, and reintegration into communities. While specialty substance use disorder care is seen as the gold standard for alcohol treatment, mHealth apps such as Step Away have great public health reach [15] and are a promising alternative for veterans who are unable or reluctant to seek traditional clinic-based alcohol treatment. This study contributes to the emerging literature on alcohol treatment apps and to the investigations of Step Away, the next iteration of LBMI-A, in particular. Results from this pilot study indicated that OEF and OIF veterans were willing to engage with Step Away; found the app acceptable with respect to effectiveness, efficiency, and overall satisfaction; and decreased their heavy drinking days over 6 months of study participation.

    While veterans recruited for this study were selected based on reports of drinking over recommended limits, they were not required to have an AUD, be seeking care, or have a goal of changing their drinking behavior. Despite these facts, over 80% (45/55) of the sample met criteria for AUD and over one-third had received prior substance use treatment at baseline. Given our sample and the mixed findings from other studies of alcohol-related apps, many showing modest reductions in use [22,23], the decreases seen in heavy drinking days and alcohol-related problems scores are encouraging. Future studies with a larger sample size and a control group are needed to validate these findings and determine their association with Step Away.

    Weekly episodes of Step Away use among those who accessed the app at least once during a given week remained steady over the study course, but time per episode dropped quickly after week 1. Such findings are similar or better than those of other studies (eg, 5% of participants using the app at week 12 [22]). This drop-off in use is understandable; we anticipated that most participants would complete the most time-consuming aspects of Step Away (eg, setting up their preferences and goals and reading through psychoeducational material) during week 1. Sustained use consisted mainly of the daily and weekly feedback features of Step Away, which continued to be used by approximately one-third of participants through week 24. This may be driven by Step Away’s use of push notifications, as recommended in the literature [15,20,50]. While these features are important, other components based in MET (eg, goal setting) and community reinforcement (eg, social supports) were not as well accessed.

    This raises the question of how to deliver treatment components that are thought to be essential to quality substance use disorder care in the virtual environment. Some apps (eg, A-CHESS) are designed to be adjunctive to standard in-person care, either to be used as an additional component of care or a continuation of care. For stand-alone treatment apps such a Step Away, the issue of how to engage app users with evidence-based interventions is critical. Future iterations of Step Away must leverage technology to deliver these interventions in a way that is perceived as relevant and useful. Personalizing app content (ie, tailoring) is associated with increases in user-rated quality and popularity [15]. Apps such as InDEx [23], which is geared specifically to a veteran population, included highly tailored messaging and saw high rates of app engagement, with two-thirds of participants using the app every week for 4 weeks after enrollment compared to 43.6% (24/55) seen in this study. More sophisticated use of tailoring that introduces new interventions specific to the app user’s treatment course (eg, relapse prevention) might help to keep users fully engaged in app content and reengage those individuals whose app usage has dropped off. Combining Step Away with provider contact, peer support, or both, a recommended means of increasing engagement [51], is under study by Blonigen and colleagues [52] and will be critical to our understanding of how to best improve engagement with alcohol treatment apps.

    Similar to findings pertaining to engagement with the DrinkLess app [24], which was tested in the general population, engagement with Step Away as measured by weeks of use and total minutes of use was positively associated with age, female gender, education level, and an income above US $50,000. Examinations of the relationship between drinking characteristics and app engagement have yielded inconsistent results, with some studies identifying an association between high drinking levels and app engagement [22] and others detecting no association [24]. Our findings of no significant associations between baseline drinking severity and engagement must be considered in relation to our sample. The study was presented as an app evaluation rather than a treatment study, and as noted above, participants were not required to have a desire to cut back on alcohol use. It is also possible that engagement reflected a desire to be compliant with the study rather than treatment engagement per se. Our findings also do not help clarify whether app engagement improves drinking outcomes. While we did not detect an association between engagement and outcomes, our sample size was small and likely underpowered. Additional research, ideally with a comparison condition and a larger sample of participants desiring to cut back on use, is needed to determine whether Step Away is more appealing to veterans with alcohol misuse and no AUD compared with those with AUD and to assess the relationship between app engagement and outcomes.

    Study Limitations

    While the primary aim of this study was to evaluate the usability of Step Away, we were not able to tease out the main components of usability—effectiveness, efficiency, and satisfaction—because the SUS is a composite measure. In addition, we were unable to determine with accuracy the amount of time spent in each Step Away module for the first time. Thus, learnability was assessed by time spent in the app on the first episode of use and first week of use, with time spent in the app after week 1 provided for context. The study relies on veteran self-report for measuring alcohol use and prior receipt of alcohol-related care without verification by laboratory testing and treatment utilization records. Without a comparison condition, we do not know if reductions in use were due to use of Step Away or other factors; other studies of alcohol treatment apps [17] have found that reductions in use are modest when compared to controls and that differences decline over time. Furthermore, we did not assess participants’ motivations for using the app or whether they desired or saw a need for cutting back on alcohol consumption. While we assessed general distress using the Kessler-10, we did not examine symptoms related to co-occurring mental health conditions that are common among veterans (eg, depression, posttraumatic stress disorder). As iPhone users tend to be less racially diverse and report higher incomes than other smartphone users, the sample of participants recruited for this study is not likely to have been representative of OEF and OIF veterans with AUD. Further, as Tofighi et al [51] point out in their recent review, access barriers to technology (eg, smartphone ownership, connectivity) often mirror the very barriers to treatment that apps are attempting to overcome. Future studies must consider how best to disseminate treatment apps to those who need them and how to overcome technology and connectivity barriers. Our sample was small and composed of non–treatment-seeking OEF and OIF veterans who were aged 18 to 55 years and enrolled in VA care; our findings may not generalize to other OEF and OIF veterans, veterans of other service eras, or individuals in the community.

    This pilot study represents one of the first studies to evaluate the effects of an interactive mHealth app for alcohol misuse in a community sample of veterans. Participants’ use of the app and alcohol-related outcomes were followed for 6 months, longer than many studies of apps addressing alcohol use. Acceptability and usability results provided essential and timely information to guide further refinement of Step Away (eg, modifications of text-heavy screens) and implementation of mHealth apps among veterans with alcohol misuse. If results are verified in a larger controlled trial, Step Away has the potential to improve access to alcohol-related care for a subset of the veteran population that is known to be reluctant to seek such care.

    Acknowledgments

    This material is based upon work supported by the VA Health Services Research and Development, Merit Review Pilot Study (PPO 15-410-2), and the VA Center of Excellence in Substance Addiction Treatment and Education, Seattle, WA. Supporting organizations had no further role in the study design; collection, analysis, and interpretation of data; writing of the report; or decision to submit the paper for publication.

    The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the US Department of Veterans Affairs or University of Washington.

    Conflicts of Interest

    PLD has an ownership interest in the company that owns Step Away.

    1. Room R, Babor T, Rehm J. Alcohol and public health. Lancet 2005 Feb 05;365(9458):519-530. [CrossRef] [Medline]
    2. Rehm J, Gmel G, Sempos CT, Trevisan M. Alcohol-related morbidity and mortality. Alcohol Res Health 2003;27(1):39-51 [FREE Full text] [Medline]
    3. Burnett-Zeigler I, Ilgen M, Valenstein M, Zivin K, Gorman L, Blow A, et al. Prevalence and correlates of alcohol misuse among returning Afghanistan and Iraq veterans. Addict Behav 2011 Aug;36(8):801-806. [CrossRef] [Medline]
    4. Calhoun PS, Elter JR, Jones ER, Kudler H, Straits-Tröster K. Hazardous alcohol use and receipt of risk-reduction counseling among U.S. veterans of the wars in Iraq and Afghanistan. J Clin Psychiatry 2008 Nov;69(11):1686-1693. [CrossRef] [Medline]
    5. Hawkins EJ, Lapham GT, Kivlahan DR, Bradley KA. Recognition and management of alcohol misuse in OEF/OIF and other veterans in the VA: A cross-sectional study. Drug Alcohol Depend 2010 Jun 01;109(1-3):147-153. [CrossRef] [Medline]
    6. Bradley KA, Ludman EJ, Chavez LJ, Bobb JF, Ruedebusch SJ, Achtmeyer CE, et al. Patient-centered primary care for adults at high risk for AUDs: The Choosing Healthier Drinking Options In primary CarE (CHOICE) trial. Addict Sci Clin Pract 2017 May 17;12(1):15. [CrossRef] [Medline]
    7. Goldberg SB, Simpson TL, Lehavot K, Katon JG, Chen JA, Glass JE, et al. Mental health treatment delay: A comparison among civilians and veterans of different service eras. Psychiatr Serv 2019 May 01;70(5):358-366 [FREE Full text] [CrossRef] [Medline]
    8. Maguen S, Madden E, Cohen BE, Bertenthal D, Seal KH. Time to treatment among veterans of conflicts in Iraq and Afghanistan with psychiatric diagnoses. Psychiatr Serv 2012 Dec;63(12):1206-1212. [CrossRef] [Medline]
    9. Willenbring ML. Gaps in clinical prevention and treatment for alcohol use disorders: Costs, consequences, and strategies. Alcohol Res 2013;35(2):238-243 [FREE Full text] [Medline]
    10. Hoge CW, Castro CA, Messer SC, McGurk D, Cotting DI, Koffman RL. Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care. N Engl J Med 2004 Jul 01;351(1):13-22. [CrossRef] [Medline]
    11. Stecker T, Shiner B, Watts BV, Jones M, Conner KR. Treatment-seeking barriers for veterans of the Iraq and Afghanistan conflicts who screen positive for PTSD. Psychiatr Serv 2013 Mar;64(3):280-283. [CrossRef] [Medline]
    12. Dulin PL, Gonzalez VM, King DK, Giroux D, Bacon S. Smartphone-based, self-administered intervention system for alcohol use disorders: Theory and empirical evidence basis. Alcohol Treat Q 2013;31(3):321-336 [FREE Full text] [CrossRef] [Medline]
    13. Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008;4:1-32. [CrossRef] [Medline]
    14. Mobile fact sheet. Pew Research Center. 2019.   URL: https://www.pewresearch.org/internet/fact-sheet/mobile/ [accessed 2020-03-19]
    15. Hoeppner BB, Schick MR, Kelly LM, Hoeppner SS, Bergman B, Kelly JF. There is an app for that - Or is there? A content analysis of publicly available smartphone apps for managing alcohol use. J Subst Abuse Treat 2017 Nov;82:67-73. [CrossRef] [Medline]
    16. Crane D, Garnett C, Brown J, West R, Michie S. Behavior change techniques in popular alcohol reduction apps: Content analysis. J Med Internet Res 2015;17(5):e118 [FREE Full text] [CrossRef] [Medline]
    17. Gajecki M, Andersson C, Rosendahl I, Sinadinovic K, Fredriksson M, Berman AH. Skills training via smartphone app for university students with excessive alcohol consumption: A randomized controlled trial. Int J Behav Med 2017 Dec;24(5):778-788 [FREE Full text] [CrossRef] [Medline]
    18. Hides L, Quinn C, Cockshaw W, Stoyanov S, Zelenko O, Johnson D, et al. Efficacy and outcomes of a mobile app targeting alcohol use in young people. Addict Behav 2018 Feb;77:89-95. [CrossRef] [Medline]
    19. Cohn AM, Hunter-Reel D, Hagman BT, Mitchell J. Promoting behavior change from alcohol use through mobile technology: The future of ecological momentary assessment. Alcohol Clin Exp Res 2011 Dec;35(12):2209-2215 [FREE Full text] [CrossRef] [Medline]
    20. Dedert E, Williams JW, Stein R, McNeil JM, McDuffie J, Ross I. e-Interventions for alcohol misuse. US Department of Veterans Affairs. 2014.   URL: https://www.ncbi.nlm.nih.gov/books/NBK293699/ [accessed 2021-03-19]
    21. Connolly SL, Miller CJ, Koenig CJ, Zamora KA, Wright PB, Stanley RL, et al. Veterans' attitudes toward smartphone app use for mental health care: Qualitative study of rurality and age differences. JMIR Mhealth Uhealth 2018 Aug 22;6(8):e10748 [FREE Full text] [CrossRef] [Medline]
    22. Attwood S, Parke H, Larsen J, Morton KL. Using a mobile health application to reduce alcohol consumption: a mixed-methods evaluation of the drinkaware track & calculate units application. BMC Public Health 2017 May 17;17(1):394 [FREE Full text] [CrossRef] [Medline]
    23. Leightley D, Puddephatt J, Jones N, Mahmoodi T, Chui Z, Field M, et al. A smartphone app and personalized text messaging framework (InDEx) to monitor and reduce alcohol use in ex-serving personnel: Development and feasibility study. JMIR Mhealth Uhealth 2018 Sep 11;6(9):e10074 [FREE Full text] [CrossRef] [Medline]
    24. Garnett C, Perski O, Tombor I, West R, Michie S, Brown J. Predictors of engagement, response to follow up, and extent of alcohol reduction in users of a smartphone app (Drink Less): Secondary analysis of a factorial randomized controlled trial. JMIR Mhealth Uhealth 2018 Dec 14;6(12):e11175 [FREE Full text] [CrossRef] [Medline]
    25. Dulin PL, Gonzalez VM, Campbell K. Results of a pilot test of a self-administered smartphone-based treatment system for alcohol use disorders: Usability and early outcomes. Subst Abus 2014;35(2):168-175 [FREE Full text] [CrossRef] [Medline]
    26. Gonzalez VM, Dulin PL. Comparison of a smartphone app for alcohol use disorders with an internet-based intervention plus bibliotherapy: A pilot study. J Consult Clin Psychol 2015 Apr;83(2):335-345. [CrossRef] [Medline]
    27. Gustafson DH, McTavish FM, Chih M, Atwood AK, Johnson RA, Boyle MG, et al. A smartphone application to support recovery from alcoholism: A randomized clinical trial. JAMA Psychiatry 2014 May;71(5):566-572 [FREE Full text] [CrossRef] [Medline]
    28. Ergonomic requirements for office work with visual display terminals (VDTs) Part 11 Guidance on usability. International standard, 9241-11. International Organization for Standardization. 1998.   URL: https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-1:en [accessed 2021-03-19]
    29. Zapata BC, Fernández-Alemán JL, Idri A, Toval A. Empirical studies on usability of mHealth apps: A systematic literature review. J Med Syst 2015 Feb;39(2):1. [CrossRef] [Medline]
    30. Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): An effective brief screening test for problem drinking. Arch Intern Med 1998 Sep 14;158(16):1789-1795 [FREE Full text] [CrossRef] [Medline]
    31. Blonigen DM, Harris-Olenak B, Haber JR, Kuhn E, Timko C, Humphreys K, et al. Customizing a clinical app to reduce hazardous drinking among veterans in primary care. Psychol Serv 2019 May;16(2):250-254. [CrossRef] [Medline]
    32. Enhancing motivation for change in substance abuse treatment. Treatment Improvement Protocol (TIP) Series, No. 35. Center for Substance Abuse Treatment. Rockville, MD: Substance Abuse and Mental Health Services Administration; 1999.   URL: https://www.ncbi.nlm.nih.gov/books/NBK64967/ [accessed 2021-03-19]
    33. Marlatt G, Donovan D. Relapse Prevention: Maintenance Strategies in the Treatment of Addictive Behaviors. 2nd ed. New York, NY: Guilford Press; 2005.
    34. Meyers RJ, Villanueva M, Smith JE. The community reinforcement approach: History and new directions. J Cogn Psychother 2005 Jul 01;19(3):247-260. [CrossRef]
    35. Smith J, Meyers R. Motivating Substance Abusers to Enter Treatment: Working With Families. New York, NY: Guilford Press; 2004.
    36. D'Zurilla T, Nezu A. Problem-Solving Therapy: A Positive Approach to Clinical Intervention. 3rd ed. New York, NY: Spring Publishing; 2007.
    37. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59(Suppl 20):22-33. [Medline]
    38. Brooke J. SUS: A quick and dirty usability scale. In: Jordan PW, Thomas B, McClelland IL, Weerdmeester B, editors. Usability Evaluation in Industry. London, UK: Taylor and Francis; 1996:189-194.
    39. Bangor A, Kortum PT, Miller JT. Determining what individual SUS scores mean: Adding an adjective rating scale. J Usability Stud 2009;4(3):114-123 [FREE Full text]
    40. Lewis JR, Sauro J. The factor structure of the System Usability Scale. In: Kurosu M, editor. Human Centered Design: Lecture Notes in Computer Science, vol 5619. Berlin, Germany: Springer; 2009:94-103.
    41. Lindgaard G, Fernandes G, Dudek C, Brown J. Attention web designers: You have 50 milliseconds to make a good first impression!. Behav Inf Technol 2006 Mar;25(2):115-126. [CrossRef]
    42. Bevan N. Measuring usability as quality of use. Software Qual J 1995 Jun;4(2):115-130. [CrossRef]
    43. Sobell LC, Sobell MB. Timeline Followback: A technique for assessing self-reported alcohol consumption. In: Litten RZ, Allen J, editors. Measuring Alcohol Consumption: Psychosocial and Biological Methods. Totowa, NJ: Humana Press; 1992:41-72.
    44. Kiluk BD, Dreifuss JA, Weiss RD, Morgenstern J, Carroll KM. The Short Inventory of Problems – Revised (SIP-R): Psychometric properties within a large, diverse sample of substance use disorder treatment seekers. Psychol Addict Behav 2013;27(1):307-314. [CrossRef] [Medline]
    45. Andrews G, Slade T. Interpreting scores on the Kessler Psychological Distress Scale (K10). Aust N Z J Public Health 2001 Dec;25(6):494-497. [CrossRef] [Medline]
    46. Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SLT, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med 2002 Aug;32(6):959-976. [CrossRef] [Medline]
    47. Zubaran C, Foresti K. Quality of life and substance use: Concepts and recent tendencies. Curr Opin Psychiatry 2009;22(3):281-286. [CrossRef] [Medline]
    48. International guide for monitoring alcohol consumption and related harm. World Health Organization. Copenhagen, Denmark: World Health Organization, Department of Mental Health and Substance Dependence, Noncommunicable Diseases and Mental Health Cluster; 2000.   URL: https://apps.who.int/iris/handle/10665/66529 [accessed 2021-03-19]
    49. Greenfield TK. Evaluating competing models of alcohol-related harm. Alcohol Clin Exp Res 1998 Apr;22(Suppl 2):52S-62S. [CrossRef] [Medline]
    50. Song T, Qian S, Yu P. Mobile health interventions for self-control of unhealthy alcohol use: Systematic review. JMIR Mhealth Uhealth 2019 Jan 29;7(1):e10899 [FREE Full text] [CrossRef] [Medline]
    51. Tofighi B, Abrantes A, Stein MD. The role of technology-based interventions for substance use disorders in primary care. Med Clin North Am 2018 Jul;102(4):715-731. [CrossRef] [Medline]
    52. Blonigen D, Harris-Olenak B, Kuhn E, Humphreys K, Timko C, Dulin P. From "Step Away" to "Stand Down": Tailoring a smartphone app for self-management of hazardous drinking for veterans. JMIR Mhealth Uhealth 2020 Feb 13;8(2):e16062 [FREE Full text] [CrossRef] [Medline]

    ‎
    A-CHESS: Addiction Comprehensive Health Enhancement Support System
    AUD: alcohol use disorder
    DSM-5: Diagnostic and Statistical Manual of Mental Disorders, Fifth Revision
    HDD: heavy drinking days
    LBMI-A: Location-Based Monitoring and Intervention System for Alcohol Use Disorders
    MET: motivational enhancement therapy
    mHealth: mobile health
    MINI: Mini International Neuropsychiatric Interview
    OEF: Operation Enduring Freedom
    OIF: Operation Iraqi Freedom
    SIP-R: Short Inventory of Problems–Revised
    SUS: System Usability Scale
    TLFB: Timeline Followback
    VA: Veterans Affairs
    WHOQOL-BREF: abbreviated World Health Organization Quality of Life

    Edited by L Buis; submitted 20.11.20; peer-reviewed by D Leightley, K Yokotani; comments to author 08.12.20; revised version received 02.02.21; accepted 10.03.21; published 08.04.21

    Copyright

    ©Carol A Malte, Patrick L Dulin, John S Baer, John C Fortney, Anissa N Danner, Aline M K Lott, Eric J Hawkins. Originally published in JMIR mHealth and uHealth (http://mhealth.jmir.org), 08.04.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.