This paper is in the following e-collection/theme issue:

mHealth for Data Collection and Research (981) Formative Studies and eHealth/mHealth Development (527) Design and Formative Evaluation of Mobile Apps (706) mHealth for Wellness, Behavior Change and Prevention (2922) Alcohol Abuse, Alcoholism Prevention and Recovery (303)

Published on in Vol 7, No 3 (2019): March

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/11157, first published .
A Smartphone App to Assess Alcohol Consumption Behavior: Development, Compliance, and Reactivity

A Smartphone App to Assess Alcohol Consumption Behavior: Development, Compliance, and Reactivity

A Smartphone App to Assess Alcohol Consumption Behavior: Development, Compliance, and Reactivity

Authors of this article:

Antoinette Poulton1 Author Orcid Image ;   Jason Pan1 Author Orcid Image ;   Loren Richard Bruns Jr2 Author Orcid Image ;   Richard O Sinnott2 Author Orcid Image ;   Robert Hester1 Author Orcid Image
Article Authors Cited by (11) Tweetations (12) Metrics

    Original Paper

    1Melbourne School of Psychological Sciences, University of Melbourne, Parkville, Australia

    2Melbourne eResearch Group, School of Computing and Information Services, University of Melbourne, Parkville, Australia

    Corresponding Author:

    Antoinette Poulton, MEd

    Melbourne School of Psychological Sciences

    University of Melbourne

    Redmond Barry Building

    Parkville, 3010

    Australia

    Phone: 61 83446377

    Fax:61 93476618

    Email: antoinette.poulton@unimelb.edu.au


    Background: There are disadvantages—largely related to cost, participant burden, and missing data—associated with traditional electronic methods of assessing drinking behavior in real time. This potentially diminishes some of the advantages—namely, enhanced sample size and diversity—typically attributed to these methods. Download of smartphone apps to participants’ own phones might preserve these advantages. However, to date, few researchers have detailed the process involved in developing custom-built apps for use in the experimental arena or explored methodological concerns regarding compliance and reactivity.

    Objective: The aim of this study was to describe the process used to guide the development of a custom-built smartphone app designed to capture alcohol intake behavior in the healthy population. Methodological issues related to compliance with and reactivity to app study protocols were examined. Specifically, we sought to investigate whether hazard and nonhazard drinkers would be equally compliant. We also explored whether reactivity in the form of a decrease in drinking or reduced responding (“yes”) to drinking behavior would emerge as a function of hazard or nonhazard group status.

    Methods: An iterative development process that included elements typical of agile software design guided the creation of the CNLab-A app. Healthy individuals used the app to record alcohol consumption behavior each day for 21 days. Submissions were either event- or notification-contingent. We considered the size and diversity of the sample, and assessed the data for evidence of app protocol compliance and reactivity as a function of hazard and nonhazard drinker status.

    Results: CNLab-A yielded a large and diverse sample (N=671, mean age 23.12). On average, participants submitted data on 20.27 (SD 1.88) out of 21 days (96.5%, 20.27/21). Both hazard and nonhazard drinkers were highly compliant with app protocols. There were no differences between groups in terms of number of days of app use (P=.49) or average number of app responses (P=.54). Linear growth analyses revealed hazardous drinkers decreased their alcohol intake by 0.80 standard drinks over the 21-day experimental period. There was no change to the drinking of nonhazard individuals. Both hazard and nonhazard drinkers showed a slight decrease in responding (“yes”) to drinking behavior over the same period.

    Conclusions: Smartphone apps participants download to their own phones are effective and methodologically sound means of obtaining alcohol consumption information for research purposes. Although further investigation is required, such apps might, in future, allow for a more thorough examination of the antecedents and consequences of drinking behavior.

    JMIR Mhealth Uhealth 2019;7(3):e11157

    doi:10.2196/11157

    Keywords

    alcohol drinking; smartphone apps; smartphone; mobile phone; research app development; compliance; reactivity 


    Background

    Advantages associated with real-time (or near real-time) methods of assessing alcohol consumption behavior for research purposes have been widely documented in recent years [1-3]. Such methods—which are increasingly electronic in nature—are advocated on the basis of how they allow data to be captured repeatedly in the natural environment and in the absence of the researcher [2,3]. This facilitates the collection of actual intake information rather than the summary data commonly elicited from more traditional retrospective methods of assessing drinking. As such, recall and response biases are thought to be minimized and the ecological validity of the data is consequently enhanced [3]. Real-time methods additionally reduce the quantity of missing data and can yield a diverse and potentially very large sample [4,5]. Crucially, real-time data enable variations in behavior to be examined across time and in concert with cognitive, affective, environmental, and physiological factors. In this way, the antecedents and consequences of drinking behavior can also be investigated [2,3].

    Real-time electronic methods of collecting alcohol consumption information for research purposes have evolved rapidly over the last two decades. Early studies typically featured hand-held electronic devices [6,7] or interactive voice response systems [8,9]. In the case of the former, participants used the device as an electronic diary; in the latter, the interactive voice response system was programmed to call participants on researcher-supplied cellular phones so that an automated questionnaire could be administered. Short message service (SMS) text messaging protocols have also been employed. In such studies, SMS text messages direct participants to follow a link to complete a Web-based survey via their mobile browser [10] or ask them to respond to simple questions about their alcohol consumption via text [11]. With the advent of smartphones, researchers have increasingly been programming study-specific apps for use in such studies. In most cases, this involves either providing participants with a phone preloaded with the app [12,13] or loading the app onto participants’ own phones and downloading the data at the end of the experimental period [14].

    There are a number of disadvantages associated with utilizing the aforementioned electronic protocols. There are costs, for instance, associated with programming, supplying, and training participants to use electronic devices that are not their own [15-18]. Participants must also be provided with some means whereby they can recharge these devices [16]. If they have their own mobile, they will be carrying 2 devices during the experimental period, which might prove unduly burdensome and reduce compliance. Questionnaires completed via cell phone browsers do not always scale well to all mobile devices and require internet connectivity [19]. Surveys conducted via SMS text messages are necessarily limited in scope and, in the absence of internet connectivity, potentially costly to participants [20]. In all cases, participants are required to visit the lab at least twice during the experimental period; they must collect the device or have the program loaded onto their own phone plus undergo training, and they must return the device or have the data downloaded off their phone [18,21]. These disadvantages potentially diminish some of the benefits of using electronic devices to collect real-time alcohol intake behavior; specifically, sample size and diversity may be a function of the cost of supplying the device to those willing and able to attend the lab, and data may go unrecorded where internet connectivity or cost to the participant is an issue.

    Using apps participants download to their own smartphones, without ever visiting a lab, might enable researchers to more fully realize the benefits of collecting alcohol consumption information electronically and in real time. Smartphone penetration currently stands at upward of 70% across many developed nations and is growing rapidly across developing ones [22]. Across the United States, United Kingdom, and Australia, more than 93% of 18 to 34 year olds own a smartphone [23]. Taking advantage of high smartphone ownership rates by using participants’ own devices represents a substantial cost reduction both in terms of equipment and training. Asking individuals to download apps via marketplace vendors and having data stored on the phone until it can be automatically uploaded to a server via a Wi-Fi connection alleviates the participants’ need to visit the lab and reduces the likelihood of data being lost or going unrecorded. Advantages of real-time assessment related to completeness of data, sample size, and diversity might therefore be preserved in studies employing apps downloaded to participants’ smartphones.

    Nonetheless, there are a number of development and methodological concerns pertaining to assessing alcohol consumption behavior via smartphone apps that warrant further investigation. Given that any app must be programmed for 2 different, frequently updating operating systems with distinct deployment protocols, researchers are likely to require the assistance of 1 or more app programmers in the development phase. The literature offers little guidance regarding the software development process as it relates to the behavioral sciences [24]. Examples of how to effectively manage and integrate the requirements and expectations of multiple stakeholders when developing apps for behavioral studies are consequently required.

    Although several recent studies have reported promising results with regard to the validity of app-based methods of capturing alcohol intake information [25-27], issues related to app protocol compliance and reactivity have received less attention. Compliance refers to the extent to which participants adhere to study requirements and protocols throughout the experimental period, whereas reactivity describes a process whereby the monitoring of a behavior results in a change in that behavior [1-3]. Simply completing traditional alcohol intake assessment and screening measures has been found to decrease consumption among heavy drinkers and reduce self-reported hazardous drinking behaviors [28-30]. However, it is unclear if this reactivity arises as a function of drinking behavior. Individuals characterized by more risky consumption patterns may, more likely than others, alter their behavior in response to monitoring. Although commentators generally report little evidence of reactivity in real-time studies of alcohol intake, they also note further investigation is required [1,21,31-33]. Reactivity is a phenomenon that can emerge for several reasons. Participants might become more aware of the behavior and become consequently motivated to implement change, or the demands of the protocol might provoke a tendency to satisfice [31]. In any real-time study of alcohol intake, a decrease in drinking could be evidence of the former, whereas a decrease in responding “yes” to the behavior (and therefore in having to respond to further questions) might suggest the latter.

    Objectives

    In this paper, we describe the process used to guide the development of a custom-built smartphone app designed to capture alcohol intake behavior in the healthy population for research purposes. We also evaluate methodological issues related to compliance with and reactivity to study protocols as a function of hazard and nonhazard drinker status. We expect individuals in both hazard and nonhazard groups will be equally compliant. Reactivity in the form of a decrease in drinking will be minimal or confined to the hazard group, whereas individuals in both groups will be susceptible to reactivity in the form of reduced responding.


    App Development

    The CNLab-A app represents the outcome of an iterative development process that included elements of agile software design, namely requirements analysis, feature and interface design, and app implementation [24,34].

    Requirements Analysis

    In the requirements analysis phase, the research team determined key variables of interest. To this end, empirical definitions of excessive and binge drinking and variables derived from validated retrospective measures of drinking were examined [35-39]. We aimed to elicit data that would assist in establishing percentage of drinking and nondrinking days, daily and average total standard drinks, daily and average drinking rate, highest drink count in 2 hours, and blood alcohol content (BAC). After soliciting advice from the programmer and giving due consideration to the ethical implications, we decided that although the date and time of app submissions would be automatically logged, geolocation would not be recorded because of concerns that such data may undermine efforts to preserve user anonymity [40,41]. In early iterations of the app, responses related to date of birth, sex, height, and weight were also recorded. Date of birth and sex details were utilized to link data from the app with information collected via other means (eg, Web-based surveys or in the lab). Height and weight were used to determine BAC. In this early iteration, all data were uploaded to a dedicated commercial Web-server company account. Given the concerns articulated in the literature regarding privacy and the secure storage of behavioral data [40,41], latter iterations of the app did not include any demographic questions; instead, a unique identification number was generated for each participant, and the data were uploaded to a secure server. In this way, app data were not linked to any personal information.

    In this phase, the research team also considered assessment design. Studies reliant on real-time (or near real-time) monitoring of behavior tend to employ event- or time-based sampling [32]. In the case of the former, participants record the behavior as it happens or shortly thereafter; in the latter, behavior is recorded in response to signals that occur multiple times a day, often at random [32]. Occasionally, both assessment methods are utilized simultaneously [32]. As substance use is episodic in nature, event-based assessment is considered an appropriate method for tracking both frequency and timing of use [1]. Therefore, we determined this would be the most pertinent method of collecting alcohol consumption information. However, a disadvantage of event-based monitoring is that it is difficult to assess compliance, that is, there is no way to verify that participants record all events as required [32]. To combat this limitation, we required the app to send participants twice-daily prompts asking them if they had consumed alcohol since the last submission. This served to remind participants to record drinking if they had forgotten to do so. In this regard, we adopted a similar assessment protocol as Dulin and colleagues; they also employed an event-based assessment along with daily notifications reminding participants to record drinking [25]. We additionally required the app to prevent participants from submitting data more than 24 h into the past or more than 15 min into the future to prevent back and forward filling.

    Finally, the content for each assessment was based on the key variables of interest. Drink type formed the central element of each assessment as, once selected, all subsequent items were dependent on this choice (Figure 1). For instance, selecting mid strength beer as the drink type in the app automatically determined the alcohol content and serving size options. In Australia, mid strength beer has an alcohol content of 3.5% and is available, at least in licensed and retail venues, in various standard serving sizes [42,43]. Table 1 details drink type, alcohol content, and serving size options available in the app (Table 1). These options were not meant to be exhaustive but were designed to capture typical drink types, average alcohol content, and standard serving sizes sold in Australia. The final aspect of assessment involved selecting a start and finish time for drinking.

    Decisions made during the requirements analysis phase were documented via an iterative storyboard process. This ensured that the research team and programmer had access to a common record.

    Feature and Interface Design

    Feature and interface design was informed by app software capabilities and in consultation with the programmer. During this phase, iOS app prototypes were developed and deployed in response to design decisions and feedback from the research team. Deployment was via Test Flight, which allowed invited users to test beta versions of iOS apps.

    ‎
    Figure 1. Flowchart of assessment pathway and screenshots from the CNLab-A app. On opening, CNLab-A asks users if alcohol has been consumed in the last 24 hours. Thereafter, participants are asked if they have consumed alcohol since their last submission. If they indicate (by pressing “No”) that no drinking has occurred, the app can be closed. If participants indicate drinking has occurred (by pressing “Yes”), images of common alcoholic beverages (including beer, wine, cider/premix, spirit/liqueur, and cocktail) are displayed (1). Type of beverage consumed is selected by touching the appropriate image on the screen. Quantity and size consumed for each beverage is indicated via a simple scroll option menu (2). Alcohol content as a function of beverage type is prefilled. This process is repeated by tapping “Back” in order to add as many drink types as required. Erroneously entered data can be deleted by swiping left. Prior to submitting data, the start and end time of drinking must be specified, again using a scroll option menu (3). Participants are able to either report drinking in separate sessions or they can leave the app open so as to record beverages as they are consumed. The latter option still allows participants to use other features on their phone. Participants can access a history of their submission dates and times (but not their drinking data) via the “History” button. At the conclusion of the experimental period, an automated message thanks participants; gives them simple feedback regarding the number of days they consumed alcohol, total standard drinks consumed, and average daily consumption; and, asks them to remove the app from their smartphone.
    View this figure

    We determined response selection would be via touch screen and scroll menus. At the commencement of each assessment, for instance, when participants were asked if they have consumed alcohol since their last submission, they indicated “Yes” or “No” by touching either option on the screen. Similarly, it was decided that drink types would be presented on 1 touch screen as a set of images with captions so that participants could readily identify and select their beverage. Images were designed using Inkscape, a freely available vector graphic software package. In the case of beer, images for mid and light-strength were opaque versions of the full-strength visual. Quantity and size options were available via a simple scroll option menu. Likewise, a scroll menu presented dates and times (in 15-min intervals) for recording of drinking start and end time. Participants pressed “Submit” to upload (to the server) and end the assessment. Any submission that failed to upload because of lack of internet connectivity would automatically be uploaded when connectivity was reestablished. Figure 1 shows screenshots of the app interface (Figure 1). The app icon was also designed during this phase. A discreet pattern and app name were chosen to minimize the likelihood friends or family of the participant would realize they were taking part in an alcohol-related study.

    App Implementation

    One of the potential advantages of using electronic means of assessment in the behavioral sciences relates to penetration. Such methods can provide investigators with large, diverse samples if facilitated by appropriate implementation decisions related to development and deployment. To that end, the research team decided to develop a native app to be run locally on iOS and Android platforms with marketplace deployment via Apple iTunes and Google Play, respectively, to optimize app availability. However, because of funding limitations, only an iOS version of the app was initially alpha and beta tested.

    Table 1. Drink types, alcohol content, and serving size options available in the CNLab-A app.
    Drink typeAlcohol content (%)Serving sizes
    Beer


    		Full strength4.8Glass 200 mL; pot/middy 285 mL; can/bottle 375 mL; schooner 425 mL; pint 570 mL

    		Mid strength3.5As above

    		Light strength2.7As above
    Wine


    		White/Champagne12.0Glass 150 mL

    		Red13.0As above
    Fortified wine


    		Port, sherry, marsala, madeira, vermouth, etc18.0Glass 60 mL
    Cider/premix spirit


    		Most ciders and premix drinks including alcopops5.0Bottle 300 mL; bottle 330 mL; can 375 mL; bottle 500 mL
    Spirit/liqueur


    		Rum, gin, vodka, brandy, tequila, whiskey, liqueurs, etc40.0Standard 30 mL; double 60 mL
    Cocktail


    		Various40.01 shot 30 mL; 2 shots 60 mL; 3 shots 90 mL; 4 shots 120 mL

    Alpha testing involved a small sample of individuals (N=8, mean age 38.13 years, SD 16.54; range 18-68 years, 37.5% female) and was designed to identify programming bugs and oversights. Beta testing comprised a slightly larger group (N=19, mean age 37.37 years, SD 9.73; range 22-68 years, 68.4% female) and focused on eliciting user feedback (via email) post testing. During both the test studies, individuals were asked to keep a hardcopy record of any data submissions so that app data could be checked for accuracy. Average time to submit drinking information during testing was 34 seconds.

    Suggestions provided by individuals involved in this phase and that were incorporated into the final version of the app included making an instructional video explaining how to use CNLab-A available to participants [44], providing post experimental summary feedback regarding total standard drinks consumed and average daily intake, along with several minor changes to the app user interface. Otherwise, testers indicated that compliance with app protocols was not onerous. They all reported using a mix of real-time and prompt-based submissions.

    The requirements analysis and feature and interface design phases took almost 4 months, whereas the alpha and beta testing of the app implementation phase spanned approximately 8 weeks. We had 3 meetings with the programmer in the early stages of development and then a further meeting toward the completion of the feature and interface design phase. All other communication was via email. The final production version of the app was eventually made available on both iOS (8.4+) and Android (Kitkat 4.1+) platforms. As operating systems evolve, both apps will be audited to ensure they continue to function as required.

    Participants and Procedure

    This study was based on data from 671 participants (mean age 23.12 years, SD 7.24; range 16-56 years, 70% female) that form a subset of an ongoing project—entitled CheckMyControl—investigating the relationship between alcohol use and various social and cognitive factors in the healthy population. This subsample completed the app component of the project (Figure 2). Participants were recruited via adverts posted in and around the University of Melbourne, researcher networks, and social media posts; as such, they formed a convenience sample. Individuals were eligible to take part in this study if they were fluent in English and aged 13 years or older. The University of Melbourne Human Research Ethics Committee approved the study in accordance with the standards for ethical research of the National Health and Medical Research Council.

    After reading a plain language statement and providing informed consent, participants answered a Web-based researcher-devised demographic survey and the Alcohol Use Disorders Identification Test (AUDIT) [39]. The demographic survey included questions pertaining to country of birth, first language, and place of residence. Participants were also asked if they had ever been diagnosed with an alcohol or substance use disorder. Participants were then required to download and use the CNLab-A smartphone app to record alcohol use for 21 days.

    They were compensated Aus $10 for time spent completing Web-based surveys and Aus $0.50 each day information about alcohol consumption was submitted via the app (regardless of whether alcohol had been consumed or not). Participants received a bonus Aus $9.50 if app data were submitted on all 21 days. The maximum participants could be reimbursed was Aus $30.

    ‎
    Figure 2. Flow diagram following Consolidated Standards of Reporting Trials guidelines of study participation.
    View this figure

    Measures

    The AUDIT is a 10-item screening measure that asks participants to respond to questions assessing alcohol intake, problems, and dependence with reference to the preceding 6 months. Participants were categorized into hazard (n=286) and nonhazard (n=385) groups based on their score, with scores of 8 or more indicative of hazardous alcohol consumption [45]. Previous studies have shown the AUDIT is a valid instrument for assessing alcohol misuse among adolescents—sensitivity (Sn)=.71; specificity (Sp)=.84—university students (Sn=.75-.89; Sp=.73-.82), and the general population (Sn=.92; Sp=.94) in various countries, including Australia (Sn=.93; Sp=.82) [39,46-48].

    CNLab-A is a freely available custom-built app that can be used to record alcohol intake for research purposes. Once downloaded, CNLab-A requires participants to allow it to send them notifications. One notification is preset to 8 am, whereas the other can be set to suit the user. Although participants are directed at the outset to record alcohol consumption as it happens (or as soon thereafter as possible), notifications serve to prompt individuals to input information twice daily in case they neglect to do so when drinking. Thus, alcohol intake data can be submitted at any time, either in response to notifications or while drinking. A unique identification code, provided to participants during the Web-based component of the study, is required before the app opens. CNLab-A has previously been found to be a valid measure of alcohol intake [27].

    Statistical Analyses

    Independent t tests and Chi-square analyses were conducted to determine whether hazard and nonhazard groups were matched demographically. Homogeneity of variance was assessed using Levene Test, where this assumption was violated, adjusted t values and associated degrees of freedom were reported. Effect sizes were computed for t tests using r values; they were interpreted according to Cohen guidelines: 0.10=small, 0.30=moderate, and 0.50=large effect [49].

    Participants were considered compliant with app protocols if they responded to at least 1 notification each day for the 21-day experimental period. We assessed both number of days of use and submissions per day as a function of gender, age bracket (13-19 years, 20-29 years, and ≥30 years), and hazard and nonhazard group status using t tests and 1-way analysis of variance. Reactivity was assessed using linear growth model analyses, conducted using SPSS 24 (IBM). These analyses examined (1) change in drinks consumed each day and (2) change in daily (“yes”) responding over the 21-day experimental period as a function of AUDIT group membership. In the first analysis, drinks per day (within persons; level 1) were nested within individuals (between persons; level 2); in the second, daily (“yes”) response rate (within persons; level 1) was nested within individuals (between persons; level 2). Time was centered on the first day of data collection (Day 0); each unit of time represented an interval of 1 day [50]. All mixed models were estimated using restricted maximum likelihood [51]. Initially, slope variance and autocorrelation were included in both models, but they were removed when parameter estimates for these effects were found to be very small (<0.01).


    Descriptive Statistics

    At the time of testing, 39.9% (268/671) of the sample was aged under 20 years, 46.2% (310/671) was aged 20 to 29 years, and 13.9% (93/671) was aged 30 years or over. In Australia, individuals in the 18 to 29-year-old age bracket are more likely than others to consume alcohol in a manner that increases their short-term risk of alcohol-related injury, whereas almost 19% are at risk of long-term alcohol-related harm [52]. Most participants were born in Australia (66.8%, 448/671), spoke English as their first language (80.0%, 537/671), and lived in urban regions (88.1%, 591/671). Census data show 67% of the Australian population is locally born and 79% speak English as their first language [53]. Most Australians (86%) reside in urban regions [54]. A small number of participants indicated they identified as an Indigenous Australian (0.6%, 4/671). This was less than what the census data suggest as typical for the state (Victoria) in which this study took place (0.8%) [53]. However, this difference is likely a product of our recruitment campaign. As advertisements for the study were posted in and around the University of Melbourne, the sample contained a large number of young tertiary-aged participants (85.7%, 575/671). The proportion of indigenous students studying at this institute in 2016 stood at 0.6% [55].

    Before commencing the 21-day recording period, the minority of participants (2.2%, 15/671) indicated they had never consumed alcohol; the majority (92.8%, 623/671) described themselves as regular drinkers. A small proportion indicated they had been diagnosed with an alcohol (0.3%, 2/671) or substance (0.4%; 3/671) use disorder. Hazard and nonhazard groups did not differ significantly with regard to age, t669=1.02, P=.31 or years of education, t654.11=1.65, P=.10. There was a significant association between gender and AUDIT group membership, χ2671=5.96, P=.02. The odds of being a hazardous drinker were 1.51 times higher for males than females (95% CI 0.22-2.01). There were significant differences between the AUDIT scores of the hazard (mean 12.45, SD 4.30) and nonhazard (mean 4.64, SD 3.59) groups, t547.67=24.94, P<.001. Mean alcohol intake indices recorded via CNLab-A are detailed in Table 2.

    Compliance

    On average, participants used CNLab-A 20.27 (SD 1.88) days out of 21 (96.5%); 96.0% (644/671) of participants completed at least 1 submission per day for the entire 21-day experimental period. There were no significant differences as a function of gender t669=0.83, P=.41, or age bracket, F2,668=0.34, P=.71, with regard to number of days of use. Moreover, there were no differences between hazard and nonhazard groups, t669=0.69, P=.49. As data submission was either event- or notification-contingent, there was no upper limit to the number of drinking sessions participants could report using the app. Participants received a maximum of 42 notifications asking them to record information about their drinking. They submitted data, on average, 2.00 (SD 0.41) times per day.

    With regard to the average number of responses per day, there were no significant differences as a function of gender, t669=0.65, P=.51, or age bracket, F2,668=1.08, P=.34. In addition, there were no differences on the basis of AUDIT group membership, t669=0.61, P=.54. There were 27,355 data points captured via the app in total.

    Table 2. Average alcohol intake indices as recorded via CNLab-A app (21 days), including hazard (n=286) and nonhazard (n=385) group totals and differences.
    Drinking indicesTotal, mean (SD)Hazard, mean (SD)Nonhazard, mean (SD)t669a95% CIPearson correlation r
    Days drinking5.32 (4.17)6.90 (4.02)4.15 (3.90)8.912.14-3.35.33
    Total drinksb24.26 (25.41)37.45 (28.09)14.47 (17.75)12.1619.27-26.70.43
    Drinks per day1.20 (1.25)1.86 (1.38)0.71 (0.86)12.450.97-1.33.43
    Drinks per day drinking3.98 (3.02)5.53 (2.92)2.83 (2.56)12.452.27-3.12.43
    Hourly rate of drinking2.20 (2.09)2.60 (2.14)1.89 (2.00)4.410.40-1.04.17
    Highest drink count in 2 hours4.14 (3.15)6.03 (3.37)2.79 (2.09)14.342.80-3.69.48
    4/4+ intakec2.16 (2.58)3.48 (2.83)1.19 (1.86)11.891.91-2.67.42
    6/6+ intake1.31 (1.92)2.26 (2.27)0.61 (1.20)11.141.35-1.94.40
    8/8+ intake0.85 (1.44)1.51 (1.70)0.36 (0.94)10.410.94-1.38.37
    12/12+ intake0.31 (0.80)0.58 (1.06)0.10 (0.43)7.260.35-0.61.27
    20/20+ intake0.07 (0.31)0.12 (0.41)0.03 (0.20)3.550.04-0.15.14

    aP values all <.001.

    bDrinks refer to self-reported alcohol consumption in Australian standard drinks (1 drink=10 g alcohol).

    c4/4+ (and so forth) intake refers to occasions where 4 or more drinks were consumed in 1 episode.

    Table 3. Parameter estimates for linear growth model of drinks per day as a function of hazard and nonhazard Alcohol Use Disorders Identification Test group membership.
    ParameterEstimate (SE)t/zadfP value95% CI
    Fixed effects (intercept, slopes)

    		Intercept (Day 0)0.67 (0.08)8.682301.73<.0010.52 to 0.82

    		Time–0.01 (0.01)–1.8013418.00.07–0.02 to 0.001

    		Hazard1.48 (0.11)13.262301.73<.0011.26 to 1.70

    		Hazard by time–0.03 (0.01)–3.5013418.00<.001–0.04 to–0.01
    Random effects ([co-]variances)

    		Between-person (level 2) intercept0.74 (0.06)12.28—b<.0010.63 to 0.87

    		Within-person (level 1) residual7.54 (0.09)81.91—<.0017.37 to 7.73

    at test value for fixed effects parameters; Wald z value for random effects parameters.

    bNot applicable.

    Table 4. Parameter estimates for linear growth model of daily (“yes”) responses per day as a function of hazard and nonhazard AUDIT group membership.
    ParameterEstimate (SE)t/zadfP value95% CI
    Fixed effects (intercept, slopes)

    		Intercept (Day 0)0.32 (0.02)18.24982.85<.0010.28 to 0.35

    		Time–0.003 (0.001)–3.6313418.00<.001–0.004 to –0.001

    		Hazard0.15 (0.03)5.99982.85<.0010.10 to 0.20

    		Hazard by time–0.004 (0.001)–3.5313418.00<.001–0.006 to –0.002
    Random effects ([co-]variances)

    		Between-person (level 2) intercept0.08 (0.01)16.86—b<.0010.07 to 0.09

    		Within-person (level 1) residual0.14 (0.002)81.91—<.0010.14 to 0.15

    at test value for fixed effects parameters; Wald z value for random effects parameters.

    bNot applicable.

    Reactivity

    Table 3 details parameter estimates for fixed and random effects of the linear growth analysis model for change in drinks consumed each day. With regard to fixed effects, the nonhazard group reported consuming significantly fewer standard drinks (0.67) on Day 0 than the hazard (0.67+1.48=2.15) group. The nonhazard group showed no significant decrease in consumption over the 21-day experimental period, whereas the hazard group demonstrated a slight but significant decrease in drinking over the same period (0.04 standard drinks per day). Within-person variance (7.54) equates to 2.75 SD units; thus, 95% of observed residuals were between ±5.49 units of their fitted values. The intercept variance (0.74) corresponds to 0.86 SD units; therefore, 95% of the population varied between ±1.72 units of the typical intercept for their group (Table 3).

    Table 4 shows parameter estimates for fixed and random effects of the linear growth model for change in daily (“yes”) responses. The nonhazard group responded (“yes”) significantly less often (0.32) on Day 0 than the hazard (0.32+0.15=0.47) group. A slight but significant decrease in responding was evident for both the nonhazard (–0.003 per day) and hazard (–0.003+(– 0.004)=–0.007 per day) groups. Within-person variance (0.14) equates to 0.37 SD units; thus, 95% of observed residuals were between ±0.75 units of their fitted values. The intercept variance (0.08) corresponds to 0.28 SD units; therefore, 95% of the population varied between ±0.57 units of the typical intercept for their group (Table 4).


    Principal Findings

    In this study, we aimed to describe the development and implementation of a custom-built smartphone app devised to measure real-time (or near real-time) alcohol consumption behavior in the healthy population. Designed for use in the research arena, the app was a product of an iterative process that included elements typical of agile software design. Decisions made during each phase of development were informed by a desire to create an app that the participants could download onto their own smartphones without ever having to visit the lab. We anticipated this might minimize disadvantages—such as equipment and training costs, participant burden, and missing data—often associated with using some types of electronic protocols, while simultaneously enhancing benefits pertaining to sample size and diversity. We additionally explored methodological factors related to app protocol compliance and reactivity as a function of hazard and nonhazard drinker status.

    Compliance with app protocols was high. Participants were required to submit data about their drinking (regardless of whether they had consumed alcohol or not) at least once per day for 21 days. On average, they uploaded data on 96.5% of days, and there were no differences between hazard and nonhazard groups with regard to the number of days of app use or the number of responses per day. Presumably, the use of daily payments and an end-of-study bonus (for 21 consecutive days of data submissions) incentivized responding. In previous alcohol intake-based studies utilizing various electronic methods of collecting data—including SMS text messaging [56], hand-held electronic devices [57], and interactive voice response systems [8]— incentivized responding resulted in similarly high rates of compliance. It should be noted that when the measure is freely available via marketplace vendors, the size of the sample can quickly balloon. As such, it is important to not only balance the burden of protocol compliance with the incentive offered but it is also necessary to consider overall budget constraints and ensure there are some swift means of limiting access to the app if required.

    Our results suggest there was some slight degree of reactivity—particularly among hazardous drinkers—to the app protocol. Though the effect was small, the hazard group decreased their intake significantly over the experimental period: 0.80 standard drinks in 21 days, which represented a 2% decrease in total standard drinks for this group. By contrast, nonhazard drinkers showed no significant reduction in consumption over the same period. This accords with evidence from other studies demonstrating some reduction in alcohol consumption only because of measurement among hazardous drinkers [28,29]. Even though participants received no feedback about their drinking during the assessment period, it is possible that those in the hazard group were motivated to modify their intake because the act of recording it made them more aware of their behavior. Equally, the knowledge that they were being monitored may have induced them to drink less. Considered a manifestation of the Hawthorne effect, social desirability is thought to underpin this type of assessment reactivity [58]. It is also possible that reductions in consumption were the result of satisficing; that is, participants may have responded “yes” to drinking less often over time to avoid having to submit further information via the app. Both hazard and nonhazard groups showed a significant reduction in the frequency of responding “yes” to drinking over the 21-day period. However, the rate of this reduction was very small: nonhazard participants decreased “yes” responding by 0.06 and hazard participants by 0.14 in 21 days. As such, this reduction might be a reflection of increased familiarity with the app over time, rather than satisficing; that is, participants may have summarized their drinking across a day into fewer submissions once they became more familiar with the app.

    There is some debate in the literature regarding reactivity to real-time measures. Several investigators postulate such assessment reduces the likelihood of reactivity related to social desirability as participants record data in the absence of the researcher [31]. Bates and Cox found participants were, for example, more likely to reveal lifetime alcohol consumption details when they completed surveys outside, as opposed to inside, the lab [59]. Other researchers speculate real-time methods are particularly susceptible to reactivity effects because assessments are completed in close proximity to the behavior, giving participants time to consider their actions [1], though it has also been suggested that repeated surveying may reduce reactivity via habituation [60,61]. Nonetheless, there is consensus that reactivity is generally an overlooked facet of real-time research and further investigation is required [21,31,62]. It is possible, for instance, that reactivity differs according to the population. Our finding that hazardous drinkers reacted to the app protocol to a greater extent than nonhazard drinkers would certainly support this supposition. Our data also suggest app-based alcohol-related intervention studies would benefit from the inclusion of a measurement-only control condition to disentangle the effects related to reactivity from those linked to the intervention.

    Limitations

    Several limitations to this study must be noted. Although representative of the population at large in terms of country of birth, first language, and usual place of residence, young female university students predominated in our sample. Although current research suggests men and women are equally likely to download and use health-orientated smartphone apps [63,64], women in Australia typically drink less than men and are consequently at decreased risk of alcohol-related harm [52]. Nonetheless, our hazard group reported drinking alcohol a third of the time during the experimental period and, on average, consumed in excess of 5 standard drinks per episode. According to Australian guidelines, this pattern of consumption places them at increased risk of both short-term alcohol-related injury and lifetime harm from alcohol [65]. Notwithstanding, future studies would be required to determine if similar rates of app compliance and reactivity are evident in a sample dominated by young men. Similarly, older individuals might respond in different ways to app-based protocols designed to assess alcohol consumption behavior. A recent survey found 59% of Australians over 65 years are willing to use or already utilize technology designed to track health [66]. In addition to research showing age has not been identified as a barrier to participation in mental health studies [67], this suggests older individuals might respond well to alcohol-related research apps. Moreover, as age-related illness and associated difficulties pertaining to condition severity, transportation, and inconvenience do inhibit participation in research [67], apps people access via marketplace vendors and download to their own smartphones may possibly boost participation in this age group. Future studies would nonetheless be required to fully consider app compliance and reactivity among older individuals. Finally, we did not examine if different assessment periods impact compliance and reactivity in diverse ways. A shorter experimental period might, for instance, diminish the effect of reactivity, though this may limit how effectively the app captures variability of intake. This is another potential area for further research.

    Conclusions

    In conclusion, we examined the feasibility of developing and employing an app—downloaded by participants to their own smartphones—designed to collect alcohol intake information for research purposes. We demonstrate how utilizing apps such as CNLab-A can yield a potentially large sample representative of the population. Both hazard and nonhazard participants appeared highly compliant when using app protocols. Although there was some evidence of reactivity in our study, especially among hazardous drinkers, effect sizes were small. Our findings suggest the CNLab-A app—or potentially 1 similar—is a methodologically sound means of examining alcohol consumption behavior across time. In future, such apps can be paired with those that chart cognition, affect, or social and environmental factors in real time to facilitate a more thorough investigation of the antecedents and consequences of drinking behavior.

    Acknowledgments

    The authors wish to thank Jiajie Li and Jemie Effendy who assisted with upgrades to the smartphone app as well as Cameron Patrick from the Melbourne Statistical Consulting Platform for advice in reviewing the analyses. This research was supported by an Australian National Health and Medical Research Council grant (1050766), and an Australian Research Council fellowship (FT110100088). The funding bodies had no role in the study design, collection, analysis or interpretation of data, writing the manuscript, or in the decision to submit the paper for publication.

    Conflicts of Interest

    None declared.

    1. Shiffman S. Ecological momentary assessment (EMA) in studies of substance use. Psychol Assess 2009 Dec;21(4):486-497 [FREE Full text] [CrossRef] [Medline]
    2. Trull TJ, Ebner-Priemer U. Ambulatory assessment. Annu Rev Clin Psychol 2013 Jan;9(2):151-176 [FREE Full text] [CrossRef] [Medline]
    3. Beckjord E, Shiffman S. Background for real-time monitoring and intervention related to alcohol use. Alcohol Res 2014;36(1):9-18 [FREE Full text] [Medline]
    4. van Griensven F, Naorat S, Kilmarx PH, Jeeyapant S, Manopaiboon C, Chaikummao S, et al. Palmtop-assisted self-interviewing for the collection of sensitive behavioral data: randomized trial with drug use urine testing. Am J Epidemiol 2006 Feb 1;163(3):271-278. [CrossRef] [Medline]
    5. Dufau S, Duñabeitia JA, Moret-Tatay C, McGonigal A, Peeters D, Alario F, et al. Smart phone, smart science: how the use of smartphones can revolutionize research in cognitive science. PLoS One 2011 Sep;6(9):e24974 [FREE Full text] [CrossRef] [Medline]
    6. Bernhardt JM, Usdan S, Mays D, Martin R, Cremeens J, Arriola KJ. Alcohol assessment among college students using wireless mobile technology. J Stud Alcohol Drugs 2009 Sep;70(5):771-775. [CrossRef] [Medline]
    7. Kashdan TB, Ferssizidis P, Collins RL, Muraven M. Emotion differentiation as resilience against excessive alcohol use: an ecological momentary assessment in underage social drinkers. Psychol Sci 2010 Sep;21(9):1341-1347. [CrossRef] [Medline]
    8. Collins RL, Kashdan TB, Gollnisch G. The feasibility of using cellular phones to collect ecological momentary assessment data: application to alcohol consumption. Exp Clin Psychopharmacol 2003 Feb;11(1):73-78. [CrossRef] [Medline]
    9. Searles JS, Helzer JE, Rose GL, Badger GJ. Concurrent and retrospective reports of alcohol consumption across 30, 90 and 366 days: interactive voice response compared with the timeline follow back. J Stud Alcohol 2002 May;63(3):352-362. [CrossRef] [Medline]
    10. Labhart F, Graham K, Wells S, Kuntsche E. Drinking before going to licensed premises: an event-level analysis of predrinking, alcohol consumption, and adverse outcomes. Alcohol Clin Exp Res 2013 Feb;37(2):284-291. [CrossRef] [Medline]
    11. Rowe C, Hern J, DeMartini A, Jennings D, Sommers M, Walker J, et al. Concordance of text message ecological momentary assessment and retrospective survey data among substance-using men who have sex with men: a secondary analysis of a randomized controlled trial. JMIR Mhealth Uhealth 2016 May 26;4(2):e44 [FREE Full text] [CrossRef] [Medline]
    12. Ramirez J, Miranda R. Alcohol craving in adolescents: bridging the laboratory and natural environment. Psychopharmacology 2014 Apr;231(8):1841-1851 [FREE Full text] [CrossRef] [Medline]
    13. Tiplady B, Oshinowo B, Thomson J, Drummond GB. Alcohol and cognitive function: assessment in everyday life and laboratory settings using mobile phones. Alcohol Clin Exp Res 2009 Dec;33(12):2094-2102. [CrossRef] [Medline]
    14. Kauer SD, Reid SC, Sanci L, Patton GC. Investigating the utility of mobile phones for collecting data about adolescent alcohol use and related mood, stress and coping behaviours: lessons and recommendations. Drug Alcohol Rev 2009 Jan;28(1):25-30. [CrossRef] [Medline]
    15. Broderick JE. Electronic diaries: appraisal and current status. Pharm Med 2008;22(2):69-74. [CrossRef] [Medline]
    16. Kuntsche E, Labhart F. Using personal cell phones for ecological momentary assessment: an overview of current developments. Eur Psychol 2013 Jan;18(1):3-11. [CrossRef]
    17. Reid SC, Kauer SD, Dudgeon P, Sanci LA, Shrier LA, Patton GC. A mobile phone program to track young people's experiences of mood, stress and coping: development and testing of the mobiletype program. Soc Psychiatry Psychiatr Epidemiol 2009 Jun;44(6):501-507. [CrossRef] [Medline]
    18. Walsh EI, Brinker JK. Should participants be given a mobile phone, or use their own? Effects of novelty vs utility. Telematics and Informatics 2016 Feb;33(1):25-33. [CrossRef]
    19. Kuntsche E, Labhart F. ICAT: development of an internet-based data collection method for ecological momentary assessment using personal cell phones. Eur J Psychol Assess 2013 May;29(2):140-148 [FREE Full text] [CrossRef] [Medline]
    20. Ravert RD, Calix SI, Sullivan MJ. Research in brief: using mobile phones to collect daily experience data from college undergraduates. J Coll Stud Dev 2010;51(3):343-352. [CrossRef]
    21. Runyan JD, Steenbergh TA, Bainbridge C, Daugherty DA, Oke L, Fry BN. A smartphone ecological momentary assessment/intervention "app" for collecting real-time data and promoting self-awareness. PLoS One 2013;8(8):e71325 [FREE Full text] [CrossRef] [Medline]
    22. Poushter J. Pew Research Center. Smartphone ownership and internet usage continues to climb in emerging economies but advanced economies still have higher rates of technology use   URL: http:/​/www.​pewglobal.org/​2016/​02/​22/​smartphone-ownership-and-internet-usage-continues-to-climb-in-emerging-economies/​ [accessed 2018-11-16] [WebCite Cache]
    23. Poushter J. Pew Research Center. Smartphones are common in advanced economies, but digital divides remain   URL: http:/​/www.​pewresearch.org/​fact-tank/​2017/​04/​21/​smartphones-are-common-in-advanced-economies-but-digital-divides-remain/​ [accessed 2018-05-24] [WebCite Cache]
    24. Smith A, de Salas K, Lewis I, Schüz B. Developing smartphone apps for behavioural studies: the AlcoRisk app case study. J Biomed Inform 2017 Dec;72:108-119. [CrossRef] [Medline]
    25. Dulin PL, Alvarado CE, Fitterling JM, Gonzalez VM. Comparisons of alcohol consumption by time-line follow back vs smartphone-based daily interviews. Addict Res Theory 2017 Nov;25(3):195-200 [FREE Full text] [CrossRef] [Medline]
    26. Monk RL, Heim D, Qureshi A, Price A. "I have no clue what I drunk last night" using smartphone technology to compare in-vivo and retrospective self-reports of alcohol consumption. PLoS One 2015;10(5):e0126209 [FREE Full text] [CrossRef] [Medline]
    27. Poulton A, Pan J, Bruns LR, Sinnott RO, Hester R. Assessment of alcohol intake: retrospective measures versus a smartphone application. Addictive Behaviors 2018;83:35-41. [CrossRef] [Medline]
    28. Carey KB, Carey MP, Maisto SA, Henson JM. Brief motivational interventions for heavy college drinkers: a randomized controlled trial. J Consult Clin Psychol 2006 Oct;74(5):943-954 [FREE Full text] [CrossRef] [Medline]
    29. McCambridge J, Day M. Randomized controlled trial of the effects of completing the Alcohol Use Disorders Identification Test questionnaire on self-reported hazardous drinking. Addiction 2008;103:241-248. [CrossRef] [Medline]
    30. Walters ST, Vader AM, Harris TR, Jouriles EN. Reactivity to alcohol assessment measures: an experimental test. Addiction 2009 Aug;104(8):1305-1310 [FREE Full text] [CrossRef] [Medline]
    31. Barta W, Tennen H, Litt M. Measurement reactivity in diary research. In: Mehl MR, Conner TS, editors. Handbook of Research Methods for Studying Daily Life. New York: The Guilford Press; 2011:108-123.
    32. Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008;4:1-32. [CrossRef] [Medline]
    33. Hufford MR, Shields AL, Shiffman S, Paty J, Balabanis M. Reactivity to ecological momentary assessment: an example using undergraduate problem drinkers. Psychol Addict Behav 2002 Sep;16(3):205-211. [CrossRef] [Medline]
    34. Moniruzzaman A, Hossain S. Comparative study on agile software development methodologies. Global Journal of Computer Science and Technology. arxiv 2013;13:3356 [FREE Full text]
    35. International Alliance for Responsible Drinking. Drinking guidelines: General population   URL: http://www.iard.org/policy-tables/drinking-guidelines-general-population/ [accessed 2018-05-25] [WebCite Cache]
    36. Courtney KE, Polich J. Binge drinking in young adults: data, definitions, and determinants. Psychol Bull 2009 Jan;135(1):142-156 [FREE Full text] [CrossRef] [Medline]
    37. Sobell L, Sobel M. Timeline Follow-Back: a technique for assessing self-reported alcohol consumption. In: Litten RZ, Allen JP, editors. Measuring Alcohol Consumption: Psychosocial and Biochemical Methods. Totowa, NJ: Humana Press; 1992:41-72.
    38. Townshend JM, Duka T. Patterns of alcohol drinking in a population of young social drinkers: a comparison of questionnaire and diary measures. Alcohol Alcohol 2002;37(2):187-192. [CrossRef] [Medline]
    39. Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption-II. Addiction 1993 Jun;88(6):791-804. [CrossRef] [Medline]
    40. Capon H, Hall W, Fry C, Carter A. Realising the technological promise of smartphones in addiction research and treatment: an ethical review. Int J Drug Policy 2016 Oct;36:47-57. [CrossRef] [Medline]
    41. Carter A, Liddle J, Hall W, Chenery H. Mobile phones in research and treatment: ethical guidelines and future directions. JMIR Mhealth Uhealth 2015 Oct 16;3(4):e95 [FREE Full text] [CrossRef] [Medline]
    42. Australian Government: Department of Health. Standard drinks guide   URL: http://www.alcohol.gov.au/internet/alcohol/publishing.nsf/content/drinksguide-cnt [accessed 2018-11-16] [WebCite Cache]
    43. National Measurement Institute. Guide to the sale of alcohol   URL: http://measurement.gov.au/Industry/Business/Pages/Alcohol.aspx [accessed 2018-11-16] [WebCite Cache]
    44. Poulton A. YouTube. 2015. CNLab-A Instructions   URL: https://youtu.be/WNqr-otRsTM [accessed 2018-11-16] [WebCite Cache]
    45. Babor TF, Higgins-Biddle JC, Saunders JB, Monteiro MG. The Alcohol Use Disorders Identification Test: Guidelines for Use in Primary Care. Geneva: World Health Organisation; 2001.
    46. Rumpf HJ, Wohlert T, Freyer-Adam J, Grothues J, Bischof G. Screening questionnaires for problem drinking in adolescents: performance of AUDIT, AUDIT-C, CRAFFT and POSIT. Eur Addict Res 2013;19(3):121-127. [CrossRef] [Medline]
    47. de Meneses-Gaya C, Zuardi AW, Loureiro SR, Crippa JA. Alcohol Use Disorders Identification Test (AUDIT): an updated systematic review of psychometric properties. Psychol Neurosci 2009 Jan;2(1):83-97. [CrossRef]
    48. Demartini KS, Carey KB. Optimizing the use of the AUDIT for alcohol screening in college students. Psychol Assess 2012 Dec;24(4):954-963 [FREE Full text] [CrossRef] [Medline]
    49. Cohen J. Quantitative methods in psychology: a power primer. Psychological Bulletin 1992;112(1):155-159. [CrossRef]
    50. Singer JD, Willet JB. Doing data analysis with the multilevel model for change. In: Applied Longitudinal Data Analysis: Modelling Change and Event Occurances. New York: Oxford University Press; 2003:75-137.
    51. Bolger N, Laurenceau JP. Intensive Longitudinal Methods: An Introduction to Diary and Experience Sampling Research. New York: The Guilford Press; 2013.
    52. Australian Institute of Health and Welfare. Canberra: AIHW; 2017. National Drug Strategy Household Survey 2016: detailed findings. Drug Statistics series no. 31. Cat. no. PHE 214   URL: https://www.aihw.gov.au/getmedia/15db8c15-7062-4cde-bfa4-3c2079f30af3/21028a.pdf.aspx?inline=true [accessed 2019-01-31] [WebCite Cache]
    53. Australian Bureau of Statistics. 2071.0 Census of Population and Housing: Reflecting Australia - Stories from the Census, 2016   URL: http://www.abs.gov.au/ausstats/abs@.nsf/Lookup/2071.0main+features22016 [accessed 2018-05-25] [WebCite Cache]
    54. United Nations: Population Division. World Urbanization Prospects 2018   URL: https://esa.un.org/unpd/wup/ [accessed 2018-05-28] [WebCite Cache]
    55. University of Melbourne. 2017. Support Indigenous Students   URL: https://murrupbarak.unimelb.edu.au/support-indigenous-students [accessed 2018-05-28] [WebCite Cache]
    56. Kuntsche E, Robert B. Short Message Service (SMS) technology in alcohol research: a feasibility study. Alcohol Alcohol 2009;44:423-428. [CrossRef] [Medline]
    57. Serre F, Fatseas M, Debrabant R, Alexandre JM, Auriacombe M, Swendsen J. Ecological momentary assessment in alcohol, tobacco, cannabis and opiate dependence: a comparison of feasibility and validity. Drug Alcohol Depend 2012 Nov 1;126(1-2):118-123. [CrossRef] [Medline]
    58. McCambridge J, Witton J, Elbourne DR. Systematic review of the Hawthorne effect: new concepts are needed to study research participation effects. J Clin Epidemiol 2014 Mar;67(3):267-277 [FREE Full text] [CrossRef] [Medline]
    59. Bates SC, Cox JM. The impact of computer versus paper-pencil survey, and individual versus group administration, on self-reports of sensitive behaviors. Comput Human Behav 2008;24:903-916. [CrossRef]
    60. Iida M, Shrout PE, Laurenceau JP, Bolger N. Using diary methods in psychological research. In: Cooper HM, Camic PM, Long DL, Panter AT, Rindskopf D, Sher KJ, editors. APA Handbook of Research Methods in Psychology: Vol. 1. Foundations, Planning, Measures, and Psychometrics. Washington, DC: American Psychological Association; 2012:277-305.
    61. Bolger N, Davis A, Rafaeli E. Diary methods: capturing life as it is lived. Annu Rev Psychol 2003;54:579-616. [CrossRef] [Medline]
    62. Moos R. Context and mechanisms of reactivity to assessment and treatment. Addiction 2008;103:249-250. [CrossRef]
    63. Krebs P, Duncan DT. Health app use among US mobile phone owners: a national survey. JMIR Mhealth Uhealth 2015 Nov;3(4):e101 [FREE Full text] [CrossRef] [Medline]
    64. Ernsting C, Dombrowski SU, Oedekoven M, O'Sullivan JL, Kanzler M, Kuhlmey A, et al. Using smartphones and health apps to change and manage health behaviors: a population-based survey. J Med Internet Res 2017 Apr 5;19(4):e101 [FREE Full text] [CrossRef] [Medline]
    65. National Health and Medical Research Council. Australian guidelines to reduce health risks from drinking alcohol   URL: https:/​/nhmrc.​gov.au/​about-us/​publications/​australian-guidelines-reduce-health-risks-drinking-alcohol [accessed 2018-11-16] [WebCite Cache]
    66. Manovel I, Sather T. Accenture. 2017. Silver surf's up: senior citizens are riding the digital health wave   URL: https:/​/www.​accenture.com/​t00010101T000000__w__/​au-en/​_acnmedia/​PDF-47/​Accenture-Health-Silver-Surfers-in-Australia.​pdf [accessed 2018-11-16] [WebCite Cache]
    67. Woodall A, Morgan C, Sloan C, Howard L. Barriers to participation in mental health research: are there specific gender, ethnicity and age related barriers? BMC Psychiatry 2010 Dec 2;10:103 [FREE Full text] [CrossRef] [Medline]

    ‎
    AUDIT: Alcohol Use Disorders Identification Test
    BAC: blood alcohol content
    SMS: short message service
    Sn: sensitivity
    Sp: specificity

    Edited by G Eysenbach; submitted 02.06.18; peer-reviewed by J Smith, S Bhatlekar, S Bright, M Savic; comments to author 19.07.18; revised version received 15.11.18; accepted 22.11.18; published 25.03.19

    Copyright

    ©Antoinette Poulton, Jason Pan, Loren Richard Bruns Jr, Richard O Sinnott, Robert Hester. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 25.03.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.