This paper is in the following e-collection/theme issue:

Quality Evaluation and Descriptive Analysis/Reviews of Multiple Existing Mobile Apps (377) Alcohol Abuse, Alcoholism Prevention and Recovery (303) mHealth for Wellness, Behavior Change and Prevention (2922) mHealth in the Developing World/LMICs, Underserved Communities, and for Global Health (578) Usability of Apps and User Perceptions of mHealth (993) Substance Abuse (428)

Published on in Vol 10, No 1 (2022): January

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/31058, first published .
Russian-Language Mobile Apps for Reducing Alcohol Use: Systematic Search and Evaluation

Russian-Language Mobile Apps for Reducing Alcohol Use: Systematic Search and Evaluation

Russian-Language Mobile Apps for Reducing Alcohol Use: Systematic Search and Evaluation

Authors of this article:

Anna Bunova1 Author Orcid Image ;   Veronika Wiemker2 Author Orcid Image ;   Boris Gornyi1 Author Orcid Image ;   Carina Ferreira-Borges3 Author Orcid Image ;   Maria Neufeld3, 4, 5 Author Orcid Image
Article Authors Cited by (5) Tweetations (3) Metrics

    Original Paper

    1National Research Center for Therapy and Preventive Medicine of the Ministry of Health of the Russian Federation, Moscow, Russian Federation

    2Heidelberg Institute of Global Health, Medical Faculty and University Hospital, Heidelberg University, Heidelberg, Germany

    3WHO European Office for the Prevention and Control of Noncommunicable Diseases, Moscow, Russian Federation

    4Institute for Mental Health Policy Research, Centre for Addiction and Mental Health, Toronto, ON, Canada

    5Institute of Clinical Psychology and Psychotherapy, Dresden University of Technology, Dresden, Germany

    Corresponding Author:

    Anna Bunova

    National Research Center for Therapy and Preventive Medicine of the Ministry of Health of the Russian Federation

    Petroverigskiy Pereulok 10

    Moscow, 101990

    Russian Federation

    Phone: 7 9151416154

    Email: asbunova@gmail.com


    Background: Personalized prevention tools such as mobile apps designed to reduce alcohol consumption are widespread in mobile app stores accessible in Russia. However, the quality and content of these mobile apps have not been systematically evaluated.

    Objective: This study aimed to identify Russian-language mobile apps for reducing alcohol use and to evaluate their quality and potential to change alcohol-related health behavior. It further aimed to identify apps that could facilitate screening and brief interventions in primary health care in Russia.

    Methods: A systematic search for mobile apps available in Russia was carried out between April 1 and 15, 2020, December 1 and 15, 2020, and in March 2021 in the iPhone App Store, Google Play Store, and the 4PDA forum. App quality was assessed using the Mobile App Rating Scale (MARS), and structured searches in electronic libraries and bibliographic databases were used to evaluate the apps’ evidence base. The number of features facilitating changes in lifestyle behavior was assessed using the App Behavior Change Scale (ABACUS).

    Results: We identified 63 mobile apps for reducing alcohol use. The mean MARS quality ratings were high for the subscales of functionality (3.92 out of 5, SD 0.58) and aesthetics (2.96, SD 0.76) and low for engagement (2.42, SD 0.76) and information (1.65, SD 0.60). Additional searches in electronic libraries and bibliographic databases (eLibrary, CyberLeninka, Google Scholar) yielded no studies involving the identified apps. ABACUS scores ranged from 1 to 15 out of 25, with a mean of 5 (SD 3.24). Two of the identified apps might be useful for screening and brief interventions in Russian primary health care after improvements in content and scientific testing.

    Conclusions: Russian-language mobile apps for reducing alcohol use are accessible in the app stores. Many of them are aesthetically pleasing, functional, and easy to use. However, information about their scientific trialing or testing is lacking. Most apps contain a low number of features that facilitate changes in lifestyle behavior. Further research should examine the context of Russian-language mobile apps for reducing alcohol use. Our findings underline the need to develop evidence-based apps to mitigate alcohol consumption in Russia and elsewhere.

    Trial Registration: PROSPERO International Prospective Register of Systematic Reviews CRD42020167458; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=167458

    JMIR Mhealth Uhealth 2022;10(1):e31058

    doi:10.2196/31058

    Keywords

    alcohol; mHealth; mobile applications; screening and brief intervention; Mobile Application Rating Scale; App Behavior Change Scale; mobile phone 


    Background

    Alcohol is one of the leading risk factors contributing to the global burden of disease and mortality [1-3]. The World Health Organization (WHO) estimates that globally, about 3 million deaths are caused by alcohol use each year, almost 1 million of which occur in the WHO European Region as the region with the highest level of per capita alcohol consumption. Drinking alcohol contributes to the development of more than 200 diseases and injuries. It increases the risk of cardiovascular and digestive diseases, neoplasms, mental and behavioral disorders (not limited to alcohol use disorders) as well as violent crimes, suicides, and road traffic accidents [4,5]. The impact of alcohol on mortality in Russia has been well documented, and Russia remains one of the countries with the largest alcohol-attributable burden of diseases worldwide, although substantial improvements were made over the last decade [6-9]. The WHO has recently launched the SAFER initiative to reduce alcohol-related harm, which recommends that health services should provide prevention and treatment interventions to individuals and families at risk of or affected by alcohol use disorders and associated conditions [10]. One of the 5 high-impact interventions of SAFER is the screening and brief intervention (SBI) programs in primary health care (PHC) [10,11].

    There is a large body of research supporting the effectiveness of SBI in reducing alcohol consumption and other alcohol-related outcomes [12-15]. Attempts to introduce SBI in the Russian PHC for patients at risk for harmful alcohol use began in 2013 when legislative changes allowed the establishment of SBI as a part of Russia’s dispanserization program within PHC facilities [16]. Dispanserization is a set of standardized measures in PHC that includes preventive medical examination for assessing the state of health and is carried out in relation to certain groups of the population in accordance with the legislation of the Russian Federation. Following the currently established provisions, dispanserization includes an evidence-based 2-step screening procedure aiming to provide early and timely detection of conditions and diseases as well as risk factors for their development, including the nonmedical use of drugs and psychotropic substances [17]. The introduced SBI as within the broader dispanserization framework consists of 2 steps [17]. In the first step, the self-administered 3-item version of the Alcohol Use Disorders Identification Test-Consumption (AUDIT-C) is used to detect patients at risk [17,18]. If the screening result is positive, that is, the score exceeds the sex-specific cut-off, the patient is asked to complete the full 10-item version of the Alcohol Use Disorders Identification Test (AUDIT) as part of an interview with a health care professional. The health care professional then provides a brief intervention depending on the results [17,19]. Despite the effectiveness of SBI, there are several barriers to their widespread implementation in PHC settings in Russia beyond the dispanserization framework [20-22]. The AUDIT is based on the concept of a standard drink, which was introduced in several countries worldwide as a measure of alcohol consumption and to provide information about alcohol consumption to consumers, which was also as part of communicating the number of standard drinks on labels of alcoholic beverages [19]. In practice, using the standard drink concept remains a challenge for PHC professionals. PHC professionals report that the concept is not understandable for patients and difficult to calculate with, especially for patients that engage in heavy episodic drinking [23,24]. Moreover, delivering a brief intervention requires specific skills and knowledge as well as additional time and resources from the PHC professionals [20,21].

    The development of electronic systems to deliver or support SBIs can potentially address some of these challenges and support health care workers. For instance, electronic devices such as smartphones and tablets can be used instead of the traditional paper-and-pencil screening tests and facilitate counting standard drinks as part of the risk assessment and support the delivery of brief interventions. Moreover, electronic SBIs are also potentially more flexible and can be adapted to take into account the regional patterns of alcohol consumption and make the assessment more personalized. They can also potentially reach larger audiences beyond the health sector [25,26].

    The growing popularity of mobile phones and the active development of mobile internet in all regions of Russia open up great opportunities for using mobile apps as tools to change individual health behavior [27]. Mobile apps can provide an additional resource for preventive interventions catering to at-risk populations. However, to be successful, such interventions require the health care professional to select effective, evidence-based, and field-proven mobile apps [28]. A study by Abroms and colleagues [29] showed that making such a choice is difficult since many mobile apps contain inaccuracies and low-quality information, are not tested in practice, or lack an evidence base. Abroms et al [29] point out the potential dangers of such apps, ranging from misinformation to misleading risk level estimates. A rigid evaluation of apps for reducing alcohol use is therefore of great interest to both alcohol consumers and health care professionals. While former studies have described the features of highly rated Russian-language apps for reducing alcohol use, they did not evaluate the app quality and the potential to change alcohol-related health behavior by using validated instruments [30,31]. By closing this gap and providing researchers and health care professionals with an overview of the currently available evidence-based apps for reducing alcohol use, this study may contribute to facilitating the provision of SBI programs in the Russian PHC.

    Objective

    The aim of this study was to conduct a systematic search and evaluation of Russian-language mobile apps for reducing alcohol use. The specific objectives were to (1) create an overview and establish a list of relevant apps available in Russia, (2) assess their overall quality and evidence base, and (3) evaluate if any of the available apps could be used to support the provision of AUDIT-based SBI in Russia and its broader implementation in PHC facilities.


    Study Design

    The study was performed in 2 steps. In step 1, we conducted a systematic app store search to identify the apps for reducing alcohol use, following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) [32]. In step 2, we evaluated the identified apps by using the Mobile App Rating Scale (MARS) [33] and the App Behavior Change Scale (ABACUS) [34]. For specific steps of the rating procedure, please see below. The study protocol was published in PROSPERO (Prospective Register of Systematic Reviews) [35] under registration CRD42020167458 (review ongoing).

    Step 1: Systematic App Store Searches

    Eligibility Criteria

    We defined mobile apps for reducing alcohol use as tools for tablets or smartphones that facilitate behavioral change related to alcohol use. We excluded apps that were clearly not aimed at the reduction of alcohol use, such as games, barcode scanners as part of the Unified State Automated Information System (EGAIS) tracking alcohol distribution and sales under the Russian Federal Service for Alcohol Market Regulation [36], recipes for alcoholic drinks, and wallpapers. Only currently available and working Russian-language apps with at least a basic or trial version free of charge were included.

    Search Strategy

    Six systematic searches in the iPhone App Store, Google Play Store, and a Russian internet forum of mobile apps, that is, 4PDA [37] were conducted between April 1 and 15, 2020, December 1 and 15, 2020, and in March 2021. Two native Russian speakers conducted these 6 independent searches on different dates to account for additional mobile apps that were created during the COVID-19 pandemic. Keywords included the Russian words for “alcohol,” “alcoholic drinks,” “spirits,” “beer,” “vodka,” “drink alcohol,” “alcohol calculator,” “alcohol tracker,” “sober,” “alcohol monitoring,” and “breathalyzer” (details in PROSPERO protocol [35] and Multimedia Appendix 1) and were entered through the general search bar of the app stores and the forum.

    Screening and Selection of Apps

    In the first step, we recorded the name, app icon, developer, store, platform, brief description, and URL of all the available alcohol-related mobile apps. Next, duplicates were removed, and app store descriptions were screened against inclusion criteria. We retained only 1 record if identical versions of an app were available for Android and iPhone operating systems (iOSs). All remaining apps were downloaded onto the study devices (Samsung Galaxy Tab A 7.0 SM-T285 8GB/Android version 9, Lenovo Tablet TB-X704L 64G/Android version 7, and iPhone 11/iOS version 14.0.1). Apps that could not be opened on these devices were excluded.

    Data Extraction

    The following information was extracted for all the included apps: app name, the app’s star rating on the platform, number of installations, developer, current version, number of ratings for current version, last update, existence of a basic version and paid premium versions, and platform. All included apps were available and all data were updated in the last week of March 2021.

    Step 2: Evaluation of Mobile Apps

    Measures/Rating Tools

    We used 2 scales to rate the identified mobile apps. The MARS scale, assessing the quality of the mobile apps, contains 23 items across 5 subscales: engagement, functionality, aesthetics, information, and subjective quality [33]. Each item is rated on a 5-point scale from 1 (lowest quality) to 5 (highest quality). The overall app quality is assessed by calculating the mean scores of the first 4 subscales and the total mean score. The subjective quality score describes the raters’ personal liking of the app and should be reported separately if assessed. Subjective quality was not assessed in this study. The ABACUS scale, evaluating the apps’ potential to facilitate behavior change, contains 21 items across 4 subscales: knowledge and information, goals and planning, feedback and monitoring, and actions [34]. The total score is obtained by counting the number of items answered affirmatively. The MARS and the ABACUS showed good internal consistency and interrater reliability (MARS, α=.92; intraclass correlation coefficient [ICC]=0.85 and ABACUS, α=.93; ICC=0.92) [33,34].

    A full evaluation of all the included apps was carried out by a first rater. A second rater independently evaluated a random sample of 30% (19/63) of the apps. Both raters were prepared for their task by completing a MARS video training tutorial [38]. To rate an app’s evidence base, as measured in MARS item 19, raters searched for randomized studies in the electronic libraries and bibliographic databases eLibrary, CyberLeninka, and Google Scholar by using the app’s name as a keyword as suggested by the MARS authors [38].

    If the mobile app requested the input of demographic characteristics or consumption data, the following data were used: female gender, 30 years of age, body weight of 60 kg, height of 170 cm, and alcohol consumption on the last occasion as 200 ml of 40% vodka. If required, the maximum legal blood alcohol content was set to 0.3 ppm.

    Classification of Apps and Criteria for Potential Use in SBI Programs

    The identified apps were classified according to their main features. For this purpose, the following data were extracted: the app’s ability to estimate blood alcohol concentration and sobering time, its ability to record personal alcohol consumption, the presence of SBI elements, the presence of a “sobriety counter” to count the time since the last drinking occasion, and the app’s ability to support the reduction of alcohol use in a structured way. To investigate the potential of the available apps for supporting the provision of SBI in Russia, app descriptions and main features were reviewed against 2 criteria: (1) availability of AUDIT (2) whether the app provided any type of brief intervention.

    Data Analysis

    Statistical analysis and data visualization were carried out in Excel (Microsoft Excel for Office 365) and SPSS Statistics 20 (IBM Corp). Measures of interrater reliability were obtained by calculating the ICCs for all MARS and ABACUS subscales [39], using a 2-way mixed effects and average measures model with absolute agreement [40]. Descriptive analysis included total sample size, percentage, median, mean, and standard deviation.


    Systematic App Store Searches

    A total of 620 alcohol-related apps were identified through keyword searches in the iOS App Store, Google Play Store, and 4PDA (Figure 1). After removing duplicates, 310 apps were screened against inclusion criteria, leaving 65 apps for reducing alcohol use for further download and evaluation. Among the downloaded apps, 2 had to be excluded as they did not work properly or required connection to a breathalyzer. Finally, 63 apps were included for evaluation, 51 of which were available only in the Google Play Store and 5 only in the iOS App Store. Only 7 apps were available in both stores (Multimedia Appendix 2).

    ‎
    Figure 1. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow chart of app selection.
    View this figure

    Overview of the Included Apps for Reducing Alcohol Use

    The included apps were grouped into 6 categories according to their main feature: apps estimating blood alcohol concentration and sobering time (n=29), apps recording personal alcohol consumption (n=15), apps for SBIs (n=2), apps counting the time since the last drinking occasion (sobriety counters, n=8), apps with structured support to reduce alcohol use (n=4), and other apps for reducing alcohol use (n=5). Most apps were designed for Android systems (n=51); a minority were available for iOS (n=5) or both operation systems (n=7). A total of 19 apps were created by commercial organizations; 1 app was developed by a science center [41]. In 43 cases, no further information on the developer’s legal status could be obtained. Most of the apps (53/63, 84%) had last been updated between 2016 and 2021. A minority (n=16) offered a paid upgrade version featuring the removal of advertisements and the use of additional features. According to Google Play statistics, the median number of installations was 10,000. No comparable information was provided in the iOS App Store and 4PDA. The median star rating of all apps in Google Play and iOS App Store was 3.9, based on a median of 81 ratings. Apps with structured support to reduce alcohol consumption were downloaded most often, with a median of 300,000 installations. The median star rating of the apps in this category was 4.8, based on a median of 4418 ratings.

    Apps Estimating Blood Alcohol Concentration and Sobering Time

    The main feature of this group of apps (n=29) was the estimation of the maximum blood alcohol concentration and sobering time. Most apps (n=14) were based on Widmark’s equation [42], 2 apps used Watson’s equation [43], and 13 apps provided no information about the method of calculation. Seven apps only allowed to calculate the maximum blood alcohol concentration (n=4) or sobering time (n=3). The other 22 apps provided a combination of both mentioned features (n=16) or offered additional features such as the estimation of “no-driving” time after drinking (n=10), the estimation of the maximum alcohol consumption to sober up by a certain time (n=2), a drinking diary (n=2), or the option to unlock achievements for reducing alcohol consumption (n=1).

    Apps Recording Personal Alcohol Consumption

    Apps in this group (n=15) provided detailed drinking diaries (n=4), consumption calendars allowing users to indicate on what days they drunk alcohol (n=9), or both functions combined (n=2), featuring statistics of consumption per day, week, month, year. In some apps (n=4), users could calculate costs related to their alcohol use and see how much money they saved by cutting down their consumption.

    Apps for SBIs

    We found only 2 Russian-language apps fulfilling our criteria to potentially facilitate SBI. Both apps allowed users to complete the AUDIT. The first app provided detailed instructions for brief interventions aimed at health care professionals and a standard drink calculator allowing users to choose consumed alcoholic drinks and calculate the number of standard drinks consumed. The second app provided information on the individual level of risk and alcohol-related harm according to AUDIT results.

    Apps Counting the Time Since the Last Drinking Occasion (Sobriety Counters)

    We identified 8 apps in this group. Two of them consisted of a simple timer, counting the time since the last drinking occasion. The other 6 apps included additional motivation components such as a progress bar and achievements to be obtained (n=4) or inspiring citations (n=2). Two apps featured a chat where users could share their experiences. One app allowed users to consult with a medical specialist and to observe positive changes connected to alcohol abstinence in the physical appearance of the visualized avatars.

    Apps With Structured Support to Reduce Alcohol Use

    A total of 4 apps featured structured support to help users quit drinking or to reduce their alcohol consumption. Most of these apps provided a plan with daily tasks (n=3), a sobriety counter (n=4), a drinking diary (n=2), and motivation components. Motivation components included a progress bar and achievements to be obtained (n=3), inspiring articles or citations (n=4), daily notifications (n=4), encouraging pictures or videos (n=2), and a visualization of the positive health consequences of alcohol abstinence (n=2). One app had a community chat where users shared their experience of reducing consumption or quitting alcohol. One app provided a blood alcohol concentration calculator. Three apps allowed users to complete the AUDIT (n=2) or the Michigan Alcohol Screening Test (n=1) [44].

    Other Apps for Reducing Alcohol Use

    Five apps could not be assigned to any of the aforementioned categories. These included an app for audio hypnosis, an app allowing to record withdrawal symptoms, an app featuring notifications about alcohol-related harm, an app allowing to estimate the dose of consumption needed to relax, to get drunk or to have fun, and an app for counting unplanned alcohol drinking occasions after quitting drinking.

    Behavior Change Techniques Featured in the Apps

    The number of behavior change features provided by each app as reflected in ABACUS scores (Multimedia Appendix 2) ranged from 1 to 15 out of 21, with a mean of 5 points (SD 3.24). A great majority (54/63, 86%) of the apps requested individual baseline information and 71% (45/63) of the apps provided (individualized) user feedback. Many apps allowed the user to self-monitor their behavior (36/63, 57%) and customize or personalize certain app features (32/63, 51%). Table 1 shows the frequencies of the 21 behavioral change features evaluated in the apps. All ABACUS scores showed high interrater reliability (2-way mixed ICC=0.96; 95% CI 0.90-0.98).

    The largest number of behavior change techniques was found in the categories of apps with structured support to reduce alcohol use and apps counting the time since the last drinking occasion (sobriety counters). Out of the 12 apps in these 2 groups, 9 apps featured more than 7 behavior change techniques. Apps estimating blood alcohol concentration and sobering time provided the lowest number of behavior change techniques, with an average ABACUS score of 2.38 (SD 1.37).

    Table 1. Behavioral change features in the apps for reducing alcohol use (N=63).
    Behavioral change featureApps providing the feature, n (%)
    Knowledge and information

    		Ability to customize and personalize features32 (51)

    		Consistency with national guidelines or created with expertise3 (5)

    		Request for baseline information54 (86)

    		Instruction on how to perform the behavior6 (10)

    		Information about the consequences of continuing or discontinuing behavior22 (35)
    Goals and planning

    		Request for willingness for behavior change6 (10)

    		Setting of goals7 (11)

    		Ability to review goals, update, and change when necessary6 (10)
    Feedback and monitoring

    		Ability to quickly and easily understand the difference between current action and future goals9 (14)

    		Ability to allow the user to easily self-monitor behavior36 (57)

    		Ability to share behaviors with others or allow for social comparison12 (19)

    		Ability to give the user feedback—either from a person or automatically45 (71)

    		Ability to export data from app4 (6)

    		Material or social reward or incentive7 (11)

    		General encouragement12 (19)
    Actions

    		Reminders or prompts or cues for activity13 (21)

    		App encourages positive habit formation7 (11)

    		App allows or encourages for practice or rehearsal in addition to daily activities1 (2)

    		Opportunity to plan for barriers4 (6)

    		Assistance with or suggest restructuring the physical or social environment1 (2)

    		Assistance with distraction or avoidance3 (5)

    App Quality

    Multimedia Appendix 2 shows the subscale and overall MARS scores of all evaluated apps for reducing alcohol use. Interrater reliability was high (2-way mixed ICC=0.96; 95% CI 0.91-0.98). The average overall MARS score of all reviewed apps was 2.74 (SD 0.52). MARS item 19 “evidence base” reached the lowest mean score (0.00)—no information about scientific trialing or testing of the identified app could be obtained. Other low mean scores included quantity of information (0.75, SD 1.24), quality of information (0.94, SD 1.47), credibility (1.17, SD 0.58), visual information (1.40, SD 1.75), interest (1.97, SD 0.97), and entertainment (1.89, SD 0.99). The highest scores were obtained for gestural design (4.05, SD 0.63), ease of use (3.98, SD 0.66), accuracy of app description (3.94, SD 0.56), and target group (3.89, SD 0.84). The average score of all MARS items is shown in Figure 2. A total of 30% (19/63) of the evaluated apps reached an overall MARS score of ≥3.0. The categories of apps with strong support to reduce alcohol use and apps for SBIs reached the highest overall scores (3.74 [SD 0.18] and 3.42 [SD 0.32], respectively).

    ‎
    Figure 2. Average score of each Mobile App Rating Scale item in Russian-language apps for reducing alcohol use (N=63). MARS: Mobile App Rating Scale.
    View this figure

    App Potential for SBI in the Russian PHC

    Out of the 63 identified mobile apps for reducing alcohol use, 4 apps contained the AUDIT, which is widely used in Russian PHC SBI. However, only 2 apps contained additional SBI elements and thus fulfilled both selection criteria. The 2 apps providing only the AUDIT (“I do not drink!” and “Sober One”) contained obvious errors. The I do not drink! app has a “urban” translation into Russian and contains only 9 out of the 10 AUDIT questions. The Sober One app is potentially more attractive for SBI as it provides a brief risk assessment. However, 1 standard dose is determined as 13.7 g of pure alcohol, which does not correspond to the value officially used in Russia [17,45]. Out of the 2 apps fulfilling both selection criteria (AUDIT and Alcoholism test), the AUDIT app applies the SBI algorithms from the official Russian guidelines [17]. The second app, Alcoholism test, evaluates the individual health risk and provides additional information about the harm associated with alcohol consumption, which may motivate a conversation with the patient. However, we did not find any information on the scientific testing or trialing of the identified apps.


    Principal Findings

    This study is the first systematic search and evaluation of Russian-language mobile apps for reducing alcohol use in Russia. We identified and assessed 63 eligible apps, 2 of which could potentially be used in SBIs in Russian PHC facilities after improvements in content and scientific testing. The MARS app quality scores of the evaluated apps showed good functionality, aesthetics, and ease of use. However, there is ample room for improvement, especially in the area of scientific support and evidence base; no information on scientific trialing or testing of any of the apps could be obtained. Further, ABACUS scores indicated that most apps provide only few features to facilitate human behavior change, casting doubt on their effectiveness to change alcohol consumption habits. These weaknesses seem to be common not only in Russian-language apps but in comparable apps worldwide. In a recent Australian study using both MARS and ABACUS, English-language apps for reducing alcohol use obtained similar ratings as the apps evaluated in this study [46].

    The analysis of the apps’ main features revealed some specific weaknesses and strong points of different app categories. Apps for calculating blood alcohol concentration and sobering time mostly used the Widmark formula developed in 1932 [42]. There are studies suggesting that this formula considerably underestimates blood alcohol concentration [47,48]. Most apps recording personal alcohol consumption and apps with structured support to reduce alcohol use featured infographics, allowing the user to quickly and visually evaluate their alcohol consumption. Some of these apps featured chats and goal-setting functions, which had an additional supportive effect. Virtual avatars with changing appearance added an element of gamification to some apps and allowed for a competitive effect between users. It is also worth highlighting the group of mobile apps with structured support to reduce alcohol use, which contained a higher number of features that facilitate changes in alcohol-related health behavior. In the future, it might be worthwhile to conduct an additional detailed analysis of these apps’ content and long-term effectiveness. Users of apps for reducing alcohol use are often not aware that most apps contain unreliable, non–peer-reviewed content, which might be noneffective or even put users at risk [29,49,50]. Currently, there is no information about apps’ evidence base or scientific background available in the App Store and the Google Play Store [50].

    Some international websites such as iMedicalApps offer expert comments and reviews of medical apps to patients and health care professionals [51]. Unfortunately, none of these sites are available in Russian language. SBI for alcohol consumption is not yet broadly established and implemented at the level of PHC in Russia, although decisive action was taken to change this in the past 8 years [52]. Electronic SBIs might offer greater flexibility, and depending on their mode of implementation, potentially more anonymity to avoid stigma for PHC patients [26]. Their wide availability in the App Store and, more importantly, Google Play Store as the most popular marketplace for mobile apps in Russia, may offer new opportunities to expand personalized medical care for people with alcohol-related problems [53]. The use of mobile apps to facilitate the assessment of alcohol intake as well as the level of according risk is a promising approach and requires further study, especially in a country like the Russian Federation that is committed to implement SBIs as a routine procedure.

    Limitations

    Searches were carried out in the iOS App Store, Google Play Store, and the 4PDA forum. These stores regularly update their content, meaning that mobile apps may become unavailable over time. Furthermore, search options such as language and region settings affect the selection and order of results, thereby reducing the reproducibility of the searches. App contents were not analyzed in detail nor did we assess the apps’ potential to change human behavior in the long term. This assessment may represent an area for future research.

    Conclusions

    This study provides a structured overview of the main features, quality, and potential to change the alcohol-related health behavior of Russian-language apps for reducing alcohol use currently available in Russia. This overview can be used as a reference by alcohol consumers and health care professionals alike when choosing an app to facilitate the reduction of alcohol use. Although Russian-language apps for reducing alcohol use were found to be aesthetically pleasing, functional, and easy to use, most apps contained a low number of features that facilitate changes in lifestyle behavior and lacked information about scientific trialing or testing. Only 2 identified apps contained the AUDIT and additional brief intervention elements and could thus potentially be used for SBI in the Russian PHC after rigorous scientific evaluation of their effectiveness. Overall, our findings underline the need to develop evidence-based apps to mitigate alcohol consumption in Russia and elsewhere.

    Authors' Contributions

    AB, MN, and BG conducted the app search and evaluation. AB and VW wrote the manuscript, and BG, CFB, and MN revised the manuscript.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    PROSPERO (Prospective Register of Systematic Reviews) protocol.

    DOCX File , 26 KB
    ‎
    Multimedia Appendix 2

    Russian-language mobile apps for reducing alcohol use.

    DOCX File , 1298 KB
    1. Rehm J, Room R, Monteiro M, Gmel G, Graham K, Rehn N, et al. Alcohol as a risk factor for global burden of disease. Eur Addict Res 2003 Oct;9(4):157-164. [CrossRef] [Medline]
    2. World Health Organization. Global Status Report on Alcohol and Health. Geneva: World Health Organization; 2018.
    3. Shield K, Manthey J, Rylett M, Probst C, Wettlaufer A, Parry C, et al. National, regional, and global burdens of disease from 2000 to 2016 attributable to alcohol use: a comparative risk assessment study. The Lancet Public Health 2020 Jan;5(1):e51-e61. [CrossRef]
    4. Fact sheet on the SDGs: Alcohol consumption and sustainable development. In: Sustainable Development Goals. Cham: Springer; 2020.
    5. Rehm J, Gmel GE, Gmel G, Hasan OSM, Imtiaz S, Popova S, et al. The relationship between different dimensions of alcohol use and the burden of disease-an update. Addiction 2017 Jun 20;112(6):968-1001 [FREE Full text] [CrossRef] [Medline]
    6. Nemtsov A, Neufeld M, Rehm J. Are Trends in Alcohol Consumption and Cause-Specific Mortality in Russia Between 1990 and 2017 the Result of Alcohol Policy Measures? J Stud Alcohol Drugs 2019 Sep;80(5):489-498. [CrossRef]
    7. Neufeld M, Rehm J. Alcohol consumption and mortality in Russia since 2000: are there any changes following the alcohol policy changes starting in 2006? Alcohol and Alcoholism 2013 Jan 07;48(2):222-230. [CrossRef] [Medline]
    8. Zaridze D, Brennan P, Boreham J, Boroda A, Karpov R, Lazarev A, et al. Alcohol and cause-specific mortality in Russia: a retrospective case–control study of 48 557 adult deaths. The Lancet 2009 Jun;373(9682):2201-2214. [CrossRef]
    9. Zaridze D, Lewington S, Boroda A, Scélo G, Karpov R, Lazarev A, et al. Alcohol and mortality in Russia: prospective observational study of 151 000 adults. The Lancet 2014 Apr;383(9927):1465-1473. [CrossRef]
    10. WHO launches SAFER alcohol control initiative to prevent and reduce alcohol-related death and disability. World Health Organization. 2018.   URL: https:/​/www.​who.int/​news/​item/​28-09-2018-who-launches-safer-alcohol-control-initiative-to-prevent-and-reduce-alcohol-related-death-and-disability [accessed 2021-12-13]
    11. World Health Organization. Screening and brief intervention for alcohol problems in primary health care. 2006.   URL: https://www.who.int/substance_abuse/publications/en/SBIFactSheet.pdf?ua=1 [accessed 2020-10-10]
    12. Kaner E, Bland M, Cassidy P, Coulton S, Dale V, Deluca P, et al. Effectiveness of screening and brief alcohol intervention in primary care (SIPS trial): pragmatic cluster randomised controlled trial. BMJ 2013 Jan 09;346:e8501 [FREE Full text] [CrossRef] [Medline]
    13. Kaner E, Beyer F, Muirhead C, Campbell F, Pienaar E, Bertholet N, et al. Effectiveness of brief alcohol interventions in primary care populations. Cochrane Database Syst Rev 2018 Feb 24;2:CD004148-CD004131 [FREE Full text] [CrossRef] [Medline]
    14. Kaner E, Dickinson H, Beyer F, Pienaar E, Schlesinger C, Campbell F, et al. The effectiveness of brief alcohol interventions in primary care settings: a systematic review. Drug Alcohol Rev 2009 May;28(3):301-323. [CrossRef] [Medline]
    15. O'Donnell A, Anderson P, Newbury-Birch D, Schulte B, Schmidt C, Reimer J, et al. The impact of brief alcohol interventions in primary healthcare: a systematic review of reviews. Alcohol and Alcoholism 2014;49(1):66-78 [FREE Full text] [CrossRef] [Medline]
    16. Garant. Methodological recommendations “Organization of medical examination and preventive medical examinations of the adult population” (approved by the Ministry of Health of the Russian Federation). Rapaht. 2013.   URL: https://www.garant.ru/products/ipo/prime/doc/70229844/ [accessed 2021-12-13]
    17. Garant. Methodological recommendations “Organization of preventive medical examination and clinical examination of certain groups of the adult population” (approved by the Ministry of Health on October 22). Rapaht. 2019.   URL: https://www.garant.ru/products/ipo/prime/doc/72936994/ [accessed 2021-12-13]
    18. Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test. Arch Intern Med 1998 Sep 14;158(16):1789-1795. [CrossRef] [Medline]
    19. World Health Organization. AUDIT: The alcohol use disorders identification test: Guidelines for use in primary health care. APA Psych Net. 2001.   URL: https://doi.apa.org/doiLanding?doi=10.1037%2Ft01528-000 [accessed 2021-12-13]
    20. Bunova AS, Gornyi BE, Dubovoi II, Dolgova SV, Odintsova EV, Paliy IA, et al. Primary health care workers' attitude towards to the prevention of problematic alcohol consumption. Profil. med 2017;20(5):37. [CrossRef]
    21. Rosário F, Santos MI, Angus K, Pas L, Ribeiro C, Fitzgerald N. Factors influencing the implementation of screening and brief interventions for alcohol use in primary care practices: a systematic review using the COM-B system and Theoretical Domains Framework. Implement Sci 2021 Jan 07;16(1):6 [FREE Full text] [CrossRef] [Medline]
    22. Johnson J, Seale J. Implementing alcohol screening and brief intervention in primary care: identifying barriers, proposing solutions. Johnson and Seale Addiction Science & Clinical Practice 2014;10(S1):1-2. [CrossRef]
    23. Neufeld M, Ferreira-Borges C, Bunova A, Gornyi B, Fadeeva E, Koshkina E. Capturing Russian drinking patterns with the Alcohol Use Disorders Identification Test: an exploratory interview study in primary healthcare and narcology centers in Moscow. WHO European Office for the Prevention and Control of NCDs (unpublished manuscript) 2022:2021. [CrossRef]
    24. Kerr W, Stockwell T. Understanding standard drinks and drinking guidelines. Drug Alcohol Rev 2012 Mar;31(2):200-205 [FREE Full text] [CrossRef] [Medline]
    25. Bewick BM, Trusler K, Barkham M, Hill AJ, Cahill J, Mulhern B. The effectiveness of web-based interventions designed to decrease alcohol consumption--a systematic review. Prev Med 2008 Jul;47(1):17-26. [CrossRef] [Medline]
    26. Donoghue K, Patton R, Phillips T, Deluca P, Drummond C. The effectiveness of electronic screening and brief intervention for reducing levels of alcohol consumption: a systematic review and meta-analysis. J Med Internet Res 2014 Jun 02;16(6):e142 [FREE Full text] [CrossRef] [Medline]
    27. DIGITAL 2020 Your ultimate guide to the evolving digital world. We Are Social.   URL: https://wearesocial.com/digital-2020 [accessed 2021-12-13]
    28. mHealth: New Horizons for Health Through Mobile Technologies. Geneva, Switzerland: World Health Organization; 2011.
    29. Abroms LC, Lee Westmaas J, Bontemps-Jones J, Ramani R, Mellerson J. A content analysis of popular smartphone apps for smoking cessation. Am J Prev Med 2013 Dec;45(6):732-736 [FREE Full text] [CrossRef] [Medline]
    30. Bryun E, Koshkina E, Sokoltchik Y, Tetenova E, Kolgashkin A, Nadezhdin S. Mobil'nyye prilozheniya dlya lits, stradayushchikh zavisimostyami, kak element sistemy elektronnogo zdravookhraneniya (Mobile applications for addicts as part of the e-health system). Narkologiya. 2017.   URL: http://www.narkotiki.ru/objects/narcology02/2017_07_spec2.pdf [accessed 2021-12-13]
    31. Bryun E, Koshkina E, Tetenova E, Kolgashkin A, Nadezhdin S. Mobil'nyye prilozheniya dlya lits, ispytyvayushchikh problemy s potrebleniyem alkogolya (Mobile applications for people with alcohol consumption problems). Narkologiya. 2016.   URL: http://www.narkotiki.ru/objects/narcology01/2016_04_spec_01.pdf [accessed 2021-12-13]
    32. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009 Jul 21;6(7):e1000097 [FREE Full text] [CrossRef] [Medline]
    33. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015 Mar 11;3(1):e27 [FREE Full text] [CrossRef] [Medline]
    34. McKay FH, Slykerman S, Dunn M. The App Behavior Change Scale: Creation of a Scale to Assess the Potential of Apps to Promote Behavior Change. JMIR Mhealth Uhealth 2019 Jan 25;7(1):e11130 [FREE Full text] [CrossRef] [Medline]
    35. Schiavo JH. PROSPERO: An International Register of Systematic Review Protocols. Med Ref Serv Q 2019;38(2):171-180. [CrossRef] [Medline]
    36. Unified state automated information system. Federal Service for the Regulation of the Alcohol Market. 2021.   URL: https://egais.ru/ [accessed 2021-12-13]
    37. 4PDA forum. 4PDA.   URL: https://4pda.ru/forum/index.php?act=idx [accessed 2021-12-13]
    38. Stoyanov S, Leanne H, Kavanagh D, Tjondronegoro D, Zelenko O, Mani M. MARS Training Video. 2016.   URL: https://www.youtube.com/watch?v=25vBwJQIOcE [accessed 2021-12-13]
    39. Shrout PE, Fleiss JL. Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin 1979;86(2):420-428. [CrossRef]
    40. Hallgren KA. Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial. Tutor Quant Methods Psychol 2012;8(1):23-34 [FREE Full text] [CrossRef] [Medline]
    41. Bunova A, Gornyi B. Razrabotka mobil'nogo prilozheniya dlya provedeniya skrininga i profilakticheskogo konsul'tirovaniya patsiyentov s riskom pagubnogo potrebleniya alkogolya [Development of a mobile application for screening and consultation of patients with harmful alcohol consumption]. In: Profilakticheskaya Meditsina. 2019 Presented at: Non-communicable diseases and public health in Russia; September 16; Moscow p. 38.
    42. Widmark EMP. Die theoretischen Grundlagen und die praktische Verwendbarkeit der gerichtlich-medizinischen Alkoholbestimmung. JAMA 1932 May 21;98(21):1834. [CrossRef]
    43. Watson PE, Watson ID, Batt RD. Prediction of blood alcohol concentrations in human subjects. Updating the Widmark Equation. J Stud Alcohol 1981 Jul;42(7):547-556. [CrossRef] [Medline]
    44. Selzer ML. The Michigan alcoholism screening test: the quest for a new diagnostic instrument. Am J Psychiatry 1971 Jun;127(12):1653-1658. [CrossRef] [Medline]
    45. Psikhicheskiye i povedencheskiye rasstroystva, vyzvannyye upotrebleniyem psikhoaktivnykh veshchestv. Pagubnoye (s vrednymi posledstviyami) upotrebleniye. [Mental and behavioral disorders caused by the use of psychoactive substances. Harmful (with harmful consequences) use]. Association of Narcologists of Russia. 2020.   URL: https://tinyurl.com/5btkhje3 [accessed 2021-12-13]
    46. McKay FH, Wright A, Shill J, Stephens H, Uccellini M. Using Health and Well-Being Apps for Behavior Change: A Systematic Search and Rating of Apps. JMIR Mhealth Uhealth 2019 Jul 04;7(7):e11926 [FREE Full text] [CrossRef] [Medline]
    47. Brouwer I. The Widmark formula for alcohol quantification. SADJ 2004 Nov;59(10):427-428. [Medline]
    48. Friel PN, Logan BK, Baer J. An Evaluation of the Reliability of Widmark Calculations Based on Breath Alcohol Measurements. J. Forensic Sci 1995 Jan 01;40(1):13767J. [CrossRef]
    49. Capras R, Bolboaca S. An evaluation of free medical applications for android smartphones. Applied Medical Informatics (3-4). 2016.   URL: https:/​/www.​researchgate.net/​publication/​338966234_An_Evaluation_of_Free_Medical_Applications_for_Android_Smartphones [accessed 2021-12-13]
    50. Visser BJ, Buijink AWG. Need to peer-review medical applications for smart phones. J Telemed Telecare 2012 Mar;18(2):124. [CrossRef] [Medline]
    51. Husain I, Misra S, Wodajo F. iMedicalApps. 2019.   URL: https://www.imedicalapps.com/ [accessed 2021-12-13]
    52. Neufeld M, Bunova A, Gornyi B, Ferreira-Borges C, Gerber A, Khaltourina D, et al. Russia's National Concept to Reduce Alcohol Abuse and Alcohol-Dependence in the Population 2010-2020: Which Policy Targets Have Been Achieved? Int J Environ Res Public Health 2020 Nov 09;17(21):8270 [FREE Full text] [CrossRef] [Medline]
    53. Russia’s mobile app economy: A new app superpower in the making? AppAnnie.com.   URL: https://www.appannie.com/en/insights/market-data/russias-mobile-app-economy/ [accessed 2021-12-13]

    ‎
    ABACUS: App Behavior Change Scale
    AUDIT: Alcohol Use Disorders Identification Test
    AUDIT-C: Alcohol Use Disorders Identification Test-Consumption
    ICC: intraclass correlation coefficient
    iOS: iPhone operating system
    MARS: Mobile App Rating Scale
    PHC: primary health care
    PROSPERO: Prospective Register of Systematic Reviews
    SBI: screening and brief intervention
    WHO: World Health Organization

    Edited by L Buis; submitted 08.06.21; peer-reviewed by I Shubina, H Goodfellow; comments to author 30.07.21; revised version received 09.08.21; accepted 29.10.21; published 10.01.22

    Copyright

    ©Anna Bunova, Veronika Wiemker, Boris Gornyi, Carina Ferreira-Borges, Maria Neufeld. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 10.01.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.