Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, March 11, 2019 at 4:00 PM to 4:30 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 04.07.19 in Vol 7, No 7 (2019): July

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/11926, first published Aug 12, 2018.

This paper is in the following e-collection/theme issue:

    Original Paper

    Using Health and Well-Being Apps for Behavior Change: A Systematic Search and Rating of Apps

    1Deakin University, School of Health and Social Development, Burwood, Australia

    2Victorian Health Promotion Foundation (VicHealth), Carlton, Australia

    3The University of Melbourne (Honorary), Parkville, Australia

    4Dialogue Consulting, Melbourne, Australia

    Corresponding Author:

    Fiona H McKay, BSc, MPH, PhD

    Deakin University

    School of Health and Social Development

    Burwood Hwy

    Burwood, 3125

    Australia

    Phone: 61 392517183

    Email:


    ABSTRACT

    Background: Smartphones have allowed for the development and use of apps. There is now a proliferation of mobile health interventions for physical activity, healthy eating, smoking and alcohol cessation or reduction, and improved mental well-being. However, the strength or potential of these apps to lead to behavior change remains uncertain.

    Objective: The aim of this study was to review a large sample of healthy lifestyle apps at a single point in time (June to July 2018) to determine their potential for promoting health-related behavior change with a view to sharing this information with the public. In addition, the study sought to test a wide range of apps using a new scale, the App Behavior Change Scale (ABACUS).

    Methods: Apps focusing on 5 major modifiable lifestyle behaviors were identified using a priori key search terms across the Australian Apple iTunes and Google Play stores. Lifestyle behavior categories were selected for their impact on health and included smoking, alcohol use, physical activity, nutrition, and mental well-being. Apps were included if they had an average user rating between 3 and 5, if they were updated in the last 18 months, if the description of the app included 2 of 4 behavior change features, and if they were in English. The selected behavior change apps were rated in 2 ways using previously developed rating scales: the Mobile App Rating Scale (MARS) for functionality and the ABACUS for potential to encourage behavior change.

    Results: The initial search identified 212,352 apps. After applying the filtering criteria, 5018 apps remained. Of these, 344 were classified as behavior change apps and were reviewed and rated. Apps were given an average MARS score of 2.93 out of 5 (SD 0.58, range 1.42-4.16), indicating low-to-moderate functionality. Scores for the ABACUS ranged from 1 to 17, out of 21, with an average score of 7.8 (SD 2.8), indicating a low-to-moderate number of behavior change techniques included in apps. The ability of an app to encourage practice or rehearsal, in addition to daily activities, was the most commonly identified feature across all apps (310/344, 90.1%), whereas the second most common feature was the ability of the user to easily self-monitor behavior (289/344, 84.0%).

    Conclusions: The wide variety of apps included in this 2018 study and the limited number of behavior change techniques found in many apps suggest an opportunity for improvement in app design that will promote sustained and significant lifestyle behavior change and, therefore, better health. The use of the 2 scales for the review and rating of the apps was successful and provided a method that could be replicated and tested in other behavior change areas.

    JMIR Mhealth Uhealth 2019;7(7):e11926

    doi:10.2196/11926

    KEYWORDS



    Introduction

    Modifiable Risk Factors for Chronic Disease

    Life expectancies across many developed countries have steadily increased over the past century. Newborns in developed countries can expect to live for 80 years or more, with an average increase of 3 years per decade [1]. At the same time, death rates in developed countries continue to fall, with the leading underlying causes of death being age-related diseases, including coronary heart and Alzheimer disease and cancers [1]. Although these overall patterns are encouraging and suggest that activities to improve health are working, areas of concern remain. An analysis of data reporting on the global burden of disease suggests that although overall life expectancy has increased, much of the burden of disease could be prevented through a reduction in exposure to modifiable risk factors, including tobacco use, high body mass, high alcohol use, physical inactivity, and high blood pressure [2]. Rates of overweight and obesity have increased, with the vast majority of adults and children not consuming the recommended quantities of fruits and vegetables or engaging in the recommended amount of daily physical activity [2]. Although rates of smoking, daily alcohol use, and overall alcohol consumption have decreased somewhat in the adult population in recent years, they remain significant contributors to disease burden [2]. In addition to the focus on physical health, global data related to mental health indicate that approximately 1 in 4 people worldwide will experience a diagnosable mental illness over their lifetime [2].

    Interventions to Address Modifiable Risk Factors

    A large amount of research has investigated the variety of responses to the most common modifiable risk factors: obesity, physical inactivity, poor nutrition, tobacco use, risky alcohol use, and poor mental health. In the quest for solutions for poor health, this research has explored the clinical as well as community setting, proposing solutions that exist at the societal, environmental, household, and individual level. Much of the research investigating ways to increase physical activity is focused on children and adolescents, as most adolescents are physically inactive, with this inactivity continuing into adulthood [3].

    A recent review found that, similar to many high-income countries, chronic disease is Australia’s biggest health challenge, responsible for 83% of premature deaths [4]. This review found that interventions targeting the workplace, facilitated group-based exercise programs, the promotion of activities that encourage or provide the ability to self-monitor behavior, tobacco cessation programs that embed coaching or counselling, and practical support for weight loss are most likely to be effective [4]. Although interventions that have little effectiveness include those focused on education or awareness raising, particularly around healthy food and beverage options, modifications to workplace and community environments have been identified as a way to encourage physical activity as have interventions that include financial rewards or penalties [4].

    Smartphone Apps for Health

    Although this evidence points to some success in supporting positive health by modifying risk factors, the intensive nature and expense often associated with these programs, can prohibit the large-scale rollout of such interventions. Smartphone apps represent a potential supplement to these efforts that could lead to substantial population-level impact and long-term health behavior change. Approximately 70% of the populations of developed countries own a smartphone [5]. The versatility of smartphones has led to the creation of millions of apps beyond those originally supplied to consumers, such as mail, map, and messaging apps, and now include gaming, banking, recipe finders, and health apps. Apps are created by developers and can be downloaded from a variety of digital marketplaces depending on the operating system of the device. Such technologies make available interventions that are low cost and can be accessed by much of the population.

    In recent years, there has been a proliferation of apps designed to improve health. This has included apps that promote physical fitness through attendance at gyms or via counting steps, apps that track calorie intake and suggest modifications, apps that aim to assist users with smoking cessation or reducing alcohol consumption, and apps that promote mindfulness and positive mental health. However, it is unclear if these apps follow best practices in app design or health behavior change, or indeed what is the best practice for designing health behavior change apps. Although some studies have reported on the behavior change content of apps, for example, smoking cessation [6], alcohol reduction [7,8], physical activity [9], or for specific medical conditions [10], there is also research suggesting that many apps fail to include techniques or features that have been shown to be effective in behavior change, such as the ability to be customizable to users’ needs or personal characteristics or to be responsive to change [7,10,11]. There is also a risk that improper or unsupervised use of apps or the use of apps that do not align with current recommendations may result in harmful outcomes for users [12,13].

    Evaluation of Mobile Health Apps

    Part of the problem in evaluating the effectiveness or accuracy of information in apps is related to limitations in the methods available and inconsistencies in the approach to research in this area. Using smartphone apps for healthy behavior change is an emerging area of investigation, and as a result, much of the current research is focused on the evaluation of single apps [14] and apps that have been purposely designed for a research project [6], or a small number of top-rated apps [15,16], rather than focusing on a thorough large-scale investigation of the potential of apps that already exist on the market to promote behavior change [17].

    A recent systematic review investigated approaches to the evaluation of health apps with the aim of identifying current best practice approaches [18]. The review of 38 papers found no single best practice method of evaluating mobile health and well-being apps. Most approaches did not include sufficient information or evaluation, potentially meaning consumers are provided with incomplete and inaccurate information about the apps. The review suggested that the evaluation of apps should include a review of the functionality and usability of the app, as well as an assessment of the apps’ potential to promote behavior change. It found that although not specific for smartphone apps, the Coventry, Aberdeen, and London—Refined taxonomy, developed by Michie et al [19], was the most commonly used instrument for assessing behavior change techniques in interventions and the Mobile Apps Rating Scale (MARS), developed by Stoyanov et al [20] was the most commonly used tool for assessing the quality and functionality of mobile health apps.

    On the basis of this review, McKay et al [21] developed a scale specifically designed to determine the behavior change potential of smartphone apps. This tool, the App Behavior Change Scale (ABACUS), based off the health behavior change intervention literature, is a 21-item instrument that reports high percentage agreement, Krippendorff alpha, interrater reliability, and high internal consistency.

    This study aims to rate the potential effectiveness of the apps using a scale that assesses the inclusion of features that are known to assist individuals with behavior change, designed to reduce alcohol consumption or smoking, improve nutrition or mental well-being, or increase physical activity to provide potential app users information on the content of apps and their likely effectiveness in supporting the user’s lifestyle behavior change goals.

    The ratings are housed on a website developed by the Victorian Health Promotion Foundation (VicHealth) to assist the public in making informed choices about effective healthy lifestyle apps. VicHealth is a public health agency based in the Australian state of Victoria that is focused on promoting good health and preventing chronic disease. The previously mentioned 5 healthy lifestyle areas were selected as these were the focus of VicHealth’s programs and reflected major lifestyle risk factors that contributed to the burden of disease in Australia [22].

    In addition, this study also sought to describe the method used in the rating of apps for health-related behavior change with a view to enabling application of the method to regular review and public update about the effectiveness of health apps. This approach has a broad application in other health areas where the assessment of an app’s potential to support effective adoption of healthy behaviors is required and where health agencies or government health departments have a mandate to support the public in making effective choices for health. This is particularly critical for app consumers as there is a proliferation of health apps on the market with claims regarding their effectiveness in supporting health behaviors, including behaviors related to a healthy lifestyle and illness self-management. Application of a consistent app review method can simplify the process of regularly reviewing apps on the market to keep the public informed of their potential effectiveness.


    Methods

    This study employed 2 scales to rate smartphone apps. The first was MARS [20] for functionality, and the second was ABACUS [21] to determine the potential for behavior change. Independent raters applied these scales to the apps identified from the Apple iTunes and Google Play stores.

    Sample Selection

    The Australian Apple iTunes and Google Play stores were searched to identify health and well-being apps using a priori key search terms outlined below from June to July 2018. Identified apps underwent a 4-step screening, review, and rating process (see Figure 1).

    All apps available for download in Australia containing a predefined keyword in either the title or description were collected from the Google Play and Apple iTunes stores from June to July 2018. Search terms were developed by health promotion experts in the fields of alcohol and tobacco cessation, healthy eating, physical activity, and mental well-being. This study sought to investigate apps that would encourage health behavior change, rather than those that would simply enable health promotion; therefore, search terms that would identify a specific condition were not included. The search terms used were as follows: health, lifestyle, alcohol, alcoholic, drinks, drinking, booze, sober, blood alcohol, BAC, smoking, smoke, cigarette, tobacco, fitness, exercise, running, exercising, physical activity, active, steps, walking, training plan, nutrition, social isolation, healthy eating, diet, healthy eating, healthy food, health food, healthy drink, health drink, water, hydration, junk food, salt, sodium, social connection, anxiety, well-being, relaxation, mindfulness, stress, mood, meditate, meditation, emotional intelligence, empathy, gratitude, loneliness, friendship, resilience, and resilient. Apps were filtered according to the following inclusion criteria: average user rating of greater than or equal to 3 and at least 10 user reviews (all versions), updated in the last 18 months, and in the English language. Apps were then categorized into 5 key healthy living categories: promoting healthy eating, encouraging regular physical activity, preventing tobacco use, reducing alcohol consumption, and improving mental well-being.

    Apps were further filtered and excluded if conflicts of interest were identified, for example, apps promoting negative behavior such as prosmoking in tobacco apps; the app targeted a specific clinical population such as people living with diabetes, or the treatment of psychological disorders, as this review sought to evaluate apps that encourage health behavior change through health promotion and not clinical management of a disease or condition; or the app was not relevant to Australia, including those where a currency other than Australian dollars was only used, nonmetric measures, or a gym franchise in countries other than Australia.

    Figure 1. Process for identifying and rating apps.
    View this figure

    Following this, app descriptions were reviewed independently by 2 reviewers to determine if they could be classified as promoting behavior change. Behavior change, in this instance, refers to the new activities or actions one needs to do regularly to achieve a healthier lifestyle, for example, exercising, eating healthier food, or managing stress. To investigate the potential for behavior change, app descriptions were reviewed against 4 criteria: (1) the ability to set goals for the actions the user would like to achieve, (2) the ability to tailor the app, (3) the ability to share progress with others (for example, through connections on social media), and (4) the ability to receive rewards or acknowledgments when activities are completed or progress toward a goal is made. These criteria are based on previous health promotion and behavior change research [23]. As this review was interested in apps that had the potential to change behavior, apps that only provided information or connected users to a service or facility and did not meet at least 2 of the 4 behavior change elements listed above were excluded.

    All behavior change apps were downloaded for use on an iPhone. If an app was not available for one of those platforms (or was incompatible with the device used), reviewers identified and used a compatible device. Where an app was available on both Google Play and Apple iTunes, for ease, the apps were downloaded for review on an Apple device. When data were collected, the description for apps on Google Play and Apple iTunes were compared. Similarities and differences in app description were noted at this point; however, if the app was described the same way (excluding differences in terms of the user experience, design, or layout as these are expected across the different platforms), the app was considered identical across both Android and Apple platforms. However, this review did not validate every feature of every app across both platforms, as such, there is a possibility that some apps may have differences when used on an Android versus iOS device.

    Functionality Review and Rating

    The functionality rating uses the MARS [20]. This rating scale was used to examine app elements, such as engagement, functionality, utility, aesthetics, and information. This scale includes 23 items across 5 categories with each item scored using a series of questions on a 5-point ordinal scale response. An overall functionality score out of 5 was derived using this scale.

    All apps were scored by at least 2 people with expertise in reviewing apps. To standardize the approach between reviewers, a pilot of a small group of apps was initially conducted and results were compared. Each app was downloaded and, consistent with other studies [15,20], used for approximately 10 min to allow the rater to familiarize themselves with the functionality of the app and user experience. Reviewers attempted to use all parts of each app, noting if the app crashed or its functions were not accessible. Where functionality scores differed, the reviewers considered the app together, sought consensus, and determined a final score.

    Technical features of apps were also recorded but did not form part of the functionality rating. These features included the following: whether the app had a privacy policy, required login, allowed password protection, allowed for social media integration, allowed data export, had an app community, sent reminders, needed Web access to function, required add-ons such as a fitness band to use the app (and whether this was a one-off purchase, such as a fitness tracker or an ongoing purchase), the presence of in-app-advertising or payments (product purchases made within the app, such as unlocking extra features including videos or removing advertisements), and whether the app asked permissions to send push notifications.

    Behavior Change Potential Review and Rating

    The ABACUS [21] was used to measure behavior change potential. This rating scale comprises 21 items and was used to examine the potential behavior change of the app in relation to goal setting, action planning, barrier identification, self-monitoring, and feedback.

    All apps were reviewed and scored by at least 2 reviewers with expertise in public health and health promotion. Interrater reliability was examined with good reliability observed between reviewers (intraclass correlation .906 [95% CI 0.854-0.936]). Each app was first explored by the reviewer to gain familiarity with the app and the interface. The reviewers used all app functions including images, cartoons, videos, record keeping, calendars, and reminders. A total theoretical score out of 21 was calculated by summing the item scores.

    Data Analysis

    Basic descriptive statistics were conducted to characterize the sample. Percentages are presented for categorical variables and means, or for medians presented for continuous variables. All analyses were conducted using SPSS for Windows, version 22.0 (SPSS Inc).


    Results

    The initial search was conducted between June 28 and July 2, 2018 and identified 212,352 apps. After applying the filtering criteria, 5018 apps remained. Of these, 356 were classified as behavior change apps, of which 12 were unavailable at the time of review and eventually removed (11 physical activity apps and 1 mental well-being app), leaving 344 for review. These apps were categorized as either physical activity (n=275), healthy eating (n=23), mental well-being (n=27), tobacco (n=14), or alcohol (n=5). All apps were reviewed by 2 reviewers.

    Most apps were free (279/344, 81.1%), and all were available on the iTunes platform (344/344, 100.0%), with over two-thirds (236/344, 68.6%) also available on the Google Play store. Around half of the apps required some form of purchase, for example, 171 apps (171/344, 49.7%) required an ongoing purchase including membership or subscription, whereas 141 apps (141/344, 40.9%) required a one-off purchase. Physical activity apps were most likely to require some form of in-app payment (191/344, 55.5%) or one-off purchase (113/344, 32.8%). Two-thirds of all apps (233/344, 67.7%) required some form of in-app payment, typically allowing the user to unlock a feature or to remove advertisements. Advertisements were identified in 93 apps (93/344, 27.1%), mostly in those that were categorized as physical activity apps (75/344, 21.8%); see Table 1 for more app features.

    All apps were assessed against both the MARS [20] and ABACUS [21] (see Multimedia Appendix 1 for an overview of scores). Using the MARS, apps were assigned a score out of 5. Apps in this review were given an average score of 2.93 (SD 0.58, range 1.42-4.16), indicating moderate functionality across all apps. Table 2 shows the average scores for the whole sample from the highest average score to the lowest on the MARS. Overall, accuracy of description (3.88), performance (3.30), and layout (3.42) were the highest rating features, whereas the credibility of the app (2.11) was the lowest scoring feature.

    The apps that were categorized as mental well-being received the highest MARS scores (average of 3.26), and apps categorized as promoting healthy eating received the lowest MARS scores (average of 2.71). Apps that were categorized as improving mental well-being also scored the highest on many of the individual elements. For example, mental well-being apps scored highest in the elements of accuracy of design (4.17), performance (3.78), target group (3.75), gestural design (3.64), layout (3.6), graphics (3.53), quality (3.43) and quantity (3.05) of information, visual appeal (3.35), interest (2.67), credibility (2.64), visual information (2.5), and entertainment (2.28).

    The ABACUS was applied to all apps, resulting in a score for each app from 0 to 21. Scores in this review ranged from 1 to 17, with an average score of 7.8 (SD 2.8), indicating a low-to-moderate number of behavior change techniques included in apps. The apps categorized as tobacco cessation scored the highest on the ABACUS indicating the highest number of behavior change features, with an average of 10.2 in each of the 14 apps rated; this was followed closely by apps categorized as improving mental well-being and promoting healthy eating, which were identified as having on average 8.7 and 8.6 items, respectively. The ability of an app to encourage practice or rehearsal in addition to daily activities was the most commonly identified feature of all apps in total (310/344, 90.1%), and specifically the apps categorized as increasing physical activity (263/275, 95.6%), healthy eating (20/23, 86%), and improving mental well-being (23/27, 85.2%). The second most common feature across all apps was the ability of the app to allow the user to easily self-monitor behavior. This feature was identified in 84.0% (289/344) of apps across all categories and in 100% (14/14) of smoking cessation apps. Apps aiming to reduce alcohol consumption were identified as having the fewest features that could promote behavior change; however, this finding needs to be interpreted with caution as there were only a small number of apps (n=5) in this category (see Table 3 for more details on the frequency of each behavior change technique).

    Table 1. App features.
    View this table
    Table 2. Performance on individual Mobile App Rating Scale elements (highest to lowest).
    View this table
    Table 3. Performance on App Behavior Change Scale (ABACUS) criteria (most to least frequently used).
    View this table

    Discussion

    Principal Findings

    This study shows the extent to which smartphone apps incorporate behavior change techniques and basic functionality by using 2 validated scales, the MARS [20] and ABACUS [21]. This study extends on previous app review work by examining a greater number of apps across 5 separate categories and testing the ABACUS for the first time, on a large number of apps [21]. Despite the increase in sample, the results for this Australian study are consistent with past research investigating the inclusion of behavior change techniques in apps for alcohol [24] and smoking cessation [25], weight loss [26,27], and improved physical activity [28], showing that smartphone apps include a limited number of behavior change techniques.

    The most common behavior change techniques included in apps in this study were those related to practice and rehearsal, instruction, self-monitoring behavior, customizing features, and the inclusion of reminders or prompts of activity. Given the large amount of research identifying goal setting as important in achieving behavior change [29,30] and with goal setting shown to increase success in changing behaviors around nutrition [31] and physical activity [32], it is disappointing to note that only around one-third of apps included an option for users to set and change goals, with many of the apps only allowing for the review of automatic goals. It is also interesting to note that the ability to plan for barriers, export data from the app (for example, to a health care professional), or gather background on willingness for behavior change were not prominent in the apps reviewed, despite the technology being readily available for these features and other research highlighting such features as important in encouraging positive behavior change [33].

    Although we identified a very large number of physical activity apps (almost 80% of the sample) leading to a high level of consumer choice, we found that most included a limited number of techniques known to promote sustained behavior change. The apps that were categorized as promoting physical activity had on average 7 to 9 behavior change techniques. In over 90% of physical activity apps, the app allowed repeat practice or rehearsal. This feature allows users of the apps to engage in the behavior more than once each day, for example, in a yoga app, the user would be permitted to undertake more than 1 yoga session in a defined period. This is particularly important as behavior change intervention research suggests that repetition is an important component of a successful intervention [34].

    Around one-quarter of the physical activity apps contained features allowing users to set their own goals or update these goals. Given the large number of physical activity apps on the market, this is a clear gap in app design, particularly given the large amount of research that has already been conducted on the importance of these features [23,35,36]. However, this is consistent with previous research which indicates that many of the physical activity apps on the market have limited behavior change features [37], and their features consist mainly of step-by-step instructions for particular exercises [35]. It is also disappointing to note that goal setting was missing from alcohol and tobacco cessation apps, given the importance of goal setting in decreasing negative health behaviors [38,39].

    Apps that were categorized as improving mental well-being, promoting healthy eating, or reducing alcohol consumption were identified as having around 8 behavior change techniques. Although the small number of alcohol reduction apps received ratings across a large range (range 2-17), the mental well-being and healthy eating apps had ratings across a smaller range (4-16 and 1-12, respectively). Unlike physical activity apps, the healthy eating apps were more likely to include a function to set and revise goals, whereas the mental well-being apps were more likely to encourage positive habit formation, with many of the apps encouraging and enabling daily practice. Mental well-being apps were also identified as allowing users to monitor their behavior against a set goal. This is positive, as there is some emerging research on mental well-being apps showing that those apps with some self-monitoring features are more likely to have positive impacts [28,40].

    Limitations

    Although there are some interesting findings presented here, there are limitations to this study. First, this study features apps that were available in the Australian Apple iTunes and Google Play stores, and we found no apps that were present in the Google Play store only. Apps that did not allow Australian currency and that did not service an Australian audience were excluded. This could mean that we have missed apps that promote behavior change but are specific to another market. As such, caution needs to be taken when extrapolating these findings to other countries.

    It may also be possible that by downloading apps from the Apple iTunes store that were also available in the Google Play store, we have missed an app that has an identical name and description in both stores but different features. Although the listings for apps were compared as part of the identification process to ensure that they were similar, we did not review or rate duplicate apps, and as such, there is a chance that some apps may have differences when used on an Android versus iOS device.

    It is important to note that this study only presents an analysis of apps available at a single point in time: 2018. Although this research provides a reference point for further research into the quality of apps and a review of a large number of apps, given the fast-moving nature of this field, some of these apps may no longer be available or may have had their features updated.

    A further limitation is the absence of content assessment of health information included within the apps. Although there has been some content investigation of single apps, or a small set of apps, this study is still in its infancy and represents an area for future investigation. Within this review, we also did not seek to measure the quality of the advice given or the relationship between the information provided with that of national and international guidelines.

    Finally, with these data, we are unable to draw any conclusion relating to long-term behavior change. Given that we know that sustaining long-term behavior change is difficult, that even those programs that are effective have been shown to result in small changes [41], and that apps are typically used only on a few occasions before they are deleted [24,42], this is an area that needs more research attention as we strive to create apps that will be able to assist in improving the health of a large number of people at a low cost.

    Conclusions

    The wide variety in apps and the low number of behavior change techniques found in most apps included in this 2018 study suggests an opportunity for growth in apps that can promote sustained and significant behavior change. Furthermore, the small number of apps on the market for reducing alcohol and tobacco consumption may also represent an opportunity for developers to create high quality apps that can assist with behavior change in these areas. Given that app development outpaces research and knowledge translation, it is difficult to see a time where apps will be based on best practice or most up-to-date behavior change techniques. However, with the increasing body of research identifying limitations in current apps, there is a potential for the creation of apps to more likely encourage behavior change. To this end, this research is complemented by a set of guidelines for app developers to assist them in developing apps that can effectively support lifestyle behavior change [43].

    Overall, the use of the ABACUS [21] taxonomy for behavior change and the MARS [20] was successful. The reviewers reported having clear guidelines for the review, the time taken for each app was not prohibitive, and interrater reliability was good. Therefore, it provides a method that could be replicated and tested in other behavior change areas or used on a periodic basis to review apps available on the health app market to enable consumers to make optimal app selections.

    Acknowledgments

    This study was funded by VicHealth.

    Authors' Contributions

    HS and MU identified health and well-being apps in the Australian Apple iTunes and Google Play stores and collected data relating to app features and functionality using the MARS. FM led the research team that collected data relating to potential behavior change effectiveness using the ABACUS. FM analyzed the data. FM and AW drafted the manuscript. All authors read and contributed to the finalization of the manuscript. All authors approved the final manuscript.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Process for identifying and rating apps.

    XLSX File (Microsoft Excel File), 21KB

    References

    1. World Health Organization. 2016. World Health Statistics 2016: Monitoring health for the SDGs   URL: https://www.who.int/gho/publications/world_health_statistics/2016/en/ [accessed 2019-06-12]
    2. GBD 2015 Risk Factors Collaborators. Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks, 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet 2016 Oct 08;388(10053):1659-1724 [FREE Full text] [CrossRef] [Medline]
    3. Caspersen CJ, Pereira MA, Curran KM. Changes in physical activity patterns in the United States, by sex and cross-sectional age. Med Sci Sports Exerc 2000 Sep;32(9):1601-1609. [Medline]
    4. Rowbotham S, Barnett P, Gomez M, Wutzke S. Australian Government Department of Health. 2017. Effective whole-of-population stategies for preventing chronic disease   URL: https:/​/preventioncentre.​org.au/​resources/​evidence-reviews/​effective-whole-of-population-strategies-for-preventing-chronic-disease/​ [accessed 2019-06-12]
    5. Poushter J, Bishop C, Chwe H. Pew Research Center. 2018. Social Media Use Continues To Rise in Developing Countries, but Plateaus Across Developed Ones   URL: https:/​/www.​pewresearch.org/​global/​2018/​06/​19/​social-media-use-continues-to-rise-in-developing-countries-but-plateaus-across-developed-ones/​ [accessed 2019-06-12]
    6. BinDhim N, McGeechan K, Trevena L. Smartphone Smoking Cessation Application (SSC App) trial: a multicountry double-blind automated randomised controlled trial of a smoking cessation decision-aid 'app'. BMJ Open 2018 Dec 21;8(1):e017105 [FREE Full text] [CrossRef] [Medline]
    7. Hoeppner B, Schick M, Kelly L, Hoeppner S, Bergman B, Kelly J. There is an app for that - Or is there? A content analysis of publicly available smartphone apps for managing alcohol use. J Subst Abuse Treat 2017 Dec;82:67-73. [CrossRef] [Medline]
    8. Crane D, Garnett C, Brown J, West R, Michie S. Behavior change techniques in popular alcohol reduction apps: content analysis. J Med Internet Res 2015 May 14;17(5):e118 [FREE Full text] [CrossRef] [Medline]
    9. Bondaronek P, Alkhaldi G, Slee A, Hamilton F, Murray E. Quality of publicly available physical activity apps: review and content analysis. JMIR Mhealth Uhealth 2018 Mar 21;6(3):e53 [FREE Full text] [CrossRef] [Medline]
    10. Morrissey EC, Corbett TK, Walsh JC, Molloy GJ. Behavior change techniques in apps for medication adherence: a content analysis. Am J Prev Med 2016 May;50(5):e143-e146. [CrossRef] [Medline]
    11. Hoeppner B, Hoeppner S, Seaboyer L, Schick M, Wu G, Bergman B, et al. How smart are smartphone apps for smoking cessation? A content analysis. Nicotine Tob Res 2016 May;18(5):1025-1031 [FREE Full text] [CrossRef] [Medline]
    12. Kumar N, Khunger M, Gupta A, Garg N. A content analysis of smartphone-based applications for hypertension management. J Am Soc Hypertens 2015 Feb;9(2):130-136. [CrossRef] [Medline]
    13. Buijink A, Visser BJ, Marshall L. Medical apps for smartphones: lack of evidence undermines quality and safety. Evid Based Med 2013 Jun;18(3):90-92. [CrossRef] [Medline]
    14. Attwood S, Parke H, Larsen J, Morton KL. Using a mobile health application to reduce alcohol consumption: a mixed-methods evaluation of the drinkaware track & calculate units application. BMC Public Health 2017 Dec 17;17(1):394 [FREE Full text] [CrossRef] [Medline]
    15. Powell AC, Torous J, Chan S, Raynor GS, Shwarts E, Shanahan M, et al. Interrater reliability of mHealth app rating measures: analysis of top depression and smoking cessation apps. JMIR Mhealth Uhealth 2016 Feb 10;4(1):e15 [FREE Full text] [CrossRef] [Medline]
    16. Patel ML, Hopkins CM, Brooks TL, Bennett GG. Comparing self-monitoring strategies for weight loss in a smartphone app: randomized controlled trial. JMIR Mhealth Uhealth 2019 Feb 28;7(2):e12209 [FREE Full text] [CrossRef] [Medline]
    17. Bardus M, van Beurden SB, Smith J, Abraham C. A review and content analysis of engagement, functionality, aesthetics, information quality, and change techniques in the most popular commercial apps for weight management. Int J Behav Nutr Phys Act 2016 Mar 10;13:35 [FREE Full text] [CrossRef] [Medline]
    18. McKay FH, Cheng C, Wright A, Shill J, Stephens H, Uccellini M. Evaluating mobile phone applications for health behaviour change: a systematic review. J Telemed Telecare 2018 Jan;24(1):22-30. [CrossRef] [Medline]
    19. Michie S, Ashford S, Sniehotta FF, Dombrowski SU, Bishop A, French DP. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: the CALO-RE taxonomy. Psychol Health 2011 Nov;26(11):1479-1498. [CrossRef] [Medline]
    20. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015 Mar 11;3(1):e27 [FREE Full text] [CrossRef] [Medline]
    21. McKay FH, Slykerman S, Dunn M. The app behavior change scale: creation of a scale to assess the potential of apps to promote behavior change. JMIR Mhealth Uhealth 2019 Jan 25;7(1):e11130 [FREE Full text] [CrossRef] [Medline]
    22. Australian Institute of Health and Welfare. 2016. Australia's health 2016   URL: https://www.aihw.gov.au/reports/australias-health/australias-health-2016/contents/summary [accessed 2019-06-12]
    23. Middelweerd A, Mollee J, van der Wal CN, Brug J, Te Velde SJ. Apps to promote physical activity among adults: a review and content analysis. Int J Behav Nutr Phys Act 2014 Jul 25;11:97 [FREE Full text] [CrossRef] [Medline]
    24. Hamamura T, Suganuma S, Ueda M, Mearns J, Shimoyama H. Standalone effects of a cognitive behavioral intervention using a mobile phone app on psychological distress and alcohol consumption among Japanese workers: pilot nonrandomized controlled trial. JMIR Ment Health 2018 Mar 22;5(1):e24 [FREE Full text] [CrossRef] [Medline]
    25. Abroms LC, Lee Westmaas J, Bontemps-Jones J, Ramani R, Mellerson J. A content analysis of popular smartphone apps for smoking cessation. Am J Prev Med 2013 Dec;45(6):732-736 [FREE Full text] [CrossRef] [Medline]
    26. Azar KM, Lesser LI, Laing BY, Stephens J, Aurora MS, Burke LE, et al. Mobile applications for weight management: theory-based content analysis. Am J Prev Med 2013 Nov;45(5):583-589. [CrossRef] [Medline]
    27. Ifejika NL, Noser EA, Grotta JC, Savitz SI. Swipe out stroke: feasibility and efficacy of using a smart-phone based mobile application to improve compliance with weight loss in obese minority stroke patients and their carers. Int J Stroke 2016 Dec;11(5):593-603. [CrossRef] [Medline]
    28. Bakker D, Kazantzis N, Rickwood D, Rickard N. A randomized controlled trial of three smartphone apps for enhancing public mental health. Behav Res Ther 2018 Dec;109:75-83. [CrossRef] [Medline]
    29. Bandura A. Social cognitive theory: an agentic perspective. Annu Rev Psychol 2001;52:1-26. [CrossRef] [Medline]
    30. Harkin B, Webb TL, Chang B, Prestwich A, Conner M, Kellar I, et al. Does monitoring goal progress promote goal attainment? A meta-analysis of the experimental evidence. Psychol Bull 2016 Feb;142(2):198-129. [CrossRef] [Medline]
    31. Olson K, Bond D, Wing RR. Behavioral approaches to the treatment of obesity. R I Med J (2013) 2017 Mar 01;100(2):21-24. [Medline]
    32. Mann DM, Palmisano J, Lin JJ. A pilot randomized trial of technology-assisted goal setting to improve physical activity among primary care patients with prediabetes. Prev Med Rep 2016 Dec;4:107-112 [FREE Full text] [CrossRef] [Medline]
    33. Kazemi DM, Borsari B, Levine M, Shehab M, Nelson M, Dooley B, et al. Real-time demonstration of a mHealth app designed to reduce college students hazardous drinking. Psychol Serv 2019 May;16(2):255-259. [CrossRef] [Medline]
    34. Allan V, Vierimaa M, Gainforth H, Côté J. The use of behaviour change theories and techniques in research-informed coach development programmes: a systematic review. Int Rev Sport Exerc Psychol 2017 Feb 15;11(1):47-69. [CrossRef]
    35. Conroy DE, Yang CH, Maher JP. Behavior change techniques in top-ranked mobile apps for physical activity. Am J Prev Med 2014 Jun;46(6):649-652. [CrossRef] [Medline]
    36. Yang CH, Maher JP, Conroy DE. Implementation of behavior change techniques in mobile applications for physical activity. Am J Prev Med 2015 Apr;48(4):452-455. [CrossRef] [Medline]
    37. Direito A, Dale LP, Shields E, Dobson R, Whittaker R, Maddison R. Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques? BMC Public Health 2014 Jun 25;14:646 [FREE Full text] [CrossRef] [Medline]
    38. Lorencatto F, West R, Bruguera C, Brose L, Michie S. Assessing the quality of goal setting in behavioural support for smoking cessation and its association with outcomes. Ann Behav Med 2016 Apr;50(2):310-318 [FREE Full text] [CrossRef] [Medline]
    39. Kaminer Y, Ohannessian CM, McKay JR, Burke RH, Flannery K. Goal commitment predicts treatment outcome for adolescents with alcohol use disorder. Addict Behav 2018 Jan;76:122-128 [FREE Full text] [CrossRef] [Medline]
    40. Bakker D, Rickard N. Engagement in mobile phone app for self-monitoring of emotional wellbeing predicts changes in mental health: MoodPrism. J Affect Disord 2018 Dec;227:432-442. [CrossRef] [Medline]
    41. Teixeira PJ, Carraça EV, Marques M, Rutter H, Oppert J, De Bourdeaudhuij I, et al. Successful behavior change in obesity interventions in adults: a systematic review of self-regulation mediators. BMC Med 2015 Apr 16;13:84 [FREE Full text] [CrossRef] [Medline]
    42. Think with Google. 2016. Mobile app marketing insights: How consumers really find and use your apps   URL: https://www.thinkwithgoogle.com/consumer-insights/mobile-app-marketing-insights/ [accessed 2019-06-12] [WebCite Cache]
    43. VIC Health. 2015. Guidelines for developing healthy living apps   URL: https:/​/www.​vichealth.vic.gov.au/​-/​media/​Images/​VicHealth/​Images-and-Files/​MediaResources/​HPApps/​Guidelines-Creating-Healthy-Living-Apps.​pdf [accessed 2019-06-12]


    Abbreviations

    ABACUS: App Behavior Change Scale
    MARS: Mobile App Rating Scale
    VicHealth: Victorian Health Promotion Foundation


    Edited by G Eysenbach; submitted 12.08.18; peer-reviewed by J Maher, A Crandall, T Janmohamed, L Lesser; comments to author 12.10.18; revised version received 16.11.18; accepted 25.05.19; published 04.07.19

    ©Fiona H McKay, Annemarie Wright, Jane Shill, Hugh Stephens, Mary Uccellini. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 04.07.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.