This paper is in the following e-collection/theme issue:

Wearables and MHealth Reviews (255) mHealth for Symptom and Disease Monitoring, Chronic Disease Management (1268) mHealth for Wellness, Behavior Change and Prevention (2678) Quality Evaluation and Descriptive Analysis/Reviews of Multiple Existing Mobile Apps (362)

Published on in Vol 10, No 2 (2022): February

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/33168, first published .
The Quality of Health Apps and Their Potential to Promote Behavior Change in Patients With a Chronic Condition or Multimorbidity: Systematic Search in App Store and Google Play

The Quality of Health Apps and Their Potential to Promote Behavior Change in Patients With a Chronic Condition or Multimorbidity: Systematic Search in App Store and Google Play

The Quality of Health Apps and Their Potential to Promote Behavior Change in Patients With a Chronic Condition or Multimorbidity: Systematic Search in App Store and Google Play

Authors of this article:

Alessio Bricca1, 2 Author Orcid Image ;   Alessandro Pellegrini1, 2 Author Orcid Image ;   Graziella Zangger1, 2 Author Orcid Image ;   Jonas Ahler2 Author Orcid Image ;   Madalina Jäger1, 2 Author Orcid Image ;   Søren T Skou1, 2 Author Orcid Image
Article Authors Cited by (13) Tweetations (58) Metrics

    Original Paper

    1Research Unit for Musculoskeletal Function and Physiotherapy, Department of Sports Science and Clinical Biomechanics, University of Southern Denmark, Odense, Denmark

    2The Research Unit PROgrez, Department of Physiotherapy and Occupational Therapy, Næstved-Slagelse-Ringsted Hospitals, Slagelse, Denmark

    Corresponding Author:

    Alessio Bricca, PhD

    Research Unit for Musculoskeletal Function and Physiotherapy

    Department of Sports Science and Clinical Biomechanics

    University of Southern Denmark

    Campusvej 55

    Odense, 5260

    Denmark

    Phone: 45 65509510

    Email: abricca@health.sdu.dk


    Background: Mobile apps offer an opportunity to improve the lifestyle of patients with chronic conditions or multimorbidity. However, for apps to be recommended in clinical practice, their quality and potential for promoting behavior change must be considered.

    Objective: We aimed to investigate the quality of health apps for patients with a chronic condition or multimorbidity (defined as 2 or more chronic conditions) and their potential for promoting behavior change.

    Methods: We followed the Cochrane Handbook guidelines to conduct and report this study. A systematic search of apps available in English or Danish on App Store (Apple Inc) and Google Play (Google LLC) for patients with 1 or more of the following common and disabling conditions was conducted: osteoarthritis, heart conditions (heart failure and ischemic heart disease), hypertension, type 2 diabetes mellitus, depression, and chronic obstructive pulmonary disease. For the search strategy, keywords related to these conditions were combined. One author screened the titles and content of the identified apps. Subsequently, 3 authors independently downloaded the apps onto a smartphone and assessed the quality of the apps and their potential for promoting behavior change by using the Mobile App Rating Scale (MARS; number of items: 23; score: range 0-5 [higher is better]) and the App Behavior Change Scale (ABACUS; number of items: 21; score: range 0-21 [higher is better]), respectively. We included the five highest-rated apps and the five most downloaded apps but only assessed free content for their quality and potential for promoting behavior change.

    Results: We screened 453 apps and ultimately included 60. Of the 60 apps, 35 (58%) were available in both App Store and Google Play. The overall average quality score of the apps was 3.48 (SD 0.28) on the MARS, and their overall average score for their potential to promote behavior change was 8.07 (SD 2.30) on the ABACUS. Apps for depression and apps for patients with multimorbidity tended to have higher overall MARS and ABACUS scores, respectively. The most common app features for supporting behavior change were the self-monitoring of physiological parameters (eg, blood pressure monitoring; apps: 38/60, 63%), weight and diet (apps: 25/60, 42%), or physical activity (apps: 22/60, 37%) and stress management (apps: 22/60, 37%). Only 8 out of the 60 apps (13%) were completely free.

    Conclusions: Apps for patients with a chronic condition or multimorbidity appear to be of acceptable quality but have low to moderate potential for promoting behavior change. Our results provide a useful overview for patients and clinicians who would like to use apps for managing chronic conditions and indicate the need to improve health apps in terms of their quality and potential for promoting behavior change.

    JMIR Mhealth Uhealth 2022;10(2):e33168

    doi:10.2196/33168

    Keywords

    app; self-management; behavior change; multimorbidity; chronic conditions; health apps; mHealth; mobile health; mobile phone 


    Osteoarthritis, hypertension, type 2 diabetes, depression, heart conditions, and chronic obstructive pulmonary disease are among the leading causes of global disability [1]. These conditions affect millions of people worldwide and are commonly co-occurring (ie, multimorbidity) [2]. Patients with chronic conditions have poorer physical and psychosocial health than those of people without such conditions, and the higher the number of co-occurring conditions, the greater the impact on the individual and society [3,4]. Importantly, these conditions can be prevented and managed by a healthy lifestyle, highlighting the importance of investigating this population [5].

    A healthy lifestyle, which includes physical activity and a healthy diet, is associated with up to a 6.3-year longer lifespan for men and a 7.6-year longer lifespan for women with 1 or more chronic conditions [6]. Different care models and interventions have been designed and implemented for people with multiple chronic conditions [7]. Although there is a paucity of information about the effects of these interventions, physical activity appears safe and beneficial for people with 1 or more chronic conditions [8,9]. The use of mobile apps to improve lifestyle has increasingly gained attention, particularly among patients with chronic conditions at any stage of their lives [10-14]. Apps may offer an opportunity to improve the lifestyles of patients with chronic conditions through, for example, self-monitoring and behavior change by providing access to personalized support and motivation anytime [15,16]. However, although apps are widely used (in 2019, more than 204 billion apps were downloaded) [17], their quality (eg, engagement and functionality), content, and potential for promoting behavior change are unclear [18]. Therefore, this study aimed to provide an overview of available health apps and their quality, content, and potential to promote behavior change in patients living with a chronic condition or multimorbidity.


    This systematic search of health apps was guided by the recommendations for performing systematic reviews in the Cochrane Handbook [19], and the protocol was made available prior to the app screening phase on Open Science Framework [20].

    Eligibility Criteria

    We included apps that targeted lifestyle behaviors, such as physical activity and diet, and were directed at patients with 1 or more of the following conditions (multimorbidity): osteoarthritis of the knee or hip, heart conditions (heart failure and ischemic heart disease), hypertension, type 2 diabetes mellitus, chronic obstructive pulmonary disease, and depression. The rationale for focusing on these conditions was that they share a common risk factor (physical inactivity) and pathogenesis (systemic low-grade inflammation) and the fact that they are highly prevalent and can co-occur with each other. Therefore, the anti-inflammatory effects of lifestyle behaviors may improve the health of this population [21].

    Search Strategy and App Selection

    We searched the Apple App Store (Apple Inc; iOS) and Google Play Store (Google LLC; Android) for Danish and English apps. Two authors (AB and AP) designed the search strategy (Table S1 in Multimedia Appendix 1), which was adapted from a prior systematic review [8,22]. One author (AP) performed the search in October 2020 and screened the titles and descriptions of the apps. Three authors (AP, GZ, and JA) independently downloaded the apps onto a smartphone. In pairs, they assessed the quality of the apps and their potential for promoting behavior change by using the Mobile App Rating Scale (MARS; number of items: 23) and the App Behavior Change Scale (ABACUS; number of items: 21), respectively. The five highest-rated apps and the five most downloaded apps were included. Quality and potential for promoting behavior change were only assessed for the free apps, given that the cost to purchase apps is a barrier to using mobile health apps [23]. Furthermore, apps were excluded if they did not target patients (eg, apps that targeted clinicians or organizations).

    Data Extraction and Outcomes

    A complete overview of the data extraction process is available in the study protocol [20]. The following outcomes were assessed: app quality and the potential to promote behavior change.

    App quality was assessed by using the MARS [24]. This validated and objective tool allows for the classification and assessment of the quality of apps. It is a 23-item scale that includes the following five categories: engagement, functionality, aesthetics, information quality, and subjective quality. Each item is assessed on a 5-point scale (1=inadequate; 2=poor; 3=acceptable; 4=good; 5=excellent).

    The potential for behavior change was assessed by using the ABACUS [25]. This validated and objective tool includes 21 items that are grouped into the following four categories: knowledge and information, goals and planning, feedback and monitoring, and actions. The score for each item is dichotomous (yes or no), and an overall score (range 0-21) can be calculated. The higher the score, the higher the potential for promoting behavior change.

    In addition, we extracted the characteristics of the apps, such as the number and type of self-monitoring tools (eg, a step count and BMI calculator), by using the 42matters website [26] for data that were not available in the iOS and Android stores. Mean scores for the MARS and ABACUS were calculated by averaging the ratings across all of the domains of the scales. The SDs were estimated accordingly.

    Synthesis of Results

    We performed a narrative synthesis of the results and presented the results in a tabular and graphical format.


    App Selection and Characteristics

    A total of 453 apps were identified, of which 150 were downloaded and screened for potential eligibility, and 60 were ultimately included (Figure S1 in Multimedia Appendix 1). Most of the included apps (35/60, 58%) were available for both iOS and Android. The apps were all available in English, and 25 out of the 60 apps (42%) were also available in other languages, including Danish, Arabic, and Chinese. The app size varied from 2.4 MB to 278 MB. Table S2 in Multimedia Appendix 1 presents a complete description of the apps.

    Quality of the Apps

    The overall quality of the apps was acceptable (MARS score: mean 3.48, SD 0.28; range 0-5). However, apps for depression tended to have a higher overall MARS score (mean 3.89, SD 0.13), and apps for osteoarthritis tended to have a lower overall score (mean 3.0, SD 0.48) and lower scores for individual items of the MARS (Tables S3 and S4 in Multimedia Appendix 1).

    Apps’ Potential to Promote Behavior Change

    The overall potential for behavior change was low to moderate (ABACUS score: mean 8.07, SD 2.30; range 0-21). Apps for patients with multimorbidity tended to have a higher overall ABACUS score (mean 12.0, SD 3.03), while apps for osteoarthritis tended to have the lowest overall scores (mean 4.22, SD 2.39) and the lowest scores for the individual categories of the ABACUS (Figure 1, Table S5 in Multimedia Appendix 1).

    ‎
    Figure 1. Summary of the findings for the quality of apps for osteoarthritis, hypertension, type 2 diabetes, depression, heart conditions, COPD, and multimorbidity and their potential for promoting behavior change. ABACUS: App Behavior Change Scale; COPD: chronic obstructive pulmonary disease; MARS: Mobile App Rating Scale.
    View this figure

    Features of the Apps That Supported Behavior Change

    The most common features presented in the apps that supported behavior change were the self-monitoring of physiological parameters (eg, blood pressure monitoring; apps: 38/60, 63%), weight and diet (apps: 25/60, 42%), or physical activity (apps: 22/60, 37%) and stress management (apps: 22/60, 37%). Only 8 out of the 60 apps (13%) were completely free.


    Principal Findings

    To the best of our knowledge, this is the first study to assess the quality of health apps for patients with 1 or more chronic conditions and their potential for promoting behavior change. The assessed apps' quality is acceptable, but their potential for promoting behavior change in patients with osteoarthritis, hypertension, type 2 diabetes, depression, heart conditions, chronic obstructive pulmonary disease, or multimorbidity is low to moderate. This highlights the need for future studies to develop and evaluate apps with both high quality and high potential for promoting behavior change in patients with chronic conditions and multimorbidity.

    The results of this study are comparable to the results of systematic reviews that investigated apps’ quality and potential for promoting behavior change in patients with a single chronic condition [27-29]. In these reviews, both low to moderate quality and low to moderate potential for promoting behavior change were found. Apps for multimorbidity tended to have higher quality and higher potential for promoting behavior change than those of apps for a single chronic condition despite the fact that research on multimorbidity is still in its infancy [30]. Future app studies should focus on improving quality and the potential for behavior change, especially among apps for conditions such as osteoarthritis, which had the lowest-quality apps [28,31]. Future studies should also test the effectiveness of apps via high-quality randomized controlled trials.

    The features of the apps were similar across the chronic conditions, including multimorbidity, and focused mainly on the self-monitoring and tracking of physiological and behavioral parameters, such as medication intake, step count, and diet. In contrast, only a minority of apps (22/60, 37%) focused on psychosocial support, although mental and social health plays a major role in managing chronic conditions and multimorbidity [32-34]. This should be kept in mind when designing new apps.

    Most of the top-rated and most downloaded apps for patients with a chronic condition or multimorbidity were not completely free (52/60, 87%). Notably, there were no free apps for depression. Nevertheless, the quality of apps for depression and their potential for behavior change were higher than those of apps for osteoarthritis, and 78% (7/9) of osteoarthritis apps were completely free. Although the development of apps has a cost, 1 in 2 smartphone users have never paid for an app [35], and the cost of apps is a barrier to using them [23]. This should be considered when designing new app-based interventions.

    Limitations

    A possible limitation of this study is that we only assessed the free content of the apps. However, the potential for promoting behavior change appeared to be similar among free apps and apps with in-app purchases [27]. Furthermore, we only focused on English or Danish apps, meaning that our findings may not be generalizable to apps in other languages. We were also unable to identify apps targeting patients with ischemic heart disease and extract data on the characteristics of people who downloaded the apps (eg, age). This limited the generalizability of the findings related to apps for heart conditions to apps for patients with heart failure. This also limited our ability to conduct stratified subgroup assessments. Finally, the limited number of apps available for each condition prevented the meaningful comparison of the MARS and ABACUS subscales within and between conditions.

    Conclusions

    Our results provide patients and clinicians with an overview of apps for managing 1 or more chronic conditions and indicate the need to improve the quality of apps and their potential for promoting behavior change, particularly among apps for patients with osteoarthritis.

    Acknowledgments

    We would like to acknowledge Benedicte Lauge Hansen for conducting a pilot search of apps targeting patients with 1 or more chronic conditions as part of her internship. This study was funded by the European Research Council under the European Union’s Horizon 2020 research and innovation program (MOBILIZE; grant 801790); Næstved, Slagelse and Ringsted Hospitals’ Research Fund; and The Association of Danish Physiotherapists Research Fund and Region Zealand (Exercise First). The funding sources were not involved in any aspect of this work.

    Authors' Contributions

    STS procured the funding for this work. AB, MJ, and STS drafted the protocol, and AP finalized it. AB and AP designed the search strategy. AP screened the titles and descriptions of the apps, and AP, JA, and GZ independently extracted data from the included apps and assessed their quality and potential for behavior change. AB wrote the manuscript. All authors read, provided feedback for, and approved the study design, methods, protocol, and manuscript drafts as well as approved the final manuscript.

    Conflicts of Interest

    STS has received grants from The Lundbeck Foundation and personal fees from Munksgaard and TrustMe-Ed, of which all are outside the submitted work. STS is a cofounder of GLA:D (Good Life With osteoArthritis in Denmark), a not-for-profit initiative hosted at University of Southern Denmark that aims to implement clinical guidelines for osteoarthritis in clinical practice.

    ‎
    Multimedia Appendix 1

    Supplementary tables and figures.

    DOCX File , 126 KB
    1. GBD 2019 Diseases and Injuries Collaborators. Global burden of 369 diseases and injuries in 204 countries and territories, 1990-2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet 2020 Oct 17;396(10258):1204-1222 [FREE Full text] [CrossRef] [Medline]
    2. Bayliss EA, Bayliss MS, Ware Jr JE, Steiner JF. Predicting declines in physical function in persons with multiple chronic medical conditions: what we can learn from the medical problem list. Health Qual Life Outcomes 2004 Sep 07;2:47 [FREE Full text] [CrossRef] [Medline]
    3. Navickas R, Petric VK, Feigl AB, Seychell M. Multimorbidity: What do we know? What should we do? J Comorb 2016 Feb 17;6(1):4-11 [FREE Full text] [CrossRef] [Medline]
    4. Vogeli C, Shields AE, Lee TA, Gibson TB, Marder WD, Weiss KB, et al. Multiple chronic conditions: prevalence, health consequences, and implications for quality, care management, and costs. J Gen Intern Med 2007 Dec;22 Suppl 3(Suppl 3):391-395 [FREE Full text] [CrossRef] [Medline]
    5. Ioakeim-Skoufa I, Poblador-Plou B, Carmona-Pírez J, Díez-Manglano J, Navickas R, Gimeno-Feliu LA, et al. Multimorbidity patterns in the general population: Results from the EpiChron Cohort Study. Int J Environ Res Public Health 2020 Jun 14;17(12):4242 [FREE Full text] [CrossRef] [Medline]
    6. Chudasama YV, Khunti K, Gillies CL, Dhalwani NN, Davies MJ, Yates T, et al. Healthy lifestyle and life expectancy in people with multimorbidity in the UK Biobank: A longitudinal cohort study. PLoS Med 2020 Sep 22;17(9):e1003332. [CrossRef] [Medline]
    7. Smith SM, Wallace E, O'Dowd T, Fortin M. Interventions for improving outcomes in patients with multimorbidity in primary care and community settings. Cochrane Database Syst Rev 2021 Jan 15;1(1):CD006560 [FREE Full text] [CrossRef] [Medline]
    8. Bricca A, Harris LK, Jäger M, Smith SM, Juhl CB, Skou ST. Benefits and harms of exercise therapy in people with multimorbidity: A systematic review and meta-analysis of randomised controlled trials. Ageing Res Rev 2020 Nov;63:101166 [FREE Full text] [CrossRef] [Medline]
    9. Pedersen BK, Saltin B. Exercise as medicine - evidence for prescribing exercise as therapy in 26 different chronic diseases. Scand J Med Sci Sports 2015 Dec;25 Suppl 3:1-72. [CrossRef] [Medline]
    10. Liu K, Xie Z, Or CK. Effectiveness of mobile app-assisted self-care interventions for improving patient outcomes in type 2 diabetes and/or hypertension: Systematic review and meta-analysis of randomized controlled trials. JMIR Mhealth Uhealth 2020 Aug 04;8(8):e15779 [FREE Full text] [CrossRef] [Medline]
    11. Mahmood A, Kedia S, Wyant DK, Ahn S, Bhuyan SS. Use of mobile health applications for health-promoting behavior among individuals with chronic medical conditions. Digit Health 2019 Oct 10;5:2055207619882181 [FREE Full text] [CrossRef] [Medline]
    12. Matthew-Maich N, Harris L, Ploeg J, Markle-Reid M, Valaitis R, Ibrahim S, et al. Designing, implementing, and evaluating mobile health technologies for managing chronic conditions in older adults: A scoping review. JMIR Mhealth Uhealth 2016 Jun 09;4(2):e29 [FREE Full text] [CrossRef] [Medline]
    13. Nelligan RK, Hinman RS, Atkins L, Bennell KL. A short message service intervention to support adherence to home-based strengthening exercise for people with knee osteoarthritis: Intervention design applying the behavior change wheel. JMIR Mhealth Uhealth 2019 Oct 18;7(10):e14619 [FREE Full text] [CrossRef] [Medline]
    14. Gray CS, Wodchis WP, Upshur R, Cott C, McKinstry B, Mercer S, Project Collaborators And Technology Partner‚ QoC Health Inc. Supporting goal-oriented primary health care for seniors with complex care needs using mobile technology: Evaluation and implementation of the Health System Performance Research Network, Bridgepoint Electronic Patient Reported Outcome Tool. JMIR Res Protoc 2016 Jun 24;5(2):e126 [FREE Full text] [CrossRef] [Medline]
    15. Direito A, Dale LP, Shields E, Dobson R, Whittaker R, Maddison R. Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques? BMC Public Health 2014 Jun 25;14:646 [FREE Full text] [CrossRef] [Medline]
    16. Middelweerd A, Mollee JS, van der Wal CN, Brug J, Te Velde SJ. Apps to promote physical activity among adults: a review and content analysis. Int J Behav Nutr Phys Act 2014 Jul 25;11:97 [FREE Full text] [CrossRef] [Medline]
    17. Sydow L. The state of mobile in 2020: The key stats you need to know. App Annie.   URL: https://www.appannie.com/en/insights/market-data/state-of-mobile-2020-infographic/ [accessed 2020-08-26]
    18. Byambasuren O, Sanders S, Beller E, Glasziou P. Prescribable mHealth apps identified from an overview of systematic reviews. NPJ Digit Med 2018 May 09;1:12 [FREE Full text] [CrossRef] [Medline]
    19. Cochrane Handbook for Systematic Reviews of Interventions, Version 6, 2019. Cochrane Training. 2019.   URL: https://training.cochrane.org/handbook/archive/v6 [accessed 2022-02-01]
    20. Bricca A, Jäger M, Skou ST, Pihl K, Harris LK, Dideriksen M. Mobile health applications (apps) to support self-management in people living with a chronic condition or multimorbidity: A systematic search in App Store and Google Play. Open Science Framework.   URL: https://osf.io/4xkpt/ [accessed 2022-01-27]
    21. Gleeson M, Bishop NC, Stensel DJ, Lindley MR, Mastana SS, Nimmo MA. The anti-inflammatory effects of exercise: mechanisms and implications for the prevention and treatment of disease. Nat Rev Immunol 2011 Aug 05;11(9):607-615. [CrossRef] [Medline]
    22. Bricca A, Harris LK, Saracutu M, Smith SM, Juhl CB, Skou ST. The benefits and harms of therapeutic exercise on physical and psychosocial outcomes in people with multimorbidity: Protocol for a systematic review. J Comorb 2020 May 12;10:2235042X20920458 [FREE Full text] [CrossRef] [Medline]
    23. Wilson J, Heinsch M, Betts D, Booth D, Kay-Lambkin F. Barriers and facilitators to the use of e-health by older adults: a scoping review. BMC Public Health 2021 Aug 17;21(1):1556 [FREE Full text] [CrossRef] [Medline]
    24. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015 Mar 11;3(1):e27 [FREE Full text] [CrossRef] [Medline]
    25. McKay FH, Slykerman S, Dunn M. The App Behavior Change Scale: Creation of a scale to assess the potential of apps to promote behavior change. JMIR Mhealth Uhealth 2019 Jan 25;7(1):e11130 [FREE Full text] [CrossRef] [Medline]
    26. Mobile app intelligence. 42matters.   URL: https://42matters.com/ [accessed 2020-10-25]
    27. Alessa T, Hawley MS, Hock ES, de Witte L. Smartphone apps to support self-management of hypertension: Review and content analysis. JMIR Mhealth Uhealth 2019 May 28;7(5):e13645 [FREE Full text] [CrossRef] [Medline]
    28. Choi W, Zheng H, Franklin P, Tulu B. mHealth technologies for osteoarthritis self-management and treatment: A systematic review. Health Informatics J 2019 Sep;25(3):984-1003 [FREE Full text] [CrossRef] [Medline]
    29. Wali S, Demers C, Shah H, Wali H, Lim D, Naik N, et al. Evaluation of heart failure apps to promote self-care: Systematic app search. JMIR Mhealth Uhealth 2019 Nov 11;7(11):e13173 [FREE Full text] [CrossRef] [Medline]
    30. The Lancet. Making more of multimorbidity: an emerging priority. Lancet 2018 Apr 28;391(10131):1637. [CrossRef] [Medline]
    31. Martínez-Pérez B, de la Torre-Díez I, López-Coronado M. Mobile health applications for the most prevalent conditions by the World Health Organization: review and analysis. J Med Internet Res 2013 Jun 14;15(6):e120 [FREE Full text] [CrossRef] [Medline]
    32. Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet 2012 Jul 07;380(9836):37-43 [FREE Full text] [CrossRef] [Medline]
    33. de Alba IGF, Gimeno-Miguel A, Poblador-Plou B, Gimeno-Feliu LA, Ioakeim-Skoufa I, Rojo-Martínez G, et al. Association between mental health comorbidity and health outcomes in type 2 diabetes mellitus patients. Sci Rep 2020 Nov 11;10(1):19583 [FREE Full text] [CrossRef] [Medline]
    34. Triolo F, Harber-Aschan L, Murri MB, Calderón-Larrañaga A, Vetrano DL, Sjöberg L, et al. The complex interplay between depression and multimorbidity in late life: risks and pathways. Mech Ageing Dev 2020 Dec;192:111383 [FREE Full text] [CrossRef] [Medline]
    35. How people discover, use, and stay engaged with apps. Think with Google. 2016 Oct.   URL: https://www.thinkwithgoogle.com/_qs/documents/331/how-users-discover-use-apps-google-research.pdf [accessed 2021-08-22]

    ‎
    ABACUS: App Behavior Change Scale
    GLA:D: Good Life With osteoArthritis in Denmark
    MARS: Mobile App Rating Scale

    Edited by L Buis; submitted 26.08.21; peer-reviewed by S Davis, I Ioakeim Skoufa, B Chaudhry; comments to author 18.10.21; revised version received 29.10.21; accepted 07.12.21; published 04.02.22

    Copyright

    ©Alessio Bricca, Alessandro Pellegrini, Graziella Zangger, Jonas Ahler, Madalina Jäger, Søren T Skou. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 04.02.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.