This paper is in the following e-collection/theme issue:

Wearables and MHealth Reviews (276) Evaluation and Research Methodology for mHealth (210) Engagement with and Adherence to Digital Health Interventions, Law of Attrition (505)

Published on in Vol 7, No 1 (2019): January

This is a member publication of Centre for Global eHealth Innovation, Toronto, ON, Canada

A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review

A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review

A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review

Authors of this article:

Quynh Pham1, 2 Author Orcid Image ;   Gary Graham2 Author Orcid Image ;   Carme Carrion3, 4 Author Orcid Image ;   Plinio P Morita1, 5 Author Orcid Image ;   Emily Seto1, 2 Author Orcid Image ;   Jennifer N Stinson6, 7, 8, 9 Author Orcid Image ;   Joseph A Cafazzo1, 2, 10 Author Orcid Image
Article Authors Cited by (80) Tweetations (78) Metrics

Journals

  1. Lo B, Shi J, Hollenberg E, Abi-Jaoudé A, Johnson A, Wiljer D. Surveying the Role of Analytics in Evaluating Digital Mental Health Interventions for Transition-Aged Youth: Scoping Review. JMIR Mental Health 2020;7(6):e15942 View
  2. Elbers S, Pool J, Wittink H, Köke A, Scheffer E, Smeets R. Mobile Health App (AGRIPPA) to Prevent Relapse After Successful Interdisciplinary Treatment for Patients With Chronic Pain: Protocol for a Randomized Controlled Trial. JMIR Research Protocols 2020;9(8):e18632 View
  3. Graham A, Greene C, Kwasny M, Kaiser S, Lieponis P, Powell T, Mohr D. Coached Mobile App Platform for the Treatment of Depression and Anxiety Among Primary Care Patients. JAMA Psychiatry 2020;77(9):906 View
  4. Wykes T, Schueller S. Why Reviewing Apps Is Not Enough: Transparency for Trust (T4T) Principles of Responsible Health App Marketplaces. Journal of Medical Internet Research 2019;21(5):e12390 View
  5. Weerahandi H, Paul S, Quintiliani L, Chokshi S, Mann D. A Mobile Health Coaching Intervention for Controlling Hypertension: Single-Arm Pilot Pre-Post Study. JMIR Formative Research 2020;4(5):e13989 View
  6. Mohr D, Schueller S, Tomasino K, Kaiser S, Alam N, Karr C, Vergara J, Gray E, Kwasny M, Lattie E. Comparison of the Effects of Coaching and Receipt of App Recommendations on Depression, Anxiety, and Engagement in the IntelliCare Platform: Factorial Randomized Controlled Trial. Journal of Medical Internet Research 2019;21(8):e13609 View
  7. Perski O, Lumsden J, Garnett C, Blandford A, West R, Michie S. Assessing the Psychometric Properties of the Digital Behavior Change Intervention Engagement Scale in Users of an App for Reducing Alcohol Consumption: Evaluation Study. Journal of Medical Internet Research 2019;21(11):e16197 View
  8. Yang Q, Hatch D, Crowley M, Lewinski A, Vaughn J, Steinberg D, Vorderstrasse A, Jiang M, Shaw R. Digital Phenotyping Self-Monitoring Behaviors for Individuals With Type 2 Diabetes Mellitus: Observational Study Using Latent Class Growth Analysis. JMIR mHealth and uHealth 2020;8(6):e17730 View
  9. Baranowski T, Lyons E. Scoping Review of Pokémon Go: Comprehensive Assessment of Augmented Reality for Physical Activity Change. Games for Health Journal 2020;9(2):71 View
  10. Figueroa C, DeMasi O, Hernandez-Ramos R, Aguilera A. Who Benefits Most from Adding Technology to Depression Treatment and How? An Analysis of Engagement with a Texting Adjunct for Psychotherapy. Telemedicine and e-Health 2021;27(1):39 View
  11. Robles N, Puigdomènech Puig E, Gómez-Calderón C, Saigí-Rubió F, Cuatrecasas Cambra G, Zamora A, Moharra M, Paluzié G, Balfegó M, Carrion C. Evaluation Criteria for Weight Management Apps: Validation Using a Modified Delphi Process. JMIR mHealth and uHealth 2020;8(7):e16899 View
  12. Pham Q, Shaw J, Morita P, Seto E, Stinson J, Cafazzo J. The Service of Research Analytics to Optimize Digital Health Evidence Generation: Multilevel Case Study. Journal of Medical Internet Research 2019;21(11):e14849 View
  13. Edney S, Ryan J, Olds T, Monroe C, Fraysse F, Vandelanotte C, Plotnikoff R, Curtis R, Maher C. User Engagement and Attrition in an App-Based Physical Activity Intervention: Secondary Analysis of a Randomized Controlled Trial. Journal of Medical Internet Research 2019;21(11):e14645 View
  14. Zhang R, Nicholas J, Knapp A, Graham A, Gray E, Kwasny M, Reddy M, Mohr D. Clinically Meaningful Use of Mental Health Apps and its Effects on Depression: Mixed Methods Study. Journal of Medical Internet Research 2019;21(12):e15644 View
  15. Sanatkar S, Baldwin P, Huckvale K, Clarke J, Christensen H, Harvey S, Proudfoot J. Using Cluster Analysis to Explore Engagement and e-Attainment as Emergent Behavior in Electronic Mental Health. Journal of Medical Internet Research 2019;21(11):e14728 View
  16. Lalloo C, Harris L, Hundert A, Berard R, Cafazzo J, Connelly M, Feldman B, Houghton K, Huber A, Laxer R, Luca N, Schmeling H, Spiegel L, Tucker L, Pham Q, Davies-Chalmers C, Stinson J. The iCanCope pain self-management application for adolescents with juvenile idiopathic arthritis: a pilot randomized controlled trial. Rheumatology 2021;60(1):196 View
  17. Alessa T, S Hawley M, Alsulamy N, de Witte L. Using a Commercially Available App for the Self-Management of Hypertension: Acceptance and Usability Study in Saudi Arabia. JMIR mHealth and uHealth 2021;9(2):e24177 View
  18. Bruehlman-Senecal E, Hook C, Pfeifer J, FitzGerald C, Davis B, Delucchi K, Haritatos J, Ramo D. Smartphone App to Address Loneliness Among College Students: Pilot Randomized Controlled Trial. JMIR Mental Health 2020;7(10):e21496 View
  19. Teckie S, Solomon J, Kadapa K, Sanchez K, Orner D, Kraus D, Kamdar D, Pereira L, Frank D, Diefenbach M. A Mobile Patient-Facing App for Tracking Patient-Reported Outcomes in Head and Neck Cancer Survivors: Single-Arm Feasibility Study. JMIR Formative Research 2021;5(3):e24667 View
  20. Lopez K, Cravero C, Krishnan A, Carvalho de Sousa Freire V, Culbert G. Feasibility of a mHealth survey application for incarcerated and postrelease people living with HIV in a low‐resource setting. Research in Nursing & Health 2021;44(1):201 View
  21. Kondylakis H, Axenie C, (Kiran) Bastola D, Katehakis D, Kouroubali A, Kurz D, Larburu N, Macía I, Maguire R, Maramis C, Marias K, Morrow P, Muro N, Núñez-Benjumea F, Rampun A, Rivera-Romero O, Scotney B, Signorelli G, Wang H, Tsiknakis M, Zwiggelaar R. Status and Recommendations of Technological and Data-Driven Innovations in Cancer Care: Focus Group Study. Journal of Medical Internet Research 2020;22(12):e22034 View
  22. Bell L, Garnett C, Qian T, Perski O, Williamson E, Potts H. Engagement With a Behavior Change App for Alcohol Reduction: Data Visualization for Longitudinal Observational Study. Journal of Medical Internet Research 2020;22(12):e23369 View
  23. Shi J, Lo B, Wong H, Hollenberg E, Sanches M, Abi-Jaoudé A, Chaim G, Cleverley K, Henderson J, Johnson A, Levinson A, Pham Q, Robb J, Voineskos A, Wiljer D. Assessing the usability and user engagement of Thought Spot - A digital mental health help-seeking solution for transition-aged youth. Internet Interventions 2021;24:100386 View
  24. Perski O, Watson N, Mull K, Bricker J. Identifying Content-Based Engagement Patterns in a Smoking Cessation Website and Associations With User Characteristics and Cessation Outcomes: A Sequence and Cluster Analysis. Nicotine & Tobacco Research 2021;23(7):1103 View
  25. Juengst S, Terhorst L, Nabasny A, Wallace T, Weaver J, Osborne C, Burns S, Wright B, Wen P, Kew C, Morris J. Use of mHealth Technology for Patient-Reported Outcomes in Community-Dwelling Adults with Acquired Brain Injuries: A Scoping Review. International Journal of Environmental Research and Public Health 2021;18(4):2173 View
  26. Miller S, Yardley L, Smith P, Weal M, Anderson A, Stuart B, Little P, Morrison L. A Digital Intervention for Respiratory Tract Infections (Internet Dr): Process Evaluation to Understand How to Support Self-care for Minor Ailments. JMIR Formative Research 2022;6(1):e24239 View
  27. Wu D, An J, Yu P, Lin H, Ma L, Duan H, Deng N. Patterns for Patient Engagement with the Hypertension Management and Effects of Electronic Health Care Provider Follow-up on These Patterns: Cluster Analysis. Journal of Medical Internet Research 2021;23(9):e25630 View
  28. Garety P, Ward T, Emsley R, Greenwood K, Freeman D, Fowler D, Kuipers E, Bebbington P, Dunn G, Hardy A. Digitally supported CBT to reduce paranoia and improve reasoning for people with schizophrenia-spectrum psychosis: the SlowMo RCT. Efficacy and Mechanism Evaluation 2021;8(11):1 View
  29. Wu D, Huyan X, She Y, Hu J, Duan H, Deng N. Exploring and Characterizing Patient Multibehavior Engagement Trails and Patient Behavior Preference Patterns in Pathway-Based mHealth Hypertension Self-Management: Analysis of Use Data. JMIR mHealth and uHealth 2022;10(2):e33189 View
  30. Baglione A, Cai L, Bahrini A, Posey I, Boukhechba M, Chow P. Understanding the Relationship Between Mood Symptoms and Mobile App Engagement Among Patients With Breast Cancer Using Machine Learning: Case Study. JMIR Medical Informatics 2022;10(6):e30712 View
  31. Yeager C, Benight C. Engagement, Predictors, and Outcomes of a Trauma Recovery Digital Mental Health Intervention: Longitudinal Study. JMIR Mental Health 2022;9(5):e35048 View
  32. Van Baelen F, De Regge M, Larivière B, Verleye K, Schelfout S, Eeckloo K. Role of Social and App-Related Factors in Behavioral Engagement With mHealth for Improved Well-being Among Chronically Ill Patients: Scenario-Based Survey Study. JMIR mHealth and uHealth 2022;10(8):e33772 View
  33. Lockwood J, Williams L, Martin J, Rathee M, Hill C. Effectiveness, User Engagement and Experience, and Safety of a Mobile App (Lumi Nova) Delivering Exposure-Based Cognitive Behavioral Therapy Strategies to Manage Anxiety in Children via Immersive Gaming Technology: Preliminary Evaluation Study. JMIR Mental Health 2022;9(1):e29008 View
  34. Molloy A, Anderson P. Engagement with mobile health interventions for depression: A systematic review. Internet Interventions 2021;26:100454 View
  35. Dullabh P, Sandberg S, Heaney-Huls K, Hovey L, Lobach D, Boxwala A, Desai P, Berliner E, Dymek C, Harrison M, Swiger J, Sittig D. Challenges and opportunities for advancing patient-centered clinical decision support: findings from a horizon scan. Journal of the American Medical Informatics Association 2022;29(7):1233 View
  36. Madujibeya I, Lennie T, Aroh A, Chung M, Moser D. Measures of Engagement With mHealth Interventions in Patients With Heart Failure: Scoping Review. JMIR mHealth and uHealth 2022;10(8):e35657 View
  37. Van Schalkwyk A, Grobbelaar S, Vermeulen E, Herselman M. A Scoping Review of the Use of Log Data for Evaluating Mobile Apps: Exploring Implications for mHealth Apps. IEEE Access 2022;10:124805 View
  38. Rookes T, Schrag A, Walters K, Armstrong M. Measures of fidelity of delivery and engagement in self-management interventions: A systematic review of measures. Clinical Trials 2022;19(6):665 View
  39. Matcham F, Leightley D, Siddi S, Lamers F, White K, Annas P, de Girolamo G, Difrancesco S, Haro J, Horsfall M, Ivan A, Lavelle G, Li Q, Lombardini F, Mohr D, Narayan V, Oetzmann C, Penninx B, Bruce S, Nica R, Simblett S, Wykes T, Brasen J, Myin-Germeys I, Rintala A, Conde P, Dobson R, Folarin A, Stewart C, Ranjan Y, Rashid Z, Cummins N, Manyakov N, Vairavan S, Hotopf M. Remote Assessment of Disease and Relapse in Major Depressive Disorder (RADAR-MDD): recruitment, retention, and data availability in a longitudinal remote measurement study. BMC Psychiatry 2022;22(1) View
  40. Ramadurai R, Beckham E, McHugh R, Björgvinsson T, Beard C. Operationalizing Engagement With an Interpretation Bias Smartphone App Intervention: Case Series. JMIR Mental Health 2022;9(8):e33545 View
  41. Cao W, Milks M, Liu X, Gregory M, Addison D, Zhang P, Li L. mHealth Interventions for Self-management of Hypertension: Framework and Systematic Review on Engagement, Interactivity, and Tailoring. JMIR mHealth and uHealth 2022;10(3):e29415 View
  42. Kunchay S, Linden-Carmichael A, Lanza S, Abdullah S. Understanding Design Approaches and Evaluation Methods in mHealth Apps Targeting Substance Use: Protocol for a Systematic Review. JMIR Research Protocols 2022;11(7):e35749 View
  43. You K, Delaney R, McKinley N, Healy P, Thomas T. Who Engages and Why It Matters?. International Journal of Gaming and Computer-Mediated Simulations 2023;15(1):1 View
  44. Armbruster C, Knaub M, Farin-Glattacker E, von der Warth R. Predictors of Adherence to Cancer-Related mHealth Apps in Cancer Patients Undergoing Oncological or Follow-Up Treatment—A Scoping Review. International Journal of Environmental Research and Public Health 2022;19(20):13689 View
  45. Delaney T, Mclaughlin M, Hall A, Yoong S, Brown A, O'Brien K, Dray J, Barnes C, Hollis J, Wyse R, Wiggers J, Sutherland R, Wolfenden L. Associations between Digital Health Intervention Engagement and Dietary Intake: A Systematic Review. Nutrients 2021;13(9):3281 View
  46. Carey A, Yang Q, DeLuca L, Toro-Ramos T, Kim Y, Michaelides A. The Relationship Between Weight Loss Outcomes and Engagement in a Mobile Behavioral Change Intervention: Retrospective Analysis. JMIR mHealth and uHealth 2021;9(11):e30622 View
  47. Baldwin P, Black M, Newby J, Brown L, Scott N, Shrestha T, Cockayne N, Tennant J, Harvey S, Christensen H. The Essential Network (TEN): rapid development and implementation of a digital-first mental health solution for Australian healthcare workers during COVID-19. BMJ Innovations 2022;8(2):105 View
  48. Al-Azzam M, Algalil F. Research on the Impact of mHealth Apps on the Primary Healthcare Professionals in Patient Care. Applied Bionics and Biomechanics 2021;2021:1 View
  49. Michalak E, Barnes S, Morton E, O'Brien H, Murray G, Hole R, Meyer D. Supporting Self-management and Quality of Life in Bipolar Disorder With the PolarUs App (Alpha): Protocol for a Mixed Methods Study. JMIR Research Protocols 2022;11(8):e36213 View
  50. Gordon D, Hensel J, Bouck Z, Desveaux L, Soobiah C, Saragosa M, Jeffs L, Bhatia S, Shaw J. Developing an explanatory theoretical model for engagement with a web-based mental health platform: results of a mixed methods study. BMC Psychiatry 2021;21(1) View
  51. Mohr D, Kwasny M, Meyerhoff J, Graham A, Lattie E. The effect of depression and anxiety symptom severity on clinical outcomes and app use in digital mental health treatments: Meta-regression of three trials. Behaviour Research and Therapy 2021;147:103972 View
  52. Kelly P, Beck A, Deane F, Larance B, Baker A, Hides L, Manning V, Shakeshaft A, Neale J, Kelly J, Oldmeadow C, Searles A, Palazzi K, Lawson K, Treloar C, Gray R, Argent A, McGlaughlin R. Feasibility of a Mobile Health App for Routine Outcome Monitoring and Feedback in SMART Recovery Mutual Support Groups: Stage 1 Mixed Methods Pilot Study. Journal of Medical Internet Research 2021;23(10):e25217 View
  53. Wu P, Zhang R, Luan J, Zhu M. Factors affecting physicians using mobile health applications: an empirical study. BMC Health Services Research 2022;22(1) View
  54. Summers C, Wu P, Taylor A. Supporting Mental Health During the COVID-19 Pandemic Using a Digital Behavior Change Intervention: An Open-Label, Single-Arm, Pre-Post Intervention Study. JMIR Formative Research 2021;5(10):e31273 View
  55. Lalloo C, Nishat F, Zempsky W, Bakshi N, Badawy S, Ko Y, Dampier C, Stinson J, Palermo T. Characterizing User Engagement With a Digital Intervention for Pain Self-management Among Youth With Sickle Cell Disease and Their Caregivers: Subanalysis of a Randomized Controlled Trial. Journal of Medical Internet Research 2022;24(8):e40096 View
  56. Kernebeck S, Busse T, Ehlers J, Vollmar H. Adhärenz digitaler Interventionen im Gesundheitswesen: Definitionen, Methoden und offene Fragen. Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz 2021;64(10):1278 View
  57. Weingarden H, Garriga Calleja R, Greenberg J, Snorrason I, Matic A, Quist R, Harrison O, Hoeppner S, Wilhelm S. Characterizing observed and effective behavioral engagement with smartphone cognitive behavioral therapy for body dysmorphic disorder: A methods roadmap and use case. Internet Interventions 2023;32:100615 View
  58. Berardi V, Fowers R, Rubin G, Stecher C. Time of Day Preferences and Daily Temporal Consistency for Predicting the Sustained Use of a Commercial Meditation App: Longitudinal Observational Study. Journal of Medical Internet Research 2023;25:e42482 View
  59. Son I, Hong J, Han Y, Gong B, Zhang M, Na W, Sohn C, Hyun T. Effectiveness of a mobile health intervention on weight loss and dietary behavior changes among employees with overweight and obesity: a 12-week intervention study investigating the role of engagement. Korean Journal of Community Nutrition 2023;28(2):141 View
  60. Holtz B, Mitchell K. Best Practices for Developing a Diabetes mHealth App. Journal of Diabetes Science and Technology 2024;18(1):39 View
  61. Forbes A, Keleher M, Venditto M, DiBiasi F. Assessing Patient Adherence to and Engagement With Digital Interventions for Depression in Clinical Trials: Systematic Literature Review. Journal of Medical Internet Research 2023;25:e43727 View
  62. Lo B, Shin H, Kemp J, Munnery M, Chen S, Ma C, Jankowicz D, Mehta R, Harris A, Sakal M, Pundit R, Chung K, Kuziemsky C, Rossetti S, Strudwick G. Shifting Mindsets: The Impact of a Patient Portal on Functioning and Recovery in a Mental Health Setting. The Canadian Journal of Psychiatry 2024;69(3):217 View
  63. Leong U, Chakraborty B. Participant Engagement in Microrandomized Trials of mHealth Interventions: Scoping Review. JMIR mHealth and uHealth 2023;11:e44685 View
  64. Sittig D, Boxwala A, Wright A, Zott C, Desai P, Dhopeshwarkar R, Swiger J, Lomotan E, Dobes A, Dullabh P. A lifecycle framework illustrates eight stages necessary for realizing the benefits of patient-centered clinical decision support. Journal of the American Medical Informatics Association 2023;30(9):1583 View
  65. Linardon J. Rates of attrition and engagement in randomized controlled trials of mindfulness apps: Systematic review and meta-analysis. Behaviour Research and Therapy 2023;170:104421 View
  66. Sadler S, Gerrard J, Searle A, Lanting S, West M, Wilson R, Ginige A, Fang K, Chuter V. The Use of mHealth Apps for the Assessment and Management of Diabetes-Related Foot Health Outcomes: Systematic Review. Journal of Medical Internet Research 2023;25:e47608 View
  67. Hawkes R, Miles L, Ainsworth B, Ross J, Meacock R, French D. Engagement with a nationally-implemented digital behaviour change intervention: Usage patterns over the 9-month duration of the National Health Service Digital Diabetes Prevention Programme. Internet Interventions 2023;33:100647 View
  68. Siezenga A, Mertens E, van Gelder J. A look under the hood: analyzing engagement and usage data of a smartphone-based intervention. BMC Digital Health 2023;1(1) View
  69. Son I, Hong J, Han Y, Gong B, Zhang M, Na W, Sohn C, Hyun T. Process evaluation of a mobile healthcare program among employees with overweight and obesity: a 12-week intervention study investigating the role of engagement. Korean Journal of Community Nutrition 2023;28(6):466 View
  70. Yunis R, Fonda S, Aghaee S, Kubo A, Davis S, Liu R, Neeman E, Oakley-Girvan I. Mobile app activity engagement by cancer patients and their caregivers informs remote monitoring. Scientific Reports 2024;14(1) View
  71. Monachelli R, Davis S, Barnard A, Longmire M, Docherty J, Oakley-Girvan I. Designing mHealth Apps to Incorporate Evidence-Based Techniques for Prolonging User Engagement. Interactive Journal of Medical Research 2024;13:e51974 View
  72. Giebel G, Speckemeier C, Schrader N, Abels C, Plescher F, Hillerich V, Wiedemann D, Börchers K, Wasem J, Blase N, Neusser S. Quality assessment of mHealth apps: a scoping review. Frontiers in Health Services 2024;4 View
  73. Sharma S, Sharma A. Insights into customer engagement in a mobile app context: review and research agenda. Cogent Business & Management 2024;11(1) View
  74. Okamoto M, Saito Y, Nakamura S, Nagasawa M, Shibuya M, Nagasaka G, Narimatsu H. Smartphone-Based Digital Peer Support for a Walking Intervention Among Public Officers in Kanagawa Prefecture: Single-Arm Pre- and Postintervention Evaluation. JMIR Formative Research 2024;8:e53759 View
  75. Torok M, McGillivray L, Gan D, Han J, Hetrick S, Wong Q. Adherence and efficacy outcomes in young Australians with suicidal ideation using a self-management app and digital engagement strategy compared with a sham app: a three-arm randomised controlled trial. eClinicalMedicine 2025;79:102963 View

Books/Policy Documents

  1. Ensari I, Elhadad N. Digital Health. View
  2. Fernandez-Luque L, Núñez-Benjumea F, Cervera-Torres S, López-Guerra J, Liao Z, Pagán J, Zambrana F. Personal Health Informatics. View
  3. Li H. Proceedings of the 4th International Conference on Big Data Analytics for Cyber-Physical System in Smart City - Volume 2. View
  4. Jat A, Grønli T. Mobile Web and Intelligent Information Systems. View