This paper is in the following e-collection/theme issue:

Quality Evaluation and Descriptive Analysis/Reviews of Multiple Existing Mobile Apps (374) Mobile Health (mhealth) (2939) Research Instruments, Questionnaires, and Tools (576) Depression and Mood Disorders; Suicide Prevention (1363) Smoking Cessation (556) Evaluation and Research Methodology for mHealth (208)

Published on in Vol 4, No 1 (2016): Jan-Mar

Interrater Reliability of mHealth App Rating Measures: Analysis of Top Depression and Smoking Cessation Apps

Interrater Reliability of mHealth App Rating Measures: Analysis of Top Depression and Smoking Cessation Apps

Interrater Reliability of mHealth App Rating Measures: Analysis of Top Depression and Smoking Cessation Apps

Authors of this article:

Adam C Powell1 Author Orcid Image ;   John Torous2, 3 Author Orcid Image ;   Steven Chan4 Author Orcid Image ;   Geoffrey Stephen Raynor2, 3 Author Orcid Image ;   Erik Shwarts4 Author Orcid Image ;   Meghan Shanahan3 Author Orcid Image ;   Adam B Landman5 Author Orcid Image
Article Authors Cited by (74) Tweetations (75) Metrics

Journals

  1. Ramos R, Cheng P, Jonas S. Validation of an mHealth App for Depression Screening and Monitoring (Psychologist in a Pocket): Correlational Study and Concurrence Analysis. JMIR mHealth and uHealth 2019;7(9):e12051 View
  2. Loeckx M, Rabinovich R, Demeyer H, Louvaris Z, Tanner R, Rubio N, Frei A, De Jong C, Gimeno-Santos E, Rodrigues F, Buttery S, Hopkinson N, Büsching G, Strassmann A, Serra I, Vogiatzis I, Garcia-Aymerich J, Polkey M, Troosters T. Smartphone-Based Physical Activity Telecoaching in Chronic Obstructive Pulmonary Disease: Mixed-Methods Study on Patient Experiences and Lessons for Implementation. JMIR mHealth and uHealth 2018;6(12):e200 View
  3. Huckvale K, Torous J, Larsen M. Assessment of the Data Sharing and Privacy Practices of Smartphone Apps for Depression and Smoking Cessation. JAMA Network Open 2019;2(4):e192542 View
  4. Ferretti A, Ronchi E, Vayena E. From principles to practice: benchmarking government guidance on health apps. The Lancet Digital Health 2019;1(2):e55 View
  5. Mercurio M, Larsen M, Wisniewski H, Henson P, Lagan S, Torous J. Longitudinal trends in the quality, effectiveness and attributes of highly rated smartphone health apps. Evidence Based Mental Health 2020;23(3):107 View
  6. Kumar S, Mehrotra S. Free mobile apps on depression for Indian users: A brief overview and critique. Asian Journal of Psychiatry 2017;28:124 View
  7. McKay F, Wright A, Shill J, Stephens H, Uccellini M. Using Health and Well-Being Apps for Behavior Change: A Systematic Search and Rating of Apps. JMIR mHealth and uHealth 2019;7(7):e11926 View
  8. Perry K, Shearer E, Sylvers P, Carlile J, Felker B. mHealth 101: an Introductory Guide for Mobile Apps in Clinical Practice. Journal of Technology in Behavioral Science 2019;4(2):162 View
  9. Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, Sarris J. The efficacy of smartphone‐based mental health interventions for depressive symptoms: a meta‐analysis of randomized controlled trials. World Psychiatry 2017;16(3):287 View
  10. McKay F, Slykerman S, Dunn M. The App Behavior Change Scale: Creation of a Scale to Assess the Potential of Apps to Promote Behavior Change. JMIR mHealth and uHealth 2019;7(1):e11130 View
  11. Anderson K, Burford O, Emmerton L. App Chronic Disease Checklist: Protocol to Evaluate Mobile Apps for Chronic Disease Self-Management. JMIR Research Protocols 2016;5(4):e204 View
  12. Maheu M, Nicolucci V, Pulier M, Wall K, Frye T, Hudlicka E. The Interactive Mobile App Review Toolkit (IMART): a Clinical Practice-Oriented System. Journal of Technology in Behavioral Science 2016;1(1-4):3 View
  13. Brinker T, Alfitian J, Seeger W, Groneberg D, Von Kalle C, Enk A, Herth F, Kreuter M, Bauer C, Gatzka M, Suhre J. A Face-Aging Smoking Prevention/Cessation Intervention for Nursery School Students in Germany: An Appearance-Focused Interventional Study. International Journal of Environmental Research and Public Health 2018;15(8):1656 View
  14. Dayer L, Shilling R, Van Valkenburg M, Martin B, Gubbins P, Hadden K, Heldenbrand S. Assessing the Medication Adherence App Marketplace From the Health Professional and Consumer Vantage Points. JMIR mHealth and uHealth 2017;5(4):e45 View
  15. Alyami M, Giri B, Alyami H, Sundram F. Social anxiety apps: a systematic review and assessment of app descriptors across mobile store platforms. Evidence Based Mental Health 2017;20(3):65 View
  16. Torous J, Powell A, Knable M. Quality Assessment of Self-Directed Software and Mobile Applications for the Treatment of Mental Illness. Psychiatric Annals 2016;46(10):579 View
  17. Guo Y, Yang F, Hu F, Li W, Ruggiano N, Lee H. Existing Mobile Phone Apps for Self-Care Management of People With Alzheimer Disease and Related Dementias: Systematic Analysis. JMIR Aging 2020;3(1):e15290 View
  18. Wisniewski H, Liu G, Henson P, Vaidyam A, Hajratalli N, Onnela J, Torous J. Understanding the quality, effectiveness and attributes of top-rated smartphone health apps. Evidence Based Mental Health 2019;22(1):4 View
  19. Torous J, Firth J, Huckvale K, Larsen M, Cosco T, Carney R, Chan S, Pratap A, Yellowlees P, Wykes T, Keshavan M, Christensen H. The Emerging Imperative for a Consensus Approach Toward the Rating and Clinical Recommendation of Mental Health Apps. Journal of Nervous & Mental Disease 2018;206(8):662 View
  20. Baumel A, Faber K, Mathur N, Kane J, Muench F. Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions. Journal of Medical Internet Research 2017;19(3):e82 View
  21. Peng C, He M, Cutrona S, Kiefe C, Liu F, Wang Z. Theme Trends and Knowledge Structure on Mobile Health Apps: Bibliometric Analysis. JMIR mHealth and uHealth 2020;8(7):e18212 View
  22. Jake-Schoffman D, Silfee V, Waring M, Boudreaux E, Sadasivam R, Mullen S, Carey J, Hayes R, Ding E, Bennett G, Pagoto S. Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps. JMIR mHealth and uHealth 2017;5(12):e190 View
  23. Powell A, Yue Z, Shan C, Torous J. The Monetization Strategies of Apps for Anxiety Management: an International Comparison. Journal of Technology in Behavioral Science 2019;4(2):67 View
  24. Siddique A, Krebs M, Alvarez S, Greenspan I, Patel A, Kinsolving J, Koizumi N. Mobile Apps for the Care Management of Chronic Kidney and End-Stage Renal Diseases: Systematic Search in App Stores and Evaluation. JMIR mHealth and uHealth 2019;7(9):e12604 View
  25. Regmi D, Tobutt C, Shaban S. QUALITY AND USE OF FREE SMOKING CESSATION APPS FOR SMARTPHONES. International Journal of Technology Assessment in Health Care 2018;34(5):476 View
  26. Torous J, Rodriguez J, Powell A. The New Digital Divide For Digital Biomarkers. Digital Biomarkers 2017;1(1):87 View
  27. Bubolz S, Mayer G, Gronewold N, Hilbel T, Schultz J. Adherence to Established Treatment Guidelines Among Unguided Digital Interventions for Depression: Quality Evaluation of 28 Web-Based Programs and Mobile Apps. Journal of Medical Internet Research 2020;22(7):e16136 View
  28. Bernardes-Souza B, Patruz Ananias De Assis Pires F, Madeira G, Felício Da Cunha Rodrigues T, Gatzka M, Heppt M, Omlor A, Enk A, Groneberg D, Seeger W, von Kalle C, Berking C, Corrêa P, Suhre J, Alfitian J, Assis A, Brinker T. Facial-Aging Mobile Apps for Smoking Prevention in Secondary Schools in Brazil: Appearance-Focused Interventional Study. JMIR Public Health and Surveillance 2018;4(3):e10234 View
  29. Karcher N, Presser N. Ethical and Legal Issues Addressing the Use of Mobile Health (mHealth) as an Adjunct to Psychotherapy. Ethics & Behavior 2018;28(1):1 View
  30. Rubanovich C, Mohr D, Schueller S. Health App Use Among Individuals With Symptoms of Depression and Anxiety: A Survey Study With Thematic Coding. JMIR Mental Health 2017;4(2):e22 View
  31. Qu C, Sas C, Daudén Roquet C, Doherty G. Functionality of Top-Rated Mobile Apps for Depression: Systematic Search and Evaluation. JMIR Mental Health 2020;7(1):e15321 View
  32. Bidargaddi N, Musiat P, Winsall M, Vogl G, Blake V, Quinn S, Orlowski S, Antezana G, Schrader G. Efficacy of a Web-Based Guided Recommendation Service for a Curated List of Readily Available Mental Health and Well-Being Mobile Apps for Young People: Randomized Controlled Trial. Journal of Medical Internet Research 2017;19(5):e141 View
  33. Larsen M, Nicholas J, Christensen H. Quantifying App Store Dynamics: Longitudinal Tracking of Mental Health Apps. JMIR mHealth and uHealth 2016;4(3):e96 View
  34. Richardson B, Dol J, Rutledge K, Monaghan J, Orovec A, Howie K, Boates T, Smit M, Campbell-Yeo M. Evaluation of Mobile Apps Targeted to Parents of Infants in the Neonatal Intensive Care Unit: Systematic App Review. JMIR mHealth and uHealth 2019;7(4):e11620 View
  35. Emerson M, Watanabe-Galloway S, Dinkel D, Kotcherlakota S, Fok L. Lessons Learned in Selection and Review of Depression Apps for Primary Care Settings. Journal of Technology in Behavioral Science 2021;6(1):42 View
  36. Rodriguez-Villa E, Torous J. Regulating digital health technologies with transparency: the case for dynamic and multi-stakeholder evaluation. BMC Medicine 2019;17(1) View
  37. Camacho E, Hoffman L, Lagan S, Rodriguez-Villa E, Rauseo-Ricupero N, Wisniewski H, Henson P, Torous J. Technology Evaluation and Assessment Criteria for Health Apps (TEACH-Apps): Pilot Study. Journal of Medical Internet Research 2020;22(8):e18346 View
  38. Moshi M, Tooher R, Merlin T. SUITABILITY OF CURRENT EVALUATION FRAMEWORKS FOR USE IN THE HEALTH TECHNOLOGY ASSESSMENT OF MOBILE MEDICAL APPLICATIONS: A SYSTEMATIC REVIEW. International Journal of Technology Assessment in Health Care 2018;34(5):464 View
  39. Nouri R, R Niakan Kalhori S, Ghazisaeedi M, Marchand G, Yasini M. Criteria for assessing the quality of mHealth apps: a systematic review. Journal of the American Medical Informatics Association 2018;25(8):1089 View
  40. Knitza J, Tascilar K, Messner E, Meyer M, Vossen D, Pulla A, Bosch P, Kittler J, Kleyer A, Sewerin P, Mucke J, Haase I, Simon D, Krusche M. German Mobile Apps in Rheumatology: Review and Analysis Using the Mobile Application Rating Scale (MARS). JMIR mHealth and uHealth 2019;7(8):e14991 View
  41. Hsin H, Torous J. Creating boundaries to empower digital health technology. BJPsych Open 2018;4(4):235 View
  42. Davis D, Logsdon M, Vogt K, Rushton J, Myers J, Lauf A, Hogan F. Parent Education is Changing. MCN: The American Journal of Maternal/Child Nursing 2017;42(5):248 View
  43. Baumel A, Kane J. Examining Predictors of Real-World User Engagement with Self-Guided eHealth Interventions: Analysis of Mobile Apps and Websites Using a Novel Dataset. Journal of Medical Internet Research 2018;20(12):e11491 View
  44. Chiauzzi E, Newell A. Mental Health Apps in Psychiatric Treatment: A Patient Perspective on Real World Technology Usage. JMIR Mental Health 2019;6(4):e12292 View
  45. Minen M, Stieglitz E, Sciortino R, Torous J. Privacy Issues in Smartphone Applications: An Analysis of Headache/Migraine Applications. Headache: The Journal of Head and Face Pain 2018;58(7):1014 View
  46. Grau-Corral I, Pantoja P, Grajales III F, Kostov B, Aragunde V, Puig-Soler M, Roca D, Couto E, Sisó-Almirall A. Assessing Apps for Health Care Workers Using the ISYScore-Pro Scale: Development and Validation Study. JMIR mHealth and uHealth 2021;9(7):e17660 View
  47. Miró J, Llorens-Vernet P. Assessing the Quality of Mobile Health-Related Apps: Interrater Reliability Study of Two Guides. JMIR mHealth and uHealth 2021;9(4):e26471 View
  48. Hensher M, Cooper P, Dona S, Angeles M, Nguyen D, Heynsbergh N, Chatterton M, Peeters A. Scoping review: Development and assessment of evaluation frameworks of mobile health apps for recommendations to consumers. Journal of the American Medical Informatics Association 2021;28(6):1318 View
  49. Agarwal P, Gordon D, Griffith J, Kithulegoda N, Witteman H, Sacha Bhatia R, Kushniruk A, Borycki E, Lamothe L, Springall E, Shaw J. Assessing the quality of mobile applications in chronic disease management: a scoping review. npj Digital Medicine 2021;4(1) View
  50. Raeesi A, Khajouei R, Ahmadian L. Evaluation of HIV/AIDS-related mobile health applications content using an evidence-based content rating tool. BMC Medical Informatics and Decision Making 2021;21(1) View
  51. Kowatsch T, Otto L, Harperink S, Cotti A, Schlieter H. A design and evaluation framework for digital health interventions. it - Information Technology 2019;61(5-6):253 View
  52. Wilks C, Chu C, Sim D, Lovell J, Gutierrez P, Joiner T, Kessler R, Nock M. User Engagement and Usability of Suicide Prevention Apps: Systematic Search in App Stores and Content Analysis. JMIR Formative Research 2021;5(7):e27018 View
  53. Neary M, Bunyi J, Palomares K, Mohr D, Powell A, Ruzek J, Williams L, Wykes T, Schueller S. A process for reviewing mental health apps: Using the One Mind PsyberGuide Credibility Rating System. DIGITAL HEALTH 2021;7 View
  54. Biswas M, Tania M, Kaiser M, Kabir R, Mahmud M, Kemal A, Rashid J. ACCU3RATE: A mobile health application rating scale based on user reviews. PLOS ONE 2021;16(12):e0258050 View
  55. AlSlaity A, Suruliraj B, Oyebode O, Fowles J, steeves d, Orji R. Mobile Applications for Health and Wellness: A Systematic Review. Proceedings of the ACM on Human-Computer Interaction 2022;6(EICS):1 View
  56. Cao J, Zhang G, Liu D. The Impact of Using mHealth Apps on Improving Public Health Satisfaction during the COVID-19 Pandemic: A Digital Content Value Chain Perspective. Healthcare 2022;10(3):479 View
  57. Spadaro B, Martin-Key N, Funnell E, Bahn S. mHealth Solutions for Perinatal Mental Health: Scoping Review and Appraisal Following the mHealth Index and Navigation Database Framework. JMIR mHealth and uHealth 2022;10(1):e30724 View
  58. Mackey R, Gleason A, Ciulla R. A Novel Method for Evaluating Mobile Apps (App Rating Inventory): Development Study. JMIR mHealth and uHealth 2022;10(4):e32643 View
  59. Wang S, Lee H, Choi W. A feature-oriented analysis of developers’ descriptions and user reviews of top mHealth applications for diabetes and hypertension. International Journal of Medical Informatics 2021;156:104598 View
  60. Ramos G, Ponting C, Labao J, Sobowale K. Considerations of diversity, equity, and inclusion in mental health apps: A scoping review of evaluation frameworks. Behaviour Research and Therapy 2021;147:103990 View
  61. Evans K, Donelan J, Rennick-Egglestone S, Cox S, Kuipers Y. Review of Mobile Apps for Women With Anxiety in Pregnancy: Maternity Care Professionals’ Guide to Locating and Assessing Anxiety Apps. Journal of Medical Internet Research 2022;24(3):e31831 View
  62. MacPherson M, Bakker A, Anderson K, Holtzman S. Do pain management apps use evidence-based psychological components? A systematic review of app content and quality. Canadian Journal of Pain 2022;6(1):33 View
  63. Li L, Wong L, Yap K. Quality evaluation of stress, anxiety and depression apps for COVID-19. Journal of Affective Disorders Reports 2021;6:100255 View
  64. Meddar J, Ponnapalli A, Azhar R, Turchioe M, Duran A, Creber R. A Structured Review of Commercially Available Cardiac Rehabilitation mHealth Applications Using the Mobile Application Rating Scale. Journal of Cardiopulmonary Rehabilitation and Prevention 2022;42(3):141 View
  65. Torous J, Chan S, Gipson S, Kim J, Nguyen T, Luo J, Wang P. A Hierarchical Framework for Evaluation and Informed Decision Making Regarding Smartphone Apps for Clinical Care. Psychiatric Services 2018;69(5):498 View

Books/Policy Documents

  1. Péteri T, Varga N, Bokor L. eHealth 360°. View
  2. Singh K, Landman A. Key Advances in Clinical Informatics. View
  3. David S, Rafiullah M. Case Study of Innovative Projects - Successful Real Cases. View
  4. Budney A, Borodovsky J, Marsch L, Lord S. The Assessment and Treatment of Addiction. View
  5. Dy Aungst T. Digital Mental Health. View