Published on 03.04.17 in Vol 5, No 4 (2017): April
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/6510, first published Aug 22, 2016.
Processes and Recommendations for Creating mHealth Apps for Low-Income Populations
Background: Mobile health (mHealth) apps have shown to improve health indicators, but concerns remain about the inclusion of populations from low- and medium-income countries (LMIC) in these new technologies. Atrial fibrillation (AF) is a chronic condition with a challenging management. Previous studies have shown socioeconomic differences in the prescription of anticoagulant treatment and shared decision strategies are encouraged to achieve better outcomes. mHealth can aid both doctors and patients in this matter.
Objective: We describe the development of an mHealth app (aFib) idealized to aid shared decision between doctor and patient about anticoagulation prophylaxis in AF in a low-income and low-literacy population in Brazil. On the basis of our research, we suggest the processes to be followed when developing mHealth apps in this context.
Methods: A multidisciplinary team collected information about the target population and its needs and detected the best opportunity to insert the app in their current health care. Literature about the subject was reviewed and important data were selected to be delivered through good navigability, easy terminology, and friendly design. The app was evaluated in a multimethod setting.
Results: The steps suggested to develop an mHealth app target to LMIC are: (1) characterize the problem and the target user, (2) review the literature, (3) translate information to knowledge, (4) protect information, and (5) evaluate usability and efficacy.
Conclusions: We expect that these recommendations can guide the development of new mHealth apps in LMIC, on a scientific basis.
JMIR Mhealth Uhealth 2017;5(4):e41
Mobile device usage has increased dramatically over the years and recent data has shown that 64% of adults in the United States own a mobile phone. About 62% of mobile phone owners have used their phones in the past year to look up information about a health condition , often using software programs, or “apps” of mobile health (mHealth) [ ]. In 2016, there were around 3.2 billion of downloads of mHealth apps around the globe [ ]. Apps have shown to improve treatment adherence [ ] and risk factors control [ , ] for chronic diseases. However, there are concerns about the proper inclusion of populations from low- and medium-income countries (LMIC) in this new health care resource [ , ]. In Brazil, for instance, the current number of mobile devices in use is around 168 million [ ], but most of these are basic phones with poor or no Internet access, which let their users relegated to the sidelines of this technology.
One of the diseases that can have its management improved with the help of mHealth is atrial fibrillation (AF), a common arrhythmia largely associated with stroke risk . Anticoagulation therapy reduces this risk [ ], but it can be challenging due to associated comorbidities and bleeding risk [ ]. Hence, it is paramount that decisions about AF treatment be shared between health care providers and patients [ ]. It is recognized that there are socioeconomic differences in AF treatment. Among different socioeconomic strata, those with lower income were less frequently prescribed anticoagulants [ ].
mHealth apps targeted to low-resource settings must be evidence-based, efficient, safe, and tailored to the users and their needs. To achieve these goals and maintain usability, special focus should be given to four specific themes: interface design, feedback, navigation, and terminology . However, most of these recommendations are not followed and systematically evaluated in a real-world setting before the go-live phase [ , ].
In this paper, we describe the development of an mHealth app idealized to aid shared decision about anticoagulation in AF in a low-income and low-educational level population in Brazil. On the basis of our research and results, we suggest processes and recommendations to be followed when developing mHealth apps adapted to use in LMIC.
aFib Study Overview
We developed an mHealth prototype, named aFib, targeted for patients with AF and their doctors. The main purpose was to facilitate shared decision on anticoagulation therapy during clinical appointment.
Our study population comprised patients with AF followed at the outpatient anticoagulation clinic of our institution. Instituto de Cardiologia do Rio Grande do Sul is a hospital specialized in treating heart diseases, supported by the Brazilian public health system. Every month, around 700 patients with AF are followed by the anticoagulation clinic and the majority of them have low-income and low-educational level. Previous studies showed that only half of these patients are adherent to therapy or within the therapeutic range of international normalized ratio (INR) [, ], showing that existing strategies are not effective.
App Development Process
The aFib team comprised a cardiac electrophysiologist with expertise in AF, a clinical cardiologist, a software developer, and a designer. After a comprehensive literature review to support all information provided by the app, we used the behavioral intervention technology (BITs) model to ensure that the development process was systematic and replicable . Our process comprised the following steps:
- Establishing the clinical aims (WHY): (a) increase knowledge about AF, stroke risk, bleeding risk, and anticoagulants [ , ] and (b) promote a shared decision about the therapy [ ].
- Selecting behavioral strategies to increase knowledge in low-income populations and aid shared decision (HOW): (a) education, (b) dialog with their doctors, and (c) motivation enhancement.
- Designing app elements to deliver selected behavioral strategies (WHAT): (a) a 1.5-min long educational video about how AF can cause stroke; (b) a one-screen-only calculator for the two most recommended risk scores for stroke and bleeding [ ]; (c) a screen with pictograms for a better understanding of the scores by poor literacy patients; and (d) an short message service (SMS) system to continue delivering information to users about their disease and treatment.
- Defining when and under what conditions the app will be used (WHEN): as many of our patients have basic handsets that can accommodate only voice and SMS text messaging, our option was to provide this first mHealth interaction during clinical consultation, using the physician’s mobile device.
All information collected could be saved and reviewed later. This was motivated by 3 reasons: (1) risk factors often change over time, which means that risk stratification must be updated and recalculated; (2) to allow a staff nurse to collect primary data that could be expanded and modified during the physician’s appointment, providing greater ease of adoption of the app in the primary care setting; and (3) to enable data transfer to other devices, since we expect that our target population will likely migrate to mobile phones in the following years.
Three clinical cardiologists, 2 cardiac electrophysiologists, 1 medicine student, and 20 patients evaluated aFib in the pilot phase and gave feedback about perceived ease of use, perceived usefulness (two statements with a 5-point Likert scale), relevancy of content, navigation, terminology, interactivity, attractiveness, learnability (through a pre- and posttest questionnaire about the disease and treatment), and conflict about decision process (measured by a decisional conflict scale) . Written informed consent was obtained from all participants, and the Institutional Ethics Committee approved the study.
After adjustments that were made based on these feedbacks, aFib is being currently evaluated in a randomized clinical trial with the target population described, with short- and long-term outcomes previously established (improve knowledge, treatment adherence, and maintenance of adequate levels of anticoagulation and cost-effectiveness of this strategy).
The main challenges in the development process were (1) in the app contents, to summarize information in a way that would maximize knowledge acquisition and maintain patient’s attention; (2) in the design, to minimize screens and to translate the percentages of risk in graphic information understandable by low-literacy users; (3) in the technical area, to level the knowledge of the development team in order to permit brainstorming, that is, to provide the developer and the designer with the medical information needed to understand the app context and, at the same time, to provide physicians with the technical information essential for structuring the app.
On the basis of this experience, we created a short guide to the development of mHealth apps (), suitable for use in other oncoming mHealth apps for use in LMIC.
Characterize the Problem and the Target User
A solid project starts with understanding who the users are and what problem do the app want to solve. If the subject in question is too broad, try to approach a key problematic aspect, like knowledge gaps, difficult choices, or complex treatments.
An mHealth app may be directed to patients or their relatives, health care professionals, or even to healthy people looking for disease prevention. It is important to understand not only the socioeconomic background and educational level of the target population, but also their desires and doubts. What is their most pressing issue? Where do they get their information? What benefit of the app will help solve their problem? All these questions must be answered in order to develop a user-centered mHealth app. It is important to think also about the Internet connectivity and multimedia capability of the device in which the app will be accessed. In the United States, low-income groups are now using mobile phones as their primary method for Internet access . In other countries, it might be desirable that the content can be downloaded to be accessed offline. Usability has to be planned foreseeing the worst scenario.
Review the Literature
Citizens from LMIC can have inconsistent access to their health systems, and an mHealth app can be a great opportunity to reach these populations. Thus, it should provide the best available evidence about the problem: guidelines, meta-analysis, systematic reviews, and randomized clinical trials will be the most helpful, with preference to local guidelines. Identify risk scores, outcomes, and the core information to be delivered. The references should be provided in order to aid users to make their own judgment on its reliability.
Ascertain the prevalence, incidence, and other important measures of impact, effect, and association of the problem in the target population. This would help to justify the app contents and/or interventions and establish outcomes.
If the subject had been addressed before by other apps, then identify which knowledge gaps are still blank and how to fill local population needs.
Translate Information to Knowledge
Once the problem has been defined globally and the content is evidence-based, the main challenge is to transform a huge amount of data in best quality and well-presented information, tailored to the user. Low literacy can be a barrier to the adoption of usual solutions. The 4 topics that should be kept in mind to better achieve the goal of transmitting knowledge are discussed below.
Build Easy Navigation
This refers to the way a user navigates throughout the app to complete tasks. If it is expected that the app will be used in a context of frequent interruptions, multitasking, and increased cognitive load, bad navigation may result in errors of attention and attribution . Icons, tab views, and buttons should be easily recognizable [ ]. It is possible to reduce cognitive load by creating steps, unifying scores, and gathering information to optimize time and minimize the number of screen switching. Screen size must also be taken into account since the smaller screen of a mobile phone will need more screen switches compared with the larger screen of a tablet.
Stick to the Main Points
There are several ways to reduce the amount of information, but any such reduction is also limited by the potential loss of critical information . Main information must be highlighted, but the app should provide ways to access more complete references (eg, through hyperlinks or information buttons). Although an app is a pull technology, additional reinforcement can be achieved by employing push technology like SMS. Push and pull technology is widely used in LMIC; some examples are the improvement of early infant diagnosis of human immunodeficiency virus (HIV) in Zambia [ ] and health education through messages in Benin, Malawi, and Uganda [ ]. Personalized messages are seen as the most easily implemented and most effective strategy in changing patient behavior [ ].
Invest in Interface Design
This theme refers to the design and layout, including consistency, location of icons, functions on each screen, font, color, density, placement, and images . People learn better from visual information [ ]. In a low-literacy scenario, cartoons can be used to simplify the message. The right images can improve comprehension, trigger emotions, and stick in long-term memory, but the incorrect use can deter instructiveness. mHealth users’ main complaints about app design are related to visibility (as well as small screen space), hard to read fonts, lack of color coding, and poor graphic displays [ ]. An effective visual communication include (1) appropriate and legible typography, (2) use of no more than five colors in the layout, (3) simple, easy to understand, and universal iconography, (4) spare use of callouts to highlight only key information, (5) significant negative space between messages, (6) use of illustration only if it enhances the content, and (7) maintain a logical hierarchy of the contents [ ].
Adapt the Terminology
Terminology reflects the user’s ability to identify with and understand the language used within the app . Linguistic and cultural customization of health-related contents improve the involvement of low-income populations and the first step of this process is related to the first recommendation of this tutorial, that is, to characterize the target user [ ]. Apps aimed at poor literacy populations must adopt health vocabulary that they use routinely. It can also be useful if the correct terminology is mentioned, between parentheses, for example, for learning purposes. Consultants that represent the target user’s population should revise all contents in the pilot evaluation. Important questions that can be asked are (1) What was the main idea? (2) Was it easy to read or understand? (3) Would you change any term to improve understanding?
Security and privacy in mHealth apps is a vast subject, and laws regulating these aspects vary widely between countries. A recent review addressed this issue and suggested minimum requirements for developers , summarized here:
- The user should be able to control access to their personal health information (PHI) at any moment.
- Authentication must be done with a unique ID.
- Use advanced encryption standard (AES) to encrypt PHI, with a cryptographic key of at least 128 bits.
- Data transfer should be done with TLS with 128-bit encryption methods or virtual private networks (VPNs).
- Cryptographic methods must be used in securing the body sensor networks for authentication and key distribution.
- In case of a PHI breach, the competent authority and the affected user must be notified as soon as possible (1-3 days) and possible consequences must be relieved.
We strongly recommend a comprehensive review of the laws from the country for which the app is being developed since these minimum requirements can be insufficient in some cases.
Evaluate Usability and Efficacy
Recent studies about mHealth usability suggest the use of a multimethod approach and standardized methods and tools in mHealth evaluations, which can result in a more comprehensive identification of usability issues, more specific redesign recommendations, and better reproducibility of results across studies. For users, improved mHealth design and usability could result in improved interactions, greater use of mHealth apps, and perhaps even increased adherence to suggested interventions and therapeutic .
To date, there is a paucity of published studies on the efficacy of mobile phone apps for health promotion in low-income populations. More research and evaluation is necessary about both internal and external validity and sustained health outcomes .
Internal validity of mHealth apps for low-income populations can be threatened by selection bias (eg, participants with sociocultural characteristics that do not represent the target population), instrument changes (eg, version updates of the app), regression toward the mean (eg, in knowledge evaluation of low-literacy participants), between other factors. To improve and standardize evaluation reports of mHealth interventions, a validated framework like CONSORT-EHEALTH  or RE-AIM [ ] is recommended. The following are the steps that can be followed to validate an app.
Make a Pilot
For formative usability tests, 5-8 users are able to detect 80-85% of usability problems . A pilot study of the app is imperative to adjust design and navigability based on user-centered data.
Test for Short-Term Outcomes
First real-world trial of the app should analyze short-term outcomes, such as knowledge increase, user satisfaction, behavioral changes, and improvements in validated tests, scores, or modifiable risk factors.
Test for Long-Term Outcomes
If the proposed new health care tool can act positively on factors mentioned above, it could possibly improve long-term outcomes as well. The ideal scenario is to test the mHealth app in a randomized trial with preestablished clinical outcomes, and to evaluate cost-effectiveness when compared with existing strategies. Burke et al , on its recent review about current science on mHealth, have proposed some interesting questions that future mHealth apps will have to answer: Does the product work best when used in certain settings or among specific patient groups? Does the app potentiate impact when it is combined with other traditional interventions? In what cases can the findings be generalized among similar technologies in the class? Are the effects seen durable? Are there any unintended consequences associated with the device and program in which it is used? [ ] We need to embrace the challenge of producing this needed evidence.
Provide Feedback Options
After go-live phase, it is important that users can continue evaluating all of the aforementioned aspects. All app stores have this option, but users can be stimulated to give their opinions and a customer service should be organized to answer main doubts.
Achieving success in health prevention and treatment in LMIC is challenging and require approaches and tools that (1) have proven clinical benefit, (2) can be scaled to reach a global population and (3) are affordable. Mobile technologies provide a potential platform to facilitate these needs .
mHealth is empowering individuals to assume a more active role in monitoring and managing their chronic conditions and therapeutic regimens, as well as their health and wellness . But, this new health tool needs to be adapted to local language and reality [ ].
This tutorial was based on the experience acquired while developing the app “aFib,” and describes processes and recommendations to aid developers who are interested in creating or adapting mHealth apps to low-income populations. A problem-targeted and user-centered strategy appears to be a logical trend to the development of these apps. A comprehensive review of literature must be the base of the project. The best efforts should be made to translate information to knowledge and it should be kept in mind that good navigability, terminology, and interface design can help on this task. Protection of user information is essential, and local laws on the matter should be studied beforehand. Usability and efficacy must always be evaluated in a variety of scenarios.
This tutorial has several limitations. First, the literature about mHealth is increasing quickly and new models are being tested every day to improve the development process, which can soon overwhelm the models we used here. Second, it is likely that a single experience cannot provide insight about every step of this process. Third, other diseases or conditions can present with different challenges related to low-income populations. Finally, the characteristics of low-income populations vary widely between countries, with cultural and social differences that may need distinct adaptations.
Despite these limitations, we believe that it can encourage the development and evaluation of mHealth apps in LMIC. mHealth is a low-cost strategy and appear to be an appreciated, easy-to-use, and promising aid to improve knowledge and engage individuals from LMIC in the management of their illness, supporting healthy behavior change and potentially improving population health.
As mobile technologies become increasingly ubiquitous, apps adapted to local use in low-income populations are needed. This tutorial expects to stimulate the development of mHealth apps for low-income populations, on a scientific base. Future work should address other possible ways to reach this special group and the extent to which this new health resource will affect their health care.
We would like to thank Dr Gustavo Glotz de Lima for the meaningful insights he gave us about the paper. There were no external funding sources for this study. This paper is part of the thesis of master submitted by Laura Siga Stephan, from Health Science Postgraduate Program of University Foundation of Cardiology of Rio Grande do Sul.
LS was involved in conception of the research. Review of literature, acquisition, analysis, and interpretation of the data were done by LS, EA, RG, AL, and TL. The application was developed by RM, and designed by MA. LS, EA, RG, RM, MA, AL, and TL wrote the manuscript.
Conflicts of Interest
Multimedia Appendix 1
Main screens of aFib app.JPG File, 1MB
- Smith A. Pewinternet. 2015. The Smartphone Difference Internet URL: http://www.pewinternet.org/2015/04/01/us-smartphone-use-in-2015/ [accessed 2016-08-15] [WebCite Cache]
- Burke LE, Ma J, Azar KM, Bennett GG, Peterson ED, Zheng Y, American Heart Association Publications Committee of the Council on Epidemiology and Prevention, Behavior Change Committee of the Council on Cardiometabolic Health, Council on Cardiovascular and Stroke Nursing, Council on Functional Genomics and Translational Biology, Council on Quality of Care and Outcomes Research, and Stroke Council. Current science on consumer use of mobile health for cardiovascular disease prevention: a scientific statement from the American Heart Association. Circulation 2015 Sep 22;132(12):1157-1213. [CrossRef] [Medline]
- Research2Guidance. 2016. mHealth App Development Economic 2016 Internet URL: http://research2guidance.com/r2g/r2g-mHealth-App-Developer-Economics-2016.pdf [accessed 2017-03-17] [WebCite Cache]
- Johnston N, Bodegard J, Jerström S, Åkesson J, Brorsson H, Alfredsson J, et al. Effects of interactive patient smartphone support app on drug adherence and lifestyle changes in myocardial infarction patients: A randomized study. Am Heart J 2016 Aug;178:85-94 [FREE Full text] [CrossRef] [Medline]
- Chow CK, Redfern J, Hillis GS, Thakkar J, Santo K, Hackett ML, et al. Effect of lifestyle-focused text messaging on risk factor modification in patients with coronary heart disease: a randomized clinical trial. J Am Med Assoc 2015;314(12):1255-1263. [CrossRef] [Medline]
- Royston G, Hagar C, Long L, McMahon D, Pakenham-Walsh N, Wadhwani N, mHIFA Working Group (Mobile Healthcare Information For All). Mobile health-care information for all: a global challenge. Lancet Glob Health 2015 Jul;3(7):e356-e357 [FREE Full text] [CrossRef] [Medline]
- Meirelles F. eaesp.fgvsp. 2016. Pesquisa Anual do Uso de TI nas Empresas, GVcia Internet URL: http://eaesp.fgvsp.br/sites/eaesp.fgvsp.br/files/pesti2016gvciappt.pdf [accessed 2017-01-28] [WebCite Cache]
- Lip GYH, Tse HF, Lane DA. Atrial fibrillation. Lancet 2012 Feb 18;379(9816):648-661. [CrossRef] [Medline]
- Katsnelson M, Koch S, Rundek T. Stroke prevention in atrial fibrillation. J Atr Fibrillation 2010;2(2):790-801.
- Turakhia MP, Hoang DD, Xu X, Frayne S, Schmitt S, Yang F, et al. Differences and trends in stroke prevention anticoagulation in primary care vs cardiology specialty management of new atrial fibrillation: the Retrospective Evaluation and Assessment of Therapies in AF (TREAT-AF) study. Am Heart J 2013 Jan;165(1):93-101.e1. [CrossRef] [Medline]
- January CT, Wann LS, Alpert JS, Calkins H, Cigarroa JE, Cleveland JC, ACC/AHA Task Force Members. 2014 AHA/ACC/HRS guideline for the management of patients with atrial fibrillation: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines and the Heart Rhythm Society. J Am Coll Cardiol 2014 Dec 02;64(21):e1-76 [FREE Full text] [CrossRef] [Medline]
- Sjölander M, Eriksson M, Asplund K, Norrving B, Glader E. Socioeconomic inequalities in the prescription of oral anticoagulants in stroke patients with atrial fibrillation. Stroke 2015 Aug;46(8):2220-2225 [FREE Full text] [CrossRef] [Medline]
- Kirwan M, Duncan MJ, Vandelanotte C, Mummery WK. Design, development, and formative evaluation of a smartphone application for recording and monitoring physical activity levels: the 10,000 Steps “iStepLog”. Health Educ Behav 2013 Apr;40(2):140-151. [CrossRef] [Medline]
- Leiria TL, Pellanda L, Miglioranza MH, Sant'Anna RT, Becker LS, Magalhães E, et al. Warfarin and emfprocumone: experience of an anticoagulation clinic. Arq Bras Cardiol 2010 Jan;94(1):41-45. [CrossRef]
- Esmerio FG, Souza EN, Leiria TL, Lunelli R, Moraes MA. Chronic use of oral anticoagulant: implications for the control of adequate levels. Arq Bras Cardiol 2009 Nov;93(5):549-554. [CrossRef]
- Mohr DC, Schueller SM, Montague E, Burns MN, Rashidi P. The behavioral intervention technology model: an integrated conceptual and technological framework for eHealth and mHealth interventions. J Med Internet Res 2014;16(6):e146 [FREE Full text] [CrossRef] [Medline]
- Clarkesmith DE, Pattison HM, Lane DA. Educational and behavioural interventions for anticoagulant therapy in patients with atrial fibrillation. Cochrane Database Syst Rev 2013 Jun 04(6):CD008600. [CrossRef] [Medline]
- Clarkesmith DE, Pattison HM, Lip GY, Lane DA. Educational intervention improves anticoagulation control in atrial fibrillation patients: the TREAT randomised trial. PLoS One 2013;8(9):e74037 [FREE Full text] [CrossRef] [Medline]
- Eckman MH, Wise RE, Naylor K, Arduser L, Lip GY, Kissela B, et al. Developing an Atrial Fibrillation Guideline Support Tool (AFGuST) for shared decision making. Curr Med Res Opin 2015 Apr;31(4):603-614 [FREE Full text] [CrossRef] [Medline]
- O'Connor A. Decisionaid.ohri. User Manual - Decisional Conflict Scale (10 question format) Internet URL: https://decisionaid.ohri.ca/docs/develop/User_Manuals/UM_Decisional_Conflict.pdf [accessed 2017-01-28] [WebCite Cache]
- Smith A. Pewinternet. 2013. Smartphone Ownership URL: http://www.pewinternet.org/2013/06/05/smartphone-ownership-2013/ [accessed 2017-01-17] [WebCite Cache]
- Varshney U. Mobile health: four emerging themes of research. Decis Support Syst 2014 Oct;66:20-35. [CrossRef]
- Wheeler E, Copeland C, McNulty T, Caktus Consulting Group. Rapidsms. 2016. Project Mwana URL: https://www.rapidsms.org/projects/project-mwana/ [accessed 2017-01-28] [WebCite Cache]
- Aker JC, Mbiti IM. Files.ethz. 2010. Mobile Phones and Economic Development in Africa URL: https://www.files.ethz.ch/isn/117279/wp211.pdf [accessed 2017-03-29] [WebCite Cache]
- Burmark L. Visual literacy: learn to see, see to learn. Alexandria, Va: Association for Supervision and Curriculum Development; 2002.
- Schnall R, Rojas M, Bakken S, Brown W, Carballo-Dieguez A, Carry M, et al. A user-centered model for designing consumer mobile health (mHealth) applications (apps). J Biomed Inform 2016 Apr;60:243-251. [CrossRef] [Medline]
- Crooks R, Lankow J, Ritchie J. Visage. 2012. A Business Guide To Visual Communication e-book URL: https://visage.co/ [accessed 2017-01-28] [WebCite Cache]
- Dragan A. Peelregion. 2009. The importance of addressing linguistic ethno-cultural diversity in the delivery of public health services: a literature review URL: https://www.peelregion.ca/health/resources/pdf/adriana.pdf [accessed 2017-02-20] [WebCite Cache]
- Martínez-Pérez B, de la Torre-Díez I, López-Coronado M. Privacy and security in mobile health apps: a review and recommendations. J Med Syst 2015 Jan;39(1):181. [CrossRef] [Medline]
- Georgsson M, Staggers N. An evaluation of patients' experienced usability of a diabetes mHealth system using a multi-method approach. J Biomed Inform 2016 Feb;59:115-129 [FREE Full text] [CrossRef] [Medline]
- Bernhardt JM, Chaney JD, Chaney BH, Hall AK. New media for health education: a revolution in progress. Health Educ Behav 2013 Apr;40(2):129-132. [CrossRef] [Medline]
- Eysenbach G, CONSORT-EHEALTH. Improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
- Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health 1999 Sep;89(9):1322-1327. [Medline]
- Virzi RA. Refining the test phase of usability evaluation: how many subjects is enough? Hum Factors 1992;34(4):457-468. [CrossRef]
- Eapen ZJ, Peterson ED. Can mobile health applications facilitate meaningful behavior change?: time for answers. J Am Med Assoc 2015;314(12):1236-1237. [CrossRef] [Medline]
|AES: advanced encryption standard|
|AF: atrial fibrillation|
|BITs: behavioral intervention technology|
|HIV: human immunodeficiency virus|
|LMIC: low- and medium-income countries|
|mHealth: mobile health|
|PHI: personal health information|
|INR: international normalized ratio|
|SMS: short message service|
|TLS: Transport Layer Security|
|VPN: virtual private network|
Edited by G Eysenbach; submitted 22.08.16; peer-reviewed by CJ Lee, W Brown, J Thakkar; comments to author 05.12.16; revised version received 27.01.17; accepted 21.02.17; published 03.04.17
©Laura Siga Stephan, Eduardo Dytz Almeida, Raphael Boesche Guimaraes, Antonio Gaudie Ley, Rodrigo Gonçalves Mathias, Maria Valéria Assis, Tiago Luiz Luz Leiria. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 03.04.2017.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.