Published on 17.01.18 in Vol 6, No 1 (2018): January
The Impact of mHealth Interventions: Systematic Review of Systematic Reviews
Background: Mobile phone usage has been rapidly increasing worldwide. mHealth could efficiently deliver high-quality health care, but the evidence supporting its current effectiveness is still mixed.
Objective: We performed a systematic review of systematic reviews to assess the impact or effectiveness of mobile health (mHealth) interventions in different health conditions and in the processes of health care service delivery.
Methods: We used a common search strategy of five major scientific databases, restricting the search by publication date, language, and parameters in methodology and content. Methodological quality was evaluated using the Measurement Tool to Assess Systematic Reviews (AMSTAR) checklist.
Results: The searches resulted in a total of 10,689 articles. Of these, 23 systematic reviews (371 studies; more than 79,665 patients) were included. Seventeen reviews included studies performed in low- and middle-income countries. The studies used diverse mHealth interventions, most frequently text messaging (short message service, SMS) applied to different purposes (reminder, alert, education, motivation, prevention). Ten reviews were rated as low quality (AMSTAR score 0-4), seven were rated as moderate quality (AMSTAR score 5-8), and six were categorized as high quality (AMSTAR score 9-11). A beneficial impact of mHealth was observed in chronic disease management, showing improvement in symptoms and peak flow variability in asthma patients, reducing hospitalizations and improving forced expiratory volume in 1 second; improving chronic pulmonary diseases symptoms; improving heart failure symptoms, reducing deaths and hospitalization; improving glycemic control in diabetes patients; improving blood pressure in hypertensive patients; and reducing weight in overweight and obese patients. Studies also showed a positive impact of SMS reminders in improving attendance rates, with a similar impact to phone call reminders at reduced cost, and improved adherence to tuberculosis and human immunodeficiency virus therapy in some scenarios, with evidence of decrease of viral load.
Conclusions: Although mHealth is growing in popularity, the evidence for efficacy is still limited. In general, the methodological quality of the studies included in the systematic reviews is low. For some fields, its impact is not evident, the results are mixed, or no long-term studies exist. Exceptions include the moderate quality evidence of improvement in asthma patients, attendance rates, and increased smoking abstinence rates. Most studies were performed in high-income countries, implying that mHealth is still at an early stage of development in low-income countries.
JMIR Mhealth Uhealth 2018;6(1):e23
Mobile phone usage has been rapidly increasing worldwide [, ]. In many high-income countries, mobile phone subscriptions exceed the population, and in many low- and middle-income countries, this number is expanding faster than other infrastructures [ ]. Mobile technology’s mobility, instantaneous access, and direct communication allow for faster transfer of health information, which in turn supports medical and public health practices. These characteristics define mobile health (mHealth). mHealth could transform the worldwide delivery of health services, especially in low- and middle-income countries. This includes simple apps and complex technologies including voice, text messaging (short message service, SMS), multimedia message service, Bluetooth technology, and others [ ].
mHealth is increasingly being used (1) for patient communication, monitoring, and education, (2) to reduce the burden of diseases linked with poverty, (3) to improve access to health services, clinical diagnosis, and treatment adherence, and (4) for chronic disease management [- ].
It is commonly stated that mHealth effectively improves the quality of care and that it can quickly be adapted on a large scale and at low cost, but evidence regarding its effectiveness and cost-effectiveness is still lacking in different areas. As the evidence in this field is consistently growing, many systematic reviews have already been performed. A thorough review of available evidence is essential to guide clinical and health policy decisions. Consequently, complex reviews, which may assess multiple interventions, different or distinct populations, and different outcomes may adequately support health policy decision making in this context . Therefore, the objective of this study was to perform a systematic review of systematic reviews that assessed the effectiveness of mHealth interventions in different health conditions and in the processes of health care service delivery, in order to investigate for which areas there is evidence and which areas still require further studies.
This study is a systematic review of systematic reviews and is part of a series of four reviews that assessed the impact to telehealth strategies in different health conditions and in health care service delivery. The study was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement and the methodological considerations when using existing systematic reviews .
Search Strategy and Inclusion Criteria
A literature search was performed using MEDLINE (accessed by PubMed), IEEE Xplore Digital Library, Cochrane (Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials, Cochrane Methodology Register, Database of Abstracts of Reviews of Effects, National Health Service Economic Evaluation Database), Literatura Latino-Americana e do Caribe em Ciências da Saúde (LILACS), and Indice Bibliográfico Español de Ciencias de la Salud (IBECS) in November 2015. Cochrane, LILACS, and IBECS were assessed by Virtual Health Library (Biblioteca Virtual em Saúde). The search was restricted to studies in humans, publication date (from January 1, 2000, up to the search data), and publication language (English, French, Spanish, Italian, and Portuguese).
We used a common search strategy and allocated relevant studies to their respective reviews before assessing their risk of bias and extracting data. The search strategies for each database are given in. All studies were included in the software StArt (State of the Art through Systematic Review) [ ]. In this software, different combinations of the terms “systematic” and “review” identified systematic reviews by title or abstract.
An additional search using the same terms and parameters was performed in February 2016. The new search was more specific to make assessment manageable and was supplemented by a manual search of reference lists .
Systematic reviews covering the effectiveness or cost-benefit analysis of eHealth interventions were included. Exclusion criteria were (1) studies about feasibility, user acceptance, or usability, (2) studies that assessed “perceived benefits,” and (3) nonsystematic reviews.
Initial screening was based on titles and abstracts, and articles were independently evaluated. Abstracts lacking information were retrieved for full-text evaluation. Subsequently, 2 investigators independently evaluated full-text articles and determined eligibility. Authorship, journal, or years were not blinded.
Data Extraction and Quality Assessment
Five investigators conducted data extraction following standardized criteria, and results were reviewed by 2 senior researchers. The following data were extracted: journal, publication year, databases searched, time period, setting/scenario, theme/specialty, objective, intervention type, number of studies, total number and countries of patients, study design, whether a review of systematic reviews or meta-analysis was performed, outcomes, main results, lessons and barriers for implementation, and main limitations. For cost analysis, the type and the perspective (ie, patient, health care provider, and/or society) were also extracted. Studies were evaluated using the Measurement Tool to Assess Systematic Reviews (AMSTAR) checklist for assessing methodological quality .
A flow diagram of literature search and study selection results is shown in. The database first search resulted in 10,106 articles, the updated search resulted in 572 articles, and 11 studies were found from additional sources. After exclusion of duplicates, 625 articles were screened and 537 were excluded. Full text of 88 eligible articles was reviewed. Out of these, 62 were excluded for not meeting the criteria relating to study type, intervention, or outcome. Three studies [ , , ] were excluded for being included in a systematic review of systematic reviews that was included in this manuscript, to avoid duplication. The 23 studies remaining were included in this systematic review.
Descriptive Analysis of the Systematic Reviews
General Characteristics of Reviewed Papers
The 23 systematic reviews included () were published between 2009 and 2016 in 16 journals. The systematic reviews involved 371 studies. After verifying the sample size of each study, we found that at least 79,665 participants were included. In these reviews, systematic literature searches were performed from 1950 to April 2015 (see ).
Of the reviews, 17 included studies that were performed in low- and middle-income countries, 13 included studies in multiple settings, 6 specified particular settings, and 2 did not describe the setting. mHealth modalities described were mainly apps for chronic diseases, but also for disease management, treatment adherence, and changes in health behavior. Nine studies performed a meta-analysis [- ].
The main objective of the reviews was to analyze the impact or effectiveness of mHealth interventions on chronic and noncommunicable diseases. Other focuses were to analyze mHealth in supporting chronic diseases management, health behavior change, attendance at appointments, disease and rehabilitation management, and the use of mHealth strategies by health workers.
Different devices were used, including mobile phones, smartphones, personal digital assistants, MP3, phone plus app, medical device connected to phone by cord or wirelessly, and many others.
The most frequent intervention was SMS for reminders, education, motivation, or prevention. Sensors and point-of-care diagnosis, data collection, provider-provider communication, patient-provider communication, decision support, client education, provider work planning, training, protocol-based treatment, voicemail, videos, immediate physician feedback from a central location, cloud-based interactive voice response, disease management calls, disease monitoring, automated email to clinicians, treatment adherence, and phone counseling were also used.
These interventions were performed for smoking cessation, to increase physical activity, chronic disease management, chemotherapy-related symptoms monitoring, sexual health behavior safety, alcohol consumption reduction, medication adherence, appointment attendance, stress management and anxiety reduction, vaccination timeliness, prenatal support, reduction in emergency referrals or adverse events, health information access, cardiopulmonary resuscitation skills, patient satisfaction, and social functioning.
Hall et al  categorized 12 common applications: (1) client education and behavior change, (2) sensors and point-of-care diagnostics, (3) registries and vital events tracking, (4) data collection and reporting, (5) electronic health records, (6) electronic decision support: information, protocols, algorithms, checklists, (7) provider-provider communication: user groups and consultation, (8) provider work planning, (9) provider training and education, (10) human resource management, (11) supply chain management, and (12) financial transactions and incentives.
Multiple interventions were used on significantly varied targets, and the duration of follow-up varied from a few minutes to up to 24 months.
The control group care was not clear in some reviews [, , ], but others were very specific.
The primary outcomes assessed were clinical outcomes (eg, frequency of hypoglycemic events, symptoms, deaths), surrogate outcomes (eg, glycated hemoglobin [HbA1c], blood pressure, lipid profile, cardiovascular disease risk profiles, lung function tests results, nebulizer use, weight, body mass index [BMI]), behavioral or lifestyle changes (eg, sexual behavior, smoking cessation, increase in physical activity), and processes of care (eg, attendance rates, compliance with medication taking, data management, communication performance, time to diagnosis, time to treatment, changes in professionals’ workload).
The secondary outcomes were cost, patient satisfaction, and potential harms and adverse effects.
Quality of Included Studies
shows the results of the quality assessment of the 23 systematic reviews. Ten were rated low quality (AMSTAR score 0-4), seven moderate quality (score 5-8), and six were high quality (score 9-11).
Regarding bias risk assessment, 10 reviews did not explicitly report on study quality assessment. Two specified that the risk of bias was mostly either low or unclear . Free et al [ , ] related that only 4 trials were at low risk of bias in all areas. All studies included in Car et al [ ] had high risk of bias.
Baron et al used the McMaster University quality assessment tool and reported that the overall quality was poor . Fanning et al used the Guide to Community Preventative Services data extraction form and reported that 7 studies were rated “fair” and 4 were “good” [ ]. Three reviews [ ] used the Cochrane Handbook for Systematic Reviews of Interventions [ ] reporting varying methodological quality, with some providing insufficient information.
Two reviews reported adequate sequence generation for randomization . De Jongh et al [ ] reported adequate sequence generation in 3 of 4 and that none of the included studies were clear if the allocation was concealed. A potential for bias occurred from the apparent lack of blinding of outcome assessors. In Vodopivec-Jamsek et al [ ], allocation concealment was considered adequate in 2 studies and unclear in 2 studies. Only one study reported on blinding of personnel collecting and analyzing samples. No mention is made of blinding of outcome assessors or researchers, which could have introduced bias.
Incomplete data analysis methods varied, with analysis and reporting based on intention-to-treat analysis and on only participants who completed the study, which could influence generalizability of the findings. Substantial heterogeneity was detected across analyses; however, a post hoc decision to conduct the main analysis using a random-effects model resulted in no difference in the interpretation of findings. Bacigalupo et al  also used Cochrane guidance [ ], reporting that 4 of 7 studies presented low risk of bias. The only studies in which Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methodology [ ] was used were those published in the Cochrane Database of Systematic Reviews [ , , , , ].
The reviews show a variety of results, as expected, for using different devices and different mHealth interventions on different populations. The most widely used and successful intervention was SMS addressed to chronic disease patients. Positive impact was reported on clinical outcomes, adherence to treatment and care, health behavior changes, disease management, attendance rates, and others. However, some reviews showed conflicting results, with no significant differences between intervention and control groups.
Positive impact has been demonstrated with moderate-quality evidence that text messaging interventions showed greater improvements in the pooled symptom score (mean difference 0.36, 95% CI -0.56 to -0.17) compared with the control group . Very low-quality evidence (GRADE Very Low) showed the following: increased office visits in the SMS group, whereas increased hospital admissions for the control group [ ]; a reduction in hospitalizations and better symptom control using home spirometry transmission to physicians via SMS and telephone counseling [ ]; increased unscheduled visits to the emergency department and hospitalizations using mobile phone-based interactive self-care software plus management feedback on pulmonary function [ ]; and improvements in cough and nighttime symptoms and decreased daily doses of medication using peak flow and symptoms monitoring via SMS [ ].
Exercise capacity in cardiac rehabilitation improved a 6-minute walk test from 524-637 meters (P=.009) in monitored exercise training assisted by a mobile phone app. In an 8-week, nonrandomized clinical trial, there was 17.6% (SD 16.1) improvement in mobile (n=30) versus 11.5% (SD 35.9) in control group (n=32) (P>.05) .
Congestive Heart Failure
Mobile technology counseling led to fewer symptom complaints in congestive heart failure subjects . There was relative risk reduction (20%) of death or hospitalization and better quality of life with nurse telephone intervention and cardiologist support [ ].
Chronic Lung Diseases
An SMS program improved cough symptoms and sleep quality . Mobile phones recorded respiratory symptoms during exercise training that increased walking distance [ ].
No statistically significant effects were demonstrated on chemotherapy-related toxicity symptoms when patients used a mobile phone app to report symptoms and receive self-care advice .
Educational group sessions for diabetic women via SMS showed positive effects on sleep, positive actions, and coping .
There was moderate-quality evidence that text messaging intervention led to greater improvements in peak flow variability (mean difference -11.12, 95% CI -19.56 to -2.68) compared with the control group. No significant differences existed between groups in impact on forced vital capacity or forced expiratory flow in 1 second (GRADE Moderate) .
Forced expiratory flow in 1 second improved after 4 months of home spirometry transmission to physicians via SMS and telephone counseling . Using mobile phone-based, interactive self-care software plus management feedback on pulmonary function showed evidence of improvement in pulmonary function and health-related quality of life and decreased unscheduled visits to emergency departments and hospitalizations, plus an increase in the proportion of participants who received leukotriene inhibitors [ ].
Improvement in at least 1 risk factor (relative risk [RR] 1.4, 95% CI 1.1-1.7) in a randomized controlled trial (RCT) that assessed the impact of lifestyle counseling, mobile intervention, devices for home monitoring plus SMS messaging of recommendations, compared to lifestyle counseling alone. The mHealth group was more likely to achieve goals for blood pressure (BP) (62.1% vs 42.9%), HbA1c (86.4% vs 54.2%), and BMI (0.37 kg/m2decrease vs 0.38 increase). No significant differences in smoking cessation, cholesterol, or medication adherence .
Chronic Lung Diseases
Three RCTs showed nonsignificant results in lung function parameters .
Educational program via SMS for self-management improved HbA1c, low-density lipoprotein cholesterol, and microalbuminuria . Cloud-based interactive voice response calls and automated email for clinicians reduced HbA1c [ ]. SMS promoting medication adherence reduced fasting plasma glucose and 2-hour, postprandial glucose [ ]. SMS with tailored instructions on diabetes mellitus care to adolescents and elderly patients improved HbA1c [ ]. Diabetes self-management intervention reduced HbA1c [ ]. Diabetes education and advice via mobile phone and SMS significantly reduced HbA1c [ ]. A mobile phone-based, home glucose monitoring program study decreased HbA1c from 13.2% to 10.5% after 3-6 months [ ]. Text messaging improved HbA1c, with positive results in 6 of 8 studies [ ]. Daily glucose readings were transmitted via mobile phone to a physician who made adjustments plus clinic appointment [ ].
The results were mixed on the impact of mobile telemonitoring supporting diabetes management and feedback on HbA1c but were more consistently positive for studies in type 2 diabetes. Ten of the 13 studies in type 2 diabetes and 4 of 7 studies on type 1 diabetes found mHealth led to HbA1c improvement . Studies without health care professional feedback led to HbA1c improvement, suggesting professional feedback might not be necessary [ ]
However, one study showed reduced benefit: educational group sessions for diabetic women via SMS showed higher diastolic blood pressure (+7 mmHg) and less spiritual hope at 6 months, and frequent texters had higher BMI and more sedentary time 
Text messages to maintain contact, monitor, and respond to medication issues in patients on antiretrovirals statistically significantly reduced human immunodeficiency virus (HIV) viral load by improving adherence .
Improvement in BP has been demonstrated with SMS or voice mail and immediate physician feedback ; SMS enabling interactive monitoring, where the provider sets reminders for patients, collects data, and schedules visits [ ]; and electronic salt sensor and mobile sensor [ ].
However, other reviews showed no benefit. Two trials showed no statistically significant reduction in BP . Groups that did or did not receive alerts and reminders had nearly equal percentages of patients with controlled BP at follow-up [ ].
Risk Factors for Coronary Artery Disease
Significant improvements were shown with automatic sphygmomanometer, blood glucose and lipid meter, and mobile phone .
Moderate-quality evidence of short-term weight loss in overweight and obese adults with BMI of 25-39.9 using mHealth structured program was shown . Mobile phone personalized advice and motivation observed a significant improvement in percent of body fat lost; however, BMI and systolic and diastolic BP were unchanged [ ].
Behavioral or Lifestyle Changes
Seven of 14 trials reported statistically significant benefits on self-reported physical activity outcomes, but no statistically significant change was demonstrated on trials using SMS to reduce calorie intake and increase physical activity or for trials targeting physical activity only, diet only, or diet and physical activity .
Positive results have been demonstrated with moderate-quality evidence that mobile phone-based cessation interventions increased abstinence rates at 26 weeks (RR 1.67 95% CI 1.46-1.90, 12 RCTs in high income countries, 11,885 participants, GRADE Moderate). Six studies verified quitting biochemically at 6 months (RR 1.83 95% CI 1.54-2.19) . SMS-based smoking cessation interventions doubled biochemically verified smoking cessation at 6 months [ ].
One study showed statistically significant benefits on behavior change .
Processes of Care
Pregnant women connecting to their health care provider through bidirectional mobile phone messaging were more likely to have skilled birth attendants .
A consistent improvement on attendance rates has been demonstrated. Text message reminders improved the rate of attendance at health care appointments compared with no reminders (RR 1.10; 95% CI 1.03-1.17) (7 studies, 5841 participants, GRADE Moderate) . They had a similar impact to phone call reminders (RR 0.99, 95% CI 0.95-1.02) (3 studies, 2509 participants, GRADE Moderate). Text messages plus postal reminders improved attendance rates at appointments compared to postal reminders (RR 1.10, 95% CI 1.02-1.19) (1 study, 291 participants, GRADE Low) [ ].
In a limited study, Shetty et al  compared the effect of one SMS reminder sent to type 2 diabetes patients every third day for 1 year. Although there was no significant reduction in the mean HbA1c values in either group, the percentage of patients with HbA1c<8% decreased significantly in the SMS group. Free et al [ ] included one study assessing SMS reminders on attendance for vaccination at different time points (as different studies). The relative risk was 1.19 (95% CI 1.15-1.23), but there was significant heterogeneity (I2=99.7%, P<.001) [ ]. In 8 studies Free et al [ ] observed that the pooled effect on appointment attendance using text message reminders versus no reminder was RR 1.06 (95% CI 1.05-1.07) [ ]. There was no effect on the number of cancelled appointments (RR 1.08, 95% CI 0.89-1.30), and no difference in attendance using SMS reminders versus other reminders (RR 0.98, 95% CI 0.94-1.02) [ ].
Hall et al  assessed 6 studies in low- and middle-income countries. The studies showed mHealth interventions to be beneficial, except a pilot study in rural Swaziland [ ]. Mahmud et al [ ] trained community health workers to use mobile phones for reporting on patient adherence, send appointments reminders, and answer physician queries. This evaluation was based on a retrospective observational study, with the possibility of recall bias.
Data Collection and Health Care Team Communication
Studies that included data collection as a primary mHealth function demonstrated that mobile phones effectively collect and report data, transfer patient-relevant information, and reduce the need for face-to-face communication . There is a reduction in communication delays and improvement on data collection and reporting [ ]. One trial reported a statistically significant improvement in nurse/surgeon communication using mobile phones [ ].
Adherence to Treatment
mHealth strategies are beneficial to increase adherence to treatment in diabetes patients: SMS to increase adherence to prescriptions in type 2 diabetes , electronic blister packs with SMS communication [ ], and insulin adherence among type 1 diabetes patients who received tailored text messages with goal-specific prompts [ ].
Compliance with medication taking among memory-impaired, HIV-positive patients significantly increased compared to those without impairment. Hepatitis A and B dose vaccination schedules also increased among international travelers with reminders sent to mobile phones .
Hall et al reported improved adherence to tuberculosis treatment by using text messages and adherence to HIV therapy, with evidence of reduction of viral load , although the authors did not perform quality assessment. The authors commented that a risk-benefit analysis that assessed mHealth reminders to improve tuberculosis medication adherence showed increased mortality and disability-adjusted life years compared to directly observed treatments, and that an RCT in China observed no benefit with voice calls. They also reported limited evidence of contraceptive knowledge improvement with the use of an SMS education scheme; risk reduction of contracting dengue fever, but no significant improvement over alternative schemes; antenatal care improvement, with increases in using skilled birth attendants and women with 4 antenatal visits; and improved vaccination rates in rural Kenya [ ].
Hamine et al observed in 2 studies that text messaging tailored to counteract negative beliefs about asthma and education was associated with improved adherence to medication .
Hall et al mentioned studies showing improvement of diagnostic rates of dermatological conditions with mobile teledermatology . However, two trials using mobile phones to transmit photos to offsite clinicians reported significant reductions in correct diagnoses compared to an onsite specialist [ ]. One trial reported reduction in quality of electrocardiography (ECG) transmitted via mobile phone to an ECG transmitted by fax, but with no effects on ECG interpretation [ ]. Krishna et al [ ] showed that fewer days to diagnosis and treatment were reported among those who were notified of test results via text messages.
The following studies assessed costs, with evidence of reduction when compared to control groups. SMS reminders were more cost-effective than telephone and were equally efficacious . SMS was found to be 35% and 45% less expensive, respectively, per attendance through reductions in research assistants’ work hours and in telecommunications costs. SMS reminders were less expensive than mobile phone reminders [ , ]. The relative cost of the text message per attendance was 55% and 65% of the cost of phone call reminders [ ]. There was a reduction in patient burden to transportation time and costs in African countries [ ]. The cost of text-based support per 1000 enrolled smokers was GB 278 per quitter, but when future health service costs were included, text-based support was considered a cost-saver [ ].
The individual studies did not assess this outcome.
Potential Harms and Adverse Effects
Only 3 reviews assessed this outcome [, , ]. Vodopivec-Jamsek et al [ ] reported one study where mobile phone messaging was used to support smoking cessation and that messaging did not have any impact on rates of pain in the thumb or finger joints (RR 1.08, 95% CI 0.74-1.59), or car crash rates (RR 0.88, 95% CI 0.58-1.35) at 26 weeks follow-up.
The current evidence shows benefits of mHealth in chronic disease management, improving symptoms and peak flow variability in asthma patients and chronic pulmonary diseases symptoms; heart failure symptoms, reducing deaths and hospitalization and improving quality of life; glycemic control in diabetes patients; and improving BP in hypertensive patients. SMS reminders improved attendance rates at reduced costs and improved adherence to tuberculosis and HIV therapy in some scenarios, with evidence of decrease of viral load.
Mobile devices may improve patient-provider communication, facilitating assistance in disease management. It may increase the likelihood of delivering health interventions to hard-to-reach populations. Whittaker et al  listed advantages of using mobile interventions: convenience, ease, cost-effectiveness, scalability, personalization, and “the ability to send time-sensitive messages with an ‘always on’ device.” Hamine et al [ ] observed that mHealth tools can impact patients who are less inclined to engage with traditional health services. Aranda-Jan et al [ ] reported that governments may benefit from increased support of patient management and increased direct communication in rural areas. Health workers may receive support through professional networks and can prioritize efforts and increase their role in active case detection using disease surveillance systems. Baron et al [ ] assessed studies involving data transferring for diabetes management and suggested that recording and tracking of data might increase patients’ motivation to self-manage.
The most popular mHealth intervention was behavior change interventions using text messaging. The low cost and low broadband requirements facilitate the spread of applications, even in low-income countries.
Different uses of motivation have also been described as a tool to be used in mHealth interventions in some of the systematic reviews analyzed. These are mainly focused on patient motivation in different contexts on chronic diseases , communicable diseases [ ], physical activity [ , , ], and empowerment in the use of services [ ].
Two reviews [, ] reported lessons learned: patient needs must be met, training and support provided, users engaged in the development and implementation of the tools, and consideration of patient age and education level. Usage might improve with user-centered design, engagement strategies, and feedback to the users.
This study provides a thorough review of available evidence on effectiveness of mHealth interventions in different health conditions and in the processes of health care service delivery, so it useful to guide clinical and health policy decisions. However, there are some limitations of the studies that need to be addressed.
Studies assessing mHealth interventions usually do not include the assessment of risks, consumer satisfaction, and acceptability of the intervention . None reported studies assessing security and confidentiality. Chen et al [ ] noted that mobile phone numbers frequently change in China, reducing certainty the message was delivered to the correct recipient. This was not assessed elsewhere. Particularly in low-income countries where mobile phones are frequently shared, these are important confidentiality issues that must be taken into account when designing interventions [ ]. De Jongh et al [ ] warned of inaccurate data input, misinterpretation of the information, and difficulties in reading due to vision or literacy problems and remarked that text messaging cannot capture verbal and nonverbal cues. Norwell suggested that doctors agree on vocabulary to minimize the risk of patients’ misunderstanding the message [ ]. Risks associated with mobile phone messaging in general may apply, such as car accidents [ ].
Other drawbacks related to mHealth initiatives were reported by Hamine et al  Some patients’ concerns included dependence on professional supervision, unnecessary medicalization, fear of technology failure, and difficulty in understanding and using the technology. Provider concerns related to data review and response times, increased clinical workload and workflow, record maintenance, and concerns about supervision and technology dependence. Aranda-Jan et al [ ] reported difficulties in monitoring text message content, data underreporting, and the possibility of biased responses from participants.
Two reviews cite availability and poor connectivity as barriers . Most identified the main limitation as the small number of RCT studies, patients enrolled, and the low-to-moderate quality of evidence. Researchers should validate their pilot study findings through follow-up studies with adequate research designs and appropriate controls [ ]. Aranda-Jan et al [ ] mention that claimed benefits are unclear and long-term results uncertain. Also, only 2 reviews assessed funding [ ]. This is important to identifying conflicts of interest. To improve the suboptimal reporting and standardize Web-based and mobile health interventions, the CONSORT-EHEALTH was developed, a checklist that is an extension of the CONSORT statement [ ].
Costs have not been routinely assessed. Such costs may be dependent on the nature of the intervention and the size and characteristics of the target group . More attention to cost implications seems warranted [ ]. Additionally, future studies should compare effects in different contexts [ ].
Although mHealth is growing in popularity, the evidence for efficacy is still limited. Positive results were reported for chronic disease management, improving chronic pulmonary diseases symptoms and heart failure symptoms, reducing deaths and hospitalization and improving quality of life, and improving glycemic control in diabetes patients and BP in hypertensive patients. SMS reminders improved attendance rates and improved adherence to tuberculosis and HIV therapy in some scenarios. However, in general the methodological quality of the studies included in the systematic reviews is low. For some fields, its impact is not evident or is mixed. Exceptions are the moderate improvement in asthma patients, attendance rates, and smoking cessation rates.
The authors thank the team that worked on the systematic review: Renato Minelli Figueira, Gustavo Moreira Alkmim, Maria Clara Noman de Alencar, Nayara Dornela Quintino, Elsy Dumit-Bechara, Francesc Saigí-Rubió, Francisco Becerra-Posada, Edward Talbott Kelley and the undergratuate students Edson Alexandre Silva Carvalho, Fernanda Cotrim Stefanelli, Gabriel Almeida Silqueira Rocha, Grace Kelly Matos e Silva, Marcelo Henriques de Camargos, Thales Matheus Mendonça Santos, Thiago Adriano de Deus Queiroz Santos.
DNO and MD are staff members of the Pan American Health Organization / World Health Organization (PAHO/WHO) and are solely responsible for the views expressed in the paper, which does not necessarily represent the views, decisions, or policies of the PAHO/WHO.
DNO, MBMA, and ALR conceptualized the study and designed the review. MSM and JAQO designed the search strategies with input from DNO, MBMA, and ALR. MBMA and ALR randomly checked the accuracy of extracted data. MSM and JAQO wrote the first draft of the review paper. MBMA, MD, ALR, and DNO contributed to the final draft of this manuscript. All authors read and approved the final manuscript.
Conflicts of Interest
Multimedia Appendix 1
Search methods and strategy.PDF File (Adobe PDF File), 23KB
Multimedia Appendix 2
Descriptive summary of the 23 systematic reviews included in mHealth review.PDF File (Adobe PDF File), 172KB
Multimedia Appendix 3
Quality assessment ratings of systematic reviews included in mHealth review.PDF File (Adobe PDF File), 76KB
- Carter A, Liddle J, Hall W, Chenery H. Mobile Phones in Research and Treatment: Ethical Guidelines and Future Directions. JMIR Mhealth Uhealth 2015 Oct 16;3(4):e95 [FREE Full text] [CrossRef] [Medline]
- Donner J. Research Approaches to Mobile Use in the Developing World: A Review of the Literature. The Information Society 2008 May 06;24(3):140-159. [CrossRef]
- World Health Organization. New horizons for health through mobile technologies. Geneva: World Health Organization; 2011. URL: http://www.who.int/goe/publications/goe_mhealth_web.pdf [accessed 2018-01-09] [WebCite Cache]
- Gurman TA, Rubin SE, Roess AA. Effectiveness of mHealth behavior change communication interventions in developing countries: a systematic review of the literature. J Health Commun 2012;17 Suppl 1:82-104. [CrossRef] [Medline]
- Nglazi MD, Bekker L, Wood R, Hussey GD, Wiysonge CS. Mobile phone text messaging for promoting adherence to anti-tuberculosis treatment: a systematic review. BMC Infect Dis 2013 Dec 02;13:566 [FREE Full text] [CrossRef] [Medline]
- Devi BR, Syed-Abdul S, Kumar A, Iqbal U, Nguyen P, Li YJ, et al. mHealth: An updated systematic review with a focus on HIV/AIDS and tuberculosis long term management using mobile phones. Comput Methods Programs Biomed 2015 Nov;122(2):257-265. [CrossRef] [Medline]
- Whitlock EP, Lin JS, Chou R, Shekelle P, Robinson KA. Using existing systematic reviews in complex systematic reviews. Ann Intern Med 2008 May 20;148(10):776-782. [Medline]
- Silva C, Zamboni A, Hernandes E, Di Thomazzo A, Belgamo A, Fabbri S. LaPES. StArt - State of the Art through Systematic Review URL: http://lapes.dc.ufscar.br/tools/start_tool [accessed 2018-01-10] [WebCite Cache]
- Smith V, Devane D, Begley CM, Clarke M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions. BMC Med Res Methodol 2011 Feb 03;11(1):15 [FREE Full text] [CrossRef] [Medline]
- Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 2007 Feb 15;7:10 [FREE Full text] [CrossRef] [Medline]
- Finitsis DJ, Pellowski JA, Johnson BT. Text message intervention designs to promote adherence to antiretroviral therapy (ART): a meta-analysis of randomized controlled trials. PLoS One 2014;9(2):e88166 [FREE Full text] [CrossRef] [Medline]
- Horvath T, Azman H, Kennedy GE, Rutherford GW. Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection. Cochrane Database Syst Rev 2012 Mar 14(3):CD009756. [CrossRef] [Medline]
- Car J, Gurol-Urganci I, de Jongh T, Vodopivec-Jamsek V, Atun R. Mobile phone messaging reminders for attendance at healthcare appointments. Cochrane Database Syst Rev 2012 Jul 11(7):CD007458. [CrossRef] [Medline]
- Guy R, Hocking J, Wand H, Stott S, Ali H, Kaldor J. How effective are short message service reminders at increasing clinic attendance? A meta-analysis and systematic review. Health Serv Res 2012 Apr;47(2):614-632 [FREE Full text] [CrossRef] [Medline]
- Gurol-Urganci I, de Jongh T, Vodopivec-Jamsek V, Atun R, Car J. Mobile phone messaging reminders for attendance at healthcare appointments. Cochrane Database Syst Rev 2013 Dec 05(12):CD007458. [CrossRef] [Medline]
- Fanning J, Mullen SP, McAuley E. Increasing physical activity with mobile devices: a meta-analysis. J Med Internet Res 2012;14(6):e161 [FREE Full text] [CrossRef] [Medline]
- de Jongh T, Gurol-Urganci I, Vodopivec-Jamsek V, Car J, Atun R. Mobile phone messaging for facilitating self-management of long-term illnesses. Cochrane Database Syst Rev 2012 Dec 12;12:CD007459. [CrossRef] [Medline]
- Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, et al. The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS Med 2013;10(1):e1001362 [FREE Full text] [CrossRef] [Medline]
- Free C, Phillips G, Watson L, Galli L, Felix L, Edwards P, et al. The effectiveness of mobile-health technologies to improve health care service delivery processes: a systematic review and meta-analysis. PLoS Med 2013;10(1):e1001363 [FREE Full text] [CrossRef] [Medline]
- Whittaker R, McRobbie H, Bullen C, Rodgers A, Gu Y. Mobile phone-based interventions for smoking cessation. Cochrane Database Syst Rev 2016 Apr 10;4:CD006611. [CrossRef] [Medline]
- Liang X, Wang Q, Yang X, Cao J, Chen J, Mo X, et al. Effect of mobile phone intervention for diabetes on glycaemic control: a meta-analysis. Diabet Med 2011 Apr;28(4):455-463. [CrossRef] [Medline]
- Hall CS, Fottrell E, Wilkinson S, Byass P. Assessing the impact of mHealth interventions in low- and middle-income countries--what has been shown to work? Glob Health Action 2014;7:25606 [FREE Full text] [Medline]
- Aranda-Jan CB, Mohutsiwa-Dibe N, Loukanova S. Systematic review on what works, what does not work and why of implementation of mobile health (mHealth) projects in Africa. BMC Public Health 2014;14:188 [FREE Full text] [CrossRef] [Medline]
- Fjeldsoe BS, Marshall AL, Miller YD. Behavior change interventions delivered by mobile telephone short-message service. Am J Prev Med 2009 Feb;36(2):165-173. [CrossRef] [Medline]
- Beratarrechea A, Lee AG, Willner JM, Jahangir E, Ciapponi A, Rubinstein A. The impact of mobile health interventions on chronic disease outcomes in developing countries: a systematic review. Telemed J E Health 2014 Jan;20(1):75-82 [FREE Full text] [CrossRef] [Medline]
- Baron J, McBain H, Newman S. The impact of mobile monitoring technologies on glycosylated hemoglobin in diabetes: a systematic review. J Diabetes Sci Technol 2012 Sep 01;6(5):1185-1196 [FREE Full text] [CrossRef] [Medline]
- Vodopivec-Jamsek V, de Jongh T, Gurol-Urganci I, Atun R, Car J. Mobile phone messaging for preventive health care. Cochrane Database Syst Rev 2012 Dec 12;12:CD007457. [CrossRef] [Medline]
- Higgins J, Green S. The Cochrane Collaboration. 2011. Cochrane Handbook for Systematic Reviews of Interventions URL: http://training.cochrane.org/handbook [accessed 2018-01-09] [WebCite Cache]
- Bacigalupo R, Cudd P, Littlewood C, Bissell P, Hawley MS, Buckley WH. Interventions employing mobile technology for overweight and obesity: an early systematic review of randomized controlled trials. Obes Rev 2013 Apr;14(4):279-291 [FREE Full text] [CrossRef] [Medline]
- Atkins D, Best D, Briss PA, Eccles M, Falck-Ytter Y, Flottorp S, GRADE Working Group. Grading quality of evidence and strength of recommendations. BMJ 2004 Jun 19;328(7454):1490 [FREE Full text] [CrossRef] [Medline]
- Krishna S, Boren SA, Balas EA. Healthcare via cell phones: a systematic review. Telemed J E Health 2009 Apr;15(3):231-240. [CrossRef] [Medline]
- Beatty AL, Fukuoka Y, Whooley MA. Using mobile technology for cardiac rehabilitation: a review and framework for development and evaluation. J Am Heart Assoc 2013;2(6):e000568 [FREE Full text] [CrossRef] [Medline]
- Peiris D, Praveen D, Johnson C, Mogulluru K. Use of mHealth systems and tools for non-communicable diseases in low- and middle-income countries: a systematic review. J Cardiovasc Transl Res 2014 Nov;7(8):677-691. [CrossRef] [Medline]
- Hamine S, Gerth-Guyette E, Faulx D, Green BB, Ginsburg AS. Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review. J Med Internet Res 2015 Feb 24;17(2):e52 [FREE Full text] [CrossRef] [Medline]
- Bloomfield GS, Vedanthan R, Vasudevan L, Kithei A, Were M, Velazquez EJ. Mobile health for non-communicable diseases in Sub-Saharan Africa: a systematic review of the literature and strategic framework for research. Global Health 2014 Jun 13;10:49 [FREE Full text] [CrossRef] [Medline]
- Valles Ortiz P, Miranda Félix P, García Sosa E. Mensajes de texto para el control glucémico en adultos con diabetes tipo 2: revisión sistemática. eGlobal 2015 Jan 01;14(1):435-444 [FREE Full text] [CrossRef]
- Agarwal S, Perry HB, Long L, Labrique AB. Evidence on feasibility and effective use of mHealth strategies by frontline health workers in developing countries: systematic review. Trop Med Int Health 2015 Aug;20(8):1003-1014 [FREE Full text] [CrossRef] [Medline]
- Shetty AS, Chamukuttan S, Nanditha A, Raj RKC, Ramachandran A. Reinforcement of adherence to prescription recommendations in Asian Indian diabetes patients using short message service (SMS)--a pilot study. J Assoc Physicians India 2011 Nov;59:711-714. [Medline]
- Kliner M, Knight A, Mamvura C, Wright J, Walley J. Using no-cost mobile phone reminders to improve attendance for HIV test results: a pilot study in rural Swaziland. Infect Dis Poverty 2013 Jun 14;2(1):12 [FREE Full text] [CrossRef] [Medline]
- Mahmud N, Rodriguez J, Nesbit J. A text message-based intervention to bridge the healthcare communication gap in the rural developing world. Technol Health Care 2010;18(2):137-144. [CrossRef] [Medline]
- Chen Z, Fang L, Chen L, Dai H. Comparison of an SMS text messaging and phone reminder to improve attendance at a health promotion center: a randomized controlled trial. J Zhejiang Univ Sci B 2008 Jan;9(1):34-38 [FREE Full text] [CrossRef] [Medline]
- Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011 Dec 31;13(4):e126 [FREE Full text] [CrossRef] [Medline]
|AMSTAR: Measurement Tool to Assess Systematic Reviews|
|BP: blood pressure|
|BMI: body mass index|
|CONSORT: Consolidated Standards of Reporting Trials|
|GRADE: Grading of Recommendations, Assessment, Development and Evaluation|
|HbA1c: glycated hemoglobin|
|IBECS: Indice Bibliográfico Español de Ciencias de la Salud|
|LILACS: Literatura Latino-Americana e do Caribe em Ciências da Saúde|
|mHealth: mobile health|
|PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses|
|RCT: randomized controlled trial|
|RR: relative risk|
|SD: standard deviation|
|SMS: short message service|
Edited by G Eysenbach; submitted 30.08.17; peer-reviewed by W Curioso, A Benis; comments to author 26.09.17; revised version received 21.11.17; accepted 08.12.17; published 17.01.18
©Milena Soriano Marcolino, João Antonio Queiroz Oliveira, Marcelo D'Agostino, Antonio Luiz Ribeiro, Maria Beatriz Moreira Alkmim, David Novillo-Ortiz. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 17.01.2018.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.