Background: Mobile health apps for diabetes self-management have different functions. However, the efficacy and safety of each function are not well studied, and no classification is available for these functions.
Objective: The aims of this study were to (1) develop and validate a taxonomy of apps for diabetes self-management, (2) investigate the glycemic efficacy of mobile app-based interventions among adults with diabetes in a systematic review of randomized controlled trials (RCTs), and (3) explore the contribution of different function to the effectiveness of entire app-based interventions using the taxonomy.
Methods: We developed a 3-axis taxonomy with columns of clinical modules, rows of functional modules and cells of functions with risk assessments. This taxonomy was validated by reviewing and classifying commercially available diabetes apps. We searched MEDLINE, EMBASE, the Cochrane Central Register of Controlled Trials, the Chinese Biomedical Literature Database, and ClinicalTrials.gov from January 2007 to May 2016. We included RCTs of adult outpatients with diabetes that compared using mobile app-based interventions with usual care alone. The mean differences (MDs) in hemoglobin A1c (HbA1c) concentrations and risk ratios of adverse events were pooled using a random-effects meta-analysis. After taxonomic classification, we performed exploratory subgroup analyses of the presence or absence of each module across the included app-based interventions.
Results: Across 12 included trials involving 974 participants, using app-based interventions was associated with a clinically significant reduction of HbA1c (MD 0.48%, 95% CI 0.19%-0.78%) without excess adverse events. Larger HbA1c reductions were noted among patients with type 2 diabetes than those with type 1 diabetes (MD 0.67%, 95% CI 0.30%-1.03% vs MD 0.37%, 95% CI –0.12%-0.86%). Having a complication prevention module in app-based interventions was associated with a greater HbA1c reduction (with complication prevention: MD 1.31%, 95% CI 0.66%-1.96% vs without: MD 0.38%, 95% CI 0.09%-0.67%; intersubgroup P=.01), as was having a structured display (with structured display: MD 0.69%, 95% CI 0.32%-1.06% vs without: MD 0.69%, 95% CI –0.18%-0.53%; intersubgroup P=.03). However, having a clinical decision-making function was not associated with a larger HbA1c reduction (with clinical decision making: MD 0.19%, 95% CI –0.24%-0.63% vs without: MD 0.61%, 95% CI 0.27%-0.95%; intersubgroup P=.14).
Conclusions: The use of mobile app-based interventions yields a clinically significant HbA1c reduction among adult outpatients with diabetes, especially among those with type 2 diabetes. Our study suggests that the clinical decision-making function needs further improvement and evaluation before being added to apps.
Diabetes mellitus poses enormous challenges to China’s health care system due to its mortality, prevalence, and costs. Of 8.3 million deaths in China in 2010, 37.3% (3.1 million) were attributable to cardiovascular disease, which was also one of the leading causes of disability-adjusted life-years . Diabetes is not only an independent risk factor for cardiovascular disease [ ], but also associated with increased mortality from a range of cardiovascular diseases (eg, ischemic heart disease and stroke), as well as noncardiovascular diseases (eg, infections) among Chinese adults [ ]. In 2008, the estimated prevalence of diabetes was 9.7%, accounting for 92.4 million adults with diabetes [ ]. A more recent cross-sectional survey reported an even larger estimate (11.6% among Chinese adults, ie, 113.9 million) in 2010 [ ]. In addition, expenditures for the medical care of patients with diabetes were 3.38 times higher than for people with normal glucose tolerance [ ].
Once diabetes is diagnosed, lifetime diabetes self-management is critical to glycemic control and is associated with the long-term prognosis for patients with diabetes. Diabetes self-management includes self-monitoring blood glucose, making healthy lifestyle choices (healthy eating, physical activity, tobacco cessation, weight management, and coping with stress), taking and managing medications, preventing diabetes complications (self-monitoring of foot health; active participation in screening for eye, foot, and renal complications; and immunizations), and setting self-selected behavioral goals . In China, diabetes self-management education and support are provided during outpatient visits and are a huge burden on patients, their families, and the health system. Hence, a more cost-effective way to provide diabetes self-management education and support is essential for reducing the socioeconomic burden of diabetes.
Mobile apps are the computer programs or software installed on smart mobile devices, with computing and connectivity capability built right into an operating system. With the rapid and ongoing growth in wireless connectivity, more than 500 million Chinese were smartphone and apps users in 2016 . In addition to their universality, apps provide real-time interactions and data transmission, which can be used in providing diabetes self-management education and support [ - ]. Accordingly, the American Diabetes Association (ADA) guideline has stated that mobile apps may be a useful element of effective lifestyle modification to prevent diabetes [ ].
In the iTunes App Store for iOS and Google Play for Android, diabetes is one of the top-ranked categories [, ], with more than 1100 different apps available for download. In contrast, according to a recent systemic review [ ], there were only 5 randomized controlled trials (RCTs) assessing the effectiveness of apps in diabetes self-management. The contrast between the number of commercially available apps and the number of RCTs of apps demonstrates a shocking lack of evidence to support the recommendation of a specific app for diabetes self-management. Consequently, it is extremely difficult for clinicians and patients to choose a safe and effective one among the thousands of available apps [ ].
Despite their variety and complexity, apps for diabetes self-management always share a limited number of basic functions, which can be classified into several simple categories (eg, self-monitoring, education, alerts and reminders, and communication) . Therefore, indirect evidence from systematic reviews of existing RCTs can give insight into the efficacy of each app function, which is helpful in estimating the effectiveness of a specific app and making recommendations for effective functions. Nevertheless, prior systematic reviews involving mobile app-based interventions with multiple functions have not attempted to investigate their differential effectiveness [ - ]. As a result, it remains unclear how their functions contribute to the efficacy of apps.
To address functional efficacy, a classification of app functions is required . Moreover, the classification should be comprehensive, with not only considerations of functions but also recommendations for clinical practice [ ], as well as risk assessment [ , ]. However, existing classifications are inconsistent, and they primarily focus on functions [ , , , - ]. Inconsistency and incompleteness have limited their use in classifying functions of diabetes self-management apps.
The aims of this systematic review of RCTs were to (1) develop and validate a taxonomy of apps for diabetes self-management, (2) perform a meta-analysis investigating the effects of mobile app-based interventions on glycemic control in adults with diabetes, and (3) explore the contribution of different functions to the glycemic efficacy of entire app-based interventions using the taxonomy and subgroup analyses.
Taxonomy Development and Validation
We developed a preliminary taxonomy based on previous classifications, evidence-based guidelines, and authoritative recommendations, and validated it by reviewing commercially available apps for diabetes management. The contents of the taxonomy were confirmed if all functions of the available apps could be classified. After validation, we proposed a final taxonomy for diabetes management apps., part A, shows the flow chart of taxonomy development. , part B, shows the review of previous classifications [ , , , - ].
The preliminary taxonomy was validated by a review of commercially available diabetes apps, as shown in, part D. We searched the iTunes App Store (Apple Inc, Cupertino, CA, USA) and Google Play (Google Inc, Mountain View, CA, USA) (for the United States and China, February 1, 2016) using the terms “diabetes” OR “blood glucose” to identify apps for diabetes management. Apps with real-time interactions and any functions supporting self-monitoring of blood glucose were included. We excluded apps that were duplicated or were designed for health care providers. Apps that did not have English or Chinese versions and that had not been updated for at least 5 years were also excluded.
Data Sources and Searches
We searched MEDLINE, EMBASE, the Cochrane Central Register of Controlled Trials (CENTRAL), and the Chinese Biomedical Literature Database using the terms “diabetes mellitus,” “blood glucose,” “blood glucose self-monitoring,” “mobile applications,” and “cell phones” from January 1, 2007, to May 30, 2016. We also searched for ongoing studies via ClinicalTrials.gov and checked the reference lists of relevant reviews and trials.lists the search strategy for MEDLINE. Necessary adjustments were made for searching other databases.
We selected RCTs that compared mobile app-based interventions with standard care (free of app-based interventions) in adult outpatients with diabetes. Mobile app-based interventions were those that could provide real-time interactions with users through apps running on smart mobile devices.
Our primary outcome was the change in hemoglobin A1c (HbA1c) concentration (%) from baseline. Our secondary outcomes were severe hypoglycemia (defined as the need for assistance from another person or very low glucose concentrations; this was study specific, eg, <2 mmol/L) and any other adverse events. We did further quantitative meta-analyses of primary and secondary outcomes if relevant data were available.
We excluded studies without any available data on HbA1c. We also excluded studies if their participants were children, adolescents, or pregnant women who required different therapeutic strategies for a more challenging or strict glycemic control . Studies of apps for continuous glucose monitoring or continuous subcutaneous insulin infusion were excluded due to their medical devices nature. We excluded interventions without real-time interactions (eg, frequent interactions or passive interactions).
Two reviewers (YW and YD) independently screened titles and abstracts and then full texts to select eligible studies. Reviewers resolved disagreements through discussion or, if necessary, through discussion with an arbitrator (SL).
Data Extraction and Quality Assessment
For each trial, 2 reviewers (YW and YD) independently extracted data using a structured abstraction form and classified functions according to our taxonomy. Then, 2 reviewers (YW and YD) independently used the Cochrane Collaboration’s tool to assess the risk of bias of included studies . The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach was used to assess the quality of evidence for primary and secondary outcomes [ ]. Reviewers resolved discrepancies by discussion or, if required, through adjudication by a third reviewer (SL).
Data Synthesis and Analysis
We used a random-effects meta-analysis to pool the overall mean difference (MD) of the HbA1c changes and the risk ratios of adverse events due to the possible clinical heterogeneity of each included study. For trials with unreported change-from-baseline standard deviations, we imputed by standard deviations at the baseline and at the end of the intervention using the formula SDchange=√ SD2baseline+ SD2final–(2× Corr × SDbaseline× SDfinal). The correlation coefficient (Corr) was calculated with the reported change-from-baseline standard deviations using the formula Corr=(SD2baseline+ SD2final– SD2change)/(2× SDbaseline× SDfinal) . Publication bias was examined in Begg funnel plots and with the Egger linear regression test [ , ]. We assessed the consistency of the results across the studies by the statistical heterogeneity with the I2 statistic [ ]. The effect of the presence and absence of each function was examined in an exploratory subgroup analysis. We also conducted subgroup analyses of interventions that applied distinct technologies and had different risk levels. Statistical analyses were performed using RevMan version 5.3.0 (the Cochrane Collaboration) and STATA version 9.0 (StataCorp LLC). GraphPad Prism version 7.0 (GraphPad Software, Inc) was used to generate the figures included in this study.
Taxonomy of Apps for Diabetes Self-Management
We designed a preliminary taxonomy with a functional axis, a clinical axis, and a risk axis as shown in, part C. The functional axis consisted of 5 technical modules (ie, log, structured display, general education, personalized feedback, and communication) whose descriptive details were refined by previous classifications. The clinical axis consisted of 5 diabetes management modules (ie, monitoring, medication management, lifestyle modification, complication prevention, and psychosocial care) referring to the ADA guideline [ ]. Functions were specified by crossing the functional axis (module) and the clinical axis (module), where we made sure that each function belonged to a functional or clinical classification, or both.
We developed the risk axis based on the US Food and Drug Administration (FDA) risk-based recommendation . This recommendation classifies functionalities of mobile health technology into 3 categories: administrative (eg, general-purpose communication and population health management), which pose limited or no risk to patient safety; health management (eg, some clinical decision support and medication management), which pose potential but generally low risks; and medical device (eg, medical device accessories and medical device clinical decision support software), which present a relatively higher risk to patient safety. We assessed the risks of functions as low, potential, and high, accordingly.
During validation, we identified 1559 apps by searching the iTunes App Store and Google Play and excluded 1414 apps that were duplicated, were not for diabetes-management, were without English or Chinese versions, and had not been updated for at least 5 years. The remaining 145 eligible apps were downloaded onto smart mobile devices. After excluding those without real-time interactions and designed solely for health care providers, we included 96 apps and classified them by the preliminary taxonomy. As we could well classify all functions among the included apps by the taxonomy, and we identified all modules in the taxonomy in the included apps, we proposed the final taxonomy after this validation ().
|Functional modules||Diabetes management modules|
|Monitoringb||Medication managementc||Lifestyle modification||Complication prevention||Psychosocial care|
|Logb||⊕⊖⊖Recording self-monitoring parametersd; |
⊕⊕⊖Recording other medical parameterse
|⊕⊕⊖Recording used medications and side effects||⊕⊖⊖Recording activities, diets, and weightf||⊕⊖⊖Recording complication-related statusg; |
⊕⊖⊖Recording appointments with doctors
|Structured display||⊕⊖⊖Displaying data in a structured way|
|General education||⊕⊖⊖Instructions for monitoring; |
⊕⊕⊖Interpreting the parameters
|⊕⊕⊖Diabetes process and treatment options; |
⊕⊕⊖Using medications safely and effectively
|⊕⊖⊖Incorporating nutritional management and physical activity into lifestyle||⊕⊕⊖Preventing, detecting, and handling acute complications and chronic complicationsh||⊕⊖⊖Addressing psychosocial issues and promoting behavior change|
|Personalized feedback||⊕⊖⊖Reminding to monitor; |
|⊕⊕⊖Reminding to take medications; |
⊕⊕⊕Clinical decision makingi
|⊕⊖⊖Reminding to eat healthily and be active; |
⊕⊕⊖Self-management decision makingj
|⊕⊖⊖Reminding to quit smoking, visit doctors, and prevent acute complications||N/Ak|
|Communication||⊕⊖⊖General communication, connecting users with their peers and families through social networking, chat forums, or websites; |
⊕⊕⊖Patient-clinician communication, in-app access to health care providers for medical support or consultation.
aRisk assessment of a function: low risk (⊕⊖⊖), potential risk (⊕⊕⊖), and high risk (⊕⊕⊕). The overall risk assessment of an app was determined by the highest risk of included functions.
bMonitoring and log are basic modules.
cMedications for diabetes include insulin, oral antidiabetic agents, aspirin, antihypertensives, lipid-lowering medications, and vaccines.
dSelf-monitoring parameters include blood glucose, blood pressure, heart rate, and pulse.
eOther medical parameters include cholesterol levels, hemoglobin A1c, urine test, and ketones.
fActivities include steps, duration, heart rate, and consumed calories; diets include food, water, nutritional values, carbohydrate counting, and calorie calculator; weight includes body mass index, body fat, and circumference.
gComplication-related status includes smoking, drinking, snoring, feet, eyes, teeth, and sensory status.
hAcute complications include hypoglycemia and hyperglycemia; chronic complications include cardiovascular disease and microvascular complications (ie, nephropathy, retinopathy, neuropathy).
iClinical decision making is recommending treatment (eg, oral agents and insulin) by algorithms alone without the participation of health care providers.
jSelf-management decision making is decision making on lifestyle modification by algorithms.
kN/A: not applicable.
Characteristics and Classifications of Included Trials
We identified 3131 references using our search strategies and identified 544 references by checking the reference lists of relevant articles, 68 of which underwent a full-text review. This process excluded 55 studies, with the reasons listed in. We included 12 trials from 13 references in a qualitative systematic review, evaluating 12 independent app-based interventions involving 974 outpatients with diabetes. shows the flow of study selection.
Across the 13 included references, the HbA1c was obtained from 12 trials with 974 participants after a median follow-up period of 6 (range 3-12) months, and severe hypoglycemia was extracted from 4 trials of 346 participants after a median follow-up of 6 months. There were 5 trials that enrolled patients with type 1 diabetes mellitus (T1DM), 5 with type 2 diabetes mellitus (T2DM), and 2 with both types of diabetes.
Of the 12 included mobile app-based interventions, 1 is available in the iTunes Store and Google Play at the time of our study . After taxonomic classification, all 12 included interventions had monitoring as a diabetes management module, followed by lifestyle modification (11/12, 92%), medication management (8/12, 67%), and complication prevention (2/12, 17%). Psychosocial care was not distinguished in any of the included interventions. For functional modules, all 12 interventions had a log as a basic functional module, followed by communication (9/12, 75%), a structured display (8/12, 67%), personalized feedback (8/12, 67%), and general education (6/12, 50%). To be noted, the included interventions only had patient-clinician communication instead of general communication.
Various technologies were applied for data transmission between users and mobile devices. Across the 12 included trials, 6 (50%) used wireless transmission through Wi-Fi, Bluetooth, near-field communication, or public switched telephone network, 5 (42%) used manual entry, and 1 (8%) used wire transmission through a data port connection.
Of the 12 included app-based interventions, we determined 3 (25%) to be of high risk due to having a clinical decision-making function. The definition of the clinical decision-making function was recommending treatment (eg, oral agents and insulin) by algorithms alone without the participation of health care providers. We determined that the other 9 interventions (75%) carried potential risk.summarizes the modules, risks, and technologies of the mobile app-based interventions included in the meta-analysis [ - ].
patients: baseline/ end
|Diabetes type||Follow-up (months)||Mean (SD) HbA1ca, %: baseline; end; change||Intervention||FMb||DMMc||Risk assessmentd||Technology|
|Hsu, 2016 ||US||Ie: 20/15; |
|2||3||I: 10.8 (1.0); 7.7 (1.6); –3.2 (1.5) |
C: 10.9 (0.9); 8.9 (2.2); –2.0 (2.0)
|Cloud-based diabetes management program||L, StD, GE, Co||M, MM, LM, CP||Potential||Wireless|
|Baron, 2017 ||UK||I: 45/40; |
|Both||9||I: 9.1 (1.8); 8.6 (1.6); |
C: 8.9 (1.7); 8.9 (1.6)
|Mobile telehealth||L, StD, GE, PF, Co||M, MM, LM||Potential||Wireless|
|Drion, 2015 ||Netherlands||I: 31/30; |
|1||3||I: 7.73 (NRg); 7.91 (NR); |
C: 7.82 (NR); 7.91 (NR)
|Diabetes Under Control (DBEES)||L, StD||M, MM, LM||Potential||Manual entry|
|Holmen, 2014 ; Torbjornsen, 2014 [ ]||Norway||I: 51/39; |
|2||12||I: 8.1 (1.1); 7.8 (0.9); |
C: 8.3 (1.2); 8.2 (1.1)
|Few Touch Application (FTA)||L, StD, GE, PF, Co||M, LM||Potential||Wireless|
|Waki, 2014 ||Japan||I: 27/24; |
|2||3||I: 7.1 (1.0); 6.7 (0.7); |
C: 7.0 (0.9); 7.1 (1.1)
|DialBetics||L, StD, GE, PF, Co||M, LM||Potential||Wireless|
|Kirwan, 2013 ||Australia||I: 36/28; |
|1||9||I: 9.1 (1.2); 8.0 (0.7); |
C: 8.5 (0.9); 8.4 (1.0)
|Glucose Buddy||L, StD||M, MM, LM||Potential||Manual entry|
|Rossi, 2013 ||Italy||I: 63/55; |
|1||6||I: 8.4 (NR); 7.9 (NR); –0.5 (NR); |
C: 8.5 (NR); 8.1 (NR); –0.5 (NR)
|Diabetes Interactive Diary||L, PF, Co||M, MM, LM||High||Manual entry|
|Charpentier, 2011 ||France||I: 60/56; |
|1||6||I: 9.2 (1.1); 8.6 (1.1); |
C: 8.9 (0.9); 9.1 (1.2)
|Diabeo system||L, StD, PF, Co||M, MM, LM||High||Manual entry|
|Rossi, 2010 ||Italy||I: 67/58; |
|1||6||I: 8.2 (0.8); 7.8 (0.8); –0.4 (0.9); |
C: 8.4 (0.7); 7.9 (1.1); –0.5 (1.0)
|Diabetes Interactive Diary||L, PF, Co||M, MM, LM||High||Manual entry|
|Yoo, 2009 ||Korea||I: 62/57; |
|2||3||I: 7.6 (0.9); 7.1 (0.8); |
C: 7.4 (0.9) 7.6 (1.0)
|Ubiquitous Chronic Disease Care (UCDC) system||L, GE, PF||M, LM||Potential||Wire|
|Istepanian, 2009 ||UK||I: 72/NR; |
|Both||9||I: 7.9 (1.5); 7.8 (NR); |
C: 8.1 (1.6) 8.4 (NR)
|Mobile phone telemonitoring system||L, Co||M||Potential||Wireless|
|Quinn, 2008 ||US||I: 15/13; |
|2||3||I: 9.5 (NR); 7.5 (NR); |
C: 9.1 (NR); 8.4 (NR)
|WellDoc Communications||L, StD, GE, PF, Co||M, MM, LM, CP||Potential||Wireless|
aHbA1c: hemoglobin A1c.
bFM: functional modules are communication (Co), general education (GE), log (L), personalized feedback (PF), and structured display (StD).
cDMM: diabetes management modules are complication prevention (CP), lifestyle modification (LM), monitoring (M), and medication management (MM).
dThe overall risk assessment of an intervention was determined by the highest risk of its functions.
eI: intervention group.
fC: control group.
gNR: not reported.
Risks of Bias of Included Trials
Only 67% (8/12) of the trials adequately reported allocation sequence generation, and 58% (7/12) adequately reported concealing the allocation sequence. As an objective outcome, all trials adequately blinded the assessment of the primary outcome (HbA1c changes). The corresponding proportion for incomplete outcome data was 25% (3/12), for selective reporting was 25% (3/12), and for other sources of bias was 50% (6/12).and present the risk-of-bias assessments of the primary outcome (HbA1c changes) for each domain of each included study. lists the detailed characteristics, taxonomic classification, and risk of bias of each included trial.
Effects of Mobile App-Based Interventions on HbA1c
The use of mobile app-based interventions was associated with a clinically significant HbA1c reduction of 0.48% (95% CI 0.19%-0.78%, I2=76%, P<.001) compared with standard care alone, asshows. However, the funnel plot was found to be asymmetrical ( ), with Egger test indicating a potential publication bias (P=.008). Overall, we used the GRADE approach to rate the quality of the evidence for HbA1c as low due to the potential publication bias and study limitations (lack of allocation concealment, lack of blinding of participants and personnel, incomplete outcome data, selective reporting, and other biases as shown in and ; ).
We performed a post hoc exploratory analysis for 5 trials enrolling patients with T1DM and 5 trials enrolling patients with T2DM. The use of app-based interventions did not achieve statistical significance among patients with T1DM (MD 0.37%, 95% CI –0.12%-0.86%, I2=86%, P<.001). Larger HbA1c reductions were noted for patients with T2DM (MD 0.67%, 95% CI 0.30%-1.03%, I2=47%, P=.11). The intersubgroup difference was not significant (P=.30) ().
Effects of Modules, Risks, and Technologies of App-Based Interventions on HbA1c
We noted a greater HbA1c reduction when interventions included a complication prevention module (with complication prevention: MD 1.31%, 95% CI 0.66%-1.96%, I2=0%, P=.84 vs without: MD 0.38%, 95% CI 0.09%-0.68%, I2=76%, P<.001; test for subgroup difference P=.01). Having a structured display was also associated with a larger HbA1c reduction (with structured display: MD 0.69%, 95% CI 0.32%-1.06%, I2=63%, P=.008 vs without: MD 0.17%, 95% CI –0.18% to 0.53%, I2=75%, P=.007; test for subgroup difference P=.05).
For high-risk interventions with a clinical decision-making function, the reduction of HbA1c was 0.19% (95% CI –0.24%-0.63%, I2=82%, P=.004), while the reduction was 0.61% (95% CI 0.27%-0.95%, I2=64%, P=.005) for potential-risk interventions without clinical decision making (test for subgroup difference P=.104.
Interventions using manual entry showed an associated lower HbA1c reduction without statistical significance (wire connection: MD 0.70%, 95% CI 0.33%-1.07% vs wireless connection: MD 0.53% CI 0.15%-0.92%, I2=46%, P=.10 vs manual entry: MD 0.37%, 95% CI –0.12%-0.86%, I2=86%, P<.001; test for subgroup difference P=.56) ().
Adverse Events of Included Trials
Adverse events were reported variably among the 5 included studies [, , - ]. One study reported no adverse clinical event but several undesired technical events in the automatic data transmission between the glucometer and the app [ ]. A total of 4 studies reported the participants or the proportion of participants with, or the incidence of severe hypoglycemia and overall hypoglycemia [ , - ]. None of the studies reported any other kinds of adverse events or death.
For severe hypoglycemia, 1 study reported significantly fewer episodes in the intervention group (0.33 vs 2.29 events/patient-year) ; 3 studies reported no severe hypoglycemia in either the intervention or control group [ , , ]. Of the 5 studies, 4 reported that 3 participants in the intervention group and 3 in the standard-care group had severe hypoglycemia episodes, with a pooled risk ratio of 1.07 (95% CI 0.23%-5.09%) [ , , , ]. The pooled risk ratio was 1.62 (95% CI 0.48%-5.40%) for the 3 trials reporting overall hypoglycemia [ , , ] ( ).
Overall, we rated the quality of the evidence for severe hypoglycemia as low due to imprecision (wide confidence intervals including null effect) and study limitations (risk of bias in 4 trials), and as very low for adverse events owing to inconsistency (substantial diversity in the definitions of outcome measures), imprecision (small sample sizes and low event rates), and study limitations (risk of bias in 5 trials) ().
As most commercially available apps for diabetes self-management were not tested by RCTs, both the patients and the clinicians needed indirect evidence to guide their assessment while choosing apps. The purposes of this review were to investigate the glycemic efficacy of mobile app-based interventions, and to explore the differential effectiveness of their functions. We could not use existing classifications for the functions of the app-based interventions because of inconsistency and incompleteness. As a result, we developed and validated a comprehensive taxonomy for the functions of diabetes self-management apps. To our knowledge, this is the first comprehensive taxonomy with clinical, functional, and risk axes, and this is the first review exploring the contribution of each function to the effectiveness of entire apps.
The meta-analysis of 12 RCTs demonstrated that app-based interventions were associated with a statistically and clinically significant HbA1c reduction of 0.48% (95% CI 0.19%-0.78%). We noted larger HbA1c reductions for patients with T2DM (MD 0.67%, 95% CI 0.30%-1.03%) than those with T1DM (MD 0.37%, 95% CI –0.12%-0.86%). The exploratory subgroup analyses showed that having a clinical decision-making function in app-based interventions was not associated with a greater HbA1c reduction (with clinical decision making: MD 0.19%, 95% CI –0.24%-0.63% vs without: MD 0.61%, 95% CI 0.27%-0.95%; intersubgroup P=.14). There were no excess adverse events related to the included app-based interventions.
Comparison With Prior Work
Consistent with previous reviews involving mobile app-based interventions [- ], our study indicated that the use of mobile app-based interventions is associated with a clinically significant HbA1c reduction in the diabetes management of adult outpatients. Our results suggested that glycemic control of adult outpatients with diabetes can benefit from apps. A subgroup analysis of diabetes types showed a larger HbA1c reduction in patients with T2DM than in those with T1DM. This difference is consistent with a previous review [ ] and may be explained, at least in part, by the complexity of the management of T1DM [ ]. Patients with T1DM, especially those at a young age, require intensive management, which increases the burdens placed on the management of T1DM. Our result suggested that current apps may not be good enough to support the intensive management of T1DM.
Our study developed a 3-axis taxonomy for diabetes apps, with rows of functional modules, columns of diabetes management modules, and cells of functions with risk assessments. The functional, clinical, and risk axes were developed based on previous classifications, the ADA’s guidelines, and the FDA’s risk recommendation, respectively. The 3-axis design of the taxonomy is comprehensive and decreases the possibility of misclassification. Additionally, this 3-axis design is applicable for diseases other than diabetes by adjusting the modules in the clinical axis. The validation process guarantees that our taxonomy can be used to classify commercial diabetes apps. Differences in the detected effect sizes in subsequent subgroup analyses indicated the utility of our taxonomy.
Our taxonomy has some advantages. First, it is a comprehensive taxonomy with functional, clinical, and risk axes. The taxonomy permits subsequent exploratory subgroup analyses of multifunction apps, which give insights into the efficacy and risk of each module in diabetes apps. Comparatively, existing classifications appear to be incomplete or inconsistent. Previous classifications have mainly focused on the functions of apps, which, as a result, have made them applicable only for functional evaluation [, , - , - ]. Some similar functions in these classifications have diverse definitions and descriptive details. Moreover, some functions lack clinical considerations, such as education, feedback, and decision support [ , , - , - ]. Only 1 classification addresses risk assessment [ ]. These classifications, on the one hand, demonstrate a requirement to classify apps comprehensively, and on the other hand, they indicate the limitation of each independent classification.
Second, our taxonomy can be of some help in the development and evolution of diabetes apps. App developers are usually technicians without a clinical background. As a result, the evidence-based guidelines for diabetes management are easily ignored during app development. For example, we found that complication prevention and psychosocial care were uncommon in the app-based interventions we examined. However, complication prevention behaviors and emotional well-being are associated with positive diabetes outcomes according to the guidelines . Previous reviews also suggested that diabetes apps lacked essential modules and neglected evidence-based guidelines [ , ]. With a clinical axis of diabetes management modules developed based on guidelines, our taxonomy makes it straightforward for app developers to follow evidence-based guidelines during the design and development of diabetes apps.
Third, our taxonomy permits subsequent exploratory subgroup analyses of multifunction apps, which give insights into the efficacy and risk of each module in diabetes apps.
Our exploratory subgroup analyses suggested a limited efficacy of clinical decision making, which was defined as recommending treatment (eg, oral agents and insulin) by algorithms alone without the participation of health care providers and was determined to be high risk according to our taxonomy. Traditionally, clinical decisions are made during a face-to-face interview after a complete assessment. Built-in clinical decision support systems, however, are less likely to collect data and assess status as thoroughly as face-to-face consultations do. Without adequate data and well-designed algorithms, clinical decision-making functions can make inappropriate decisions and pose risks to patients [, ]. Additionally, complex data collection may cause technical difficulties. Despite the above-mentioned issues, clinical decision making can be found in diabetes apps both in trials [ - ] and in app stores [ , ]. Therefore, we suggest that app developers should employ caution to add clinical decision making into diabetes apps, and patients should consult with health care providers on using apps for diabetes self-management.
Our subgroup analyses indicated that having a complication prevention module in the apps was associated with a greater HbA1c reduction. Complication prevention behaviors such as smoking cessation and hypoglycemia prevention are critical components of diabetes management according to current guidelines . However, only 2 included app-based interventions had a complication prevention module. Further studies are needed to confirm the efficacy of a complication prevention module. Meanwhile, having a structured display module was associated with a larger HbA1c reduction. The structured display module may improve blood glucose self-monitoring behaviors by displaying structured self-monitoring of blood glucose profiles. Having a structured display is consistent with current clinical guidelines, in which self-monitoring of blood glucose is a critical element in the management of diabetes [ ].
Having a lifestyle modification in app-based interventions was associated with a trend toward reduced HbA1c, as was having a general education module. The modules of lifestyle modification and general education may raise awareness of lifestyle change and self-management. Since these 2 modules pose limited risks to patients with diabetes, it might be reasonable to add lifestyle modification and general education to diabetes apps.
The data suggested limited glycemic efficacy of having a personalized feedback module. However, considerable uncertainty and limitations exist regarding its efficacy. Given that the personalized feedback module has a relatively high risk, further evaluation is required before adding a personalized feedback module to diabetes apps. Consistent with a previous review , our review found that none of the interventions included a general communication function. Particular attention should be paid to the complexity and variety of the patient-clinician communication function as shown in . As for the technologies, direct data transmission between users and mobile devices using wire or wireless connections was associated with a trend toward reduced HbA1c, which could be explained by the convenience and accuracy of the technology.
Our study also has some limitations. First, the exploratory and observational nature of our subgroup analyses and the possibility of misclassification prevented us from drawing a solid conclusion about the modular efficacies and risks. Second, we examined only 12 trials in our study, which may limit the strength of this systematic review. Third, we noted the asymmetry of the funnel plot, which indicated a potential risk of publication bias in our systematic review.
In our study, we developed a 3-axis taxonomy for diabetes self-management apps. Mobile app-based interventions improve glycemic control in adult outpatients with diabetes, especially in those with T2DM. Our analyses suggest that clinical decision making requires further improvement and evaluation before being added to apps. Safety issues such as hypoglycemia and other adverse events are being overlooked and need attention in future investigations.
The authors thank Dr Xiaodan Li, Department of Gastroenterology, West China Hospital, Sichuan University, for her comprehensive revision and advice for this manuscript. The corresponding authors were supported by grants from the National Natural Science Foundation of China (grant nos. 81400811 and 21534008), National Basic Research Program of China (2015CB942800), and the Scientific Research Project of Health and Family Planning Commission of Sichuan Province (grant nos. 130029 and 150149).
YW, XY, HT, and SL conceived this study. YW and YD contributed to data extraction and quality assessment. YW and XY contributed to the Web-based searches of the literature and apps. YW and SL wrote the report. YW, JK, and LL conducted the statistical analysis. GV, AN, and XS guaranteed the study methodology. All authors discussed and interpreted the results and reviewed the manuscript before submission.
Conflicts of Interest
Multimedia Appendix 1
Taxonomy development and validation.PDF File (Adobe PDF File), 578KB
Multimedia Appendix 2
MEDLINE search strategy.PDF File (Adobe PDF File), 29KB
Multimedia Appendix 3
List of excluded references with reasons for exclusions.PDF File (Adobe PDF File), 66KB
Multimedia Appendix 4
The detailed information, taxonomic classification, and risk of bias of included trials.PDF File (Adobe PDF File), 164KB
Multimedia Appendix 5
Funnel plot.PDF File (Adobe PDF File), 61KB
Multimedia Appendix 6
GRADE for primary and secondary outcomes.PDF File (Adobe PDF File), 44KB
Multimedia Appendix 7
Meta-analyses for adverse events.PDF File (Adobe PDF File), 160KB
Multimedia Appendix 8
Classifications of the patient-clinician communication function.PDF File (Adobe PDF File), 27KB
- Yang G, Wang Y, Zeng Y, Gao GF, Liang X, Zhou M, et al. Rapid health transition in China, 1990-2010: findings from the Global Burden of Disease Study 2010. Lancet 2013 Jun 8;381(9882):1987-2015. [CrossRef] [Medline]
- American Diabetes Association. Standards of medical care in diabetes-2017.: Diabetes Care; 2017 Jan. URL: http://professional.diabetes.org/sites/professional.diabetes.org/files/media/dc_40_s1_final.pdf [accessed 2017-03-11] [WebCite Cache]
- Bragg F, Holmes M, Iona A, Guo Y, Du H, Chen Y, China Kadoorie Biobank Collaborative Group. Association between diabetes and cause-specific mortality in rural and urban areas of China. JAMA 2017 Dec 17;317(3):280-289. [CrossRef] [Medline]
- Yang W, Lu J, Weng J, Jia W, Ji L, Xiao J, China National Diabetes and Metabolic Disorders Study Group. Prevalence of diabetes among men and women in China. N Engl J Med 2010 Mar 25;362(12):1090-1101. [CrossRef] [Medline]
- Xu Y, Wang L, He J, Bi Y, Li M, Wang T, 2010 China Noncommunicable Disease Surveillance Group. Prevalence and control of diabetes in Chinese adults. JAMA 2013 Sep 04;310(9):948-959. [CrossRef] [Medline]
- Yang W, Zhao W, Xiao J, Li R, Zhang P, Kissimova-Skarbek K, et al. Medical care and payment for diabetes in China: enormous threat and great opportunity. PLoS One 2012;7(9):e39513 [FREE Full text] [CrossRef] [Medline]
- Statista. Number of smartphone users in China from 2013 to 2021. URL: https://www.statista.com/statistics/467160/forecast-of-smartphone-users-in-china/ [accessed 2017-03-11] [WebCite Cache]
- Danes M, Whinder F. Diabetes management goes digital. Lancet Diabetes Endocrinol 2013 Sep;1(1):17-18. [CrossRef] [Medline]
- Bradway M, Årsand E, Grøttland A. Mobile health: empowering patients and driving change. Trends Endocrinol Metab 2015 Mar;26(3):114-117. [CrossRef] [Medline]
- Istepanian RS. Mobile applications for diabetes management: efficacy issues and regulatory challenges. Lancet Diabetes Endocrinol 2015 Dec;3(12):921-923. [CrossRef] [Medline]
- Research 2 Guidance. mHealth app developer economics 2015: the current status and trends of the mHealth app market. 2015. URL: http://research2guidance.com/r2g/r2g-mHealth-App-Developer-Economics-2015.pdf [accessed 2017-03-08] [WebCite Cache]
- IMS Institute for Healthcare Informatics. Patient apps for improved healthcare: from novelty to mainstream. 2013 Oct. URL: http://obroncology.com/imshealth/content/IIHI%20Apps%20report%20231013F_interactive.pdf [accessed 2017-03-09] [WebCite Cache]
- Whitehead L, Seaton P. The effectiveness of self-management mobile phone and tablet apps in long-term condition management: a systematic review. J Med Internet Res 2016;18(5):e97 [FREE Full text] [CrossRef] [Medline]
- Powell AC, Landman AB, Bates DW. In search of a few good apps. JAMA 2014 May 14;311(18):1851-1852. [CrossRef] [Medline]
- Chomutare T, Fernandez-Luque L, Arsand E, Hartvigsen G. Features of mobile diabetes applications: review of the literature and analysis of current applications compared against evidence-based guidelines. J Med Internet Res 2011;13(3):e65 [FREE Full text] [CrossRef] [Medline]
- Holtz B, Lauckner C. Diabetes management via mobile phones: a systematic review. Telemed J E Health 2012 Apr;18(3):175-184. [CrossRef] [Medline]
- Liang X, Wang Q, Yang X, Cao J, Chen J, Mo X, et al. Effect of mobile phone intervention for diabetes on glycaemic control: a meta-analysis. Diabet Med 2011 Apr;28(4):455-463. [CrossRef] [Medline]
- Krishna S, Boren SA. Diabetes self-management care via cell phone: a systematic review. J Diabetes Sci Technol 2008 May;2(3):509-517 [FREE Full text] [Medline]
- Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, et al. Can we systematically review studies that evaluate complex interventions? PLoS Med 2009 Aug;6(8):e1000086 [FREE Full text] [CrossRef] [Medline]
- Lewis TL, Wyatt JC. mHealth and mobile medical apps: a framework to assess risk and promote safer use. J Med Internet Res 2014 Sep 15;16(9):e210 [FREE Full text] [CrossRef] [Medline]
- Cortez NG, Cohen IG, Kesselheim AS. FDA regulation of mobile health technologies. N Engl J Med 2014 Jul 24;371(4):372-379. [CrossRef] [Medline]
- de Ridder M, Kim J, Jing Y, Khadra M, Nanan R. A systematic review on incentive-driven mobile health technology: as used in diabetes management. J Telemed Telecare 2016 Feb 16. [CrossRef] [Medline]
- Basilico A, Marceglia S, Bonacina S, Pinciroli F. Advising patients on selecting trustful apps for diabetes self-care. Comput Biol Med 2016 Apr 01;71:86-96. [CrossRef] [Medline]
- Williams JP, Schroeder D. Popular glucose tracking apps and use of mHealth by Latinos with diabetes: review. JMIR Mhealth Uhealth 2015;3(3):e84 [FREE Full text] [CrossRef] [Medline]
- Riazi H, Larijani B, Langarizadeh M, Shahmoradi L. Managing diabetes mellitus using information technology: a systematic review. J Diabetes Metab Disord 2015;14:49 [FREE Full text] [CrossRef] [Medline]
- El-Gayar O, Timsina P, Nawar N, Eid W. A systematic review of IT for diabetes self-management: are we there yet? Int J Med Inform 2013 Aug;82(8):637-652. [CrossRef] [Medline]
- El-Gayar O, Timsina P, Nawar N, Eid W. Mobile applications for diabetes self-management: status and potential. J Diabetes Sci Technol 2013;7(1):247-262 [FREE Full text] [Medline]
- Demidowich AP, Lu K, Tamler R, Bloomgarden Z. An evaluation of diabetes self-management applications for Android smartphones. J Telemed Telecare 2012 Jun;18(4):235-238. [CrossRef] [Medline]
- Årsand E, Frøisland DH, Skrøvseth SO, Chomutare T, Tatara N, Hartvigsen G, et al. Mobile health applications to assist patients with diabetes: lessons learned and design implications. J Diabetes Sci Technol 2012 Sep;6(5):1197-1206 [FREE Full text] [Medline]
- Rao A, Hou P, Golnik T, Flaherty J, Vu S. Evolution of data management tools for managing self-monitoring of blood glucose results: a survey of iPhone applications. J Diabetes Sci Technol 2010 Jul;4(4):949-957 [FREE Full text] [Medline]
- Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011].: The Cochrane Collaboration; 2011. URL: http://handbook.cochrane.org/ [accessed 2017-03-09] [WebCite Cache]
- Atkins D, Best D, Briss PA, Eccles M, Falck-Ytter Y, Flottorp S, et al. Grading quality of evidence and strength of recommendations. BMJ 2004 Jun 19;328(7454):1490 [FREE Full text] [CrossRef] [Medline]
- Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994 Dec;50(4):1088-1101. [Medline]
- Egger M, Davey SG, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997 Sep 13;315(7109):629-634 [FREE Full text] [Medline]
- Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med 2002 Jun 15;21(11):1539-1558. [CrossRef] [Medline]
- Food and Drug Administration, Federal Communications Commission, The Office of the National Coordinator for Health Information Technology. FDASIA health IT report: proposed strategy and recommendations for a risk-based framework. 2014 Apr. URL: http://www.fda.gov/downloads/AboutFDA/CentersOffices/OfficeofMedicalProductsandTobacco/CDRH/CDRHReports/UCM391521.pdf [accessed 2017-03-09] [WebCite Cache]
- Kirwan M, Vandelanotte C, Fenning A, Duncan MJ. Diabetes self-management smartphone application for adults with type 1 diabetes: randomized controlled trial. J Med Internet Res 2013;15(11):e235 [FREE Full text] [CrossRef] [Medline]
- Hsu WC, Lau KH, Huang R, Ghiloni S, Le H, Gilroy S, et al. Utilization of a cloud-based diabetes management program for insulin initiation and titration enables collaborative decision making between healthcare providers and patients. Diabetes Technol Ther 2016 Feb;18(2):59-67 [FREE Full text] [CrossRef] [Medline]
- Baron JS, Hirani S, Newman SP. A randomised, controlled trial of the effects of a mobile telehealth intervention on clinical and patient-reported outcomes in people with poorly controlled diabetes. J Telemed Telecare 2016 Feb 15. [CrossRef] [Medline]
- Drion I, Pameijer LR, van Dijk PR, Groenier KH, Kleefstra N, Bilo HJ. The effects of a mobile phone application on quality of life in patients with type 1 diabetes mellitus: a randomized controlled trial. J Diabetes Sci Technol 2015 May 11;9(5):1086-1091 [FREE Full text] [CrossRef] [Medline]
- Holmen H, Torbjørnsen A, Wahl AK, Jenum AK, Småstuen MC, Arsand E, et al. A mobile health intervention for self-management and lifestyle change for persons with type 2 diabetes, part 2: one-year results from the Norwegian randomized controlled trial RENEWING HEALTH. JMIR Mhealth Uhealth 2014;2(4):e57 [FREE Full text] [CrossRef] [Medline]
- Torbjørnsen A, Jenum AK, Småstuen MC, Arsand E, Holmen H, Wahl AK, et al. A low-intensity mobile health intervention with and without health counseling for persons with type 2 diabetes, part 1: baseline and short-term results from a randomized controlled trial in the Norwegian part of RENEWING HEALTH. JMIR Mhealth Uhealth 2014;2(4):e52 [FREE Full text] [CrossRef] [Medline]
- Waki K, Fujita H, Uchimura Y, Omae K, Aramaki E, Kato S, et al. DialBetics: a novel smartphone-based self-management support system for type 2 diabetes patients. J Diabetes Sci Technol 2014 Mar 13;8(2):209-215 [FREE Full text] [CrossRef] [Medline]
- Rossi MC, Nicolucci A, Lucisano G, Pellegrini F, Di Bartolo P, Miselli V, et al. Impact of the Diabetes Interactive Diary telemedicine system on metabolic control, risk of hypoglycemia, and quality of life: a randomized clinical trial in type 1 diabetes. Diabetes Technol Ther 2013 Aug;15(8):670-679. [CrossRef] [Medline]
- Charpentier G, Benhamou P, Dardari D, Clergeot A, Franc S, Schaepelynck-Belicar P, et al. The Diabeo software enabling individualized insulin dose adjustments combined with telemedicine support improves HbA1c in poorly controlled type 1 diabetic patients: a 6-month, randomized, open-label, parallel-group, multicenter trial (TeleDiab 1 Study). Diabetes Care 2011 Mar;34(3):533-539 [FREE Full text] [CrossRef] [Medline]
- Rossi MC, Nicolucci A, Di Bartolo P, Bruttomesso D, Girelli A, Ampudia FJ, et al. Diabetes Interactive Diary: a new telemedicine system enabling flexible diet and insulin therapy while improving quality of life: an open-label, international, multicenter, randomized study. Diabetes Care 2010 Jan;33(1):109-115 [FREE Full text] [CrossRef] [Medline]
- Yoo HJ, Park MS, Kim TN, Yang SJ, Cho GJ, Hwang TG, et al. A ubiquitous chronic disease care system using cellular phones and the internet. Diabet Med 2009 Jun;26(6):628-635. [CrossRef] [Medline]
- Istepanian RS, Zitouni K, Harry D, Moutosammy N, Sungoor A, Tang B, et al. Evaluation of a mobile phone telemonitoring system for glycaemic control in patients with diabetes. J Telemed Telecare 2009;15(3):125-128. [CrossRef] [Medline]
- Quinn CC, Clough SS, Minor JM, Lender D, Okafor MC, Gruber-Baldini A. WellDoc mobile diabetes management randomized controlled trial: change in clinical and behavioral outcomes and patient and physician satisfaction. Diabetes Technol Ther 2008 Jun;10(3):160-168. [CrossRef] [Medline]
- Rossi MG, Bigi S. Weak educational components in mHealth devices for diabetes support available on the Italian market. J Diabetes Sci Technol 2016 Sep;10(5):1199-1200. [CrossRef] [Medline]
- Huckvale K, Adomaviciute S, Prieto JT, Leow MK, Car J. Smartphone apps for calculating insulin dose: a systematic assessment. BMC Med 2015;13:106 [FREE Full text] [CrossRef] [Medline]
- Hirsch IB, Parkin CG. Unknown safety and efficacy of smartphone bolus calculator apps puts patients at risk for severe adverse outcomes. J Diabetes Sci Technol 2016 Jul;10(4):977-980 [FREE Full text] [CrossRef] [Medline]
|ADA: American Diabetes Association|
|CENTRAL: Cochrane Central Register of Controlled Trials|
|FDA: Food and Drug Administration|
|GRADE: Grading of Recommendations Assessment, Development and Evaluation|
|HbA1c: hemoglobin A1c|
|MD: mean difference|
|RCT: randomized controlled trial|
|T1DM: type 1 diabetes mellitus|
|T2DM: type 2 diabetes mellitus|
Edited by S Kitsiou; submitted 22.08.16; peer-reviewed by S Agboola, P Wang, A Powell; comments to author 11.09.16; revised version received 20.10.16; accepted 25.02.17; published 14.03.17Copyright
©Yuan Wu, Xun Yao, Giacomo Vespasiani, Antonio Nicolucci, Yajie Dong, Joey Kwong, Ling Li, Xin Sun, Haoming Tian, Sheyu Li. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 14.03.2017.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.