This paper is in the following e-collection/theme issue:

Quality Evaluation and Descriptive Analysis/Reviews of Multiple Existing Mobile Apps (374) Mobile Health (mhealth) (2939) Glucose Tracking and Self-Monitoring of Blood Glucose (162) Apps, Mobile, Wearables for Diabetes (298)

Published on in Vol 5, No 3 (2017): March

Mobile App-Based Interventions to Support Diabetes Self-Management: A Systematic Review of Randomized Controlled Trials to Identify Functions Associated with Glycemic Efficacy

Mobile App-Based Interventions to Support Diabetes Self-Management: A Systematic Review of Randomized Controlled Trials to Identify Functions Associated with Glycemic Efficacy

Mobile App-Based Interventions to Support Diabetes Self-Management: A Systematic Review of Randomized Controlled Trials to Identify Functions Associated with Glycemic Efficacy

Authors of this article:

Yuan Wu1 Author Orcid Image ;   Xun Yao2 Author Orcid Image ;   Giacomo Vespasiani3 Author Orcid Image ;   Antonio Nicolucci4 Author Orcid Image ;   Yajie Dong1 Author Orcid Image ;   Joey Kwong5 Author Orcid Image ;   Ling Li5 Author Orcid Image ;   Xin Sun5 Author Orcid Image ;   Haoming Tian1 Author Orcid Image ;   Sheyu Li1 Author Orcid Image
Article Authors Cited by (194) Tweetations (27) Metrics

    Original Paper

    1Department of Endocrinology and Metabolism, West China Hospital, Sichuan University, Chengdu, China

    2Department of Academic Affairs, West China School of Medicine, Sichuan University, Chengdu, China

    3Diabetes Unit, Madonna del Soccorso Hospital, San Benedetto del Tronto (AP), Italy

    4Center for Outcomes Research and Clinical Epidemiology, Pescara, Italy

    5Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, Chengdu, China

    *these authors contributed equally

    Corresponding Author:

    Sheyu Li, MD

    Department of Endocrinology and Metabolism

    West China Hospital

    Sichuan University

    37# Guoxue Road

    Wuhou District

    Chengdu, 610041

    China

    Phone: 86 13194874843

    Fax:86 2885422982

    Email: lisheyu@gmail.com


    Related ArticleThis is a corrected version. See correction statement in: http://mhealth.jmir.org/2018/1/e20/

    Background: Mobile health apps for diabetes self-management have different functions. However, the efficacy and safety of each function are not well studied, and no classification is available for these functions.

    Objective: The aims of this study were to (1) develop and validate a taxonomy of apps for diabetes self-management, (2) investigate the glycemic efficacy of mobile app-based interventions among adults with diabetes in a systematic review of randomized controlled trials (RCTs), and (3) explore the contribution of different function to the effectiveness of entire app-based interventions using the taxonomy.

    Methods: We developed a 3-axis taxonomy with columns of clinical modules, rows of functional modules and cells of functions with risk assessments. This taxonomy was validated by reviewing and classifying commercially available diabetes apps. We searched MEDLINE, EMBASE, the Cochrane Central Register of Controlled Trials, the Chinese Biomedical Literature Database, and ClinicalTrials.gov from January 2007 to May 2016. We included RCTs of adult outpatients with diabetes that compared using mobile app-based interventions with usual care alone. The mean differences (MDs) in hemoglobin A1c (HbA1c) concentrations and risk ratios of adverse events were pooled using a random-effects meta-analysis. After taxonomic classification, we performed exploratory subgroup analyses of the presence or absence of each module across the included app-based interventions.

    Results: Across 12 included trials involving 974 participants, using app-based interventions was associated with a clinically significant reduction of HbA1c (MD 0.48%, 95% CI 0.19%-0.78%) without excess adverse events. Larger HbA1c reductions were noted among patients with type 2 diabetes than those with type 1 diabetes (MD 0.67%, 95% CI 0.30%-1.03% vs MD 0.37%, 95% CI –0.12%-0.86%). Having a complication prevention module in app-based interventions was associated with a greater HbA1c reduction (with complication prevention: MD 1.31%, 95% CI 0.66%-1.96% vs without: MD 0.38%, 95% CI 0.09%-0.67%; intersubgroup P=.01), as was having a structured display (with structured display: MD 0.69%, 95% CI 0.32%-1.06% vs without: MD 0.69%, 95% CI –0.18%-0.53%; intersubgroup P=.03). However, having a clinical decision-making function was not associated with a larger HbA1c reduction (with clinical decision making: MD 0.19%, 95% CI –0.24%-0.63% vs without: MD 0.61%, 95% CI 0.27%-0.95%; intersubgroup P=.14).

    Conclusions: The use of mobile app-based interventions yields a clinically significant HbA1c reduction among adult outpatients with diabetes, especially among those with type 2 diabetes. Our study suggests that the clinical decision-making function needs further improvement and evaluation before being added to apps.

    JMIR Mhealth Uhealth 2017;5(3):e35

    doi:10.2196/mhealth.6522

    Keywords

    mobile health; mHealth; mobile applications; mobile apps; diabetes mellitus; classification 


    Diabetes mellitus poses enormous challenges to China’s health care system due to its mortality, prevalence, and costs. Of 8.3 million deaths in China in 2010, 37.3% (3.1 million) were attributable to cardiovascular disease, which was also one of the leading causes of disability-adjusted life-years [1]. Diabetes is not only an independent risk factor for cardiovascular disease [2], but also associated with increased mortality from a range of cardiovascular diseases (eg, ischemic heart disease and stroke), as well as noncardiovascular diseases (eg, infections) among Chinese adults [3]. In 2008, the estimated prevalence of diabetes was 9.7%, accounting for 92.4 million adults with diabetes [4]. A more recent cross-sectional survey reported an even larger estimate (11.6% among Chinese adults, ie, 113.9 million) in 2010 [5]. In addition, expenditures for the medical care of patients with diabetes were 3.38 times higher than for people with normal glucose tolerance [6].

    Once diabetes is diagnosed, lifetime diabetes self-management is critical to glycemic control and is associated with the long-term prognosis for patients with diabetes. Diabetes self-management includes self-monitoring blood glucose, making healthy lifestyle choices (healthy eating, physical activity, tobacco cessation, weight management, and coping with stress), taking and managing medications, preventing diabetes complications (self-monitoring of foot health; active participation in screening for eye, foot, and renal complications; and immunizations), and setting self-selected behavioral goals [2]. In China, diabetes self-management education and support are provided during outpatient visits and are a huge burden on patients, their families, and the health system. Hence, a more cost-effective way to provide diabetes self-management education and support is essential for reducing the socioeconomic burden of diabetes.

    Mobile apps are the computer programs or software installed on smart mobile devices, with computing and connectivity capability built right into an operating system. With the rapid and ongoing growth in wireless connectivity, more than 500 million Chinese were smartphone and apps users in 2016 [7]. In addition to their universality, apps provide real-time interactions and data transmission, which can be used in providing diabetes self-management education and support [8-10]. Accordingly, the American Diabetes Association (ADA) guideline has stated that mobile apps may be a useful element of effective lifestyle modification to prevent diabetes [2].

    In the iTunes App Store for iOS and Google Play for Android, diabetes is one of the top-ranked categories [11,12], with more than 1100 different apps available for download. In contrast, according to a recent systemic review [13], there were only 5 randomized controlled trials (RCTs) assessing the effectiveness of apps in diabetes self-management. The contrast between the number of commercially available apps and the number of RCTs of apps demonstrates a shocking lack of evidence to support the recommendation of a specific app for diabetes self-management. Consequently, it is extremely difficult for clinicians and patients to choose a safe and effective one among the thousands of available apps [14].

    Despite their variety and complexity, apps for diabetes self-management always share a limited number of basic functions, which can be classified into several simple categories (eg, self-monitoring, education, alerts and reminders, and communication) [15]. Therefore, indirect evidence from systematic reviews of existing RCTs can give insight into the efficacy of each app function, which is helpful in estimating the effectiveness of a specific app and making recommendations for effective functions. Nevertheless, prior systematic reviews involving mobile app-based interventions with multiple functions have not attempted to investigate their differential effectiveness [16-18]. As a result, it remains unclear how their functions contribute to the efficacy of apps.

    To address functional efficacy, a classification of app functions is required [19]. Moreover, the classification should be comprehensive, with not only considerations of functions but also recommendations for clinical practice [15], as well as risk assessment [20,21]. However, existing classifications are inconsistent, and they primarily focus on functions [16,17,20,22-30]. Inconsistency and incompleteness have limited their use in classifying functions of diabetes self-management apps.

    The aims of this systematic review of RCTs were to (1) develop and validate a taxonomy of apps for diabetes self-management, (2) perform a meta-analysis investigating the effects of mobile app-based interventions on glycemic control in adults with diabetes, and (3) explore the contribution of different functions to the glycemic efficacy of entire app-based interventions using the taxonomy and subgroup analyses.


    Taxonomy Development and Validation

    We developed a preliminary taxonomy based on previous classifications, evidence-based guidelines, and authoritative recommendations, and validated it by reviewing commercially available apps for diabetes management. The contents of the taxonomy were confirmed if all functions of the available apps could be classified. After validation, we proposed a final taxonomy for diabetes management apps. Multimedia Appendix 1, part A, shows the flow chart of taxonomy development. Multimedia Appendix 1, part B, shows the review of previous classifications [16,17,20,22-30].

    The preliminary taxonomy was validated by a review of commercially available diabetes apps, as shown in Multimedia Appendix 1, part D. We searched the iTunes App Store (Apple Inc, Cupertino, CA, USA) and Google Play (Google Inc, Mountain View, CA, USA) (for the United States and China, February 1, 2016) using the terms “diabetes” OR “blood glucose” to identify apps for diabetes management. Apps with real-time interactions and any functions supporting self-monitoring of blood glucose were included. We excluded apps that were duplicated or were designed for health care providers. Apps that did not have English or Chinese versions and that had not been updated for at least 5 years were also excluded.

    Data Sources and Searches

    We searched MEDLINE, EMBASE, the Cochrane Central Register of Controlled Trials (CENTRAL), and the Chinese Biomedical Literature Database using the terms “diabetes mellitus,” “blood glucose,” “blood glucose self-monitoring,” “mobile applications,” and “cell phones” from January 1, 2007, to May 30, 2016. We also searched for ongoing studies via ClinicalTrials.gov and checked the reference lists of relevant reviews and trials. Multimedia Appendix 2 lists the search strategy for MEDLINE. Necessary adjustments were made for searching other databases.

    Eligibility Criteria

    We selected RCTs that compared mobile app-based interventions with standard care (free of app-based interventions) in adult outpatients with diabetes. Mobile app-based interventions were those that could provide real-time interactions with users through apps running on smart mobile devices.

    Our primary outcome was the change in hemoglobin A1c (HbA1c) concentration (%) from baseline. Our secondary outcomes were severe hypoglycemia (defined as the need for assistance from another person or very low glucose concentrations; this was study specific, eg, <2 mmol/L) and any other adverse events. We did further quantitative meta-analyses of primary and secondary outcomes if relevant data were available.

    We excluded studies without any available data on HbA1c. We also excluded studies if their participants were children, adolescents, or pregnant women who required different therapeutic strategies for a more challenging or strict glycemic control [2]. Studies of apps for continuous glucose monitoring or continuous subcutaneous insulin infusion were excluded due to their medical devices nature. We excluded interventions without real-time interactions (eg, frequent interactions or passive interactions).

    Two reviewers (YW and YD) independently screened titles and abstracts and then full texts to select eligible studies. Reviewers resolved disagreements through discussion or, if necessary, through discussion with an arbitrator (SL).

    Data Extraction and Quality Assessment

    For each trial, 2 reviewers (YW and YD) independently extracted data using a structured abstraction form and classified functions according to our taxonomy. Then, 2 reviewers (YW and YD) independently used the Cochrane Collaboration’s tool to assess the risk of bias of included studies [31]. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach was used to assess the quality of evidence for primary and secondary outcomes [32]. Reviewers resolved discrepancies by discussion or, if required, through adjudication by a third reviewer (SL).

    Data Synthesis and Analysis

    We used a random-effects meta-analysis to pool the overall mean difference (MD) of the HbA1c changes and the risk ratios of adverse events due to the possible clinical heterogeneity of each included study. For trials with unreported change-from-baseline standard deviations, we imputed by standard deviations at the baseline and at the end of the intervention using the formula SDchange=√ SD2baseline+ SD2final–(2× Corr × SDbaseline× SDfinal). The correlation coefficient (Corr) was calculated with the reported change-from-baseline standard deviations using the formula Corr=(SD2baseline+ SD2final– SD2change)/(2× SDbaseline× SDfinal) [31]. Publication bias was examined in Begg funnel plots and with the Egger linear regression test [33,34]. We assessed the consistency of the results across the studies by the statistical heterogeneity with the I2 statistic [35]. The effect of the presence and absence of each function was examined in an exploratory subgroup analysis. We also conducted subgroup analyses of interventions that applied distinct technologies and had different risk levels. Statistical analyses were performed using RevMan version 5.3.0 (the Cochrane Collaboration) and STATA version 9.0 (StataCorp LLC). GraphPad Prism version 7.0 (GraphPad Software, Inc) was used to generate the figures included in this study.


    Taxonomy of Apps for Diabetes Self-Management

    We designed a preliminary taxonomy with a functional axis, a clinical axis, and a risk axis as shown in Multimedia Appendix 1, part C. The functional axis consisted of 5 technical modules (ie, log, structured display, general education, personalized feedback, and communication) whose descriptive details were refined by previous classifications. The clinical axis consisted of 5 diabetes management modules (ie, monitoring, medication management, lifestyle modification, complication prevention, and psychosocial care) referring to the ADA guideline [2]. Functions were specified by crossing the functional axis (module) and the clinical axis (module), where we made sure that each function belonged to a functional or clinical classification, or both.

    We developed the risk axis based on the US Food and Drug Administration (FDA) risk-based recommendation [36]. This recommendation classifies functionalities of mobile health technology into 3 categories: administrative (eg, general-purpose communication and population health management), which pose limited or no risk to patient safety; health management (eg, some clinical decision support and medication management), which pose potential but generally low risks; and medical device (eg, medical device accessories and medical device clinical decision support software), which present a relatively higher risk to patient safety. We assessed the risks of functions as low, potential, and high, accordingly.

    During validation, we identified 1559 apps by searching the iTunes App Store and Google Play and excluded 1414 apps that were duplicated, were not for diabetes-management, were without English or Chinese versions, and had not been updated for at least 5 years. The remaining 145 eligible apps were downloaded onto smart mobile devices. After excluding those without real-time interactions and designed solely for health care providers, we included 96 apps and classified them by the preliminary taxonomy. As we could well classify all functions among the included apps by the taxonomy, and we identified all modules in the taxonomy in the included apps, we proposed the final taxonomy after this validation (Table 1).

    Table 1. Taxonomy of apps for diabetes self-management.
    Functional modulesDiabetes management modules
    MonitoringbMedication managementcLifestyle modificationComplication preventionPsychosocial care
    Logb⊕⊖⊖Recording self-monitoring parametersd;
    ⊕⊕⊖Recording other medical parameterse    		⊕⊕⊖Recording used medications and side effects⊕⊖⊖Recording activities, diets, and weightf⊕⊖⊖Recording complication-related statusg;
    ⊕⊖⊖Recording appointments with doctors    		⊕⊖⊖Recording mood
    Structured display⊕⊖⊖Displaying data in a structured way
    General education⊕⊖⊖Instructions for monitoring;
    ⊕⊕⊖Interpreting the parameters    		⊕⊕⊖Diabetes process and treatment options;
    ⊕⊕⊖Using medications safely and effectively    		⊕⊖⊖Incorporating nutritional management and physical activity into lifestyle⊕⊕⊖Preventing, detecting, and handling acute complications and chronic complicationsh⊕⊖⊖Addressing psychosocial issues and promoting behavior change
    Personalized feedback⊕⊖⊖Reminding to monitor;
    ⊕⊖⊖Off-target alert;
    ⊕⊕⊖Setting targets    		⊕⊕⊖Reminding to take medications;
    ⊕⊕⊕Clinical decision makingi    		⊕⊖⊖Reminding to eat healthily and be active;
    ⊕⊕⊖Self-management decision makingj    		⊕⊖⊖Reminding to quit smoking, visit doctors, and prevent acute complicationsN/Ak
    Communication⊕⊖⊖General communication, connecting users with their peers and families through social networking, chat forums, or websites;
    ⊕⊕⊖Patient-clinician communication, in-app access to health care providers for medical support or consultation.

    aRisk assessment of a function: low risk (⊕⊖⊖), potential risk (⊕⊕⊖), and high risk (⊕⊕⊕). The overall risk assessment of an app was determined by the highest risk of included functions.

    bMonitoring and log are basic modules.

    cMedications for diabetes include insulin, oral antidiabetic agents, aspirin, antihypertensives, lipid-lowering medications, and vaccines.

    dSelf-monitoring parameters include blood glucose, blood pressure, heart rate, and pulse.

    eOther medical parameters include cholesterol levels, hemoglobin A1c, urine test, and ketones.

    fActivities include steps, duration, heart rate, and consumed calories; diets include food, water, nutritional values, carbohydrate counting, and calorie calculator; weight includes body mass index, body fat, and circumference.

    gComplication-related status includes smoking, drinking, snoring, feet, eyes, teeth, and sensory status.

    hAcute complications include hypoglycemia and hyperglycemia; chronic complications include cardiovascular disease and microvascular complications (ie, nephropathy, retinopathy, neuropathy).

    iClinical decision making is recommending treatment (eg, oral agents and insulin) by algorithms alone without the participation of health care providers.

    jSelf-management decision making is decision making on lifestyle modification by algorithms.

    kN/A: not applicable.

    Characteristics and Classifications of Included Trials

    We identified 3131 references using our search strategies and identified 544 references by checking the reference lists of relevant articles, 68 of which underwent a full-text review. This process excluded 55 studies, with the reasons listed in Multimedia Appendix 3. We included 12 trials from 13 references in a qualitative systematic review, evaluating 12 independent app-based interventions involving 974 outpatients with diabetes. Figure 1 shows the flow of study selection.

    Across the 13 included references, the HbA1c was obtained from 12 trials with 974 participants after a median follow-up period of 6 (range 3-12) months, and severe hypoglycemia was extracted from 4 trials of 346 participants after a median follow-up of 6 months. There were 5 trials that enrolled patients with type 1 diabetes mellitus (T1DM), 5 with type 2 diabetes mellitus (T2DM), and 2 with both types of diabetes.

    Of the 12 included mobile app-based interventions, 1 is available in the iTunes Store and Google Play at the time of our study [37]. After taxonomic classification, all 12 included interventions had monitoring as a diabetes management module, followed by lifestyle modification (11/12, 92%), medication management (8/12, 67%), and complication prevention (2/12, 17%). Psychosocial care was not distinguished in any of the included interventions. For functional modules, all 12 interventions had a log as a basic functional module, followed by communication (9/12, 75%), a structured display (8/12, 67%), personalized feedback (8/12, 67%), and general education (6/12, 50%). To be noted, the included interventions only had patient-clinician communication instead of general communication.

    Various technologies were applied for data transmission between users and mobile devices. Across the 12 included trials, 6 (50%) used wireless transmission through Wi-Fi, Bluetooth, near-field communication, or public switched telephone network, 5 (42%) used manual entry, and 1 (8%) used wire transmission through a data port connection.

    Of the 12 included app-based interventions, we determined 3 (25%) to be of high risk due to having a clinical decision-making function. The definition of the clinical decision-making function was recommending treatment (eg, oral agents and insulin) by algorithms alone without the participation of health care providers. We determined that the other 9 interventions (75%) carried potential risk. Table 2 summarizes the modules, risks, and technologies of the mobile app-based interventions included in the meta-analysis [37-49].

    Table 2. Characteristics, modules, risk assessments, and technologies of the included mobile app-based interventions.
    StudyCountryNo.
    patients: baseline/ end    		Diabetes typeFollow-up (months)Mean (SD) HbA1ca, %: baseline; end; changeInterventionFMbDMMcRisk assessmentdTechnology
    Hsu, 2016 [38]USIe: 20/15;
    Cf: 20/16    		23I: 10.8 (1.0); 7.7 (1.6); –3.2 (1.5)
    C: 10.9 (0.9); 8.9 (2.2); –2.0 (2.0)    		Cloud-based diabetes management programL, StD, GE, CoM, MM, LM, CPPotentialWireless
    Baron, 2017 [39]UKI: 45/40;
    C: 36/31    		Both9I: 9.1 (1.8); 8.6 (1.6);
    C: 8.9 (1.7); 8.9 (1.6)    		Mobile telehealthL, StD, GE, PF, CoM, MM, LMPotentialWireless
    Drion, 2015 [40]NetherlandsI: 31/30;
    C: 32/32    		13I: 7.73 (NRg); 7.91 (NR);
    C: 7.82 (NR); 7.91 (NR)    		Diabetes Under Control (DBEES)L, StDM, MM, LMPotentialManual entry
    Holmen, 2014 [41]; Torbjornsen, 2014 [42]NorwayI: 51/39;
    C: 50/41    		212I: 8.1 (1.1); 7.8 (0.9);
    C: 8.3 (1.2); 8.2 (1.1)    		Few Touch Application (FTA)L, StD, GE, PF, CoM, LMPotentialWireless
    Waki, 2014 [43]JapanI: 27/24;
    C: 27/25    		23I: 7.1 (1.0); 6.7 (0.7);
    C: 7.0 (0.9); 7.1 (1.1)    		DialBeticsL, StD, GE, PF, CoM, LMPotentialWireless
    Kirwan, 2013 [37]AustraliaI: 36/28;
    C: 36/32    		19I: 9.1 (1.2); 8.0 (0.7);
    C: 8.5 (0.9); 8.4 (1.0)    		Glucose BuddyL, StDM, MM, LMPotentialManual entry
    Rossi, 2013 [44]ItalyI: 63/55;
    C: 64/57    		16I: 8.4 (NR); 7.9 (NR); –0.5 (NR);
    C: 8.5 (NR); 8.1 (NR); –0.5 (NR)    		Diabetes Interactive DiaryL, PF, CoM, MM, LMHighManual entry
    Charpentier, 2011 [45]FranceI: 60/56;
    C: 61/60    		16I: 9.2 (1.1); 8.6 (1.1);
    C: 8.9 (0.9); 9.1 (1.2)    		Diabeo systemL, StD, PF, CoM, MM, LMHighManual entry
    Rossi, 2010 [46]ItalyI: 67/58;
    C: 63/61    		16I: 8.2 (0.8); 7.8 (0.8); –0.4 (0.9);
    C: 8.4 (0.7); 7.9 (1.1); –0.5 (1.0)    		Diabetes Interactive DiaryL, PF, CoM, MM, LMHighManual entry
    Yoo, 2009 [47]KoreaI: 62/57;
    C: 61/54    		23I: 7.6 (0.9); 7.1 (0.8);
    C: 7.4 (0.9) 7.6 (1.0)    		Ubiquitous Chronic Disease Care (UCDC) systemL, GE, PFM, LMPotentialWire
    Istepanian, 2009 [48]UKI: 72/NR;
    C: 65/NR    		Both9I: 7.9 (1.5); 7.8 (NR);
    C: 8.1 (1.6) 8.4 (NR)    		Mobile phone telemonitoring systemL, CoMPotentialWireless
    Quinn, 2008 [49]USI: 15/13;
    C: 15/13    		23I: 9.5 (NR); 7.5 (NR);
    C: 9.1 (NR); 8.4 (NR)    		WellDoc CommunicationsL, StD, GE, PF, CoM, MM, LM, CPPotentialWireless

    aHbA1c: hemoglobin A1c.

    bFM: functional modules are communication (Co), general education (GE), log (L), personalized feedback (PF), and structured display (StD).

    cDMM: diabetes management modules are complication prevention (CP), lifestyle modification (LM), monitoring (M), and medication management (MM).

    dThe overall risk assessment of an intervention was determined by the highest risk of its functions.

    eI: intervention group.

    fC: control group.

    gNR: not reported.

    ‎
    Figure 1. Study selection. CBM: Chinese Biomedical Literature Database; CENTRAL: Cochrane Central Register of Controlled Trials; CGM: continuous glucose monitoring; CSII: continuous subcutaneous insulin infusion; HbA1c: hemoglobin A1c; HCP: health care provider; PHR: personal health record.
    View this figure

    Risks of Bias of Included Trials

    Only 67% (8/12) of the trials adequately reported allocation sequence generation, and 58% (7/12) adequately reported concealing the allocation sequence. As an objective outcome, all trials adequately blinded the assessment of the primary outcome (HbA1c changes). The corresponding proportion for incomplete outcome data was 25% (3/12), for selective reporting was 25% (3/12), and for other sources of bias was 50% (6/12). Figure 2 and Figure 3 present the risk-of-bias assessments of the primary outcome (HbA1c changes) for each domain of each included study. Multimedia Appendix 4 lists the detailed characteristics, taxonomic classification, and risk of bias of each included trial.

    ‎
    Figure 2. Risk of bias for the primary outcome (hemoglobin A1c changes): review authors’ judgments about each risk-of-bias item presented as percentages across all included studies.
    View this figure
    ‎
    Figure 3. Risk-of-bias summary for the primary outcome (hemoglobin A1c changes): review authors’ judgments about each risk-of-bias item for each included study.
    View this figure

    Effects of Mobile App-Based Interventions on HbA1c

    The use of mobile app-based interventions was associated with a clinically significant HbA1c reduction of 0.48% (95% CI 0.19%-0.78%, I2=76%, P<.001) compared with standard care alone, as Figure 4 shows. However, the funnel plot was found to be asymmetrical (Multimedia Appendix 5), with Egger test indicating a potential publication bias (P=.008). Overall, we used the GRADE approach to rate the quality of the evidence for HbA1c as low due to the potential publication bias and study limitations (lack of allocation concealment, lack of blinding of participants and personnel, incomplete outcome data, selective reporting, and other biases as shown in Figure 2 and Figure 3; Multimedia Appendix 6).

    We performed a post hoc exploratory analysis for 5 trials enrolling patients with T1DM and 5 trials enrolling patients with T2DM. The use of app-based interventions did not achieve statistical significance among patients with T1DM (MD 0.37%, 95% CI –0.12%-0.86%, I2=86%, P<.001). Larger HbA1c reductions were noted for patients with T2DM (MD 0.67%, 95% CI 0.30%-1.03%, I2=47%, P=.11). The intersubgroup difference was not significant (P=.30) (Figure 5).

    ‎
    Figure 4. Effects of app-based mobile health interventions on hemoglobin A1c (HbA1c). MD: mean difference.
    View this figure
    ‎
    Figure 5. Effects of app-based mobile health interventions on hemoglobin A1c (HbA1c) for patients with type 1 diabetes (T1DM) and type 2 diabetes (T2DM). MD: mean difference.
    View this figure

    Effects of Modules, Risks, and Technologies of App-Based Interventions on HbA1c

    We noted a greater HbA1c reduction when interventions included a complication prevention module (with complication prevention: MD 1.31%, 95% CI 0.66%-1.96%, I2=0%, P=.84 vs without: MD 0.38%, 95% CI 0.09%-0.68%, I2=76%, P<.001; test for subgroup difference P=.01). Having a structured display was also associated with a larger HbA1c reduction (with structured display: MD 0.69%, 95% CI 0.32%-1.06%, I2=63%, P=.008 vs without: MD 0.17%, 95% CI –0.18% to 0.53%, I2=75%, P=.007; test for subgroup difference P=.05).

    For high-risk interventions with a clinical decision-making function, the reduction of HbA1c was 0.19% (95% CI –0.24%-0.63%, I2=82%, P=.004), while the reduction was 0.61% (95% CI 0.27%-0.95%, I2=64%, P=.005) for potential-risk interventions without clinical decision making (test for subgroup difference P=.104.

    Interventions using manual entry showed an associated lower HbA1c reduction without statistical significance (wire connection: MD 0.70%, 95% CI 0.33%-1.07% vs wireless connection: MD 0.53% CI 0.15%-0.92%, I2=46%, P=.10 vs manual entry: MD 0.37%, 95% CI –0.12%-0.86%, I2=86%, P<.001; test for subgroup difference P=.56) (Figure 6).

    ‎
    Figure 6. Effects of modules, risks, and technologies of app-based mobile health interventions on hemoglobin A1c (HbA1c). MD: mean difference.
    View this figure

    Adverse Events of Included Trials

    Adverse events were reported variably among the 5 included studies [38,41,44-46]. One study reported no adverse clinical event but several undesired technical events in the automatic data transmission between the glucometer and the app [41]. A total of 4 studies reported the participants or the proportion of participants with, or the incidence of severe hypoglycemia and overall hypoglycemia [38,44-46]. None of the studies reported any other kinds of adverse events or death.

    For severe hypoglycemia, 1 study reported significantly fewer episodes in the intervention group (0.33 vs 2.29 events/patient-year) [44]; 3 studies reported no severe hypoglycemia in either the intervention or control group [38,41,46]. Of the 5 studies, 4 reported that 3 participants in the intervention group and 3 in the standard-care group had severe hypoglycemia episodes, with a pooled risk ratio of 1.07 (95% CI 0.23%-5.09%) [38,41,45,46]. The pooled risk ratio was 1.62 (95% CI 0.48%-5.40%) for the 3 trials reporting overall hypoglycemia [38,41,46] (Multimedia Appendix 7).

    Overall, we rated the quality of the evidence for severe hypoglycemia as low due to imprecision (wide confidence intervals including null effect) and study limitations (risk of bias in 4 trials), and as very low for adverse events owing to inconsistency (substantial diversity in the definitions of outcome measures), imprecision (small sample sizes and low event rates), and study limitations (risk of bias in 5 trials) (Multimedia Appendix 5).


    Principal Findings

    As most commercially available apps for diabetes self-management were not tested by RCTs, both the patients and the clinicians needed indirect evidence to guide their assessment while choosing apps. The purposes of this review were to investigate the glycemic efficacy of mobile app-based interventions, and to explore the differential effectiveness of their functions. We could not use existing classifications for the functions of the app-based interventions because of inconsistency and incompleteness. As a result, we developed and validated a comprehensive taxonomy for the functions of diabetes self-management apps. To our knowledge, this is the first comprehensive taxonomy with clinical, functional, and risk axes, and this is the first review exploring the contribution of each function to the effectiveness of entire apps.

    The meta-analysis of 12 RCTs demonstrated that app-based interventions were associated with a statistically and clinically significant HbA1c reduction of 0.48% (95% CI 0.19%-0.78%). We noted larger HbA1c reductions for patients with T2DM (MD 0.67%, 95% CI 0.30%-1.03%) than those with T1DM (MD 0.37%, 95% CI –0.12%-0.86%). The exploratory subgroup analyses showed that having a clinical decision-making function in app-based interventions was not associated with a greater HbA1c reduction (with clinical decision making: MD 0.19%, 95% CI –0.24%-0.63% vs without: MD 0.61%, 95% CI 0.27%-0.95%; intersubgroup P=.14). There were no excess adverse events related to the included app-based interventions.

    Comparison With Prior Work

    Consistent with previous reviews involving mobile app-based interventions [16-18], our study indicated that the use of mobile app-based interventions is associated with a clinically significant HbA1c reduction in the diabetes management of adult outpatients. Our results suggested that glycemic control of adult outpatients with diabetes can benefit from apps. A subgroup analysis of diabetes types showed a larger HbA1c reduction in patients with T2DM than in those with T1DM. This difference is consistent with a previous review [17] and may be explained, at least in part, by the complexity of the management of T1DM [2]. Patients with T1DM, especially those at a young age, require intensive management, which increases the burdens placed on the management of T1DM. Our result suggested that current apps may not be good enough to support the intensive management of T1DM.

    Our study developed a 3-axis taxonomy for diabetes apps, with rows of functional modules, columns of diabetes management modules, and cells of functions with risk assessments. The functional, clinical, and risk axes were developed based on previous classifications, the ADA’s guidelines, and the FDA’s risk recommendation, respectively. The 3-axis design of the taxonomy is comprehensive and decreases the possibility of misclassification. Additionally, this 3-axis design is applicable for diseases other than diabetes by adjusting the modules in the clinical axis. The validation process guarantees that our taxonomy can be used to classify commercial diabetes apps. Differences in the detected effect sizes in subsequent subgroup analyses indicated the utility of our taxonomy.

    Our taxonomy has some advantages. First, it is a comprehensive taxonomy with functional, clinical, and risk axes. The taxonomy permits subsequent exploratory subgroup analyses of multifunction apps, which give insights into the efficacy and risk of each module in diabetes apps. Comparatively, existing classifications appear to be incomplete or inconsistent. Previous classifications have mainly focused on the functions of apps, which, as a result, have made them applicable only for functional evaluation [16,17,22-25,27-30]. Some similar functions in these classifications have diverse definitions and descriptive details. Moreover, some functions lack clinical considerations, such as education, feedback, and decision support [16,17,23-25,27-30]. Only 1 classification addresses risk assessment [20]. These classifications, on the one hand, demonstrate a requirement to classify apps comprehensively, and on the other hand, they indicate the limitation of each independent classification.

    Second, our taxonomy can be of some help in the development and evolution of diabetes apps. App developers are usually technicians without a clinical background. As a result, the evidence-based guidelines for diabetes management are easily ignored during app development. For example, we found that complication prevention and psychosocial care were uncommon in the app-based interventions we examined. However, complication prevention behaviors and emotional well-being are associated with positive diabetes outcomes according to the guidelines [2]. Previous reviews also suggested that diabetes apps lacked essential modules and neglected evidence-based guidelines [15,50]. With a clinical axis of diabetes management modules developed based on guidelines, our taxonomy makes it straightforward for app developers to follow evidence-based guidelines during the design and development of diabetes apps.

    Third, our taxonomy permits subsequent exploratory subgroup analyses of multifunction apps, which give insights into the efficacy and risk of each module in diabetes apps.

    Our exploratory subgroup analyses suggested a limited efficacy of clinical decision making, which was defined as recommending treatment (eg, oral agents and insulin) by algorithms alone without the participation of health care providers and was determined to be high risk according to our taxonomy. Traditionally, clinical decisions are made during a face-to-face interview after a complete assessment. Built-in clinical decision support systems, however, are less likely to collect data and assess status as thoroughly as face-to-face consultations do. Without adequate data and well-designed algorithms, clinical decision-making functions can make inappropriate decisions and pose risks to patients [51,52]. Additionally, complex data collection may cause technical difficulties. Despite the above-mentioned issues, clinical decision making can be found in diabetes apps both in trials [44-46] and in app stores [23,28]. Therefore, we suggest that app developers should employ caution to add clinical decision making into diabetes apps, and patients should consult with health care providers on using apps for diabetes self-management.

    Our subgroup analyses indicated that having a complication prevention module in the apps was associated with a greater HbA1c reduction. Complication prevention behaviors such as smoking cessation and hypoglycemia prevention are critical components of diabetes management according to current guidelines [2]. However, only 2 included app-based interventions had a complication prevention module. Further studies are needed to confirm the efficacy of a complication prevention module. Meanwhile, having a structured display module was associated with a larger HbA1c reduction. The structured display module may improve blood glucose self-monitoring behaviors by displaying structured self-monitoring of blood glucose profiles. Having a structured display is consistent with current clinical guidelines, in which self-monitoring of blood glucose is a critical element in the management of diabetes [2].

    Having a lifestyle modification in app-based interventions was associated with a trend toward reduced HbA1c, as was having a general education module. The modules of lifestyle modification and general education may raise awareness of lifestyle change and self-management. Since these 2 modules pose limited risks to patients with diabetes, it might be reasonable to add lifestyle modification and general education to diabetes apps.

    The data suggested limited glycemic efficacy of having a personalized feedback module. However, considerable uncertainty and limitations exist regarding its efficacy. Given that the personalized feedback module has a relatively high risk, further evaluation is required before adding a personalized feedback module to diabetes apps. Consistent with a previous review [15], our review found that none of the interventions included a general communication function. Particular attention should be paid to the complexity and variety of the patient-clinician communication function as shown in Multimedia Appendix 8. As for the technologies, direct data transmission between users and mobile devices using wire or wireless connections was associated with a trend toward reduced HbA1c, which could be explained by the convenience and accuracy of the technology.

    Limitations

    Our study also has some limitations. First, the exploratory and observational nature of our subgroup analyses and the possibility of misclassification prevented us from drawing a solid conclusion about the modular efficacies and risks. Second, we examined only 12 trials in our study, which may limit the strength of this systematic review. Third, we noted the asymmetry of the funnel plot, which indicated a potential risk of publication bias in our systematic review.

    Conclusions

    In our study, we developed a 3-axis taxonomy for diabetes self-management apps. Mobile app-based interventions improve glycemic control in adult outpatients with diabetes, especially in those with T2DM. Our analyses suggest that clinical decision making requires further improvement and evaluation before being added to apps. Safety issues such as hypoglycemia and other adverse events are being overlooked and need attention in future investigations.

    Acknowledgments

    The authors thank Dr Xiaodan Li, Department of Gastroenterology, West China Hospital, Sichuan University, for her comprehensive revision and advice for this manuscript. The corresponding authors were supported by grants from the National Natural Science Foundation of China (grant nos. 81400811 and 21534008), National Basic Research Program of China (2015CB942800), and the Scientific Research Project of Health and Family Planning Commission of Sichuan Province (grant nos. 130029 and 150149).

    Authors' Contributions

    YW, XY, HT, and SL conceived this study. YW and YD contributed to data extraction and quality assessment. YW and XY contributed to the Web-based searches of the literature and apps. YW and SL wrote the report. YW, JK, and LL conducted the statistical analysis. GV, AN, and XS guaranteed the study methodology. All authors discussed and interpreted the results and reviewed the manuscript before submission.

    Conflicts of Interest

    None declared.

    ‎

    Multimedia Appendix 1

    Taxonomy development and validation.

    PDF File (Adobe PDF File), 578KB
    ‎

    Multimedia Appendix 2

    MEDLINE search strategy.

    PDF File (Adobe PDF File), 29KB
    ‎

    Multimedia Appendix 3

    List of excluded references with reasons for exclusions.

    PDF File (Adobe PDF File), 66KB
    ‎

    Multimedia Appendix 4

    The detailed information, taxonomic classification, and risk of bias of included trials.

    PDF File (Adobe PDF File), 164KB
    ‎

    Multimedia Appendix 5

    Funnel plot.

    PDF File (Adobe PDF File), 61KB
    ‎

    Multimedia Appendix 6

    GRADE for primary and secondary outcomes.

    PDF File (Adobe PDF File), 44KB
    ‎

    Multimedia Appendix 7

    Meta-analyses for adverse events.

    PDF File (Adobe PDF File), 160KB
    ‎

    Multimedia Appendix 8

    Classifications of the patient-clinician communication function.

    PDF File (Adobe PDF File), 27KB
    1. Yang G, Wang Y, Zeng Y, Gao GF, Liang X, Zhou M, et al. Rapid health transition in China, 1990-2010: findings from the Global Burden of Disease Study 2010. Lancet 2013 Jun 8;381(9882):1987-2015. [CrossRef] [Medline]
    2. American Diabetes Association. Standards of medical care in diabetes-2017.: Diabetes Care; 2017 Jan.   URL: http://professional.diabetes.org/sites/professional.diabetes.org/files/media/dc_40_s1_final.pdf [accessed 2017-03-11] [WebCite Cache]
    3. Bragg F, Holmes M, Iona A, Guo Y, Du H, Chen Y, China Kadoorie Biobank Collaborative Group. Association between diabetes and cause-specific mortality in rural and urban areas of China. JAMA 2017 Dec 17;317(3):280-289. [CrossRef] [Medline]
    4. Yang W, Lu J, Weng J, Jia W, Ji L, Xiao J, China National Diabetes and Metabolic Disorders Study Group. Prevalence of diabetes among men and women in China. N Engl J Med 2010 Mar 25;362(12):1090-1101. [CrossRef] [Medline]
    5. Xu Y, Wang L, He J, Bi Y, Li M, Wang T, 2010 China Noncommunicable Disease Surveillance Group. Prevalence and control of diabetes in Chinese adults. JAMA 2013 Sep 04;310(9):948-959. [CrossRef] [Medline]
    6. Yang W, Zhao W, Xiao J, Li R, Zhang P, Kissimova-Skarbek K, et al. Medical care and payment for diabetes in China: enormous threat and great opportunity. PLoS One 2012;7(9):e39513 [FREE Full text] [CrossRef] [Medline]
    7. Statista. Number of smartphone users in China from 2013 to 2021.   URL: https://www.statista.com/statistics/467160/forecast-of-smartphone-users-in-china/ [accessed 2017-03-11] [WebCite Cache]
    8. Danes M, Whinder F. Diabetes management goes digital. Lancet Diabetes Endocrinol 2013 Sep;1(1):17-18. [CrossRef] [Medline]
    9. Bradway M, Årsand E, Grøttland A. Mobile health: empowering patients and driving change. Trends Endocrinol Metab 2015 Mar;26(3):114-117. [CrossRef] [Medline]
    10. Istepanian RS. Mobile applications for diabetes management: efficacy issues and regulatory challenges. Lancet Diabetes Endocrinol 2015 Dec;3(12):921-923. [CrossRef] [Medline]
    11. Research 2 Guidance. mHealth app developer economics 2015: the current status and trends of the mHealth app market. 2015.   URL: http://research2guidance.com/r2g/r2g-mHealth-App-Developer-Economics-2015.pdf [accessed 2017-03-08] [WebCite Cache]
    12. IMS Institute for Healthcare Informatics. Patient apps for improved healthcare: from novelty to mainstream. 2013 Oct.   URL: http://obroncology.com/imshealth/content/IIHI%20Apps%20report%20231013F_interactive.pdf [accessed 2017-03-09] [WebCite Cache]
    13. Whitehead L, Seaton P. The effectiveness of self-management mobile phone and tablet apps in long-term condition management: a systematic review. J Med Internet Res 2016;18(5):e97 [FREE Full text] [CrossRef] [Medline]
    14. Powell AC, Landman AB, Bates DW. In search of a few good apps. JAMA 2014 May 14;311(18):1851-1852. [CrossRef] [Medline]
    15. Chomutare T, Fernandez-Luque L, Arsand E, Hartvigsen G. Features of mobile diabetes applications: review of the literature and analysis of current applications compared against evidence-based guidelines. J Med Internet Res 2011;13(3):e65 [FREE Full text] [CrossRef] [Medline]
    16. Holtz B, Lauckner C. Diabetes management via mobile phones: a systematic review. Telemed J E Health 2012 Apr;18(3):175-184. [CrossRef] [Medline]
    17. Liang X, Wang Q, Yang X, Cao J, Chen J, Mo X, et al. Effect of mobile phone intervention for diabetes on glycaemic control: a meta-analysis. Diabet Med 2011 Apr;28(4):455-463. [CrossRef] [Medline]
    18. Krishna S, Boren SA. Diabetes self-management care via cell phone: a systematic review. J Diabetes Sci Technol 2008 May;2(3):509-517 [FREE Full text] [Medline]
    19. Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, et al. Can we systematically review studies that evaluate complex interventions? PLoS Med 2009 Aug;6(8):e1000086 [FREE Full text] [CrossRef] [Medline]
    20. Lewis TL, Wyatt JC. mHealth and mobile medical apps: a framework to assess risk and promote safer use. J Med Internet Res 2014 Sep 15;16(9):e210 [FREE Full text] [CrossRef] [Medline]
    21. Cortez NG, Cohen IG, Kesselheim AS. FDA regulation of mobile health technologies. N Engl J Med 2014 Jul 24;371(4):372-379. [CrossRef] [Medline]
    22. de Ridder M, Kim J, Jing Y, Khadra M, Nanan R. A systematic review on incentive-driven mobile health technology: as used in diabetes management. J Telemed Telecare 2016 Feb 16. [CrossRef] [Medline]
    23. Basilico A, Marceglia S, Bonacina S, Pinciroli F. Advising patients on selecting trustful apps for diabetes self-care. Comput Biol Med 2016 Apr 01;71:86-96. [CrossRef] [Medline]
    24. Williams JP, Schroeder D. Popular glucose tracking apps and use of mHealth by Latinos with diabetes: review. JMIR Mhealth Uhealth 2015;3(3):e84 [FREE Full text] [CrossRef] [Medline]
    25. Riazi H, Larijani B, Langarizadeh M, Shahmoradi L. Managing diabetes mellitus using information technology: a systematic review. J Diabetes Metab Disord 2015;14:49 [FREE Full text] [CrossRef] [Medline]
    26. El-Gayar O, Timsina P, Nawar N, Eid W. A systematic review of IT for diabetes self-management: are we there yet? Int J Med Inform 2013 Aug;82(8):637-652. [CrossRef] [Medline]
    27. El-Gayar O, Timsina P, Nawar N, Eid W. Mobile applications for diabetes self-management: status and potential. J Diabetes Sci Technol 2013;7(1):247-262 [FREE Full text] [Medline]
    28. Demidowich AP, Lu K, Tamler R, Bloomgarden Z. An evaluation of diabetes self-management applications for Android smartphones. J Telemed Telecare 2012 Jun;18(4):235-238. [CrossRef] [Medline]
    29. Årsand E, Frøisland DH, Skrøvseth SO, Chomutare T, Tatara N, Hartvigsen G, et al. Mobile health applications to assist patients with diabetes: lessons learned and design implications. J Diabetes Sci Technol 2012 Sep;6(5):1197-1206 [FREE Full text] [Medline]
    30. Rao A, Hou P, Golnik T, Flaherty J, Vu S. Evolution of data management tools for managing self-monitoring of blood glucose results: a survey of iPhone applications. J Diabetes Sci Technol 2010 Jul;4(4):949-957 [FREE Full text] [Medline]
    31. Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011].: The Cochrane Collaboration; 2011.   URL: http://handbook.cochrane.org/ [accessed 2017-03-09] [WebCite Cache]
    32. Atkins D, Best D, Briss PA, Eccles M, Falck-Ytter Y, Flottorp S, et al. Grading quality of evidence and strength of recommendations. BMJ 2004 Jun 19;328(7454):1490 [FREE Full text] [CrossRef] [Medline]
    33. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994 Dec;50(4):1088-1101. [Medline]
    34. Egger M, Davey SG, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997 Sep 13;315(7109):629-634 [FREE Full text] [Medline]
    35. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med 2002 Jun 15;21(11):1539-1558. [CrossRef] [Medline]
    36. Food and Drug Administration, Federal Communications Commission, The Office of the National Coordinator for Health Information Technology. FDASIA health IT report: proposed strategy and recommendations for a risk-based framework. 2014 Apr.   URL: http:/​/www.​fda.gov/​downloads/​AboutFDA/​CentersOffices/​OfficeofMedicalProductsandTobacco/​CDRH/​CDRHReports/​UCM391521.​pdf [accessed 2017-03-09] [WebCite Cache]
    37. Kirwan M, Vandelanotte C, Fenning A, Duncan MJ. Diabetes self-management smartphone application for adults with type 1 diabetes: randomized controlled trial. J Med Internet Res 2013;15(11):e235 [FREE Full text] [CrossRef] [Medline]
    38. Hsu WC, Lau KH, Huang R, Ghiloni S, Le H, Gilroy S, et al. Utilization of a cloud-based diabetes management program for insulin initiation and titration enables collaborative decision making between healthcare providers and patients. Diabetes Technol Ther 2016 Feb;18(2):59-67 [FREE Full text] [CrossRef] [Medline]
    39. Baron JS, Hirani S, Newman SP. A randomised, controlled trial of the effects of a mobile telehealth intervention on clinical and patient-reported outcomes in people with poorly controlled diabetes. J Telemed Telecare 2016 Feb 15. [CrossRef] [Medline]
    40. Drion I, Pameijer LR, van Dijk PR, Groenier KH, Kleefstra N, Bilo HJ. The effects of a mobile phone application on quality of life in patients with type 1 diabetes mellitus: a randomized controlled trial. J Diabetes Sci Technol 2015 May 11;9(5):1086-1091 [FREE Full text] [CrossRef] [Medline]
    41. Holmen H, Torbjørnsen A, Wahl AK, Jenum AK, Småstuen MC, Arsand E, et al. A mobile health intervention for self-management and lifestyle change for persons with type 2 diabetes, part 2: one-year results from the Norwegian randomized controlled trial RENEWING HEALTH. JMIR Mhealth Uhealth 2014;2(4):e57 [FREE Full text] [CrossRef] [Medline]
    42. Torbjørnsen A, Jenum AK, Småstuen MC, Arsand E, Holmen H, Wahl AK, et al. A low-intensity mobile health intervention with and without health counseling for persons with type 2 diabetes, part 1: baseline and short-term results from a randomized controlled trial in the Norwegian part of RENEWING HEALTH. JMIR Mhealth Uhealth 2014;2(4):e52 [FREE Full text] [CrossRef] [Medline]
    43. Waki K, Fujita H, Uchimura Y, Omae K, Aramaki E, Kato S, et al. DialBetics: a novel smartphone-based self-management support system for type 2 diabetes patients. J Diabetes Sci Technol 2014 Mar 13;8(2):209-215 [FREE Full text] [CrossRef] [Medline]
    44. Rossi MC, Nicolucci A, Lucisano G, Pellegrini F, Di Bartolo P, Miselli V, et al. Impact of the Diabetes Interactive Diary telemedicine system on metabolic control, risk of hypoglycemia, and quality of life: a randomized clinical trial in type 1 diabetes. Diabetes Technol Ther 2013 Aug;15(8):670-679. [CrossRef] [Medline]
    45. Charpentier G, Benhamou P, Dardari D, Clergeot A, Franc S, Schaepelynck-Belicar P, et al. The Diabeo software enabling individualized insulin dose adjustments combined with telemedicine support improves HbA1c in poorly controlled type 1 diabetic patients: a 6-month, randomized, open-label, parallel-group, multicenter trial (TeleDiab 1 Study). Diabetes Care 2011 Mar;34(3):533-539 [FREE Full text] [CrossRef] [Medline]
    46. Rossi MC, Nicolucci A, Di Bartolo P, Bruttomesso D, Girelli A, Ampudia FJ, et al. Diabetes Interactive Diary: a new telemedicine system enabling flexible diet and insulin therapy while improving quality of life: an open-label, international, multicenter, randomized study. Diabetes Care 2010 Jan;33(1):109-115 [FREE Full text] [CrossRef] [Medline]
    47. Yoo HJ, Park MS, Kim TN, Yang SJ, Cho GJ, Hwang TG, et al. A ubiquitous chronic disease care system using cellular phones and the internet. Diabet Med 2009 Jun;26(6):628-635. [CrossRef] [Medline]
    48. Istepanian RS, Zitouni K, Harry D, Moutosammy N, Sungoor A, Tang B, et al. Evaluation of a mobile phone telemonitoring system for glycaemic control in patients with diabetes. J Telemed Telecare 2009;15(3):125-128. [CrossRef] [Medline]
    49. Quinn CC, Clough SS, Minor JM, Lender D, Okafor MC, Gruber-Baldini A. WellDoc mobile diabetes management randomized controlled trial: change in clinical and behavioral outcomes and patient and physician satisfaction. Diabetes Technol Ther 2008 Jun;10(3):160-168. [CrossRef] [Medline]
    50. Rossi MG, Bigi S. Weak educational components in mHealth devices for diabetes support available on the Italian market. J Diabetes Sci Technol 2016 Sep;10(5):1199-1200. [CrossRef] [Medline]
    51. Huckvale K, Adomaviciute S, Prieto JT, Leow MK, Car J. Smartphone apps for calculating insulin dose: a systematic assessment. BMC Med 2015;13:106 [FREE Full text] [CrossRef] [Medline]
    52. Hirsch IB, Parkin CG. Unknown safety and efficacy of smartphone bolus calculator apps puts patients at risk for severe adverse outcomes. J Diabetes Sci Technol 2016 Jul;10(4):977-980 [FREE Full text] [CrossRef] [Medline]

    ‎
    ADA: American Diabetes Association
    CENTRAL: Cochrane Central Register of Controlled Trials
    FDA: Food and Drug Administration
    GRADE: Grading of Recommendations Assessment, Development and Evaluation
    HbA1c: hemoglobin A1c
    MD: mean difference
    RCT: randomized controlled trial
    T1DM: type 1 diabetes mellitus
    T2DM: type 2 diabetes mellitus

    Edited by S Kitsiou; submitted 22.08.16; peer-reviewed by S Agboola, P Wang, A Powell; comments to author 11.09.16; revised version received 20.10.16; accepted 25.02.17; published 14.03.17

    Copyright

    ©Yuan Wu, Xun Yao, Giacomo Vespasiani, Antonio Nicolucci, Yajie Dong, Joey Kwong, Ling Li, Xin Sun, Haoming Tian, Sheyu Li. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 14.03.2017.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.