This paper is in the following e-collection/theme issue:

mHealth for Symptom and Disease Monitoring, Chronic Disease Management (1428) Participatory Medicine & E-Patients (787) Personal Health Records, Patient-Accessible Electronic Health Records, Patient Portals (591) Telehealth and Telemonitoring (1713) mHealth for Wellness, Behavior Change and Prevention (2922) Glucose Tracking and Self-Monitoring of Blood Glucose (166) Diabetes Self-Management (495)

Published on in Vol 6, No 2 (2018): February

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/9265, first published .
Mobile Diabetes Intervention Study of Patient Engagement and Impact on Blood Glucose: Mixed Methods Analysis

Mobile Diabetes Intervention Study of Patient Engagement and Impact on Blood Glucose: Mixed Methods Analysis

Mobile Diabetes Intervention Study of Patient Engagement and Impact on Blood Glucose: Mixed Methods Analysis

Authors of this article:

Charlene Connolly Quinn1 Author Orcid Image ;   Erin C Butler2 Author Orcid Image ;   Krystal K Swasey1 Author Orcid Image ;   Michelle D Shardell3 Author Orcid Image ;   Michael D Terrin1 Author Orcid Image ;   Erik A Barr1 Author Orcid Image ;   Ann L Gruber-Baldini1 Author Orcid Image
Article Authors Cited by (42) Tweetations (5) Metrics

    Original Paper

    1Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore, MD, United States

    2Department of Emergency Medicine, Wellspan York Hospital, York, PA, United States

    3National Institute on Aging, Baltimore, MD, United States

    Corresponding Author:

    Charlene Connolly Quinn, RN, PhD

    Department of Epidemiology and Public Health

    University of Maryland School of Medicine

    Howard Hall Suite 200

    660 W Redwood Street

    Baltimore, MD,

    United States

    Phone: 1 410 706 2406

    Fax:1 410 706 4433

    Email: cquinn@som.umaryland.edu


    Background: Successful treatment of diabetes includes patient self-management behaviors to prevent or delay complications and comorbid diseases. On the basis of findings from large clinical trials and professional guidelines, diabetes education programs and health providers prescribe daily regimens of glucose monitoring, healthy eating, stress management, medication adherence, and physical activity. Consistent, long-term commitment to regimens is challenging. Mobile health is increasingly being used to assist patients with lifestyle changes and self-management behaviors between provider visits. The effectiveness of mobile health to improve diabetes outcomes depends on patient engagement with a technology, content, or interactions with providers.

    Objectives: In the current analysis, we aimed to identify patient engagement themes in diabetes messaging with diabetes providers and determine if differences in engagement in the Mobile Diabetes Intervention Study (MDIS) influenced changes in glycated hemoglobin A1c (HbA1c) over a 1-year treatment period (1.9% absolute decrease in the parent study).

    Methods: In the primary MDIS study, 163 patients were enrolled into 1 of 3 mobile intervention groups or a usual care control group based on their physician cluster randomization assignment. The control group received care from their physicians as usual. Participants in each intervention group had access to a patient portal where they could record monitoring values for blood glucose, blood pressure, medication changes, or other self-management information while also assigned to varying levels of physician access to patient data. Intervention participants could choose to send and receive messages to assigned certified diabetes educators with questions or updates through the secure Web portal. For this secondary analysis, patient engagement was measured using qualitative methods to identify self-care themes in 4109 patient messages. Mixed methods were used to determine the impact of patient engagement on change in HbA1c over 1 year.

    Results: Self-care behavior themes that received the highest engagement for participants were glucose monitoring (75/107, 70.1%), medication management (71/107, 66.4%), and reducing risks (71/107, 66.4%). The average number of messages sent per patient were highest for glucose monitoring (9.2, SD 14.0) and healthy eating (6.9, SD 13.2). Compared to sending no messages, sending any messages about glucose monitoring (P=.03) or medication (P=.01) led to a decrease in HbA1c of 0.62 and 0.72 percentage points, respectively. Sending any messages about healthy eating, glucose monitoring, or medication combined led to a decrease in HbA1c of 0.54 percentage points compared to not sending messages in these themes (P=.045).

    Conclusions: The findings from this study help validate the efficacy of the mobile diabetes intervention. The next step is to determine differences between patients who engage in mobile interventions and those who do not engage and identify methods to enhance patient engagement.

    Trial Registration: ClinicalTrials.gov: NCT01107015; https://clinicaltrials.gov/ct2/show/NCT01107015 (Archived by WebCite at http://www.webcitation.org/6wh4ekP4R)

    JMIR Mhealth Uhealth 2018;6(2):e31

    doi:10.2196/mhealth.9265

    Keywords

    mobile health; diabetes; engagement; randomized clinical trial; qualitative; digital health 


    Type 2 diabetes is a growing national health concern affecting an estimated 10% of the US population [1]. It is a costly disease that requires an intricate self-management regimen including regular self-glucose monitoring, healthy eating, exercise, regular physician examinations, and specialist visits. Many patients, however, miss recommended screenings and lack diabetes self-management education (DSME) leading to higher rates of poor glycemic management and associated complications [2-7].

    Several studies have previously documented the efficacy of lifestyle modifications and drug therapy to prevent and treat type 2 diabetes, with many finding that lifestyle modifications are more effective at long-term prevention compared to metformin therapy [5,8-10]. The Action to Control Cardiovascular Risk in Diabetes (ACCORD) study suggested that intensive drug therapy could increase risk of adverse events and death, although mechanisms of the adverse events remain unknown [11-13].

    One approach to facilitate self-management and lifestyle changes is behavior intervention technology, which uses technology and mobile health to target specific short- and long-term treatment and management goals [14]. There have been numerous phone-, text-, and Web-based intervention studies in recent years that demonstrate mixed impact when compared to traditional phone call or face-to-face intervention strategies. One personal digital assistant–based intervention found some improvement in glycated hemoglobin A1c (HbA1c) management during a 9-month study, and another found improvement with an intervention based on regularly scheduled telephone calls depending on patient risk level [15,16]. Although some short message service interventions have been shown to help prevent and manage diabetes [17,18], other studies have found that strictly phone-based applications have minimal impact on glycemic management compared to traditional intervention methods [19]. Furthermore, many studies on Web-based interventions, including components for tracking blood glucose readings, medications, diet, exercise, and weight loss through an online portal system, had varying degrees of success at helping participants lose weight and improve glycemic management [20-24].

    A promising future direction of mobile diabetes management may be an integrated system that uses multiple means of access via Web portals or mobile apps and provides people with feedback based on their tracking data [7,21,25-27]. A particularly effective component of many recent studies is patient interaction with certified diabetes educators (CDEs) via phone, email, or other messaging systems. Regardless of medium, patient engagement and the ability to communicate with a diabetes educator helped improve outcomes across a variety of mobile health interventions [23,28-32]. Yet, less than 20% of currently available diabetes management applications have a motivational feedback component to them [32]. These cost-effective, easy-to-implement measures could help patients avoid expensive hospitalizations and diabetes complications by allowing them to manage their diabetes at home. Feedback components may also increase the efficiency for primary care physicians who manage patients with diabetes most often [29].

    The messaging component of studies such as the DiabetesCoach intervention [31] show that patients are responsive to both automated and personalized messages, and an individualized, personal message option is effective at helping reach a given treatment outcome. However, further research into the impact of patient engagement and best practices to engage patients is needed before standards of care can be amended [32]. In this study, we identified patient engagement messages and assessed patient engagement in the Mobile Diabetes Intervention Study (MDIS) to determine if differences in engagement were related to changes in HbA1c.


    Study Design and Eligibility

    A detailed description of the Mobile Diabetes Intervention Study was published previously [33]. The study was a cluster-randomized clinical trial including 26 primary care physician groups across 4 geographic areas of Maryland. Randomization took place at the practice level to avoid contamination among physicians regarding care of their patients.

    Eligible patients followed physician randomization assignment. Inclusion criteria for patients included diagnosis of type 2 diabetes at least 6 months prior to enrollment in the study, HbA1c ≥7.5%, and age 18 to 64 years. Patients who were uninsured or Medicare or Medicaid beneficiaries were not included. Baseline data was collected from all participants, including demographic information, health history, current health status (including HbA1c) and medications, risk factors for complications associated with poor diabetes management, and lifestyle and self-management behaviors.

    The MDIS enrolled 163 patients across 3 intervention groups and 1 control group. The control group received care from their physicians as usual. Participants in each intervention group had access to a patient portal where they could record self-care behavior while also assigned to varying levels of physician access to patient data. In the most complex intervention group, physicians could review raw patient data, see analyzed patient data reports every 3 months, and make treatment recommendations based on these summaries. All patients received their choice of 1 of 2 smartphones with an unlimited 1-year data plan as well as a OneTouch Ultra 2 (LifeScan Inc) glucose meter and enough testing supplies for the duration of the 1-year study.

    For this secondary analysis of the MDIS, group 1 data was not evaluated because control patients were not able to message their providers.

    Patient Engagement

    In addition to tracking information related to self-management of their diabetes, the secure patient portal allowed participants to communicate with CDEs throughout the study. When patients input data into the system, the computer would automatically generate feedback messages with encouragement or advice based on recently recorded data. For example, if a participant input a low blood glucose value, the system would provide a feedback message such as “This blood sugar is low! Eat 15 grams of carbs and recheck in 15 minutes.” Additionally, the data would be reviewed by the patient’s assigned CDE who could provide feedback intermittently. Most patients used the portal messaging system to communicate with educators over the course of the study, seeking advice, feedback, and answers to questions; however, using the messaging feature was not required for patients, and there was no set schedule of communication as part of the study intervention. The portal contained a variety of diabetes education materials including information on healthy eating, counting carbohydrates, being active, self-monitoring blood glucose, medications, and coping with and adjusting to living with diabetes.

    Patients covered a wide variety of content in their messages to the CDEs from asking questions about healthy eating to changing medications to optimizing their medication schedule. To investigate the association of patient engagement with improved patient outcomes observed in previous studies [23,28-32], we evaluated patient engagement in our study through a qualitative analysis of messages sent through the secure patient portal.

    For this analysis, we used the grounded theory approach [34] to analyze patient messages. As its name suggests, the theory is grounded in the observation of qualitative data and is used (for the purpose of this study) to categorize the data into core concepts. Based on review of a few sample patients, we created a coding scheme based on the 7 self-care behaviors for healthy living recommended by the American Association of Diabetes Educators (AADE) and the American Diabetes Association (ADA) [35,36]. After a pilot coding of 2 complete patient files, additional codes to account for patient-reported motivation and learning as well as general discussion about diet, medication, or self-monitoring of blood glucose were added (27 codes). Patient messages were then coded by EB and CQ (team members) based on the 27 codes developed for this project, with the appropriate codes assigned to each patient message, allowing for multiple codes assigned to a single message depending on content. Each team member independently coded the same message narrative line by line in Atlas.ti (ATLAS.ti Scientific Software Development GmbH), a qualitative data management program. Messages were coded individually without accounting for message threads on a single subject.

    Study Oversight

    The Institutional Review Board of the University of Maryland, Baltimore approved this study. A data and safety monitoring board was designated to review the study procedures and adverse events. After enrollment was closed, errors in consent were found and all participants, both physicians and patients, were asked to sign consent forms again as recommended by the Institutional Review Board. All patients in the final analysis were reconsented.

    Statistics

    The frequency of message themes was computed based on coding to categorize messages using Atlas.ti. Baseline characteristics are expressed as mean and standard deviation for continuous variables comparing users versus nonusers with 2-sample t tests or frequencies and proportions for categorical variables comparing users with nonusers with chi-square tests. A mixed methods approach was used to determine the effect of patient engagement on HbA1c. Using qualitative analysis data, regression models were developed to determine the predicted change in HbA1c for a patient based on the number and theme of messages sent over the 1-year study period. SAS 9.2 (SAS Institute Inc) was used to perform all statistical analyses. A P<.05 was considered statistically significant.


    There were 107 patients in this secondary analysis of MDIS. Among intervention participants, 76.6% (82/107) messaged at any time during the year (users), and 25 participants never messaged during the intervention year (nonusers). Males and females were equally represented. Although not statistically significant, participants who messaged (users) had more education, lower baseline HbA1c, and lower body mass indexes (BMIs) than nonusers (Table 1). Users were significantly older (53.5 [SD 7.5] years vs 49.6 [SD 8.9] years, P=.03) and more likely to be white (62.2% versus 37.8%, P=.02) compared to nonusers.

    Table 2 shows the 7 self-care behaviors for healthy living with diabetes as recommended by the AADE plus 2 additional messaging domains. Patients sent messages in an average of 4.3 behavior themes throughout the study. Among all participants, 76.6% (82/107) sent messages in at least 1 behavior theme, and each patient sent an average of 38.4 messages over the 1-year treatment period. Patient engagement was highest for glucose monitoring (75/107, 70.1%), medication (71/107, 66.4%), and reducing risks (71/107, 66.4%) themes and lowest for being active (44/107, 41.1%) and healthy coping (63/107, 58.9%). On average, most messages sent per patient were related to glucose monitoring (9.2, SD 14.0) and healthy eating (6.9, SD 13.2), while patients sent few messages about being active (2.2, SD 5.2) or healthy coping (4.4, SD 8.1).

    Table 1. Baseline characteristics.
    Baseline characteristicsUsers (n=82)Nonusers (n=25)P value
    Glycated hemoglobin A1c, n (%)

    		.78

    		7.5 to 8.9%42 (51.2)12 (48.0)

    		≥9.0%40 (48.8)13 (52.0)
    Age, years, mean (SD)53.5 (7.5)49.6 (8.9).03
    Sex

    		.28

    		Male43 (52.4)10 (40.0)

    		Female39 (47.6)15 (60.0)
    Race

    		.02

    		Nonwhite31 (37.8)16 (64.0)

    		White (non-Hispanic)51 (62.2)9 (36.0)
    Duration of diabetes, years, mean (SD)7.8 (5.4)7.6 (4.9)
    Education, n (%)

    		.36

    		High school or less24 (29.3)11 (44.0)

    		Some college or associates34 (41.5)9 (36.0)

    		Bachelor’s degree or higher24 (29.3)5 (20.0)
    Body mass index (kg/m2), mean (SD)35.7 (7.2)36.8 (9.9).61

    		Normal or underweight (16.5 to 24.9 kg/m2), n (%)2 (2.4)2 (8.0)

    		Pre-obese (25 to 29.9 kg/m2), n (%)18 (22.0)5 (20.0)

    		Obese class 1 (30 to 34.9 kg/m2), n (%)20 (24.4)5 (20.0)

    		Obese class 2 (35 to 39.9 kg/m2), n (%)20 (24.4)5 (20.0)

    		Obese class 3 (≥40 kg/m2), n (%)22 (26.8)8 (32.0)
    Table 2. Mobile communication messages by patient diabetes behaviors over 1-year treatment period.
    Messaging domainNumberAny messages sentMessages per patienta


    		% of total% of usersMean (SD)
    Domains




    		Healthy eating6762.681.76.9 (13.2)

    		Being active4441.153.72.2 (5.2)

    		Monitoring7570.191.59.2 (14.0)

    		Medication7166.486.66.1 (9.3)

    		Problem solving7065.485.45.0 (8.2)

    		Healthy coping6358.976.84.4 (8.1)

    		Reducing risks7166.486.64.5 (6.4)
    Any of above behaviors8276.6100.038.4 (60.6)
    Healthy eating, monitoring, medications6056.173.213.9 (20.7)

    aMean messages per patient is calculated for all patients in group, both those that did send messages in this theme and those that did not send messages in this theme.

    Table 3. Effect of domain messaging on hemoglobin A1c.
    Message domainSent no messages by domainSent messages by domainP value
    Healthy eating, n4067

    		Baseline, mean (SD)9.8 (2.1)9.4 (1.9)

    		12-month, mean (SD)8.2 (1.7)7.6 (1.3)

    		Change, mean (SD)–1.6 (2.2)–1.7 (1.7).10
    Being active, n6344

    		Baseline, mean (SD)9.7 (2.0)9.4 (2.0)

    		12-month, mean (SD)7.9 (1.6)7.7 (1.4)

    		Change, mean (SD)–1.7 (1.9)–1.7 (1.8).60
    Monitoring, n3275

    		Baseline, mean (SD)9.8 (2.2)9.5 (1.9)

    		12-month, mean (SD)8.3 (1.7)7.6 (1.4)

    		Change, mean (SD)–1.4 (2.2)–1.8 (1.7).03
    Medication, n3671

    		Baseline, mean (SD)9.8 (2.1)9.5 (1.9)

    		12-month, mean (SD)8.4 (1.6)7.6 (1.3)

    		Change, mean (SD)–1.4 (2.1)–1.9 (1.7).01
    Problem solving, n3770

    		Baseline, mean (SD)10.1 (2.2)9.3 (1.9)

    		12-month, mean (SD)8.3 (1.6)7.6 (1.4)

    		Change, mean (SD)–1.7 (2.3)–1.7 (1.6).12
    Healthy coping, n4463

    		Baseline, mean (SD)9.8 (2.1)9.4 (1.9)

    		12-month, mean (SD)8.1 (1.6)7.6 (1.4)

    		Change, mean (SD)–1.6 (2.1)–1.7 (1.7).21
    Reducing risks, n3671

    		Baseline, mean (SD)9.9 (2.2)9.4 (1.9)

    		12-month, mean (SD)8.2 (1.7)7.6 (1.4)

    		Change, mean (SD)–1.6 (2.2)–1.7 (1.7).12
    Message on any behavior, n2582

    		Baseline, mean (SD)9.8 (2.3)9.5 (1.9)

    		12-month, mean (SD)8.5 (1.8)7.6 (1.3)

    		Change, mean (SD)–1.2 (2.2)–1.8 (1.7).02

    Participants who sent messages about glucose monitoring (P=.03) or medication (P=.01) decreased their HbA1c significantly more than those who did not send messages related to those themes (Table 3). Individual theme regression models in Table 4 show that sending any messages lowered HbA1c 0.75 percentage points (95% CI 0.13 to 1.36, P=.02) compared to sending no messages. Likewise, sending any messages about glucose monitoring was associated with a decrease in HbA1c of 0.62 percentage points (95% CI 0.05 to 1.19, P=.03) and sending any messages about medication was associated with a decrease in HbA1c of 0.72 percentage points (95% CI 0.17 to 1.26, P=.01). Based on the top 3 significant themes presented in Table 4, the composite of healthy eating, glucose monitoring, and medication was also tested to determine its combined predictive power. Sending any messages about healthy eating, glucose monitoring, or medication combined significantly decreased HbA1c by 0.54 percentage points (95% CI 0.01 to 1.08, P=.02) compared to messages not including these themes (not shown in table).

    Table 4. Effect of domain messaging (both count and dichotomous) on hemoglobin A1c.
    Message domainMessage count (continuous)Any message sent (dichotomous)

    		Estimatea95% CIP valueEstimatea95% CIP value
    Healthy eating–0.005–0.025 to 0.015.62–0.469–1.020 to 0.083.10
    Being active–0.017–0.067 to 0.033.50–0.146–0.692 to 0.399.60
    Monitoring–0.010–0.029 to 0.010.32–0.624–1.193 to –0.054.03
    Medication–0.015–0.043 to 0.013.30–0.717–1.264 to –0.171.01
    Problem solving–0.014–0.047 to 0.019.40–0.452–1.018 to 0.115.12
    Healthy coping–0.020–0.053 to 0.014.25–0.344–0.886 to 0.198.21
    Reducing risks–0.025–0.070 to 0.019.26–0.445–1.010 to 0.120.12
    Any message–0.002–0.007 to 0.002.35–0.748–1.363 to –0.132.02

    aPoint estimates are per message.


    Principal Findings

    Among adults with type 2 diabetes, engagement in the portal messaging system of the MDIS was associated with an absolute decrease in HbA1c of 0.75 percentage points. A 0.5 to 1.0 percentage point change in HbA1c is considered clinically significant to reduce risk of comorbid conditions [37,38]; the US Food and Drug Administration requires a 0.4 percentage point change in HbA1c for drug evaluations [39]. Although any sending of messages was related to a reduction in HbA1c, glucose monitoring and medication use themes were also associated with decreases in HbA1c. Patients sent the most messages on glucose monitoring, medication use, and reducing complication risks themes. The average number of messages sent per patient was highest for glucose monitoring, medication use, and healthy eating themes.

    Self-Care Behaviors and Hemoglobin A1c

    The AADE and the ADA provide patients, researchers, and clinicians with current self-care and lifestyle behavior guidelines for the management of diabetes and the prevention of its complications [35,36]. These guidelines, developed from the findings of the UK Prospective Diabetes Study [40], supply individuals with type 2 diabetes the knowledge needed to better understand their disease. Physicians in this study were given current ADA patient care guidelines but were not explicitly told to use them to care for study patients. Our findings support other studies that have shown the benefits of lifestyle interventions on diabetes outcomes [41-45]. In particular, digital health interventions targeting behavior change have shown lower HbA1c levels, lower random [43] and postprandial [44] plasma glucose levels, and lower body weight [43] as well as improved self-efficacy [45].

    Among the behavior themes measured, most messages contained either monitoring, healthy eating, or medication themes. Since messages sent regarding the medication and glucose monitoring themes also significantly decreased HbA1c, patients may need more education surrounding medication use and monitoring blood glucose to ensure HbA1c goals can be achieved effectively on their own.

    Patient Engagement

    Previous studies that assessed patient engagement in telemedicine and digital health interventions showed that race, age, and health literacy all play significant roles in patient participation [46-48]. Racial minorities, older patients, and patients with low health literacy showed the least engagement in telemedicine and digital health interventions [46,48]. In a 3-month mobile health intervention involving adults with type 2 diabetes, Nelson and colleagues [47] found that those who were younger or were diagnosed with type 2 diabetes closer to the start of the intervention displayed higher engagement activities and had more favorable experiences than older individuals or those with a longer diabetes duration. Our results are consistent with others, showing that nonwhite patients were less likely to send messages to assigned CDEs. Likewise, among participants who did not use the messaging portal, most had a high school education or less, perhaps also indicating a lower health literacy rate. However, unlike previous studies, we observed that users of the messaging portal tended to be older than nonusers. This suggests that older age does not imply disengagement from mobile health technology [49-51]. In fact, in a study evaluating the self-efficacy and use of a mobile health diabetes intervention among older adults, we previously concluded that participants experienced high self-efficacy in making changes to manage their diabetes and demonstrated their ability to use the intervention and communicate with educators [52]. We recommend including older adults and nonwhite individuals in mobile technology development with specific aims to evaluate improving patient engagement.

    Other studies concluded that patients’ high engagement in digital health interventions was related to feedback received from physicians or assigned caregivers. From this feedback, patients felt more motivated and were able to attain higher self-efficacy [53,54]. Patients in this study who elected to send messages regarding any self-care behavior reported significant decreases in HbA1c. Although the influence of CDE messages on patients’ outcomes was not examined, knowing a diabetes educator was available may have improved patient confidence and encouraged them to participate.

    Mixed-Methods Approach to Analysis

    We believe that patient engagement in an intervention cannot be determined simply by a quantitative value but must also include qualitative data that demonstrates the effectiveness of the intervention from the participants’ perspectives. To accurately interpret the extensive data collected from digital health studies, it is important to include a qualitative component [55], as information on individual experience influences the effectiveness of the intervention. We used a mixed-methods approach to evaluate patient engagement data for participants in MDIS. We identified coding themes reflecting patient messages sent to CDEs and analyzed these themes against changes in patient HbA1c values. Results of this study reinforce findings from previous mobile health investigations that use a mixed-methods approach to examine data, collecting self-care behavior and self-efficacy data to measure outcomes [47,56,57]. These studies add valuable knowledge about the usability of digital health applications for the management of diabetes and reveal areas lacking in development that, if revised, could enhance patient user experience and improve diabetes outcomes. This secondary analysis of the MDIS affirms that it is not enough to simply give patients information about diabetes; patients must also be given actionable items that drive behavior change.

    Strengths, Limitations, and Future Directions

    The secondary data analysis is, to our knowledge, the first of its kind. Few previous studies have used a mixed-methods approach to evaluate patient engagement. While prior interventions included a patient messaging component [48] or analysis of self-management behaviors [58], none performed a qualitative evaluation of patient messages that was then used to create models predicting the impact on patient clinical outcomes. Furthermore, previous studies show that although participants preferred to use mobile health applications for diabetes management, currently available apps do not offer functions that would allow proper disease monitoring and management [59,60]. Results of this analysis may help pinpoint behavioral features that could improve existing mobile health technologies and satisfy the lack in functionality.

    There are a few limitations of this secondary analysis. One is that although the models give a statistically significant prediction of change in HbA1c based on certain message themes, it cannot be definitively stated that this is a direct result of solely the message content. It is important to consider the other aspects of the intervention, such as tracking data, accessing the learning library, or receiving directed care from their primary care physicians as also potentially influencing the patient’s outcome. Also, engagement was not randomized, so there is potential for confounding.

    It is also important to note that based on the structure of the program, some patients engaged in external email and phone messages with the CDEs that are not in the portal message records; without knowing the content of these messages, it is impossible to get a complete picture of patient engagement over the year of the study. Furthermore, the role that messages from the diabetes educators play in patient outcome is unknown. While a future analysis may explore the impact of CDEs on patient outcomes, this analysis cannot account for the influence of the content of those messages on patient engagement or overall patient outcomes.

    Since each message was analyzed and coded individually, we did not account for message threads. A conversation spanning several messages could have been counted each time the patient mentions the subject when really it is all part of the same conversation on the subject. Our analysis of dichotomies may be based on more tenable assumptions than the analysis per message.

    Conclusion

    In this study, messages sent in the combined healthy eating, monitoring, and medication themes or monitoring and medication themes separately significantly improved HbA1c over the study period. Our results provide insight into the importance of health provider feedback and essential self-care behaviors that require greater emphasis when developing mobile health technologies for diabetes populations.

    Acknowledgments

    This research project was funded through a contract between the University of Maryland, Baltimore, and WellDoc in addition to contributions by CareFirst Blue Cross/Blue Shield of Maryland, LifeScan, and Sprint. Additional funding was provided by the Maryland Industrial Partnerships program through the University of Maryland, an initiative of the A James Clark School of Engineering’s Maryland Technology Enterprise Institute. No other potential conflicts of interest relevant to this article were reported.

    The funders of this study did not play a role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; or in the preparation of the manuscript. WellDoc did not have veto power over or have say about changing any manuscript text other than the description of the software coaching system they provided. Dr Ram Miller served as the data and safety monitoring board.

    Authors' Contributions

    CCQ was principal investigator for these studies. CCQ, EB, KKS, MDS, MLT, and ALG-B were responsible for the design, data analyses, writing, and review of the manuscript. EB and CQ were responsible for the qualitative message data coding. EAB was responsible for the data analyses and manuscript review. KKS contributed to the writing and review of the manuscript.

    Conflicts of Interest

    None declared.

    1. American Diabetes Association. Standards of medical care in diabetes—2014. Diabetes Care 2014 Jan;37 Suppl 1:S14-S80. [CrossRef] [Medline]
    2. Parchman ML, Romero RL, Pugh JA. Encounters by patients with type 2 diabetes—complex and demanding: an observational study. Ann Fam Med 2006;4(1):40-45 [FREE Full text] [CrossRef] [Medline]
    3. Orzano AJ, Strickland P, Tallia F, Hudson S, Balasubramanian B, Nutting PA, et al. Improving outcomes for high-risk diabetics using information systems. J Am Board Fam Med 2007;20(3):245-251 [FREE Full text] [CrossRef] [Medline]
    4. Kramer MK, McWilliams JR, Chen H, Siminerio LM. A community-based diabetes prevention program: evaluation of the group lifestyle balance program delivered by diabetes educators. Diabetes Educ 2011;37(5):659-668. [CrossRef] [Medline]
    5. Hartz A, Kent S, James P, Xu Y, Kelly M, Daly J. Factors that influence improvement for patients with poorly controlled type 2 diabetes. Diabetes Res Clin Pract 2006 Dec;74(3):227-232. [CrossRef] [Medline]
    6. Ahola AJ, Groop P. Barriers to self-management of diabetes. Diabet Med 2013 Apr;30(4):413-420. [CrossRef] [Medline]
    7. Diabetes Prevention Program Research Group, Crandall J, Schade D, Ma Y, Fujimoto WY, Barrett-Connor E, et al. The influence of age on the effects of lifestyle modification and metformin in prevention of diabetes. J Gerontol A Biol Sci Med Sci 2006 Oct;61(10):1075-1081 [FREE Full text] [Medline]
    8. Jones H, Edwards L, Vallis TM, Ruggiero L, Rossi SR, Rossi JS, Diabetes Stages of Change (DiSC) Study. Changes in diabetes self-care behaviors make a difference in glycemic control: the Diabetes Stages of Change (DiSC) study. Diabetes Care 2003 Mar;26(3):732-737. [Medline]
    9. Knowler WC, Barrett-Connor E, Fowler SE, Hamman RF, Lachin JM, Walker EA, et al. Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin. N Engl J Med 2002 Feb 7;346(6):393-403 [FREE Full text] [CrossRef] [Medline]
    10. Choy M, Richman M. Standards of medical care in diabetes: focus on updated recommendations in hospitalized patients. Formulary 2013;48(6):189-191.
    11. Jenny-Avital ER. Intensive glucose control in type 2 diabetes. N Engl J Med 2008 Oct 02;359(14):1519-1521. [CrossRef] [Medline]
    12. Havas S. The ACCORD Trial and control of blood glucose level in type 2 diabetes mellitus: time to challenge conventional wisdom. Arch Intern Med 2009 Jan 26;169(2):150-154. [CrossRef] [Medline]
    13. Mohr DC, Schueller SM, Montague E, Burns MN, Rashidi P. The behavioral intervention technology model: an integrated conceptual and technological framework for eHealth and mHealth interventions. J Med Internet Res 2014;16(6):e146 [FREE Full text] [CrossRef] [Medline]
    14. Istepanian RSH, Zitouni K, Harry D, Moutosammy N, Sungoor A, Tang B, et al. Evaluation of a mobile phone telemonitoring system for glycaemic control in patients with diabetes. J Telemed Telecare 2009;15(3):125-128. [CrossRef] [Medline]
    15. Franc S, Daoudi A, Mounier S, Boucherie B, Dardari D, Laroye H, et al. Telemedicine and diabetes: achievements and prospects. Diabetes Metab 2011 Dec;37(6):463-476. [CrossRef] [Medline]
    16. Cho J, Lee H, Lim D, Kwon H, Yoon K. Mobile communication using a mobile phone with a glucometer for glucose control in Type 2 patients with diabetes: as effective as an Internet-based glucose monitoring system. J Telemed Telecare 2009;15(2):77-82. [CrossRef] [Medline]
    17. Travasso C. Lifestyle advice by text messages helps prevent type 2 diabetes in high risk men. BMJ 2013 Sep 23;347:f5750. [Medline]
    18. McMahon GT, Gomes HE, Hickson HS, Hu TM, Levine BA, Conlin PR. Web-based care management in patients with poorly controlled diabetes. Diabetes Care 2005 Jul;28(7):1624-1629 [FREE Full text] [Medline]
    19. Yoon K, Kim H. A short message service by cellular phone in type 2 diabetic patients for 12 months. Diabetes Res Clin Pract 2008 Feb;79(2):256-261. [CrossRef] [Medline]
    20. Nes AAG, Eide H, Kristjánsdóttir B, van Dulmen S. Web-based, self-management enhancing interventions with e-diaries and personalized feedback for persons with chronic illness: a tale of three studies. Patient Educ Couns 2013 Dec;93(3):451-458 [FREE Full text] [CrossRef] [Medline]
    21. Lorig K, Ritter PL, Laurent DD, Plant K, Green M, Jernigan VBB, et al. Online diabetes self-management program: a randomized study. Diabetes Care 2010 Jun;33(6):1275-1281 [FREE Full text] [CrossRef] [Medline]
    22. Anton SD, LeBlanc E, Allen HR, Karabetian C, Sacks F, Bray G, et al. Use of a computerized tracking system to monitor and provide feedback on dietary goals for calorie-restricted diets: the POUNDS LOST study. J Diabetes Sci Technol 2012 Sep;6(5):1216-1225 [FREE Full text] [Medline]
    23. Mayes PA, Silvers A, Prendergast JJ. New direction for enhancing quality in diabetes care: utilizing telecommunications and paraprofessional outreach workers backed by an expert medical team. Telemed J E Health 2010 Apr;16(3):358-363 [FREE Full text] [CrossRef] [Medline]
    24. Greenwood DA, Gee PM, Fatkin KJ, Peeples M. A systematic review of reviews evaluating technology-enabled diabetes self-management education and support. J Diabetes Sci Technol 2017 Sep;11(5):1015-1027. [CrossRef] [Medline]
    25. Cotter AP, Durant N, Agne AA, Cherrington AL. Internet interventions to support lifestyle modification for diabetes management: a systematic review of the evidence. J Diabetes Complications 2014;28(2):243-251 [FREE Full text] [CrossRef] [Medline]
    26. El-Gayar O, Timsina P, Nawar N, Eid W. A systematic review of IT for diabetes self-management: are we there yet? Int J Med Inform 2013 Aug;82(8):637-652. [CrossRef] [Medline]
    27. Årsand E, Frøisland DH, Skrøvseth SO, Chomutare T, Tatara N, Hartvigsen G, et al. Mobile health applications to assist patients with diabetes: lessons learned and design implications. J Diabetes Sci Technol 2012 Sep;6(5):1197-1206 [FREE Full text] [Medline]
    28. Baron J, McBain H, Newman S. The impact of mobile monitoring technologies on glycosylated hemoglobin in diabetes: a systematic review. J Diabetes Sci Technol 2012 Sep;6(5):1185-1196 [FREE Full text] [Medline]
    29. Fitzner K, Moss G. Telehealth—an effective delivery method for diabetes self-management education? Popul Health Manag 2013 Jun;16(3):169-177. [CrossRef] [Medline]
    30. Liang X, Wang Q, Yang X, Cao J, Chen J, Mo X, et al. Effect of mobile phone intervention for diabetes on glycaemic control: a meta-analysis. Diabet Med 2011 Apr;28(4):455-463. [CrossRef] [Medline]
    31. Nijland N, van Gemert-Pijnen JEWC, Kelders SM, Brandenburg BJ, Seydel ER. Factors influencing the use of a Web-based application for supporting the self-care of patients with type 2 diabetes: a longitudinal study. J Med Internet Res 2011;13(3):e71 [FREE Full text] [CrossRef] [Medline]
    32. Chomutare T, Fernandez-Luque L, Arsand E, Hartvigsen G. Features of mobile diabetes applications: review of the literature and analysis of current applications compared against evidence-based guidelines. J Med Internet Res 2011;13(3):e65 [FREE Full text] [CrossRef] [Medline]
    33. Quinn CC, Shardell MD, Terrin ML, Barr EA, Ballew SH, Gruber-Baldini AL. Cluster-randomized trial of a mobile phone personalized behavioral intervention for blood glucose control. Diabetes Care 2011 Sep;34(9):1934-1942 [FREE Full text] [CrossRef] [Medline]
    34. Corbin J, Strauss A. Grounded theory research: procedures, canons and evaluative criteria. Zeitschrift für Soziologie 1990 Dec;19(6):418-427 [FREE Full text]
    35. AADE7 Self-Care Behaviors.: American Association of Diabetes Educators; 2017.   URL: https://www.diabeteseducator.org/patient-resources/aade7-self-care-behaviors [WebCite Cache]
    36. American Diabetes Association. Position Statements. Diabetes Care 2017;40(Supplement 1):S6-S129.
    37. United Kingdom Prospective Diabetes Study Group. United Kingdom Prospective Diabetes Study 24: a 6-year, randomized, controlled trial comparing sulfonylurea, insulin, and metformin therapy in patients with newly diagnosed type 2 diabetes that could not be controlled with diet therapy. Ann Intern Med 1998 Feb 01;128(3):165-175. [Medline]
    38. Klonoff DC, Blonde L, Cembrowski G, Chacra AR, Charpentier G, Colagiuri S, et al. Consensus report: the current role of self-monitoring of blood glucose in non-insulin-treated type 2 diabetes. J Diabetes Sci Technol 2011 Nov;5(6):1529-1548 [FREE Full text] [Medline]
    39. Guidance for Industry—diabetes mellitus: developing drugs and therapeutic biologics for treatment and prevention.: U.S. Department of Health and Human Services, Food and Drug Administration: Center for Drug Evaluation and Research; 2017 Jan 22.   URL: https://www.fda.gov/downloads/Drugs/.../Guidances/ucm071624.pdf [WebCite Cache]
    40. UK Prospective Diabetes Study Group. Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33). Lancet 1998 Sep 12;352(9131):837-853. [Medline]
    41. Garcia JM, Cox D, Rice DJ. Association of physiological and psychological health outcomes with physical activity and sedentary behavior in adults with type 2 diabetes. BMJ Open Diabetes Res Care 2017;5(1):e000306 [FREE Full text] [CrossRef] [Medline]
    42. Sbroma TE, Pippi R, Reginato E, Aiello C, Buratta L, Mazzeschi C, et al. Intensive lifestyle intervention is particularly advantageous in poorly controlled type 2 diabetes. Nutr Metab Cardiovasc Dis 2017 Aug;27(8):688-694. [CrossRef] [Medline]
    43. Jackson SL, Staimez LR, Safo S, Long Q, Rhee MK, Cunningham SA, et al. Participation in a National Lifestyle Change Program is associated with improved diabetes control outcomes. J Diabetes Complications 2017 Sep;31(9):1430-1436. [CrossRef] [Medline]
    44. Wang G, Zhang Z, Feng Y, Sun L, Xiao X, Wang G, et al. Telemedicine in the management of type 2 diabetes mellitus. Am J Med Sci 2017 Jan;353(1):1-5. [CrossRef] [Medline]
    45. Torbjørnsen A, Jenum AK, Småstuen MC, Arsand E, Holmen H, Wahl AK, et al. A low-intensity mobile health intervention with and without health counseling for persons with type 2 diabetes, part 1: baseline and short-term results from a randomized controlled trial in the Norwegian part of RENEWING HEALTH. JMIR Mhealth Uhealth 2014;2(4):e52 [FREE Full text] [CrossRef] [Medline]
    46. Nelson LA, Mulvaney SA, Gebretsadik T, Ho Y, Johnson KB, Osborn CY. Disparities in the use of a mHealth medication adherence promotion intervention for low-income adults with type 2 diabetes. J Am Med Inform Assoc 2016 Jan;23(1):12-18 [FREE Full text] [CrossRef] [Medline]
    47. Nelson LA, Mulvaney SA, Johnson KB, Osborn CY. mHealth intervention elements and user characteristics determine utility: a mixed-methods analysis. Diabetes Technol Ther 2017 Jan;19(1):9-17. [CrossRef] [Medline]
    48. Nelson LA, Coston TD, Cherrington AL, Osborn CY. Patterns of user engagement with mobile- and Web-delivered self-care interventions for adults with T2DM: a review of the literature. Curr Diab Rep 2016 Dec;16(7):66 [FREE Full text] [CrossRef] [Medline]
    49. Parker SJ, Jessel S, Richardson JE, Reid MC. Older adults are mobile too! Identifying the barriers and facilitators to older adults' use of mHealth for pain management. BMC Geriatr 2013;13:43 [FREE Full text] [CrossRef] [Medline]
    50. Tennant B, Stellefson M, Dodd V, Chaney B, Chaney D, Paige S, et al. eHealth literacy and Web 2.0 health information seeking behaviors among baby boomers and older adults. J Med Internet Res 2015 Mar;17(3):e70 [FREE Full text] [CrossRef] [Medline]
    51. Mobile Fact Sheet. Washington: Pew Internet and American Life Project   URL: http://www.pewinternet.org/fact-sheet/mobile/ [accessed 2017-01-22] [WebCite Cache]
    52. Quinn CC, Khokhar B, Weed K, Barr E, Gruber-Baldini AL. Older adult self-efficacy study of mobile phone diabetes management. Diabetes Technol Ther 2015 Jul;17(7):455-461 [FREE Full text] [CrossRef] [Medline]
    53. Graffigna G, Barello S, Bonanomi A, Menichetti J. The motivating function of healthcare professional in eHealth and mHealth interventions for type 2 diabetes patients and the mediating role of patient engagement. J Diabetes Res 2016;2016:2974521 [FREE Full text] [CrossRef] [Medline]
    54. Piette JD, Marinec N, Janda K, Morgan E, Schantz K, Yujra ACA, et al. Structured caregiver feedback enhances engagement and impact of mobile health support: a randomized trial in a lower-middle-income country. Telemed J E Health 2016 Apr;22(4):261-268 [FREE Full text] [CrossRef] [Medline]
    55. Sahin C, Naylor P. Mixed-methods research in diabetes management via mobile health technologies: a scoping review. JMIR Diabetes 2017 Feb 06;2(1):e3. [CrossRef]
    56. Baron JS, Hirani SP, Newman SP. Investigating the behavioural effects of a mobile-phone based home telehealth intervention in people with insulin-requiring diabetes: results of a randomized controlled trial with patient interviews. J Telemed Telecare 2016 Jul 03;23(5):503-512. [CrossRef] [Medline]
    57. Nundy S, Mishra A, Hogan P, Lee SM, Solomon MC, Peek ME. How do mobile phone diabetes programs drive behavior change? Evidence from a mixed methods observational cohort study. Diabetes Educ 2014;40(6):806-819 [FREE Full text] [CrossRef] [Medline]
    58. Chen L, Chuang L, Chang C, Wang C, Wang I, Chung Y, et al. Evaluating self-management behaviors of diabetic patients in a telehealthcare program: longitudinal study over 18 months. J Med Internet Res 2013;15(12):e266 [FREE Full text] [CrossRef] [Medline]
    59. Chavez S, Fedele D, Guo Y, Bernier A, Smith M, Warnick J, et al. Mobile apps for the management of diabetes. Diabetes Care 2017 Oct;40(10):e145-e146. [CrossRef] [Medline]
    60. Conway N, Campbell I, Forbes P, Cunningham S, Wake D. mHealth applications for diabetes: user preference and implications for app development. Health Informatics J 2016 Dec;22(4):1111-1120. [CrossRef] [Medline]

    ‎
    AADE: American Association of Diabetes Educators
    ACCORD: Action to Control Cardiovascular Risk in Diabetes
    ADA: American Diabetes Association
    BMI: body mass index
    CDE: certified diabetes educator
    DSME: diabetes self-management education
    HbA1c: glycated hemoglobin A1c
    MDIS: Mobile Diabetes Intervention Study

    Edited by G Eysenbach; submitted 25.10.17; peer-reviewed by D Greenwood, O El-Gayar; comments to author 22.11.17; revised version received 04.12.17; accepted 05.12.17; published 02.02.18

    Copyright

    ©Charlene Connolly Quinn, Erin C Butler, Krystal K Swasey, Michelle D Shardell, Michael D Terrin, Erik A Barr, Ann L Gruber-Baldini. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 02.02.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.