Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 08.07.20 in Vol 8, No 7 (2020): July

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/16925, first published Nov 05, 2019.

This paper is in the following e-collection/theme issue:

    Original Paper

    Mobile Health Apps in Pediatric Obesity Treatment: Process Outcomes From a Feasibility Study of a Multicomponent Intervention

    1School Public Health, Physiotherapy & Sports Science, University College Dublin, Dublin, Ireland

    2Insight Centre for Data Analytics, School of Computer Science, University College Dublin, Dublin, Ireland

    3School of Sociology, University College Dublin, Dublin, Ireland

    4Division of Population Health Sciences, School of Physiotherapy, Royal College of Surgeons in Ireland, Dublin, Ireland

    5UCD Michael Smurfit Graduate Business School, University College Dublin, Dublin, Ireland

    6W82GO Child and Adolescent Weight Management Service, Children's Health Ireland at Temple Street, Dublin, Ireland

    *these authors contributed equally

    Corresponding Author:

    Grace O'Malley, BSc, PhD

    Division of Population Health Sciences

    School of Physiotherapy

    Royal College of Surgeons in Ireland

    Beaux Lane House

    Dublin, D02 YN77

    Ireland

    Phone: 353 014028591

    Email: graceomalley@rcsi.ie


    ABSTRACT

    Background: Multicomponent family interventions underline current best practice in childhood obesity treatment. Mobile health (mHealth) adjuncts that address eating and physical activity behaviors have shown promise in clinical studies.

    Objective: This study aimed to describe process methods for applying an mHealth intervention to reduce the rate of eating and monitor physical activity among children with obesity.

    Methods: The study protocol was designed to incorporate 2 mHealth apps as an adjunct to usual care treatment for obesity. Children and adolescents (aged 9-16 years) with obesity (BMI ≥98th centile) were recruited in person from a weight management service at a tertiary health care center in the Republic of Ireland. Eligible participants and their parents received information leaflets, and informed consent and assent were signed. Participants completed 2 weeks of baseline testing, including behavioral and quality of life questionnaires, anthropometry, rate of eating by Mandolean, and physical activity level using a smart watch and the myBigO smartphone app. Thereafter, participants were randomized to the (1) intervention (usual clinical care+Mandolean training to reduce the rate of eating) or (2) control (usual clinical care) groups. Gender and age group (9.0-12.9 years and 13.0-16.9 years) stratifications were applied. At the end of a 4-week treatment period, participants repeated the 2-week testing period. Process evaluation measures included recruitment, study retention, fidelity parameters, acceptability, and user satisfaction.

    Results: A total of 20 participants were enrolled in the study. A web-based randomization system assigned 8 participants to the intervention group and 12 participants to the control group. Attrition rates were higher among the participants in the intervention group (5/8, 63%) than those in the control group (3/12, 25%). Intervention participants undertook a median of 1.0 training meal using Mandolean (25th centile 0, 75th centile 9.3), which represented 19.2% of planned intervention exposure. Only 50% (9/18) of participants with smart watches logged physical activity data. Significant differences in psychosocial profile were observed at baseline between the groups. The Child Behavior Checklist (CBCL) mean total score was 71.7 (SD 3.1) in the intervention group vs 57.6 (SD 6.6) in the control group, t-test P<.001, and also different among those who completed the planned protocol compared with those who withdrew early (CBCL mean total score 59.0, SD 9.3, vs 67.9, SD 5.6, respectively; t-test P=.04).

    Conclusions: A high early attrition rate was a key barrier to full study implementation. Perceived task burden in combination with behavioral issues may have contributed to attrition. Low exposure to the experimental intervention was explained by poor acceptability of Mandolean as a home-based tool for treatment. Self-monitoring using myBigO and the smartwatch was acceptable among this cohort. Further technical and usability studies are needed to improve adherence in our patient group in the tertiary setting.

    JMIR Mhealth Uhealth 2020;8(7):e16925

    doi:10.2196/16925

    KEYWORDS



    Introduction

    Background

    Global prevalence rates of childhood obesity were estimated at 7.8% for boys and 5.6% for girls in 2016, and prevalence is increasing in low-income countries and communities [1]. Interventions in childhood are critical, as children with obesity experience a range of physical and psychosocial health issues and are at a high risk of developing chronic disease in adulthood [2]. Diet, physical activity, and other behavioral interventions can be effective in terms of change in adiposity, and significant clinically relevant metabolic benefits have been demonstrated with a 0.25 reduction in BMI z-score [3], although meaningful reductions in cardiometabolic markers are observed with reductions of 0.15 [4,5]. Recent Cochrane meta-analyses of behavior change interventions reported 12-month reductions in BMI z-score of −0.06 units among children aged 6 to 11 years [6] and −0.13 units (95% CI −0.21 to −0.05) in adolescents aged 12 to 17 years [7].

    There is growing evidence that eating behaviors, not simply driven by food choice, influence energy consumption, appetite, and satiety. Fast eating is associated with high body weight [8], and interventions to reduce the eating rate seem to enhance weight loss [9]. Eating food quickly may contribute to blunted responses to normal satiety signals, whereby an individual does not respond to gastric distension and gut peptide release, so that normal appetite suppression pathways do not function as expected during fast eating occasions [10,11]. A reduction in the eating rate aimed at reducing portion size and normalizing satiety signaling has been recently studied [10-16]. A study of adolescents aged 9 to 17 years found that an eating rate intervention enhanced weight loss at 12 months compared with usual care (change in BMI z-score of −0.27) [16]. Slowing eating rate can also reduce self-selected portion size with no reduction in postmeal satiety levels among children and teenagers [10,13,16]. A recent review appraised a number of commercial apps targeting appetite regulation [17]. Research-driven interventions include real-time technology-assisted tools for meal times, including utensils with vibrotactile feedback [12,14] and Mandolean, a plate scale measuring eating rate with real-time computer or smartphone feedback [13,15,16]. Mandolean has shown promise for the treatment of childhood obesity [16].

    Physical activity in combination with dietary behavior change, rather than either in isolation, is the recommended component of interventions for childhood obesity [6,7,18]. The use of wearable accelerometers to measure physical activity is the accepted objective means of measurement in free-living individuals [19], which can be used to determine energy expenditure and requirements [20], and the time spent in high-intensity physical activity determines variation in childhood cardiometabolic risk factors [21]. One of the advantages of mobile health (mHealth) interventions compared with traditional approaches is that data from monitoring tools and participant engagement are provided objectively.

    Despite improved technologies and access to mHealth tools for the purpose of monitoring health status and implementing interventions for health behavior change [22,23], challenges with adherence and exposure remain [24,25]. Planned exposure, impact, and potential outcomes are altered by participants’ interaction with study tools and technology [13,15,24]. The importance of content, design, and testing periods with the target group has been emphasized as a means of enhancing engagement with mHealth apps [24,25]. Reporting process measures is increasingly important, as they contribute to moving the field forward and providing translational accuracy in research and practice [26].

    Interventions that improve and expand treatment options for children with obesity are important because of challenges within traditional clinical care, including available time and resources that impact access for service users. mHealth tools provide adjunctive options to standard treatment approaches and can be beneficial for patients at home and their clinical team. However, engagement with devices and apps can act as a barrier to treatment [13,15,22].

    Objective

    The aim of this study was to determine the feasibility and acceptability of an intervention using 2 mHealth apps among children in the treatment for obesity in a tertiary outpatient setting. As diet and physical activity interventions are typically undertaken together, it was of interest to assess the acceptability of Mandolean in addition to a physical activity monitoring tool.


    Methods

    Study Design

    This study was conducted to determine the feasibility and acceptability of a proposed mHealth intervention. The study was not registered as a trial; however, a randomized design was implemented to ascertain protocol feasibility for a proposed randomized controlled trial. We evaluated the process of using 2 mHealth smartphone apps among children and adolescents receiving treatment for obesity. Feasibility measures included recruitment rates and procedures, and retention rates. Fidelity encompassed intervention delivery and adherence to randomization and study procedures. Retrospective acceptability included objective measures (engagement with smartphone apps) and self-reported measures (system usability score surveys and verbal feedback).

    Participants

    Children and adolescents (aged 9-16 years), with a diagnosis of clinical obesity (BMI >98th percentile for age and sex), referred to the W82GO Child and Adolescent Obesity Service at Children’s Health Ireland at Temple Street, Dublin, Ireland, were eligible to participate. Socioeconomic status was indicated by the Pobal HP Deprivation Index for Small Areas [27]. Children and adolescents were required to have access to a smartphone (phones with Android operating system version 6.0 or above were compatible with the smartwatch and myBigO at version 0 when used in the feasibility study and both Android and iOS were compatible with Mandolean, which did not undergo further development during the study). Smartphone literacy was assumed, and training was provided on study apps by a researcher at baseline who established competency in study tasks. Exclusion criteria included moderate or severe learning difficulties that would prevent the use of smartphone apps or giving informed assent, the child having a concurrent serious medical issue, if the parent or child was not proficient in understanding English, refusal by the child to give assent or parents/legal guardians to give informed consent to participate in the project, or if the child lived in Direct Provision (the system of asylum seeker accommodation used in the Republic of Ireland). Pregnancy and the use of medications known to affect weight also precluded participation.

    Study Procedures

    Health professionals working within the obesity service informed eligible participants about the study and provided a patient information leaflet to parent(s)/legal guardian(s) and their child. After 3 to 7 days, a researcher contacted the parent/guardian by phone to answer questions and check whether they wished to participate. Once written informed consent and child assent were received, a study appointment was offered for baseline assessment. A single dietetic researcher (SB) implemented the study protocol, coordinating, and providing communication. All participants met a researcher for scheduled face-to-face and phone communication and were also invited to call or email the researcher outside scheduled reviews. Study contacts at each time point (T), modality, and actions/measures for each contact are detailed later. At baseline, the researcher guided participants through a practice meal of their choice (brought to the hospital by participants) using Mandolean (Multimedia Appendix 1 shows a more detailed protocol). When participants completed a meal using Mandolean, data were available to the research team via a dedicated web-based clinical portal (Mandobase).

    At present, the Big Data Against Childhood Obesity (BigO) project is testing the myBigO app and clinical portal [28]. The app aims to gather behavioral data alongside measures of environmental conditions (eg, urban built environment, infrastructure for physical activity, food marketing) among young people in general and an age-matched clinical cohort with obesity. Aggregation mechanisms are being developed to correlate population behaviors with environmental characteristics for the purpose of highlighting priority public health interventions [29].

    All participants registered with the myBigO app and were set up with their smartwatch at baseline and postintervention. The default method of data synchronizing between the smartwatch and myBigO on the smartphone was a wireless internet connection (to avoid potential expense by using participants’ personal mobile data). To ensure that the BigO system received regular accelerometer data, participants and their parent(s) were shown how to check the Bluetooth and internet connection between the smartwatch and phone, and they were asked to repeat this process every evening. For consistency, standard verbal, practical, and written instructions to take home were provided to participants and their caregivers (Multimedia Appendix 2). When participants completed a meal using Mandolean and wore the smartwatch, the data were available to the research team via web-based clinical portals (Mandobase and BigO clinical portal; see Multimedia Appendix 3 for detail of baseline and postintervention measures).

    Usual Clinical Care

    The W82GO Child and Adolescent Weight Management Service is a multidisciplinary obesity service that delivers efficacious obesity interventions [30]. Children and adolescents aged ≤16 years with a BMI >98th percentile are referred to the service by hospital physicians based at Children’s Health Ireland at Temple Street. On referral, children and their caregivers are invited to a multidisciplinary clinic and undergo assessment by a pediatric dietitian, a pediatric physiotherapist, and a pediatric psychologist. On the basis of the needs of the child and family, a treatment plan is developed, and patients are offered either group-based treatment or treatment delivered in a 1:1, more traditional outpatient setting. Treatment is family based and was developed using contemporary scientific evidence [30]. Participants allocated to the usual care arm completed baseline testing, followed by 4 weeks of usual clinical care and subsequent retesting (Figure 1).

    Figure 1. Flowchart of study protocol for a mobile health randomized feasibility study for an eating behavior intervention with children (aged 9.0-16.9 years) in the treatment of obesity in a tertiary health care setting. Baseline and postintervention measures include anthropometry, questionnaires (Child Behavior Checklist, Pediatric Quality of Life, Piers-Harris, Dutch Eating Behavior Questionnaire, and, at study end, evaluation questionnaires and System Usability Scale [31]), rate of eating using Mandolean, and physical activity levels with the smartwatch and myBigO app.
    View this figure
    Intervention

    Mandolean was developed by the Section of Applied Neuroendocrinology, Karolinska Institute, and Mando Group AB, Stockholm, Sweden. It consists of a plate scale that is wirelessly connected to a smartphone app with 2 main functions: (1) measures the rate of eating and (2) provides the user with visual feedback on slowing the rate of eating. The intervention arm involved usual care with additional training to reduce the rate of eating using Mandolean. Following randomization, the participants assigned to the intervention group received additional instruction on using the training functions of Mandolean for at least one meal per day (lunch, dinner, or both) over 4 weeks (minimum planned dose exposure: 28 meals). Using Mandolean training functions, the patient learns to adopt a typical pattern of eating and satiety by following the displayed ideal rate of eating, which they aim to match. The clinician used baseline data (usual portions sizes and rate of eating) to guide a training meal program for the user. The training aims to teach the patient to eat 280 to 350 g in 13 to 15 min and to perceive a level of satiety of moderately full by the end of the meal. A full description of the Mandolean training procedures is included in Multimedia Appendix 1. The use of Mandolean in this study integrated a number of behavior change components, categorized according to the behavior change technique taxonomy by Michie et al [32], including goals and planning, feedback and monitoring, social support, shaping knowledge, comparison of behavior, repetition and substitutions, and antecedents (Multimedia Appendix 4 gives the subtechniques used).

    Sample Size

    A sample size of 20 participants was the target, which was considered sufficient to evaluate the process measures in this randomized feasibility study and is in line with similar studies [10,13].

    Randomization

    Using a web-based randomization service (Sealed Envelope), participants were randomized to Mandolean eating behavior training intervention or control group (Figure 1) by 1 researcher (SB). Age (9-11.9 years and 12-16.0 years) and gender stratifications were applied, and participants’ parents were informed of their treatment group by phone after baseline measurements. Participants, therefore, were aware of their study allocation, as the intervention required exposure to new eating behavior training. At this point, further study review appointments were planned which are outlined in the results section.

    Outcomes

    The Consolidated Standards of Reporting Trials (CONSORT) extension for randomized feasibility studies was used to guide transparency and quality in reporting study measures (Multimedia Appendix 5) [33,34]. Trial process–related outcomes measured in this study addressed (1) feasibility (recruitment process, rates of recruitment to the study, and rates of retention and attrition of the study arms), (2) fidelity (adherence to randomization protocol, appointment attendance [number, modality, and duration of study appointments], dose delivered [study tasks planned and completed], dose received [training exposure logged in Mandolean clinical portal], and adherence to intervention procedures), and (3) acceptability (participant engagement with the Mandolean app [number of training meals completed], participants’ engagement with the BigO physical activity monitoring app [volume of data collected], and scores from the system usability scale [SUS] questionnaires [31]).

    Data Analysis

    Statistical methods for quantitative measures included descriptive frequencies and standard t test comparisons between intervention and control groups and completer and noncompleter groups for baseline age, anthropometry, and questionnaire scores. Qualitative feedback from questionnaires and discussions with users was analyzed for content and categories created for the purpose of presenting key acceptability issues, challenges, and facilitators for users and health care professionals.

    Ethics

    The research protocol was reviewed by the research ethics committee at Temple St. Children’s University Hospital and approved on August 08, 2018 (number 18.013). A pseudonymized patient identification coding system was incorporated and stored in an encrypted file at the clinical site, so that no personal patient information was shared or processed via mHealth apps. Data collected on the apps were locally transformed on the participants’ mobile phones, and the transformed data, not containing identifiable information, were transmitted and stored to the respective clinical portals (for Mandolean and BigO).


    Results

    Participants

    Participants were recruited between May 2018 and February 2019. Table 1 describes participants’ characteristics and baseline assessment measures for the intervention and control groups. A total of 63% (5/8) of participants in the intervention group and 42% (5/12) of participants in the control group were categorized as being below average socioeconomic status (Multimedia Appendix 6 gives further detail). No significant differences between the intervention and control groups were noted for mean age, BMI, or BMI SD score (SDS). Differences in mean total score, externalizing behavior total score, and internalizing behavior total score for the parent-reported Child Behavior Checklist (CBCL) were observed (Table 1). A significantly higher score in mean baseline total T score for CBCL was observed between those who completed the study and those who did not, indicating more behavioral issues among those who withdrew. Owing to the high attrition rate, completer and noncompleter groups are also presented in Table 1.

    Table 1. Characteristics of participants in a randomized feasibility study for a mobile health eating behavior training intervention at baseline and follow-up.
    View this table

    Feasibility: Rate of Recruitment

    Children and adolescents were recruited between June 2018 and January 2019. One strategy of recruitment, which involved offering patients and their families study recruitment packs at their first multidisciplinary assessment appointment for the obesity service, was discontinued during the feasibility study. Families reported mixing up the recruitment pack with usual care information received on the same day and had not read the study information by the time the researcher contacted them some days later by phone. Instead, a researcher or clinician provided a 5-min information session and study information pack to parents and their children when they were established within the service and followed up with a phone call 3 to 7 days later. In total, 72 eligible parent-child dyads took recruitment packs for the study, and 33% (24/72) signed informed consent to participate. Following this 28% (20/72) attended for the first study appointment (Figure 2 shows participant flow through the study).

    Figure 2. Consolidated standards of reporting trials diagram for pilot randomized trials.
    View this figure

    Feasibility: Retention and Attrition

    A total of 25% (3/8) of participants in the control arm and 63% (5/12) of participants in the intervention arm withdrew early. Characteristics, participation levels, and feedback from children and adolescents who dropped out of the feasibility study before completion are presented in more detail in Multimedia Appendix 7.

    Fidelity: Adherence to the Randomization Protocol

    The web-based randomization process resulted in males being underrepresented in the intervention group.

    Fidelity: Appointment Attendance

    Intervention participants attended study appointments in addition to usual care (Table 2). There was good adherence to planned face-to-face appointments at time point 1 (T1); however, there was mixed adherence thereafter, with the exception of phone reviews provided by the researcher. The time allocated to the study appointments was appropriate. Illness, school and family commitments, competing appointments at the hospital, and living a long distance from hospital (as perceived by families) were barriers to attending appointments. Final reviews were completed by phone for 3 families who lived at a distance to the hospital to minimize absenteeism from school/work.

    Table 2. Fidelity with planned actions and measures at each time point.
    View this table

    Fidelity: Dose Delivered and Adherence to Intervention Procedures

    Table 2 shows adherence to intervention protocols at each time point. The reasons for an incomplete smartwatch setup at T1 included an incompatible smartphone (n=5), the parent could not remember personal account password to complete syncing with the app (n=2), and insufficient time (n=1). In total, 5 patients took written instructions for smartphone installation at T1 and completed the process at home on a compatible smartphone belonging to another parent or sibling. Two patients did not complete the Mandolean setup at T1 because of patient time constraints, and this was planned for time point 2 (T2), which was completed with 1 participant, and the other did not attend T2 or subsequent appointments. Two patients did not complete questionnaires at baseline, because of lack of time, and were asked to return by post or at the next appointment, of which 1 set was returned.

    In terms of intervention implementation, of 8 patients randomized to Mandolean treatment, 4 received demonstration and instructions by the researcher in person; 1 patient was provided with instructions over the phone and written instructions by post, and 3 patients did not attend T2 to commence training (Table 2).

    Fidelity: Dose Received

    Smartwatch and myBigO Apps

    An early version of the myBigO app used here (which accessed accelerometer data via smartwatches) was compatible with Android operating systems 6.0 and above. Of the 18 children set up with smartwatches at baseline, 11 were connected to parents’ phones, 1 was connected with a sister’s phone, and 6 children and adolescents used their own phones. Available data from the BigO system indicated that of the 18 smartwatch setups with myBigO, 50% (9/18) of participants contributed some data. Of those who contributed data, the range was highly variable from 0.3 to 9.2 days (mean 1.6, SD 2.9 days; median 0.2; IQR 2.0). Two participants did not wear the smartwatch at all after the baseline setup (one because of illness and the other was self-conscious about wearing at school) and subsequently dropped out. Two parents deleted the myBigO app at some point during the study (one because of lack of space on the phone and the other because the father thought the child was no longer using the watch/app). One child did not live with the parent who had myBigO and the smartwatch setup with a compatible smartphone and, as a result, did not synchronize regularly. Attrition (n=8), poor attendance at time point 3 (n=2), technical challenges resynchronizing watch to phone (n=3), and strap breaking (n=1) were reasons for low usage postintervention. In addition, self-reported days wearing the watch among users at the postintervention stage was highly variable. Two patients reported sensory issues and disliked wearing the watch. A short battery life and forgetting to charge or wear were commonly reported by patients for not wearing as advised.

    Mandolean

    All participants completed at least one Mandolean baseline meal that measured their rate of eating. Three participants completed 1 baseline meal with the researcher at the hospital canteen and did not complete any at home. The remaining participants successfully completed some baseline measurement meals at home, with a range of usage (2-19 meals). Participants’ engagement with Mandolean and exposure to the planned intervention are presented in Table 3.

    Table 3. Summary statistics for the use of Mandolean device at baseline (all participants), intervention phase (intervention only), and postintervention (all participants).
    View this table

    Of the 8 participants allocated to the intervention training, 5 received training instructions and 3 did not engage with the training component. One participant subsequently dropped out of the study before training commenced; therefore, the final number of participants exposed to intervention training meals was 50% (4/8 of those randomized to training). Exposure at an individual level represented 7% (2/28 planned meals; male aged 12.3 years), 14% (4/28 planned meals; female aged 9.5 years), 39% (11/28 planned meals; female aged 15.2 years), and 93% (26/28 planned meals; female aged 11.6 years) of planned intervention.

    Acceptability

    Participants’ Engagement With Mandolean and the BigO Physical Activity Monitoring App

    The findings relating to the dose received presented earlier indicated poor acceptability as measured through active engagement among users.

    Self-Report Acceptability Measure: System Usability Scale

    The mean SUS score results are illustrated in Figure 3. A score of 68 or greater is considered acceptable when assessing the user experience of technology [31]. Mandolean did not achieve a mean greater than 68 for the total group or within any subgroup, and the smartwatch achieved a mean of 68 or greater for all groups. A more detailed table of results is presented in Multimedia Appendix 8.

    Figure 3. Bar chart showing participants’ postintervention System Usability Scale scores for Mandolean and smartwatch for the total (n=11), intervention (n=4), and control (n=7) groups.
    View this figure

    Acceptability: Qualitative Feedback From Participants and Their Parents

    Qualitative feedback from participants and their parents was categorized for each piece of technology. The main barriers to using Mandolean were (1) connectivity issues; (2) difficult, awkward, or time consuming to set up, which interfered with family meal times; (3) incompatible with family routine (ie, no regular family meal times, summer holidays, or parental shift work); and (4) forgetting to use. A small number of children and parents reported becoming more aware of their speed of eating as a result of using Mandolean. Most participants enjoyed wearing the watch, liked the timekeeping function, and self-monitored their daily activity levels. The main drawbacks noted were (1) a short battery life, (2) sensory issues and finding the watch uncomfortable, and (3) feeling self-conscious at school. Participants’ quotes and more details are presented in Multimedia Appendix 8.


    Discussion

    Principal Findings

    We conducted a study to determine the feasibility and acceptability of a proposed intervention using 2 mHealth apps among children and adolescents being treated for obesity. The study process was documented thoroughly, and based on the observed results, we concluded the need for further technical usability testing in this population. A slow recruitment rate, high attrition rate, and low fidelity with planned interventions were the key outcomes informing feasibility. Greater psychosocial issues among the intervention and noncompleter groups, observed in the baseline behavioral questionnaire (CBCL), were also noteworthy in this cohort. Although we cannot imply causality about the effect on study engagement or attrition, this finding provides important contextual background about individual and group characteristics, which may have contributed to suboptimal usage of mHealth tools at home.

    In terms of delivering study components, we found realistic time points and modes of delivery. Poor fidelity with participants’ exposure to intervention components, in particular, the low number of participants randomized to the intervention who attended the necessary training, and the low level of engagement with training meals on Mandolean were the primary barriers to intervention implementation. Adherence with the smartwatch set up at baseline was for the majority achieved, whereas fidelity postintervention was problematic because of attrition and nonattendance for reviews.

    We considered the high attrition rate as a signal of poor acceptability of the intervention, particularly when a greater number of intervention arm participants opted to leave the study before completion. The poor rating of Mandolean on the SUS scores provided further evidence. In contrast, positive feedback about using and understanding the smartwatch and the myBigO app was received. Despite the acceptability of the smartwatch, the wide range of exposure levels is suggestive of underlying barriers that need to be understood if we are to maximize adherence to mHealth adjuncts to clinical care. Sekhon et al [38] proposed acceptability as multifaceted to include the following 7 component constructs: affective attitude, burden, perceived effectiveness, ethicality, intervention coherence, opportunity costs, and self-efficacy. Applying these constructs to our SUS and qualitative findings, we suggest that technical difficulties, perceived awkwardness, and time cost associated with using Mandolean contributed to a negative attitude among participants and their parent(s). These, in turn, possibly contributed to feelings of high burden and low confidence in completing the required study tasks. There is also the possibility that the perceived burden associated with Mandolean affected overall study task adherence, including the smartwatch and myBigO.

    Comparison With Prior Work

    Our study with Mandolean differs from previously published work in 2 technical ways: (1) we used a new mobile tool, with a smartphone app interface for Mandolean, whereas others plugged it into a computer [15,16], and (2) we had access to objective engagement data from a clinical portal facility that was not available for an earlier clinical study [16]. Compared with a community-based feasibility study that reported process measures, we had an older cohort (9-16.0 years vs 6-11.0 years), we recruited in the hospital setting, and we also incorporated an additional mHealth tool to measure physical activity levels [15]. Intervention exposure in a more recent study using smartphones mirrored our findings that engagement with Mandolean meals at home among adolescents varied considerably within the intervention group from 5 to 80 meals (median 28 meals), out of a planned 1 meal per day for 6 months [13]. A study of younger children found that just 19% achieved the minimum expected usage of 5 meals per week with Mandolean [15]. These studies and others [39] reported engagement issues among children and adolescents when mHealth apps are considered burdensome.

    Individual factors contributing to poor adherence with wearing the smartwatch that we found, including early attrition, sensory issues, forgetting to charge, forgetting to wear, and feeling self-conscious, are similar to other studies using wearable devices with young people. Although rigorous research with smartwatches as activity trackers is in its infancy in comparison with traditional accelerometers [40], some of the same adherence issues may apply. For example, Jago et al [41] reported considerable variability in adhering to a 7-day accelerometer among children, finding that parents would forget to put on the accelerometer, some children found it uncomfortable, and some were self-conscious about wearing it at school; however, others were excited or interested in wearing it. We found similar barriers among our older group and facilitators among younger participants. Research with a commercial fitness tracker among adolescents with obesity reported a discontinuation rate of 68% before the end of the study that was linked to barriers to physical activity not being addressed by a tracker, seasonality, feelings of activity incompetence, and gradual withdrawal of parental and clinical support [42]. Our finding that high acceptability of a smartwatch does not translate to adherence is also reported by Phan et al [42]. The physical activity self-monitoring tool available on the smartwatch screen in our study was cited by a number of children and parents as a benefit because they were trying to increase their activity levels. Formal integration of recognized and important behavioral change techniques for self-monitoring and goal setting [32] could be maximized for future studies with research-led apps such as myBigO and smartwatches. Retention in clinical research, however, is challenging, and we note that a two-fold study initiation rate may be required to achieve meaningful physical activity data for clinicians treating children in treatment for obesity.

    Although withdrawal of 63.5% of participants in the intervention arm here is considerably higher than that in previous studies using Mandolean [13,15,16], the psychosocial profile of participants has not been described by others. Therefore, we cannot assume that participants were similar across published trials. The most comparable health care setting and age group to our own is the study by Ford et al [16]. They demonstrated high compliance with the intervention, particularly among the Mandolean arm, with 83% of participants attending all study appointments. High-intensity contact (14 appointments in 12 months) was reported as a facilitator of retention [16]. Meta-analyses in the wider electronic health (eHealth) literature show attrition rates of 12% to 29% [43]. Attrition can depend on a range of factors known to be influential in clinical care (eg, school absenteeism, dissatisfaction with care components, demographic factors) [44-46], in addition to factors influencing dropout from eHealth-specific interventions (eg, registration requirements and male gender) [47-49]. One unique aspect of this study was the combination of 2 mHealth tools for measuring both dietary behavior and physical activity. Our attrition rate, therefore, may not be informative for all mHealth interventions with children and adolescents but certainly contributes insight where high participant engagement is expected among groups with complex health and psychological needs.

    The predominant technical issues identified were difficulty connecting scale to phone, Mandolean failing to recognize the plate when weighing out food, and loss of connection midmeal, which others also report as a barrier to compliance at home [13,15]. User experiences such as annoying, cumbersome, and time consuming reported by Hamilton-Shield et al [15] reflected the feedback from our participants, despite using an updated mobile app version of Mandolean. We also found a number of other practical challenges similar to Hinton et al [13], including child impatience during setup, interruption of the flow of family mealtimes, difficulty with the portion size limit for training meals, and forgetting to use. A minority of parents in this study reported more positively that children adapted quickly to the routine of using Mandolean at mealtimes, particularly younger participants. In contrast, parents whose teenagers withdrew from the study early would have preferred them to complete the study. In a community study, by 4 to 10 weeks, some children lost interest, and a few parents were tired of using the Mandolean, particularly setting up, dishing food onto a plate, and weighing food [15]. Although their trial was a longer duration, we found that these reactions were evident earlier (from 2 weeks onward) and, in some cases, contributed to early withdrawal from the study.

    Higher behavioral problems among the intervention group at baseline appeared to be a random outcome of allocation. The subsequent high attrition within the group suggests that psychosocial issues in combination with the intervention burden discussed earlier may have played a role in early attrition. The reasons for attrition among children with obesity vary in the intervention literature. Some interventions report no differences between completers and noncompleters for behavior measures using CBCL [50,51]. Others have shown that the social competence of children aged 8 to 14 years who are overweight or obese, defined using the CBCL, was one of a number of predictors (including lower baseline weight and Caucasian parents) of BMI SDS reduction following a 12-month intervention [45]. Behavioral problems in children from disadvantaged areas have been linked to adherence in other conditions such as type 1 diabetes [51]. Behavioral problems are associated with a high risk of overweight and obesity among children, independent of other risk factors such as parental obesity, education, poverty, and race [52,53]; therefore, we expected to find behavioral issues among a substantial number of our participants. Participants here may not be representative of the general population of children and adolescents with obesity for a number of potential reasons, including obesity severity that prompted a referral to the specialist pediatric service, varying motivation depending on the stage of treatment, and interest in joining research studies based on health status. Although patients with known behavioral disorders were ineligible for participation in this study, a self-report tool at baseline assessing psychosocial and behavioral issues detected underlying behavioral issues that may have affected children’s ability to partake fully in research tasks (and hence treatment tasks). On the basis of this experience, we recommend multidisciplinary baseline assessments to include behavioral measures for similar adjunct interventions with children receiving treatment for obesity.

    This is the first published study in which myBigO with a smartwatch was incorporated into an intervention in a clinical setting. The process outcomes provide some lessons for future research and practice. To fully describe the feasibility phase process, we included all participants who attended a baseline appointment. The slow uptake and early attrition observed indicates that children in treatment for obesity may require greater choice or flexibility in how they contribute data and benefit personally from participation. Different approaches to recruitment and deployment need to be explored with different subgroups, including those with psychosocial or behavioral issues and different age groups (children vs early adolescents vs midadolescents), as they have varied motivations. Greater self-monitoring functionalities and reminders to charge and wear smartwatches may also improve adherence based on barriers reported. Given our challenges with a postintervention accelerometer period, one unbroken smartwatch exposure may be more realistic and preferable among children in treatment for obesity, reducing the need for extra face-to-face review appointments. However, clinicians wishing to observe behavior pre- and postintervention may wish to examine the feasibility of a longer intervention period in which participants would have time to implement and monitor goals based on baseline measures.

    Limitations

    This is a feasibility study with a small sample size and short intervention period. Recruitment was limited to children and adolescents attending 1 specialist pediatric obesity program, which may have limited recruitment rate and introduced population bias in terms of obesity severity and associated complications and participant motivation to participate in the research. The recruitment rate was also delayed at the study outset by the implementation of the General Data Protection Regulation in the European Union and Irish interpretation of the regulation for the purposes of health research. Poor adherence to treatment was evident at early stages; therefore, a longer intervention with Mandolean was unlikely to add additional benefit or knowledge in this group. The intervention group received additional training on Mandolean that the control group was not exposed to which heightened awareness about behaviors of interest and combined with task burden could well introduce unknown biases. A more structured and validated technical usability study may be of benefit to further understand the challenges children and their families face in using the mobile Mandolean system. Although the SUS has been used previously to evaluate adult user experience with wearable devices [54], the survey has not, to our knowledge, been validated in a pediatric population. However, it has advantages for use with children, as it is short and uncomplicated. It is suitable for use with small samples, provides space for comments, and a final score can be interpreted with an established reference standard. The smartwatch with myBigO was in the first stage of feasibility testing in this cohort, and, as such, the technology will continue to be developed based on users’ needs. The attrition and engagement measures should be interpreted in the context of a feasibility study with 2 mHealth apps aimed at children with obesity and, as such, not indicative of the performance of either tool used in isolation.

    Conclusions

    Our study explored the process outcomes of using mHealth tools in an obesity treatment study and highlighted challenges and opportunities related to feasibility, fidelity, and acceptability. By transparently reporting feasibility using the CONSORT extension guidance [33], we reported potential challenges for mHealth interventions among children with obesity. mHealth interventions are rapidly progressing; however, we need to be cautious in terms of efficacy, burden to participants, and our responsibility to identify vulnerable subgroups at baseline. Challenges include task burden and adherence to complexity in mHealth systems recommended for use at home, particularly among families experiencing behavioral issues. The opportunities noted here include high acceptability of a self-monitoring physical activity system where data are shared between patients and healthcare workers. Children with obesity attending treatment have complex needs and, given health service limitations, would benefit from adjuncts to traditional treatment that can be implemented outside of clinical settings. Additional technical and usability studies are recommended to improve our understanding of adherence to treatment.

    Acknowledgments

    The research team wishes to acknowledge the research collaborators Anastasios Delopoulos, Eirini Lekka, Ioannis Ioakeimidis, Christos Diou, Isabel Perez, Daniel Ferri, and all the BigO Project Consortium Members; Cecilia Bergh, Per Söderston, and the team at Mando Group AB, Stockholm, Sweden; the W82GO clinical and administrative team, and the physiotherapy department at Children’s Health Ireland, Temple Street, Dublin; and participating patients and their parents. The work leading to these results has received funding from the European Community’s Health, Demographic Change, and Well-being program under grant agreement number 727688. The project in receipt of this grant is ‘The BigO Project: Big Data Against Childhood Obesity’ [28].

    Conflicts of Interest

    The researchers collaborated with Mando Group AB, Stockholm, Sweden, who provided Mandolean devices for the purpose of the study.

    Multimedia Appendix 1

    Protocol and process for training participants to use Mandolean.

    DOCX File , 20 KB

    Multimedia Appendix 2

    Written standard instructions provided to the participants.

    DOCX File , 536 KB

    Multimedia Appendix 3

    Description of baseline measurements.

    DOCX File , 18 KB

    Multimedia Appendix 4

    Behaviour Change Techniques incorporated into the intervention.

    DOCX File , 19 KB

    Multimedia Appendix 5

    Consolidated standards of reporting trials of electronic and mobile health apps and online telehealth checklist report.

    PDF File (Adobe PDF File), 1657 KB

    Multimedia Appendix 6

    Bar chart showing participants’ socioeconomic position.

    DOCX File , 19 KB

    Multimedia Appendix 7

    Characteristics and feedback from children and teenagers who dropped out before completion.

    DOCX File , 22 KB

    Multimedia Appendix 8

    System usability scores for Mandolean and a smartwatch, including qualitative comments.

    DOCX File , 24 KB

    References

    1. NCD Risk Factor Collaboration (NCD-RisC). Worldwide trends in body-mass index, underweight, overweight, and obesity from 1975 to 2016: a pooled analysis of 2416 population-based measurement studies in 128·9 million children, adolescents, and adults. Lancet 2017 Dec 16;390(10113):2627-2642 [FREE Full text] [CrossRef] [Medline]
    2. Umer A, Kelley GA, Cottrell LE, Giacobbi P, Innes KE, Lilly CL. Childhood obesity and adult cardiovascular disease risk factors: a systematic review with meta-analysis. BMC Public Health 2017 Aug 29;17(1):683 [FREE Full text] [CrossRef] [Medline]
    3. Reinehr T, Lass N, Toschke C, Rothermel J, Lanzinger S, Holl RW. Which amount of BMI-SDS reduction is necessary to improve cardiovascular risk factors in overweight children? J Clin Endocrinol Metab 2016 Aug;101(8):3171-3179. [CrossRef] [Medline]
    4. Kolsgaard ML, Joner G, Brunborg C, Anderssen SA, Tonstad S, Andersen LF. Reduction in BMI z-score and improvement in cardiometabolic risk factors in obese children and adolescents. The Oslo adiposity intervention study-a hospital/public health nurse combined treatment. BMC Pediatr 2011 May 27;11(36):47 [FREE Full text] [CrossRef] [Medline]
    5. Savoye M, Nowicka P, Shaw M, Yu S, Dziura J, Chavent G, et al. Long-term results of an obesity program in an ethnically diverse pediatric population. Pediatrics 2011 Mar;127(3):402-410 [FREE Full text] [CrossRef] [Medline]
    6. Mead E, Brown T, Rees K, Azevedo LB, Whittaker V, Jones D, et al. Diet, physical activity and behavioural interventions for the treatment of overweight or obese children from the age of 6 to 11 years. Cochrane Database Syst Rev 2017 Jun 22;6:CD012651 [FREE Full text] [CrossRef] [Medline]
    7. Al-Khudairy L, Loveman E, Colquitt JL, Mead E, Johnson RE, Fraser H, et al. Diet, physical activity and behavioural interventions for the treatment of overweight or obese adolescents aged 12 to 17 years. Cochrane Database Syst Rev 2017 Jun 22;6:CD012691 [FREE Full text] [CrossRef] [Medline]
    8. Ohkuma T, Hirakawa Y, Nakamura U, Kiyohara Y, Kitazono T, Ninomiya T. Association between eating rate and obesity: a systematic review and meta-analysis. Int J Obes (Lond) 2015 Nov;39(11):1589-1596. [CrossRef] [Medline]
    9. Robinson E, Almiron-Roig E, Rutters F, de Graaf C, Forde CG, Smith C, et al. A systematic review and meta-analysis examining the effect of eating rate on energy intake and hunger. Am J Clin Nutr 2014 Jul;100(1):123-151. [CrossRef] [Medline]
    10. Hawton K, Ferriday D, Rogers P, Toner P, Brooks J, Holly J, et al. Slow down: behavioural and physiological effects of reducing eating rate. Nutrients 2018 Dec 27;11(1):191 [FREE Full text] [CrossRef] [Medline]
    11. Galhardo J, Hunt LP, Lightman SL, Sabin MA, Bergh C, Sodersten P, et al. Normalizing eating behavior reduces body weight and improves gastrointestinal hormonal secretion in obese adolescents. J Clin Endocrinol Metab 2012 Feb;97(2):E193-E201. [CrossRef] [Medline]
    12. Faith MS, Diewald LK, Crabbe S, Burgess B, Berkowitz RI. Reduced eating pace (RePace) behavioral intervention for children prone to or with obesity: does the turtle win the race? Obesity (Silver Spring) 2019 Jan;27(1):121-129 [FREE Full text] [CrossRef] [Medline]
    13. Hinton EC, Birch LA, Barton J, Holly JM, Biernacka KM, Leary SD, et al. Using neuroimaging to investigate the impact of Mandolean training in young people with obesity: a pilot randomised controlled trial. BMC Pediatr 2018 Nov 22;18(1):366 [FREE Full text] [CrossRef] [Medline]
    14. Hermsen S, Frost JH, Robinson E, Higgs S, Mars M, Hermans RC. Evaluation of a smart fork to decelerate eating rate. J Acad Nutr Diet 2016 Jul;116(7):1066-1068. [CrossRef] [Medline]
    15. Hamilton-Shield J, Goodred J, Powell L, Thorn J, Banks J, Hollinghurst S, et al. Changing eating behaviours to treat childhood obesity in the community using Mandolean: the community Mandolean randomised controlled trial (ComMando)-a pilot study. Health Technol Assess 2014 Jul;18(47):i-xxiii, 1 [FREE Full text] [CrossRef] [Medline]
    16. Ford AL, Bergh C, Södersten P, Sabin MA, Hollinghurst S, Hunt LP, et al. Treatment of childhood obesity by retraining eating behaviour: randomised controlled trial. Br Med J 2009 Jan 5;340:b5388. [CrossRef] [Medline]
    17. Lyzwinski LN, Edirippulige S, Caffery L, Bambling M. Mindful eating mobile health apps: review and appraisal. JMIR Ment Health 2019 Aug 22;6(8):e12820 [FREE Full text] [CrossRef] [Medline]
    18. National Institute for Healthcare and Excellence. Weight Management: Lifestyle Services For Overweight or Obese Children and Young People. London, UK: National Institute for Healthcare and Excellence; 2013.
    19. Cain KL, Sallis JF, Conway TL, van Dyck D, Calhoon L. Using accelerometers in youth physical activity studies: a review of methods. J Phys Act Health 2013 Mar;10(3):437-450 [FREE Full text] [CrossRef] [Medline]
    20. Puyau MR, Adolph AL, Vohra FA, Zakeri I, Butte NF. Prediction of activity energy expenditure using accelerometers in children. Med Sci Sports Exerc 2004 Sep;36(9):1625-1631. [Medline]
    21. Tarp J, Child A, White T, Westgate K, Bugge A, Grøntved A, International Children’s Accelerometry Database (ICAD) Collaborators. Physical activity intensity, bout-duration, and cardiometabolic risk markers in children and adolescents. Int J Obes (Lond) 2018 Sep;42(9):1639-1650 [FREE Full text] [CrossRef] [Medline]
    22. Tu AW, Watts AW, Chanoine JP, Panagiotopoulos C, Geller J, Brant R, et al. Does parental and adolescent participation in an e-health lifestyle modification intervention improves weight outcomes? BMC Public Health 2017 Apr 24;17(1):352 [FREE Full text] [CrossRef] [Medline]
    23. Kumar S, Nilsen WJ, Abernethy A, Atienza A, Patrick K, Pavel M, et al. Mobile health technology evaluation: the mhealth evidence workshop. Am J Prev Med 2013 Aug;45(2):228-236 [FREE Full text] [CrossRef] [Medline]
    24. de Cock N, van Lippevelde W, Vangeel J, Notebaert M, Beullens K, Eggermont S, et al. Feasibility and impact study of a reward-based mobile application to improve adolescents' snacking habits. Public Health Nutr 2018 Aug;21(12):2329-2344. [CrossRef] [Medline]
    25. O'Malley G, Dowdall G, Burls A, Perry IJ, Curran N. Exploring the usability of a mobile app for adolescent obesity management. JMIR Mhealth Uhealth 2014 Jun 27;2(2):e29 [FREE Full text] [CrossRef] [Medline]
    26. Blatch-Jones AJ, Pek W, Kirkpatrick E, Ashton-Key M. Role of feasibility and pilot studies in randomised controlled trials: a cross-sectional study. BMJ Open 2018 Sep 25;8(9):e022233 [FREE Full text] [CrossRef] [Medline]
    27. Haase T, Pratschke J. Pobal: Pobal Programmes and Initiatives throughout Ireland. 2017. The 2016 Pobal HP Deprivation Index for Small Areas (SA)   URL: https://www.pobal.ie/app/uploads/2018/06/The-2016-Pobal-HP-Deprivation-Index-Introduction-07.pdf [accessed 2018-06-12]
    28. The BigO Study. 2019. Big Data Against Childhood Obesity   URL: https://bigoprogram.eu/ [accessed 2020-02-15]
    29. Diou C, Sarafis I, Papapanagiotou V, Ioakimidis I, Delopoulos A. A methodology for obtaining objective measurements of population obesogenic behaviors in relation to the environment. J Stat 2019 Dec 10;35(4):677-690 [FREE Full text] [CrossRef]
    30. O'Malley G, Hussey J, Roche E. A pilot study to profile the lower limb musculoskeletal health in children with obesity. Pediatr Phys Ther 2012;24(3):292-298. [CrossRef] [Medline]
    31. Maramba I, Chatterjee A, Newman C. Methods of usability testing in the development of ehealth applications: a scoping review. ‎Int J Med Inform 2019 Jun;126:95-104. [CrossRef] [Medline]
    32. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med 2013 Aug;46(1):81-95. [CrossRef] [Medline]
    33. Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, PAFS Consensus Group. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. Pilot Feasibility Stud 2016;2:64 [FREE Full text] [CrossRef] [Medline]
    34. Eysenbach G. Consort-eHealth: implementation of a checklist for authors and editors to improve reporting of web-based and mobile randomized controlled trials. Stud Health Technol Inform 2013;192:657-661. [Medline]
    35. Varni JW, Seid M, Kurtin PS. PedsQL 4.0: reliability and validity of the pediatric wuality of life inventory version 4.0 generic core scales in healthy and patient populations. Med Care 2001 Aug;39(8):800-812. [CrossRef] [Medline]
    36. van Strien T, Frijters JE, Bergers GP, Defares PB. The Dutch eating behavior questionnaire (DEBQ) for assessment of restrained, emotional, and external eating behavior. Int J Eat Disord 1986 Feb;5(2):295-315 [FREE Full text] [CrossRef]
    37. Achenbach TM, Dumenci L. Advances in empirically based assessment: revised cross-informant syndromes and new DSM-oriented scales for the CBCL, YSR, and TRF: comment on Lengua, Sadowksi, Friedrich, and Fischer (2001). J Consult Clin Psychol 2001 Aug;69(4):699-702. [Medline]
    38. Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res 2017 Jan 26;17(1):88 [FREE Full text] [CrossRef] [Medline]
    39. Jensen CD, Duncombe KM, Lott MA, Hunsaker SL, Duraccio KM, Woolford SJ. An evaluation of a smartphone-assisted behavioral weight control intervention for adolescents: pilot study. JMIR Mhealth Uhealth 2016 Aug 23;4(3):e102 [FREE Full text] [CrossRef] [Medline]
    40. Ridgers ND, McNarry MA, Mackintosh KA. Feasibility and effectiveness of using wearable activity trackers in youth: a systematic review. JMIR Mhealth Uhealth 2016 Nov 23;4(4):e129 [FREE Full text] [CrossRef] [Medline]
    41. Jago R, Sebire SJ, Turner KM, Bentley GF, Goodred JK, Fox KR, et al. Feasibility trial evaluation of a physical activity and screen-viewing course for parents of 6 to 8 year-old children: TeamPlay. Int J Behav Nutr Phys Act 2013 Mar 4;10:31 [FREE Full text] [CrossRef] [Medline]
    42. Phan TL, Barnini N, Xie S, Martinez A, Falini L, Abatemarco A, et al. Feasibility of using a commercial fitness tracker as an adjunct to family-based weight management treatment: pilot randomized trial. JMIR Mhealth Uhealth 2018 Nov 27;6(11):e10523 [FREE Full text] [CrossRef] [Medline]
    43. Hammersley ML, Jones RA, Okely AD. Parent-focused childhood and adolescent overweight and obesity ehealth interventions: a systematic review and meta-analysis. J Med Internet Res 2016 Jul 21;18(7):e203 [FREE Full text] [CrossRef] [Medline]
    44. Skelton JA, Goff DC, Ip E, Beech BM. Attrition in a multidisciplinary pediatric weight management clinic. Child Obes 2011 Jun 20;7(3):185-193 [FREE Full text] [CrossRef] [Medline]
    45. de Niet J, Timman R, Jongejan M, Passchier J, van den Akker E. Predictors of participant dropout at various stages of a pediatric lifestyle program. Pediatrics 2011 Jan;127(1):e164-e170. [CrossRef] [Medline]
    46. Cote MP, Byczkowski T, Kotagal U, Kirk S, Zeller M, Daniels S. Service quality and attrition: an examination of a pediatric obesity program. Int J Qual Health Care 2004 Apr;16(2):165-173. [CrossRef] [Medline]
    47. van der Mispel C, Poppe L, Crombez G, Verloigne M, de Bourdeaudhuij I. A self-regulation-based ehealth intervention to promote a healthy lifestyle: investigating user and website characteristics related to attrition. J Med Internet Res 2017 Jul 11;19(7):e241 [FREE Full text] [CrossRef] [Medline]
    48. Geraghty AW, Torres LD, Leykin Y, Pérez-Stable EJ, Muñoz RF. Understanding attrition from international internet health interventions: a step towards global ehealth. Health Promot Int 2013 Sep;28(3):442-452 [FREE Full text] [CrossRef] [Medline]
    49. Brouwer W, Oenema A, Raat H, Crutzen R, de Nooijer J, de Vries NK, et al. Characteristics of visitors and revisitors to an internet-delivered computer-tailored lifestyle intervention implemented for use by the general public. Health Educ Res 2010 Aug;25(4):585-595. [CrossRef] [Medline]
    50. Vignolo M, Rossi F, Bardazza G, Pistorio A, Parodi A, Spigno S, et al. Five-year follow-up of a cognitive-behavioural lifestyle multidisciplinary programme for childhood obesity outpatient treatment. Eur J Clin Nutr 2008 Sep;62(9):1047-1057. [CrossRef] [Medline]
    51. Cohen DM, Lumley MA, Naar-King S, Partridge T, Cakan N. Child behavior problems and family functioning as predictors of adherence and glycemic control in economically disadvantaged children with type 1 diabetes: a prospective study. J Pediatr Psychol 2004;29(3):171-184. [CrossRef] [Medline]
    52. Aparicio E, Canals J, Arija V, de Henauw S, Michels N. The role of emotion regulation in childhood obesity: implications for prevention and treatment. Nutr Res Rev 2016 Jun;29(1):17-29. [CrossRef] [Medline]
    53. Lumeng JC, Gannon K, Cabral HJ, Frank DA, Zuckerman B. Association between clinically meaningful behavior problems and overweight in children. Pediatrics 2003 Nov;112(5):1138-1145. [CrossRef] [Medline]
    54. Liang J, Xian D, Liu X, Fu J, Zhang X, Tang B, et al. Usability study of mainstream wearable fitness devices: feature analysis and system usability scale evaluation. JMIR Mhealth Uhealth 2018 Nov 8;6(11):e11066 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    BigO: big data against childhood obesity
    CBCL: Child Behavior Checklist
    CONSORT: consolidated standards of reporting trials
    eHealth: electronic health
    mHealth: mobile health
    SDS: SD score
    SUS: system usability scale


    Edited by G Eysenbach, S Nelson; submitted 05.11.19; peer-reviewed by J Alvarez Pitti, S Smith; comments to author 22.01.20; revised version received 11.03.20; accepted 29.03.20; published 08.07.20

    ©Sarah Browne, M-Tahar Kechadi, Shane O'Donnell, Mckenzie Dow, Louise Tully, Gerardine Doyle, Grace O'Malley. Originally published in JMIR mHealth and uHealth (http://mhealth.jmir.org), 08.07.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.