Published on 22.08.16 in Vol 4, No 3 (2016): Jul-Sept
Retrofit Weight-Loss Outcomes at 6, 12, and 24 Months and Characteristics of 12-Month High Performers: A Retrospective Analysis
Background: Obesity is the leading cause of preventable death costing the health care system billions of dollars. Combining self-monitoring technology with personalized behavior change strategies results in clinically significant weight loss. However, there is a lack of real-world outcomes in commercial weight-loss program research.
Objective: Retrofit is a personalized weight management and disease-prevention solution. This study aimed to report Retrofit’s weight-loss outcomes at 6, 12, and 24 months and characterize behaviors, age, and sex of high-performing participants who achieved weight loss of 10% or greater at 12 months.
Methods: A retrospective analysis was performed from 2011 to 2014 using 2720 participants enrolled in a Retrofit weight-loss program. Participants had a starting body mass index (BMI) of >25 kg/m² and were at least 18 years of age. Weight measurements were assessed at 6, 12, and 24 months in the program to evaluate change in body weight, BMI, and percentage of participants who achieved 5% or greater weight loss. A secondary analysis characterized high-performing participants who lost ≥10% of their starting weight (n=238). Characterized behaviors were evaluated, including self-monitoring through weigh-ins, number of days wearing an activity tracker, daily step count average, and engagement through coaching conversations via Web-based messages, and number of coaching sessions attended.
Results: Average weight loss at 6 months was −5.55% for male and −4.86% for female participants. Male and female participants had an average weight loss of −6.28% and −5.37% at 12 months, respectively. Average weight loss at 24 months was −5.03% and −3.15% for males and females, respectively. Behaviors of high-performing participants were assessed at 12 months. Number of weigh-ins were greater in high-performing male (197.3 times vs 165.4 times, P=.001) and female participants (222 times vs 167 times, P<.001) compared with remaining participants. Total activity tracker days and average steps per day were greater in high-performing females (304.7 vs 266.6 days, P<.001; 8380.9 vs 7059.7 steps, P<.001, respectively) and males (297.1 vs 255.3 days, P<.001; 9099.3 vs 8251.4 steps, P=.008, respectively). High-performing female participants had significantly more coaching conversations via Web-based messages than remaining female participants (341.4 vs 301.1, P=.03), as well as more days with at least one such electronic message (118 vs 108 days, P=.03). High-performing male participants displayed similar behavior.
Conclusions: Participants on the Retrofit program lost an average of −5.21% at 6 months, −5.83% at 12 months, and −4.09% at 24 months. High-performing participants show greater adherence to self-monitoring behaviors of weighing in, number of days wearing an activity tracker, and average number of steps per day. Female high performers have higher coaching engagement through conversation days and total number of coaching conversations.
JMIR Mhealth Uhealth 2016;4(3):e101
- body mass index;
- weight loss
Obesity is the leading cause of preventable death in the world, yet it continues to remain a crisis in the United States with two-thirds of the American adult population overweight or obese . The overweight population in the United States has nearly doubled, while obesity rates have nearly tripled in the past 50 years [ ]. Direct and indirect health care costs for preventable chronic disease, including obesity-related diseases such as heart disease and diabetes, range from US $147 billion to US $215 billion per year [ , ]. On average, women report trying to lose weight 7 times in their lifetime, whereas men report an average of 3.6 times [ ]. In fact, Americans spent US $2.5 billion on weight-loss programs and products in 2014 [ ].
The Affordable Care Act encourages employee wellness programs designed to increase health knowledge and skills to promote healthy behaviors, which can aid in the reduction of health care costs incurred by employers . A morbidly obese employee currently costs employers, on average, an additional US $4000 or more per year than an employee who is of a healthy weight [ ]. When achieving 10% weight loss, it increases the likelihood of lowering cholesterol, blood pressure, and risk for diabetes, and even a modest 5% weight reduction can lead to clinically significant decreases in comorbidities associated with overweight and obesity [ - ]. Owing to the extreme impact overweight and obesity have on morbidity, mortality, and the financial state of health care in the United States, the development of effective weight-loss programs is imperative [ - ].
Many employers have taken experts’ recommendations and implemented an employee wellness program; however, these programs are often underused with short-term benefits . Lack of education, personalization, and slow weight loss in Web-based interventions are directly connected to weak adherence and high attrition leading to unsuccessful outcomes [ ]. Therefore, initiating programs that are accessible, personalized, easy to use, and interesting to employees is a key factor to achieving successful outcomes that decrease employer health care costs [ ].
The Look AHEAD (Action for Health in Diabetes) trial resulted in increased outcomes and greater retention in participants receiving education with an intensive behavior modification plan including nutrition and physical activity over education alone [- ]. Remote programs are also desired and improve adherence in intensive programs [ ]. In recent years, Internet accessibility and technology advancements have positively impacted weight-loss programs through the development of mobile phone apps, Web-based weight-loss methods with both personalized and nonpersonalized approaches, and point-click nutrition and fitness information [ , ]. Successful Web-based programs include a structured approach with a hypocaloric nutrition plan, cognitive behavioral strategies, self-monitoring, and individualized feedback and support [ ]. Behavioral weight control approaches that include a comprehensive lifestyle modification program using Wi-Fi scales, mobile phones, or tablets for self-monitoring are shown to be effective in achieving a 7%-10% weight reduction [ , , ].
Combining in-person support with remote technologies has been shown to significantly increase 5% weight-loss outcomes over remote technologies alone . Remote technology such as mobile phone and tablet apps, wireless activity trackers, and wireless scales allows for convenient self-monitoring of weight, food choices, and activity; however, individualization of a participant’s program and personalized feedback create greater adherence, and adherence is associated with greater retention rates [ , - ].
Efficacy of structured research projects with commercial and proprietary weight-loss programs lack real-world outcomes, meaning that current populations are being selected by the study staff . This lack of evidence is visible in a systematic review regarding efficacy of commercial and proprietary weight-loss programs released by Gudzune et al [ ].
Retrofit is a personalized weight management and disease-prevention solution (see). The purpose of this study was to report Retrofit’s weight-loss outcomes at 6, 12, and 24 months using real-world data. A secondary purpose of the study was to characterize behaviors, age, and sex of participants who achieved a weight loss of 10% or greater at 12 months, who are labeled as high performers.
A retrospective analysis using deidentified data of the Retrofit weight-loss program was performed using a case series  approach that included the participants with known weight measurements at 6, 12, and 24 months. This study characterized the changes in participants’ body weight and body mass index (BMI) from the first weight measurement (start date) to different time points and the percentage of participants who reached a clinically significant weight loss of 5% at the corresponding time period. A secondary analysis was conducted focusing on participants with known weight at 12 months, to characterize the differences in various behaviors, age, and sex between participants who lost ≥10% of their starting weight and remaining participants. Western Institutional Review Board granted institutional review board exemption.
Clients in this study were paying customers of the Retrofit program who enrolled through the direct-to-consumer website (Retrofitme.com) or through an employer-sponsored program. Participants were defined as a client who provided at least one weight measurement (N=2720).
Inclusion criteria included participants who had a starting BMI of >25 kg/m², had signed up for the program between September 27, 2011, and December 31, 2014, and were at least 18 years of age. Exclusion criteria included a participant having no weight measurement available at 6, 12, or 24 months. A lack of available weight measurement was due to either a start date more recent than the reviewed data window (see, inclusion criteria) or not providing a known weight measurement (see , exclusion criteria). Decreasing numbers of participants at each data window was related to study design and not directly related to dropping out of the Retrofit program. The reported Retrofit programs are 12-month programs. However, participants could request to continue their program beyond 12 months. If a participant does not remain in an active program guided by an expert coach, the participant still has continued access to program devices, Wi-Fi scale and activity tracker, and private dashboard. According to previous study observations, self-weighing adherence decreases over time [ - ]; therefore, including only those participants with weight data in this study design, the number of excluded participants increased as the data windows progressed. For the purposes of this study, excluded participants will be defined as dropouts.
Initially, 2720 clients were considered as study participants who provided at least one weight measurement. On the basis of the inclusion and exclusion criteria defined in, the final study sample sizes were determined at different time points. At 6 months, 1387 participants met the final inclusion criteria. At 12 months, 1075 participants met the final inclusion criteria. At 24 months, 338 participants met the final inclusion criteria. The sample was treated as an independent group at each data window, as a participant could have a known weight measurement at any one or more than one of the observed milestones. See .
Retrofit offered 3 programs during the period of analysis: Expert 10 Weight Loss Program, Expert 15 Weight Loss Program, and Advisor Weight Loss Program. The programs were designed with a 6-month weight-loss phase and an additional 6-month weight maintenance phase. Weight maintenance after the 12 months was anticipated to be observed through continued application of the learned health behaviors.
The participant was initiated into the program, meeting with a personal program advisor who explained the components of the program, and tested familiarity with the provided technology and Web-based video communication capabilities. Client information was collected during the initial setup period.
The participant was provided with a Fitbit activity tracker, Wi-Fi–enabled scale, and access to a private dashboard (see). The dashboard allowed each participant to keep a personal food and exercise log, review his or her personal data, and enabled communication between the participant and his or her expert coach through a Web-based electronic messaging feature. The private dashboard was accessed via the Retrofitme.com Web application, mobile website, or mobile phone app, which was available on Apple iOS and Android platforms.
Participants were provided with sessions and check-ins to use with an expert coach during their program. The initial session was scheduled for 60 minutes with follow-up sessions scheduled for 30 minutes. Scheduled check-ins were 15 minutes. Sessions were conducted via Web-based video chat or mobile phone (see). All sessions included an educational component, allowing the participant to learn the Retrofit philosophy and weight-loss guiding principles associated with nutrition, mindset, exercise, and daily activity. Sessions and check-ins were used for collaboration between the expert coach and participant to evaluate current health-related behaviors, goal setting, and create individualized plans and strategies. The sessions and check-ins also provided accountability to previously agreed upon strategies. A minimum of 24 one-on-one coaching sessions that included sessions and check-ins, or only check-ins, were allotted to each participant’s program. One-on-one coaching session totals included 24 sessions for Expert 10, 36 sessions for Expert 15, and 12 sessions and 12 check-ins for Advisor.
Participants were encouraged to weigh in and wear their activity tracker daily. Wearing an activity tracker and setting a step goal has been associated with a decrease in BMI and increase in activity . Step count goals were personalized to the participant’s baseline step count. Expert coaches recommended that participants increase step counts in increments of 500 to ultimately achieve their personal daily step goal at 6 months. Participants were encouraged to communicate daily with the expert coach via Web-based messages on the dashboard. Expert coaches were required to review a client’s food and exercise logs, step data, weight data, and progress toward goals a minimum of 1 time per week to provide feedback via Web-based messages. If a client initiated a coaching conversation, the expert coach was required to respond within 24 hours.
All 3 programs provided the participants with the same technology, access to a weight-loss expert, accountability, feedback, and the opportunity to communicate with a weight-loss expert via Web-based messages equally. The differences among programs were defined by number and type of one-on-one coaching sessions a participant was provided, and the Advisor program provided access to 1 expert coach, whereas Expert 10 and Expert 15 programs provided a team of experts in mindset, nutrition, and exercise. Weight-loss experts were employed professionals with a master’s or doctorate level college education in nutritional sciences, exercise physiology, health education, counseling, or psychology. Mindset experts had degrees in counseling, health education, social work, or psychology. Nutrition experts were registered and licensed dietitians, and exercise experts were exercise physiologists. Experts are assigned to a participant for the duration of their program; however, a new expert may have been assigned to a participant’s program related to employee turnover or as part of the quality assurance process. Expert coaches were trained on and utilized Retrofit’s weight-loss protocol.
Weight data were collected through use of the provided Wi-Fi connected scale (97.87% of recorded weights) or self-reported entry (2.13%). Self-reported entry was permissible if participants had difficulty setting up their Wi-Fi scale. Starting weight was determined at the first collected weight from the participant. The criteria for determining if a participant had a known weight measurement at different time points in the program are outlined in. A widening window approach was used at each time point to account for decreased self-weighing behavior. A reduction in the frequency of self-weighing behavior is observed in existing research [ - ]. Therefore, a wider range of time was used to determine a participant’s weight at 12 and 24 months. Similar widening window approaches have been used in previous commercial weight-loss studies [ ].
When more than one measurement was collected within the identified range, the weight measurement on or closest to the specified day of measurement was used. Participants were encouraged to step on the scale daily.
Participant self-monitoring adherence was analyzed at 12 months through the use of the activity tracker and frequency of weigh-ins. Participant behaviors and engagement were observed through the number of coaching conversations in the form of an electronic message posted on the private dashboard between participant and weight-loss expert, number of days that an electronic message was logged, along with the length of each electronic message. Coaching conversations include both coach-initiated and participant-initiated Web-based messages. In addition, number of coaching sessions attended were also analyzed for participant engagement.
The primary outcome measurements were total weight lost in kilograms, percentage of weight lost, change in BMI, and percentage of participants who lost ≥5% and ≥10% of their starting weight. Program outcomes were analyzed at 6, 12, and 24 months, grouped by sex. At each milestone, data of participants with a known weight measurement were used to calculate outcomes.
Further analysis summarized self-monitoring behaviors and coaching conversations via Web-based messages between the participant and weight-loss expert at 12 months. The analysis grouped participants based on sex. Participants were also divided into groups that lost at least 10% of their starting weight at 12 months and those who had a weight loss of less than 10% at 12 months.
The summarized behaviors include total weigh-in measurements, total days of activity tracker use, daily step count average, total number of coaching conversations via Web-based messages, total count of days with a conversation, average conversation length, and number of coaching sessions attended.
Primary data analyses were performed using Python 2.7.11, which included NumPy 1.10.4, Pandas 0.17.1, and SciPy 0.17.0 analytic packages. For two-group comparisons, t tests of equal variance were conducted on continuous variables at baseline and subsequent time points. One-way analysis of variance (ANOVA) was used to determine mean differences for more than two-group comparisons. Subsequently, Tukey tests were conducted to determine mean differences. Chi-square analyses were performed to determine differences among categorical variables when appropriate. Outcome variable means are summarized with standard errors (SEs) and a 95% confidence interval is included in the populations summarized in. Alpha was set at .05 for all statistical tests to determine statistical significance.
Of the participants with a known weight measurement at each time point, 41.9% (581/1387) at 6 months, 43.6% (469/1075) at 12 months, and 44.4% (150/338) at 24 months were male. There were no differences in age or starting BMI at baseline, between male and female participants, for each sample. Male participants had a higher starting weight at 6 months (P<.001), 12 months (P<.001), and 24 months (P<.001). Baseline summaries for age, starting weight, and starting BMI are outlined in.
|P value||12 Months, |
|P value||24 Months, |
|Starting weight, |
|Starting BMIa, kg/m2||33.8 |
aBMI: body mass index.
Weight Change Status
The average weight loss at 6 months was −5.55% (SE 0.20) and −4.86% (SE 0.18) for males and females, respectively. Males at 12 months had an average weight loss of −6.28% (SE 0.28). Females at 12 months lost an average of −5.37% (SE 0.28). The average weight loss at 24 months was −5.03% (SE 0.61) and −3.15% (SE 0.62) for males and females, respectively. Weight loss was calculated by subtracting baseline weight from milestone weight. There was a significant difference in total weight lost in kilograms, percentage of weight lost, and BMI change at all of the observed milestones, when comparing males and females. A complete outline of these weight change outcomes, for all 3 observed durations is available in.
shows the percentage of the male and female participants who lost ≥5% of their starting weight. There was a significant difference between male and female participants at 6 months (P=.045) and 12 months (P=.02).
Baseline Characteristics for High-Performing and Remaining Participants
Participants who lost ≥10% of their starting weight were identified as high performers. Those participants who did not achieve that amount of weight loss were identified as the remaining participants.
At baseline, high-performing males had a statistically significant higher average starting weight of 112.7 (SD 22.11) kg, whereas the remaining male participants had an average starting weight of 107.8 (SD 21.84) kg (P=.045). High-performing females were older on average than the remaining females, where the average ages were 50.3 (SD 11.0) years and 46.9 (SD 10.7) years, respectively (P=.001). All other baseline characteristics were similar between the high-performing participants and the remaining participants. Baseline characteristics are outlined in.
|Outcomes||6 Months||P value||12 Months||P value||24 Months||P value|
|Weight change, |
kilograms mean (SE)
|Weight change, % |
|BMIa change, kg/m2|
|% With ≥5% weight loss |
|% With ≥10% weight loss |
aBMI: body mass index.
|Characteristics||Male, mean (SD)||P value||Female, mean (SD)||P value|
|High performers (n=105)||Remaining (n=364)||High performers (n=133)||Remaining (n=473)|
|Age, years||46.9 (11.3)||47.9 (11.4)||.44||50.3 (11.0)||46.9 (10.7)||.001|
|Starting weight, kilograms||112.7 (22.11)||107.8 (21.84)||.045||91.1 (18.2)||90.8 (19.9)||0.87|
|Starting BMIa, kg/m2||34.6 (6.37)||33.3 (6.37)||.06||33.3 (5.9)||33.4 (7.05)||.94|
aBMI: body mass index.
Further analysis of participants’ sex, age, and average weight loss at 12 months was performed by dividing participants by sex, grouping them by 10-year age ranges, and conducting a one-way ANOVA. To address outlying age groupings, participants 20 years and younger or 80 years and older were not included in the assessment. For male participants, there was no statistically significant difference (P=.37) in relation to age and weight loss. However, for female participants, there was a significant difference of mean weight loss between the different groups (P=.002), see. A subsequent Tukey test was performed, finding that the significant mean differences occurred between the 31- to 40-year age group and 51- to 60-year age group (P=.026) and between the 31- to 40-year age group and 61- to 70-year age group (P=.004).
Self-Monitoring Behaviors and Coaching Conversations at 12 Months
For all self-monitoring behaviors, the high-performing participants had significantly higher adherence at 12 months. High-performing males weighed in 197.3 (SE 9.97) times, whereas remaining males weighed in 165.4 (SE 4.39) times (P=.001). High-performing females weighed in 222 (SE 8.47) times compared with 167 (SE 4.12) times for remaining females (P<.001). The total days of activity tracker use and average steps per day for high-performing females was 304.7 (SE 6.81) days and 8380.9 (SE 268.5) steps, respectively, whereas the remaining females had 266.6 (SE 98.1) days (P<.001) and 7059.7 (SE 2499.9) steps (P<.001). Males had 297.1 (SE 88.0) and 255.3 (SE 106.3) activity tracker days (P<.001) for high performers and remaining participants, respectively. On average, high-performing males had 9099.3 (SE 2954) average daily step counts, whereas the remaining males had 8251.4 (SE 2821) steps (P=.008). Self-monitoring measurements for males and females are outlined in.
|Male, mean (SE)||P value||Female, mean (SE)||P value|
|High performers (n=105)||Remaining (n=364)||High performers (n=133)||Remaining (n=473)|
|Weigh-in daysa||197.3 (9.97)||165.4 (4.39)||.001||222 (8.47)||167 (4.12)||<.001|
|Activity tracker daysb||297.1 (8.71)||255.3 (5.60)||<.001||304.7 (6.81)||266.6 (4.52)||<.001|
|Daily step count||9099.3 (289.7)||8251.4 (148.7)||.008||8380.9 (268.5)||7059.7 (115.1)||<.001|
|Total coaching conversationsc||260.2 (14.02)||236 (7.87)||.14||341.4 (15.7)||301.1 (8.9)||.03|
|Coaching conversation daysd||100.9 (3.60)||95.9 (2.21)||.27||118 (4.10)||108 (2.17)||.03|
|Coaching conversation lengthe||239.1 (6.93)||262 (5.13)||.03||232.4 (5.31)||247.6 (3.61)||.04|
|Number of coaching sessions attendedf||18.7 (0.62)||16.7 (0.43)||.008||19.7 (0.57)||17.7 (0.34)||.003|
aWeigh-in day: day where participant reported weigh-in via Wi-Fi scale or self-report.
bActivity tracker day: day where participant’s activity tracker recorded more than one step count.
cCoaching conversation: online communication between expert and participant in the form of an electronic message, excludes communication between coach and participant in live one-on-one coaching sessions.
dCoaching conversation days: a day where a participant or expert posted an electronic message.
eCoaching conversation length: the number of characters of an electronic message.
fNumber of coaching sessions attended: the total number of one-on-one coaching sessions a participant attended, includes both 30-minute sessions and 15-minute check-ins.
Reviewing engagement between the participant and expert coach, high-performing female participants had significantly more total coaching conversations via Web-based messages with 341.4 (SE 15.7) compared with 301.1 (SE 8.88) for the remaining participants (P=.03). High-performing females also had more days with at least one coaching conversation, with 118 (SE 4.10) days compared with the remaining participants who had 108 (SE 2.17) days (P=.03). Similar trends were found when reviewing male participant coaching conversation totals; however, these were not significant. High performers had 260.2 (SE 14.02) coaching conversations and 100.9 (SE 3.60) days, compared with the remaining males with 236 (SE 7.87) coaching conversations (P=.14) and 95.9 (SE 2.21) days (P=.27). Interestingly, the coaching conversations were not longer for high performers. This was true for females where conversation length was 232.4 (SE 5.31) characters for high performers and 247.6 (SE 3.61) characters for remaining participants (P=.04). This also was found with males, as high performers’ conversation length was 239.9 (SE 6.93) characters compared with 262 (SE 5.13) characters (P=.03) for remaining participants. Coaching conversations via electronic message measurements can be found in.
Further engagement was reviewed in number of coaching sessions attended. High-performing male participants attended 18.7 (SE 0.62) sessions compared with remaining male participants attending 16.7 (SE 0.43) sessions (P=.008). High-performing female participants attended 19.7 (SE 0.57) sessions, whereas remaining female participants attended 17.7 (SE 0.34) sessions (P=.003). High-performing male and female participants attended a statistically significant number of coaching sessions over remaining participants. Seefor number of coaching session measurements.
Participants on the Retrofit program lost an average of −5.21% (male −5.55%, female −4.86%) at 6 months, −5.83% (male −6.28%, female −5.37%) at 12 months, and −4.09% (male −5.03%, female −3.15%) at 24 months. Men consistently lost more weight than women at all the milestones. At 12 months, 56.3% (264/469) of males and 48.8% (296/606) of females had clinically significant weight loss, losing 5% of starting weight. High-performing male and female participants, who lost ≥10% of their starting weight, had higher adherence to all self-monitoring behaviors, whereas only high-performing female participants had a higher rate of engagement through coaching conversations. However, both male and female high performers attended a statistically significant number of one-on-one coaching sessions.
Male Versus Female Outcomes
Although more females were included in the study population at each time point, no differences were observed in age or starting BMI at baseline; however, males had a higher starting weight at each time point. In addition, men were significantly more successful at 6, 12, and 24 months with more total weight lost in kg, greater percentage of weight loss, and change in BMI. Therefore, more male participants lost ≥5% than female participants. Enrollment, baseline data, and weight loss comparison between male and female participants are consistent with other weight-loss studies; however, a higher percentage of men were represented in the Retrofit study population than presented in the literature [, , , , , , , , , , , ]. Women are shown to seek out weight-loss opportunities more than men, whereas men lose more weight regardless of age or baseline weight characteristics, likely due to biological differences between males and females [ , , ]. However, regardless of total weight lost, losing a clinically significant amount of weight at ≥5% is of most importance to reduce comorbidities related to overweight and obesity [ - , , , ].
High Performers’ Characteristics and Behaviors
Determining potential baseline indicators and behaviors of participants achieving 10% or greater weight loss was important to increase the reduction of overweight- and obesity-related health conditions [- , ]. A majority of the baseline characteristics for high-performing males and females were not significantly different compared with the remaining participants. However, high-performing males had a higher starting weight than remaining male participants and high-performing females were older on average than the remaining female participants. Older adults have been shown to be more successful in losing weight than younger adults owing to intervention adherence in the Look AHEAD trial [ , ]. Men, in general, and specifically older women are more motivated by health risks than cosmetic or social factors [ , ].
Of particular interest were the participant behaviors associated with high-performing participants at 12 months, which included the self-monitoring behaviors of weighing in, number of days wearing an activity tracker, and average number of steps per day, as well as engagement behaviors, including total number of coaching conversations, number of days with a coaching conversation, length of coaching conversations, and number of coaching sessions attended. Male and female high performers had a greater adherence rate to all self-monitoring behaviors and attended significantly more coaching sessions, which was consistent with the large amount of available research connecting program adherence to weight loss [, , , ]. Self-monitoring behaviors, specifically when incorporated through technology, have consistently been shown to improve weight-loss outcomes [ , , , , , ].
High-performing female clients engaged more through coaching conversations than high-performing male clients on both total number of conversations and number of days with a conversation. This also was seen by Tate et al  in number of diary submissions being significantly associated with weight loss, although the study did not divide participants by sex. Participants, both male and female, who did not achieve 10% weight loss had longer conversations than high-performing participants. This observation identifies the hypothesis that frequency of messages, as opposed to length of messages, is a critical component of participant and coach asynchronous communication via Web-based messages. Multiple studies support the hypothesis that frequency of contact does improve weight-loss outcomes, specifically in achieving ≥5% weight loss [ , , ].
Strengths and Limitations
This study has several strengths, including reporting of real-world weight-loss outcomes. Participants were actual clients of Retrofit and were not recruited or provided with any incentives to participate in the study. In addition, all clients who met the starting BMI, age, and weight inclusion criteria were included as participants. No client who had a lack of success on the program was removed or eliminated from the population. As an uncommon research practice noted by Gudzune et al , researchers conclude that this study adds value and brings a unique set of outcomes to weight-loss research. No previous commercial program has published all of its data in such a manner, providing a true picture of efficacy of the Retrofit program. In addition, outcomes were segmented by sex to identify specific baseline characteristics and behaviors for success between men and women; and lastly, age was used as an additional component to target baseline characteristics and behaviors to achieve 10% or greater weight loss in 12 months.
In addition to the identified strengths, the researchers also noted some weaknesses. According to the study design, cross-sectional samplings were performed at 6, 12, and 24 months to select participants with known weight, which provided a separate population for each weight-loss period. The case series approach of this study does not allow any causal inferences based on the critical observations. In addition, because of the real-world population, it is unknown if participants were integrating any other weight-loss practices outside of the Retrofit program components.
Because of a lack of real-world outcomes within the commercial weight-loss industry, Retrofit encourages all commercial weight-loss programs to publish similar data to show efficacy of programs. By reporting real-world outcomes in relation to targeted behaviors, commercial weight-loss programs can structure protocols and client strategies to enhance long-term weight-loss success. Clearly defining the necessary behaviors for long-term weight-loss success and the efficacy of each commercial weight-loss program will solidify our ability as an industry and country to combat the obesity crisis, including obesity-related diseases such as heart disease and diabetes.
Recommended future research includes studying a population over time for a causal effect of weight loss, as well as comparing the population with a control group and targeting specific characteristics and behaviors for high-performing clients such as what engagement factors matter for male participants, why older female participants are more successful, and why men with a higher starting weight are more successful. In addition, it is recommended to compare male and female high performers as a single population with the remaining participants for further insight into baseline characteristics and behaviors for success, and observing self-monitoring and health behavior adherence beyond 12 months. Finally, evaluate the impact of Retrofit’s weight-loss program on short-term and long-term employer health care spending.
In conclusion, participants on the Retrofit program lost an average of −5.21% at 6 months, −5.83% at 12 months, and −4.09% at 24 months. Men, on average, lost more weight than women. High-performing participants, or participants who lost ≥10% of starting weight at 12 months, had a greater adherence to the self-monitoring behaviors of weighing in, number of days wearing an activity tracker, and average number of steps per day. Female high performers had a higher engagement in coaching conversations through conversation days and total number of conversations with their expert coaches. However, both high-performing male and female participants attended significantly more one-on-one coaching sessions.
Robert Kushner, MD, MS, and James Hill, PhD, are both active members of the Retrofit, Inc Advisory Board and were involved in reviewing the manuscript for submission.
Conflicts of Interest
SP, GD, RA, and KK are employees of Retrofit, Inc, with equity in the company. BH and JB are paid consultants of Retrofit, Inc, with equity in the company.
Multimedia Appendix 1
Retrofit logo.JPG File, 64KB
Multimedia Appendix 2
The technology provided included a Wi-Fi–enabled scale, activity tracker, and access to a private dashboard. The dashboard was accessible via Web and mobile apps.PNG File, 135KB
Multimedia Appendix 3
Coaching sessions were conducted via video chat, available online or with a mobile phone.PNG File, 237KB
- Ogden CL, Carroll MD, Fryar CD, Flegal KM. Prevalence of Obesity Among Adults and Youth: United States, 2011-2014. NCHS Data Brief 2015 Nov(219):1-8 [FREE Full text] [Medline]
- Parikh NI, Pencina MJ, Wang TJ, Lanier KJ, Fox CS, D'Agostino RB, et al. Increasing trends in incidence of overweight and obesity over 5 decades. Am J Med 2007 Mar;120(3):242-250. [CrossRef] [Medline]
- Cawley J, Meyerhoefer C. The medical care costs of obesity: an instrumental variables approach. J Health Econ 2012 Jan;31(1):219-230. [CrossRef] [Medline]
- Hammond RA, Levine R. The economic impact of obesity in the United States. Diabetes Metab Syndr Obes 2010;3:285-295 [FREE Full text] [CrossRef] [Medline]
- Saad L. Gallup. 2011. To Lose Weight, Americans Rely More on Dieting Than Exercise URL: http://www.gallup.com/poll/150986/Lose%C2%ADWeight%C2%ADAmericans%C2%ADRely%C2%ADDieting%C2%ADExercise.aspx [accessed 2016-02-25] [WebCite Cache]
- Gudzune KA, Bleich SN, Clark JM. Efficacy of Commercial Weight-Loss Programs. Ann Intern Med 2015 Sep 1;163(5):399. [CrossRef] [Medline]
- United States Department of Labor. DOL. 2014. The Affordable Care Act and Wellness Programs URL: http://www.dol.gov/ebsa/pdf/fswellnessprogram.pdf [WebCite Cache]
- Van NK, Globe D, Ng-Mak D, Cheung H, Sullivan J, Goldman D. The association between employee obesity and employer costs: evidence from a panel of U.S. employers. Am J Health Promot 2014;28(5):277-285. [CrossRef] [Medline]
- Wing RR, Lang W, Wadden TA, Safford M, Knowler WC, Bertoni AG, Look AHEAD Research Group. Benefits of modest weight loss in improving cardiovascular risk factors in overweight and obese individuals with type 2 diabetes. Diabetes Care 2011 Jul;34(7):1481-1486 [FREE Full text] [CrossRef] [Medline]
- Van Gaal LF, Mertens I, Ballaux D. What is the relationship between risk factor reduction and degree of weight loss? Eur Heart J Suppl 2005;7(Supplement L):L21-L26. [CrossRef]
- Vidal J. Updated review on the benefits of weight loss. Int J Obes Relat Metab Disord 2002 Dec;26 Suppl 4:S25-S28. [CrossRef] [Medline]
- Mozaffarian D, Benjamin E, Go A, Arnett D, Blaha M, Cushman M, et al. Executive Summary: Heart Disease and Stroke Statistics—2015 Update: A Report From the American Heart Association. Circulation 2015;131:434-441 [FREE Full text] [CrossRef]
- Raynor HA, Champagne CM. Position of the Academy of Nutrition and Dietetics: Interventions for the Treatment of Overweight and Obesity in Adults. J Acad Nutr Diet 2016 Jan;116(1):129-147. [CrossRef] [Medline]
- Abdullah A, Peeters A, de courten M, Stoelwinder J. The magnitude of association between overweight and obesity and the risk of diabetes: a meta-analysis of prospective cohort studies. Diabetes Res Clin Pract 2010 Sep;89(3):309-319. [CrossRef] [Medline]
- Appel LJ, Clark JM, Yeh H, Wang N, Coughlin JW, Daumit G, et al. Comparative effectiveness of weight-loss interventions in clinical practice. N Engl J Med 2011 Nov 24;365(21):1959-1968 [FREE Full text] [CrossRef] [Medline]
- Colombi AM, Wood GC. Obesity in the workplace: impact on cardiovascular disease, cost, and utilization of care. Am Health Drug Benefits 2011 Sep;4(5):271-278 [FREE Full text] [Medline]
- Elmer PJ, Obarzanek E, Vollmer WM, Simons-Morton D, Stevens VJ, Young DR, PREMIER Collaborative Research Group. Effects of comprehensive lifestyle modification on diet, weight, physical fitness, and blood pressure control: 18-month results of a randomized trial. Ann Intern Med 2006 Apr 4;144(7):485-495. [Medline]
- Flegal KM, Graubard BI, Williamson DF, Gail MH. Cause-specific excess deaths associated with underweight, overweight, and obesity. JAMA 2007 Nov 7;298(17):2028-2037. [CrossRef] [Medline]
- Almeida FA, You W, Harden SM, Blackman KC, Davy BM, Glasgow RE, et al. Effectiveness of a worksite-based weight loss randomized controlled trial: the worksite study. Obesity (Silver Spring) 2015 Apr;23(4):737-745 [FREE Full text] [CrossRef] [Medline]
- Arem H, Irwin M. A review of web-based weight loss interventions in adults. Obes Rev 2011 May;12(5):e236-e243 [FREE Full text] [CrossRef] [Medline]
- Kent K, Goetzel RZ, Roemer EC, Prasad A, Freundlich N. Promoting Healthy Workplaces by Building Cultures of Health and Applying Strategic Communications. J Occup Environ Med 2016 Feb;58(2):114-122. [CrossRef] [Medline]
- Foster GD, Wadden TA, Lagrotte CA, Vander VS, Hesson LA, Homko CJ, et al. A randomized comparison of a commercially available portion-controlled weight-loss intervention with a diabetes self-management education program. Nutr Diabetes 2013;3:e63 [FREE Full text] [CrossRef] [Medline]
- Heshka S, Anderson JW, Atkinson RL, Greenway FL, Hill JO, Phinney SD, et al. Weight loss with self-help compared with a structured commercial program: a randomized trial. JAMA 2003 Apr 9;289(14):1792-1798. [CrossRef] [Medline]
- Jebb SA, Ahern AL, Olson AD, Aston LM, Holzapfel C, Stoll J, et al. Primary care referral to a commercial provider for weight loss treatment versus standard care: a randomised controlled trial. Lancet 2011 Oct 22;378(9801):1485-1492 [FREE Full text] [CrossRef] [Medline]
- Wadden TA, Webb VL, Moran CH, Bailer BA. Lifestyle modification for obesity: new developments in diet, physical activity, and behavior therapy. Circulation 2012 Mar 6;125(9):1157-1170 [FREE Full text] [CrossRef] [Medline]
- Jane M, Foster J, Hagger M, Pal S. Using new technologies to promote weight management: a randomised controlled trial study protocol. BMC Public Health 2015;15:509 [FREE Full text] [CrossRef] [Medline]
- Collins CE, Morgan PJ, Jones P, Fletcher K, Martin J, Aguiar EJ, et al. Evaluation of a commercial web-based weight loss and weight loss maintenance program in overweight and obese adults: a randomized controlled trial. BMC Public Health 2010;10:669 [FREE Full text] [CrossRef] [Medline]
- Saperstein SL, Atkinson NL, Gold RS. The impact of Internet use for weight loss. Obes Rev 2007 Sep;8(5):459-465. [CrossRef] [Medline]
- Popkin BM, Gordon-Larsen P. The nutrition transition: worldwide obesity dynamics and their determinants. Int J Obes Relat Metab Disord 2004 Nov;28(Suppl 3):S2-S9. [CrossRef] [Medline]
- Dansinger ML, Gleason JA, Griffith JL, Selker HP, Schaefer EJ. Comparison of the Atkins, Ornish, Weight Watchers, and Zone diets for weight loss and heart disease risk reduction: a randomized trial. JAMA 2005 Jan 5;293(1):43-53. [CrossRef] [Medline]
- Finley CE, Barlow CE, Greenway FL, Rock CL, Rolls BJ, Blair SN. Retention rates and weight loss in a commercial weight loss program. Int J Obes (Lond) 2007 Feb;31(2):292-298. [CrossRef] [Medline]
- Harvey-Berino J, West D, Krukowski R, Prewitt E, VanBiervliet A, Ashikaga T, et al. Internet delivered behavioral obesity treatment. Prev Med 2010 Aug;51(2):123-128 [FREE Full text] [CrossRef] [Medline]
- Tate DF, Jackvony EH, Wing RR. A randomized trial comparing human e-mail counseling, computer-automated tailored counseling, and no counseling in an Internet weight loss program. Arch Intern Med 2006;166(15):1620-1625. [CrossRef] [Medline]
- Song JW, Chung KC. Observational studies: cohort and case-control studies. Plast Reconstr Surg 2010 Dec;126(6):2234-2242 [FREE Full text] [CrossRef] [Medline]
- Gokee-Larose J, Gorin AA, Wing RR. Behavioral self-regulation for weight loss in young adults: a randomized controlled trial. Int J Behav Nutr Phys Act 2009;6:10 [FREE Full text] [CrossRef] [Medline]
- Gokee LJ, Tate DF, Gorin AA, Wing RR. Preventing weight gain in young adults: a randomized controlled pilot study. Am J Prev Med 2010 Jul;39(1):63-68 [FREE Full text] [CrossRef] [Medline]
- Linde JA, Jeffery RW. Testing a brief self-directed behavioral weight control program. Behav Med 2011 Apr;37(2):47-53 [FREE Full text] [CrossRef] [Medline]
- Steinberg DM, Tate DF, Bennett GG, Ennett S, Samuel-Hodge C, Ward DS. The efficacy of a daily self-weighing weight loss intervention using smart scales and e-mail. Obesity (Silver Spring) 2013 Sep;21(9):1789-1797 [FREE Full text] [CrossRef] [Medline]
- Zheng Y, Sereika SM, Ewing LJ, Danford CA, Terry MA, Burke LE. Association between Self-Weighing and Percent Weight Change: Mediation Effects of Adherence to Energy Intake and Expenditure Goals. J Acad Nutr Diet 2016 Apr;116(4):660-666. [CrossRef] [Medline]
- Bravata DM, Smith-Spangler C, Sundaram V, Gienger AL, Lin N, Lewis R, et al. Using pedometers to increase physical activity and improve health: a systematic review. JAMA 2007 Nov 21;298(19):2296-2304. [CrossRef] [Medline]
- Sepah SC, Jiang L, Peters AL. Translating the Diabetes Prevention Program into an Online Social Network: Validation against CDC Standards. Diabetes Educ 2014 Apr 10;40(4):435-443. [CrossRef] [Medline]
- Wadden TA, Neiberg RH, Wing RR, Clark JM, Delahanty LM, Hill JO, Look AHEAD Research Group. Four-year weight losses in the Look AHEAD study: factors associated with long-term success. Obesity (Silver Spring) 2011 Oct;19(10):1987-1998 [FREE Full text] [CrossRef] [Medline]
- Wadden TA, West DS, Neiberg RH, Wing RR, Ryan DH, Johnson KC, Look AHEAD Research Group. One-year weight losses in the Look AHEAD study: factors associated with success. Obesity (Silver Spring) 2009 Apr;17(4):713-722 [FREE Full text] [CrossRef] [Medline]
- Hankey CR, Leslie WS, Lean ME. Why lose weight? Reasons for seeking weight loss by overweight but otherwise healthy men. Int J Obes Relat Metab Disord 2002 Jun;26(6):880-882. [CrossRef] [Medline]
- LaRose JG, Leahey TM, Hill JO, Wing RR. Differences in motivations and weight loss behaviors in young adults and older adults in the National Weight Control Registry. Obesity (Silver Spring) 2013 Mar;21(3):449-453 [FREE Full text] [CrossRef] [Medline]
|ANOVA: analysis of variance|
|BMI: body mass index|
|Look AHEAD: Action for Health in Diabetes|
|SE: standard error|
Edited by G Eysenbach; submitted 14.04.16; peer-reviewed by Anonymous, D Gaz; comments to author 05.05.16; revised version received 16.06.16; accepted 26.07.16; published 22.08.16
©Stefanie Painter, Gary Ditsch, Rezwan Ahmed, Nicholas Buck Hanson, Kevin Kachin, Jan Berger. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 22.08.2016.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.