Published on 29.09.16 in Vol 4, No 3 (2016): Jul-Sept
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/5992, first published May 18, 2016.
Baseline Motivation Type as a Predictor of Dropout in a Healthy Eating Text Messaging Program
Background: Growing evidence suggests that text messaging programs are effective in facilitating health behavior change. However, high dropout rates limit the potential effectiveness of these programs.
Objective: This paper describes patterns of early dropout in the HealthyYou text (HYTxt) program, with a focus on the impact of baseline motivation quality on dropout, as characterized by Self-Determination Theory (SDT).
Methods: This analysis included 193 users of HYTxt, a diet and physical activity text messaging intervention developed by the US National Cancer Institute. Descriptive statistics were computed, and logistic regression models were run to examine the association between baseline motivation type and early program dropout.
Results: Overall, 43.0% (83/193) of users dropped out of the program; of these, 65.1% (54/83; 28.0% of all users) did so within the first 2 weeks. Users with higher autonomous motivation had significantly lower odds of dropping out within the first 2 weeks. A one unit increase in autonomous motivation was associated with lower odds (odds ratio 0.44, 95% CI 0.24–0.81) of early dropout, which persisted after adjusting for level of controlled motivation.
Conclusions: Applying SDT-based strategies to enhance autonomous motivation might reduce early dropout rates, which can improve program exposure and effectiveness.
JMIR Mhealth Uhealth 2016;4(3):e114
The proliferation of mobile phone ownership in the United States and worldwide has provided a unique opportunity to reach broad audiences with health behavior messages and interventions [- ]. Growing evidence suggests that text messaging programs are effective in facilitating health behavior change in multiple domains, including diet and physical activity [ , , ]. Some of the advantages of text messaging programs over traditional health behavior change programs include their potential reach, particularly among hard-to-reach populations, and cost-effectiveness [ ]. However, high user dropout rates are commonly noted in text-based programs [ ]. This issue represents a significant challenge, as the majority of disenrollment occurs early in these interventions, limiting the potential effectiveness of text messaging programs [ ]. In order for programs to be maximally effective, there is a need to identify modifiable predictors of engagement that can serve as the basis for strategies to reduce dropout.
Motivation is one factor that has been associated with engagement in health behavior change programs and longer-term pursuits of health behavior change . Traditional theories of motivation have typically been of limited value, in part because they have conceptualized motivation as a relatively static variable measured in terms of quantity, rather than quality [ ]. Self-Determination Theory (SDT) offers an alternative approach to characterizing motivation, and may prove to be more useful in understanding and enhancing motivation for sustained behavioral change [ - ]. SDT may also provide key insights into engagement and persistence with mobile technology-based interventions. Rather than focusing solely on motivational quantity, SDT emphasizes the importance of motivational quality in engagement with, and maintenance of, behavior [ , ]. SDT distinguishes between autonomous motivation, which arises from within the person and is congruent with other goals and values, and controlled motivation, which emerges from external and/or intrapsychic pressures (eg, incentives, approval from others, feelings of guilt or shame). Autonomous motivation has been associated with improved physical and mental health outcomes, and initiation and maintenance of health behaviors [ - ]. This study describes patterns of early dropout in the HealthyYou text (HYTxt) messaging program and examines them through the lens of SDT.
HYTxt is a free text message-based resource that provides behavioral interventions to promote healthy diet and physical activity. HYTxt was developed as a component of the US National Cancer Institute’s Smokefree.gov Initiative (SFGI). SFGI is a large, national, multi-platform program that includes websites, text message programs, smartphone apps, and social media platforms that engage with 3-6 million users annually. HYTxt is a 6-week intervention program that delivers 1-4 daily texts, including standardized behavioral intervention and social support messages that target specific health behavior goals each week, via unidirectional and bidirectional messages. At the time of enrollment, users answer a series of basic demographic questions and complete a brief motivational assessment. Users then select a behavior change goal related to healthy eating or physical activity. Throughout the program, users receive text messages that provide SDT-based intervention content, and assess their status in achieving health behavior goals. Users may discontinue the program at any time by texting the word stop to the program.
As a part of ongoing program quality assurance and improvement efforts, the sample for this project consisted of 193 consecutive individuals who enrolled in the HYtxt healthy eating stream of the text messaging program between June 2014 and December 2014, and met our inclusion criteria. Given our interest in the impact of motivation type on early dropout, we restricted our analysis to individuals with complete data for the motivation questions (described below). We did not collect information on the gender of our participants, but the program was promoted on the Smokefree Women Website  and Smokefree Women Facebook page, so the sample is presumed to be primarily women.
The dependent variable was early dropout, which was defined as actively dropping out within 2 weeks of program enrollment. Our primary independent variable was motivation quality.includes the items used to assess motivational quality, adapted from the Self-Regulation Questionnaire [ ]. Response options were very true (4), a little true (3), a little untrue (2), and very untrue (1). The autonomous motivation subscale was comprised of the mean of the identified and integrated questions; the controlled motivation subscale was comprised of the mean of the introjected and external questions. Higher values signified higher levels of motivational quality.
Users self-reported their age, educational level, and race/ethnicity during program enrollment. Users could enroll in the HYTxt program by texting a keyword on their phone or by completing the Web enrollment form. Only individuals who enrolled using the Web enrollment were asked demographic questions; therefore, demographic data were only available for that subset of users.
All analyses were conducted in SAS 9.3 (SAS Institute, Inc). Descriptive statistics were calculated and chi-square tests were conducted to examine associations between demographic characteristics and early dropout status. Logistic regression was used to test the association between early dropout and motivation type. Separate unadjusted logistic regression models for controlled motivation on dropout, and autonomous motivation on dropout, were computed. Subsequently, a model including both controlled motivation and autonomous motivation was run. For the subset of individuals with complete demographic data (n=126) we also examined the association between autonomous motivation and early dropout, controlling for demographic characteristics (ie, education level, race, and age).
|Motivation type||Question wording: I would try to eat more fruits, vegetables, and whole grains because…|
|Autonomous (identified)||Eating fruits, vegetables, and whole grains helps me feel better|
|Autonomous (integrated)||Eating more fruits, vegetables, and whole grains is an important thing for me to do|
|Controlled (introjected)||I would feel bad about myself if I didn’t|
|Controlled (external)||Others want me to eat more fruits, vegetables and whole grains|
Most users had at least some college education, were predominately white, and had an average age of 34.6 years (). There were no significant demographic differences between those who dropped out within the first 2 weeks and those who did not. Overall, 28.0% (54/193) of users dropped out of the program within the first 2 weeks.
Of those who dropped out before completing the program (83/193, 43.0%), 65.1% (54/83) of users did so within the first 2 weeks.
At the beginning of the program, most users endorsed both autonomous and controlled motivations for healthy eating; however, on average users reported higher levels of autonomous motivation (mean 3.64, standard deviation 0.49) than controlled motivation (mean 2.42, standard deviation 0.88). Users with higher autonomous motivation had significantly lower odds of dropping out of the program within the first 2 weeks. A one unit increase in autonomous motivation was associated with a significantly lower odds of early dropout (odds ratio [OR] 0.44, 95% CI 0.24–0.81; P=.008). This association persisted after adjusting for level of controlled motivation (OR 0.48, 95% CI 0.26–0.90; P=.022). Controlled motivation was not associated with early dropout (OR 0.71, 95% CI 0.49–1.02; P=.064). Given the association between autonomous motivation and early dropout, we further explored whether this association held true after controlling for demographic characteristics (67/193, 34.7% of cases were missing data, and were excluded), and autonomous motivation remained significantly associated with early dropout (OR 0.44, 95% CI 0.20–0.95; P=.035).
|Variable||% or mean (n)||Dropped out within the first 2 weeks, % (n)||P value|
|Total, % (n)|
|100.0 (193)||28.0 (54)||72.0 (139)|
|Education, % (n)|
|High school or less||18.1 (35)||22.2 (12)||16.6 (23)||0.77|
|Some college||32.6 (63)||33.3 (18)||32.4 (45)|
|College graduate or higher||19.2 (37)||18.5 (10)||19.4 (27)|
|Missing||30.1 (58)||25.9 (14)||31.7 (44)|
|Race, % (n)|
|White||48.7 (94)||59.3 (32)||44.6 (62)||0.19|
|Non-white||18.1 (35)||14.8 (8)||19.4 (27)|
|Missing||33.2 (64)||25.9 (14)||36.0 (50)|
|Age in years, mean (range)||34.6 (13-62)||32.6 (16-62)||35.5 (13-62)||0.22|
In this study, approximately two-thirds (65.1%, 54/83) of users who dropped out did so within the first 2 weeks. Users with higher levels of autonomous motivation at baseline were less likely to drop out early, even after adjusting for controlled motivation. This result is consistent with previous research that has demonstrated that autonomous motivation is predictive of initiating and maintaining health behaviors [, ].
Participants in this study were users of the HYTxt text messaging program, and were not recruited for a particular study. Although this sample represents a self-selected group, they are likely more reflective of individuals who would use the publicly available program in general than participants of a tightly controlled randomized trial would be. Not all users completed the motivation questions, resulting in a great deal of missing data for demographic correlates; therefore, our results may not be generalizable to all users of HYTxt. This analysis focused solely on motivation related to healthy eating, and other factors (eg, comfort with mobile technology) might influence dropout rates. Furthermore, we focused on those who actively opted out of the program, and cannot comment on those who may have continued to receive messages but disengaged from the program.
Comparison with Prior Work
Dropout is a significant problem in behavior change text messaging interventions. This study provides insight into a modifiable factor that influences likelihood of dropping out: autonomous motivation. The extant literature on SDT-based interventions offers potential insights into techniques that could be leveraged to promote autonomous motivation early in text messaging behavior change programs to decrease early dropout. Candidate SDT techniques include: supporting users in aligning behavior change goals with broader life goals and values; providing opportunities for choice, including opportunities to disengage from the current program and either (1) return at a later time or (2) change to another health behavior that better fits the user’s current interests and life situation; and providing content that normalizes the trial-and-error nature of the health behavior change processes, while offering strategies for dealing with failures and setbacks [- ]. While these techniques have been well-validated in more traditional intervention delivery modalities (eg, in-person or telephone-based), there is a need to translate these techniques into strategies that would be applicable when using a text messaging platform. For example, more messaging can be added at early stages that encourage users to consider how this behavior change aligns with their broader life goals and values, and ensure that users are selecting behavior change goals that are consistent with their core values. In addition, users’ progress towards meeting their goals can be assessed at regular intervals, and individuals who are struggling can be provided with additional content that both normalizes setbacks and provides strategies for dealing with these setbacks.
Text messaging interventions have the potential to reach large numbers of individuals, especially traditionally hard-to-reach populations. However, high early dropout rates inhibit the potential effectiveness of such programs. This study demonstrated that those who had higher levels of autonomous motivation were less likely to drop out in the first 2 weeks of the program, during which dropout rates were highest. Applying SDT-based strategies early in text messaging programs (to enhance autonomous motivation) might reduce early dropout rates, which in turn can improve program exposure and effectiveness.
The authors would like to acknowledge Dr. Erik Augustson for his comments on drafts of this manuscript. This study was funded in part by National Institutes of Health, National Cancer Institute HHSN261201400002B, HHSN26100006, HHSN26100007.
Conflicts of Interest
- Cole-Lewis H, Kershaw T. Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev 2010 Mar;32:56-69 [FREE Full text] [CrossRef] [Medline]
- Buhi ER, Trudnak TE, Martinasek MP, Oberne AB, Fuhrmann HJ, McDermott RJ. Mobile phone-based behavioural interventions for health: a systematic review. Health Educ J 2012 Jul 10;72(5):564-583. [CrossRef]
- Tomlinson M, Rotheram-Borus MJ, Swartz L, Tsai AC. Scaling up mHealth: where is the evidence? PLoS Med 2013 Feb;10(2):e1001382 [FREE Full text] [CrossRef] [Medline]
- Siopis G, Chey T, Allman-Farinelli M. A systematic review and meta-analysis of interventions for weight management using text messaging. J Hum Nutr Diet 2015 Feb;28 Suppl 2:1-15. [CrossRef] [Medline]
- Hall AK, Cole-Lewis H, Bernhardt JM. Mobile text messaging for health: a systematic review of reviews. Annu Rev Public Health 2015 Mar 18;36:393-415 [FREE Full text] [CrossRef] [Medline]
- Guerriero C, Cairns J, Roberts I, Rodgers A, Whittaker R, Free C. The cost-effectiveness of smoking cessation support delivered by mobile phone text messaging: Txt2stop. Eur J Health Econ 2013 Oct;14(5):789-797 [FREE Full text] [CrossRef] [Medline]
- Buis LR, Hirzel L, Turske SA, Des Jardins TR, Yarandi H, Bondurant P. Use of a text message program to raise type 2 diabetes risk awareness and promote health behavior change (part I): assessment of participant reach and adoption. J Med Internet Res 2013;15(12):e281 [FREE Full text] [CrossRef] [Medline]
- Glanz K, Rimer B, Viswanath K. Health behavior and health education: theory, research and practice. Hoboken, NJ: John Wiley & Sons; Sep 02, 2008.
- Baumeister RF, Vohs KD. Self-regulation, ego depletion, and motivation. Soc Personal Psychol Compass 2007;1(1):115-128.
- Deci EL, Ryan RM. Self-determination theory. In: Van Lange PA, Kruglanski AW, Higgins ET, editors. Handbook of Theories of Social Psychology: Volume One (SAGE Social Psychology Program). Thousand Oaks, CA: Sage Publications Ltd; 2011:416-437.
- Deci EL, Ryan RM. Facilitating optimal motivation and psychological well-being across life's domains. Canadian Psychology/Psychologie canadienne 2008 Jul;49(1):14-23. [CrossRef]
- Silva MN, Marques MM, Teixeira PJ. Testing theory in practice: The example of self-determination theory-based interventions. Eur Health Psychol 2014;16(5):171-180.
- Ng JY, Ntoumanis N, Thøgersen-Ntoumani C, Deci EL, Ryan RM, Duda JL, et al. Self-determination theory applied to health contexts: a meta-analysis. Perspect Psychol Sci 2012 Jul;7(4):325-340. [CrossRef] [Medline]
- Teixeira P, Carraça E, Markland D, Silva M, Ryan R. Exercise, physical activity, and self-determination theory: a systematic review. Int J Behav Nutr Phys Act 2012;9(1):78.
- Teixeira PJ, Silva MN, Mata J, Palmeira AL, Markland D. Motivation, self-determination, and long-term weight control. Int J Behav Nutr Phys Act 2012;9:22 [FREE Full text] [CrossRef] [Medline]
- Smokefree Women. URL: http://women.smokefree.gov [accessed 2016-09-22] URL: 6kioRwWIy [accessed 2016-09-22]
- Levesque CS, Williams GC, Elliot D, Pickering MA, Bodenhamer B, Finley PJ. Validating the theoretical structure of the Treatment Self-Regulation Questionnaire (TSRQ) across three different health behaviors. Health Educ Res 2007 Oct;22(5):691-702 [FREE Full text] [CrossRef] [Medline]
- Ryan RM, Patrick H, Deci EL, Williams GC. Facilitating health behaviour change and its maintenance: interventions based on self-determination theory. Eur Health Psychol 2008;10(1):2-5.
- Silva MN, Markland D, Carraça EV, Vieira PN, Coutinho SR, Minderico CS, et al. Exercise autonomous motivation predicts 3-yr weight loss in women. Med Sci Sports Exerc 2011 Apr;43(4):728-737. [CrossRef] [Medline]
- Williams GC, Niemiec CP, Patrick H, Ryan RM, Deci EL. The importance of supporting autonomy and perceived competence in facilitating long-term tobacco abstinence. Ann Behav Med 2009 Jun;37(3):315-324 [FREE Full text] [CrossRef] [Medline]
|HYTxt: HealthyYou text|
|OR: odds ratio|
|SDT: Self-Determination Theory|
|SFGI: Smokefree.gov Initiative|
Edited by G Eysenbach; submitted 18.05.16; peer-reviewed by L Buis, R Whittaker; comments to author 23.06.16; revised version received 16.08.16; accepted 10.09.16; published 29.09.16
©Kisha Coa, Heather Patrick. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 29.09.2016.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.