Published on 03.11.14 in Vol 2, No 4 (2014): Oct-Dec
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/3888, first published Sep 24, 2014.
The Medium and the Message: Fitting Sound Health Promotion Methodology Into 160 Characters
Comment on: http://mhealth.jmir.org/2014/4/e51/
Text messaging health promotion projects continue to proliferate due to their relative low-cost, simplicity, non-intrusiveness, and proven effectiveness in several randomized controlled trials. In these past trials, participants have typically been recruited through traditional means, received the text messaging intervention, and then completed evaluation. In this issue of the Journal of Medical Internet Research, Sheoran et al have demonstrated how use of text messaging alone can be a feasible method for all three stages: recruitment, intervention, and evaluation. Use of text messages without any other modes of communication could be a key to population-level dissemination and wider uptake of health promotion messages. However, in the rush to utilize new technologies and in the brevity of 160 characters, it should not be forgotten that quality, rigour, and careful development remain essential in any health promotion practice.
JMIR mHealth uHealth 2014;2(4):e40
There are now 96 mobile subscriptions for every 100 people on the planet , and text messaging (SMS, short message service) remains one of the most common uses of mobile phones, particularly for young people in the United States [ ]. Consequently, text messaging is being increasingly used as a health promotion tool, as highlighted recently by Sheoran et al in the Journal of Medical Internet Research [ ]. As technologies develop and projects in this field proliferate, it is vital that quality research continues to be conducted to maximize the quality of interventions, to refine the methods used, and to evaluate impact.
While the major benefit of text messaging interventions is their ability to reach people in a non-intrusive way, most trials published to date have bookended the text messaging intervention itself with traditional recruitment methodologies such as face-to-face or clinic-based recruitment and traditional evaluation methodologies such as focus group discussions or questionnaires [- ]. While this might have been considered necessary initially to provide scientific rigour, the cost and effort of going through these methods negates the key benefits and simplicity of the technology. However, it is possible to use text messages as the sole method of communication in an intervention; to identify and recruit participants, to deliver the intervention, and to evaluate the project. The Hookup provides an example of a sexual health promotion project using text messaging in all of these three ways.
Text Messaging to Recruit Participants
Text messaging health promotion and research efforts have often relied on starting with face-to-face recruitment . However, this may not be necessary and means that some of the benefits of mobile-delivered health promotion or research are lost—in particular it is more costly, time-consuming and inconvenient for both researchers and participants. Instead, researchers could utilize text messaging to recruit people with whom they have never had any contact with in any other form.
One of the greatest advantages in using text messaging to recruit participants is the feasibility for population-wide dissemination and translation of research into practice; a much lower level of engagement is needed than for other contact methods. This may be particularly salient for young people; other evaluation methods such as postal mail and landline communication have limited reach for this demographic group and may recruit only the most motivated young people. Through mixing technologies and approaches, it may be possible to reach different people who do not normally engage in research. The Hookup’s recruitment approach was opt-in, via text messages . They advertised the service widely at schools, adolescent health centers, and online but had no direct contact with potential participants. Other programs have attempted to attract users through in-person enrollment at festivals or street intercept, and use of mass media [ , - ].
Probably the most effective and efficient way to recruit participants via text messages is to partner with a telecommunications company or mobile phone provider. This allows individuals’ mobile phones to be accessed in large numbers from existing databases with very little effort [, ]. However, as discussed in depth by Gold et al, this can be problematic when the priorities of the private company and the public health or research organization do not align [ ]. A particular concern is that researchers become dependent on a third party (the private telecommunications company) to conduct their research; for example in one study 316 text message surveys were not delivered due to a mid-study block by a local mobile phone provider [ ], and in another study the telecommunications company elected to censor the content of sexual health promotion messages [ ]. Other important potential limitations to using text messaging to recruit participants are that engagement with the program may be lower, initial participation rates may be lower, and it may not be possible to validate participant characteristics (eg, age and gender) [ , ].
Text Messaging as the Intervention
Sheoran et al report that The Hookup project was successful, with 90% of respondents reporting a positive change to their behavior such as testing for sexually transmitted infection (STI) or condom use . This work supports the findings of several previous trials and reviews [ , , - ]. However, despite the success of text messaging interventions in sexual health promotion, there remains important research gaps in this area. While several studies have shown impact using text messaging, this does not mean that all text messaging programs will be effective; significant work is needed to develop effective content. As Ybarra et al, pointed out “many researchers seem to view text messaging as the intervention itself instead of simply a delivery mechanism… Like other interventions, however, the content is a central driver of the behavior change.”[ ] There has been limited use of behavior change theory to guide message development in many previous studies [ ]. The impact of important variables on the success of a project; including the timing, frequency, duration, tailoring, and interactivity of text messaging has not been fully explored [ , ]. Furthermore, while mHealth sexual health promotion interventions show great promise in developing countries [ ], to date there are no reported RCTs in this setting.
Text Messaging to Evaluate the Intervention
When evaluating a text messaging health promotion intervention, typical outcomes include process measures such as acceptability of the intervention and impact measures such as changes in knowledge and behaviors. Process measures can use a combination of data on number of subscribers, response rates and dropout rates, which should be collated throughout the project. Additionally, participants may be asked to report their opinions about the program generally and the content specifically. Impact measures can also utilize self-report data (eg, in the Hookup participants reported whether they had changed their behavior).
Common methods used previously to collect these self-report data include focus group discussions and surveys [, , ]. However, as Sheoran et al describe, in an intervention where the only contact researchers have with participants is via text messages this may not be feasible. Online evaluation is considerably simpler than 10 years ago now that many recipients can switch from a text message to an online survey instantly on a single device using Web-enabled mobile phones. However, this may bias participation to those who own smartphones and exclude those who choose only to engage with the program via text messaging. An alternative is to use text messages themselves to collect self-report questionnaire data.
Text messaging data collection in research is well established [, - ]. This method is effective, low-cost and useful, and achieves good response rates compared to other survey delivery methods [ , , , ]. The major limitation of text messaging data collection is the number of characters; the 160 character limit can make it difficult to provide sufficient detail to pose clear and valid questions. However, several studies have compared text messaging questionnaire responses to retrospective reports by more traditional survey methodologies and have demonstrated reliability over time in responses [ , , ].
An additional benefit of text messaging data collection is that it allows the possibility of using frequent (eg, daily) real-time diary-style data collection. This may improve the reliability of data beyond retrospective questionnaires through decreasing recall bias and is particularly useful for rapidly fluctuating measures (eg, mood)[, , , ]. One concern is that frequent prompts to complete data collection may influence behavior by serving as a reminder about the behavior in question; for example, one study’s participants reported that participating in a weekly text messaging sexual behavior survey made them want to have sex more often [ ].
No matter how they are collected, self-report data are subject to certain biases and limitations . Objective biological measures (eg, STI test results) would improve validity. Mobile technologies may be a pathway to achieving this; a consortium in the United Kingdom are working to develop mobile phone enabled point-of-care STI diagnostics for STI which link directly to mobile networks [ ]. Other novel technological tools for evaluating the impact of a health promotion project include direct and objective mobile data collection via an app, wearable cameras, or other electronic devices such as accelerometers [ , ]. However, these sorts of devices may not be appropriate or acceptable for measuring sexual health related behaviors.
Text messaging interventions have demonstrated effectiveness in several trials, however, there is still much to learn about how to maximize their impact. As these programs are more broadly implemented, it is important to maintain rigour in development and evaluation. When moving beyond research into health promotion practice, the burden of poor funding and shortage of research-trained staff can prohibit the conduct of high quality evaluation via other methods. Thankfully as discussed above, the text messaging tool lends itself to practical and low-cost intervention delivery, recruitment, and evaluation.
Text messaging health promotion is an exciting area offering many opportunities in implementation and evaluation, but it is vital to ensure we are not leaving behind the theory and evidence that has been carefully developed and tested on other platforms. Even though a text message is only 160 characters long, it does not mean that work in this field requires less careful consideration. While text messaging is a highly promising tool, it is important to remember that text messaging itself is not the answer but only a mode of delivery. Whatever medium we use, we still need to be certain that we are recruiting the right people, delivering the right message, and measuring the right things to conduct successful and rigorous research and health promotion.
ML is funded by an Australian Government Department of Health Preventive Health Research Fellowship, CW is funded by an Australian Postgraduate Award from Monash University, MH is funded by a National Health and Medical Research Council Senior Researcher Fellowship. The authors also gratefully acknowledge the contribution of the Victorian Operational Infrastructure Support Program received by the Burnet Institute. No specific funding was received for this work.
Conflicts of Interest
- International Telecommunication Union. 2014. Statistics URL: http://www.itu.int/en/ITU-D/Statistics/Pages/stat/default.aspx [accessed 2014-09-22] [WebCite Cache]
- Duggan M, Rainie L. Cell Phone Activities 2012. 2012. URL: http://www.pewinternet.org/2012/11/25/cell-phone-activities-2012/ [accessed 2014-09-22] [WebCite Cache]
- Sheoran B, Braun RA, Gaarde J, Levine DK. The Hookup: Collaborative Evaluation of a Youth Sexual Health Program Using Short Message Service (SMS) Technology. J Med Internet Res 2014 (forthcoming).
- Fjeldsoe BS, Marshall AL, Miller YD. Behavior change interventions delivered by mobile telephone short-message service. Am J Prev Med 2009 Feb;36(2):165-173. [CrossRef] [Medline]
- Lim MS, Hocking JS, Aitken CK, Fairley CK, Jordan L, Lewis JA, et al. Impact of text and email messaging on the sexual health of young people: a randomised controlled trial. J Epidemiol Community Health 2012 Jan;66(1):69-74. [CrossRef] [Medline]
- de Tolly KM, Constant D. Integrating mobile phones into medical abortion provision: intervention development, use, and lessons learned from a randomized controlled trial. JMIR Mhealth Uhealth 2014;2(1):e5 [FREE Full text] [CrossRef] [Medline]
- Buis LR, Hirzel L, Turske SA, Des Jardins TR, Yarandi H, Bondurant P. Use of a text message program to raise type 2 diabetes risk awareness and promote health behavior change (part I): assessment of participant reach and adoption. J Med Internet Res 2013;15(12):e281 [FREE Full text] [CrossRef] [Medline]
- Gold J, Lim MS, Hocking JS, Keogh LA, Spelman T, Hellard ME. Determining the impact of text messaging for sexual health promotion to young people. Sex Transm Dis 2011 Apr;38(4):247-252. [CrossRef] [Medline]
- Lee HY, Koopmeiners JS, Rhee TG, Raveis VH, Ahluwalia JS. Mobile phone text messaging intervention for cervical cancer screening: changes in knowledge and behavior pre-post intervention. J Med Internet Res 2014;16(8):e196 [FREE Full text] [CrossRef] [Medline]
- Chib A, Wilkin H, Ling LX, Hoefman B, Van Biejma H. You have an important message! Evaluating the effectiveness of a text message HIV/AIDS campaign in Northwest Uganda. J Health Commun 2012;17 Suppl 1:146-157. [CrossRef] [Medline]
- Gold J, Hellard M, Lim M, Dixon H, Wakefield M, Aitken C. Public-Private Partnerships for Health Promotion. American Journal of Health Education 2012 Jul;43(4):250-253. [CrossRef]
- Curran K, Mugo NR, Kurth A, Ngure K, Heffron R, Donnell D, et al. Daily short message service surveys to measure sexual behavior and pre-exposure prophylaxis use among Kenyan men and women. AIDS Behav 2013 Nov;17(9):2977-2985. [CrossRef] [Medline]
- Kew S. Text messaging: an innovative method of data collection in medical research. BMC Res Notes 2010;3:342 [FREE Full text] [CrossRef] [Medline]
- Cole-Lewis H, Kershaw T. Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev 2010 Apr;32(1):56-69 [FREE Full text] [CrossRef] [Medline]
- Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, et al. The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS Med 2013;10(1):e1001362 [FREE Full text] [CrossRef] [Medline]
- Gold J, Aitken CK, Dixon HG, Lim MS, Gouillou M, Spelman T, et al. A randomised controlled trial using mobile advertising to promote safer sex and sun safety to young people. Health Educ Res 2011 Oct;26(5):782-794 [FREE Full text] [CrossRef] [Medline]
- De Leon E, Fuentes LW, Cohen JE. Characterizing periodic messaging interventions across health behaviors and media: systematic review. J Med Internet Res 2014;16(3):e93 [FREE Full text] [CrossRef] [Medline]
- Ybarra ML, Holtrop JS, Bağci Bosi AT, Emri S. Design considerations in developing a text messaging program aimed at smoking cessation. J Med Internet Res 2012;14(4):e103 [FREE Full text] [CrossRef] [Medline]
- Vahdat HL, L'Engle KL, Plourde KF, Magaria L, Olawo A. There are some questions you may not ask in a clinic: providing contraception information to young people in Kenya using SMS. Int J Gynaecol Obstet 2013 Nov;123 Suppl 1:e2-e6 [FREE Full text] [CrossRef] [Medline]
- Wilkins A, Mak DB. . . . Sending out an SMS: an impact and outcome evaluation of the Western Australian Department of Health's 2005 chlamydia campaign. Health Promot J Austr 2007 Aug;18(2):113-120. [Medline]
- Whitford HM, Donnan PT, Symon AG, Kellett G, Monteith-Hodge E, Rauchhaus P, et al. Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project. J Am Med Inform Assoc 2012;19(5):744-749 [FREE Full text] [CrossRef] [Medline]
- Lim MS, Sacks-Davis R, Aitken CK, Hocking JS, Hellard ME. Randomised controlled trial of paper, online and SMS diaries for collecting sexual behaviour information from young people. J Epidemiol Community Health 2010 Oct;64(10):885-889. [CrossRef] [Medline]
- Bexelius C, Merk H, Sandin S, Ekman A, Nyrén O, Kühlmann-Berenzon S, et al. SMS versus telephone interviews for epidemiological data collection: feasibility study estimating influenza vaccination coverage in the Swedish population. Eur J Epidemiol 2009;24(2):73-81. [CrossRef] [Medline]
- Lagerros YT, Sandin S, Bexelius C, Litton JE, Löf M. Estimating physical activity using a cell phone questionnaire sent by means of short message service (SMS): a randomized population-based study. Eur J Epidemiol 2012 Jul;27(7):561-566. [CrossRef] [Medline]
- Ybarra ML, Holtrop JS, Prescott TL, Strong D. Process evaluation of a mHealth program: Lessons learned from Stop My Smoking USA, a text messaging-based smoking cessation program for young adults. Patient Educ Couns 2014 Jul 17. [CrossRef] [Medline]
- Khosropour CM, Johnson BA, Ricca AV, Sullivan PS. Enhancing retention of an Internet-based cohort study of men who have sex with men (MSM) via text messaging: randomized controlled trial. J Med Internet Res 2013;15(8):e194 [FREE Full text] [CrossRef] [Medline]
- Garcia C, Hardeman RR, Kwon G, Lando-King E, Zhang L, Genis T, et al. Teenagers and texting: use of a youth ecological momentary assessment system in trajectory health research with latina adolescents. JMIR Mhealth Uhealth 2014;2(1):e3 [FREE Full text] [CrossRef] [Medline]
- Schnall R, Okoniewski A, Tiase V, Low A, Rodriguez M, Kaplan S. Using text messaging to assess adolescents' health information needs: an ecological momentary assessment. J Med Internet Res 2013;15(3):e54 [FREE Full text] [CrossRef] [Medline]
- Catania JA, Gibson DR, Chitwood DD, Coates TJ. Methodological problems in AIDS behavioral research: influences on measurement error and participation bias in studies of sexual behavior. Psychol Bull 1990 Nov;108(3):339-362. [Medline]
- UKCRC translational infection research initiative consortium. electronic self testing instruments for sexually transmitted infections URL: http://www.esti2.org.uk/node/68 [accessed 2014-09-22] [WebCite Cache]
- Dalton AF, Ní Scanaill C, Carew S, Lyons D, OLaighin G. A clinical evaluation of a remote mobility monitoring system based on SMS messaging. Conf Proc IEEE Eng Med Biol Soc 2007 Jan;2007:2327-2330. [CrossRef] [Medline]
- Gemming L, Doherty A, Kelly P, Utter J, Ni Mhurchu C. Feasibility of a SenseCam-assisted 24-h recall to reduce under-reporting of energy intake. Eur J Clin Nutr 2013 Oct;67(10):1095-1099. [CrossRef] [Medline]
Edited by G Eysenbach; This is a non–peer-reviewed article. submitted 24.09.14; accepted 24.09.14; published 03.11.14
©Megan S C Lim, Cassandra Wright, Margaret E Hellard. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 03.11.2014.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.