Review
Abstract
Background: The World Health Organization recommends that all adults with HIV adhere to antiretroviral therapy (ART). Good adherence to ART is beneficial to patients and the public. Furthermore, mHealth has shown promise in improving HIV medication adherence globally.
Objective: The aim of this meta-analysis is to analyze the effectiveness of mHealth on adherence to antiretroviral therapy in patients living with HIV.
Methods: Randomized controlled trials (RCTs) of the association between mHealth and adherence to ART published until December 2021 were searched in electronic databases. Odds ratios (ORs), weighted mean differences, and 95% CIs were calculated. This meta-analysis was performed using the Mantel-Haenszel method or the inverse variance test. We evaluated heterogeneity with the I2 statistic. If I2 was ≤50%, heterogeneity was absent, and a fixed effect model was used. If I2 was >50%, heterogeneity was present, and a random effects model was used.
Results: A total of 2163 participants in 8 studies were included in this meta-analysis. All included studies were RCTs. The random effects model was used for a meta-analysis of the effects of various intervention measures compared to routine nursing; the outcome was not statistically significant (OR 1.54, 95% CI 0.99-2.38; P=.05). In the subgroups, only short messaging service (SMS)-based interventions significantly increased adherence to ART (OR 1.76, 95% CI 1.07-2.89; P=.03). Further analysis showed that only interactive or bidirectional SMS could significantly increase ART adherence (OR 1.69, 95% CI 1.22-2.34; P=.001). After combining the difference in CD4 cell count before and after the interventions, we concluded that there was no statistical heterogeneity among the studies (I2=0%; tau2=0.37; P=.95).
Conclusions: Interactive or bidirectional SMS can enhance intervention effects. However, whether mHealth can improve adherence to ART in patients with HIV needs further study. Owing to a lack of the required significant staff time, training, and ongoing supervision, there is still much more to do to apply mHealth to the clinical use of ART for patients living with HIV.
Trial Registration: PROSPERO CRD42022358774; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=358774
doi:10.2196/42799
Keywords
Introduction
HIV is a public health issue that every country needs to address. There were an estimated 37.7 million people living with HIV at the end of 2020 [
]. The World Health Organization (WHO) recommends that all adults with HIV should adhere to antiretroviral therapy (ART) [ ]. ART does not cure HIV infection but strongly suppresses viral replication within a person’s body and modifies HIV from a terminal illness to a manageable chronic disease [ ]. One of the most significant factors in the effectiveness of ART is adherence [ ]. Good adherence to ART is beneficial to patients and public health [ , ]. In contrast, lack of adherence increases the risk of progression to AIDS and the creation of drug-resistant strains of HIV [ ]. Therefore, it is important to promote ART adherence through special techniques [ , ]. However, traditional ART adherence interventions are limited in their ability to maintain behavior modification [ ]. Mobile health (mHealth) technology, which refers to the use of mobile and wireless technologies to improve health, has shown promise in improving HIV medication adherence, both globally and domestically [ , , ]. Therefore, we performed a meta-analysis of the effectiveness of mHealth for improving adherence to ART in patients living with HIV.Methods
Ethical Considerations
This paper contains no primary data obtained directly from research participants. Data obtained from previously published resources have been acknowledged with references. Ethical approval was not required.
Protocol Registration
The review protocol was prospectively registered with PROSPERO (International Prospective Register of Systematic Reviews; CRD42022358774).
Search Strategy
This meta-analysis was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement guidelines [
]. Searching was conducted using the electronic databases PubMed, EMbase, CINAHL, ScienceDirect, the Cochrane Library, Web of Science, and ClinicalTrials.gov to identify original articles meeting the evaluation criteria for inclusion and exclusion published until December 2021. Searching was conducted and evaluated by 2 independent reviewers. The search strategy for identifying studies included the key terms mobile health, human immunodeficiency virus, medication adherence, randomized controlled trial, and other related terms. These keywords were also combined using the OR and AND operators ( ).Inclusion and Exclusion Criteria
The screening process was divided into 2 phases: a preliminary selection by title and abstract and a second phase that screened the full text of the remaining articles. Articles were included based on the following criteria: (1) they reported the results of a randomized controlled trial (RCT); (2) they included HIV-positive persons receiving antiretroviral treatment regardless of age, sex, or nationality; (3) the intervention measures included, but were not limited to, short message service (SMS) texts and voice calls; (4) an mHealth intervention was used in the experimental group with no limits on intervention frequency, time, content, or period and the control group received routine nursing at the same time to help patients improve their treatment compliance; and (5) the primary outcome was adherence to ART. This was measured directly (eg, by pill count) or indirectly (eg, by self-reporting). If the article reported the use of a variety of measurement methods, priority was given to measurement results obtained with the self-report method. The secondary outcome was CD4 cell count.
The exclusion criteria included the following: (1) the study was a duplicate, (2) the study was a systematic review or meta-analysis, (3) the study was missing outcome measures, (4) the experimental group used a variety of interventions, and (5) the control group did not receive routine nursing.
Data Extraction
A predesigned Excel sheet was used to extract and organize the data into categories by 2 independent researchers. These data included (1) authors, (2) location, (3) publication date, (4) intervention details (ie, intervention mode and duration), (5) outcome measures, including ART adherence and CD4 cell counts, and (6) risk of bias.
Risk of Bias and Quality Assessment
Two of the authors assessed the risk of bias using RevMan (version 5.4; Cochrane Collaboration); the results are summarized in
. The Cochrane Collaboration’s Risk of Bias tool was also used to assess quality and risk of bias. This tool assesses bias in 7 domains: random sequence generation (for selection bias), concealment of the allocation sequence (for selection bias), blinding of participants and personnel (for performance bias), blinding of outcome assessment (for detection bias), incomplete outcome data (for attrition bias), selective outcome reporting (for reporting bias), and other biases. Studies are assigned a low risk of bias, an unclear risk of bias, or a high risk of bias.Data Analysis
The meta-analysis was conducted using RevMan. Measures of effect are presented as odds ratios (ORs) with the 95% CI. For continuous data, we calculated the sample-size weighted mean difference (WMD). This meta-analysis was performed using the Mantel-Haenszel method or the inverse variance test. We evaluated heterogeneity with the I2 statistic. If I2 was ≤50%, heterogeneity was absent, and a fixed effect model was used. If I2 was >50%, heterogeneity was present, and a random effects model was used.
Results
Study Selection Process
The search strategy identified 2783 articles from the electronic databases. In total, 423 articles were excluded because of duplication. We screened the titles and abstracts of the remaining articles and included 26 for full-text review based on the inclusion and exclusion criteria. Of these 26 studies, 8 met the inclusion criteria, and 18 studies were excluded: 15 because they were missing outcome measures, 1 because a variety of interventions were used in the experimental group, and 2 because they did not use routine nursing in the control group. Therefore, 8 studies were selected for the current meta-analysis [
, , - ] ( ).Study Characteristics
The characteristics of the studies are summarized in
. All included studies were RCTs. A total of 2163 participants in 8 studies were included in this meta-analysis. Except for the study by Mbuagbaw et al [ ], all participants in the studies were aged 18 years or older. Study duration ranged between 1 and 12 months. SMS was used as the basis for the intervention in 6 studies. One of these studies used an mHealth intervention program that included text messages and WeChat. The remaining studies used voice calls.First author, year | Location | Participants, n (age, years) | Recruitment period (duration) | Intervention | Outcome measures |
Ruan, 2017 [ | ]Hengyang, China | 100 (≥18) | Mar 2013-Mar 2014 (6 months) | SMSa | ARTb adherence measured by VASc, Community Programs for Clinical Research on AIDS Antiretroviral Medication Self-Report, and CD4 cell count |
Guo, 2018 [ | ]South China | 53 (≥18) | Oct 2016-Mar 2017 (3 months) | SMS and WeChat | CD4 cell count |
Shet, 2014 [ | ]South India | 631 (18-60) | Jul 2010-Aug 2011 (6 months) | Customized motivational voice call | ART adherence measured by pill count |
Sherman, 2020 [ | ]South Florida, US | 94 (>18) | Sept 2011-Apr 2014 (3-6 months) | Automated 1-way medication reminders delivered via SMS | ART adherence measured by VAS and CD4 cell count |
Lester, 2010 [ | ]Kenya | 538 (>18) | May 2007-Oct 2008 (12 months) | SMS | ART adherence measured by self-report |
Sabin, 2015 [ | ]Guangxi, China | 119 (≥18) | Dec 2012-Apr 2013 (6 months) | SMS | ART adherence measured by a medication device |
Pop-Eleches, 2011 [ | ]Kenya | 428 (>18) | Jun 2007-Aug 2008 (3-12 months) | SMS | ART adherence measured by a medication event monitoring system and CD4 cell count |
Mbuagbaw, 2013 [ | ]Cameroon | 200 (≥21) | Nov 2010-Dec 2010 (3-6 months) | Weekly standardized motivational text message | VAS and self-reported adherence |
aSMS: short message service.
bART: antiretroviral therapy.
cVAS: visual analog scale.
Meta-analysis
Medication Adherence
Adherence to ART was measured as a primary outcome in 7 studies. The method and frequency of measuring adherence varied across the studies. The details are listed in
. A random effects model was used for a meta-analysis of the effects of various intervention measures and routine nursing; the outcome was not statistically significant (OR 1.54, 95% CI 0.99-2.38; P=.05). There was also evidence of heterogeneity among the studies (I2=74%; tau2=0.23; P<.001; ). In the subgroups, only SMS interventions significantly increased adherence to ART (OR 1.76, 95% CI 1.07-2.89; P=.03).Medication Adherence With SMS Intervention
Six studies were included in a meta-analysis of the effect of SMS on adherence to ART; this showed that SMS could improve adherence (OR 1.76, 95% CI 1.07-2.89; P=.03) but also revealed considerable heterogeneity among the included studies (I2=69%; tau2=0.25; P=.007;
). In the subgroups, only interactive or bidirectional SMS interventions could significantly increase ART adherence (OR 1.69, 95% CI 1.22-2.34; P=.001). However, these studies did not show statistical heterogeneity (I2=0%; tau2=0.00; P=.41). A subgroup analysis of studies with unidirectional SMS interventions showed no statistical heterogeneity, but the analysis also showed a lack of effect in improving adherence ( ).CD4 Cell Count
Four studies reported CD4 cell count as a secondary outcome of medication adherence. Combining the differences in CD4 cell count before and after the interventions revealed no statistical heterogeneity among the studies (I2=0%; tau2=0.37; P=.95;
). Meta-analysis showed that CD4 cell count measures after mHealth interventions revealed no significant difference in medication adherence among HIV patients compared with routine nursing (WMD=20.85, 95% CI 1.60-43.29; P=.07; ). Only 2 studies reported viral load as an outcome to evaluate the intervention effect, so we did not perform a meta-analysis.Discussion
Principal Findings
A total of 2163 participants in 8 studies were included in this meta-analysis. The main result of the meta-analysis was that the pooled OR was 1.54. However, the outcome was not statistically significant, and there was considerable heterogeneity among the studies (I2=74%). Within-study heterogeneity reduces study robustness and relevance [
]. Our current results are different from those of a 2015 study [ ]. That study found that mHealth interventions did seem to have been beneficial. We speculate that one of the possible reasons for this difference is that the number of articles included in our study was limited. Also, the different studies used a variety of methods to measure results. However, compared with the 2015 study, this meta-analysis combined the outcomes (separately for primary and secondary outcomes) to increase the reliability of the results.A subgroup analysis showed that SMS interventions improved adherence to ART. Further analysis suggested that interactive or bidirectional SMS interventions could enhance intervention effects. This result matches that of a 2014 study [
]. Interactive or bidirectional SMS could increase medication adherence by enhancing engagement and the patient-provider relationship. Follow-up research could further study the content, time, and frequency of text messages. In this study, due to limitations arising from incomplete reporting of the relevant content, these aspects of the intervention were not analyzed.CD4 cell count and viral load are good indicators of treatment success [
]. Several previous reviews did not obtain the same results as this study for CD4 cell count. One study [ ] showed that compared to a control group, a group receiving text message–based support was more likely to maintain an adherence threshold at follow-up and meet the clinical goal of a higher CD4 cell count. However, another study [ ], like ours, did not obtain this result. Our meta-analysis of the 4 studies that reported CD4 cell count showed considerable heterogeneity and no significant pooled mean difference. This may be attributable to the heterogeneity of the studies. We did not perform a meta-analysis of studies that measured viral load, as there was an insufficient number of these studies.The WHO recommends mHealth strategies for improving ART adherence [
]. At the same time, against the background of the coronavirus epidemic, telemedicine has gradually continued to develop [ ]. Currently, 95% of people use mobile phones and 77% of people use smartphones in different parts of the world [ ]; mHealth has shown promise in increasing the accessibility of self-management interventions [ ] and improving HIV health outcomes [ ]. At the same time, research has indicated that patients living with HIV are interested in mobile apps to support HIV self-management [ ]. However, most current mHealth interventions lack functionality, offering only medication reminders [ ] or voice calls. Therefore, more comprehensive mHealth interventions that address multiple self-management needs of patients living with HIV are needed [ ]. At the same time, the implementation of ART interventions in real-world clinical settings has been severely limited by a lack of the resources required to initiate and maintain the interventions [ ], such as staff time, training, and ongoing supervision. Future research should focus on how to apply personalized mHealth interventions to the management of patients living with HIV.Limitations
There are several limitations of the current review. The interventions used in the included studies differed in form and frequency. At the same time, these studies used diverse methods for measuring their primary outcomes. This may have produced bias. The robustness and relevance of results increase with the number of distinct outcome measures that show the same result [
]. However, few of the included studies reported CD4 cell count or viral load, and our analysis of these outcomes is thus insufficient.Conclusion
Interactive or bidirectional SMS interventions can enhance intervention effects. However, whether mHealth can improve adherence to ART in patients with HIV is a question that needs further study. Owing to a lack of staff time, training, and ongoing supervision, there is still much work to be done to use mHealth in the clinic for ART adherence among patients living with HIV.
Acknowledgments
This work has been partly supported by the Program for Youth Backbone Teacher Training in University of Henan Province (2019GGJS021), and Science and Technology Project in Henan province in 2018 (182102310201).
Conflicts of Interest
None declared.
Keywords.
DOCX File , 46 KBReferences
- HIV/AIDS: key facts. World Health Organization. URL: https://www.who.int/news-room/fact-sheets/detail/hiv-aids [accessed 2022-07-20]
- Nachega J, Skinner D, Jennings L, Magidson J, Altice F, Burke J, et al. Acceptability and feasibility of mHealth and community-based directly observed antiretroviral therapy to prevent mother-to-child HIV transmission in South African pregnant women under Option B+: an exploratory study. Patient Prefer Adherence 2016;10:683-690 [FREE Full text] [CrossRef] [Medline]
- Chory A, Callen G, Nyandiko W, Njoroge T, Ashimosi C, Aluoch J, et al. A pilot study of a mobile intervention to support mental health and adherence among adolescents living with HIV in western Kenya. AIDS Behav 2022 Jan;26(1):232-242 [FREE Full text] [CrossRef] [Medline]
- Ruan Y, Xiao X, Chen J, Li X, Williams AB, Wang H. Acceptability and efficacy of interactive short message service intervention in improving HIV medication adherence in Chinese antiretroviral treatment-naïve individuals. Patient Prefer Adherence 2017;11:221-228 [FREE Full text] [CrossRef] [Medline]
- De Costa A, Shet A, Kumarasamy N, Ashorn P, Eriksson B, Bogg L, HIVIND study team. Design of a randomized trial to evaluate the influence of mobile phone reminders on adherence to first line antiretroviral treatment in South India--the HIVIND study protocol. BMC Med Res Methodol 2010 Mar 26;10:25 [FREE Full text] [CrossRef] [Medline]
- Duthely LM, Sanchez-Covarrubias AP, Mohamed AB, Potter JE. A multilingual, culturally competent mobile health intervention to improve treatment adherence among women living with hiv: protocol for a randomized controlled trial. JMIR Res Protoc 2020 Jun 19;9(6):e17656 [FREE Full text] [CrossRef] [Medline]
- DeSilva M, Vu CN, Bonawitz R, Hai LT, Van Lam N, Yen LT, et al. The Supporting Adolescent Adherence in Vietnam (SAAV) study: study protocol for a randomized controlled trial assessing an mHealth approach to improving adherence for adolescents living with HIV in Vietnam. Trials 2019 Feb 28;20(1):150 [FREE Full text] [CrossRef] [Medline]
- Baranoski AS, Meuser E, Hardy H, Closson EF, Mimiaga MJ, Safren SA, et al. Patient and provider perspectives on cellular phone-based technology to improve HIV treatment adherence. AIDS Care 2014 Jan;26(1):26-32 [FREE Full text] [CrossRef] [Medline]
- Sabin L, Bachman DeSilva M, Gill C, Zhong L, Vian T, Xie W, et al. Improving adherence to antiretroviral therapy with triggered real-time text message reminders: the China Adherence Through Technology Study. J Acquir Immune Defic Syndr 2015 Aug 15;69(5):551-559 [FREE Full text] [CrossRef] [Medline]
- Ramsey SE, Ames EG, Uber J, Habib S, Clark S, Waldrop D. A preliminary test of an mHealth facilitated health coaching intervention to improve medication adherence among persons living with HIV. AIDS Behav 2021 Nov;25(11):3782-3797 [FREE Full text] [CrossRef] [Medline]
- Fuchs JD, Stojanovski K, Vittinghoff E, McMahan VM, Hosek SG, Amico KR, et al. A mobile health strategy to support adherence to antiretroviral preexposure prophylaxis. AIDS Patient Care STDS 2018 Mar;32(3):104-111 [FREE Full text] [CrossRef] [Medline]
- Martin CA, Upvall MJ. A mobile phone HIV medication adherence intervention: Acceptability and feasibility study. J Assoc Nurses AIDS Care 2016;27(6):804-816. [CrossRef] [Medline]
- Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009 Jul 21;6(7):e1000097 [FREE Full text] [CrossRef] [Medline]
- Guo Y, Xu Z, Qiao J, Hong YA, Zhang H, Zeng C, et al. Development and feasibility testing of an mHealth (text message and WeChat) intervention to improve the medication adherence and quality of life of people living with HIV in China: pilot randomized controlled trial. JMIR Mhealth Uhealth 2018 Sep 04;6(9):e10274 [FREE Full text] [CrossRef] [Medline]
- Shet A, De Costa A, Kumarasamy N, Rodrigues R, Rewari BB, Ashorn P, HIVIND Study Team. Effect of mobile telephone reminders on treatment outcome in HIV: evidence from a randomised controlled trial in India. BMJ 2014 Oct 24;349:g5978 [FREE Full text] [CrossRef] [Medline]
- Sherman EM, Niu J, Elrod S, Clauson KA, Alkhateeb F, Eckardt P. Effect of mobile text messages on antiretroviral medication adherence and patient retention in early HIV care: an open-label, randomized, single center study in south Florida. AIDS Res Ther 2020 May 13;17(1):16 [FREE Full text] [CrossRef] [Medline]
- Lester RT, Ritvo P, Mills EJ, Kariri A, Karanja S, Chung MH, et al. Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): a randomised trial. Lancet 2010 Nov 27;376(9755):1838-1845. [CrossRef] [Medline]
- Pop-Eleches C, Thirumurthy H, Habyarimana JP, Zivin JG, Goldstein MP, de Walque D, et al. Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders. AIDS 2011 Mar 27;25(6):825-834 [FREE Full text] [CrossRef] [Medline]
- Mbuagbaw L, Thabane L, Ongolo-Zogo P, Lester RT, Mills EJ, Smieja M, et al. The Cameroon Mobile Phone SMS (CAMPS) trial: a randomized trial of text messaging versus usual care for adherence to antiretroviral therapy. PLoS One 2012;7(12):e46909 [FREE Full text] [CrossRef] [Medline]
- Bärnighausen T, Chaiyachati K, Chimbindi N, Peoples A, Haberer J, Newell M. Interventions to increase antiretroviral adherence in sub-Saharan Africa: a systematic review of evaluation studies. Lancet Infect Dis 2011 Dec;11(12):942-951 [FREE Full text] [CrossRef] [Medline]
- Anglada-Martinez H, Riu-Viladoms G, Martin-Conde M, Rovira-Illamola M, Sotoca-Momblona JM, Codina-Jane C. Does mHealth increase adherence to medication? Results of a systematic review. Int J Clin Pract 2015 Jan;69(1):9-32. [CrossRef] [Medline]
- Finitsis DJ, Pellowski JA, Johnson BT. Text message intervention designs to promote adherence to antiretroviral therapy (ART): a meta-analysis of randomized controlled trials. PLoS One 2014;9(2):e88166 [FREE Full text] [CrossRef] [Medline]
- Lv Q, Jiang Y, Qi J, Zhang Y, Zhang X, Fang L, et al. Using mobile apps for health management: a new health care mode in China. JMIR Mhealth Uhealth 2019 Jun 03;7(6):e10299 [FREE Full text] [CrossRef] [Medline]
- Mehra N, Tunje A, Hallström IK, Jerene D. Effectiveness of mobile phone text message reminder interventions to improve adherence to antiretroviral therapy among adolescents living with HIV: A systematic review and meta-analysis. PLoS One 2021;16(7):e0254890 [FREE Full text] [CrossRef] [Medline]
- Consolidated guidelines on the use of antiretroviral drugs for treating and preventing HIV infection: recommendations for a public health approach, 2nd ed. World Health Organization. 2016. URL: https://www.who.int/publications/i/item/9789241549684 [accessed 2022-07-20]
- Ameli V, Haberer J, Sabin L, Meinck F, Barlow J, Taj L, et al. Tailored mHealth intervention for improving treatment adherence for people living with HIV in Iran (HamRaah): protocol for a feasibility study and randomised pilot trial with a nested realist evaluation. BMJ Open 2021 Jun 23;11(6):e042296 [FREE Full text] [CrossRef] [Medline]
- Lee SB, Valerius J. mHealth interventions to promote anti-retroviral adherence in HIV: narrative review. JMIR Mhealth Uhealth 2020 Aug 28;8(8):e14739 [FREE Full text] [CrossRef] [Medline]
- Cooper V, Clatworthy J, Whetham J, Consortium E. mHealth interventions to support self-management in HIV: a systematic review. Open AIDS J 2017;11:119-132 [FREE Full text] [CrossRef] [Medline]
- Lucero RJ, Frimpong JA, Fehlberg EA, Bjarnadottir RI, Weaver MT, Cook C, et al. The relationship between individual characteristics and interest in using a mobile phone app for HIV self-management: observational cohort study of people living with HIV. JMIR Mhealth Uhealth 2017 Jul 27;5(7):e100 [FREE Full text] [CrossRef] [Medline]
- Ramsey S, Ames E, Uber J, Habib S, Clark S. A mobile health app to improve HIV medication adherence: protocol for a pilot randomized controlled trial. JMIR Res Protoc 2019 Nov 13;8(11):e15356 [FREE Full text] [CrossRef] [Medline]
- Claborn KR, Fernandez A, Wray T, Ramsey S. Computer-based HIV adherence promotion interventions: a systematic review. Transl Behav Med 2015 Sep;5(3):294-306 [FREE Full text] [CrossRef] [Medline]
Abbreviations
ART: antiretroviral therapy |
mHealth: mobile health |
OR: odds ratio |
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses |
RCT: randomized controlled trial |
SMS: short message service |
VAS: visual analog scale |
WMD: weighted mean difference |
Edited by L Buis; submitted 19.09.22; peer-reviewed by E Sanders, A Bwanika Naggirinya; comments to author 18.11.22; revised version received 08.12.22; accepted 21.12.22; published 23.01.23
Copyright©Liang Sun, Mengbing Qu, Bing Chen, Chuancang Li, Haohao Fan, Yang Zhao. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 23.01.2023.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.