Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, March 11, 2019 at 4:00 PM to 4:30 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 06.03.19 in Vol 7, No 3 (2019): March

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/9904, first published Jan 29, 2018.

This paper is in the following e-collection/theme issue:

    Original Paper

    Experience of Using an App in HIV Patients Older Than 60 Years: Pilot Program

    1Unidad de Medicina Interna Hospital Costa del Sol, Marbella, Spain

    2Servicio de Farmacia, Hospital Costa del Sol, Marbella, Spain

    3Unidad de Investigación, Hospital Costa del Sol, Marbella, Spain

    4Asociación Concordia Antisida, Marbella, Spain

    Corresponding Author:

    Julián Olalla, MD, PhD

    Unidad de Medicina Interna Hospital Costa del Sol

    A-7, Km 187,

    Marbella, 29603

    Spain

    Phone: 34 951976669 ext 125

    Email:


    ABSTRACT

    Background: New technologies can promote knowledge of HIV infection among patients suffering from this disease. Older patients with HIV infection represent an increasingly large group that could benefit from the use of specific apps.

    Objective: The aim of the study was to observe the acceptability and use of a mobile app on HIV infection in patients at least 60 years old and offer them the possibility of anonymously establishing contact with their peers.

    Methods: A series of clinical and psychosocial parameters were studied in 30 HIV-infected patients of over 60 years. The patients must be at least 60 years old, with a follow-up in the outpatient clinic for at least 1 year and without pathologies that limit his or her life expectancy to less than a year. They must know how to read and write. To be part of the group assigned to the app, they had to have their own smartphone and confirm that they were connected to the internet from that device. Overall, 15 of them were randomized to use an app and 15 were in the control group. All tests were repeated after 6 months.

    Results: The median age of patients was 66.5 years. Among them, 29 patients had an undetectable viral load at baseline. The median number of comorbid diseases was 2. Overall, 11 of them lived with their partners and 19 lived alone. They spent an average of 5 hours a day sitting down, and 56% (17/30) of them referred high physical activity. They scored 4 out of 5 for general quality of life perception. Moreover, 80% (24/30) presented high adherence to their treatment, and the average number of concomitant medications was 5. In the 6-min walking test, they covered a distance of 400 meters, and 3 of them desaturated during the test. The 15 patients made frequent use of the app, with 2407 sessions and an average of 7 min and 56 seconds time of use with a total of 13,143 screen views. During the 6 months of the trial, 3 non-AIDS events took place. There were no significant modifications to body mass index, blood pressure measurements, lipid profile, or immuno-virology information data. There were no differences in the questionnaire scores for perception of quality of life, confessed physical activity, or antiretroviral treatment (ART) and non-ART treatment adherence.

    Conclusions: Significant differences between studied parameters were not objectified in these patients, possibly because this trial has significant limitations, such as a small sample size and only a brief follow-up period. However, patients did use the app frequently, making this a possible intervention to be proposed in future subsequent studies.

    JMIR Mhealth Uhealth 2019;7(3):e9904

    doi:10.2196/mhealth.9904

    KEYWORDS



    Introduction

    Background

    The proportion of older adults infected with HIV grows progressively [1], not only because of increased survival of cohorts but also because of an increase in the number of new diagnoses in this group of population [2,3]. With the increasing age of our patients, the possibility of AIDS diagnosis event, serious non-AIDS events (osteoporosis, renal failure, vascular events, non-AIDS cancers, and neurocognitive impairment), or metabolic conditions (diabetes, hypertension, and hyperlipidemia) that are associated with increased morbidity and mortality rises [4,5]. All these conditions are encompassed in the concept of comorbidities. These patients are a population group in which the accumulation of different types of medications and the potential for toxicity and interactions will also be greater [6]. The social stigma that accompanies HIV infection is not negligible, especially in patients of older age; so being able to share their experience with their peers could lead to reducing feelings of loneliness and stigmatization. The use of these technologies in smartphones (mobile health) has also been developed in the HIV-infected population, although a specific HIV-infected older adults’ experience has not been reported yet [7,8]. Probably, compared with the younger infected ones, older adults are a differentiated group, who are less accustomed to the use of new technologies and have a special interest in being informed not only about HIV infection but also about the comorbidities associated with age. In addition, the isolation is greater in older individuals, so an app specifically designed for this group could be useful [9].

    New technologies allow the creation of virtual communities that help to maintain the anonymity of the individual while allowing interaction with other peers [10]. The creation of peer support groups formed with reference and access to tips for health promotion and commented on by medical personnel news may have beneficial effects in this population. Anonymity could favor those people who would not participate in face-to-face activities or with fear of losing their privacy and those who could benefit from being supported by peers. This can be especially important in older people belonging to generations in which HIV infection or sexual condition was associated with a certain stigma in Spain [11].

    Objectives

    The GoSHAPE 2015 program was supported by Gilead to promote the use of new technologies and the empowerment of patients. In this context, we deliver the development of an app. Being a pilot study, our objective was to observe the acceptability and use of a mobile app on HIV infection in patients at least 60 years old as well as offer the possibility of establishing anonymous contact between peers.


    Methods

    Investigative Team

    The study was led by Costa del Sol Hospital Internal Medicine Unit (Marbella, Spain), in collaboration with the Pharmacy unit, the department of clinical investigation, and a local nongovernmental organization (Concordia). The approval of the local ethics committee was obtained, and all the patients signed informed consent before any study performance.

    A prospective observational study was conducted in 2 phases. An app with different content was designed, and afterward, this app was tested with the patients over 6 months. The name of the app was e-ging (Figure 1). After registering, the patients accessed the menu screen, where they could choose among the different options of the app.

    The app consisted of 3 different sections, which can be seen in Figure 2:

    • News (medical, health care, social, and healthy aging): Always focusing on commenting on news about HIV infection that was being spread in the national and international press. Some of the news was “What is osteoporosis and why is it produced?,” “alcohol causes 250,000 deaths from liver cancer per year,” “the dangers of high blood pressure,” “the epidemic of loneliness as a threat to health,” “the link between HIV and heart attack,” and “advances in the vaccine against HIV.”
    • Reports: Information in understandable language about key aspects of the infection, such as the meaning of CD4 and viral load, antiretroviral treatment (ART) components, vaccine effectiveness, and smoking habit. Some of the reports were “What does CD4 and viral load mean?,” “What vaccines should I take?,” “What are opportunistic infections?,” “The importance of papilloma virus,” and “WHO recommendations on physical activity.”
    • Chat: Designed for the purpose of anonymously exchanging opinions between patients. The patients were explicitly explained that the comments of the chat would be analyzed (in frequency, content, and number of participants) at the end of the study.

    Both the news and the reports were uploaded by the research team, not by the patients, and both sections could be marked with like by the patients.

    To have access to the app contents, the patients received a user number in a closed envelope and an access password assigned at random by computer software external to the project. Each user number had an avatar assigned to it as a profile to reinsure patient anonymity. To maintain privacy, the external aspect of the app and its name (e-ging) did not make any reference to HIV infection, and its use required a username and password each time the app was to be accessed.

    Selection of Participants

    Before recruiting the patients who collaborated in the study, a survey was conducted among all the patients aged at least 60 years in our HIV infection clinic, with a view to exploring their knowledge about the internet and new technologies [12]. Later, 30 of them were recruited. The patients must be at least 60 years old, with a follow-up in the outpatient clinic for at least 1 year and without pathologies that limit his or her life expectancy to less than a year. They must know how to read and write. To be part of the group assigned to the app, they had to have their own smartphone and refer that they were connected to the internet from that device. They were offered to enter the study according to their usual consultation. The patients who used the internet on their mobile phone (15) were offered to download the app, and those who did not have internet access on their mobile (the other 15) constituted a control group. There was no randomization.

    Scheme of Visits and Information Collected

    The app remained in operation for 6 months, after which it was canceled. During this time, clinical follow-up was the usual in both groups of patients (with or without app), with a visit to consultations every 4 to 6 months. No specific action was developed with the control group.

    Figure 1. Interface of the app.
    View this figure
    Figure 2. Menu screen.
    View this figure

    The following information was collected at baseline 6 months later:

    1. Education level (referred by the patient himself).
    2. Anthropometric information and blood pressure (taken in consultation, twice in recumbent position after 3-5 min of rest in that posture).
    3. Blood count parameters: CD4 lymphocytes and viral load, lipid profile, and estimated glomerular filtrate using Chronic Kidney Disease Epidemiology Collaboration [13].
    4. Comorbidities: cancer, diabetes, hypertension, dyslipidemia, osteoporosis or fractures, liver disease, cognitive deterioration, and tobacco consumption (for all these: yes or no). This information was taken from the patients’ medical records, if the patients had recorded this diagnosis between the clinical judgments.
    5. Medication: type of ART received and chronic non-ART medication.
    6. Adherence to ART and non-ART medication: calculation using dispensation of ART registries provided by the pharmacy unit, followed by the Simplified Medication Adherence Questionnaire (SMAQ) [14].
    7. Adherence to chronic non-ART medication: the Morisky-Green-Levine questionnaire [15].
    8. WHOQOL-BREF, World Health Organization Quality of Life Questionnaire (short version): it evaluates physical and Psychological quality of life, social relationships and satisfaction with health care and social services [16].
    9. International Physical Activity Questionnaire (IPAQ): classifies weekly physical activity as high, moderate or low [17].
    10. 6-min walking test (6MWT): reflects the physical capacity of an individual to perform the physical activities of daily life.

    In addition to these questionnaires, patients were asked to rate their quality of life perception ranging from 1 (worst) to 5 (best), and the same for the perception of health.

    Analytical parameters and 6MWT results were collected to explore if a short intervention could improve physical, functional, and analytical status of our patients.

    Data Analysis

    For the analysis of the chat at the end of the experience, a dictionary of words and terms of interest was put together to be able to discard irrelevant words for the purpose of the project. The choice of relevant terms was agreed to by the research team. Once the dictionary was available, an algorithm was implemented that searched for coincidences in all chat messages. The terms were grouped into areas for this purpose, and in these areas, words were classified as key words, which is the term or expression that we want to quantify, or its variants, which are variations of that word or expression. With this structure, a search was implemented in the whole chat. The areas into which the key words have been grouped are as follows: pathologies, medications, nutrition, healthy attitudes, sanitary and professional centers, psychological, and emotional. In the pathologies area, a second analysis of key words was made and grouped into the following areas: cardiovascular disease, cancer, HIV, and osteoporosis. The contents of the chat were analyzed by 3 members of the research group so that the comments were framed in the context of these key words.

    After closing the app, the possibility was offered to send a brief written opinion about the experience of using the app to the 15 individuals who had downloaded it.

    Quantitative data are provided as medians with an interquartile range, and qualitative information is given as percentages. A nonparametric procedure (Mann-Whitney U) was used to compare quantitative variables, and proportions were compared using the chi-square test. IBM SSPS 20 was used for statistical analysis.


    Results

    Population Characteristics

    Baseline characteristics of the patients are shown in Table 1. All of them were receiving ART.

    As for physical activity measured according to the IPAQ, 2/30 patients (7%) referred low activity, 11/30 (37%) moderate, and 17/30 (57%) high. They stated that they spent 5 hours sitting down (0-12). The quality of life perception was 4 (2-5). With that same scale, the perception of health was 3 (2-5).

    The number of concomitant medications was 5 (0-12), and 17/30 (57%) patients were using at least four medications.

    There were no significant differences found between the group that downloaded the app and the control group in any of the variables mentioned.

    Over the 6 months of this project, there was no registry of any AIDS events, but there were 3 non-AIDS events: one sudden death in the group not assigned to use the app and 1 heart attack and colon cancer in 2 patients in the app use–assigned group.

    There was no significant modification in body mass index parameters, blood pressure, lipid profile, or immuno-virology information data. There was no significant modification of the distance covered in the 6MWT. There was no significant modification in the perception of quality of life questionnaire scores, confessed physical activity, or ART or non-ART adherence. Table 2 shows the main analytical parameters, adherence to treatment, quality of life, and the 6MWT results at baseline and 6 months, without any significant differences being observed in any case.

    Use of the App

    The app was in use between April 30, 2017, and October 31, 2017. During these 6 months, 19 reports and 75 news were uploaded. There was a total of 2407 sessions and an average session time of 7 min and 56 seconds. The screen views ascended to 13,143, with an average of 5.46 screens per session.

    The most visualized screens were the Chat (4046 views) and News (890) screens, at a considerable distance behind them were Contacts (96), Reports (90), and Useful addresses (66).

    Table 1. Baseline characteristics of the patients (N=30).
    View this table

    News and Reports

    There were 75 news publications in different categories: HIV (34 published), healthy aging (27), project information (7), social and psychological (5), and Information and Communication Technologies (ICT) use and the elderly (2). A total of 135 likes were received, the most liked being “On going” (5 likes), “How walking a dog can help the elderly comply with physical exercise recommendations” (5), “How to get brown in a healthy way” (5), “Welcome!” (4), “A cure for HIV?” (4), “Food for people with HIV” (4), “Is the flu vaccine less effective in overweight people” (4), “A monthly injection can maintain AIDS virus confined” (4), and “Spain fails in recommended calcium intake” (4). There were 22 news comments, the most commented paper being “Around 5000 patients have HIV infection in Malaga province” (3 comments).

    Chat Analysis

    As an example, in the section corresponding to psychological, the key words were happiness, emotion, sadness, surprise, restlessness, and greetings. Within the key word sadness were included chat comments such as “you lose the desire of everything,” “today I’ve been very dejected and sad,” “we all have a bad day,” “I’m pulling, I have head like a pot of crickets,” “I never dream,” “I’m fed up,” “I do not know anything about anyone,” “I’m worried, without knowing anything,” “this heat kills me,” “hello guys you’re going to forgive me I’m not for nothing,” “it was a horrible time and without being able to talk to anyone, it passes very badly,” “I have the body as if I had been beaten,” “no one knows what it is,” “absolutely nobody in my family knows anything,” “I’m bored,” “my friends do not know after twelve years,” “that’s why it was so hard for me to admit it, it cost us much assimilate, fuck has cost me,” “I do not understand how people are so denied,” and “what a pity, we are the only survivors.”

    Table 2. Evolution of the main parameters evaluated.
    View this table

    As we already stated, terms were grouped by categories, where we can find the following:

    • Nutrition: terms related to the nutrition field were mentioned 104 times, where coffee was the most frequently mentioned term.
    • Health care environment (sanitary and professional centers): terms related to health care environment were mentioned 187 times, with doctor being the most named term (124).
    • Healthy attitudes: terms related to healthy attitudes were mentioned 273 times, the most mentioned terms were beach (94) and walking (87).
    • Medications: terms related to medications were mentioned 115 times, the most named terms were medication or treatment (28) and acenocoumarol (24).
    • Pathology or disease: terms related to pathology or disease were mentioned 414 times, especially weight or height (76), blood pressure (76), cancer (24), heart or heart attack (21), depression (20), and diabetes (18).
    • HIV: was quoted 184 times, with references to health care environment above all (doctors, internal medicine outpatient consultation room, Costa del Sol Hospital, and in good hands) being 157 and only 9 direct references to HIV.
    • Psychology and emotional: terms related to psychology and emotional were mentioned 554 times, the most used terms (or similar) being greetings (305), happiness (135), emotion (70), anxiety or mood (27), surprise or wishes (11), and sadness ormelancholy (6).

    The chat participants described the experience as purely positive; it allowed them to create “a space for freedom in which they could talk to other elderly patients infected,” they found “nice people with my same problems,” and all of them would repeat the experience. All the patients that downloaded the app referred that their knowledge about the infection had increased and their feelings of secret or taboo toward the disease had lessened.


    Discussion

    Principal Findings

    In our experience, the use of a mobile app in older adults infected with HIV has translated into a frequent use of this app, with just over 2400 sessions and an average time of use of almost 8 min for each one of them. Far from being a collective that shies away from mobile app use, it is quite clear that if this population’s interest is stimulated toward these apps, they will make use of them and make the most of the information they have to offer. The fact that the navigation in each session implies an average of 5 screens in each one of them also shows user’s interest for the different sections of the app and that navigation is certainly dynamic. The most frequently viewed screens were Chat (over 4000 times) and News (over 800 times), which reveals that patients were clearly interested in the social relationship that the app implied and in commenting on latest medical news.

    The population of our study responds to a pattern of comorbid and polymedicated patients (a median of 5 medications excluding antiretroviral), diagnosed at around 50 years of age and with a decade of ART use. Although the perception of their health was 3 over 5, the perception of quality of life was higher (4 out of 5), which definitely shows certain optimism about their own life in spite of the illness, verified again in the WHOQOL-BREF results, where the psychological quality of life results were higher than the physical quality of life ones. The high appreciation of health care and social services also stands out (75 over 100).

    The use of the app was not associated with clinical or analytical parameter changes in patients. Changes in this type of parameters are probably not to be expected in this type of elderly population in such a short period as 6 months and also because of the low number of patients included in each group (n=15) of this pilot study.

    Analysis of the chat reveals that the main area of concern for patients is disease in general, a lot more than HIV, referring to typically age-related pathologies rather than the chronic infection itself. The analysis of feeling-related terms reveals a positive attitude, with frequent mention of happiness.

    Strengths and Limitations

    Compared with other studies [18], our study population had physically active perception of itself (over 50% referred high physical activity), which could also be related to a better perception of their psychological welfare. Indirectly related information that supports this fact is that beach (94) and walking (87) stand out among the most quoted individual terms in the chat.

    Experiences of the development of apps in HIV have been published with the purpose of improving adherence [19], but perhaps, elderly HIV-infected patients represent a group in which this type of apps can promote stigma reduction and sharing experience between peers. The use of mobile apps, where anonymity is preserved, can help reduce the social barriers that these patients have to confront [20]. The presence of this stigma can be associated with worse ART adherence rates and less viral suppression rates [21-23]. However, in our patients, adherence to ART was very high, although it could be improved in non-ART medication. Comorbidity presence related to age translates into a higher use of these medications, and making this treatment easier (lower amounts of pills, and precise indications) must be another step in the reinforcement of this adherence.

    Similar to other mobile phone–based interventions [24], ours has not demonstrated a significant increase in ART adherence, although the truth is that the initial situation was very positive in that parameter (almost 90% referred over 95% adherence).

    Conclusions

    Ours constitutes a preliminary experience that seems to confirm that our older adults with HIV infection find the utilization of a mobile app to be able to receive information about the infection and connect with individuals with their same problems to be useful. Studies larger than ours, and probably more extended in time, should confirm if some kind of benefit is obtained in this group of patients (older adults with HIV infection) through new technologies.

    Acknowledgments

    This study has been supported by a grant from Gilead Sciences Europe Ltd.

    Conflicts of Interest

    None declared.

    References

    1. High KP, Brennan-Ing M, Clifford DB, Cohen MH, Currier J, Deeks SG, OAR Working Group on HIVAging. HIV and aging: state of knowledge and areas of critical need for research. A report to the NIH Office of AIDS Research by the HIV and Aging Working Group. J Acquir Immune Defic Syndr 2012 Jul 1;60(Suppl 1):S1-18 [FREE Full text] [CrossRef] [Medline]
    2. Schmid GP, Williams BG, Garcia-Calleja JM, Miller C, Segar E, Southworth M, et al. The unexplored story of HIV and ageing. Bull World Health Organ 2009 Mar;87(3):162-16A [FREE Full text] [Medline]
    3. Lazarus JV, Nielsen KK. HIV and people over 50 years old in Europe. HIV Med 2010 Aug;11(7):479-481 [FREE Full text] [CrossRef] [Medline]
    4. Centers for Disease Control and Prevention. 2013 Feb. HIV Surveillance Report, 2011   URL: https://www.cdc.gov/hiv/pdf/statistics_2011_hiv_surveillance_report_vol_23.pdf [accessed 2019-01-23] [WebCite Cache]
    5. Data Collection on Adverse Events of Anti-HIV drugs (D:A:D) Study Group, Smith C, Sabin CA, Lundgren JD, Thiebaut R, Weber R, et al. Factors associated with specific causes of death amongst HIV-positive individuals in the D:A:D Study. AIDS 2010 Jun 19;24(10):1537-1548. [CrossRef] [Medline]
    6. Justice AC, Gordon KS, Skanderson M, Edelman EJ, Akgün KM, Gibert CL, VACS Project Team. Nonantiretroviral polypharmacy and adverse health outcomes among HIV-infected and uninfected individuals. AIDS 2018 Mar 27;32(6):739-749 [FREE Full text] [CrossRef] [Medline]
    7. Dworkin M, Chakraborty A, Lee S, Monahan C, Hightow-Weidman L, Garofalo R, et al. A realistic talking human embodied agent mobile phone intervention to promote HIV medication adherence and retention in care in young HIV-Positive African American men who have sex with men: qualitative study. JMIR Mhealth Uhealth 2018 Jul 31;6(7):e10211 [FREE Full text] [CrossRef] [Medline]
    8. Venter W, Coleman J, Chan VL, Shubber Z, Phatsoane M, Gorgens M, et al. Improving linkage to HIV care through mobile phone apps: randomized controlled trial. JMIR Mhealth Uhealth 2018 Jul 17;6(7):e155 [FREE Full text] [CrossRef] [Medline]
    9. Abellán A, Ayala A, Pujol R. Consejo Superior de Investigaciones Científicas, Centro de Ciencias Humanas y Sociales, Envejecimiento en red. 2017. Un perfil de las personas mayores en España, 2017 Indicadores estadísticos básicos [A profile of the elderly in Spain]   URL: http://envejecimiento.csic.es/documentos/documentos/enred-indicadoresbasicos17.pdf [accessed 2019-01-23] [WebCite Cache]
    10. Conde Gutiérrez F. [Future scenarios of HIV-AIDS: from the "event" disease to diffuse chronicity. From the moral stigma to the central zones of social vulnerability]. Rev Esp Salud Publica 1997;71(1):1-7 [FREE Full text] [Medline]
    11. Bauermeister JA, Muessig KE, LeGrand S, Flores DD, Choi SK, Dong W, et al. HIV and sexuality stigma reduction through engagement in online forums: results from the HealthMPowerment intervention. AIDS Behav 2018 Aug 18. [CrossRef] [Medline]
    12. Garcia de Lomas Guerrero JM, Del AA, Del Arco A, De la Torre J, Prada JL, Márquez E, et al. [Penetration of new technologies in elderly HIV patients]. 2017 Dec 1 Presented at: Proceedings of the IX Congress of GESIDA; 2017; Vigo (Spain) p. 30-31   URL: http:/​/www.​elsevier.es/​es-revista-enfermedades-infecciosas-microbiologia-clinica-28-pdf-X0213005X17619041
    13. Levey AS, Stevens LA, Schmid CH, Zhang YL, Castro AF, Feldman HI, CKD-EPI (Chronic Kidney Disease Epidemiology Collaboration). A new equation to estimate glomerular filtration rate. Ann Intern Med 2009 May 5;150(9):604-612 [FREE Full text] [Medline]
    14. Knobel H, Alonso J, Casado JL, Collazos J, González J, Ruiz I, et al. Validation of a simplified medication adherence questionnaire in a large cohort of HIV-infected patients: the GEEMA Study. AIDS 2002 Mar 8;16(4):605-613. [Medline]
    15. Morisky DE, Green LW, Levine DM. Concurrent and predictive validity of a self-reported measure of medication adherence. Med Care 1986 Jan;24(1):67-74. [Medline]
    16. The WHOQOL Group. Development of the World Health Organization WHOQOL-BREF quality of life assessment. Psychol Med 1998 May;28(3):551-558. [Medline]
    17. Craig CL, Marshall AL, Sjöström M, Bauman AE, Booth ML, Ainsworth BE, et al. International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc 2003 Aug;35(8):1381-1395. [CrossRef] [Medline]
    18. Moore RC, Kaufmann CN, Rooney AS, Moore DJ, Eyler LT, Granholm E, et al. Feasibility and acceptability of ecological momentary assessment of daily functioning among older adults with HIV. Am J Geriatr Psychiatry 2017 Aug;25(8):829-840 [FREE Full text] [CrossRef] [Medline]
    19. Horvath KJ, Alemu D, Danh T, Baker JV, Carrico AW. Creating effective mobile phone apps to optimize antiretroviral therapy adherence: perspectives from stimulant-using HIV-positive men who have sex with men. JMIR Mhealth Uhealth 2016 Apr 15;4(2):e48 [FREE Full text] [CrossRef] [Medline]
    20. Hightow-Weidman LB, Muessig KE, Bauermeister J, Zhang C, LeGrand S. Youth, technology, and HIV: recent advances and future directions. Curr HIV/AIDS Rep 2015 Dec;12(4):500-515. [CrossRef] [Medline]
    21. Quinn K, Voisin DR, Bouris A, Jaffe K, Kuhns L, Eavou R, et al. Multiple dimensions of stigma and health related factors among young black men who have sex with men. AIDS Behav 2017 Jan;21(1):207-216 [FREE Full text] [CrossRef] [Medline]
    22. Friedman MR, Stall R, Silvestre AJ, Wei C, Shoptaw S, Herrick A, et al. Effects of syndemics on HIV viral load and medication adherence in the multicentre AIDS cohort study. AIDS 2015 Jun 1;29(9):1087-1096 [FREE Full text] [CrossRef] [Medline]
    23. Katz IT, Ryu AE, Onuegbu AG, Psaros C, Weiser SD, Bangsberg DR, et al. Impact of HIV-related stigma on treatment adherence: systematic review and meta-synthesis. J Int AIDS Soc 2013 Nov 13;16(3 Suppl 2):18640 [FREE Full text] [Medline]
    24. Herbst JH, Mansergh G, Pitts N, Denson D, Mimiaga MJ, Holman J. Effects of brief messages about antiretroviral therapy and condom use benefits among black and latino MSM in three U.S. cities. J Homosex 2018;65(2):154-166. [CrossRef] [Medline]


    Abbreviations

    ART: antiretroviral treatment
    IPAQ: International Physical Activity Questionnaire
    ICT: Information and Communication Technology
    6MWT: 6-min walking test
    WHOQOL-BREF: World Health Organization Quality of Life Questionnaire (short version)


    Edited by G Eysenbach; submitted 29.01.18; peer-reviewed by R Moore, B Hawkins, D Vance, A Thomas; comments to author 14.08.18; revised version received 24.08.18; accepted 12.10.18; published 06.03.19

    ©Julián Olalla, Jose María García de Lomas, Efrén Márquez, Francisco Jesús González, Alfonso Del Arco, Javier De La Torre, Jose Luis Prada, Francisca Cantudo, María Dolores Martín, Miriam Nieto, Javier Perez Stachowski, Javier García-Alegría. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 06.03.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.