Published on 12.02.20 in Vol 8, No 2 (2020): February
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/13747, first published May 10, 2019.
Push Notifications From a Mobile App to Improve the Body Composition of Overweight or Obese Women: Randomized Controlled Trial
Background: Technology—in particular, access to the Internet from a mobile device—has forever changed the way we relate to others and how we behave in our daily life settings. In recent years, studies have been carried out to analyze the effectiveness of different actions via mobile phone in the field of health: telephone calls, short message service (SMS), telemedicine, and, more recently, the use of push notifications. We have continued to explore ways to increase user interaction with mobile apps, one of the pending subjects in the area of mHealth. By analyzing the data produced by subjects during a clinical trial, we were able to extract behavior patterns and, according to them, design effective protocols in weight loss programs.
Objective: A clinical trial was proposed to (1) evaluate the efficacy of push notifications in an intervention aimed at improving the body composition of adult women who are overweight or obese, through a dietary procedure, and (2) analyze the evolution of body composition based on push notifications and prescribed physical activity (PA).
Methods: A two-arm randomized controlled trial was carried out. A sample size of 117 adult obese women attended a face-to-face, 30-minute consultation once a week for 6 months. All patients were supplied with an app designed for this study and a pedometer. The control group did not have access to functionalities related to the self-monitoring of weight at home, gamification, or prescription of PA. The intervention group members were assigned objectives to achieve a degree of compliance with diet and PA through exclusive access to specific functionalities of the app and push notifications. The same diet was prescribed for all patients. Three possible PA scenarios were studied for both the control and intervention groups: light physical activity (LPA), moderate physical activity (MPA), and intense physical activity (IPA). For the analysis of three or more means, the analysis of variance (ANOVA) of repeated means was performed to evaluate the effects of the intervention at baseline and at 3 and 6 months.
Results: Receiving notifications during the intervention increased body fat loss (mean -12.9% [SD 6.7] in the intervention group vs mean -7.0% [SD 5.7] in the control group; P<.001) and helped to maintain muscle mass (mean -0.8% [SD 4.5] in the intervention group vs mean -3.2% [SD 2.8] in the control group; P<.018). These variations between groups led to a nonsignificant difference in weight loss (mean -7.9 kg [SD 3.9] in the intervention group vs mean -7.1 kg [SD 3.4] in the control group; P>.05).
Conclusions: Push notifications have proven effective in the proposed weight loss program, leading women who received them to achieve greater loss of fat mass and a maintenance or increase of muscle mass, specifically among those who followed a program of IPA. Future interventions should include a longer evaluation period; the impact of different message contents, as well as message delivery times and frequency, should also be researched.
Trial Registration: ClinicalTrials.gov NCT03911583; https://www.clinicaltrials.gov/ct2/show/NCT03911583
JMIR Mhealth Uhealth 2020;8(2):e13747
Mobile technology can be considered as being fundamental to our lives. Its presence is ubiquitous; estimates in 2019 have suggested that there will be around 4.1 billion intelligent devices globally, between mobile phones and tablets . Furthermore, the wearable market is also a promising one, since the number of wearable devices connected worldwide is expected to jump to over 1.1 billion in 2022, while telecom technology will change from 4G to 5G [ ]. Furthermore, this fact has changed the way we relate to each other, live, and work [ ]. In 2014 there was a turning point in connectivity; for the first time, the amount of browsing through mobile devices exceeded that of desktop computers [ ]. We can, therefore, dispense with the adjective mobile when we talk about technology, as both terms are already inseparable [ ].
The health care field has not been alien to this revolution. The mHealth concept was born in 2000; the 2010 mHealth Summit held by the Foundation for the National Institutes of Health defined it as “the provision of health care services through mobile communication devices” . Nowadays, around 40% of the 300,000 apps available in the major app stores are related to health, particularly those focused on disease monitoring and management [ ].
Communication technology has evolved, taking us from making phone calls or sending short message service (SMS) text messages to developing telemedicine via Web or mobile apps as supports for clinical decision making or increasing the degree of adherence to treatments [- ]. SMS text messaging has shown itself to be a great resource for delivering electronic reminders in practice and a highly feasible platform, since it is an older technology that can be used on any existing mobile phone. It has shown clear benefits in increasing adherence to treatment [ ], preventing complications in chronic conditions [ ], allowing communication between professionals [ ], and helping in disease self-management [ ], among others. In these situations, SMS text messaging has been used alone [ , ] or in combination with other technologies [ , ].
Push technology, however, has recently emerged in the mHealth sector because of its potential for improving pervasive functionalities in mobile health apps. It permits the delivery of timely updates and customized reminders to its users, with respect to the time sent and their contents. A push notification has been defined as being an event-based mechanism by which remote servers push events to mobile phone client apps . This functionality offers auditory and visual alerts to inform users about an incoming message and invites them to act, even if the app sending the notifications is not currently in use [ ]. Push notifications have proven to be effective in communication with professionals [ ] and assessing health behavior patterns [ ], but there is scant evidence of their effectiveness in interventions aimed at changing lifestyles.
Recent reviews confirm that providing digital solutions to people with an interest in health interventions improves the results obtained [, ]. Some functions, such as self-monitoring, interaction between users, or setting objectives, have positive effects on health status [ ]. In particular, self-evaluation is a characteristic that has shown encouraging results and has been the subject of study in clinical trials [ , ].
The role of physical activity (PA) in weight loss programs, as well as in the maintenance of weight loss in the long term, is fundamental  and has been confirmed in recent years through several systematic reviews [ , ]; this has revealed the existence of an inverse association between PA and body mass index (BMI).
Taking all of the above into account, a clinical trial was proposed to evaluate, as a primary outcome, the efficacy of push notifications in an intervention aiming to improve body composition—defined as loss of fat mass while maintaining or increasing muscle mass—of adult women who are overweight or obese. Assessing the evolution of body composition based on diet and prescribed PA was considered a secondary outcome.
Study Design: Overview
A two-arm randomized controlled trial of a 6-month intervention (ie, prescription of PA and diet) was carried out. The intervention group was comprised of women who received push notifications, while women assigned to the control group did not receive any. All the women in both groups followed the same diet. In addition, the women in the intervention group and the control group were randomly assigned to programs of PA of different intensities: light physical activity (LPA), moderate physical activity (MPA), or intense physical activity (IPA). The intervention group received push notifications with the aim of establishing a mechanism of control, gamification, and reminders of the PA prescribed in a face-to-face consultation. The control group, despite being recommended and prescribed corresponding PA, did not have a control and monitoring mechanism associated with push notifications. After enrollment, body composition variables were assessed every week for 24 weeks. The study protocol complied with the Declaration of Helsinki for medical studies and was approved by the bioethical committee of the University of Córdoba from the Department of Health at the Regional Government of Andalusia (Act No. 284, reference 4156). The protocol was registered at ClinicalTrials.gov (NCT03911583). This trial has been reported according to the Consolidated Standards of Reporting Trials (CONSORT) statement and the CONSORT-Electronic and Mobile HEalth Applications and onLine TeleHealth (EHEALTH) extension (see).
Recruitment and Enrollment
The sample consisted of 117 Caucasian women from the region of Andalusia, Spain. Participants were recruited from a private health center, to which they came on their own initiative to undergo a weight loss program; women learned of the program either through ads published within the clinic itself or specific publicity in social networks. Data began to be collected on January 1, 2016, and lasted for a period of 2 years. All study participants were required to sign a written informed consent form.
Participants were randomly assigned following a simple randomization procedure (ie, computerized random numbers) to intervention or control groups and to LPA, MPA, or IPA groups. Participants were randomized using a random-number generator in Microsoft Excel (Microsoft Corporation).
Sample Size Calculation
The primary outcome variable was fat mass loss after 6 months; the anticipated minimum difference in the average fat mass loss was 2% with an expected SD not exceeding 3.5% . The study was designed to have at least 80% power and an alpha level set at .05, obtaining a sample size of 27 individuals in each of the intervention and control groups for a total of 54. A total of 90 women—45 in each group—was estimated to be necessary to mitigate the effect of possible dropouts during this trial.
Automatic push notifications (see) were scheduled to be sent to the intervention group on specific days with personalized health-related and motivational messages; these messages aimed to provide comments to reinforce behavior modification and encourage interaction with the app.
The content of the feedback messages was extracted from a previously established library (seeand ) and was based on the following behavioral theories:
- Health tips, where the primary tailoring goals are attention and peripheral processing [ ].
- PA tips, in this case attention and being informed [ ].
- Self-monitoring tips, where the primary tailoring goals are decision making and behavioral intention [ ].
Randomized Test Design
The implementation of the methodology for sending push notifications (see) was designed considering aspects collected in previous studies that mention, above all, the importance of the following: (1) patients’ ability to select their preferred time for receiving notifications and (2) the increased effectiveness of notifications when delivered at times that do not interrupt the daily routine [ ]. Based on these criteria, three time points were established at which the notifications would be sent to the patients in the intervention group: 08:30 (point 1)—the time point before going to work; 14:00 (point 2)—lunch time; and 20:00 (point 3)—the time when patients arrived home, before dinner. The first message was sent between points 1 and 2, according to the patients’ preferences; patients who did not respond to the push notifications automatically received a notification at point 3.
The notifications were sent from an online tool developed specifically for this study. This tool allows the researcher to program push notifications and to check for who has responded and when (see).
To estimate the degree of PA and sedentary activity at the beginning of the study, we used the long version of the International Physical Activity Questionnaire (IPAQ-long), which has been shown to be reliable and valid for estimating PA and sitting-down time . To adjust for sedentary behavior and/or PAs outside working hours, the IPAQ-long was administered via interview at the beginning of the study and repeated at the end of the intervention. The Accupedo app—a pedometer app—was installed on the patients' mobile phones. This app is capable of tracking and storing information about daily PA in relation to walking or running; as well, it has been previously validated as a measure to encourage and motivate patients to reach a certain number of steps [ ]. The purpose of the push notifications in this case was to encourage and remind patients of the objective that was previously established in the face-to-face consultation, regarding the number of steps. Patients had to report, within the app, the data obtained in Accupedo; this information was checked weekly in the consultation by the research team.
Self-evaluation was related to the women’s behavior during each week. The women had to enter their weight in the app when they received the push notification. The objective was to determine whether receiving a reminder and keeping track of weight made a difference among the women in the intervention group compared to the group of patients without access to this functionality (see). Apps that offer self-evaluation features have previously demonstrated to help patients lose weight [ ].
Eligibility Criteria: Inclusion and Exclusion
A flowchart of participants is shown in. Of the 117 women who attended the consultations to lose weight, 27 (23.1%) did not meet the inclusion criteria, so the remaining 90 women (76.9%) were randomized into two groups: intervention group or control group. After this, the women in each group were randomly assigned to one of the three PA programs described previously. We decided to study a group of women, exclusively, because of differences from men with respect to body composition (ie, a higher percentage of fat mass) and metabolic response to PA plans (ie, lower capacity to build muscle mass) [ ]. For this reason, and since the primary objective was to analyze the effect of push notifications, we decided not to include men. Another inclusion criterion was having at least 32% of total body fat at the start of the study because this is the lowest limit that determines obesity in a woman, as the percentage of fat is considered a marker of obesity [ ].
Women who had a metabolic illness and those who had previously been diagnosed with type 2 diabetes mellitus were excluded from the study. Exclusion criteria also included being pregnant or breastfeeding, being under the age of 18, and having a BMI of less than 25 kg/m2. Finally, another exclusion criterion was taking antidepressant drugs, due to their possible role in the incidence of obesity in middle-aged women . A total of 60 women out of 90 completed the follow-up evaluation, representing a retention rate of 67%. There were no statistical differences in the dropout rate between any of the groups.
Study Variables and Measurements
Body fat, muscle mass, and water percentages, considering variable outcomes, were monitored and collected over time using multifrequency bioelectrical impedance with the BWB-800A electronic scale (Tanita Corporation of America), which was previously validated . Standing height without shoes was measured to the nearest millimeter using the wall-mounted PORTROD stadiometer (Health o meter). The independent variables collected were age (years), height (cm), weight (kg), and BMI (kg/m2). The anthropometric measurements were collected following the recommendations of the reference manual of standardized anthropometry [ ].
For the PA, the strata proposed by Matthew were used . Patients in MPA and IPA groups were instructed to perform aerobic exercises corresponding to energy expenditure induced by training of approximately 300-600 kcal/day. For PA to be considered MPA, women had to walk for 30-60 minutes every day or complete 7500-10,000 steps per day. On the other hand, to be considered IPA, patients had to carry out, in addition to the target set in the MPA group, IPA sessions of over 70% of VO2max three times a week. Several members of the research team—nurses and a nutritionist—assessed the women in order to prescribe the adequate intensity of PA. This was based on heart rate, estimated using the Karvonen formula [ ], and establishing the maximum heart rate of 220 - age (years). Adherence was monitored by weekly exercise records that were completed by participants and researchers.
With respect to diet, the daily energy requirements were determined by estimating the energy expenditure at rest through the formula proposed by Harris-Benedict (655.0955 + 9.5634 [weight in kg] + 1.8496 [size in cm] - 4.6756 [age in years])  and multiplying the value obtained by a factor of 1.5 in those patients who did PA [ ]. During a period of 24 weeks, all the participants followed a diet with the following distribution of macronutrients: 25%-30% protein, 40%-45% carbohydrates, and 30%-35% fat. A hypocaloric diet was designed, with a reduction of 500 kcal/day during the intervention period to achieve a weekly weight loss of 400 grams; no vitamins or other nutritional supplements were prescribed. In order to be included in the study, each woman participated in a 1-hour seminar, in which a dietitian-nutritionist taught her the appropriate selection and preparation of food. The proposed menu was valid for 7 days, and at the weekly review appointment, the protocol for the current week was handed out. The energy and nutritional contributions were assessed through the Dietowin program and the weighing method [ ].
The follow-up tests began during the first week of the diet and PA assignment. Body composition was measured after an overnight fast; the subject was then required to go to the center on the same day of the week at the same time, wearing the same clothes. Review appointments continued on a weekly basis until week 24, when all the variables were collected.
The quantitative variables have been presented with the mean and SD, and the qualitative variables with frequencies and percentages.
To contrast the goodness of fit with a normal distribution of data from quantitative variables, the Kolmogorov-Smirnov test with the Lilliefors correction was used. For the bivariate hypothesis, the Student's t test was performed for two means, while for the qualitative variables the chi-square and Fisher exact tests were employed when necessary. Likewise, for the analysis of three or more means, the analysis of variance (ANOVA) of repeated means determined the effects of the intervention at baseline and at 3 and 6 months; the correlation between the quantitative variables was verified by the coefficient of Pearson correlation (r). Finally, if the normality or homoscedasticity criterion was not met for the ANOVA, the Kruskal-Wallis test was performed.
To adjust for the possible impact of PA on body composition and its possible role as a confounding factor, adjusted linear regressions were made for each body composition variable (percent body fat and muscle mass) and weight, calculating the standardized beta coefficients. To determine the goodness of fit of the models, the SE, the adjusted coefficient of determination, the F statistic, the linearity, and the residuals were analyzed.
For all statistical analyses, an alpha error of less than 5% was accepted (P<.05) and a 95% CI was calculated. For the statistical analysis, IBM SPSS Statistics software, version 22.0 (IBM Corp), was used.
Characteristics of the Population Studied
The women studied had a mean age of 41.5 years (SD 11.3). With regard to body composition, in the first consultation we found an average weight of 82.6 kg (SD 14.5) (95% CI 78.8-86.3), average muscle mass of 44.7 kg (SD 5.1) (95% CI 43.4-46), and average body fat of 42.2% (SD 5.5) (95% CI 40.8-43.6) (see).
(N=60), mean (SD)
|No push notifications|
(n=29), mean (SD)
(n=31), mean (SD)
|Age (years)||41.5 (11.3)||40.3 (11.6)||42.9 (10.9)||.38|
|Height (m)||1.6 (0.1)||1.6 (0.1)||1.6 (0.1)||.77|
|Weight (kg)||82.6 (14.5)||84.8 (14.9)||80.5 (13.9)||.25|
|Body mass index (kg/m2)||31.8 (5.3)||32.8 (5.3)||31.0 (5.3)||.19|
|Body fat (%)||42.2 (5.5)||43.4 (5.0)||41.0 (5.8)||.10|
|Muscle mass (kg)||44.7 (5.1)||45.0 (5.3)||44.4 (4.9)||.66|
|Water (%)||43.1 (3.9)||42.1 (3.3)||44.1 (4.2)||.05|
No significant differences were found between the group that received notifications and the one that did not, with respect to the number of women who remained in the LPA group or engaged in MPA or IPA (P>.05). The baseline data according to whether the push notifications were sent or not are shown in.
Analysis of the Evolution of Body Composition Based on the Use of Push Notifications
The analysis of the variation in body composition in the study groups was based on the percentage changes between the measurements collected at baseline and at 3 and 6 months. A total of 3 months after the intervention, the group that received push notifications showed a significantly greater reduction in the percentage of body fat (-8.4% [SD 4.7], 95% CI -10.1 to -6.6; P=.005). For the rest of the anthropometric variables, although there was a greater decrease in the intervention group, the decreases were not significant with respect to the control group (P>.05).
However, this trend was not maintained after 6 months of the intervention. The women who received push notifications showed a greater improvement in their body composition than those who did not receive them; a higher decrease in body fat percentage (P<.001), a smaller reduction in muscle mass (P<.05), and a higher percentage increase in body water (P<.05) were observed (see).
|Variable||At 3 months||At 6 months|
|No push notifications, mean (SD)||Push notifications, mean (SD)||P value||No push notifications, mean (SD)||Push notifications, mean (SD)||P value|
|Weight (kg)||-6.3 (3.3)||-7.1 (2.4)||.27||-7.1 (3.4)||-7.9 (3.9)||.39|
|Body mass index, (kg/m2)||-2.1 (1.2)||-2.3 (1.0)||.56||-8.0 (3.7)||-9.1 (5.7)||.36|
|Body fat (%)||-5.0 (4.2)||-8.4 (4.7)||.005||-7.0 (5.7)||-12.9 (6.7)||<.001|
|Muscle mass (kg)||-2.6 (3.1)||-1.6 (4.1)||.27||-3.2 (2.8)||-0.8 (4.5)||.02|
|Water (%)||3.2 (3.3)||5.1 (4.5)||.07||4.8 (4.3)||8.0 (5.8)||.02|
Analysis of the Evolution of Body Composition Based on the Use of Push Notifications and Physical Activity
At 3 months, it was found that there was no significant change in weight, nor in BMI or muscle mass, in women who remained in the LPA group. However, we observed a reduction in body fat percentage in women who received motivational messages during the intervention (-5.9% [SD 2.3], 95% CI -7.5 to -4.2) and a significantly elevated water percentage (3.4% [SD 1.3], 95% CI 2.4-4.3), compared to that in women who did not receive the messages.
With regard to women who performed some type of physical activity (ie, MPA and IPA), although a more favorable change was found among the women who received the push notifications, it was not significant (P>.05) (see).
The trend varied in the data collected at 6 months among the three study groups. Regarding sedentary women, it was found that the difference in body fat loss and water gain was significantly greater (P<.001 and P<.01, respectively) among women who received push notifications.
With respect to the group that did MPA, women in the control group showed greater modifications in all body composition variables, but they were only significant in the case of body fat (P<.01) (see).
|Variable||Light PA (n=21)||Moderate PA (n=19)||Intense PA (n=20)|
|No push notifications (n=11),|
|Push notifications (n=10),|
|P value||No push notifications (n=9),|
|Push notifications (n=10),|
|P value||No push notifications (n=9),|
|Push notifications (n=11),|
|Weight (kg)||-4.8 (3.8)||-6.5 (2.0)||.22||-6.9 (2.9)||-8.1 (1.7)||.36||-7.5 (2.6)||-6.7 (3.2)||.66|
|Body mass index (kg/m2)||-1.7 (1.5)||-2.1 (0.7)||.56||-2.3 (0.8)||-2.5 (0.9)||.84||-2.3 (0.9)||-2.2 (1.3)||.55|
|Body fat (%)||-2.3 (3.6)||-5.9 (2.3)||.02||-5.6 (3.5)||-6.8 (2.4)||.60||-8.0 (3.5)||-12.0 (5.7)||.07|
|Muscle mass (kg)||-2.8 (3.9)||-2.9 (2.4)||.71||-2.9 (2.3)||-3.7 (1.8)||.55||-2.1 (2.8)||1.6 (5.0)||.11|
|Water (%)||1.5 (2.5)||3.4 (1.3)||.04||3.1 (3.7)||4.2 (1.4)||.07||5.6 (2.4)||7.6 (6.9)||.30|
|Variable||Light PA (n=21)||Moderate PA (n=19)||Intense PA (n=20)|
|No push notifications (n=11),|
|Push notifications (n=10),|
|P value||No push notifications (n=9),|
|Push notifications (n=10),|
|P value||No push notifications (n=9),|
|Push notifications (n=11),|
|Weight (kg)||-5.6 (3.1)||-7.2 (1.9)||.07||-9.5 (2.3)||-11.4 (2.4)||.13||-10.0 (3.7)||-10.0 (4.3)||>.99|
|Body mass index (kg/m2)||-5.3 (2.6)||-7.1 (2.0)||.09||-9.6 (2.3)||-9.5 (5.2)||.54||- 9.5 (4.3)||-10.6 (7.9)||.88|
|Body fat (%)||-1.2 (1.5)||-6.2 (2.1)||<.001||-8.1 (2.6)||-12.8 (2.6)||.002||-13.0 (3.7)||-19.0 (6.1)||.046|
|Muscle mass (kg)||-4.3 (2.2)||-3.0 (2.1)||.28||-3.6 (2.1)||-2.9 (1.9)||.24||-1.4 (3.4)||3.0 (5.3)||.08|
|Water (%)||1.2 (1.8)||4.1 (1.6)||.003||4.6 (3.2)||8.2 (2.1)||.02||9.3 (3.1)||11.4 (8.1)||.60|
Finally, women who were referred to IPA and received push notifications had significantly greater reductions in the percentage of body fat (received notifications: -19.0% [SD 6.1], 95% CI -23.1 to -15; did not receive notifications: -13.0% [SD 3.7], 95% CI -15.5 to -10.5; P<.05). On the other hand, although no significant differences in muscle mass were found, muscle mass gain was observed in the intervention group.
Adjusted Regressions in Body Composition Modifications
The results shown inconfirm that the incorporation of push notifications had a different impact in body composition variables. Thus, we observed how receiving these notifications during the intervention lead to the weight loss increase (standardized beta=-.208) and helped to maintain or gain muscle mass (standardized beta=.266). However, the most important impact was observed on body fat, where loss occurred to a high degree (standardized beta=-.397).
|Result variable and modelsa and measures they are adjusted for||Standardized beta||R2b||SE||rc||P value|
|Weight lost at 6 months (kg)|
|2.214 - 4.335 (MPAd- 4.219 (IPAe) - 1.487 (push notificationsf) - 0.092 (weight at baseline)||.393||2.812||.658||<.001|
|Weight at baseline||-.367|
|Body fat lost at 6 months (%)|
|1.443 - 6.720 (MPA) - 12.390 (IPA) - 5.379 (push notifications) - 0.058 (body fat at baseline)||.743||3.461||.872||<.001|
|Body fat at baseline||-.047|
|Muscle mass lost at 6 months (kg)|
|5.769 - 0.029 (MPA) + 3.926 (IPA) + 2.062 (push notifications) - 0.226 (muscle mass at baseline)||.416||2.985||.675||<.001|
|Muscle mass at baseline||-.294|
aModels are adjusted for age, weight at baseline, push notifications, percentage of fat at baseline, muscle mass at baseline, percentage of water at baseline, and physical activity (PA).
bR2: coefficient of determination (goodness of fit).
cr: Pearson´s linear correlation.
dMPA: moderate physical activity (sedentary=0, moderate=1).
eIPA: intense physical activity (light=0, intense=1).
fPush notifications (no=0, yes=1).
As far as we know, this work has been the first clinical trial to study the impact of establishing a tracking and gamification system through push notifications in a weight loss program that included PA, combined with dietary treatment in face-to-face consultations, with a weekly tracking frequency over 6 months. From the results, we have extracted encouraging data. Introducing an mHealth strategy in patient consultation was shown to be, at the end of the trial period, a differentiating element: women receiving push notifications lost more weight, lost more total body fat, and had better muscle mass results than those who did not receive these notifications.
Comparison With Prior Work
Effects After 12 Weeks of the Push Notifications
In the first 3 months of the study, we found that push notifications only had an effect on total body fat and not on the rest of the anthropometric variables.
In the LPA groups, which only encouraged complying with the diet and carrying out weight control at home, push notifications triggered greater body fat loss, compared to the group who did not receive notifications. What differentiated the patients of this group was their access via the app to a specific functionality called self-monitoring, a concept that allows the patient to restrict or cancel a response, which makes decision making possible . The use of technology in a clinical trial of behavioral weight loss in a face-to-face intervention has previously been documented in the work of Polzien et al [ ], who reported additional weight loss at 12 weeks of 2.1 kg in the group that had technological support; these data approximate those obtained in our study, since women who received push notifications lost 1.76 kg of additional weight in the LPA group.
We found important differences in applying mHealth technology in combination with face-to-face follow-ups when compared to resorting exclusively to an mHealth intervention. At 12 weeks, our trial subjects lost an average of 7.1 kg (SD 2.4), while participants in another intervention using only text messages lost an average of 1.6 kg (SD 2.6) .
Sending messages of encouragement results in an increase in PA in the short term. Although the data in the first 12 weeks show an improvement in the body composition of women who received notifications, this was not significant (P>.05). A previous study among sedentary women confirmed that an mHealth intervention helped increase PA, although there were no significant changes in BMI .
Effects After 24 Weeks of the Push Notifications
At 6 months, the women in the trial who received push notifications lost more fatty tissue and their fat-free mass behaved better (ie, muscle mass and total body water).
A study focusing on the effects of mobile phone-based support and weight loss found a difference in additional weight loss of 1.9 kg at 6 months between groups with and without technology . This difference was greater than the 1.63 kg between women who did or did not receive push notifications in our study, despite the fact that patients were aware that they were being monitored. In previous studies, this aspect was seen to affect patients’ behavior [ ]. Our findings were similar to those obtained in the review by Hutchesson et al [ ], who compared weight loss among participants assigned to an mHealth intervention (13 studies), finding that the additional characteristics led to an average weight loss difference of 1.46 kg.
The body composition variables of groups assigned to performing MPA and IPA improved, highlighting an increased loss of total body fat and better behavior in fat-free mass (ie, maintaining or gaining). Text messages (ie, push notifications) aimed at fulfilling an assigned PA protocol were effective in interventions of at least 6 months in duration. These results do not coincide with a study of the same duration , in which there was no monitoring in face-to-face consultations. Reinforcing the strategy to be followed in the consultation and using technology as a support may be more feasible. However, we found similar results in a study where subjects were monitored at a weekly frequency for 24 weeks [ ].
The same conclusion made at 12 weeks on the effectiveness of text messaging and weight loss without face-to-face control can be extrapolated to longer periods of 24 weeks. Even though, in our study, patients monitored through push notifications and face-to-face consultations lost an average of 7.87 kg (SD 3.87), in studies that exclusively measured the effectiveness of mobile messaging and weight loss, the results were not so promising, as participants only lost an average of 1.27 kg (SD 6.51) [, ].
Previous studies reported that decreases in muscle mass were restored over time after weight loss interventions [, ]. Although the muscle mass loss was lower than that of total body fat, muscle maintenance should be monitored and prescribed even in weight loss programs. The subjects of our study who had a light or moderate exercise prescription (ie, walking) lost muscle mass at the end of the period. The explanation is that this kind of PA seems insufficient for mobilizing and stimulating muscle mass [ ]. The group in our study that had an intense physical exercise prescription (ie, incorporating resistance training) was the only one that showed muscle mass gain at 6 months. These results provide evidence that a combined program of aerobic and resistance-type exercise helps to preserve muscle mass during weight loss, results that matched those of a recent review [ ].
Our findings reveal that the prescription of PA results in significant body fat loss; the higher the intensity of PA, the greater the loss of fat at 6 months. While the LPA prescription implied a 6% fat loss at 6 months, the IPA subjects reached a fat loss of 19%. In addition, when analyzing the results among MPA and IPA subjects, we observed that IPA subjects lost an additional 7% of fat, whereas no significant weight loss was observed between the MPA and IPA groups. Our results are consistent with the existing literature ; although high-intensity training did not improve weight loss over 6 months compared to a lower intensity, the impact on fat loss was significant [ ].
Limitations and Strengths
Although the sample size in this study is similar to that used in previous works [, ], we carried out a randomization procedure that led to balanced arms; besides, the dropout pattern at 3 months was similar in the three groups. To avoid self-report bias, which was previously documented [ ], the data collection records were checked by the research staff in face-to-face consultations on a weekly basis, in which women had to show her Accupedo status directly from their mobile phones. Key strengths include the use of an objective measure of PA, which has stronger associations with health behaviors than hypothetical methods and self-reported measures [ ]. To understand the results in body composition and to be able to apply them in public health, our study included a combination of diet and PA and we had to demonstrate the difference in the change in muscle mass between diet, PA programs, or both [ ]. In this work, we aimed to contribute to the growing interest in the field of mHealth, regarding improvement of body composition and the change in dynamics of disease prevention and treatment, through text messaging interventions [ ]. This study abandons SMS technology to enter into a scenario of greater interaction between patients and their health, allowing feedback from the patients.
Although the number of women who completed the follow-up evaluation is greater than the estimated minimum sample size, the results should be interpreted with caution. In this sense, subsequent investigations with longer follow-up times, larger sample sizes, and with similar designs that allow us to corroborate the effectiveness found in this research would be necessary. Besides, more empirical research is needed to examine the effect of notification content and delivery times, as well as the purpose of user responsiveness, and to assess the impact of push notifications in other health care settings.
Push notifications have proven to be effective in the proposed weight loss program, leading to greater loss of fat mass and maintenance or increase of muscle mass among women who received it, specifically among those who followed a program of IPA. Future interventions should include a longer evaluation period; the impact of different message contents, as well as message delivery times and frequency, should also be researched.
Conflicts of Interest
CONSORT-EHEALTH checklist (V 1.6.1).PDF File (Adobe PDF File), 2200 KB
Main themes of the app message library.PPTX File , 46 KB
Intranet developed for the study.PDF File (Adobe PDF File), 2956 KB
- Porter J, Huggins CE, Truby H, Collins J. The effect of using mobile technology-based methods that record food or nutrient intake on diabetes control and nutrition outcomes: A systematic review. Nutrients 2016 Dec 17;8(12):815 [FREE Full text] [CrossRef] [Medline]
- Liu S. Statista. 2019 Mar 04. Wearable technology: Statistics & facts URL: https://www.statista.com/topics/1556/wearable-technology/ [accessed 2019-08-31]
- Alonso-Arévalo J, Mirón-Canelo J. Revista Cubana de Información en Ciencias de la Salud (ACIMED). 2017. Aplicaciones móviles en salud: Potencial, normativa de seguridad y regulación URL: http://scielo.sld.cu/scielo.php?script=sci_arttext&pid=S2307-21132017000300005 [accessed 2019-12-28]
- Eurostat. 2016 Dec 20. Internet use by individuals URL: http://ec.europa.eu/eurostat/documents/2995521/7771139/9-20122016-BP-EN.pdf/f023d81a-dce2-4959-93e3-8cc7082b6edd [accessed 2019-08-29]
- Laxminarayan S, Istepanian RS. UNWIRED E-MED: The next generation of wireless and Internet telemedicine systems. IEEE Trans Inf Technol Biomed 2000 Sep;4(3):189-193. [CrossRef] [Medline]
- Business Insider. 2017 Nov 07. IQVIA Institute for Human Data Science Study: Impact of digital health grows as innovation, evidence and adoption of mobile health apps accelerate URL: https://markets.businessinsider.com/news/stocks/iqvia -institute-for-human-data-science-study-impact-of-digital-health-grows-as-innovation-evidence-and-adoption-of-mobile-health-apps -accelerate-1007156018 [accessed 2019-08-29]
- Fjeldsoe BS, Marshall AL, Miller YD. Behavior change interventions delivered by mobile telephone short-message service. Am J Prev Med 2009 Feb;36(2):165-173. [CrossRef] [Medline]
- Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, et al. The effectiveness of mobile health technology-based health behaviour change or disease management interventions for health care consumers: A systematic review. PLoS Med 2013;10(1):e1001362 [FREE Full text] [CrossRef] [Medline]
- Molina Recio G, García-Hernández L, Molina Luque R, Salas-Morera L. The role of interdisciplinary research team in the impact of health apps in health and computer science publications: A systematic review. Biomed Eng Online 2016 Jul 15;15 Suppl 1:77 [FREE Full text] [CrossRef] [Medline]
- Thakkar J, Kurup R, Laba T, Santo K, Thiagalingam A, Rodgers A, et al. Mobile telephone text messaging for medication adherence in chronic disease: A meta-analysis. JAMA Intern Med 2016 Mar;176(3):340-349. [CrossRef] [Medline]
- Redfern J, Thiagalingam A, Jan S, Whittaker R, Hackett ML, Mooney J, et al. Development of a set of mobile phone text messages designed for prevention of recurrent cardiovascular events. Eur J Prev Cardiol 2014 Apr;21(4):492-499. [CrossRef] [Medline]
- Hao W, Hsu Y, Chen K, Li H, Iqbal U, Nguyen P, et al. LabPush: A pilot study of providing remote clinics with laboratory results via short message service (SMS) in Swaziland, Africa - A qualitative study. Comput Methods Programs Biomed 2015 Jan;118(1):77-83. [CrossRef] [Medline]
- Casillas J, Goyal A, Bryman J, Alquaddoomi F, Ganz P, Lidington E, et al. Development of a text messaging system to improve receipt of survivorship care in adolescent and young adult survivors of childhood cancer. J Cancer Surviv 2017 Aug;11(4):505-516 [FREE Full text] [CrossRef] [Medline]
- Leightley D, Puddephatt J, Jones N, Mahmoodi T, Chui Z, Field M, et al. A smartphone app and personalized text messaging framework (InDEx) to monitor and reduce alcohol use in ex-serving personnel: Development and feasibility study. JMIR Mhealth Uhealth 2018 Sep 11;6(9):e10074 [FREE Full text] [CrossRef] [Medline]
- Warren I, Meads A, Srirama S, Weerasinghe T, Paniagua C. Push notification mechanisms for pervasive smartphone applications. IEEE Pervasive Comput 2014 Apr;13(2):61-71. [CrossRef]
- Iqbal ST, Bailey BP. Effects of intelligent notification management on users and their tasks. In: Proceedings of the 26th Annual CHI Conference on Human Factors in Computing Systems. 2008 Presented at: 26th Annual CHI Conference on Human Factors in Computing Systems; April 5-10, 2008; Florence, Italy p. 93-102 URL: https://interruptions.net/literature/Iqbal-CHI08.pdf [CrossRef]
- Pielot M, Church K, de Oliveira R. An in-situ study of mobile phone notifications. In: Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices and Services. 2014 Presented at: 16th International Conference on Human-Computer Interaction with Mobile Devices and Services; September 23-26, 2014; Toronto, ON p. 233-242. [CrossRef]
- Gill S, Panda S. A smartphone app reveals erratic diurnal eating patterns in humans that can be modulated for health benefits. Cell Metab 2015 Nov 03;22(5):789-798 [FREE Full text] [CrossRef] [Medline]
- Armanasco AA, Miller YD, Fjeldsoe BS, Marshall AL. Preventive health behavior change text message interventions: A meta-analysis. Am J Prev Med 2017 Mar;52(3):391-402. [CrossRef] [Medline]
- Stephenson A, McDonough SM, Murphy MH, Nugent CD, Mair JL. Using computer, mobile and wearable technology enhanced interventions to reduce sedentary behaviour: A systematic review and meta-analysis. Int J Behav Nutr Phys Act 2017 Aug 11;14(1):105 [FREE Full text] [CrossRef] [Medline]
- Klasnja P, Pratt W. Healthcare in the pocket: Mapping the space of mobile-phone health interventions. J Biomed Inform 2012 Feb;45(1):184-198 [FREE Full text] [CrossRef] [Medline]
- van der Weegen S, Verwey R, Spreeuwenberg M, Tange H, van der Weijden T, de Witte L. The development of a mobile monitoring and feedback tool to stimulate physical activity of people with a chronic disease in primary care: A user-centered design. JMIR Mhealth Uhealth 2013 Jul 02;1(2):e8 [FREE Full text] [CrossRef] [Medline]
- Falk EB, O'Donnell MB, Cascio CN, Tinney F, Kang Y, Lieberman MD, et al. Self-affirmation alters the brain's response to health messages and subsequent behavior change. Proc Natl Acad Sci U S A 2015 Feb 17;112(7):1977-1982 [FREE Full text] [CrossRef] [Medline]
- Clark JE. Diet, exercise or diet with exercise: Comparing the effectiveness of treatment options for weight-loss and changes in fitness for adults (18-65 years old) who are overfat, or obese; systematic review and meta-analysis. J Diabetes Metab Disord 2015;14:31 [FREE Full text] [CrossRef] [Medline]
- Golubic R, Ekelund U, Wijndaele K, Luben R, Khaw K, Wareham NJ, et al. Rate of weight gain predicts change in physical activity levels: A longitudinal analysis of the EPIC-Norfolk cohort. Int J Obes (Lond) 2013 Mar;37(3):404-409 [FREE Full text] [CrossRef] [Medline]
- Liu F, Wang W, Ma J, Sa R, Zhuang G. Different associations of sufficient and vigorous physical activity with BMI in Northwest China. Sci Rep 2018 Sep 03;8(1):13120 [FREE Full text] [CrossRef] [Medline]
- Newton RL, Carter LA, Johnson W, Zhang D, Larrivee S, Kennedy BM, et al. A church-based weight loss intervention in African American adults using text messages (LEAN Study): Cluster randomized controlled trial. J Med Internet Res 2018 Aug 24;20(8):e256 [FREE Full text] [CrossRef] [Medline]
- Campbell MK, DeVellis BM, Strecher VJ, Ammerman AS, DeVellis RF, Sandler RS. Improving dietary behavior: The effectiveness of tailored messages in primary care settings. Am J Public Health 1994 May;84(5):783-787. [CrossRef] [Medline]
- Bull FC, Kreuter MW, Scharff DP. Effects of tailored, personalized and general health messages on physical activity. Patient Educ Couns 1999 Feb;36(2):181-192. [CrossRef] [Medline]
- Walther JB, Pingree S, Hawkins RP, Buller DB. Attributes of interactive online health information systems. J Med Internet Res 2005 Jul 01;7(3):e33 [FREE Full text] [CrossRef] [Medline]
- Bentley F, Tollmar K. The power of mobile notifications to increase well-being logging behavior. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York, NY: ACM; 2013 Presented at: SIGCHI Conference on Human Factors in Computing Systems; April 27-May 2, 2013; Paris, France. [CrossRef]
- Hagströmer M, Oja P, Sjöström M. The International Physical Activity Questionnaire (IPAQ): A study of concurrent and construct validity. Public Health Nutr 2006 Sep;9(6):755-762. [CrossRef] [Medline]
- Walsh JC, Corbett T, Hogan M, Duggan J, McNamara A. An mHealth intervention using a smartphone app to increase walking behavior in young adults: A pilot study. JMIR Mhealth Uhealth 2016 Sep 22;4(3):e109 [FREE Full text] [CrossRef] [Medline]
- Thomas JG, Bond DS. Review of innovations in digital health technology to promote weight control. Curr Diab Rep 2014;14(5):485. [CrossRef] [Medline]
- Cardozo LA, Guzman C, Andrés Y, Torres M, Alejandro J. Nutrición clínica y dietética hospitalaria, Volume 36, Issue 3. 2016. Body fat percentage and prevalence of overweight-obesity in college students of sports performance in Bogotá, Colombia [Article in Spanish] URL: https://www.researchgate.net/profile/Luis_Cardozo4/publication/318351764 _Porcentaje_de_grasa_corporal_y_prevalencia_de_sobrepeso-obesidad_en_estudiantes_universitarios_de_rendimiento_deportivo _de_Bogota_Colombia_Body_fat_percentage_and_prevalence_of_overweight-obesity_in_c/links/59655bd0aca27227 d78c60e6/Porcentaje-de-grasa-corporal-y-prevalencia-de-sobrepeso-obesidad-en-estudiantes-universitarios-de-rendimiento -deportivo-de-Bogota-Colombia-Body-fat-percentage-and-prevalence-of-overweight-obesity-in.pdf [accessed 2019-12-28]
- Forbes GB. Human Body Composition: Growth, Aging, Nutrition, and Activity. New York, NY: Springer-Verlag; 1987.
- Svärd A, Lahti J, Rahkonen O, Lahelma E, Lallukka T. Obesity and psychotropic medication: A prospective register linkage study among midlife women and men. BMC Psychiatry 2016 Jun 06;16:185 [FREE Full text] [CrossRef] [Medline]
- Schubert MM, Seay RF, Spain KK, Clarke HE, Taylor JK. Reliability and validity of various laboratory methods of body composition assessment in young adults. Clin Physiol Funct Imaging 2019 Mar;39(2):150-159. [CrossRef] [Medline]
- Callaway W, Chumlea WC, Bouchard C, Himes JH, Lohman TG, Martin AD, et al. Circumferences. In: Lohman TG, Roche AF, Martorell R, editors. Anthropometric Standardization Reference Manual. Champaign, IL: Human Kinetics Books; 1988:44-45.
- Matthew CE. Calibration of accelerometer output for adults. Med Sci Sports Exerc 2005 Nov;37(11 Suppl):S512-S522. [CrossRef] [Medline]
- Karvonen J, Vuorimaa T. Heart rate and exercise intensity during sports activities: Practical application. Sports Med 1988 May;5(5):303-311. [CrossRef] [Medline]
- Harris JA, Benedict FG. A biometric study of human basal metabolism. Proc Natl Acad Sci U S A 1918 Dec;4(12):370-373 [FREE Full text] [CrossRef] [Medline]
- Segal KR, Edano A, Abalos A, Albu J, Blando L, Tomas MB, et al. Effect of exercise training on insulin sensitivity and glucose metabolism in lean, obese, and diabetic men. J Appl Physiol (1985) 1991 Dec;71(6):2402-2411. [CrossRef] [Medline]
- Dietowin. URL: http://www.dietowin.es/ [accessed 2019-12-28]
- Baumeister RF, Vohs KD, Tice DM. The strength model of self-control. Curr Dir Psychol Sci 2016 Jun 24;16(6):351-355. [CrossRef]
- Polzien KM, Jakicic JM, Tate DF, Otto AD. The efficacy of a technology-based system in a short-term behavioral weight loss intervention. Obesity (Silver Spring) 2007 Apr;15(4):825-830 [FREE Full text] [CrossRef] [Medline]
- Hebden L, Cook A, van der Ploeg HP, King L, Bauman A, Allman-Farinelli M. A mobile health intervention for weight management among young adults: A pilot randomised controlled trial. J Hum Nutr Diet 2014 Aug;27(4):322-332. [CrossRef] [Medline]
- Fukuoka Y, Vittinghoff E, Jong SS, Haskell W. Innovation to motivation: Pilot study of a mobile phone intervention to increase physical activity among sedentary women. Prev Med 2010;51(3-4):287-289 [FREE Full text] [CrossRef] [Medline]
- Turner-McGrievy G, Tate D. Tweets, apps, and pods: Results of the 6-month Mobile Pounds Off Digitally (Mobile POD) randomized weight-loss intervention among adults. J Med Internet Res 2011 Dec 20;13(4):e120 [FREE Full text] [CrossRef] [Medline]
- Jacko JA, editor. Human Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications. 3rd edition. Boca Raton, FL: CRC Press; 2012.
- Hutchesson MJ, Rollo ME, Krukowski R, Ells L, Harvey J, Morgan PJ, et al. eHealth interventions for the prevention and treatment of overweight and obesity in adults: A systematic review with meta-analysis. Obes Rev 2015 May;16(5):376-392. [CrossRef] [Medline]
- Gell NM, Wadsworth DD. The use of text messaging to promote physical activity in working women: A randomized controlled trial. J Phys Act Health 2015 Jun;12(6):756-763 [FREE Full text] [CrossRef] [Medline]
- Fournier M, d'Arripe-Longueville F, Radel R. Testing the effect of text messaging cues to promote physical activity habits: A worksite-based exploratory intervention. Scand J Med Sci Sports 2017 Oct;27(10):1157-1165. [CrossRef] [Medline]
- Steinberg DM, Levine EL, Askew S, Foley P, Bennett GG. Daily text messaging for weight control among racial and ethnic minority women: Randomized controlled pilot study. J Med Internet Res 2013 Nov 18;15(11):e244 [FREE Full text] [CrossRef] [Medline]
- Shapiro JR, Koro T, Doran N, Thompson S, Sallis JF, Calfas K, et al. Text4Diet: A randomized controlled study using text messaging for weight loss behaviors. Prev Med 2012 Nov;55(5):412-417. [CrossRef] [Medline]
- Bosy-Westphal A, Schautz B, Lagerpusch M, Pourhassan M, Braun W, Goele K, et al. Effect of weight loss and regain on adipose tissue distribution, composition of lean mass and resting energy expenditure in young overweight and obese adults. Int J Obes (Lond) 2013 Oct;37(10):1371-1377. [CrossRef] [Medline]
- Gallagher D, Kelley DE, Thornton J, Boxt L, Pi-Sunyer X, Lipkin E, MRI Ancillary Study Group of the Look AHEAD Research Group. Changes in skeletal muscle and organ size after a weight-loss intervention in overweight and obese type 2 diabetic patients. Am J Clin Nutr 2017 Jan;105(1):78-84 [FREE Full text] [CrossRef] [Medline]
- Tanaka NI, Murakami H, Aiba N, Morita A, Watanabe S, Miyachi M, Saku Control Obesity Program (SCOP) Study Group. Effects of 1-year weight loss intervention on abdominal skeletal muscle mass in Japanese overweight men and women. Asia Pac J Clin Nutr 2019;28(1):72-78 [FREE Full text] [CrossRef] [Medline]
- Cava E, Yeat NC, Mittendorfer B. Preserving healthy muscle during weight loss. Adv Nutr 2017 May;8(3):511-519 [FREE Full text] [CrossRef] [Medline]
- Swift DL, Johannsen NM, Lavie CJ, Earnest CP, Church TS. The role of exercise and physical activity in weight loss and maintenance. Prog Cardiovasc Dis 2014;56(4):441-447 [FREE Full text] [CrossRef] [Medline]
- Donnelly JE, Honas JJ, Smith BK, Mayo MS, Gibson CA, Sullivan DK, et al. Aerobic exercise alone results in clinically significant weight loss for men and women: Midwest exercise trial 2. Obesity (Silver Spring) 2013 Mar;21(3):E219-E228 [FREE Full text] [CrossRef] [Medline]
- Morrison LG, Hargood C, Pejovic V, Geraghty AW, Lloyd S, Goodman N, et al. The effect of timing and frequency of push notifications on usage of a smartphone-based stress management intervention: An exploratory trial. PLoS One 2017;12(1):e0169162 [FREE Full text] [CrossRef] [Medline]
- Turner-McGrievy GM, Wilcox S, Boutté A, Hutto BE, Singletary C, Muth ER, et al. The Dietary Intervention to Enhance Tracking with Mobile Devices (DIET Mobile) Study: A 6-month randomized weight loss trial. Obesity (Silver Spring) 2017 Aug;25(8):1336-1342 [FREE Full text] [CrossRef] [Medline]
- Helmerhorst HJ, Brage S, Warren J, Besson H, Ekelund U. A systematic review of reliability and objective criterion-related validity of physical activity questionnaires. Int J Behav Nutr Phys Act 2012 Aug 31;9:103 [FREE Full text] [CrossRef] [Medline]
- Ferrari P, Friedenreich C, Matthews CE. The role of measurement error in estimating levels of physical activity. Am J Epidemiol 2007 Oct 01;166(7):832-840. [CrossRef] [Medline]
- Armanasco AA, Miller YD, Fjeldsoe BS, Marshall AL. Preventive health behavior change text message interventions: A meta-analysis. Am J Prev Med 2017 Mar;52(3):391-402. [CrossRef] [Medline]
|ANOVA: analysis of variance|
|BMI: body mass index|
|CONSORT: Consolidated Standards of Reporting Trials|
|EHEALTH: Electronic and Mobile HEalth Applications and onLine TeleHealth|
|IPA: intense physical activity|
|IPAQ-long: long version of the International Physical Activity Questionnaire|
|LPA: light physical activity|
|MPA: moderate physical activity|
|PA: physical activity|
|SMS: short message service|
Edited by C Dias; submitted 10.05.19; peer-reviewed by C Tejera Pérez, J Alvarez Pitti, C Carrion, R Ciptaningtyas, M Gaman, D Leightley; comments to author 19.08.19; revised version received 29.09.19; accepted 05.11.19; published 12.02.20
©Alberto Hernández-Reyes, Fernando Cámara-Martos, Guillermo Molina Recio, Rafael Molina-Luque, Manuel Romero-Saldaña, Rafael Moreno Rojas. Originally published in JMIR mHealth and uHealth (http://mhealth.jmir.org), 12.02.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.