Background: Approximately 50% of cardiovascular disease (CVD) cases are attributable to lifestyle risk factors. Despite widespread education, personal knowledge, and efficacy, many individuals fail to adequately modify these risk factors, even after a cardiovascular event. Digital technology interventions have been suggested as a viable equivalent and potential alternative to conventional cardiac rehabilitation care centers. However, little is known about the clinical effectiveness of these technologies in bringing about behavioral changes in patients with CVD at an individual level.
Objective: The aim of this study is to identify and measure the effectiveness of digital technology (eg, mobile phones, the internet, software applications, wearables, etc) interventions in randomized controlled trials (RCTs) and determine which behavior change constructs are effective at achieving risk factor modification in patients with CVD.
Methods: This study is a systematic review and meta-analysis of RCTs designed according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analysis) statement standard. Mixed data from studies extracted from selected research databases and filtered for RCTs only were analyzed using quantitative methods. Outcome hypothesis testing was set at 95% CI and P=.05 for statistical significance.
Results: Digital interventions were delivered using devices such as cell phones, smartphones, personal computers, and wearables coupled with technologies such as the internet, SMS, software applications, and mobile sensors. Behavioral change constructs such as cognition, follow-up, goal setting, record keeping, perceived benefit, persuasion, socialization, personalization, rewards and incentives, support, and self-management were used. The meta-analyzed effect estimates (mean difference [MD]; standard mean difference [SMD]; and risk ratio [RR]) calculated for outcomes showed benefits in total cholesterol SMD at −0.29 [−0.44, −0.15], P<.001; high-density lipoprotein SMD at –0.09 [–0.19, 0.00], P=.05; low-density lipoprotein SMD at −0.18 [−0.33, −0.04], P=.01; physical activity (PA) SMD at 0.23 [0.11, 0.36], P<.001; physical inactivity (sedentary) RR at 0.54 [0.39, 0.75], P<.001; and diet (food intake) RR at 0.79 [0.66, 0.94], P=.007. Initial effect estimates showed no significant benefit in body mass index (BMI) MD at −0.37 [−1.20, 0.46], P=.38; diastolic blood pressure (BP) SMD at −0.06 [−0.20, 0.08], P=.43; systolic BP SMD at −0.03 [−0.18, 0.13], P=.74; Hemoglobin A1C blood sugar (HbA1c) RR at 1.04 [0.40, 2.70], P=.94; alcohol intake SMD at −0.16 [−1.43, 1.10], P=.80; smoking RR at 0.87 [0.67, 1.13], P=.30; and medication adherence RR at 1.10 [1.00, 1.22], P=.06.
Conclusions: Digital interventions may improve healthy behavioral factors (PA, healthy diet, and medication adherence) and are even more potent when used to treat multiple behavioral outcomes (eg, medication adherence plus). However, they did not appear to reduce unhealthy behavioral factors (smoking, alcohol intake, and unhealthy diet) and clinical outcomes (BMI, triglycerides, diastolic and systolic BP, and HbA1c).
Cardiovascular diseases (CVDs), including coronary heart disease (CHD), stroke, and peripheral vascular disease, remain one of the most common causes of early death and disability worldwide, with 17.9 million deaths and 422.7 million cases each year . In 2017 alone, there were approximately 1.7 million inpatient episodes of CVDs in the United Kingdom [ ]. This imposes a heavy burden on individuals and the society, accounting for £19 billion in public expense, 7.4 million disabilities, and 167,000,000 deaths in 2019 [ ].
Although there are genetic, demographic, and environmental causes of CVDs , approximately 50% of CVD risk is attributable to modifiable lifestyle factors such as obesity, diabetes, inactivity, and smoking [ ]. However, despite widespread education and personal knowledge, many individuals fail to adequately modify these risk factors, even after a cardiovascular event with cardiac rehabilitation care center support [ ]. Failure to address this challenge (ie, a change from cognitive insight to manifest action) results in patients remaining at a higher risk of future cardiovascular events with associated personal, social, and economic costs.
There could be several reasons for the challenges in the personalized management (ie, modification) of CVD and other chronic disease risk factors. These include care center accessibility and outpatient mobility and morbidity, comprehensibility, and retainability . For these reasons, lifestyle risk factor management (particularly low physical activity [PA] and obesity) remains suboptimally addressed in CVD outpatients [ ]. These show that although there is a modest success with rehabilitation care center interventions, the technical reach of this population-based approach is limited in its ability to bring about a significant sustainable change in exposed individuals [ ].
To achieve a sustainable change, social construct strategies (eg, self-management, motivation, perceived benefits, etc) embedded in behavioral change interventions have shown health benefits in chronic disease risk factor management . Their substantial contribution to changes in health behaviors suggests a worthy consideration in behavioral health interventions at the individual level. However, in the context of a population-based health behavior change in rehabilitation care centers, there are limitations in the ability of social constructs to make an individual cope sustainably with its strategies at the personal level [ ].
The emergence of digital health technologies (eg, the internet, phone apps and devices, and wearable sensors for telemedicine, web browsing, emailing, text messaging, monitoring) in the health care sector , designed to manage and monitor chronic disease lifestyle factors, has shown potential in personalized chronic disease lifestyle factor modification [ ]. This potential is based on evidence that healthy lifestyle factors are behavior-specific, measurable, and modifiable [ ]. Due to the commercial drive and attributed qualities, many of these technologies and devices have been continually used in cardiac rehabilitation care centers, and even instead of care [ , ]. However, despite their popularity and potential, these technologies lack evidence summary of secondary prevention of clinically relevant outcomes, which result from behavior change in CVD outpatients, especially at a personalized level [ , ].
The primary objective of this systematic review is to identify and measure the effectiveness of digital technology (eg, mobile phones, the internet, software applications, wearables, etc) interventions in randomized controlled trials (RCTs) and determine which behavior change constructs were effective at achieving risk factor modification among patients with CVD.
This study is a systematic literature review and meta-analysis of RCTs designed in line with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analysis) statement standard . The protocol was registered with PROSPERO protocol ID CRD42019139801 [ ].
Inclusion Criteria for Considering Studies in This Review
Types of Studies
RCTs of digital interventions with a minimum of 4 weeks of intervention follow-up period were considered. Publications in English from 2000 to September 2019 were included.
Types of Participants
The considered studies focused on an adult population (≥18 years) with a minimum of 30 participants in the intervention study.
Types of Interventions
The considered intervention types were digital intervention only versus usual care or digital intervention plus usual care versus usual care. The studies were required to be based on a well-defined CVD risk factor modification measurement function and intention to modify health behavior in outpatients diagnosed or treated for CVD only or with comorbidities using a named digital device.
Types of Outcome Measures
Clinical and behavioral outcomes were measured at baseline and endpoint. All outcome hypothesis testing was set at 95% CI and a 2-tailed P value of .05 level of statistical significance. Behavioral outcomes included PA (physical inactivity [PI], sedentary lifestyle), food intake (diet), smoking, alcohol intake, and medication adherence. Clinical outcomes included BMI, cholesterol levels (total cholesterol [TC], high-density lipoproteins [HDLs], low-density lipoproteins [LDLs], and triglycerides [TGs]), blood pressure (diastolic BP and systolic BP), and blood sugar levels (HbA1c), which are measures of obesity, hypercholesterolemia, hypertension, and diabetes, respectively.
Studies related to non-RCTs, nondigital interventions, and journal papers not published in English were excluded. In addition, studies whose populations shared modifiable risk factors with CVD but were not diagnosed with a named CVD; studies with nonclinical or nonbehavioral outcomes, such as studies with genetic outcomes and studies directly measuring hospital or staff service efficiency, etc; and healthy population or intensive care studies were excluded.
No analysis was conducted on data of outcomes from subgroups (endpoint to endpoint) within the population of the included studies.
Search Methods for Identification of Studies
A single 6S pyramid systematic literature search strategy was developed (Table S3 in the). This was run on Ovid Medline and Ovid Embase, Web of Science (Core Collection), Scopus, Cochrane Library, and on the following databases in EBSCOHost: CINAHL, Psych Info, Health Source, Open Dissertation, Psych Article, and Business Source Elite. Filters were used to narrow searches to studies using RCT methodology and those written in the English language and from the year 2000 onward. The year limit was applied, in line with the World Health Organization’s release of the document on the approach to digital health strategies [ ], as the start of the mass availability and use of digital technologies, making pre-2000 literature less relevant.
Two independent reviewers (AS and RP) were involved in a thorough search strategy build-up and study extraction to identify potentially relevant publications. References and citations were also searched. Where an abstract did not provide sufficient precision to meet the selection prerequisite, the article was reserved for full-text review. Relevant articles retrieved for full-text reviews were independently evaluated (AS and MG). The consensus to include or exclude a trial was reached based on study design, method, population demography, intervention mechanism, and study outcomes.
Data Collection and Analysis
The PRISMA search protocol  was followed, with all extracted data subsequently managed using the Mendeley Desktop reference manager software (Elsevier). Publication search outcomes were imported in .ris format into the Mendeley Desktop and partitioned based on the search database source. Imported publications were autochecked for duplicates using the software, and a further manual, independent duplication check was carried out (AS and YD). Publication papers were title-read, abstract-read, and full-text read based on the inclusion and exclusion preselection criteria. Selected journal papers were read for data synthesis and analysis.
Data Extraction and Management
Data were extracted into a preset Excel (Microsoft Corporation) worksheet. The data extraction process was performed independently (AS) using predetermined variables and then validated accordingly (MG). Data extracted included population demographics (mean age, sex, size, and CVD diagnosis) description of the study (authors, year of publication, country, intervention acronym, digital device, intervention type, trial protocol registration, design, and duration), behavioral change context (change technique and risk factors), and clinical study outcomes (outcome measures, outcome units, mean baseline measurements, mean outcome measurements, P values, and SDs). Authors of studies with insufficient or missing outcome data were contacted for further information.
All extracted data from the selected studies were analyzed () using Review Manager 5.3 (The Cochrane Collaboration). An assessment of the risk of bias ( ) was carried out by 2 researchers, AS and YD, using the modified Cochrane Collaboration AUB KQ1 Risk of Bias Assessment Tool, Review Manager 5.3 (The Cochrane Collaboration) with assessment result validation by an external independent researcher. Bias quality was assessed as high, low, or unclear for individual elements from 6 items: selection, performance, attrition, reporting, proportion, outcome, and treatment efficacy. Where the attrition bias risk is high, there is more likely to be a high treatment efficacy bias except where the basis for participant dropout is a medical reason, relocation, or death. Quality assessment items were evaluated by an external assessor to validate the initial scales judged by the author. Controversial evaluation differences were discussed, and consensus was reached before the final documentation. The risk of bias across studies was assessed for each analyzed outcome for publication bias reporting. Results were generated with meta-analysis data for each outcome and are presented in the Results section.
The review authors considered the variations in outcome measurement across studies by applying appropriate statistical methods (fixed effect and random effect) using the Inverse-Variance and Mantel-Haenszel (DerSimonian and Laird) models to generate meta-analytic estimates of treatment effect using the Review Manager 5.3 software. Differences in effects were examined by comparing digital with usual care. The weighted mean difference (MD) or standardized mean difference (SMD) was calculated for continuous data using the inverse variance statistical method. Relative risks were calculated for dichotomous data using the Mantel-Haenszel statistical method (The Cochrane Collaboration). Provision for variations among the included studies was made using the random effect meta-analysis model in analyzing all included studies. The heterogeneity statistic I2 was calculated to describe the percentage of variation among the studies. Hypothesis testing was set at a 2-tailed 0.05 level of significance and a 95% CI. No analysis was conducted on the data of outcomes from subgroups within the population of the included studies.
Sensitivity analyses were proportionately conducted on outcomes to check the cumulative effects of the publication year, participant size, efficacy, and category of intervention (risk factors and digital intervention) on statistical significance. For food intake, studies with interventions targeting healthy diet and studies targeting unhealthy diet were analyzed separately to provide a clearer insight into treatment effects. Studies with treatment for medication adherence were analyzed separately for (1) other risk factor treatments plus medication adherence using the SMS text messaging intervention only, (2) medication adherence treatment only (with no other risk factor) using the SMS text messaging intervention alone, (3) other risk factor treatment plus medication adherence treatment using non-SMS text messaging intervention, and (4) medication adherence treatment with SMS text messaging intervention only. The results are presented and discussed in the Results and Discussion sections, respectively.
|Outcomes or subgroups||Number of studies (N=25), n (%)||Participants||Statistical methods||Effect estimates (95% CI)||P value|
|BMI||10 (40)||2558||MDb (IV, random, 95% CI)||−0.37 (−1.20 to 0.46)||.38|
|Total cholesterol||9 (36)||1783||SMDc (IV, random, 95% CI)||−0.29 (−0.44 to −0.15)||<.001|
|High-density lipoprotein||9 (36)||1783||SMD (IV, random, 95% CI)||−0.09 (−0.19 to 0.00)||.05|
|Low-density lipoprotein||12 (48)||3431||SMD (IV, random, 95% CI)||−0.18 (−0.33 to −0.04)||.01|
|Triglycerides||8 (32)||1660||SMD (IV, random, 95% CI)||−0.07 (−0.24 to 0.11)||.28|
|Diastolic BPd||11 (44)||2460||SMD (IV, random, 95% CI)||−0.06 (−0.20 to 0.08)||.43|
|Systolic BP||12 (48)||3283||SMD (IV, random, 95% CI)||−0.03 (−0.18 to 0.13)||.74|
|Physical activity||14 (56)||3015||SMD (IV, random, 95% CI)||0.23 (0.11 to 0.36)||<.001|
|Alcohol consumption||4 (16)||651||SMD (IV, random, 95% CI)||−0.16 (−1.43 to 1.10)||.80|
|Blood sugar, HbA1ce||2 (8)||380||RRf (M-H, random, 95% CI)||1.04 (0.40 to 2.70)||.94|
|Physical inactivity||4 (16)||1054||RR (M-H, random, 95% CI)||0.54 (0.39 to 0.75)||<.001|
|Food intake (diet)||6 (24)||716||RR (M-H, random, 95% CI)||0.79 (0.66 to 0.94)||.007|
|Health diet||3 (12)||173||RR (M-H, random, 95% CI)||0.70 (0.55 to 0.89)||.004|
|Unhealthy diet||3 (12)||185||RR (M-H, random, 95% CI)||0.90 (0.68 to 1.19)||.47|
|Smoking||11 (44)||2916||RR (M-H, random, 95% CI)||0.87 (0.67 to 1.13)||.30|
|Medication adherence||11 (44)||2710||RR (M-H, random, 95% CI)||1.10 (1.00 to 1.22)||.06|
|Medication adherence (multiple treatment)||5 (20)||758||RR (M-H, random, 95% CI)||1.07 (1.01 to 1.14)||.02|
aSummary of analyzed data.
bMD: mean difference.
cSMD: standard mean difference.
dBP: blood pressure.
eHbA1c: Hemoglobin A1c blood sugar.
fRR: risk ratio.
|Study (reference)||Selection bias||Performance bias||Detection bias||Attrition bias||Proportion bias||Outcome bias||Reportin bias||Treatmen efficacy|
|Random sequence generation||Allocation concealment||Blinding of participants and personnel||Blinding of outcome assessment||Incomplete outcome data||Groups balanced at baseline||Groups received same intervention||Selective reporting||Intention-to-treat analysis|
|Akhu-Z et al, 2016 ||Low||Unclear||Unclear||Low||High||Low||Low||Low||High|
|Chow et al, 2015 ||Low||Low||Low||Low||High||Low||High||Low||High|
|Dale et al, 2015 ||Low||Low||Low||High||Low||High||High||Low||Low|
|Devi et al, 2014 ||Low||Low||Low||High||High||Low||Low||High||Unclear|
|Frederix et al, 2015 ||Low||Low||Low||Low||High||Low||Low||Low||Unclear|
|Hawkes et al, 2012 ||Low||High||Low||Low||High||Low||Low||High||Unclear|
|Johnston et al, 2016 ||Low||Unclear||Unclear||Unclear||High||High||High||High||Unclear|
|Kamal et al, 2015 ||Low||Low||Low||Low||High||Low||High||Low||High|
|Khonsari et al, 2015 ||Low||Unclear||High||Unclear||Low||Low||High||Low||Low|
|Kraal et al, 2014 ||Low||Low||Unclear||Unclear||Low||Low||High||Low||Low|
|Lear et al, 2014 ||Low||Low||Low||Low||High||Low||Low||Low||Low|
|Maddison et al, 2014 ||Low||Low||Low||Low||High||Low||High||Low||Unclear|
|Ogren et al, 2018 ||Low||Low||High||Unclear||Low||Low||Low||Unclear||High|
|Pandey et al, 2014 ||Unclear||Unclear||Low||Low||Unclear||Low||Low||Unclear||Unclear|
|Park et al, 2013 ||Low||Low||High||Low||Low||Unclear||Low||Low||Low|
|Quilici et al, 2012 ||Low||Low||Unclear||Unclear||High||Low||Low||Low||Unclear|
|Redfern et al, 2009 ||Low||Low||Low||Low||Low||Low||Low||Low||Low|
|Reid et al, 2011 ||Low||Low||Low||Low||High||Low||Low||Low||Low|
|Southard et al, 2003 ||Low||Low||Low||Low||Low||Low||Low||Low||Low|
|Tiede et al, 2017 ||Low||Low||High||Unclear||High||High||Low||Low||High|
|Vale et al, 2002 ||Low||High||High||Low||High||Low||Low||High||Low|
|Vemooij et al, 2012 ||Low||Low||Unclear||Unclear||Low||Low||High||Low||Low|
|Wan et al, 2016 ||Low||Low||Low||Low||High||Low||Low||Low||Low|
|Widmer et al, 2017 ||Low||Low||Low||Low||Low||High||High||Low||Unclear|
|Zheng et al, 2019 ||Low||High||Low||Low||Low||Low||High||Low||Low|
aRisk of bias: review authors’ judgments about each risk of bias item for the included studies.
The search retrieved 1626 papers with the auto-removal of 326 duplicates. A total of 35 papers remained after applying inclusion and exclusion criteria. Ten papers were excluded because they were systematic literature reviews but not RCTs. A final count of 25 papers was considered for the review: 12 from the database searches and 13 from references, citations, and gray literature (). The included studies are listed in the table of included studies (Table S4 in ), and excluded studies are listed in the table of excluded studies (Table S5 in ) with reasons.
Studies are described by their common characteristics, which include population demography, digital technologies and brands, intervention mechanisms and behavioral change constructs, types of CVD, and general characteristics. Table S6 () provides a detailed summary of the reviewed studies.
The included studies had a total participant count of 5,779 at baseline, with a mean age of 60.03 years (SD 2.73) and a male proportion of 75.22% (4347/5779). A geographical analysis of the included studies identified evenly distributed locations of studies on a global scale, with countries spanning Europe (5 studies), Middle East (2 studies), Asia (3 studies), Northern America (6 studies), Scandinavia (2 studies), Australasia (6 studies), and the United Kingdom (1 study).
Digital Technologies and Brands
Cardiovascular digital interventions were delivered using devices such as cell phones, smartphones, personal computers (laptops and desktops), and wearables. Technologies included the internet, software applications, and mobile sensors. Intervention device brand names such as Personal Health Assistant, PHA, FIT@Home, HeartLinks, SUPPORT, SMS4Stroke, ProActive Heart, Text4Heart, CHAT, CardioFit, HEART, ActivateYourHeart, MEMS, vCRP, COACH, CHOICE, and TBHC were recorded.
Intervention Mechanisms and Behavioral Change Constructs
Intervention mechanisms (ie, the digital strategy plus behavioral construct) were based on online support, telerehabilitation, telemonitoring, and online coaching. The interventions included major behavioral change constructs such as cognition, follow-up, goal setting, record keeping, perceived benefit, persuasion, social engagement (virtual), personalization (or customization), rewards and incentives, support, and self-management.
CVD types: Diagnosed CVDs included CHD, coronary artery disease, myocardial infarction, acute coronary syndrome, angina, atherosclerosis, heart failure, transient ischemic attack, and stroke. Four studies [, , , ] were not specific about CVD diagnosis in the study population.
Study follow-up ranged from 1 to 4 (9 studies), 6 (12 studies), 12 (3 studies), and 24 months (1 study), with 6 months being the most frequent duration of the follow-up period for interventions. No data on outcomes from subgroups within the populations of the included studies were considered in the analysis.
The main units of outcome measurements were kg/m2 (BMI), mg/dL, and mmol/L (TC, HDL, low-density lipoprotein [LDL], and TGs, mmHg (diastolic blood pressure [DBP] and systolic blood pressure [SBP]), min/week (PA and PI), percentage, % (Hemoglobin A1C blood sugar—HbA1c, alcohol, smoking, and food intake), and Morisky Medication Adherence Scale for Medication Adherence 8. In the treatment context, all the intervention studies had been administered either as digital intervention versus usual care (15 studies) or digital intervention and usual care versus usual care (10 studies).
Synthesis of Results
The use of digital intervention compared with usual care significantly modified all CVD risk factors except BMI, TG, DBP, SBP, HbA1c, alcohol intake, smoking, and medication adherence. A detailed summary of these findings is presented in.
Summary of Results
Effect estimates (MD, SMD, and RR) were significant and in favor of digital interventions for TC, HDL, LDL, PA, PI, and food intake.
The BMI outcome () reported MD was estimated at −0.37 (95% CI –1.20 to 0.46, P=.38). The TC outcome ( ) reported an SMD estimated at −0.29 (95% CI –0.44 to –0.15, P<.001). The HDL outcome ( ) reported an SMD estimated at −0.09 (95% CI −0.19 to 0.00, P=.05). The LDL outcome ( ) reported an SMD estimated at –0.18 (95% CI –0.33 to –0.04, P=.01). The TG outcome ( ) reported an SMD estimated at −0.10 (95% CI –0.28 to 0.08), P=.28. Diastolic and systolic BP outcomes ( and ) reported SMDs estimated at –0.06 (95% CI −0.20 to 0.08, P=.43) and −0.03 (95% CI −0.18 to 0.13, P=.74), respectively. The HbA1c outcome ( ) reported an RR estimated at 1.04 (95% CI 0.40 to 2.70, P=.94). A summary of the clinical outcome findings is presented in - .
The PA outcome () reported an SMD estimated at 0.23 (95% CI 0.11 to 0.36, P<.001). PI (sedentary) in reported an RR estimated at 0.54 (95% CI 0.39 to 0.75, P<.001). Diet (food intake) in reported an RR estimated at 0.79 (0.66 to 0.94, P=.007). Further analysis was conducted as healthy diet targeted ( ) treatment and unhealthy diet targeted ( ) treatment; this is reported in the AdditionalAnalysis section. The alcohol intake outcome ( ) reported an SMD estimated at −0.16 (95% CI –1.43 to 1.10, P=.80). Smoking and medication adherence outcomes ( and ) reported RR estimated at 0.87 (95% CI 0.67 to 1.13, P=.30), and 1.10 (95% CI 1.00 to 1.22, P=.06), respectively. A summary of the behavioral outcome findings is presented in - .
Risk of Bias in Included Studies
provides a qualitative detail of the risk of bias assessment of the studies in the review. Proportion bias at baseline was reported in 16% (4/25) of the included studies as high risk. Intervention dropout was recorded in 32% (8/25) of the included studies at less than 10% of participants per study. Dropouts greater than 10% of study participants were recorded as high risk for treatment efficacy.
Risk of Bias Across Studies
The results of the risk of bias across studies for each outcome are presented along with the meta-analysis (- ). Outcomes are sparsely identified with low and unclear risks for the identified risk items.
Results of the sensitivity analysis were included for the considered outcomes inand and - . Sensitivity analyses proportionately conducted on outcomes to check the cumulative effects of the study population and intervention characteristics (eg, publication year, participant size, efficacy, and categories of treatment) on subgroups showed significant effects of interest in 2 outcomes as follows:
Food intake: Healthy diet targeted () treatment (P=.004) and unhealthy diet targeted ( ) treatment (P=.47); medication adherence: medication adherence plus other risk factors ( ) treatment (P=.02) and medication adherence treatment alone (P=.11), as shown in .
This study of digital technology interventions addressing clinical and behavioral risk factor modification in people with CVDs demonstrates that not all CVD lifestyle risk factor modifications are favored by the use of digital interventions. Digital technology intervention in cardiac patients was associated with improvements in TC, HDL, LDL, PA, PI, healthy diet, and medication adherence (all P≤.05). However, there were no differences in intervention effects for BMI, TGs, BP (diastolic and systolic), blood sugar, alcohol intake, and smoking (all P>.05).
Behavioral Change Constructs and Digital Intervention Strategies
The mechanism of risk factor modification in the included studies is based on behavioral change constructs [, ], which include self-management, feedback mechanisms, progress recording and tracking (monitoring), one-on-one or social support, persuasion, personalization (customization), reiteration, self-efficacy, and motivation. For this study, these constructs are commonly used in the study trials compared with other constructs in the literature, such as perceived risk and perceived benefits, incentives, and reimbursement (rewards), which are rarely used in the study trials.
The use of behavioral change constructs in combination with digital technologies in the study trials has revealed their successful application in individual behavioral risk factor modification . The overall desired effect has been found in digital interventions alone (15 studies) when compared with digital plus usual care interventions (10 studies), giving support to out-of-clinic risk factor modification at the personal level [ ].
From our results, the use of behavioral change constructs and digital intervention strategies largely relies on patients’ self-dependency (low- to moderate-risk CVD patients), and interventions that favored digital technologies were reported for all CVD populations but barely for study trials on stroke and rarely for study trials on angina outpatients. An exception to this reliance was found in studies on medication adherence, which had been successfully self-managed with a digital intervention (SMS text messaging) - this informed advice-based instead of activity-based options for moderate-risk CVD outpatients in risk factor modification prescriptions. The effect of mobile sensor technology using wearable devices was inconclusive as there was only one study that engaged this digital intervention in its trial (Table S4 in).
There was no clinical benefit for BMI, TG, SBP, DBP, or HbA1c with the use of digital interventions compared with usual care intervention in the study trials. This finding suggests a form of association between clinical factors and unhealthy behavior modification using digital technologies, noting that these clinical factors are the main indicators of unhealthy behavior conditions such as obesity, hypercholesterolemia, hypertension, and diabetes.
However, an exception to these similarities is the significant effect of digital technology intervention on clinical factors such as TC, HDL, and LDL, which could only be inferred by their shared physiological response to regulations in and by healthy behavioral factors such as healthy diet and medication adherence from a lifestyle perspective . This response was less impactful on TGs, which are stored lipids in fatty cells and though considered bad cholesterol like LDL, are less regulated by medication (eg, statin) as compared with diet [ ]. Our findings suggest that this exception is not necessarily based on the application of behavioral change techniques or other change-effecting variables. This view is validated by the fact that BMI (an indicator of overweight) and HbA1c (an indicator of excess sugar), which are precursors for obesity and diabetes respectively as CVD risk factors, in association with unhealthy food intake appear to be not modifiable by digital technology interventions. Furthermore, we consider that the modification of LDL (bad cholesterol) by digital intervention might have been because of the positive inverse effect derived from the modification benefits of TC and HDL (good cholesterols) within each study population.
TC, HDL, and LDL modifications are associated with the use of cell phone devices in study trials. Behavior change techniques in TC, HDL, and LDL populations include self-reporting and self-recording of progress, one-on-one support, and persuasion. TC, HDL, and LDL study populations share commonly diagnosed CVDs and digital intervention strategies.
PA trials are characterized by smartphones and cell phone devices in a 1:1 ratio. In order of preference, the use of intervention strategies is, first, telerehabilitation and online education, followed by online feedback (tele-support) and telemonitoring, and finally, SMS text messaging support by active coaching (20% of trials). PI (sedentary) trials revealed a higher population mean age, which suggests a close association with comorbidity and immobility among outpatients ; therefore, there is a need to tailor digital intervention treatment to patients’ level of engagement.
PA and PI have gained modification preferences and digital intervention effectiveness because of active participant engagement in 11 smartphone studies using tele-intervention (audiovisual) strategy, 2 cell phone studies engaging in active coaching (audio) strategy, and 6 cell phone studies using automated SMS text messaging support (text) strategy (in 19 studies). This finding suggests greater effectiveness of smartphones in audiovisual interventions compared with cell phones, indicating that cell phones might have gained usage (in medication adherence study trials) only because of their affordability and ease of use [, ]. However, both audiovisual support and audio or text support appear to be efficient digital interventions for risk factor modification for PA; however, audio or text support only appears sufficient for PI modification.
Generally, PA (a healthy behavioral factor) has been viewed as a null to PI (sedentary; an unhealthy behavioral factor) effects in maintaining a healthy lifestyle. This view has been disapproved in the literature . However, this disapproval has only been validated in a healthy population prospective study. More evidence is needed to validate this in a CVD population to elucidate the effectiveness of digital technology interventions for PI risk factor modification. Therefore, we consider that the modification of PI, just as in LDL, might have been because of the positive inverse effect of PA modification in the CVD populations reviewed.
Studies reporting effects on diet, alcohol consumption, and smoking share similar characteristics in behavioral change techniques, which include mostly social support and group discussion, followed by self-management, goal setting, follow-up, progress self-reporting and self-recording, and auto-reminders. Social support and group discussion, which are related to online support and online discussion, have been identified as activity-based behavioral change techniques in mental health management for diet, alcohol consumption, and smoking behavior modifications . Interactivity (as a result of social support and group discussion) can, therefore, be affirmed as an effective factor in the behavior change technique of diet, alcohol consumption, and smoking on a digital platform. However, digital interventions for alcohol consumption and smoking behavior change show a weak effect in their modification when compared with conventional CVDs’ usual care interventions. There could be several reasons for this—first, social support and group discussions or interaction are less effectively accomplished compared with cell phone device interventions, which have no smart facial contact technology features but have gained wider usage in reviewed study trials because of their affordability and availability to participants in both risk factor studies. Second, digital technology interventions, from the trend seen in this study, appear to be effective in healthy behavior modification but less effective in attending to unhealthy behavior modification when compared with usual care: healthy dieting is physiologically linked to lipid regulation in the body [ ], a strong basis for clinical factor (TC, HDL, and LDL) modification.
In addition, digital intervention effectiveness in TC, HDL, and LDL, as stated earlier, might also be largely linked to the positive pharmacological effect of medication adherence in study trials. Of the 6 studies on food intake (diet), unhealthy food intake () modification is not favored by digital intervention (P=.47); however, a healthy diet ( ) shows a significant modification effect in favor of digital intervention (P=.004) when compared with usual care. This difference reveals significant alignment and potency of digital intervention toward healthy behavioral factors than unhealthy behavioral factors. The same was confirmed for PA, a healthy behavioral factor. Healthy behavioral factor (eg, PA, healthy diet, medication adherence) modification using digital technology is supported by findings from Chow et al [ ].
Medication adherence outcome from trials in this study was achieved only by the use of cell phones with SMS text messaging support strategy, in line with the findings of Palmer et al . However, the effectiveness of smartphones is inconclusive, as only 1 trial is available in this study—this could be responsible for its limitation in maximizing change technique features, for example, telerehabilitation in medication adherence trials. Cell phones remain the most affordable and available [ ] digital devices in medication adherence-targeted interventions compared with other behavioral factor interventions as they cut across all CVD types and engage behavioral change techniques based on cognition such as auto-support, auto-reminders, persuasion (iteration), goal setting, self-management, and customization (personalization).
Trials () that strictly targeted medication adherence outcome only, using an SMS text messaging strategy with a cell phone device, did not show a significant effect (P=.11) when collectively analyzed for digital intervention effectiveness. However, trials ( ) with a similar strategy and device as the former but having multiple clinical and behavioral outcome treatments (analyzed with or without the previous trials) were significantly effective (P=.02) with the use of digital intervention compared with usual care. Non-SMS-administered medication adherence trials ( ) did not favor digital intervention. In summary, these findings suggest the effectiveness of multiple clinical and behavioral outcome treatments when designing digital technology (SMS text messaging) interventions.
A few meta-analyzed results such as for smoking, LDL, BMI, and SBP were limited by high heterogeneity not fully explained (or not explained at all as for alcohol consumption and sedentary lifestyle with low included study counts) by study population or intervention characteristics. However, minor adjustments (exclusion of Chow et al , Widmer et al [ ], and Redfern et al [ ]) in the number of included studies toward increased homogeneity did not show a significant change from the initial treatment effect by either digital intervention or usual care.
The main intervention strategies in this study are automated SMS text messaging support (auto-reminder based on cognition which is largely accessible using cell phones in study trials), a feature supported by Kassavou et al ; and then online education and coaching, followed by telerehabilitation and telemonitoring, which were barely represented in analyses that favored digital intervention—representation might be because of limited access to smartphones based on the participants’ affordability or level of technological advancement or inclination at the time of the trial. A desirable device is the smartphone because it combines all operability features needed to attain desirable intervention outcomes by identifying behavioral change-specific strategies. However, a major limitation to the use of smartphones by the population age group in the study could be their level of comprehensibility [ ].
Although this collection of studies is evenly distributed on a global scale, no RCT study has been identified in Africa, where only cost-effective digital health programs have presently gained widespread use . A high proportion of male to female patients would be considered a major limitation of participant inclusion in studies. However, this trend appears to be in resonance with quantitative analyses of CVD gender prevalence in the literature [ ] and, therefore, may reflect disease prevalence rather than study design.
This study further reveals gaps in the application of emerging technologies (immersive media, eg, 3D animations and games, an ongoing trial by Gallagher et al ; big data technologies, eg, artificial intelligence applications; and user experience) in CVD risk factor modification using evidence-based RCT intervention studies on a digital device platform. Therefore, this study suggests the initiation of cutting-edge research in the field of emerging digital technologies.
This study shows that the use of digital technology interventions did not improve all CVD lifestyle risk factors compared with usual care interventions. Effective digital technology interventions appear to improve healthy behavioral factors (PA, healthy diet) and associated clinical outcomes (TC, HDL, and LDL), and were more potent in multiple outcome treatment (medication adherence plus) but were weak in abating unhealthy behavioral factors (smoking, alcohol intake, and unhealthy food intake) and their outcomes (BMI, BP, and HbA1c).
Cell phones are considered efficient digital devices for use with cognitive intervention strategies and have been most widely studied; however, smartphones may have advantages because of additional interaction features. This study was not able to analyze cutting-edge technology (such as immersive media technologies) as the data do not exist or are not reported. Newer immersive media technologies, therefore, warrant further study. Further RCT research is deemed necessary to consolidate the use of digital technology interventions, especially in CVD risk factors (eg, diabetes), with fewer RCT studies.
This is a trans-European cardiovascular (ECME) collaboration project, supervised by the University of the Highlands and Islands, UK. This study was supported by the EU’s INTERREG VA Program, managed by the Special EU Programs Body (SEUPB).
Conflicts of Interest
Protocol registration link and tables and abbreviations and definition of terms.DOC File , 469 KB
Study characteristics.DOC File , 95 KB
- Cardiovascular diseases. World Health Organization. 2019. URL: https://www.who.int/health-topics/cardiovascular-diseases/ [accessed 2021-02-11]
- Hospital Episode Statistics (HES). NHS Digital. 2017. URL: http://www.content.digital.nhs.uk/hes [accessed 2021-02-11]
- Health diseases. British Heart Foundation. 2014. URL: https://www.bhf.org.uk/old-starts-with-your-heart/heart-diseases [accessed 2021-02-11]
- Khot UN, Khot MB, Bajzer CT, Sapp SK, Ohman EM, Brener SJ, et al. Prevalence of conventional risk factors in patients with coronary heart disease. J Am Med Assoc 2003 Aug 20;290(7):898-904. [CrossRef] [Medline]
- Rocca HB, Fleischhacker L, Golubnitschaja O, Heemskerk F, Helms T, Hoedemakers T, et al. Challenges in personalised management of chronic diseases-heart failure as prominent example to advance the care process. EPMA J 2015;7:2 [FREE Full text] [CrossRef] [Medline]
- Conner CT. Social problems: the limits and strengths of the social constructionist perspective. Symb Interact 2014 Oct 06. [CrossRef]
- Valente TW. Network interventions. Sci 2012 Jul 06;337(6090):49-53. [CrossRef] [Medline]
- Widmer RJ, Collins NM, Collins CS, West CP, Lerman LO, Lerman A. Digital health interventions for the prevention of cardiovascular disease: a systematic review and meta-analysis. Mayo Clin Proc 2015 Apr;90(4):469-480 [FREE Full text] [CrossRef] [Medline]
- Franklin NC, Lavie CJ, Arena RA. Personal health technology: a new era in cardiovascular disease prevention. Postgrad Med 2015 Mar;127(2):150-158 [FREE Full text] [CrossRef] [Medline]
- Scotland Government. eHealth strategy 2011-2017 (Revised July 2012 to include a Sixth Strategic Aim). In: The eHealth Strategy for NHS Scotland 2011-2017. Scotland: Scotland Government; 2012.
- Digital technologies improve remote rehabilitation, medical monitoring for patients. Barcelona Digi Cent Tecnològic. 2019. URL: https://www.sciencedaily.com/releases/2013/11/131104035243.htm [accessed 2019-10-13]
- Krick T, Huter K, Domhoff D, Schmidt A, Rothgang H, Wolf-Ostermann K. Digital technology and nursing care: a scoping review on acceptance, effectiveness and efficiency studies of informal and formal care technologies. BMC Health Serv Res 2019 Jun 20;19(1):400 [FREE Full text] [CrossRef] [Medline]
- Charles A, Buck D, Evans H, McKenna H. King's Fund Webcast: what's in store for health and care? King's Fund Webcast, 2019. URL: https://www.kingsfund.org.uk/events/whats-store-health-and-care-2020 [accessed 2021-02-11]
- Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009 Jul 21;6(7):e1000097 [FREE Full text] [CrossRef] [Medline]
- Akinosun AS, Polson R, Grindle M. Digital technologies risk factors modification in patients with cardiovascular disease: a systematic review and meta-analysis. Prospero. 2019. URL: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42019139801 [accessed 2021-02-11]
- World Health Organization, global strategy on digital health 2020-2024 in global strategy on digital health. 2019. URL: https://extranet.who.int/dataform/upload/surveys/183439/files/Draft [accessed 2021-02-11]
- Akhu-Zaheya LM, Shiyab WY. The effect of short message system (SMS) reminder on adherence to a healthy diet, medication, and cessation of smoking among adult patients with cardiovascular diseases. Int J Med Inform 2017 Feb;98:65-75. [CrossRef] [Medline]
- Chow CK, Redfern J, Hillis GS, Thakkar J, Santo K, Hackett ML, et al. Effect of lifestyle-focused text messaging on risk factor modification in patients with coronary heart disease: a randomized clinical trial. J Am Med Assoc 2015;314(12):1255-1263. [CrossRef] [Medline]
- Pfaeffli Dale L, Whittaker R, Jiang Y, Stewart R, Rolleston A, Maddison R. Text message and internet support for coronary heart disease self-management: results from the text4heart randomized controlled trial. J Med Internet Res 2015 Oct 21;17(10):e237 [FREE Full text] [CrossRef] [Medline]
- Devi R, Powell J, Singh S. A web-based program improves physical activity outcomes in a primary care angina population: randomized controlled trial. J Med Internet Res 2014 Sep 12;16(9):e186 [FREE Full text] [CrossRef] [Medline]
- Frederix I, Van Driessche N, Hansen D, Berger J, Bonne K, Alders T, et al. Increasing the medium-term clinical benefits of hospital-based cardiac rehabilitation by physical activity telemonitoring in coronary artery disease patients. Eur J Prev Cardiol 2015 Feb;22(2):150-158. [CrossRef] [Medline]
- Hawkes AL, Patrao TA, Atherton J, Ware RS, Taylor CB, O'Neil A, et al. Effect of a telephone-delivered coronary heart disease secondary prevention program (proactive heart) on quality of life and health behaviours: primary outcomes of a randomised controlled trial. Int J Behav Med 2013 Sep;20(3):413-424. [CrossRef] [Medline]
- Johnston N, Bodegard J, Jerström S, Åkesson J, Brorsson H, Alfredsson J, et al. Effects of interactive patient smartphone support app on drug adherence and lifestyle changes in myocardial infarction patients: A randomized study. Am Heart J 2016 Aug;178:85-94 [FREE Full text] [CrossRef] [Medline]
- Kamal AK, Shaikh Q, Pasha O, Azam I, Islam M, Memon AA, et al. A randomized controlled behavioral intervention trial to improve medication adherence in adult stroke patients with prescription tailored Short Messaging Service (SMS)-SMS4Stroke study. BMC Neurol 2015 Oct 21;15:212 [FREE Full text] [CrossRef] [Medline]
- Khonsari S, Subramanian P, Chinna K, Latif LA, Ling LW, Gholami O. Effect of a reminder system using an automated short message service on medication adherence following acute coronary syndrome. Eur J Cardiovasc Nurs 2015 Apr;14(2):170-179. [CrossRef] [Medline]
- Kraal JJ, Peek N, Van den Akker-Van Marle ME, Kemps HM. Effects of home-based training with telemonitoring guidance in low to moderate risk patients entering cardiac rehabilitation: short-term results of the FIT@Home study. Eur J Prev Cardiol 2014 Nov;21(2 Suppl):26-31. [CrossRef] [Medline]
- Lear SA, Singer J, Banner-Lukaris D, Horvat D, Park JE, Bates J, et al. Randomized trial of a virtual cardiac rehabilitation program delivered at a distance via the internet. Circ Cardiovasc Qual Outcomes 2014 Nov;7(6):952-959. [CrossRef] [Medline]
- Maddison R, Pfaeffli L, Whittaker R, Stewart R, Kerr A, Jiang Y, et al. A mobile phone intervention increases physical activity in people with cardiovascular disease: results from the HEART randomized controlled trial. Eur J Prev Cardiol 2015 Jun;22(6):701-709. [CrossRef] [Medline]
- Ögren J, Irewall AL, Söderström L, Mooe T. Long-term, telephone-based follow-up after stroke and TIA improves risk factors: 36-month results from the randomized controlled NAILED stroke risk factor trial. BMC Neurol 2018 Sep 21;18(1):153 [FREE Full text] [CrossRef] [Medline]
- Pandey A, Choudhry N. Text message reminders to address medication non-adherence in post-mi patients: a one year intervention study. Can J Cardiol 2014 Oct;30(10):S179. [CrossRef]
- Park LG, Howie-Esquivel J, Chung ML, Dracup K. A text messaging intervention to promote medication adherence for patients with coronary heart disease: a randomized controlled trial. Patient Educ Couns 2014 Feb;94(2):261-268. [CrossRef] [Medline]
- Quilici J, Fugon L, Beguin S, Morange PE, Bonnet JL, Alessi MC, et al. Effect of motivational mobile phone short message service on aspirin adherence after coronary stenting for acute coronary syndrome. Int J Cardiol 2013 Sep 20;168(1):568-569. [CrossRef] [Medline]
- Redfern J, Briffa T, Ellis E, Freedman SB. Choice of secondary prevention improves risk factors after acute coronary syndrome: 1-year follow-up of the CHOICE (Choice of Health Options In prevention of Cardiovascular Events) randomised controlled trial. Heart 2009 Mar;95(6):468-475. [CrossRef] [Medline]
- Reid RD, Morrin LI, Beaton LJ, Papadakis S, Kocourek J, McDonnell L, et al. Randomized trial of an internet-based computer-tailored expert system for physical activity in patients with heart disease. Eur J Prev Cardiol 2012 Dec;19(6):1357-1364. [CrossRef] [Medline]
- Southard BH, Southard DR, Nuckolls J. Clinical trial of an internet-based case management system for secondary prevention of heart disease. J Cardiopulm Rehabil 2003;23(5):341-348. [CrossRef] [Medline]
- Tiede M, Dwinger S, Herbarth L, Härter M, Dirmaier J. Long-term effectiveness of telephone-based health coaching for heart failure patients: a post-only randomised controlled trial. J Telemed Telecare 2017 Sep;23(8):716-724. [CrossRef] [Medline]
- Vale MJ, Jelinek MV, Best JD, Santamaria JD. Coaching patients with coronary heart disease to achieve the target cholesterol: a method to bridge the gap between evidence-based medicine and the "real world"--randomized controlled trial. J Clin Epidemiol 2002 Mar;55(3):245-252. [CrossRef] [Medline]
- Vernooij JW, Kaasjager HA, van der Graaf Y, Wierdsma J, Grandjean HM, Hovens MM, SMARTStudy Group. Internet based vascular risk factor management for patients with clinically manifest vascular disease: randomised controlled trial. BMJ 2012 Jun 12;344:e3750 [FREE Full text] [CrossRef] [Medline]
- Wan LH, Zhang XP, Mo MM, Xiong XN, Ou CL, You LM, et al. Effectiveness of goal-setting telephone follow-up on health behaviors of patients with ischemic stroke: a randomized controlled trial. J Stroke Cerebrovasc Dis 2016 Sep;25(9):2259-2270. [CrossRef] [Medline]
- Widmer RJ, Allison TG, Lennon R, Lopez-Jimenez F, Lerman LO, Lerman A. Digital health intervention during cardiac rehabilitation: a randomized controlled trial. Am Heart J 2017 Jun;188:65-72. [CrossRef] [Medline]
- Zheng X, Spatz ES, Bai X, Huo X, Ding Q, Horak P, et al. Effect of text messaging on risk factor management in patients with coronary heart disease: the CHAT randomized clinical trial. Circ Cardiovasc Qual Outcomes 2019 Apr;12(4):e005616. [CrossRef] [Medline]
- Kraal JJ, Peek N, van den Akker-Van Marle ME, Kemps HMC. Effects and costs of home-based training with telemonitoring guidance in low to moderate risk patients entering cardiac rehabilitation: the FIT@Home study. BMC Cardiovasc Disord 2013 Oct 08;13:82 [FREE Full text] [CrossRef] [Medline]
- Vale MJ, Jelinek MV, Best JD, Santamaria JD. Coaching patients with coronary heart disease to achieve the target cholesterol: a method to bridge the gap between evidence-based medicine and the. J Clin Epidemiol 2002 Mar;55(3):245-252. [CrossRef] [Medline]
- Kassavou A, Houghton V, Edwards S, Brimicombe J, Sutton S. Development and piloting of a highly tailored digital intervention to support adherence to antihypertensive medications as an adjunct to primary care consultations. BMJ Open 2019 Jan 06;9(1):e024121 [FREE Full text] [CrossRef] [Medline]
- Lower your cholesterol. NHS. 2019. URL: https://www.nhs.uk/live-well/healthy-body/lower-your-cholesterol/ [accessed 2019-10-18]
- Figueiró TH, Arins GCB, Santos CESD, Cembranel F, Medeiros PAD, d'Orsi E, et al. Association of objectively measured sedentary behavior and physical activity with cardiometabolic risk markers in older adults. PLoS One 2019 Jan 18;14(1):e0210861 [FREE Full text] [CrossRef] [Medline]
- Healthcare and economic growth in Africa: digital health. UNECA, GBCHealth and Aliko Dangote Foundation. 2019. URL: http://gbchealth.org/healthcare-and-economic-growth-in-africa-digital-health/ [accessed 2021-02-11]
- Katzmarzyk PT. Physical activity, sedentary behavior, and health: paradigm paralysis or paradigm shift? Diabetes 2010 Nov;59(11):2717-2725 [FREE Full text] [CrossRef] [Medline]
- National Institute for Health and Care Excellence. Behaviour change: digital and mobile health interventions. NICE. 2020. URL: https://www.nice.org.uk/guidance/gid-ng10101/documents/final-scope [accessed 2021-02-11]
- Udenigwe CC, Rouvinen-Watt K. The role of food peptides in lipid metabolism during dyslipidemia and associated health conditions. Int J Mol Sci 2015 Apr 24;16(5):9303-9313 [FREE Full text] [CrossRef] [Medline]
- Palmer MJ, Barnard S, Perel P, Free C. Mobile phone-based interventions for improving adherence to medication prescribed for the primary prevention of cardiovascular disease in adults. Cochrane Database Syst Rev 2018 Jun 22;6:CD012675 [FREE Full text] [CrossRef] [Medline]
- Gallagher R, Chow C, Parker H, Neubeck L, Celermajer D, Redfern J, et al. Design and rationale of the MyHeartMate study: a randomised controlled trial of a game-based app to promote behaviour change in patients with cardiovascular disease. BMJ Open 2019 May 14;9(5):e024269 [FREE Full text] [CrossRef] [Medline]
|BP: blood pressure|
|CHD: coronary heart disease|
|CVD: cardiovascular disease|
|DBP: diastolic blood pressure|
|HbA1c: Hemoglobin A1c blood sugar|
|HDL: high-density lipoprotein|
|LDL: low-density lipoprotein|
|MD: mean difference|
|PA: physical activity|
|PI: physical inactivity|
|PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-analysis|
|RCT: randomized controlled trial|
|RR: risk ratio|
|SBP: systolic blood pressure|
|SMD: standard mean difference|
|TC: total cholesterol|
Edited by L Buis; submitted 05.06.20; peer-reviewed by L Park, R Lundin, J Li, J Van den Eynde, N Mohammad Gholi Mezerji; comments to author 14.09.20; revised version received 08.11.20; accepted 01.12.20; published 03.03.21Copyright
©Adewale Samuel Akinosun, Rob Polson, Yohanca Diaz - Skeete, Johannes Hendrikus De Kock, Lucia Carragher, Stephen Leslie, Mark Grindle, Trish Gorely. Originally published in JMIR mHealth and uHealth (http://mhealth.jmir.org), 03.03.2021.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.