This paper is in the following e-collection/theme issue:

mHealth for Wellness, Behavior Change and Prevention (2922) Usability of Apps and User Perceptions of mHealth (993) Supporting Informal Care and Caregivers (302) Supporting Home Care and Family Caregivers (200) Use and User Demographics of mHealth (344) Adoption and Change Management of eHealth Systems (731) Mobile Health (mhealth) (2982)

Published on in Vol 9, No 3 (2021): March

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/24755, first published .
Intention to Adopt mHealth Apps Among Informal Caregivers: Cross-Sectional Study

Intention to Adopt mHealth Apps Among Informal Caregivers: Cross-Sectional Study

Intention to Adopt mHealth Apps Among Informal Caregivers: Cross-Sectional Study

Authors of this article:

Fereshteh Ghahramani1 Author Orcid Image ;   Jingguo Wang2 Author Orcid Image
Article Authors Cited by (14) Tweetations (8) Metrics

    Original Paper

    1College of Computing and Digital Media, DePaul University, Chicago, IL, United States

    2Department of Information Systems and Operations Management, University of Texas at Arlington, Arlington, TX, United States

    Corresponding Author:

    Fereshteh Ghahramani, MPH, PhD

    College of Computing and Digital Media

    DePaul University

    243 South Wabash Ave

    Chicago, IL, 60604

    United States

    Phone: 1 3123628381

    Email: fereshteh.ghahramani@depaul.edu


    Background: Caregiving responsibility can change caregivers’ lives; modify their emotions; and make them feel frustrated, fearful, and nervous, thereby imposing physical and mental stress. Caregiving-related mobile apps provide a platform for obtaining valuable and trusted information, connecting more easily with other caregivers, monitoring medications, and managing appointments, and assessing health requirements and conditions of care receivers. Such apps also incorporate valuable resources that address care for the caregivers. Despite the potential benefits of caregiving-related apps, only a limited number of caregivers have adopted and used them.

    Objective: The aim of this study is to explore the important factors that affect caregivers’ intentions to integrate related mobile apps into their routine caregiving responsibilities.

    Methods: Using the protection motivation theory, we conducted a cross-sectional study among 249 participants. Purposive sampling was used to target participants who met 4 inclusion criteria: US residents, owning and using a smartphone, informal caregivers (individuals who give care to a friend or family member without payment) who provided at least 8 hours of care per week in the past year, and those currently not using any mobile app for caregiving purposes. We created a survey using Qualtrics and posted it on Amazon’s Mechanical Turk website. Participants received monetary compensation after successful completion of the survey.

    Results: We found that capabilities and skills of caregivers to use mobile apps, the app’s effectiveness in responding to the needs of caregivers, the degree of control of caregivers over their responsibilities, and the decisions they make for their care receivers can predict their willingness to adopt caregiving-related apps. In addition, the severity of health status and vulnerability of care receivers to unexpected health changes indirectly shape their caregivers’ decisions to adopt and use mobile apps for caregiving purposes.

    Conclusions: This study explores the important factors that affect informal caregivers’ intentions to adopt related mobile apps into their routine caregiving responsibilities. The results contribute to both mobile health adoption and the caregiving literature, and they offer significant implications for developers, health care practitioners, and policy makers.

    JMIR Mhealth Uhealth 2021;9(3):e24755

    doi:10.2196/24755

    Keywords

    mobile health; cross-sectional study; informal caregivers; mobile app; caregiving app; mobile phone 


    Background

    In 2017, only approximately 37 million patients were admitted to US hospitals [1]. As the number of individuals needing hospitalization has increased in recent years [2], hospitals have mainly limited their beds to acute care and left the rest of treatments in the form of outpatient settings to the patients’ loved ones [3,4]. Unpaid family or informal caregivers are, therefore, the backbone of the long-term care system and offer the majority of long-term care that patients require in the United States [5]. In addition, informal caregiving is essential for sustaining adults with disabilities or chronic health conditions [6].

    Caregiving responsibilities primarily include providing informational and emotional support, dealing with financial concerns, and managing medical care [4]. These responsibilities also consist of more basic support, such as assistance in eating, bathing, grocery shopping, and meal preparation [7]. Many informal caregivers experience positive feelings such as satisfaction, a sense of gratification for giving back to those who cared for them, and improved family relationships [8,9]. However, the nature and amount of such responsibilities may change caregivers’ lives; modify their emotions; and make them feel frustrated, fearful, and nervous, all resulting in a decline in their quality of life [10].

    Estimates of the number of informal caregivers in the United States vary widely. According to the American Association of Retired Persons, there are currently more than 40 million unpaid caregivers in the United States [11], about 7 potential informal caregivers per adult [12]. Although studies indicate that the number of informal caregivers will continue to rise, it is expected that the number of individuals who need care will be far from the number of those who offer that care in the near future (about 4 potential informal caregivers per adult) [12,13]. There are 2 main reasons for this result. First, the number of individuals who will be over 65 years old by 2050 is expected to be 2 times more than that number in 2010; the majority of those individuals will be dealing with various chronic conditions and a decline in quality of life [14,15]. Second, the traditional American family structure has experienced fundamental changes in recent years. Family sizes continue to decrease as a result of higher rates of those who have never married or are divorced or are affected by infertility and childlessness. In addition, there is a higher chance that women, who are the backbone of informal caregiving, are in the workforce [16,17].

    This shrinkage in the number of potential informal caregivers per adult increases the amount of responsibility and inflicts more physical and mental stress among the existing caregivers [14]. The ubiquity of mobile technology and its applications has the potential to reduce such stress. In general, mobile apps are reasonably priced and user friendly and offer an information repository collected from various sources [18-20]. Caregiving-related apps are specifically designed to provide users with a platform to gain appropriate and trusted information, manage medication taking, improve communication with care providers and support groups, connect with counterparts, reserve transportation, and manage the health condition of care receivers in an organized manner [21].

    Although there are hardly any studies in the literature that investigate the role of caregiving-related apps in reducing caregiving-related stress [22], it is very likely that such apps significantly lessen the stress caregivers face by providing a convenient platform to receive informational and emotional support [14]. Despite the considerable role of caregiving apps in reducing stress and improving the overall quality of life among caregivers and although more than 57% of American caregivers have a smartphone, only 40% of them use a caregiving-related app [23]. This raises the concern of finding solutions to increase caregivers’ access to and effective use of such beneficial resources.

    Some studies highlight the roles of caregivers’ digital literacy and sociodemographic factors on their natural propensity to use various internet-based tools and services for caregiving purposes in general [24,25]. However, the current understanding of caregivers’ intentions to use related mobile apps for their responsibilities is limited, and we could not find any published studies that directly investigated the influential factors.

    As such, our objective is to provide insights into this issue. To explore the important factors that affect their intentions to integrate mobile apps into their routine caregiving responsibilities, we designed a cross-sectional study using the protection motivation theory (PMT) perspective [26]. PMT is among the most influential explanatory theories in the literature to predict an individual’s intention to adopt recommended actions (adoption of related mobile apps in this study) [27]. It has also been empirically applied to both technological and nontechnological solutions [28].

    Theoretical Background

    PMT suggests 2 consecutive appraisals that explain the process whereby individuals adopt a recommended action: threat and coping [29]. If an individual is exposed to a stressful or fearful situation, a personal perception of threat arises. If the threat is perceived to be appropriate and possibly harmful, coping appraisal will occur [28].

    On the basis of the threatening event, individuals first assess the level of danger in 2 aspects: (1) perceived threat severity, which is the individual’s assessment of the seriousness of the threat, and (2) perceived threat vulnerability, which is the individual’s assessment of the likelihood of coming across the threat personally. Once the threat has been assessed, individuals assess their ability to cope with the threat and form their perceptions of the efficacy of the recommended action in 2 aspects: (1) self-efficacy, which is the individuals’ assessment of their capability to perform the recommended action, and (2) response efficacy, which is the individual’s assessment of the efficacy and benefits of the recommended action [26,29,30]. This efficacy assessment affects individuals’ intentions to adopt the recommended action. Figure 1 illustrates the PMT model.

    ‎
    Figure 1. Protection motivation theory model.
    View this figure

    Research Model and Hypotheses

    Overview

    Informal caregivers experience a vast amount of uncertainty and psychological distress [31] because of the difficulty in predicting their care receivers’ disease and care progress [32]. Adopting and using mobile health apps can be considered a recommended action to reduce caregivers’ stress. Building on PMT, we propose that, reflecting care receivers’ physical and mental condition, caregivers form perceptions about the severity and vulnerability of their care receivers’ health threats (threat appraisal). If they perceive a significant and harmful degree of threat, caregivers will assess both their responses and self-efficacy to cope with the situation (coping appraisal). Caregivers who expect that mobile apps can help them (high response efficacy) and have the efficacy to operate the technologies (high self-efficacy) are expected to begin using related mobile apps for caregiving purposes [28].

    Moreover, as self-efficacy only reflects caregivers’ perceptions of their general capability to use an app [33], we also need to consider the degree to which caregivers have control over their caregiving responsibilities and the decisions they make for their care receivers. This is called perceived self-autonomy, and previous studies have verified it as a major contributor to technology acceptance together with self-efficacy [34,35]. When caregivers feel autonomous in choosing a mobile app, they perceive it as useful and easy to adopt [34]. Thus, we propose that perceived self-autonomy is an antecedent that influences caregivers’ intention to adopt and use caregiving-related apps. The proposed research model is illustrated in Figure 2. The construct definitions are presented in Table 1.

    ‎
    Figure 2. Research model.
    View this figure
    Table 1. Definitions of constructs.
    ConstructDefinition
    Perceived threat severityDegree to which a caregiver assesses the seriousness of their care receiver’s health status
    Perceived threat vulnerabilityDegree to which a caregiver assesses the susceptibility of their care receiver to a sudden change in health status or an unexpected health condition
    Perceived self-efficacyDegree to which a caregiver believes that they are capable and have the necessary skills to use a caregiving-related mobile app
    Perceived response efficacyDegree to which a caregiver believes that a caregiving-related mobile app will effectively prevent threats related to their care receiver’s health condition
    Perceived self-autonomyDegree to which a caregiver has control over caregiving responsibilities and the decision they make for the care receiver
    Intention to adoptCaregiver’s willingness to adopt a caregiving-related app
    Threat Appraisal

    Depending on the physical and mental conditions of the care receiver, the caregivers assesses the seriousness of the care receiver’s health status. This assessment can influence the significance of caregiving-related apps by manipulating both responses and self-efficacy perceptions of caregivers [28]. More specifically, as a caregiver feels that their care receiver deals with a more severe health situation, he or she is more willing to trust sources that can provide the support he or she is looking for to help him or her cope with the situation.

    Therefore, the caregivers perceives the app as a more capable and qualified tool to effectively help him or her address the threat in a way that he or she might not have previously recognized. It can also persuade caregivers to re-examine their abilities to use the recommended app for caregiving activities. As the care receiver’s health status is perceived to be more severe, the caregivers will rely more on him or her and feel more confident about using a caregiving-related app as one of the few means to deal with the severe situation. Therefore, we hypothesize the following:

    Hypothesis 1a (H1a): The caregiver’s perception of the care receiver’s severity of health status positively influences the caregiver’s perception of the mobile app’s response efficacy.

    Hypothesis 1b (H1b): The caregiver’s perception of the care receiver’s severity of health status positively influences the caregiver’s perception of his or her self-efficacy in using the mobile app.

    Similar to the logic of perceived severity, when caregivers notice that there is a likelihood that their care receiver will encounter a sudden and unanticipated change in their health condition, they tend to perceive the mobile app as comprehensive and effective enough to offer them the support the caregivers are looking for during this time.

    Therefore, it is expected that as the threat of facing unexpected health changes becomes more probable, caregivers will perceive the mobile app as a more effective and efficient tool to help them in their caregiving responsibilities. In addition, caregivers will find themselves more capable and confident in using the mobile app as a tool to lessen the burden and the effects of the vulnerable situation. So, we proposed the following hypothesis:

    Hypothesis 2a (H2a): The caregiver’s perception of the care receiver’s vulnerability to unexpected health changes positively influences the caregiver’s perception of the mobile app’s response efficacy.

    Hypothesis 2b (H2b): The caregiver’s perception of the care receiver’s vulnerability to unexpected health changes positively influences the caregiver’s perception of his or her self-efficacy in using the mobile app.

    Coping Appraisal

    Perceived response efficacy is a cognitive process by which caregivers develop thoughts about the effectiveness and capability of the app to address their needs while they are dealing with a threatening situation [26,29]. In other words, the caregivers’ perception of the mobile app’s response efficacy determines whether they choose that app to help them handle the threat or not [36]. According to PMT, a high level of response efficacy forms a positive disposition toward the recommended solution. So, we proposed the following hypothesis:

    Hypothesis 3 (H3): The perceived response efficacy of the caregiving-related app has a positive effect on the caregiver’s intention to adopt the app.

    Even if a caregiver believes that the app is effective enough to address their needs, he or she still needs to consider their own ability to successfully install and effectively use the app [28]. Caregivers who perceive themselves as capable of using the app are more willing to adopt and use such apps to address their caregiving-related requirements [37]. Therefore, we proposed the following hypothesis:

    Hypothesis 4 (H4): The caregiver’s perceived self-efficacy has a positive effect on his or her intention to adopt the caregiving-related app.

    Self-Autonomy

    Furthermore, if caregivers have some freedom of action in their caregiving activities and have a say regarding what mobile apps they want to use, there is a higher chance that they will become intrinsically motivated or maintain the primary levels of intrinsic motivation to adopt and use the app [38]. Such a feeling of control can also enhance caregivers’ positive feelings toward using the app [39,40]. Therefore, we proposed the following hypothesis:

    Hypothesis 5 (H5): The caregiver’s perceived self-autonomy has a positive effect on his or her intention to adopt the caregiving-related app.


    Recruitment

    To test the proposed model, we recruited participants through Amazon’s Mechanical Turk, which is a web-based crowdsourcing market for registered users to participate in various tasks and receive a predetermined amount of money upon successful completion [41]. Studies in the domain of information systems have confirmed the validity and reliability of the results [42,43]. Purposive sampling was used to target participants who met the following inclusion criteria [44]: (1) US residents, (2) owning and using a smartphone, (3) informal caregivers (individuals who give care to a friend or family member without payment) who provided at least 8 hours of care per week in the past year, and (4) currently not using any mobile app for caregiving purposes. We obtained approval from the Institutional Review Board for the explained approach.

    Instrument Development

    We adapted measures from a set of empirically validated studies in the literature and used multi-item measures to enhance the validity and reliability of the measurement. All the main constructs were reflective. For the constructs drawn from PMT, measurement items were adapted from Witte [45] and modified to fit the context of our study. Under threat appraisal, 5 items (mean 3.76, SD 0.74) and 4 items (mean 4.03, SD 0.69) were used to assess perceived vulnerability (eg, “My care-receiver is at risk for getting health threats”) and perceived severity (eg, “I believe that threats to my care receiver's health are severe”), respectively. For coping appraisal, 6 items (mean 3.37, SD 0.86) assessed response efficacy (eg, “Using mobile apps is effective in monitoring my care-receiver’s health condition remotely”), and 4 items (mean 3.79, SD 0.78) were used to measure self-efficacy (eg, “I feel confident using mobile health applications for my caregiving activities”). Intention to use items was adapted from a widely used scale in the literature [46] (3 items; mean 2.98, SD 0.93) and changed appropriately to fit our study (eg, “I plan to use mobile apps to manage my care-receiver’s health status in the next 3 months”). Items for perceived self-autonomy were adapted from the study by Deci et al [47] (5 items; mean 3.89, SD 0.83) and altered to suit our context (eg, “I have some choice in what I want to do in my caregiving activities”). For all the aforementioned constructs, participants indicated their level of agreement with each item using a 5-point Likert-type scale ranging from strongly disagree (1) to strongly agree (5).

    Questions were randomly shown to the participants to minimize the order-effect bias. Two experts reviewed the initial questionnaire to ensure face validity. We revised the survey based on their comments and feedback. We also conducted a pilot study among master’s students at a large university in the southwestern region of the United States and made appropriate changes to the survey based on the results. Previous literature, pilot tests, and numerous series of pretests allowed us to confirm the content validity of our instrument and measures [48]. The final measurement items are listed in Table 2. The Checklist for Reporting Results of Internet E-Survey is available in Multimedia Appendix 1 [49].

    Table 2. Instrument items.
    ConstructItemsReferences
    Dependent variable

    		Intention to use
    • It is my intention to use mobile applications in caregiving activities.
      • ‎
    • I plan to use mobile apps to manage my care-receiver’s health status in the next 3 months.
      • ‎
    • I am likely to learn about using mobile apps in caregiving activities.
      • ‎
    		Venkatesh et al [46]
    Threat appraisal

    		Vulnerability
    • My care-receiver can be subjected to a sudden change in health condition.
      • ‎
    • My care-receiver is at risk for getting health threats.
      • ‎
    • It is possible that my care-receiver will contract health threats.
      • ‎
    • It is likely that my care-receiver requires an urgent care.
      • ‎
    • It is likely that my care-receiver will contract health threats.
      • ‎
    		Witte [45]

    		Severity
    • If my care-receiver faces an unexpected health problem, it would be serious.
      • ‎
    • I believe that threats to my care-receiver’s health are severe.
      • ‎
    • I believe that threats to my care-receiver’s health are serious.
      • ‎
    • I believe that threats to my care-receiver’s health are significant.
      • ‎
    		Witte [45]
    Coping appraisal

    		Response efficacy
    • Mobile apps will help me manage medication for my care-receiver.
      • ‎
    • Mobile apps serve as an effective disease reference and caregiving adviser.
      • ‎
    • Mobile apps enable me to keep a log of medical information for my care-receiver.
      • ‎
    • Mobile apps work in preventing health threats due to mismanagement of medications.
      • ‎
    • Using mobile apps is effective in monitoring my care-receiver’s health condition remotely (eg, heart rate, oxygen level, or other vital signs).
      • ‎
    • If I use mobile apps in my caregiving activities, my care-receiver is less likely to get health threats due to mismanagement of medications.
      • ‎
    		Witte [45]

    		Self-efficacy
    • I feel confident using mobile health applications for my caregiving activities.
      • ‎
    • I am able to use mobile apps.
      • ‎
    • Mobile apps are easy to use.
      • ‎
    • Using mobile apps is convenient.
      • ‎
    		Witte [45]

    		Perceived self-autonomy
    • In my caregiving activities, I can decide which mobile apps I want to use.
      • ‎
    • In my caregiving activities, I have a say regarding what mobile apps I want to use.
      • ‎
    • I feel that I will use mobile apps for caregiving purposes because I want to.
      • ‎
    • I feel a certain freedom of action in my caregiving activities.
      • ‎
    • I have some choice in what I want to do in my caregiving activities.
      • ‎
    		Deci et al [47]

    Sample Characteristics

    A total of 249 valid responses were collected. The average time that our responders provided care for their current care receivers and for various individuals in general was 50 and 83 months, respectively. A total of 32.5% (81/249) of the care receivers were financially dependent on their caregivers. Tables 3 and 4 summarize the key demographic variables of the respondents and their care receivers.

    Table 3. Key demographics of care receivers.
    VariablePercentage, n (%)
    Age (years)

    		≤1828 (11.2)

    		18-4939 (15.7)

    		50-6955 (22.1)

    		≥70127 (51.0)
    Education

    		High school or general educational development106 (42.6)

    		Some college or bachelor’s degree89 (35.7)

    		Master’s degree32 (12.9)

    		Professional degree17 (6.8)

    		Doctoral degree5 (2.0)
    Race

    		White185 (74.3)

    		African American27 (10.8)

    		Hispanic22 (8.9)

    		Asian11 (4.4)

    		Native American2 (0.8)

    		Pacific Islander2 (0.8)
    Gender

    		Male102 (41.0)

    		Female147 (59.0)
    Relationship with care receiver

    		Parents46 (18.5)

    		Friend132 (53.0)

    		Family friend25 (10.0)

    		Spouse28 (11.3)

    		Child18 (7.2)
    Reason for receiving care

    		Any form of disease78 (31.3)

    		Old age77 (30.9)

    		Disability59 (23.7)

    		Mental disorder35 (14.1)
    Table 4. Key demographics of caregivers (N=249).
    VariablePercentage, n (%)
    Age (years)

    		≤180 (0)

    		18-2433 (13.3)

    		25-3488 (35.3)

    		35-4464 (25.7)

    		45-5435 (14.1)

    		55-6421 (8.4)

    		≥658 (3.2)
    Education

    		High school or general educational development22 (8.8)

    		Some college or bachelor’s degree181 (72.7)

    		Master’s degree42 (16.9)

    		Professional degree1 (0.4)

    		Doctoral degree3 (1.2)
    Race

    		White193 (77.5)

    		African American24 (9.7)

    		Hispanic16 (6.4)

    		Asian9 (3.6)

    		Native American2 (0.8)

    		Pacific Islander5 (2.0)
    Gender

    		Male78 (31.3)

    		Female171 (68.7)
    Marital status

    		Single without children72 (28.9)

    		Single with children33 (13.3)

    		Married without children18 (7.2)

    		Married with children98 (39.4)

    		Life partner without children13 (5.2)

    		Life partner with children15 (6.0)
    Income, US ($)

    		≤20,00047 (18.9)

    		20,000-40,00072 (28.9)

    		40,000-60,00061 (24.5)

    		60,000-80,00041 (16.4)

    		≥80,00028 (11.2)

    Data Analysis

    A partial least squares approach was used to test the proposed model and associated hypotheses. We used the SmartPLS software package (version 3.2.6, SmartPLS GmbH) to analyze the data [50]. To estimate the path coefficient weights and their significance, we used bootstrapping procedures with 5000 resamples.

    To assess the measurement model, we conducted a confirmatory factor analysis. The results are summarized in Table 5. All of the latent constructs are modelled to be reflective. For each latent construct, the path loadings, t statistics, and SE were calculated. At α=.05, all the measures’ path loadings are significant with a value of more than 0.7 [51], indicating that more than 50% of the variance is shared between each construct’s items [52].

    Table 5. Confirmatory factor analysis results.
    Construct and itemsLoadingt testSEAverage variance extractedComposite reliabilityCronbach α
    Intention to use0.8100.927.882

    		Inta10.91161.3070.015



    		Int20.930107.1610.009



    		Int30.85733.7460.025


    Vulnerability0.6560.905.869

    		Vulb10.75010.7630.070



    		Vul20.83411.1790.075



    		Vul30.8189.6880.084



    		Vul40.76713.2470.058



    		Vul50.87317.9010.049


    Severity0.7580.926.895

    		Sevc10.86118.7910.046



    		Sev20.83513.6640.061



    		Sev30.89723.5580.038



    		Sev40.88823.8970.037


    Response efficacy0.6810.927.906

    		REd10.87463.1740.014



    		RE20.84333.0260.026



    		RE30.84236.8620.023



    		RE40.84625.6700.033



    		RE50.79420.2710.039



    		RE60.74517.2340.043


    Self-efficacy0.6360.874.813

    		SEe10.79230.1090.026



    		SE20.74513.6920.054



    		SE30.78711.9890.066



    		SE40.86231.1750.028


    Self-autonomy0.6150.888.853

    		SAf10.83728.5300.029



    		SA20.81822.7840.036



    		SA30.83343.4200.019



    		SA40.71410.4620.068



    		SA50.7089.5750.074


    aInt: intention to use.

    bVul: vulnerability.

    cSev: severity.

    dRE: response efficacy.

    eSE: self-efficacy.

    fSA: self-autonomy.

    To examine convergent validity, both composite reliability and average variance extracted (AVE) were obtained [53]. All constructs met the acceptable score of 0.5 for AVE, confirming their reliability [54]. Moreover, the composite reliability values were between 0.874 and 0.927.

    The square root of the AVE was also used to verify discriminant validity [54]. The results are presented in Table 6. For each latent construct, the square root of the AVE was higher than all its cross-correlations. Moreover, higher values of interconstruct correlations confirmed the greater variance among each construct’s specific measures compared with other measures [55]. All things considered, we can confirm that all the indicators were valid through their constructs.

    As data for all the variables were collected in a single survey, common method variance (CMV) could have an excessive effect on the results [56]. Harman’s single factor test was conducted [57] to find out the extent of this effect. According to this approach, with a factor analysis, if only a single factor arises, or a factor explains the majority of variance among all the measures, we can conclude that CMV is a significant issue in the sample [56]. After conducting an exploratory factor analysis among all the items, 6 factors were obtained that explained more than 70% of the variance. All the extracted factors had an eigenvalue >1, and the highest factor accounted for only 33% of the variance. This indicates that CMV is not a serious concern in this data set.

    Table 6. Matrix of latent constructs’ correlations.
    ConstructMean (SD)Construct 1Construct 2Construct 3Construct 4Construct 5Construct 6
    1. Intention to use2.976 (0.927)0.900a–b––––
    2. Vulnerability3.764 (0.736)0.6090.810a––––
    3. Severity4.034 (0.691)0.1290.6460.871a–––
    4. Response efficacy3.371 (0.858)0.6070.2450.2010.825a––
    5. Self-efficacy3.790 (0.780)0.4790.1110.2080.6520.797a–
    6. Self-autonomy3.892 (0.829)0.4720.2110.2570.5610.6310.784a

    aItalicized values in the diagonal row are the square root of the average variance extracted.

    bnot applicable.


    The results of data analysis, including R2 values, standardized path coefficients, associated t values, and path significance, are depicted in Figure 3. To test the significance of the path coefficients in the structural model, we used a bootstrapping approach with 1000 resamples.

    ‎
    Figure 3. Partial least squares results.
    View this figure

    The R2 value of intention to adopt a caregiving mobile app is 0.401, indicating that more than 40% of the variance in intention to adopt can be explained by response efficacy, self-efficacy, and self-autonomy. As this amount of variance is more than 10%, we can claim that the proposed model is valid and acceptable [58].

    The results indicate that response efficacy (β=.471; t999=6.567; P<.001), self-efficacy (β=.145; t999=1.973; P=.049), and self-autonomy (β=.150; t999=2.362; P=.03) had significant effects on the intention to adopt, supporting H3, H4, and H5. Moreover, perceived vulnerability and perceived severity had significant effects on response efficacy (β=.197; t999=2.546; P=.008) and self-efficacy (β=.235; t999=2.306; P=.01), respectively, supporting H2a and H1b. Perceived vulnerability and perceived severity, however, do not significantly affect self-efficacy (β=.041; t999=0.451; P=.63) and response efficacy (β=.074; t999=0.887; P=.35), respectively. Therefore, we do not have sufficient evidence to support H2b and H1a. The results are summarized in Table 7.

    To account for individual differences in the proposed model, we controlled for the effects of the caregivers’ age, education level, race, gender [46,58], and caregiving experience. None of these variables had a significant effect on the intention to adopt a caregiving mobile app.

    Table 7. Summary of results.
    HypothesisResult
    H1a. The caregiver’s perception of the care receiver’s severity of health status positively influences the caregiver’s perception of the mobile app’s response efficacy.Not supported
    H1b. The caregiver’s perception of the care receiver’s severity of health status positively influences the caregiver’s perception of his or her self-efficacy to use the mobile app.Supported
    H2a. The caregiver’s perception of the care receiver’s vulnerability to unexpected health changes positively influences the caregiver’s perception of the mobile app’s response efficacy.Supported
    H2b. The caregiver’s perception of the care receiver’s vulnerability to unexpected health changes positively influences the caregiver’s perception of his or her self-efficacy to use the mobile app.Not supported
    H3. The perceived response efficacy of the caregiving-related app has a positive effect on the caregiver’s intention to adopt the app.Supported
    H4. The caregiver’s perceived self-efficacy has a positive effect on his or her intention to adopt the caregiving-related app.Supported
    H5. The caregiver’s perceived self-autonomy has a positive effect on his or her intention to adopt the caregiving-related app.Supported

    Principal Findings

    The primary goal of this study is to investigate the factors that affect caregivers’ intentions to adopt caregiving-related mobile apps based on a model that contextualizes PMT. The results indicate support for the proposed model with decent explanatory power.

    As the analyses illustrate, caregivers’ capabilities and skills to use mobile apps and the app’s effectiveness in responding to caregivers’ needs can predict their willingness to adopt related apps. In addition, our results indicate that the degree of control of caregivers over their responsibilities and the decisions they make for their care receivers can also increase the likelihood of adopting such mobile apps. Interestingly, the app’s effectiveness in responding to caregivers’ needs had the strongest effect on their intention to adopt such apps.

    We also found that as the care receiver’s health status is perceived to be more severe, caregivers will count more on their capability to use a caregiving-related app. In addition, as the threat of facing unexpected health changes becomes more likely, caregivers will perceive the mobile app as a more efficient tool to help them with their responsibilities. These findings are consistent with previous studies on PMT [28].

    However, we did not find enough evidence to support the effect of the care receiver’s severity of health status on the caregiver’s perception of the mobile app’s effectiveness. In addition, the results indicate that the effect of the care receiver’s vulnerability to unexpected health changes on the caregiver’s perception of their self-efficacy in using the mobile app is not significant. Although these results are not congruent with PMT, there are various other studies that confirm that individuals, in most cases, believe that threats either happen only to others or influence other individuals more than themselves [59]. This belief helps them maintain a sense of invulnerability and explains why we did not find evidence to support 2 of the hypotheses.

    Implications

    As mentioned earlier, caregiving apps play a considerable role in reducing stress and improving the overall quality of life of informal caregivers. Therefore, it is important to devote time, money, and effort to develop and promote caregiving-related apps to enhance both caregivers’ and care receivers’ well-being. In this regard, the results of this study provide several practical implications for developers, health care practitioners, and policy makers.

    Developers

    Currently, more than 318,000 mobile health apps are available to consumers in the top app stores globally, and more than 200 apps are being added every day [60]. However, only a small number of these apps are designed specifically to help caregivers with the challenges they face because of their responsibilities (excluding apps for professional caregiving organizations or those that help in locating such services and organizations) [14]. Developing more caregiving-related apps gives caregivers the opportunity to have several options to choose from and enhances their sense of control over a stressful situation.

    Moreover, caregiving-related apps must offer a comprehensive set of features that caregivers typically look for. Although previous studies have confirmed the significant and positive effects of caregivers’ quality of life on the patients’ quality of life [61], only 20% of current caregiving-related apps have a collective set of features required by caregivers at different stages of their responsibilities [14]. According to our results, response efficacy has the strongest effect on behavioral intention. Including a broad range of features that address care for the care receiver (ie, appointment and medication management and reliable information about the disease or specific situation) can increase the chance of the caregivers’ adoption of those apps.

    In addition to the resources and features on how to manage their care receivers’ condition, incorporating features that address care for the caregivers can help them find a way to meet their needs in one place. This can increase the effectiveness of mobile apps [62] and possibly increase the likelihood of adopting these apps. For instance, apps may contain features to (1) learn and assess emotions such as journaling as a tool to keep track of moods and mood shifts; (2) manage and reduce personal stress through quick meditative activities and breathing exercises that fit into busy routines or through the use of in-app coloring books; (3) receive emotional and social support such as app-based chats and support groups [14]; and (4) receive informational support such as podcasts or discussions on caregivers’ self-care, including suggestions, resources, and inspiring words from others in the community of caregivers.

    Finally, based on our results, caregiving-related apps should be designed in a user-friendly, straightforward way to help caregivers locate services more easily, considering the time constraints of caregivers. Moreover, nearly 55% of caregivers are aged 50 years or more [63]. This makes it more important to design such apps in a simple and easy-to-operate manner to ensure that both younger and older adults can equally benefit from those apps.

    Health Care Practitioners

    Lack of awareness about the appropriate options or possible benefits, feeling overwhelmed by the available choices, and shortness of time to conduct appropriate research are among the biggest barriers of caregivers’ adoption of technology [64]. By educating physicians, nurses, social workers, and personal care aides on the available caregiving apps and asking them to spread the word by suggesting approved ones, there is a higher chance that those apps will find their way into caregivers’ routines.

    Moreover, based on our results, awareness of the care receiver’s health condition and how it may progress can affect the perceived effectiveness and efficiency of the suggested app among caregivers. Rather than only suggesting the app, it would be better to suggest why and how (based on the severity of the care receiver’s health status and vulnerability to unexpected health changes) the suggested app can take some weight off of caregivers’ shoulders. This indirectly increases the chances of adopting such apps.

    Flyers and signage are also great tools to target caregivers and to let them know the names and features of available caregiving-related apps in the market. Information about the variety of services offered by the apps, assurance of consistency with federal or state security and privacy acts, and instructions on ways to find and download the app (ie, relevant screenshots and licensed QR codes) are examples of the essential information that should be included in such flyers.

    Policy Makers

    Besides spreading the word to the worlds of developers and health practitioners, implementing various incentives might be a good motivator to increase adoption rates among caregivers. Insurance providers and policy makers can take into account policies to promote the adoption and use of caregiving-related apps [65]. Covering the cost of caregiving-related app purchases by insurance companies, reducing the price of apps or in-app purchases, raising research funds to develop more apps in this category, setting standards to require a minimum level of quality for those apps, and supporting young and motivated developers who are interested in this area are only a few examples of systematic changes that increase the likelihood of adopting and using caregiving-related apps [66].

    Limitations and Future Research

    This study has some limitations. First, the survey was limited to US caregivers, raising the external validity issue. Future research is required to generalize the results and offer an inclusive perspective of caregivers’ adoption of related mobile apps in the context of other countries. Second, the collected information and derived results were based on self-reported data. This can increase the likelihood of some biases such as social desirability. Further studies may use a more inclusive data collection technique to measure adoption more rigorously. Finally, there is still some unexplained variance in the intention to adopt mobile apps. Although including more constructs may have improved the explanatory factor of the proposed model, we intended to maintain a parsimonious extension of PMT [28]. Additional studies are required to investigate other effective factors.

    Conclusions

    Grounded on PMT, this study investigates the factors that affect the intentions of informal caregivers to adopt related mobile apps for their routine caregiving responsibilities. The results of the survey of 249 US-based informal caregivers indicated that caregivers’ degree of control over their responsibilities and choices, their perception of the app’s effectiveness in responding to their needs, and their capability to use mobile apps play a positive role in their willingness to adopt caregiving-related apps. Furthermore, care receivers’ vulnerability to unpredicted health changes and the severity of their health status indirectly affect their caregivers’ intentions to adopt such mobile apps. These findings offer important contributions to the field and have significant implications for developers, health care practitioners, and policy makers.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    The checklist for reporting results of our internet e-survey (CHERRIES).

    DOCX File , 16 KB
    1. Fast facts on US hospitals. American Hospital Association. 2020.   URL: https://www.aha.org/statistics/fast-facts-us-hospitals [accessed 2021-03-08]
    2. Total number of hospital admissions in the U.S. from 1946 to 2018. 2020.   URL: https://www.statista.com/statistics/459718/total-hospital-admission-number-in-the-us/ [accessed 2020-04-28]
    3. Kane RL, Priester R, Totten AM. Meeting the challenge of chronic illness. Baltimore: The Johns Hopkins University Press; 2006.
    4. American Cancer Society. 2019.   URL: https://www.cancer.org/research/cancer-facts-statistics/survivor-facts-figures.html [accessed 2021-02-24]
    5. Robison J, Fortinsky R, Kleppinger A, Shugrue N, Porter M. A broader view of family caregiving: effects of caregiving and caregiver conditions on depressive symptoms, health, work, and social isolation. J Gerontol B Psychol Sci Soc Sci 2009 Nov 24;64(6):788-798. [CrossRef] [Medline]
    6. Caregiving. Family Caregiver Alliance. 2009.   URL: https://www.caregiver.org/caregiving [accessed 2021-02-24]
    7. Flinn B. Millennials: the emerging generation of family caregivers. Innovation in Aging 2018:1-240. [CrossRef]
    8. Abdollahpour I, Nedjat S, Salimi Y. Positive aspects of caregiving and caregiver burden: a study of caregivers of patients with dementia. J Geriatr Psychiatry Neurol 2018 Jan 29;31(1):34-38. [CrossRef] [Medline]
    9. Long-term care in America: expectations and preferences for care and caregiving. NORC. 2016.   URL: https:/​/www.​longtermcarepoll.org/​project/​long-term-care-in-america-expectations-and-preferences-for-care-and-caregiving/​ [accessed 2021-03-08]
    10. van Ryn M, Sanders S, Kahn K, van Houtven C, Griffin JM, Martin M, et al. Objective burden, resources, and other stressors among informal cancer caregivers: a hidden quality issue? Psychooncology 2011 Jan 22;20(1):44-52 [FREE Full text] [CrossRef] [Medline]
    11. Jenkins JA. Millennials and caregiving? Yes, it’s a thing. American Association of Retired Persons. 2018.   URL: https://www.aarp.org/caregiving/home-care/info-2018/millennial-caregivers-work-life.html [accessed 2021-03-08]
    12. Caregiving for family and friends — a public health issue. Centers for Disease Control and Prevention.   URL: https://www.cdc.gov/aging/agingdata/docs/caregiver-brief-508.pdf [accessed 2021-02-24]
    13. Raskin R. 40 million caregivers and not growing strong. HuffPost. 2017.   URL: https://www.huffpost.com/entry/40-million-caregivers-and_b_9019978 [accessed 2021-02-24]
    14. Grossman MR, Zak DK, Zelinski EM. Mobile apps for caregivers of older adults: quantitative content analysis. JMIR Mhealth Uhealth 2018 Jul 30;6(7):e162 [FREE Full text] [CrossRef] [Medline]
    15. The state of aging and health in America 2013. Centers for Disease Control and Prevention.   URL: https://www.cdc.gov/aging/pdf/state-aging-health-in-america-2013.pdf [accessed 2021-02-24]
    16. Redfoot D, Feinberg L, Houser A. The aging of the baby boom and the growing care gap: a look at future declines in the availability of family caregivers. AARP Public Policy Institute.   URL: https:/​/www.​aarp.org/​content/​dam/​aarp/​research/​public_policy_institute/​ltc/​2013/​baby-boom-and-the-growing-care-gap-insight-AARP-ppi-ltc.​pdf [accessed 2021-02-24]
    17. Committee on Family Caregiving for Older Adults, Board on Health Care Services; Health and Medicine Division, National Academies of Sciences, Engineering, and Medicine. Families caring for an aging America. National Academies Press 2016. [CrossRef] [Medline]
    18. Frisbee KL. Variations in the use of mHealth tools: the VA mobile health study. JMIR Mhealth Uhealth 2016 Jul 19;4(3):e89 [FREE Full text] [CrossRef] [Medline]
    19. Portz JD, Elsbernd K, Plys E, Ford KL, Zhang X, Gore MO, et al. Elements of social convoy theory in mobile health for palliative care: scoping review. JMIR Mhealth Uhealth 2020 Jan 06;8(1):- [FREE Full text] [CrossRef] [Medline]
    20. Dayer L, Heldenbrand S, Anderson P, Gubbins PO, Martin BC. Smartphone medication adherence apps: potential benefits to patients and providers. J Am Pharm Assoc 2013 Mar;53(2):172-181. [CrossRef]
    21. Saltzman M. These apps for caregivers can help you get organized, find support. American Association of Retired Persons.   URL: https://www.aarp.org/home-family/personal-technology/info-2019/top-caregiving-apps.html [accessed 2020-03-06]
    22. Wittenberg E, Xu J, Goldsmith J, Mendoza Y. Caregiver communication about cancer: development of a mhealth resource to support family caregiver communication burden. Psychooncology 2019 Feb 11;28(2):365-371 [FREE Full text] [CrossRef] [Medline]
    23. Wang H, Hanich K, Jiang Y, Mitchel D, Li K. Independent living needs: helping aging parents thrive. 2016.   URL: https://www.parksassociates.com/marketfocus/independent-living-360vu-march2016 [accessed 2021-02-24]
    24. Chiu TML, Eysenbach G. Theorizing the health service usage behavior of family caregivers: a qualitative study of an internet-based intervention. Int J Med Inform 2011 Nov;80(11):754-764. [CrossRef]
    25. Shaffer KM, Chow PI, Cohn WF, Ingersoll KS, Ritterband LM. Informal caregivers' use of internet-based health resources: an analysis of the health information national trends survey. JMIR Aging 2018 Dec 18;1(2):- [FREE Full text] [CrossRef] [Medline]
    26. Rogers RW. A protection motivation theory of fear appeals and attitude change1. J Psychol 1975 Sep;91(1):93-114. [CrossRef] [Medline]
    27. Anderson CL, Agarwal R. Practicing safe computing: a multimethod empirical examination of home computer user security behavioral intentions. MIS Q 2010;34(3):613. [CrossRef]
    28. Johnston AC, Warkentin M. Fear appeals and information security behaviors: an empirical study. MIS Q 2010;34(3):549. [CrossRef]
    29. Witte K. Putting the fear back into fear appeals: the extended parallel process model. Commun Monogr 1992 Dec;59(4):329-349. [CrossRef]
    30. Witte K. Fear control and danger control: a test of the Extended Parallel Process Model (EPPM). Commun Monogr 2009 Jun 02;61(2):113-134. [CrossRef]
    31. Schulz R, O'Brien AT, Bookwala J, Fleissner K. Psychiatric and physical morbidity effects of dementia caregiving: prevalence, correlates, and causes. Gerontologist 1995 Dec 01;35(6):771-791. [CrossRef] [Medline]
    32. Poulshock SW, Deimling GT. Families caring for elders in residence: issues in the measurement of burden. J Gerontol 1984 Mar 01;39(2):230-239. [CrossRef] [Medline]
    33. Agarwal R, Karahanna E. Time flies when you're having fun: cognitive absorption and beliefs about information technology usage. MIS Q 2000 Dec;24(4):665. [CrossRef]
    34. Cheon J, Lee S, Crooks SM, Song J. An investigation of mobile learning readiness in higher education based on the theory of planned behavior. Comput Educ 2012 Nov;59(3):1054-1064. [CrossRef]
    35. Liaw SS, Huang H, Chen G. An activity-theoretical approach to investigate learners’ factors toward e-learning systems. Comput Hum Behav 2007 Jul;23(4):1906-1920. [CrossRef]
    36. Rogers RW, Rogers R, Cacioppo BL, Petty LL. Cognitive and psychological processes in fear appeals and attitude change: a revised theory of protection motivation. Soc Psychol. 1983.   URL: https://www.scienceopen.com/document?vid=7533a33e-b921-43d9-9b18-6b3f5c52f5f7 [accessed 2021-02-24]
    37. Maddux JE, Rogers RW. Protection motivation and self-efficacy: a revised theory of fear appeals and attitude change. J Exp Soc Psychol 1983 Sep;19(5):469-479. [CrossRef]
    38. Roca JC, Gagné M. Understanding e-learning continuance intention in the workplace: a self-determination theory perspective. Comput Hum Behav 2008 Jul;24(4):1585-1604. [CrossRef]
    39. Joussemet M, Koestner R, Lekes N, Houlfort N. Introducing uninteresting tasks to children: a comparison of the effects of rewards and autonomy support. J Pers 2004 Feb;72(1):139-166. [CrossRef] [Medline]
    40. Flavián C, Guinalíu M. Consumer trust, perceived security and privacy policy. Industr Mngmnt & Data Systems 2006 Jun;106(5):601-620. [CrossRef]
    41. Bohannon J. Human subject research. Social science for pennies. Science 2011 Oct 21;334(6054):307. [CrossRef] [Medline]
    42. Steelman ZR, Hammer BI, Limayem M. Data collection in the digital age: innovative alternatives to student samples. MIS Q 2014 Feb 2;38(2):355-378. [CrossRef]
    43. Lowry PB, D’Arcy J, Hammer B, Moody GD. “Cargo Cult” science in traditional organization and information systems survey research: a case for using nontraditional methods of data collection, including Mechanical Turk and online panels. J Strat Info Sys 2016 Oct;25(3):232-240. [CrossRef]
    44. Patton MQ. Qualitative research & evaluation methods. Thousand Oaks, CA: SAGE Publications; 2002.   URL: https://in.sagepub.com/en-in/sas/qualitative-research-evaluation-methods/book232962 [accessed 2021-02-24]
    45. Witte K, Cameron KA, McKeon JK, Berkowitz JM. Predicting risk behaviors: development and validation of a diagnostic scale. J Health Commun 1996 Oct 29;1(4):317-341. [CrossRef] [Medline]
    46. Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: toward a unified view. MIS Q 2003;27(3):425. [CrossRef]
    47. Deci EL, Ryan RM, Gagné M, Leone DR, Usunov J, Kornazheva BP. Need satisfaction, motivation, and well-being in the work organizations of a former eastern bloc country: a cross-cultural study of self-determination. Pers Soc Psychol Bull 2016 Jul 02;27(8):930-942. [CrossRef]
    48. Straub D, Boudreau MC, Gefen D. Validation guidelines for IS positivist research. Commu Asso Info Sys 2004;13. [CrossRef]
    49. Eysenbach G. Improving the quality of web surveys: the checklist for reporting results of internet e-surveys (CHERRIES). J Med Internet Res 2004 Sep 29;6(3):e34 [FREE Full text] [CrossRef] [Medline]
    50. Ringle C, Wende S, Becker J. SmartPLS3. Boenningstedt: SmartPLS GmbH. 2015.   URL: https://www.smartpls.com/ [accessed 2021-02-24]
    51. Chin W, Marcolin B. The holistic approach to construct validation in is research: examples of the interplay between theory and measurement 1. Mathematics 1995:34 [FREE Full text] [CrossRef]
    52. Chin WW. Commentary: issues opinion on structural equation modeling. MIS Q. vol. 22, no. 1, pp. vii-xvi. 1998.   URL: https:/​/www.​scirp.org/​(S(351jmbntvnsjt1aadkposzje))/​reference/​ReferencesPapers.​aspx?ReferenceID=2126824 [accessed 2021-02-24]
    53. Hair Jr. JF. Multivariate data analysis with readings, 4th ed. NJ: Prentice Hall: Englewood Cliffs; 1995.
    54. Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Mark Res 2018 Nov 28;18(1):39-50. [CrossRef]
    55. Gefen D, Straub D, Boudreau M. Structural equation modeling and regression: guidelines for research practice. Commu Asso Info Sys 2000;4. [CrossRef]
    56. Podsakoff PM, MacKenzie SB, Lee J, Podsakoff NP. Common method biases in behavioral research: a critical review of the literature and recommended remedies. J Appl Psychol 2003 Oct;88(5):879-903. [CrossRef] [Medline]
    57. Podsakoff PM, Organ DW. Self-reports in organizational research: problems and prospects. J Manage 2016 Sep 04;12(4):531-544. [CrossRef]
    58. Falk RF, Miller NB. A primer for soft modeling. United States: University of Akron Press; 1992.
    59. Loch KD, Carr HH, Warkentin ME. Threats to information systems: today's reality, yesterday's understanding. MIS Q 1992 Jun;16(2):173. [CrossRef]
    60. Aitken M, Clancy B, Nass D. The growing value of digital health in the United Kingdom. Evidence and Impact on Human Health and the Healthcare System Institute Report. 2017.   URL: https:/​/www.​iqvia.com/​insights/​the-iqvia-institute/​reports/​the-growing-value-of-digital-health-in-the-united-kingdom [accessed 2021-02-24]
    61. Alejandra CU, Alessandrini M, Urzúa A, Zendjidjian X, Boyer L, Williams DR. Caregiver's quality of life and its positive impact on symptomatology and quality of life of patients with schizophrenia. Health Qual Life Outcomes 2017 Apr 19;15(1):76 [FREE Full text] [CrossRef] [Medline]
    62. Montgomery RV, Kwak J, Kosloski KD. Theories guiding support services for family caregivers. In: Handbook of Theories of Aging. New York: Springer Publishing Company; 2016:443-462.
    63. Caregiving in the U.S. 2020 Report. American Association of Retired Persons. 2020.   URL: https:/​/www.​aarp.org/​content/​dam/​aarp/​ppi/​2020/​05/​full-report-caregiving-in-the-united-states.​doi.​10.​26419-2Fppi.​00103.​001.​pdf [accessed 2021-02-24]
    64. Seegert L. Study: caregivers want tech support, but adoption rates low. Association of Health Care Journalists. 2016.   URL: https://healthjournalism.org/blog/2016/06/study-caregivers-want-tech-support-but-adoption-rates-low/ [accessed 2020-09-15]
    65. Kim H, Powell MP, Bhuyan SS. Seeking medical information using mobile apps and the internet: are family caregivers different from the general public? J Med Syst 2017 Mar 18;41(3):38. [CrossRef] [Medline]
    66. Ghahramani F, Wang J. Impact of smartphones on quality of life: a health information behavior perspective. Inf Syst Front 2019 Jun 03;22(6):1275-1290. [CrossRef]

    ‎
    AVE: average variance extracted
    CMV: common method variance
    PMT: protection motivation theory

    Edited by L Buis; submitted 03.10.20; peer-reviewed by R Mousavi, W Tang; comments to author 27.10.20; revised version received 14.12.20; accepted 12.02.21; published 17.03.21

    Copyright

    ©Fereshteh Ghahramani, Jingguo Wang. Originally published in JMIR mHealth and uHealth (http://mhealth.jmir.org), 17.03.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.