Published on 04.12.17 in Vol 5, No 12 (2017): December
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/8741, first published Aug 19, 2017.
Mobile Phone Apps for Quality of Life and Well-Being Assessment in Breast and Prostate Cancer Patients: Systematic Review
Background: Mobile phone health apps are increasingly gaining attention in oncological care as potential tools for supporting cancer patients. Although the number of publications and health apps focusing on cancer is increasing, there are still few specifically designed for the most prevalent cancers diagnosed: breast and prostate cancers. There is a need to review the effect of these apps on breast and prostate cancer patients’ quality of life (QoL) and well-being.
Objective: The purposes of this study were to review the scientific literature on mobile phone apps targeting breast or prostate cancer patients and involving QoL and well-being (anxiety and depression symptoms) and analyze the clinical and technological characteristics, strengths, and weaknesses of these apps, as well as patients’ user experience with them.
Methods: We conducted a systematic review of peer-reviewed literature from The Cochrane Library, Excerpta Medica Database, PsycINFO, PubMed, Scopus, and MEDLINE to identify studies involving apps focused on breast and/or prostate cancer patients and QoL and/or well-being published between January 1, 2000, and July 12, 2017. Only trial studies which met the inclusion criteria were selected. The systematic review was completed with a critical analysis of the apps previously identified in the health literature research that were available from the official app stores.
Results: The systematic review of the literature yielded 3862 articles. After removal of duplicates, 3229 remained and were evaluated on the basis of title and abstract. Of these, 3211 were discarded as not meeting the inclusion criteria, and 18 records were selected for full text screening. Finally, 5 citations were included in this review, with a total of 644 patients, mean age 52.16 years. Four studies targeted breast cancer patients and 1 focused on prostate cancer patients. Four studies referred to apps that assessed QoL. Only 1 among the 5 analyzed apps was available from the official app store. In 3 studies, an app-related intervention was carried out, and 2 of them reported an improvement on QoL. The lengths of the app-related interventions varied from 4 to 12 weeks. Because 2 of the studies only tracked use of the app, no effect on QoL or well-being was found.
Conclusions: Despite the existence of hundreds of studies involving cancer-focused mobile phone apps, there is a lack of rigorous trials regarding the QoL and/or well-being assessment in breast and/or prostate cancer patients. A strong and collective effort should be made by all health care providers to determine those cancer-focused apps that effectively represent useful, accurate, and reliable tools for cancer patients’ disease management.
Trial Registration: PROSPERO CRD42017073069; https://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID= CRD42017073069 (Archived by WebCite at http://www.webcitation.org/6v38Clb9T)
JMIR Mhealth Uhealth 2017;5(12):e187
The number of new cancer cases diagnosed every year worldwide is rapidly rising from 14.1 million in 2012 to well over 20 million predicted by 2030 . Of those, breast and prostate cancers are the most prevalent diagnosed in women and men, respectively [ ]. It should be noted that around 30% to 40% of these cancer patients suffer from psychological distress (anxiety and depression symptoms commonly reported) as has been mentioned previously by a meta-analysis comprising 94 studies and 14,078 cancer patients [ ]. This emotional distress has been associated with poorer quality of life (QoL) [ ]. Well-being, QoL, and treatment satisfaction in breast and prostate cancer patients could be monitored by ubiquitous technologies such as mobile phone health apps, which can provide useful data to reflect on therapy work [ ] and thereby improve patients’ well-being.
Mobile phone health apps have the potential to revolutionize psychological science because they can collect behavioral data  and behavioral information with great ecological validity [ ], facilitating high-frequency assessments and more objective data collection [ ]. These apps can also potentially empower patients, promoting behavior changes, facilitating self-monitoring of symptoms [ ], improving their educational level [ ], and allowing patients the feeling of being in contact with their health care team [ ].
Apps are widely used by professionals and patients, and attention to them in health care environments is increasing daily . However, there are some important concerns about their use. Because of the large number of health care apps available, patients could get overwhelmed, encountering difficulties in finding the right app or features [ ]. Poorly validated information, often created by nonexperts [ ], and a lack of updated data [ ] have also been mentioned as concerning issues related to health apps. Limited evidence involving these apps in studies [ ] and little or no quality control or regulations to guarantee the apps as user-friendly, accurate, or efficacious tools [ ] have also been reported.
In several systematic reviews on mobile phone health apps, authors urge different strategies that will result in higher quality evidence for app effectiveness and contents [, , - ]. This would allow us to distinguish apps that subscribe to evidence-based protocols from those that do not [ ]. The health care team should have a leading role not only in the review and verification of app contents but also in determining the most reliable ones and in selecting the patients best suited to using them [ ]. Therefore, health care providers and organizations should standardize the identification, evaluation, and selection of these mobile health (mHealth) apps to maximize their utility and safety [ ].
Attending to patients’ point of view about using mHealth apps, authors have commonly used survey studies to determine the user experience. In general, cancer patients positively value the use of Internet-based technologies for health care management and feel comfortable using them . Breast cancer patients usually use this technology to seek general information, search for therapies or scientific data, and exchange information with other patients [ ]. Authors have also pointed out the importance of including customizable functionalities in mobile phone apps in order to manage care-related information so that these features can be easily modified depending on changes in the user’s needs [ ]. Other people affected by cancer, such as prostate cancer patients, have shown interest in using apps, indicating apps should be easy to use, tailored to the individual, and include social support [ ]. A recent survey of 375 cancer patients reported that about half of the patients (182/375, 48.5%) were willing to send data via an app supporting their oncological treatment and follow-up [ ]. Moreover, around two-thirds (125/182, 68.7%) agreed to use these regularly sent data as an ideal complement to the standard follow-up. The most mentioned characteristics that should be included in a cancer-focused app were pseudonymizing, data protection, and feedback from a physician based on the patients’ input [ ].
Although mHealth apps could be useful tools for cancer patients , there are only a few apps focused on oncological care that support patients during treatment and aftercare [ ]. The purposes of this study were to (1) identify evidence-based mobile phone health apps focused on QoL and well-being (anxiety and depression symptoms) in breast and/or prostate cancer patients, (2) recognize their clinical and technological characteristics, (3) categorize their clinical and technological strengths and weaknesses, and (4) determine patients’ user experience (satisfaction level and comments regarding the apps used).
We developed a systematic search strategy to detect all relevant studies involving the use of mobile phone apps for QoL and/or well-being (anxiety and depression symptoms) in breast and/or prostate cancer on July 12, 2017. Once we determined these studies, we searched the identified apps on the online market to describe them. The systematic research protocol is registered at PROSPERO [CRD42017073069].
Reviewing the Scientific Literature
Articles were considered potentially relevant if they were trials or peer-reviewed studies published between January 1, 2000, and July 12, 2017, including a smartphone app focused on QoL and/or well-being (anxiety and depression symptoms) used by breast and/or prostate cancer patients.
We considered a smartphone “a mobile phone with Internet connectivity and the ability to download and run third-party software apps available from a commercial marketplace” . We excluded articles that did not involve a mobile phone app (eg, a Web-based or iPad app), medical studies, systematic reviews and meta-analyses, abstracts or congress papers, qualitative studies, study protocols, and studies not including QoL or well-being assessment. We applied no language restrictions.
The search strategy followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines . We searched for trials in The Cochrane Library, Excerpta Medica Database (EMBASE), PsycINFO (via ProQuest), PubMed, Scopus, and MEDLINE (via OvidSP) on July 12, 2017. We extracted trials with the keywords “breast cancer + app,” “breast cancer + mHealth,” “breast cancer + mobile application,” “prostate cancer + app,” “prostate cancer + mHealth,” and “prostate cancer + mobile application” published between January 1, 2000, and July 12, 2017. Two of the authors of this study (ER and EG) independently reviewed the titles and abstracts of the total search yield to identify eligible articles. The full text of the article was retrieved if any reviewer considered a citation potentially relevant. In case of disagreement, a third reviewer (FG) selected the reference finally included, based on inclusion and exclusion criteria. Search results were stored using Endnote version X8 (Clarivate Analytics). Duplications of studies were removed.
Two of the authors of this study (ER and EG) independently reviewed the full text of the articles meeting the eligibility criteria. The interrater agreement (kappa value) was calculated with SPSS version 22 (IBM Corp). The following data were extracted from the selected papers: (1) general patient and study characteristics (year of publication, country of study, language, author affiliations, number of participants, mean age, and cancer type targeted), (2) clinical characteristics (QoL assessment, other variables measured, functionalities, type of validated questionnaire involved and timing for assessment, treatment offered, main clinical results, quality of the study, randomized controlled trial [RCT] design, social media inclusion, theoretical framework based, and quality of the journal), (3) clinical strengths and weaknesses, and (4) patients’ user experience (satisfaction level and comments regarding the apps used). Disagreements were rare and were easily resolved by consensus.
Two of the authors (ORR and ED) independently reviewed the full text of selected articles and extracted the following information: (1) technological characteristics (app name, platform, availability in markets, price, number of downloads, rating, patients targeted, and main features), (2) technological strengths and weaknesses, and (3) patients’ user experience (ratings, health certification obtained, and number of user comments). Disagreements were resolved by a third reviewer (FG). The quality of the included studies was assessed in terms of their design. Nonrandomized, observational, descriptive, and qualitative studies were considered low to medium quality. Quasi-randomized and interventional studies and studies with strongest design were considered of moderate to high quality.
Reviewing the Apps on the Market
In addition to the systematic review, 3 of the authors (ORR, ED, and CSB) downloaded the apps identified in the studies from the online store. They collected the following information: (1) technological characteristics, (2) technological strengths and weaknesses, and (3) patients’ user experience (satisfaction level and comments regarding the app used). An English language restriction was applied for the mobile phone apps downloaded.
The search of the electronic databases retrieved 3862 citations. After removal of duplicates, 3229 remained and were evaluated on the basis of title and abstract. Of these, 3211 were discarded because they clearly did not meet the inclusion criteria. Based on titles and abstracts, 18 records were selected for full text screening; 13 out of these 18 [- ] being discarded for various reasons (see ). A total of 5 publications [ - ] were finally included. An interrater agreement of kappa=.561 was found, reaching a moderate agreement according to Landis and Koch [ ]. All chosen studies were deemed to be of sufficient quality to contribute equally to the thematic synthesis. A PRISMA flowchart is shown in [ ].
The 5 studies included a total of 644 patients, mean age 52.16 years (sample sizes and mean ages listed in). Of these, 3 studies were conducted in Korea [ , , ], 1 in the United States [ ], and 1 in Sweden [ ]. All main authors affiliations were university departments [ - ]. The majority of the studies targeted breast cancer patients [ - , ]; only 1 focused on prostate cancer patients [ ]. Other general characteristics of the studies included are summarized in .
Clinical and Technological Characteristics
Regarding the clinical approach, 4 of the 5 included studies referred to apps that assessed QoL [- ]. Among the other variables measured were depression status (mood, anxiety, and sleep satisfaction) [ ]; daily food intake, daily exercise, daily body weight, weight efficacy, anthropometrics, and physical activity [ ]; sleep disturbance [ ]; sense of coherence, bladder and bowel function, fatigue, pain, anxiety, distress, sleep, and flushing [ ]; physical activity [ , ]; and user satisfaction [ ].
All studies allowed patients to collect patient-reported outcome measures [- ], and 3 included a related-intervention app [ , , ].
|Study||Publication year||Country/language||Participant number||Mean age||Cancer type|
|Kim et al ||2016||Korea/Korean||78||44.35||Breast|
|McCarroll et al ||2015||United States/English||50||58.4||Breast|
|Min et al ||2014||Korea/Korean||30||45||Breast|
|Sundberg et al ||2017||Sweden/Swedish||130||69||Prostate|
|Uhm et al ||2017||Korea/Korean||356||50.3||Breast|
The included studies measured QoL through different questionnaires such as the Functional Assessment of Cancer Therapy–General (FACT-G) , a generic core questionnaire that comprises 27 items divided into 4 domains (physical, functional, emotional, and social well-being) [ ]; the EuroQol 5 Dimensional Questionnaire (EQ-5D-3L) [ ], a generic health outcome instrument comprising 5 dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression) [ ]; the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire–Core (EORTC QLQ-C30) [ ], a 30-item generic cancer questionnaire that consists of 5 function scales (physical, role, emotional, cognitive, and social), a global health scale, 3 multi-item symptom scales (fatigue, nausea/vomiting, and pain), and 6 single item scales (dyspnea, sleep, appetite, constipation, diarrhea, and financial difficulties due to disease) [ ]; and the EORTC complementary modules on prostate cancer, QLQ-PR25 [ ], and breast cancer, QLQ-BR23 [ ]. One study did not assess QoL symptoms [ ], focusing only on well-being assessment through the Patient Health Questionnaire (PHQ-9) [ ], which measures both the presence and the severity of 9 depression symptoms and is able to yield a diagnosis [ ]. Only one of the included studies reported the theoretical framework on which the app relied. Further details on other clinical variables assessed by the included studies are reported in .
Concerning the main clinical results, the adherence to the self-reporting measures was associated with higher accuracy of depression screening . Moreover, the compliance with the daily self-reporting rates was not affected by depression symptoms or health-related quality of life (HRQoL) status reported by the patients [ ]. Of the 3 studies that included intervention [ , , ], only 2 reported a QoL improvement [ , ]. The real-time assessment and management of symptoms through Interaktor [ ] produced significantly less burden in emotional functioning, insomnia, and urinary-related symptoms at T2 (after end of treatment, which ranged from 5 to 8 weeks) and at T3 (3 months after end of treatment) compared with the control group. Likewise, the 12-week regimen of aerobic and resistance exercise through Smart After Care [ ] produced a significant improvement in physical function, physical activity, and QoL at baseline and 12 weeks. The 4-week comprehensive lifestyle program focusing on nutrition quality, physical activity, and improving eating displayed by LoseIt! [ ] did not affect QoL.
With regard to the quality of the studies, 3 were considered of low-to-medium level [, , ], and 2 a medium-to-high level of quality [ , ].
The study design involved 2 prospective, nonrandomized multicenter controlled trials [, ], 1 with control group [ ], but no RCT designs were included. None of the 5 studies involved social media features, and only 1 study [ ] mentioned the theoretical framework, social cognitive theory, on which it was based.
Concerning the publication journals, 4 out of the 5 included studies [, , , ] were published in the last 3 years (2015-2017). Scientific journals are ranked yearly based on impact factor data, and the Journal Citation Reports (JCR) published by Clarivate Analytics are widely used as a quality indicator. The JCR ranks journals into categories based on which quartile of the impact factor distribution the journal occupies for that category: Q1 represents the top 25% of journals in the distribution, Q2 between the top 50% and top 25% of journals, and Q3 between the top 75% and top 50% of journals. According to the 2017 JCR, 4 studies [ - , ] were issued in journals ranking Q1 or Q2.
With regard to technological characteristics, all of the 5 studies included provided the names of the mobile phone apps evaluated [- ]. There were 2 studies involving the same app [ , ] (see ). The majority of the studies included an app targeted at cancer patients [ , - ]. The main features of the apps were focused on exercise and nutrition logging [ ]; collection of patient-reported outcomes [ ]; early detection, reporting, and management of symptoms [ ]; and exercise by a step counter [ ]. More technological characteristics can be seen in .
App functionalities included the following: (1) customization and personalization features (create a menu plan and calorie tracker  to establish an individual profile), (2) motivational features (providing feedback), and (3) social features (developing a community for inspiration).
Quality of study
Kim et al [ ]
|PROb: daily mental health ratings over a 48-week period||PHQ-9c via app biweekly|
McCarroll et al [ ]
PRO: daily, real-time, and motivational feedback + intervention
|FACT-Gd, WELe at baseline and at 4-week follow-up|
Comprehensive lifestyle program
Min et al [ ]
PRO: daily basis over a 90-day period
|BDIf, EQ-5D-3Lg via app on a daily basis for 90 days|
Sundberg et al [ ]
|PRO: daily, real-time assessment of symptoms and concerns during radiotherapy + interventionh||EORTC QLQ-C30i, EORTC QLQ-PR25j via app daily at any time during radiotherapy and 3 weeks after completion|
Management of symptoms
Uhm et al [ ]
|PRO + interventionh||EORTC QLQ-C30, EORTC QLQ-BR23k at baseline and 12 weeks|
12-week regimen of aerobics
aQoL: quality of life.
bPRO: patient-reported outcome measures.
cPHQ-9: Patient Health Questionnaire–9.
dFACT-G: Functional Assessment of Cancer Therapy–General.
eWEL: Weight Efficacy Lifestyle questionnaire.
fBDI: Beck Depression Inventory.
gEQ-5D-3L: EuroQol 5-Dimension 3-Level survey.
hSignificant improvement in quality of life.
iEORTC QLQ-C30: European Organization for Research and Treatment of Cancer Quality of Life Questionnaire–Core.
jEORTC QLQ-PR25: European Organization for Research and Treatment of Cancer Quality of Life Questionnaire–Prostate.
kEORTC QLQ-BR23: European Organization for Research and Treatment of Cancer Quality of Life Questionnaire–Breast Cancer.
|Study||App name||Platform||Available in markets||Price||Downloads||Ratings||Patients Targeted|
|Kim et al ||Pit-a-Pat||Android/iOS||No||Unknown||Unknown||Unknown||Yes|
|McCarroll et al ||LoseIt!||Android/iOS||Yes||free/premium||Android: 5,000,000-10,000,000||Android: 4.4; iOS: 4.0||No|
|Min et al ||Pit-a-Pat||Android/iOS||No||Unknown||Unknown||Unknown||Yes|
|Sundberg et al ||Interaktor||Unknown||No||Unknown||Unknown||Unknown||Yes|
|Uhm et al ||Smart After Care||iOS||No||Unknown||Unknown||Unknown||Yes|
Clinical and Technological Strengths and Weaknesses
Regarding the studies’ strengths, 2 of them involved the same app called Pit-a-Pat [, ]. Pit-a-Pat was developed for cancer patients to self-report factors related with the diagnosis itself and the subsequent treatments: (1) sleep-disturbance symptoms, (2) acute symptoms related to cytotoxic chemotherapeutic agents, and (3) medication diary for antihormonal treatment. Kim et al [ ] studied the accuracy of a mobile mental health tracker for depression screening, as well as the adherence on screening accuracy. For that purpose, daily patient reports of anxiety symptoms, mood, and sleep satisfaction were collected through a reliable and valid questionnaire (PHQ-9). The app involved user-friendly functionalities in the form of a facial emoticon scale. Min et al [ ] studied the patient’s self-reported sleep disturbance, HRQoL status, and depression symptoms via the Pit-a-Pat app on a daily basis for 90 days with standardized questionnaires. Push notifications were sent to participants daily at 9 AM and 7 PM.
LoseIt!  was a Web- and mobile-based app, not cancer targeted, used for logging food intake and volitional exercise. McCarroll et al [ ] aimed to assess a 4-week comprehensive lifestyle program with emphasis on nutrition quality, physical activity, and improving eating self-efficacy delivered using a beta health care provider version of LoseIt! in which the patients could log daily food choices, daily exercise type and duration, and daily body weight over the treatment period. Participants received motivational patient-provider feedback notifications (phone call, email message, and/or a push notification) in response to their individual input in the LoseIt! app.
Interaktor  was codesigned by patients and health care personnel as an interactive app for mobile phones and tablets. Interaktor was specifically intended for early detection, reporting, and management of symptoms and concerns during treatment for prostate cancer. Daily reports via the app enable instant support from a nurse in early detection and management of symptoms and concerns in real-time during treatment for prostate cancer. The app features included symptom assessment, a risk assessment model for alerts directly to a nurse, continuous access to evidence-based self-care advice, and links to relevant websites. The apps sent patients a reminder message if they had not submitted their report. In addition, the system sent 2 alerts (yellow and red) to the patients, depending on their symptom occurrence and frequency. The red meant a higher priority (should contact the nurse within an hour), and the yellow alert indicated that the nurse should be called that day. Sundberg et al [ ] included a control and an intervention group in their study, which used the app for daily, real-time assessment and management of symptoms and concerns during radiotherapy treatment. Participants were asked to send reports daily and at any time point when they felt unwell during the radiation treatment (5 to 8 weeks) and the following 3 weeks.
Smart After Care  was a newly developed mobile phone exercise app. This app recorded minutes of physical activity weekly and established a weekly goal for minutes of activity beginning in the second week. Every week, the achievement rate was displayed by the app. Also, patients receiving hormonal therapy could watch a video clip of resistance and stretching exercises through the app. This study included standardized QoL questionnaires and a user satisfaction survey in the intervention group. Patients in the study by Uhm et al [ ] performed a 12-week regimen of aerobic and resistance exercise through Smart After Care, where the intervention group received a pedometer and Smart After Care to perform 150 or 90 minutes of aerobic exercise.
Among the main weaknesses could be cited the small samples of the studies [- ] and the lack of RCT protocols and framework-based apps. Moreover, we can report only 1 app for free download on the market [ ], which was used with breast cancer patients despite not being cancer-focused.
Patients’ User Experience
Only 1 study  reported information regarding patient satisfaction level, and only 1 app showed a quality certification [ ] and a considerable number of user comments (see ). The mean Likert scale response for overall patient satisfaction with the service was 4.27/5 in the mHealth group [ ].
Health certification (OSR)
Number of user comments (OSR)
|Kim et al ||Unknown||Unknown||Unknown||Unknown|
McCarroll et al [ ]
Android: 4.4; iOS: 4.0
|Helix’s CLIAb certified and CAPc accredited lab|
Android: 61,063; iOS: 374,815
|Min et al ||Unknown||Unknown||Unknown||Unknown|
|Sundberg et al ||Unknown||Unknown||Unknown||Unknown|
|Uhm et al ||Satisfied with use||Unknown||Unknown||Unknown|
aOSR: Online store research.
bCLIA: Certified Laboratory Improvement Amendments.
cCAP: College of American Pathologists.
The use of mobile phone apps for health purposes continues to increase , and currently thousands and thousands of health apps are available on the online market. They target different health conditions, including cancer. Health apps represent an opportunity to monitor psychological distress and QoL related to cancer and its associated treatments. Our systematic review shows that the scientific literature referring to apps targeting breast or prostate cancer patients and involving QoL and/or well-being measurements is very modest, as we only could identify 5 studies meeting the inclusion criteria. However, the quality and dates of publication show a current scientific interest in this research topic.
The most recent reviews involving focused cancer apps started the searching methodology by looking for apps on the online stores, followed by searching bibliographic databases of health literature [, ]. However, we considered it more appropriate to start by determining whether rigorous trials had been published on cancer-focused apps. Hence, we conducted the systematic literature review first, and then we downloaded the apps from the market stores to examine them.
More Evidence-Based Apps Are Needed
Despite the increase in the number of health care apps available , only a very few of them discussed in the scientific literature focus on QoL and/or well-being assessment in breast or prostate cancer patient even though breast and prostate cancer are the most prevalent cancers diagnosed [ ] and QoL and well-being are frequently assessed to determine the health status of cancer patients [ , ]. There are only 2 studies that reported QoL improvement by using related-treatment health apps [ , ].
Related research on health apps for cancer patients was identified but not included in the review due to the following reasons (see): it did not involve mobile phone apps [ - , , , ], it did not assess QoL or well-being [ , , , , ], or it involved qualitative studies focused on feasibility or patient opinions [ , ].
We selected the QoL measure considering it has a wide range of variables involving other psychological measures (eg, cognitive, emotional, and social abilities) and not only as performance status and daily functional activities , symptom experience [ ], or chemotherapy-related symptoms (nausea, vomiting, fatigue, mucositis, hand-foot syndrome, and diarrhea) [ ].
We have defined well-being as existing levels of general anxiety and depression symptoms and not only as perceived stress level  assessed by the Perceived Stress Scale (PSS) [ ], a scale “designed to measure the degree to which situations in one’s life are appraised as stressful” and suggested by its own authors “as an outcome measure of experienced levels of stress” [ ], not well-being levels.
In our review, only 1 of the selected papers provided information regarding patient satisfaction level , therefore it is not possible to draw conclusions about the patient satisfaction or perceived effectiveness of the current apps.
Most of the apps referred to in the scientific literature targeted breast cancer, as in previous reviews [, , - ], and only 1 study focused on prostate cancer. All of these health apps were developed by university institutions; in contrast with the review of Mobasheri et al [ ], which reports that a minority of medical professionals were involved in the apps. Our results showed that, a priori, all the studies have been hosted by significant research and educational institutions.
With regard to the technological characteristics, it should be noted that the 3 apps specifically designed for cancer patients [, - ] were not available for download on the market. Furthermore, only 1 [ ] out of 4 total apps included was available for download at the online store, and despite this app (LoseIt!) not being specifically patient-targeted, it was used by 50 breast cancer patients to manage exercise and nutrition concerns.
Clinical and Technological Strengths and Weaknesses
Regarding the studies’ strengths, the use of related-treatment mobile phone apps has resulted in a significant improvement in cancer patients’ QoL [, ]. Some features like displaying daily patient reports in real time and providing personalized feedback [ , ] have also been pointed out as a significant advantage of the apps [ ]. Moreover, if the assessment involves user-friendly functionalities such as a facial emoticon scale [ ], which could be adapted to the small phone screen, this may facilitate user participation, potentially making the data more useful. Previous studies [ ] have reported important usability adaptation, incorporating several design decisions to account for patients with various disabilities (eg, impaired vision), presenting only 1 question at a time to patients. The easy and visual (similar to a stock chart) way of obtaining the information displayed by the app as feedback on the symptoms report form at any time during the study has also been mentioned as a relevant strength [ ]. Also, it is notable that when some researchers wished to test a general-population–targeted app with cancer patients, they delivered a cancer-focused health care provider beta version [ ] and designed the user interface of the app based on reliable guidelines developed by the National Cancer Institute, like previous authors did [ ].
Participants using their own mobile phones have mentioned this as better than being provided with an additional device , probably because in the latter case they must deal with 2 mobile phones in their daily life or because they prefer some relative freedom for testing the app, meaning the possibility of using the app at their convenience with no minimum amount of time to be spent using the app, as previous authors have reported [ ]. In contrast, other studies have pointed out patient preferences for using a device without phone functionality [ ] instead of using their own phones. Users strongly appreciate the use of no personal patient identifiers or other information stored on the devices used [ ], as well as pseudonymizing and data protection [ ]. Apps that can be used on more than 1 device could provide the patients with more possibilities to test them, such as LoseIt! [ ], which offers both website and mobile versions for users, or Interaktor [ ], available for mobile phones and tablets. The real-time feedback component and the motivational feedback notification are considered relevant strengths as well. The flexibility in the self-reporting task [ ] could probably be a more suitable option in oncological settings than prefixed hours of a day [ ] because of the patients’ highly variable functional status during the day, largely dependent on the medical treatments.
Among the main weaknesses could be (1) no cancer-focused apps are being used in studies involving cancer patients [, , , , ], (2) many of these studies have small samples, (3) studies are without rigorous design based on RCTs, (4) studies are not free to the user, (5) no theoretical framework is reported, and (6) there are usability and accessibility issues with cancer patients.
It is important to highlight the relevance of using cancer-focused apps in oncological settings, as cancer patients could be considered vulnerable recipients . People suffering from cancer have to struggle with quick relapses, bad prognoses [ ], side effects caused by cancer treatments, and psychological distress [ ]. Also, they represent a population interested in doing everything possible to improve their health [ ], so they could be interested in using apps that do not constitute reliable and accurate tools for them, which is even worse if the patients have to pay for them. Mobasheri et al [ ] reported that of the 30 apps reviewed, which functioned as self-assessment tools for breast disease, only 2 (2/30, 7%) had a documented evidence base (the rest relied on empirical data). It is imperative to develop apps and other health information and technology systems specifically targeted to cancer patients.
Although some encouraging results have been reported using apps in cancer patients , bigger samples sizes and framework-based and RCT designs are needed in order to obtain stronger research conclusions. Otherwise, serious concerns could arise regarding the lack of validation [ ] and quality control [ ] of the studies. Furthermore, the identification of rigorous trials involving empirical testing of these mobile phone apps in oncological settings is imperative, as none of the selected studies in this review followed a randomized method and only 1 was based on a previous framework. The use of theories, models, and frameworks for apps will help to identify the mechanisms, approaches, and functionalities that work best.
Cancer patients and survivors could have cognitive deterioration due to treatments. Therefore, usability and accessibility are relevant aspects to be considered in the development process of these apps, especially when they are intended for older people. Apps not designed for cancer patients and survivors could entail difficult challenges for them, resulting in reduced adoption and engagement rates. Equally, the large variety of apps available makes it difficult to establish which of them are the most adequate for breast and prostate cancer patients and what is the best way to use them. Also, patients could become overwhelmed due to the huge number of cancer apps available . Because of this, stronger efforts should be made to consolidate the evidence base, effectiveness, and safety of cancer-focused apps [ ].
In line with previous research [, , - , , ], we consider a main challenge the task of ensuring that those apps that are planned to be used with cancer patients be effectively cancer-focused, meaning that they should have been originally designed for, tested on, and adapted to the cancer population. Only if this technology is evidence-based and targeted to cancer patients can health care providers guarantee the apps’ safety, accuracy, reliability, and high quality and be able to recommend them in oncological care settings.
Patients’ Satisfaction With the Health Apps
Regarding patients’ satisfaction, it is noteworthy that only 1 app of the 3 reviewed reported a quality certification and showed user comments regarding its use. Moreover, it is relevant that this app was not cancer-focused and was the only one available for download at the online store. Only user-friendly and quality-certified apps should be provided to cancer patients. Thus, these health apps must be available for download at market stores once they are certified as useful tools for cancer patients. It would probably be helpful as well that these apps provide new users with comments about other patient’s experiences, in order to obtain a more powerful overview of the main features included in the app.
More evidence on the patient satisfaction level using health apps for QoL and/or well-being assessment in oncological settings is needed. In our review, only 1 study  focusing on cancer patients provided information about satisfaction level.
People affected by cancer are usually open to strategies that could have a positive influence on their disease . Probably due to this fact, mobile phone developers and health care teams involved in oncological settings should be especially careful with the apps that are going to be used and tested by this population and implement patient-centered design approaches. Current RCTs are still being developed that might produce promising data to help reach a high-quality evidence base for apps for cancer patients’ use [ , - ].
Our study had certain limitations. Our selection criteria intentionally excluded apps that were not specifically focused on breast or prostate cancer patients. We considered only the assessment of 2 main psychological variables in psycho-oncological care: QoL and well-being (anxiety and depression symptoms). Additional studies could consider other psychological measures such as fatigue or the secondary symptoms produced by the cancer treatments. Although our data search represents a wide range of peer-reviewed journals, we might have missed studies that were not identified with our search terms or that were not published.
Despite the existence of hundreds of studies involving mobile phone health apps used by cancer patients, there is a lack of rigorous trials regarding QoL and/or well-being assessment in breast and/or prostate cancer patients. More evidence-based apps, which could be tested in future RCT protocols, are still needed. However, promising results are expected to be available from some RCTs that are still running. A strong and collective effort should be made by all health care providers to determine those cancer-focused apps that provide useful and reliable tools for cancer patients’ disease management.
This study received funding from the European Union’s Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement number 722012 (Cancer: Activating Technology for Connected Health). The authors would like to sincerely thank Dr Luis Fernandez-Luque for his guidance and support.
Conflicts of Interest
Multimedia Appendix 1
Reasons for exclusion of studies.PDF File (Adobe PDF File), 26KB
Multimedia Appendix 2
Overview of the systematic review.PDF File (Adobe PDF File), 11MB
- Bray F. Transitions in human development and the global cancer burden. In: Stewart BW, Wild CP, editors. World Cancer Report 2014. Lyon: International Agency for Research on Cancer; 2014:54-68.
- Mitchell AJ, Chan M, Bhatti H, Halton M, Grassi L, Johansen C, et al. Prevalence of depression, anxiety, and adjustment disorder in oncological, haematological, and palliative-care settings: a meta-analysis of 94 interview-based studies. The Lancet Oncology 2011 Feb;12(2):160-174. [CrossRef] [Medline]
- Giese-Davis J, Collie K, Rancourt KMS, Neri E, Kraemer HC, Spiegel D. Decrease in depression symptoms is associated with longer survival in patients with metastatic breast cancer: a secondary analysis. J Clin Oncol 2011 Feb 01;29(4):413-420 [FREE Full text] [CrossRef] [Medline]
- Kessel KA, Vogel MM, Kessel C, Bier H, Biedermann T, Friess H, et al. Mobile health in oncology: a patient survey about app-assisted cancer care. JMIR Mhealth Uhealth 2017 Jun 14;5(6):e81 [FREE Full text] [CrossRef] [Medline]
- Gosling SD, Mason W. Internet research in psychology. Annu Rev Psychol 2015 Jan 03;66:877-902. [CrossRef] [Medline]
- Harari GM, Lane ND, Wang R, Crosier BS, Campbell AT, Gosling SD. Using smartphones to collect behavioral data in psychological science: opportunities, practical considerations, and challenges. Perspect Psychol Sci 2016 Nov;11(6):838-854 [FREE Full text] [CrossRef] [Medline]
- Dorsey ER, Yvonne CY, McConnell MV, Shaw SY, Trister AD, Friend SH. The use of smartphones for health research. Acad Med 2017 Dec;92(2):157-160. [CrossRef] [Medline]
- Bender JL, Yue RYK, To MJ, Deacken L, Jadad AR. A lot of action, but not in the right direction: systematic review and content analysis of smartphone applications for the prevention, detection, and management of cancer. J Med Internet Res 2013 Dec 23;15(12):e287 [FREE Full text] [CrossRef] [Medline]
- Mosa ASM, Yoo I, Sheets L. A systematic review of healthcare applications for smartphones. BMC Med Inform Decis Mak 2012 Jul 10;12:67 [FREE Full text] [CrossRef] [Medline]
- Wang J, Wang Y, Wei C, Yao NA, Yuan A, Shan Y, et al. Smartphone interventions for long-term health management of chronic diseases: an integrative review. Telemed J E Health 2014 Jun;20(6):570-583. [CrossRef] [Medline]
- van VL, Beaujean DJMA, van GPJEWC. Why mobile health app overload drives us crazy, and how to restore the sanity. BMC Med Inform Decis Mak 2013 Feb 11;13:23 [FREE Full text] [CrossRef] [Medline]
- O'Neill S, Brady RRW. Colorectal smartphone apps: opportunities and risks. Colorectal Dis 2012 Sep;14(9):e530-e534. [CrossRef] [Medline]
- Collado-Borrell R, Escudero-Vilaplana V, Ribed-Sánchez A, Ibáñez-García S, Herranz-Alonso A, Sanjurjo-Sáez M. Smartphone applications for cancer patients; what we know about them? Farm Hosp 2016 Jan 01;40(1):25-35 [FREE Full text] [CrossRef] [Medline]
- Mirkovic J, Kaufman DR, Ruland CM. Supporting cancer patients in illness management: usability evaluation of a mobile app. JMIR Mhealth Uhealth 2014 Aug 13;2(3):e33 [FREE Full text] [CrossRef] [Medline]
- Boudreaux ED, Waring ME, Hayes RB, Sadasivam RS, Mullen S, Pagoto S. Evaluating and selecting mobile health apps: strategies for healthcare providers and healthcare organizations. Transl Behav Med 2014 Dec;4(4):363-371 [FREE Full text] [CrossRef] [Medline]
- Agboola SO, Ju W, Elfiky A, Kvedar JC, Jethwani K. The effect of technology-based interventions on pain, depression, and quality of life in patients with cancer: a systematic review of randomized controlled trials. J Med Internet Res 2015 Mar 13;17(3):e65 [FREE Full text] [CrossRef] [Medline]
- Brouard B, Bardo P, Bonnet C, Mounier N, Vignot M, Vignot S. Mobile applications in oncology: is it possible for patients and healthcare professionals to easily identify relevant tools? Ann Med 2016 Nov;48(7):509-515. [CrossRef] [Medline]
- Mobasheri MH, Johnston M, King D, Leff D, Thiruchelvam P, Darzi A. Smartphone breast applications—what's the evidence? Breast 2014 Oct;23(5):683-689. [CrossRef] [Medline]
- Pandey A, Hasan S, Dubey D, Sarangi S. Smartphone apps as a source of cancer information: changing trends in health information-seeking behavior. J Cancer Educ 2013 Mar;28(1):138-142. [CrossRef] [Medline]
- Payne HE, Lister C, West JH, Bernhardt JM. Behavioral functionality of mobile apps in health interventions: a systematic review of the literature. JMIR Mhealth Uhealth 2015 Feb 26;3(1):e20 [FREE Full text] [CrossRef] [Medline]
- Coulon SM, Monroe CM, West DS. A systematic, multi-domain review of mobile smartphone apps for evidence-based stress management. Am J Prev Med 2016 Jul;51(1):95-105. [CrossRef] [Medline]
- Girault A, Ferrua M, Lalloué B, Sicotte C, Fourcade A, Yatim F, et al. Internet-based technologies to improve cancer care coordination: current use and attitudes among cancer patients. Eur J Cancer 2015 Mar;51(4):551-557. [CrossRef] [Medline]
- Drewes C, Kirkovits T, Schiltz D, Schinkoethe T, Haidinger R, Goldmann-Posch U, et al. EHealth acceptance and new media preferences for therapy assistance among breast cancer patients. JMIR Cancer 2016 Sep 14;2(2):e13 [FREE Full text] [CrossRef] [Medline]
- Klasnja P, Hartzler A, Powell C, Phan G, Pratt W. Health weaver mobile: designing a mobile tool for managing personal health information during cancer care. AMIA Annu Symp Proc 2010 Nov 13;2010:392-396 [FREE Full text] [Medline]
- Trinh L, Arbour-Nicitopoulos KP, Sabiston CM, Alibhai SM, Jones JM, Berry SR, et al. A qualitative study exploring the perceptions of sedentary behavior in prostate cancer survivors receiving androgen-deprivation therapy. Oncol Nurs Forum 2015 Jul;42(4):398-406. [CrossRef] [Medline]
- Odeh B, Kayyali R, Nabhani-Gebara S, Philip N. Optimizing cancer care through mobile health. Support Care Cancer 2015 Jul;23(7):2183-2188. [CrossRef] [Medline]
- Firth J, Torous J. Smartphone apps for schizophrenia: a systematic review. JMIR Mhealth Uhealth 2015 Nov 06;3(4):e102 [FREE Full text] [CrossRef] [Medline]
- Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009 Jul 21;6(7):e1000097 [FREE Full text] [CrossRef] [Medline]
- Egbring M, Far E, Roos M, Dietrich M, Brauchbar M, Kullak-Ublick GA, et al. A mobile app to stabilize daily functional activity of breast cancer patients in collaboration with the physician: a randomized controlled clinical trial. J Med Internet Res 2016 Sep 06;18(9):e238 [FREE Full text] [CrossRef] [Medline]
- Foley NM, O'Connell EP, Lehane EA, Livingstone V, Maher B, Kaimkhani S, et al. PATI—patient accessed tailored information: a pilot study to evaluate the effect on preoperative breast cancer patients of information delivered via a mobile application. Breast 2016 Dec;30:54-58. [CrossRef] [Medline]
- Fromme EK, Kenworthy-Heinige T, Hribar M. Developing an easy-to-use tablet computer application for assessing patient-reported outcomes in patients with cancer. Support Care Cancer 2011 Jun;19(6):815-822 [FREE Full text] [CrossRef] [Medline]
- Fu MR, Axelrod D, Guth AA, Rampertaap K, El-Shammaa N, Hiotis K, et al. mHealth self-care interventions: managing symptoms following breast cancer treatment. Mhealth 2016 Jul;2 [FREE Full text] [CrossRef] [Medline]
- Hyun-Ju J, Bok-Hee C. Efficacy of an application-based recurrence prevention program for breast cancer survivors: a pilot study. Indian J Sci Technol 2016;9(46). [CrossRef]
- Kearney N, McCann L, Norrie J, Taylor L, Gray P, McGee-Lennon M, et al. Evaluation of a mobile phone-based, advanced symptom management system (ASyMS) in the management of chemotherapy-related toxicity. Support Care Cancer 2009 Apr;17(4):437-444. [CrossRef] [Medline]
- Matthew AG, Currie KL, Irvine J, Ritvo P, Santa MD, Jamnicky L, et al. Serial personal digital assistant data capture of health-related quality of life: a randomized controlled trial in a prostate cancer clinic. Health Qual Life Outcomes 2007 Jul 06;5:38 [FREE Full text] [CrossRef] [Medline]
- Quintiliani LM, Mann DM, Puputti M, Quinn E, Bowen DJ. Pilot and feasibility test of a mobile health-supported behavioral counseling intervention for weight management among breast cancer survivors. JMIR Cancer 2016 May 09;2(1):e4 [FREE Full text] [CrossRef] [Medline]
- Skolarus TA, Holmes-Rovner M, Hawley ST, Dunn RL, Barr KLC, Willard NR, et al. Monitoring quality of life among prostate cancer survivors: the feasibility of automated telephone assessment. Urology 2012 Nov;80(5):1021-1026. [CrossRef] [Medline]
- Somers TJ, Abernethy AP, Edmond SN, Kelleher SA, Wren AA, Samsa GP, et al. A pilot study of a mobile health pain coping skills training protocol for patients with persistent cancer pain. J Pain Symptom Manage 2015 Oct;50(4):553-558 [FREE Full text] [CrossRef] [Medline]
- Sundberg K, Eklöf AL, Blomberg K, Isaksson A, Wengström Y. Feasibility of an interactive ICT-platform for early assessment and management of patient-reported symptoms during radiotherapy for prostate cancer. Eur J Oncol Nurs 2015 Oct;19(5):523-528. [CrossRef] [Medline]
- Valle CG, Deal AM, Tate DF. Preventing weight gain in African American breast cancer survivors using smart scales and activity trackers: a randomized controlled pilot study. J Cancer Surviv 2017 Feb;11(1):133-148. [CrossRef] [Medline]
- Young-Afat DA, van Gils CH, Bruinvels DJ, van der Pol CC, Witkamp AJ, Sijtsema S, et al. Patients’ and health care providers’ opinions on a supportive health app during breast cancer treatment: a qualitative evaluation. JMIR Cancer 2016 Jun 07;2(1):e8 [FREE Full text] [CrossRef] [Medline]
- Kim J, Lim S, Min YH, Shin Y, Lee B, Sohn G, et al. Depression screening using daily mental-health ratings from a smartphone application for breast cancer patients. J Med Internet Res 2016 Aug 04;18(8):e216 [FREE Full text] [CrossRef] [Medline]
- McCarroll ML, Armbruster S, Pohle-Krauza RJ, Lyzen AM, Min S, Nash DW, et al. Feasibility of a lifestyle intervention for overweight/obese endometrial and breast cancer survivors using an interactive mobile application. Gynecol Oncol 2015 Jun;137(3):508-515. [CrossRef] [Medline]
- Min YH, Lee JW, Shin Y, Jo M, Sohn G, Lee J, et al. Daily collection of self-reporting sleep disturbance data via a smartphone app in breast cancer patients receiving chemotherapy: a feasibility study. J Med Internet Res 2014 May 23;16(5):e135 [FREE Full text] [CrossRef] [Medline]
- Sundberg K, Wengström Y, Blomberg K, Hälleberg-Nyman M, Frank C, Langius-Eklöf A. Early detection and management of symptoms using an interactive smartphone application (Interaktor) during radiotherapy for prostate cancer. Support Care Cancer 2017 Jul;25(7):2195-2204 [FREE Full text] [CrossRef] [Medline]
- Uhm KE, Yoo JS, Chung SH, Lee JD, Lee I, Kim JI, et al. Effects of exercise intervention in breast cancer patients: is mobile health (mHealth) with pedometer more effective than conventional program using brochure? Breast Cancer Res Treat 2017 Feb;161(3):443-452. [CrossRef] [Medline]
- Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977 Mar;33(1):159-174. [Medline]
- Cella DF, Tulsky DS, Gray G, Sarafian B, Linn E, Bonomi A, et al. The Functional Assessment of Cancer Therapy scale: development and validation of the general measure. J Clin Oncol 1993 Mar;11(3):570-579. [CrossRef] [Medline]
- Fallowfield L, Payne H, Jenkins V. Patient-reported outcomes in metastatic castration-resistant prostate cancer. Nat Rev Clin Oncol 2016 Oct;13(10):643-650. [CrossRef] [Medline]
- EuroQol Group. EuroQol—a new facility for the measurement of health-related quality of life. Health Policy 1990 Dec;16(3):199-208. [Medline]
- Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst 1993 Mar 03;85(5):365-376. [Medline]
- van Andel G, Bottomley A, Fosså SD, Efficace F, Coens C, Guerif S, et al. An international field study of the EORTC QLQ-PR25: a questionnaire for assessing the health-related quality of life of patients with prostate cancer. Eur J Cancer 2008 Nov;44(16):2418-2424. [CrossRef] [Medline]
- Sprangers MA, Groenvold M, Arraras JI, Franklin J, te Velde A, Muller M, et al. The European Organization for Research and Treatment of Cancer breast cancer-specific quality-of-life questionnaire module: first results from a three-country field study. J Clin Oncol 1996 Oct;14(10):2756-2768. [CrossRef] [Medline]
- Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. JAMA 1999 Nov 10;282(18):1737-1744. [Medline]
- Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001 Sep;16(9):606-613 [FREE Full text] [Medline]
- Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav 1983 Dec;24(4):385-396. [Medline]
- Lyons EJ, Baranowski T, Basen-Engquist KM, Lewis ZH, Swartz MC, Jennings K, et al. Testing the effects of narrative and play on physical activity among breast cancer survivors using mobile apps: study protocol for a randomized controlled trial. BMC Cancer 2016 Mar 09;16:202 [FREE Full text] [CrossRef] [Medline]
- Lozano-Lozano M, Martín-Martín L, Galiano-Castillo N, Álvarez-Salvago F, Cantarero-Villanueva I, Fernández-Lao C, et al. Integral strategy to supportive care in breast cancer survivors through occupational therapy and a m-health system: design of a randomized clinical trial. BMC Med Inform Decis Mak 2016 Nov 25;16(1):150 [FREE Full text] [CrossRef] [Medline]
- Maguire R, Fox PA, McCann L, Miaskowski C, Kotronoulas G, Miller M, et al. The eSMART study protocol: a randomised controlled trial to evaluate electronic symptom management using the advanced symptom management system (ASyMS) remote technology for patients with cancer. BMJ Open 2017 Jun 06;7(5):e015016 [FREE Full text] [CrossRef] [Medline]
|BDI: Beck Depression Inventory|
|CAP: College of American Pathologists|
|CLIA: Clinical Laboratory Improvement Amendments|
|EORTC QLQ-C30: European Organization for Research and Treatment of Cancer Quality of Life Questionnaire–Core|
|EORTC QLQ-BR23: European Organization for Research and Treatment of Cancer Quality of Life Questionnaire complementary module for breast cancer patients|
|EORTC QLQ-PR25: European Organization for Research and Treatment of Cancer Quality of Life Questionnaire complementary module for prostate cancer patients|
|EQ-5D-3L: EuroQol 5-Dimension questionnaire|
|FACT-G: Functional Assessment of Cancer Therapy–General|
|HRQoL: health-related quality of life|
|mHealth: mobile health|
|PHQ-9: Patient Health Questionnaire–9|
|PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses|
|PRO: patient-reported outcome measures|
|PSS: Perceived Stress Scale|
|QoL: quality of life|
|RCT: randomized controlled trial|
|OSR: online store research|
|WEL: Weight Efficacy Lifestyle questionnaire|
Edited by G Eysenbach; submitted 19.08.17; peer-reviewed by S Bhatlekar, N Azevedo; comments to author 13.09.17; revised version received 26.10.17; accepted 29.10.17; published 04.12.17
©Esther Rincon, Francisco Monteiro-Guerra, Octavio Rivera-Romero, Enrique Dorronzoro-Zubiete, Carlos Luis Sanchez-Bocanegra, Elia Gabarron. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 04.12.2017.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.