Published on 23.08.19 in Vol 7, No 8 (2019): August
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/12649, first published Oct 30, 2018.
Passive Sensing of Health Outcomes Through Smartphones: Systematic Review of Current Solutions and Possible Limitations
Background: Technological advancements, together with the decrease in both price and size of a large variety of sensors, has expanded the role and capabilities of regular mobile phones, turning them into powerful yet ubiquitous monitoring systems. At present, smartphones have the potential to continuously collect information about the users, monitor their activities and behaviors in real time, and provide them with feedback and recommendations.
Objective: This systematic review aimed to identify recent scientific studies that explored the passive use of smartphones for generating health- and well-being–related outcomes. In addition, it explores users’ engagement and possible challenges in using such self-monitoring systems.
Methods: A systematic review was conducted, following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, to identify recent publications that explore the use of smartphones as ubiquitous health monitoring systems. We ran reproducible search queries on PubMed, IEEE Xplore, ACM Digital Library, and Scopus online databases and aimed to find answers to the following questions: (1) What is the study focus of the selected papers? (2) What smartphone sensing technologies and data are used to gather health-related input? (3) How are the developed systems validated? and (4) What are the limitations and challenges when using such sensing systems?
Results: Our bibliographic research returned 7404 unique publications. Of these, 118 met the predefined inclusion criteria, which considered publication dates from 2014 onward, English language, and relevance for the topic of this review. The selected papers highlight that smartphones are already being used in multiple health-related scenarios. Of those, physical activity (29.6%; 35/118) and mental health (27.9; 33/118) are 2 of the most studied applications. Accelerometers (57.7%; 67/118) and global positioning systems (GPS; 40.6%; 48/118) are 2 of the most used sensors in smartphones for collecting data from which the health status or well-being of its users can be inferred.
Conclusions: One relevant outcome of this systematic review is that although smartphones present many advantages for the passive monitoring of users’ health and well-being, there is a lack of correlation between smartphone-generated outcomes and clinical knowledge. Moreover, user engagement and motivation are not always modeled as prerequisites, which directly affects user adherence and full validation of such systems.
JMIR Mhealth Uhealth 2019;7(8):e12649
Modern mobile phones have long transcended their basic use as communication tools. At present, a smartphone is equally a digital camera, a pedometer, a fitness tracker, or a virtual assistant, among others. Smartphones are familiar, unobtrusive, and discrete devices in today’s society. Their various embedded sensors along with their high ubiquity have turned them into a valuable accessory in multiple areas of research. One such area is passive sensing or self-monitoring for either predicting or classifying health-related behaviors of smartphone users .
Behavioral patterns such as app usage, social interactions, and a user’s activity log or contextual information such as user’s location or Wi-Fi connectivity are just a few examples of smartphone data that can be modeled into passive indicators of a user’s health or well-being [, ]. A smartphone’s numerous embedded sensors such as digital camera, microphone, global positioning system (GPS), accelerometer, gyroscope, Wi-Fi, Bluetooth, light and sound sensors, along with their programmable platforms, enable the passive collection of user data, thus making smartphones particularly promising self-monitoring tools.
This systematic review aims to overview current existing literature about the passive sensing technologies and data of smartphones used to monitor users’ health status. Passive sensing does not require any explicit user involvement but rather relies on the ubiquity of smartphones for gathering meaningful data in the background, without any biases that could be introduced by users’ categorical participation. In this review, we assess recent studies on the use of smartphones as a tool for providing passive health insights, which do not use any other kind of complementary sensing or monitoring tools. Moreover, we are interested in highlighting possible limitations or system validation concerns that have been identified in the studies included in the review.
This systematic review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and is registered in the PROSPERO database (identifier CRD 4201912447). The objective of this paper was to review the literature regarding the functionality of passive sensing of modern smartphones. As such, we focused on finding the most suitable keywords for retrieving recent studies that focus on this topic. We conducted a bibliographic search on the following Web-based databases: PubMed, IEEE Xplore, ACM Digital Library, and Scopus.
The search query used for this purpose was as follows: (smartphone OR mobile) AND (sensing OR monitoring) AND well-being AND (health OR mhealth)
This strategy retrieved 7602 publications. Papers published between January 2014 and March 2019 were included in the search. We first removed duplicate titles by an automatic script and then assessed the remaining titles for relevance for the topic. The studies that passed this first assessment were further evaluated based on their abstract. The final decision on the inclusion of a study was based on its full-text evaluation.
Inclusion and Exclusion Criteria
The titles, authors, and publication dates of the manuscripts resulting from the search were provided in a list that was further ordered by author names. Manuscripts written by the same author group and that refer to the same methodology or application were analyzed for the sake of identifying the most recent or complete publication. Having identified one such manuscript per author group, the remaining articles written by the same author group were discarded, as they would contain similar content and thus add some redundancy to the final results of the review. Other inclusion criteria were as follows:
Relevance for the Chosen Topic
Study focus is passive sensing. Therefore, studies in which users have to explicitly manipulate the smartphone were not considered. Publications that considered smartphone as the sole sensing device were included.
Papers published from January 1, 2014 to April 1, 2019 were included in the review. Due to the fast evolution of smartphone technologies, what existed a few years ago may be obsolete now. Therefore, we decided to include only recent manuscripts based on current technologies.
Exclusion criteria were as follows: (1) publication language other than English; (2) use of other sensing devices or external sensors; (3) user interaction with the sensing system—this review focuses on passive sensing, where users should neither be aware of the sensing process nor willingly interact with the device for this purpose; (4) unavailability of the full text of a manuscript through the library services in our research institute; (5) out of scope for this review’s target; (6) lack of results—position papers were excluded; and reviews.
On the basis of the aforementioned selection criteria, the query results were evaluated based on their titles first and then abstracts. The full text of remaining papers was read and analyzed critically to select the ones that best fulfilled the main purpose of this review.shows a PRISMA flow diagram [ ] of the bibliographic search.
Data Collection and Analysis
The first 2 authors of this review performed individual assessments of the papers to be included in the review. These reviewers identified possible bias in each paper, based on the Cochrane Collaboration’s risk of bias tool . Finally, observations were combined into 1 spreadsheet for discussion. In case of disagreement, the third author provided advice on the final decision regarding the inclusion of a manuscript. No papers were discarded because of bias.
The search query used for the retrieval of studies for this review resulted in 7602 papers. These papers were evaluated by 2 reviewers only, which may have caused biases in the selection and screening of search results considering the topic of the review. However, when in doubt, the 2 reviewers involved the third author for an objective opinion. Another limitation of this review is the fact that all the information presented and summarized here was manually collected.
A total of 7602 manuscripts were retrieved through the systematic search methodology described above. After removal of duplicates, we obtained 7404 studies. Of the 7404 titles inspected, 1339 were considered suitable for abstract assessment. Out of these, 199 abstracts were considered as potential candidates for the review, which led to 199 full-text retrievals and assessments. Finally, 119 manuscripts were included in the review.shows the number of returned and selected papers from different Web-based databases.
The exclusion of a large number of papers after title assessment is because of the broadness of the search query used for study retrieval. The query was not applied to a specific field or section of a paper (eg, title or abstract), rather we looked for the terms in the query anywhere in the text of the manuscript. This led to the retrieval of a large number of papers related to the Internet of Things, smart homes, wearable monitoring systems, and robotics, as well as a considerable number of systematic reviews. The abstract evaluation further refined the number of candidate studies as, on one hand, many revealed the use of external sensors as complements of smartphones in the sensing process. On the other hand, many studies exposed explicit human interaction with the monitoring system, which would no longer satisfy 1 of the inclusion criteria for this review, passive sensing.summarizes the percentage of excluded papers in the last step of our evaluation, based on the exclusion criteria described above.
Among the studies included for the review, we can verify that the number of published papers related to passive sensing and monitoring of health conditions using smartphones has increased over the years. More particularly, the number has doubled from 2014 to 2017 as shown in. This advocates for the research interest on the topic and strengthens the motivation of this review.
Below we provide an overview of some of the study characteristics including their main purpose, target audience, number and types of participants, and the sensing methods used. We also compiled the health conditions that have been studied and monitored using the various smartphone sensors.
|Reason for exclusion||Excluded studies, n|
|Full text not available||18|
|User interaction required||22|
|Use of external sensors||17|
|Language (not English)||2|
|Same application–different study||1|
Focus and Target Population of Included Studies
As shown in, the interest in sensing capabilities of a smartphone with the aim of improving users’ health and well-being has been increasing over the last few years. Among the selected papers for this systematic review, physical activities and mental health are 2 of the most studied health dimensions, along with sociability, students’ academic performance monitoring, and general well-being, as shown in .
Of the selected papers, 29.6% (35/118) are dedicated to the detection of users’ physical activities. Most of them aimed to recognize basic daily activities such as walking [- ], standing or sitting [ - , , - , - ], jogging or running [ - , , ], going up and down the stairs [ - , ], lying down [ , , ], and driving a bike [ , , ] or vehicle [ , , ]. In addition, 1 study tried to infer riding up and down an elevator [ ], 1 assessed different activities including being stationary, limping, shuffling, and skipping [ ], and 1 detected shopping and dining activities [ ]. Physical activities were also explored in the sense of detecting and counting steps [ , ], distinguishing physical activity from lifestyle activities such as eating [ , ], assessing mobility in the elderly to avoid sedentary lives [ ], studying its relationship with happiness including nonexercise activities [ - ], or even measuring and predicting the walking speed and distance of patients with pulmonary diseases [ ].
Another health-related issue well studied in the selected papers is mental health disorders. Some of the mental health-related issues, factors, or diseases that have been investigated using smartphones are as follows: stress conditions [- ], bipolar disorder [ - ], anxiety [ , ], schizophrenia [ , ], depression [ - ], psychotic relapse [ ], mood [ - ], and affect, which have been detected, for example, using photos taken by the camera in smartphones [ , ]. A novel approach for understanding users’ emotions is the study of the typing behavior and texting speed of the users [ ]. The influence of users’ exposure to natural outdoor environments on mental health has also been investigated through passive sensing [ ]. Two other studies developed their monitoring solution including a recommendation system to support patients with depression to cope with their diagnosis [ , ]. Mental health systems have also been used as a tool by caregivers to access the summary of situations experienced by patients with depression [ ] or to alert physicians and families if an abnormal behavior is detected in patients with mood disorders [ ].
Sociability has been less studied, but it is an equally important health dimension of people’s overall well-being. It is known to have a considerable impact on the stress and anxiety levels of individuals. In fact, healthy relationships between colleagues may improve their productivity , united families are happier [ , ], and students cope better with their studies when surrounded by friends [ ]. One way of analyzing this health dimension is by exploring interaction patterns and near locations [ , ]. An interesting approach for using the sensing capabilities of smartphones to infer the risk-taking propensity of users has been proposed in 2 studies [ , ]. One recommendation study in particular includes a feature that informs caregivers that their patients feel lonely and need additional examination [ ].
Only 5.9% (7/118) of the selected papers chose to infer users’ sleep by detecting sleep patterns, irregular nights, and sleep start and end times [, - ]. One study focused on the correlation between sleep patterns and schizophrenia [ ].
The health areas described above were investigated on an individual basis by some of the selected papers, but several other studies explored more than just 1 area to infer insights on users’ general well-being. Such systems are developed to detect the physical activities, sleep patterns, sociability levels, and location of users to either better understand and improve their behaviors or to promote awareness and self-reflection [- ].
Self-monitoring systems have become very helpful in supporting older people with their health conditions and in the early diagnosis of abnormal conditions in the elderly. For example, the easy monitoring of cardiac parameters with smartphones, only using the users’ photographs of the finger or face, can provide a first pulse rate estimation, and users can quickly understand if something is wrong and needs additional examination [, ]. Similarly, incidents of fall events and tremors are prone to increase in older people. Fall detection systems can quickly alert when a fall occurs, decrease the time spent on the floor, and reduce the fear of falling among the elderly [ ]. On the other hand, the early diagnosis of hand tremors by passive sensing is an important contribution in the diagnosis and treatment of Parkinson disease [ - ].
Finally, 10.1% (12/118) of the selected studies developed monitoring systems specifically dedicated to students, mainly to understand how their behaviors (physical activities, sleep, and social interactions) affect their academic performance [- ], mental health [ - ], social anxiety [ ], mobility, and behaviors [ , - ]. One study [ ] presented an approach for predicting the students’ food purchase within their proximity to provide them with recommendations about healthier options.
Considering the selected papers and their described study focus, we can categorize them by disease or lifestyle monitoring. In fact, 4 studies aimed to monitor health conditions related to a specific disease, such as detecting sleep abnormalities in patients with schizophrenia or hand tremors in those with Parkinson disease, and another 12 opted to use smartphones to sense users’ daily lives to improve their general health and well-being. Among the studies that targeted a specific population, 6.9% (8/118) were on monitoring students’ lives [, , , , , - ] and 27.1% (33/118) on people with mental health conditions, such as depression or schizophrenia [ , - , ]. Senior population and workers were targeted by 3 studies each [ , , , , , ]. Among the remaining studies, 2 aimed to monitor patients with Parkinson disease [ , ], 1 targeted pulmonary patients [ ], and 1 targeted family members [ ]. It should be noted that among studies that aimed to monitor diseases, almost all of them targeted a specific population.
Today’s off-the-shelf smartphones are equipped with many passive and powerful sensing technologies, which allow the continuous collection of various health-related data. Among the smartphone physical sensors, accelerometer is the most used sensor because of its low privacy and power consumption. In fact, 56.7% of the selected papers (67/118) took advantage of this sensor to gather users’ data, mostly related to physical activities.
The GPS is another commonly explored physical sensor in smartphones as it is part of most commercially available smartphones. Of the studies included, 40.6% (48/118) collected useful GPS data about users’ location and movements. This sensor was either used alone or along with Wi-Fi, Bluetooth, or accelerometer. Besides the users’ location, Bluetooth was highly used to infer levels of sociability. In fact, of the 6 papers that used Bluetooth, 4 aimed to detect users’ physical encounters.
Microphone and gyroscope are other well-studied sensors in passive systems and have been explored in 20.3% (24/118) and 16.9% (20/118) of the selected papers, respectively. A microphone is used to infer loneliness, sleep, and fall events, and a gyroscope is essentially used to detect basic physical activities.
In addition to the information collected by physical sensors, proposed solutions also collect a set of useful health-related data about the use of smartphones and users’ usage pattern. The most common ones are related to communication events including calls and text messages and smartphone usage such as screen events, light values, time spent on the phone, and device settings. Furthermore, battery level and status and app usage, used in 5.9% (7/118) of the selected papers, allow the collection of useful data about sleep.
Other health-related data can be collected from physical sensors and smartphone data, for example, camera, temporal context, and magnetometer, as shown in. The table overviews the sensors and smartphone data that are used in the selected papers.
provides an overview of the use of smartphone sensors and data in the selected papers and different health areas.
|Source of data||Studies, n|
|Battery level & stats||5|
|SMS & calls||13|
|Smartphone & app usage||19|
|Studied behavior||Smartphone sensors/data|
|General well-being||Microphone [, ]; accelerometer [ , , , , - ]; smartphone usage [ , , , ]; app usage [ , ], activity recognition APIa [ ]; text messages, calls, Wi-Fi [ , ]; GPSb [ , - , , ]; Bluetooth, magnetometer, gyroscope, battery level and status [ ], camera [ ]|
|Fall detection||Audio features (microphone) , accelerometer [ - ], GPS[ ]|
|Sleep||App and smartphone usage [, , , ]; Wi-Fi, temporal context, battery level and status [ , , ]; accelerometer [ , , ]; GPS, calls, text messages, activity recognition API [ ]; microphone [ , ]|
|Sociability (loneliness, relationships)||Bluetooth [, , , ]; accelerometer, gyroscope, microphone [ , ]; GPS [ , , , , , ]; Wi-Fi [ , , ]; calls, text messages, social app usage [ , , , ]; emails [ ]|
|Mental health (depression, emotions, stress level, bipolar disorder, schizophrenia)||GPS [- , , , , , - , - , , - ]; smartphone and app usage [ , , , , , , , , , , - ]; accelerometer [ , , - , , , , , , , ]; cell-ID/calls [ , , , , - ]; text messages [ , , , , , ]; Wi-Fi [ , , , , ]; Bluetooth [ ]; microphone [ , , , , , , , ]; camera [ , ]; keyboard [ ]; temporal context [ ]; battery usage [ ]; Bluetooth [ ]; Google location services API, activity recognition API [ , ]|
|Physical activities recognition (mobility, steps counting)||Accelerometer [- , - , - , , , , , , - ]; gyroscope [ , , , , , , , , , , , , , ]; magnetometer [ , , , , , , ]; GPS [ , , - , , - ]; barometer [ , , ]; gravity sensor [ ], microphone [ , ]; Wi-Fi access points [ , , ]|
|Heart rate measurements||Camera [, ]|
|Hand tremor||Accelerometer [, ]; gyroscope [ ]|
|Oxygen, breath, and voice analysis||Accelerometer ; microphone [ , ]|
|Parkinson disease||GPS ; gyroscope [ ]; accelerometer [ ]|
|Students’ monitoring (behaviors, performance)||GPS [, , , ]; microphone [ , , , , ]; Wi-Fi [ , , , ]; accelerometer [ , , , ]; smartphone usage [ , , ]; temporal context [ ]; app usages, text messages, calls [ , , ]; battery level and status [ , ]; location, weather data [ ]; gyroscope, Bluetooth [ ]; Google activity recognition [ ]|
aAPI: application programming interface.
bGPS: global positioning system.
One of the main advantages of the use of smartphones in health monitoring is the possibility to passively collect data. Passive data collection means that user interaction or participation is not intentional, and all sensing data come from the ubiquitous sensors of the smartphone. Of the 118 selected papers, 50 used collected data from only 1 sensor, mostly accelerometer to detect physical activities. GPS and camera were also used alone in 7 different papers. On the other hand, of the selected papers that investigated the use of several sensors, 23 used accelerometer that was essentially used along with gyroscope, GPS, Wi-Fi, and microphone to detect physical activities and general users’ behaviors.
In the spectrum of smartphone technologies, one of the main challenges that can affect the health-related collection of data when developing monitoring systems is the choice of the operating system. In fact, there are some differences and difficulties in development for Android or IOS systems, the 2 most used phone operating systems worldwide. Android is currently the most popular system and has the advantage of being convenient from the programming point of view . Scanning rates of sensors are found to be superior with this operating system [ ]. Furthermore, IOS hampers third-party apps to run endlessly in background, which may make the data collection difficult [ ]. Of the selected papers, 56.7% (67/118) developed their system only for Android smartphones, 6 developed for both Android and IOS, and 45 did not provide any information about the chosen operating system.
To ensure that users of smartphone-based passive monitoring systems engage with their use requires a strong validation before releasing such systems for mass usage. Three aspects related to the validation of systems can be highlighted: the dimension of the sample of participants, the study duration, and the ground truth data that are used to compare and evaluate the results.
Validation of monitoring systems is an important phase as it can provide researchers and developers with relevant feedback and information about the accuracy and efficiency of the systems. The developed systems are tested by a sample of participants for a specific duration. Of the selected papers, about 71.1% (84/118) asked less than 50 participants to use and test their developed systems. Only few studies tested their monitoring systems with more participants: in 16.1% (19/118) of the studies, the systems were tested by 51 to 450 participants, and only 2.5% (3/118) used more than 10,000 participants in the validation phase. Although most of the papers gave information about the number of participants on their studies, 12 out of 118 (10.1%) did not provide any relevant information (see). Another aspect to be noted is that, of the papers with information about the participants, 21 out of 118 asked students to test their developed systems [ , , , , , , , - , ]. This may be an indicator of the willingness of younger adults to engage in this area.
Study duration is also an important feature to be considered. Of the selected papers, about 20% (24 out of 118) did not provide any relevant information about the study duration. Of those studies with a specific study duration, 16.1% (19/118) lasted between 1 to 3 weeks or between 4 to 8 weeks, 12.7% (15/118) lasted between 8 to 35 weeks, and 7.6% (9/118) lasted for more than 36 weeks. Some of the papers that tried to detect physical activities chose to ask the participants to perform specific activities to test their developed systems without having a specific duration (29%, 35/118) [, - , , , , , , ] (see ).
Only 1 of the selected papers did not provide any information about the number of participants and the study duration but mentioned that they had used 4 different smartphones to infer nearness based on users’ daily activities and social interactions over time and space .
Ground truth data allow the comparison and validation of the data collected by smartphones. Of the selected papers, about 59.3% (70/118) indicated the type of data used as ground truth, and the remaining studies did not provide any relevant information. The most used method is self-reports and questionnaires that can be performed either by a physician or provided by the participants. This method is very useful when testing monitoring systems because self-reports can be prompted to the users in their smartphones without involving any additional efforts. On the other hand, this method presents some disadvantages because the users may not always respond accurately, and results turn out to be biased. In the studies selected for this review, the questionnaire method has been essentially used to collect information about the users’ mental health [, , , , , , , ], sleep [ , , ], stress levels [ , , , ], and physical activities [ , , ]. Some of the studies chose to use self-reports recognized in the health area, as for example the Patient Health Questionnaire about depression [ , ], the Pittsburgh Sleep Quality Index [ ], the Unified Parkinson’s Disease Rating Scale [ ], and the Beck’s Depression Inventory [ ]. To collect ground truth data, dedicated devices can also be used as an alternative to questionnaires: actigraph [ ], fitness devices [ , ], electrocardiogram [ ], and video clips [ , ] to record participants’ physical activities. The actual pulse rate of the participants has also been collected when trying to measure cardiac parameters using the smartphone [ ]. Of the selected papers, 3 asked the participants to manually label the data about them used during the study [ , , ].
Limitations and Validation Concerns
Users’ motivations, interests, and concerns about monitoring systems may influence their adherence on using available solutions. Some of them are related to physiological aspects such as improving behaviors or monitoring health conditions such as cardiac parameters, and others are related to more technical aspects of the systems. Selected papers in this review had more concerns about technical limitations of the proposed solutions as they may affect the users’ interest and adherence to monitoring systems.
As described previously, 56.7% (67/118) papers decided to develop their systems with Android as it is simpler to develop third-party apps and because it is the most common operating system worldwide attracting more people to use the proposed systems.
Battery levels and privacy are 2 main themes approached in some of the selected papers. In fact, if these 2 aspects do not fulfill the users’ expectations, they may not use the available solutions. Of the selected papers, about 36.4% (43/118) improved the use of smartphone battery or demonstrated some concerns about its levels and hope to improve this performance in future work. The most used solution to maintain reasonable levels of battery was to decrease the sampling rates of sensors [, , , , , , ]. Other studies chose to pause the sampling when the battery was low [ ] or to only do a unique sampling per day [ ]. Finally, only 1 study [ ] used accelerometer to classify activities because this sensor does not use much battery. Related to privacy, 25.4% (30/118) evidenced that privacy issues may drop users’ adherence. For example, users may want their data to be securely stored as explained and implemented in 2 studies [ , ]. Other studies chose to not store any user information on the smartphone or in the cloud [ , ], to hash all the relevant information about the user [ , , , , ] or to only use the accelerometer as it raises few privacy concerns [ ].
Another possible limitation of these studies is that if a developed system is tested by a sample of young adults, it may not be adapted to senior people, and results may not be accurate [, ]. Some of the proposed models were developed and tested only with a specific population and may be too personalized, thus leading to inaccurate results when the systems are used by other populations [ , ]. Other papers pointed out the fact that personalized models produced better results than general models [ , , , ]. Summing up, about 16.1% (19/118) raised some concerns about the accuracy of the developed models when used on different populations. This percentage can be explained by the fact that 43.2% (51/118) of the selected papers chose to develop their systems to specific populations, and no concerns were raised by the developed models.
One of the main advantages in using a smartphone in health monitoring is its unobtrusiveness. However, almost half the selected papers required the smartphones to be on a specific body position, such as in the pocket trouser, in the handbag, or in the hand. Other studies required the smartphones to be placed in the users’ vicinity [, , ] or to keep it always on to make sure that the system works correctly [ , ]. These conditions may nullify the use of smartphones as it turns it into an obtrusive device for users.
Finally, considering that the main purpose of health monitoring systems is to improve users’ behaviors, health, and well-being, 37.2% (44/118) of the selected papers referred the importance of a recommendation and feedback system to make sure that users are aware of their behaviors to be able to improve them. In fact, such system features may lead to improvements in users’ daily lives and health when providing useful information to users, for example, improvements in subjects’ depression levels . However, users are not willing to receive too many recommendations, as described in 1 study [ ], and notifications should be sent to users only when necessary, for example, when symptoms are detected [ ].
presents a list of the selected papers that referred the described technical aspects that can have an impact on the users’ adherence to the systems.
|Battery levels||[, , , , , , , , , , , , , - , , , ]|
|Privacy||[, , , , , , , , , , , , ]|
|Developed models||[, , , , , , , ]|
|Smartphone body position||[- , - , , , , , , , , , , , ]|
|Recommendations and feedback||[- , , , , - , , , , , , - ]|
Comparison With Prior Work
The reviewed studies illustrate the potential of monitoring several health dimensions using only data collected from the smartphone to support users in improving their health and well-being. Several strategies for data collection were demonstrated for different health areas offering researchers several options to develop passive sensing solutions. We provide an overview of the limitations of such health-related monitoring systems reviewing the specific use of smartphone technologies to monitor, understand, and improve users’ well-being through several health dimensions. As far as we know, this is the first review that investigates the use of smartphone sensing technologies and data in health monitoring and discusses the limitations and concerns on using such systems.
Many reviewed papers focused on specific conditions such as mental health (bipolar disease, schizophrenia, major depressive disease, and mood disorder) [- ], stress [ ], cardiology [ ], sleep [ ], weight control through physical activities [ ], management of chronic diseases in older adults [ ], or in a more general way, health and well-being with particular representation of mental health and sleep [ ], and psychological research (social interactions, activities, and mobility patterns) [ ]. Regarding the technologies and devices used in the reviews, smartphone is the most commonly used [ - ], but only a few studies used it to collect data from its sensors [ , , , , ]. In other cases, smartphones are used to prompt ecological momentary assessments to users [ , , ], provide smartphone apps [ - , ], or send some recommendations by short messaging service to the users [ ]. Reviewed papers also consider wearable devices [ , , , , ] and other devices and technologies such as tablets, fitness trackers, smartphone-connected devices, accessories, and desktop resources [ , - ].
Compared with these reviewed papers, this review does not target a specific condition or a sensor. Our ambition was to identify all health-related aspects that can be monitored with a smartphone and to understand how far we are from using such systems as an alternative or a complement to standard clinical procedures.
Although the use of smartphones in health monitoring demonstrates to be a promising study field, available solutions still face some limitations that need to be overcome to make sure that users are comfortable and confident in using such systems. In fact, in some situations, monitoring systems may be perceived as uncomfortable, burdensome, and intrusive to users.
Regular users expect monitoring systems to be able to provide useful information and recommendations about their behaviors . Given a health-related feedback, users are prone to improve their lifestyle and habits in relation with physical activities, well-being, sociability, and mental health [ , ].
Several technological aspects of health monitoring systems using smartphones should be taken into account. Among them, the most interesting one is the possibility to passively and continuously collect health-related data about users without changing their daily lives, thus turning smartphones into an unobtrusive and less burdensome tool compared with other health devices. In addition, smartphones are portable, cheaper, and more convenient than other devices and stay with the users throughout the day, which makes them a familiar tool to users . Moreover, these passive systems can be used to share behavioral and health-related data with health professionals and peers. Recommendations, interventions, feedback, and reminders can be integrated to inform the users about their current state and eventually improve it [ , ].
Despite these advantages, users may still have some concerns about the use of smartphones in health monitoring. Nowadays, users decide very quickly on whether they are going to use a smartphone app or not; therefore, the developed systems should fully meet their expectations. The first aspect that the users normally evaluate is the design of apps. In addition, they hope that the developed system is easy to use and that they will not spend too much time to understand how it works. Concerns about the battery and privacy are also often raised. In fact, users expect that their battery level will not drop significantly given that these systems usually run in background continuously. Users may also discard apps because of privacy issues. Data collected using smartphones are private and should not be shared without permission or maliciously accessed. Generally, users accept to share their data with physicians or within a group of people with the same goal but are not comfortable with sharing it on social media sites, as an example. In addition, users are comfortable with apps using password access but are not willing to spend too much effort in creating accounts. Moreover, inconsistent or inappropriate results or advice may lead to the removal of a certain app. Still related to technical aspects, users expect that the app will not consume excessive space and memory and that it can run in background without affecting other smartphone functionalities [, ].
Another important point is that users are willing to receive a reasonable number of notifications about their current state, mostly positive recommendations. The possibility to choose the frequency and timing of notifications is a feature that is interesting to them . On the other hand, users are also interested in setting personal goals and achieving them. This shows that a challenge or gamification feature is prone to increase the users’ engagement [ , ].
Considering the described challenges and possible concerns, the developed systems referred in this systematic review still face some limitations that need to be overcome to meet users’ expectations and needs. First of all, validation of monitoring systems is one of the most important phases, and the systems should be tested with a sample of population highly representative of the target population for a sufficient period to collect enough data and produce results as accurate as possible. Among the selected papers, 71.1% (84/118) asked up to only 50 participants to test the developed system, and about 17.7% (21/118) of the selected papers tested their system for 1 to 3 weeks, which seems to be a short period to ensure reasonable results to make sure users are confident on using available solutions. In addition, some of the proposed systems developed models too personalized for specific populations, which may produce inaccurate results when using the system with other populations. Furthermore, the main advantage of using smartphones as a data collector is its unobtrusiveness. However, 43.2% (51/118) of the selected papers require users to keep the smartphone near them or use it on a specific body position such as hand, chest, or trouser pocket. Privacy and battery levels are other 2 aspects that need to be considered when developing monitoring systems and that make users more confident when using such systems. In fact, users insist on maintaining a good battery level despite the use of several smartphone sensors and expect that their data will be securely stored.
This review points out that smartphones may have the potential to collect health-related data and provide useful feedback to users about their health conditions. Despite the growing interest and ongoing maturation, monitoring systems may still need to be improved to attract a more diversified type of users and meet their expectations. Besides above-mentioned needs and concerns, more questions may be raised by the use of smartphones in health monitoring. In fact, at present, smartphones are used worldwide, but younger population are more comfortable using them. Health monitoring systems may be very useful to older populations, but smartphones may not be an easy and adaptable tool to them. In addition, these systems may attract more people with diagnosed diseases and specific goals, such as monitoring behaviors, controlling pulse rate, or improving their fitness, than to people with no specific goal in mind. Finally, a disadvantage of such systems is that when the users are familiar with them or have achieved their personal goals, they may not use the developed system anymore.
In recent years, the capabilities of smartphones have made it possible to detect and monitor health-related behaviors of their users. Smartphones are easy to use, unobtrusive, familiar, and cheap compared with more traditional monitoring methods and come with many sensors that allow the continuous collection of health-related data, without directly interfering with users’ daily activities.
As demonstrated by this systematic review, the monitoring of health and well-being of users using a smartphone and its sensors is a promising field, hence the growing interest and ongoing maturation. Although there are a couple of predominant fields in which smartphone passive sensing contributes to the well-being of its users, considerable other domains remain underexplored. In addition, most studies focus on the prevailing use of some of the most common sensors, such as GPS or accelerometer, whereas only a handful of studies have so far explored user patterns in interaction with smartphones.
Smartphones have emerged as a good monitoring tool as they are unobtrusive, discrete, and omnipresent in today’s society and allow to continuously collect data about their users. Smartphones facilitate the diagnosis and treatment of some diseases as the care manager may have access to additional data sensed by them. Nevertheless, available solutions still present some limitations, such as privacy and battery issues, that have to be overcome to meet the users’ expectations. Finally, another aspect worth mentioning is that researchers and developers are focused on understanding what might motivate users to use such monitoring systems and arouse their confidence and long-term adherence.
This work was supported by the Integrated Programme of SR&TD “SOCA” (Reference no CENTRO-01-0145-FEDER-000010), cofunded by Centro 2020 program, Portugal 2020, European Union, through the European Regional Development Fund.
Conflicts of Interest
- Cheffena M. Fall detection using smartphone audio features. IEEE J Biomed Health Inform 2016 Dec;20(4):1073-1080. [CrossRef] [Medline]
- Huang K, Ding X, Xu J, Guanling C, Ding W. Monitoring sleep and detecting irregular nights through unconstrained smartphone sensing. : IEEE; 2015 Presented at: UIC-ATC-ScalCom; August 10-14, 2015; Beijing, China p. 36-45. [CrossRef]
- Boonstra TW, Werner-Seidler A, O'Dea B, Larsen ME, Christensen H. Smartphone app to investigate the relationship between social connectivity and mental health. Conf Proc IEEE Eng Med Biol Soc 2017 Dec;2017:287-290. [CrossRef] [Medline]
- Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009 Jul 21;6(7):e1000097 [FREE Full text] [CrossRef] [Medline]
- Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Cochrane Bias Methods Group, Cochrane Statistical Methods Group. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. Br Med J 2011 Oct 18;343:d5928 [FREE Full text] [CrossRef] [Medline]
- Shoaib M, Bosch S, Incel OD, Scholten H, Havinga PJ. Fusion of smartphone motion sensors for physical activity recognition. Sensors (Basel) 2014 Jun 10;14(6):10146-10176 [FREE Full text] [CrossRef] [Medline]
- Wang C, Zhang W. Activity recognition based on smartphone and dual-tree complex wavelet transform. : IEEE; 2015 Presented at: 2015 8th International Symposium on Computational Intelligence and Design (ISCID); December 12-15, 2015; Hangzhou, China p. 267-270.
- Arif M, Bilal M, Kattan A, Ahamed SI. Better physical activity classification using smartphone acceleration sensor. J Med Syst 2014 Sep;38(9):95. [CrossRef] [Medline]
- Spinsante S, Angelici A, Lundström J, Espinilla M, Cleland I, Nugent C. A mobile application for easy design and testing of algorithms to monitor physical activity in the workplace. Mob Inf Syst 2016;2016:1-17. [CrossRef]
- Yang HC, Li YC, Liu ZY, Qiu J. Harlib: A human activity recognition library on android. : IEEE; 2014 Presented at: 11th International Computer Conference on Wavelet Actiev Media Technology and Information Processing(ICCWAMTIP); December 19-21, 2014; Chengdu, China p. 313-315.
- Aguiar B, Silva J, Rocha T, Carneiro S, Sousa I. Monitoring physical activity and energy expenditure with smartphones. : IEEE; 2014 Presented at: IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI); June 1-4, 2014; Valencia, Spain p. 664-667.
- Li P, Wang Y, Tian Y, Zhou TS, Li JS. An automatic user-adapted physical activity classification method using smartphones. IEEE Trans Biomed Eng 2017 Dec;64(3):706-714. [CrossRef] [Medline]
- Zheng W, Yoshishara Y, Noel T, Tang D, Kubota N. Energy-efficient activity recognition on smartphone. : IEEE; 2016 Presented at: Third International Conference on Computing Measurement Control and Sensor Network (CMCSN); May 20-22, 2016; Matsue, Japan p. 1-4.
- Wan N, Lin GE, Wilson G. Addressing location uncertainties in GPS-based activity monitoring: a methodological framework. Trans GIS 2017 Aug;21(4):764-781 [FREE Full text] [CrossRef] [Medline]
- del Rosario MB, Wang K, Wang J, Liu Y, Brodie M, Delbaere K, et al. A comparison of activity classification in younger and older cohorts using a smartphone. Physiol Meas 2014 Nov;35(11):2269-2286. [CrossRef] [Medline]
- Merchán-Baeza JA, González-Sánchez M, Cuesta-Vargas AI. Using smartphones to collect quantitative data on lower limb functionality in people who have suffered a stroke. J Stroke Cerebrovasc Dis 2018 Dec;27(12):3555-3562. [CrossRef] [Medline]
- Incel OD, Ozgovde A. Arservice: a smartphone based crowd-sourced data collection and activity recognition framework. Procedia Comput Sci 2018;130:1019-1024. [CrossRef]
- Mafrur R, Nugraha IG, Choi D. Modeling and discovering human behavior from smartphone sensing life-log data for identification purpose. Hum Cent Comput Inf Sci 2015 Oct 12;5(1):31. [CrossRef]
- Lee K, Kwan MP. Physical activity classification in free-living conditions using smartphone accelerometer data and exploration of predicted results. Comput Environ Urban Syst 2018 Jan;67:124-131. [CrossRef]
- Solanas A, Batista E, Borras F, Martínez-Ballesté A, Patsakis C. Wandering analysis with mobile phones: On the relation between randomness and wandering. : IEEE; 2015 Presented at: International Conference on Pervasive and Embedded Computing and Communication Systems (PECCS); February 11-13, 2015; Angers, Loire Valley, France p. 168-173.
- Capela NA, Lemaire ED, Baddour N, Rudolf M, Goljar N, Burger H. Evaluation of a smartphone human activity recognition application with able-bodied and stroke participants. J Neuroeng Rehabil 2016 Jan 20;13:5 [FREE Full text] [CrossRef] [Medline]
- Hnoohom N, Mekruksavanich S, Jitpattanakul A. Human activity recognition using triaxial acceleration data from smartphone and ensemble learning. : IEEE; 2017 Presented at: 13th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS); December 4-7, 2017; Jaipur, India p. 408-412.
- Bort-Roig J, Puig-Ribera A, Contreras RS, Chirveches-Pérez E, Martori JC, Gilson ND, et al. Monitoring sedentary patterns in office employees: validity of an m-health tool (Walk@Work-App) for occupational health. Gac Sanit 2018;32(6):563-566 [FREE Full text] [CrossRef] [Medline]
- Juen J, Cheng Q, Prieto-Centurion V, Krishnan JA, Schatz B. Health monitors for chronic disease by gait analysis with mobile phones. Telemed J E Health 2014 Nov;20(11):1035-1041 [FREE Full text] [CrossRef] [Medline]
- Chu H, Raman V, Shen J, Kansal A, Bahl V, Choudhury RR. I am a smartphone and I know my user is driving. 2014 Presented at: Sixth International Conference on Communication Systems and Networks (COMSNETS); January 6-10, 2014; Bangalore, India p. 1-8.
- Tang Z, Guo Y, Chen X. Self-adaptive step counting on smartphones under unrestricted stepping modes. 2016 Presented at: IEEE 40th Annual Computer Software and Applications Conference (COMPSAC); June 10-14, 2016; Atlanta, USA p. 788-797.
- Khedr K, El-Sheimy N. A smartphone step counter using IMU and magnetometer for navigation and health monitoring applications. Sensors (Basel) 2017 Nov 8;17(11):2573 [FREE Full text] [CrossRef] [Medline]
- Lutrek M, Cvetkovi B, Mirchevska V, Kafal O, Romero AE, Stathis K. Recognising lifestyle activities of diabetic patients with a smartphone. : IEEE; 2015 Presented at: 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth); May 20-23, 2015; Istanbul, Turkey p. 317-324.
- Gu F, Niu J, He Z, Jin X. Familypal: An effective system for detecting family activities based on smartphone. 2017 Presented at: IEEE 15th International Conference on Industrial Informatics (INDIN); July 24-26, 2017; Emden, Germany p. 155-160.
- Madhushri P, Dzhagaryan A, Jovanov E, Milenkovic A. A smartphone application suite for assessing mobility. Conf Proc IEEE Eng Med Biol Soc 2016 Dec;2016:3117-3120. [CrossRef] [Medline]
- Lathia N, Sandstrom G, Mascolo C, Rentfrow PJ. Happier people live more active lives: using smartphones to link happiness and physical activity. PLoS One 2017;12(1):e0160589 [FREE Full text] [CrossRef] [Medline]
- Liu CT, Chan CT. Exercise performance measurement with smartphone embedded sensor for well-being management. Int J Environ Res Public Health 2016 Dec 11;13(10):1001 [FREE Full text] [CrossRef] [Medline]
- Kelly D, Curran K, Caulfield B. Automatic prediction of health status using smartphone-derived behavior profiles. IEEE J Biomed Health Inform 2017 Dec;21(6):1750-1760. [CrossRef] [Medline]
- Juen J, Cheng Q, Schatz B. A natural walking monitor for pulmonary patients using mobile phones. IEEE J Biomed Health Inform 2015 Jul;19(4):1399-1405. [CrossRef] [Medline]
- Garcia-Ceja E, Osmani V, Mayora O. Automatic stress detection in working environments from smartphones' accelerometer data: a first step. IEEE J Biomed Health Inform 2016 Dec;20(4):1053-1060. [CrossRef] [Medline]
- Ben-Zeev D, Scherer EA, Wang R, Xie H, Campbell AT. Next-generation psychiatric assessment: using smartphone sensors to monitor behavior and mental health. Psychiatr Rehabil J 2015 Sep;38(3):218-226 [FREE Full text] [CrossRef] [Medline]
- Boonstra TW, Nicholas J, Wong QJ, Shaw F, Townsend S, Christensen H. Using mobile phone sensor technology for mental health research: integrated analysis to identify hidden challenges and potential solutions. J Med Internet Res 2018 Dec 30;20(7):e10131 [FREE Full text] [CrossRef] [Medline]
- Matthews M, Abdullah S, Murnane E, Voida S, Choudhury T, Gay G, et al. Development and evaluation of a smartphone-based measure of social rhythms for bipolar disorder. Assessment 2016 Dec;23(4):472-483 [FREE Full text] [CrossRef] [Medline]
- Beiwinkel T, Kindermann S, Maier A, Kerl C, Moock J, Barbian G, et al. Using smartphones to monitor bipolar disorder symptoms: a pilot study. JMIR Ment Health 2016 Jan 6;3(1):e2 [FREE Full text] [CrossRef] [Medline]
- Maxhuni A, Muñoz-Meléndez A, Osmani V, Perez H, Mayora O, Morales EF. Classification of bipolar disorder episodes based on analysis of voice and motor activity of patients. Pervasive Mob Comput 2016 Sep;31:50-66. [CrossRef]
- Wang R, Aung MS, Abdullah S, Brian R, Campbell AT, Choudhury T, et al. Crosscheck: toward passive sensing detection of mental health changes in people with schizophrenia. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 2016 Presented at: UbiComp'16; September 12-16, 2016; Heidelberg, Germany p. 886-897.
- Saeb S, Lattie EG, Kording KP, Mohr DC. Mobile phone detection of semantic location and its relationship to depression and anxiety. JMIR Mhealth Uhealth 2017 Aug 10;5(8):e112 [FREE Full text] [CrossRef] [Medline]
- Boukhechba M, Huang Y, Chow P, Fua K, Teachman BA, Barnes LE. Monitoring social anxiety from mobilitycommunication patterns. In: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers. 2017 Presented at: UbiComp'17; September 11-15, 2017; Maui, Hawaii, USA p. 749-753.
- Ben-Zeev D, Wang R, Abdullah S, Brian R, Scherer AE, Mistler LA, et al. Mobile behavioral sensing for outpatients and inpatients with schizophrenia. Psychiatr Serv 2016 Dec 1;67(5):558-561 [FREE Full text] [CrossRef] [Medline]
- Buck B, Scherer E, Brian R, Wang R, Wang W, Campbell A, et al. Relationships between smartphone social behavior and relapse in schizophrenia: a preliminary report. Schizophr Res 2019 Jun;208:167-172. [CrossRef] [Medline]
- Farhan AA, Lu J, Bi J, Russell A, Wang B, Bamis A. Multi-view bi-clustering to identify smartphone sensing features indicative of depression. 2016 Presented at: IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE); June 27-29, 2016; Arlington, USA p. 264-273.
- Yue C, Ware S, Morillo R, Lu J, Shang C, Bi J, et al. Fusing location data for depression prediction. IEEE Trans Big Data 2018:1-1. [CrossRef]
- Boukhechba M, Daros AR, Fua K, Chow PI, Teachman BA, Barnes LE. DemonicSalmon: monitoring mental health and social interactions of college students using smartphones. Smart Health 2018 Dec;9-10:192-203. [CrossRef]
- Pratap A, Atkins DC, Renn BN, Tanana MJ, Mooney SD, Anguera JA, et al. The accuracy of passive phone sensors in predicting daily mood. Depress Anxiety 2019 Dec;36(1):72-81. [CrossRef] [Medline]
- Ben-Zeev D, Brian R, Wang R, Wang W, Campbell AT, Aung MS, et al. CrossCheck: integrating self-report, behavioral sensing, and smartphone use to identify digital indicators of psychotic relapse. Psychiatr Rehabil J 2017 Dec;40(3):266-275 [FREE Full text] [CrossRef] [Medline]
- Servia-Rodríguez S, Rachuri KK, Mascolo C, Rentfrow PJ, Lathi N, Sandstrom GM. Mobile sensing at the service of mental well-being: a large-scale longitudinal study. In: Proceedings of the 26th International Conference on World Wide Web. 2017 Presented at: WWW'17; April 3-7, 2017; Perth, Australia p. 103-112.
- Grünerbl A, Muaremi A, Osmani V, Bahle G, Ohler S, Tröster G, et al. Smartphone-based recognition of states and state changes in bipolar disorder patients. IEEE J Biomed Health Inform 2015 Jan;19(1):140-148. [CrossRef] [Medline]
- McNamara L, Ngai E. SADHealth: a personal mobile sensing system for seasonal health monitoring. IEEE Syst J 2018 Mar;12(1):30-40. [CrossRef]
- Zhang H, Gashi S, Kimm H, Hanci E, Matthews O. Moodbook: An application for continuous monitoring of social media usage and mood. In: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. 2018 Presented at: UbiComp'18; October 8-12, 2018; Singapore p. 1150-1155.
- Jeong S, Breazeal CL. Improving smartphone users' affect and wellbeing with personalized positive psychology interventions. In: Proceedings of the Fourth International Conference on Human Agent Interaction. 2016 Presented at: HAI'16; October 4-7, 2016; Singapore p. 131-137.
- Wang R, Campbell AT, Zhou X. Using opportunistic face logging from smartphone to infer mental health: challenges and future directions. In: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers. 2015 Presented at: UbiComp/ISWC'15 Adjunct; September 7-11, 2015; Osaka, Japan p. 683-692.
- Shapsough S, Hesham A, Elkhorazaty Y, Zualkerman IA, Aloul F. Emotion recognition using mobile phones. 2016 Presented at: IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom); September 14-16, 2016; Munich, Germany p. 1-6.
- Triguero-Mas T, Donaire-Gonzalez D, Seto E, Valentín A, Martínez D, Smith G, et al. Natural outdoor environments and mental health: Stress as a possible mechanism. Environ Res 2017 Dec;159:629-638. [CrossRef] [Medline]
- Saeb S, Zhang M, Karr CJ, Schueller SM, Corden ME, Kording KP, et al. Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: an exploratory study. J Med Internet Res 2015 Jul 15;17(7):e175 [FREE Full text] [CrossRef] [Medline]
- Wahle F, Kowatsch T, Fleisch E, Rufer M, Weidt S. Mobile sensing and support for people with depression: a pilot trial in the wild. JMIR Mhealth Uhealth 2016 Sep 21;4(3):e111 [FREE Full text] [CrossRef] [Medline]
- Teles AS, Rocha A, da Silva E Silva FJ, Lopes JC, O'Sullivan D, van de Ven P, et al. Enriching mental health mobile assessment and intervention with situation awareness. Sensors (Basel) 2017 Jan 10;17(1):127 [FREE Full text] [CrossRef] [Medline]
- Ng JKY, Wang J, Lam KL, Kam CH, Han S. Capturing and analyzing pervasive data for smart health. 2017 Presented at: IEEE 28th International Conference on Advanced Information Networking and Applications; May 13-16, 2014; Taipei, Taiwan p. 985-992.
- Sahiti K, Kalanadhabhatta LM, Bhunia SS, Singhal A, Majethia R. Smartphone-based qualitative analyses of social activities during family time. In: Proceedings of the First International Workshop on Human-centered Sensing, Networking, and Systems. 2017 Presented at: HumanSys'17; November 5, 2017; Delft, Netherlands p. 47-54.
- Huang Y, Xiong H, Leach K, Zhang Y, Chow P, Fua K, et al. Assessing social anxiety using gps trajectoriespoint-of-interest data. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 2016 Presented at: UbiComp'16; September 12-16, 2016; Heidelberg, Germany p. 898-90e.
- Luo L, Yang J, Bao X, Yan Z, Jiang Y. SWAN: A novel mobile system to track and analyze social well-being. In: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers. 2015 Presented at: UbiComp/ISWC'15 Adjunct; September 7-11, 2015; Osaka, Japan p. 703-712.
- Rute S, Firdose S, Lopes LA, Moreira W, Mendes P. NSense: A people centric, non-intrusive opportunistic sensing tool for contextualizing nearness. 2016 Presented at: IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom); September 14-16, 2016; Munich, Germany p. 1-6.
- Singh VK, Goyal R, Wu S. Riskalyzer: inferring individual risk-taking propensity using phone metadata. Proc ACM Interact Mob Wearable Ubiquitous Technol 2018 Mar 26;2(1):1-21. [CrossRef]
- Bati GF, Singh VK. “Trust Us”: Mobile Phone Use Patterns Can Predict Individual Trust Propensity. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 2018 Presented at: CHI'18; April 21-26, 2018; Montreal, Canada p. 330.
- Pulekar G, Agu E. Autonomously sensing loneliness and its interactions with personality traits using smartphones. 2016 Presented at: IEEE Healthcare Innovation Point-Of-Care Technologies Conference (HI-POCT); November 9-11, 2016; Cancun, Mexico p. 134-137.
- Saeb S, Cybulski TR, Schueller SM, Kording KP, Mohr DC. Scalable passive sleep monitoring using mobile phones: opportunities and obstacles. J Med Internet Res 2017 Dec 18;19(4):e118 [FREE Full text] [CrossRef] [Medline]
- Montanini L, Sabino N, Spinsante S, Gambio E. Smartphone as unobtrusive sensor for real-time sleep recognition. 2018 Presented at: IEEE International Conference on Consumer Electronics (ICCE); January 12-14, 2018; Las Vegas, USA p. 1-4.
- Sarda A, Munuswamy S, Sarda S, Subramanian V. Using passive smartphone sensing for improved risk stratification of patients with depression and diabetes: crosssectional observational study. JMIR Mhealth Uhealth 2019 Jan 29;7(1):e11041 [FREE Full text] [CrossRef] [Medline]
- Lin HY, Wong BY, Lin SH, Chiu YC, Pan YC, Lee YH. Development of a mobile application (App) to delineate "digital chronotype" and the effects of delayed chronotype by bedtime smartphone use. J Psychiatr Res 2019 Mar;110:9-15. [CrossRef] [Medline]
- Nakano H, Hirayama K, Sadamitsu Y, Toshimitsu A, Fujita H, Shin S, et al. Monitoring sound to quantify snoring and sleep apnea severity using a smartphone: proof of concept. J Clin Sleep Med 2014 Jan 15;10(1):73-78 [FREE Full text] [CrossRef] [Medline]
- Staples P, Torous J, Barnett I, Carlson K, Sandoval L, Keshavan M, et al. A comparison of passive and active estimates of sleep in a cohort with schizophrenia. NPJ Schizophr 2017 Oct 16;3(1):37 [FREE Full text] [CrossRef] [Medline]
- DeMasi O, Feygin S, Dembo A, Aguilera A, Recht B. Well-being tracking via smartphone-measured activity and sleep: cohort study. JMIR Mhealth Uhealth 2017 Oct 5;5(10):e137 [FREE Full text] [CrossRef] [Medline]
- Lane ND, Lin M, Mohammod M, Yang X, Lu H, Cardone G, et al. BeWell: sensing sleep, physical activities and social interactions to promote wellbeing. Mobile Netw Appl 2014 Jan 9;19(3):345-359. [CrossRef]
- Aslam H, Mukhtar H, Seemi F, Belaid D. Harnessing smartphones as a personal informatics tool towards self-awareness and behavior improvement. 2016 Presented at: IEEE 14th Inernational Conference on Dependable, Autonomic and Secure Computing, 14th International Conference on Pervasive Intelligence and Computing, 2nd International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech); August 8-12, 2016; Auckland, New Zealand p. 467-474.
- Mo X, Shi D, Yang R, Li H, Tong ZH, Wang F. A framework of fine-grained mobile sensing data collection and behavior analysis in an energy-configurable way. 2015 Presented at: IEEE International Conference on Smart City/SocialCom/SustainCom (SmartCity); December 19-21, 2015; Chengdu, China p. 391-398.
- DeMasi O, Recht B. A step towards quantifying when an algorithm cancannot predict an individual's wellbeing. In: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers. 2017 Presented at: UbiComp'17; September 11-15, 2017; Maui, Hawaii, USA p. 763-771.
- Siddiqui SA, Zhang Y, Feng Z, Kos A. A pulse rate estimation algorithm using ppg and smartphone camera. J Med Syst 2016 May;40(5):126. [CrossRef] [Medline]
- Huang RY, Dung LR. Measurement of heart rate variability using off-the-shelf smart phones. Biomed Eng Online 2016 Jan 29;15:11 [FREE Full text] [CrossRef] [Medline]
- García-Magariño I, Medrano C, Plaza I, Oliván B. A smartphone-based system for detecting hand tremors in unconstrained environments. Pers Ubiquit Comput 2016 Sep 8;20(6):959-971. [CrossRef]
- Kostikis N, Hristu-Varsakelis D, Arnaoutoglou M, Kotsavasiloglou C. A smartphone-based tool for assessing Parkinsonian hand tremor. IEEE J Biomed Health Inform 2015 Nov;19(6):1835-1842. [CrossRef] [Medline]
- Lipsmeier F, Taylor KI, Kilchenmann T, Wolf D, Scotland A, Schjodt-Eriksen J, et al. Evaluation of smartphone-based testing to generate exploratory outcome measures in a phase 1 Parkinson's disease clinical trial. Mov Disord 2018 Dec;33(8):1287-1297 [FREE Full text] [CrossRef] [Medline]
- Liddle J, Ireland D, McBride SJ, Brauer SG, Hall LM, Ding H, et al. Measuring the lifespace of people with Parkinson's disease using smartphones: proof of principle. JMIR Mhealth Uhealth 2014 Mar 12;2(1):e13 [FREE Full text] [CrossRef] [Medline]
- Wang R, Chen F, Chen Z, Li T, Harari G, Tignor S, et al. StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 2014 Presented at: UbiComp'14; September 13-17, 2014; Seattle, USA p. 3-14.
- Wang R, Harari G, Hao P, Zhou X, Cambpell AT. Smartgpa: how smartphones can assess and predict academic performance of college students. In: Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing. 2015 Presented at: UbiComp'15; September 7-11, 2015; Osaka, Japan p. 295-306.
- Baras K, Soares L, Paulo N, Barros R. 'Smartphine': supporting students' well-being according to their calendar and mood. 2016 Presented at: International Multidisciplinary Conference on Computer and Energy Science (SpliTech); July 13-15, 2016; Split, Croatia p. 1-7.
- Tseng VW, Merrill M, Wittleder F, Abdullah S, Aung MH, Choudhury T. Assessing mental health issues on college campuses: preliminary findings from a pilot study. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. 2016 Presented at: UbiComp'16; September 12-16, 2016; Heidelberg, Germany p. 1200-1208.
- Hossain A, Poellabauer C. Challenges in building continuous smartphone sensing applications. 2016 Presented at: IEEE 12th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob); October 17-19, 2016; New York, USA p. 1-8.
- Vhaduri S, Munch A, Poellabauer C. Assessing health trends of college students using smartphones. 2016 Presented at: IEEE Healthcare Innovation Point-Of-Care Technologies Conference (HI-POCT); November 9-11, 2016; Cancun, Mexico p. 70-73.
- Harari GM, Gosling SD, Wang R, Chen F, Chen Z, Campbell AT. Patterns of behavior change in students over an academic term: a preliminary study of activity and sociability behaviors using smartphone sensing methods. Comput Hum Behav 2017 Feb;67:129-138. [CrossRef]
- Chen F, Wang R, Zhou X, Campbell AT. Department of Computer Science - Dartmouth College. 2014. My smartphone knows I am hungry URL: https://home.cs.dartmouth.edu/~xia/papers/wpa14.pdf
- Barbosa R, Nunes D, Figueira A, Aguiar H, Silva JS, Gonzalez F, et al. An architecture for emotional smartphones in Internet of Things. 2016 Presented at: IEEE Ecuador Technical Chapters Meeting (ETCM); October 12-14, 2016; Guayaquil, Equador p. 1-5.
- Vathsangam H, Sukhatme GS. Using phone-based activity monitors to promote physical activity in older adults: a pilot study. 2014 Presented at: IEEE Healthcare Innovation Conference (HIC); October 8-10, 2014; Seattle, USA p. 42-47.
- Kelly D, Donnelly S, Caulfield B. Smartphone derived movement profiles to detect changes in health status in COPD patients - a preliminary investigation. Conf Proc IEEE Eng Med Biol Soc 2015 Dec;2015:462-465. [CrossRef] [Medline]
- Nambi AU, Bannur S, Mehta I, Kalra H, Virmani A, Padmanabhan VN, et al. HAMS: Driver and Driving Monitoring using a Smartphone. In: Proceedings of the 24th Annual International Conference on Mobile Computing and Networking. 2018 Presented at: MobiCom'18; October 29-November 2, 2018; New Delhi, India p. 840-842.
- Kau LJ, Chen CS. A smart phone-based pocket fall accident detection, positioning, and rescue system. IEEE J Biomed Health Inform 2015 Jan;19(1):44-56. [CrossRef] [Medline]
- Sie MR, Lo SC. The design of a smartphone-based fall detection system. 2015 Presented at: IEEE 12th International Conference on Networking, Sensing and Control; April 9-11, 2015; Taipei, Taiwan p. 456-461.
- Vermeulen J, Willard S, Aguiar B, De Witte LP. Validity of a smartphone-based fall detection application on different phones worn on a belt or in a trouser pocket. Assist Technol 2015;27(1):18-23. [CrossRef] [Medline]
- Sansrimahachai W, Toahchoodee M, Piakaew R, Vijitphu T, Jeenboonmee S. Real-time fall risk assessment system based on acceleration data. 2017 Presented at: International Conference on Orange Technologies (ICOT); December 8-10, 2017; Singapore p. 33-36.
- Chow KK, Leong BD, Lee BY. Imagining consequences of excessive smartphone use via a character-based mobile application. Int J Ment Health Addiction 2018 Nov 20;16(6):1420-1434. [CrossRef]
- Fasoulis A, Virvou M, Tsihrintzis G, Patsakis C, Alepis E. Sensus vox: Sentiment mapping through smartphone multi-sensory crowdsourcing. 2018 Presented at: IEEE 30th International Conference on Tools with Artificial Intelligence (ICTAI); November 5-7, 2018; Portland, Oregon, USA p. 438-444.
- Bati GF, Singh VK. Are you altruistic? Your mobile phone could tell. 2017 Presented at: IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI); August 4-8, 2017; San Francisco, CA, USA p. 1-6.
- Wang R, Scherer EA, Walsh M, Wang W, Aung MH, Ben-Zeev D, et al. Predicting symptom trajectories of schizophrenia using mobile sensing. Proc ACM Interact Mob Wearable Ubiquitous Technol 2018 Sep 5;22(2):32-37. [CrossRef]
- Asensio-Cuesta S, Sánchez-García Á, Conejero JA, Saez C, Rivero-Rodriguez A, García-Gómez JM. Smartphone sensors for monitoring cancer-related quality of life: app design, EORTC QLQ-C30 mapping and feasibility study in healthy subjects. Int J Environ Res Public Health 2019 Dec 5;16(3):461 [FREE Full text] [CrossRef] [Medline]
- Ferdous R, Osmati V, Mayora O. Smartphone app usage as a predictor of perceived stress levels at workplace. 2015 Presented at: 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth); May 20-23, 2015; Istanbul, Turkey p. 225-228.
- Rapeepisarn T, Tatiyanupanwong S, Kornvisitvatin B, Tangsripairoj S. iRelief: an android application for smartphone syndrome prevention and treatment. 2016 Presented at: IEEE 5th ICT International Student Project Conference (ICT-ISPC); May 27-28, 2016; Nakhon Pathom, Thailand p. 121-124.
- Kanjo E, Kuss DJ, Ang CS. NotiMind: utilizing responses to smart phone notifications as affective sensors. IEEE Access 2017;5:22023-22035. [CrossRef]
- Gu F, Kealy A, Khoshelham K, Shang J. User-independent motion state recognition using smartphone sensors. Sensors (Basel) 2015 Dec 4;15(12):30636-30652 [FREE Full text] [CrossRef] [Medline]
- Weiss GM, Lockhart JW, Pulickal TT, McHugh T, Ronan IH, Timko JL. Actitracker: a smartphone-based activity recognition system for improving health and well-being. 2016 Presented at: IEEE International Conference on Data Science and Advanced Analytics (DSAA); October 17-19, 2016; Montreal, Canada p. 682-688.
- Mukherjee A, Misra S, Mangrulkar P, Rajarajan M, Rahulamathavan Y. SmartARM: a smartphone-based group activity recognition and monitoring scheme for military applications. 2017 Presented at: IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS); December 17-20, 2017; Bhubaneswar, Odisha, India p. 1-6.
- Wu T, Wang L, Zheng Z, Wu S, Ma J, Tao X, et al. Carmus: Towards a general framework for continuous activity recognition with missing values on smartphones. 2018 Presented at: IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC); July 23-27, 2018; Tokyo, Japan p. 850-859.
- Canzian L, Musolesi M. Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 2015 Presented at: UbiComp'15; September 7-11, 2015; Osaka, Japan p. 1293-1304.
- Wan N, Lin G. Classifying human activity patterns from smartphone collected GPS data: A fuzzy classification and aggregation approach. Trans GIS 2016 Dec;20(6):869-886 [FREE Full text] [CrossRef] [Medline]
- Goodspeed R, Yan X, Hardy J, Vydiswaran VG, Berrocal VJ, Clarke P, et al. Comparing the data quality of global positioning system devices and mobile phones for assessing relationships between place, mobility, and health: field study. JMIR Mhealth Uhealth 2018 Aug 13;6(8):e168 [FREE Full text] [CrossRef] [Medline]
- Cheng Q, Juen J, Schatz BR. Using mobile phones to simulate pulse oximeters: gait analysis predicts oxygen saturation. In: Proceedings of the 5th ACM Conference on Bioinformatics, Computational Biology, and Health Informatics. 2014 Presented at: BCB'14; September 20-23, 2014; Newport Beach, CA, USA p. 331-340.
- Azam MA, Shahzadi A, Khalid A, Anwar SM, Naeem U. Smartphone based human breath analysis from respiratory sounds. Conf Proc IEEE Eng Med Biol Soc 2018 Dec;2018:445-448. [CrossRef] [Medline]
- Jannetts S, Schaeffler F, Beck J, Cowen S. Assessing voice health using smartphones: bias and random error of acoustic voice parameters captured by different smartphone types. Int J Lang Commun Disord 2019 Mar;54(2):292-305. [CrossRef] [Medline]
- Faurholt-Jepsen M, Bauer M, Kessing LV. Smartphone-based objective monitoring in bipolar disorder: status and considerations. Int J Bipolar Disord 2018 Jan 23;6(1):6 [FREE Full text] [CrossRef] [Medline]
- Rajagopalan A, Shah P, Zhang MW, Ho RC. Digital platforms in the assessment and monitoring of patients with bipolar disorder. Brain Sci 2017 Nov 12;7(11):150 [FREE Full text] [CrossRef] [Medline]
- Batra S, Baker RA, Wang T, Forma F, DiBiasi F, Peters-Strickland T. Digital health technology for use in patients with serious mental illness: a systematic review of the literature. Med Devices (Auckl) 2017;10:237-251 [FREE Full text] [CrossRef] [Medline]
- Dogan E, Sander C, Wagner X, Hegerl U, Kohls E. Smartphone based monitoring of objective and subjective data in affective disorders: where are we and where are we going? Systematic review. J Med Internet Res 2017 Dec 24;19(7):e262 [FREE Full text] [CrossRef] [Medline]
- Areàn PA, Hoa Ly K, Andersson G. Mobile technology for mental health assessment. Dialogues Clin Neurosci 2016 Dec;18(2):163-169 [FREE Full text] [Medline]
- Þórarinsdóttir H, Kessing LV, Faurholt-Jepsen M. Smartphone-based self- assessment of stress in healthy adult individuals: a systematic review. J Med Internet Res 2017 Dec 13;19(2):e41 [FREE Full text] [CrossRef] [Medline]
- Nguyen HN, Silva JN. Use of smartphone technology in cardiology. Trends Cardiovasc Med 2016 May;26(4):376-386. [CrossRef] [Medline]
- Ko PR, Kientz JA, Choe EY, Kay M, Landis CA, Watson NF. Consumer sleep technologies: a review of the landscape. J Clin Sleep Med 2015 Dec 15;11(12):1455-1461 [FREE Full text] [CrossRef] [Medline]
- Thomas JG, Bond DS. Review of innovations in digital health technology to promote weight control. Curr Diab Rep 2014;14(5):485. [CrossRef] [Medline]
- Kim BY, Lee J. Smart devices for older adults managing chronic disease: a scoping review. JMIR Mhealth Uhealth 2017 May 23;5(5):e69 [FREE Full text] [CrossRef] [Medline]
- Cornet VP, Holden RJ. Systematic review of smartphone-based passive sensing for health and wellbeing. J Biomed Inform 2018 Dec;77:120-132 [FREE Full text] [CrossRef] [Medline]
- Harari GM, Lane ND, Wang R, Crosier BS, Campbell AT, Gosling SD. Using smartphones to collect behavioral data in psychological science: practical considerations and challenges. Perspect Psychol Sci 2016 Dec;11(6):838-854 [FREE Full text] [CrossRef] [Medline]
- Dennison L, Morrison L, Conway G, Yardley L. Opportunities and challenges for smartphone applications in supporting health behavior change: qualitative study. J Med Internet Res 2013 Apr 18;15(4):e86 [FREE Full text] [CrossRef] [Medline]
- Torous J, Friedman R, Keshavan M. Smartphone ownership and interest in mobile applications to monitor symptoms of mental health conditions. JMIR Mhealth Uhealth 2014 Jan 21;2(1):e2 [FREE Full text] [CrossRef] [Medline]
- Harari GM, Müller S, Mishra V, Wang R, Campbell AT, Rentfrow PJ, et al. An evaluation of students' interest in and compliance with self- tracking methods: recommendations for incentives based on three smartphone sensing studies. Soc Psychol Personal Sci 2017 Jul 18;8(5):479-492. [CrossRef]
- Anderson K, Burford O, Emmerton L. Mobile health apps to facilitate self-care: a qualitative study of user experiences. PLoS One 2016;11(5):e0156164 [FREE Full text] [CrossRef] [Medline]
|GPS: global positioning system|
|PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses|
Edited by G Eysenbach; submitted 30.10.18; peer-reviewed by A Pereira, D Revere, T Wang, E Kohls; comments to author 04.02.19; revised version received 24.05.19; accepted 28.05.19; published 23.08.19
©Alina Trifan, Maryse Oliveira, José Luís Oliveira. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 23.08.2019.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.