This paper is in the following e-collection/theme issue:

Wearable Devices and Sensors (788) mHealth for Data Collection and Research (867) GIS (Geographic Information Systems) Applications in Public Health and Spatial Epidemiology (82) Fitness Trackers and Smart Pedometers/Accelerometers (534) Ecological Momentary Assessment (EMA) (288)

Published on in Vol 6, No 8 (2018): August

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/9771, first published .
Comparing the Data Quality of Global Positioning System Devices and Mobile Phones for Assessing Relationships Between Place, Mobility, and Health: Field Study

Comparing the Data Quality of Global Positioning System Devices and Mobile Phones for Assessing Relationships Between Place, Mobility, and Health: Field Study

Comparing the Data Quality of Global Positioning System Devices and Mobile Phones for Assessing Relationships Between Place, Mobility, and Health: Field Study

Authors of this article:

Robert Goodspeed1 Author Orcid Image ;   Xiang Yan1 Author Orcid Image ;   Jean Hardy2 Author Orcid Image ;   VG Vinod Vydiswaran2, 3 Author Orcid Image ;   Veronica J Berrocal4 Author Orcid Image ;   Philippa Clarke5, 6 Author Orcid Image ;   Daniel M Romero2 Author Orcid Image ;   Iris N Gomez-Lopez6 Author Orcid Image ;   Tiffany Veinot2, 7 Author Orcid Image
Article Authors Cited by (15) Tweetations (17) Metrics

    Original Paper

    1Urban and Regional Planning Program, Taubman College of Architecture and Urban Planning, University of Michigan, Ann Arbor, MI, United States

    2School of Information, University of Michigan, Ann Arbor, MI, United States

    3Department of Learning Health Sciences, Medical School, University of Michigan, Ann Arbor, MI, United States

    4Department of Biostatistics, School of Public Health, University of Michigan, Ann Arbor, MI, United States

    5Department of Epidemiology, School of Public Health, University of Michigan, Ann Arbor, MI, United States

    6Institute for Social Research, University of Michigan, Ann Arbor, MI, United States

    7Department of Health Behavior and Health Education, School of Public Health, University of Michigan, Ann Arbor, MI, United States

    Corresponding Author:

    Robert Goodspeed, PhD

    Urban and Regional Planning Program

    Taubman College of Architecture and Urban Planning

    University of Michigan

    2000 Bonisteel Blvd

    Ann Arbor, MI, 48109

    United States

    Phone: 1 734 615 7254

    Email: rgoodspe@umich.edu


    Background: Mobile devices are increasingly used to collect location-based information from individuals about their physical activities, dietary intake, environmental exposures, and mental well-being. Such research, which typically uses wearable devices or mobile phones to track location, benefits from the growing availability of fine-grained data regarding human mobility. However, little is known about the comparative geospatial accuracy of such devices.

    Objective: In this study, we compared the data quality of location information collected from two mobile devices that determine location in different ways—a global positioning system (GPS) watch and a mobile phone with Google’s Location History feature enabled.

    Methods: A total of 21 chronically ill participants carried both devices, which generated digital traces of locations, for 28 days. A mobile phone–based brief ecological momentary assessment (EMA) survey asked participants to manually report their location at 4 random times throughout each day. Participants also took part in qualitative interviews and completed surveys twice during the study period in which they reviewed recent mobile phone and watch trace data to compare the devices’ trace data with their memory of their activities on those days. Trace data from the devices were compared on the basis of (1) missing data days, (2) reasons for missing data, (3) distance between the route data collected for matching day and the associated EMA survey locations, and (4) activity space total area and density surfaces.

    Results: The watch resulted in a much higher proportion of missing data days (P<.001), with missing data explained by technical differences between the devices as well as participant behaviors. The mobile phone was significantly more accurate in detecting home locations (P=.004) and marginally more accurate (P=.07) for all types of locations combined. The watch data resulted in a smaller activity space area and more accurately recorded outdoor travel and recreation.

    Conclusions: The most suitable mobile device for location-based health research depends on the particular study objectives. Furthermore, data generated from mobile devices, such as GPS phones and smartwatches, require careful analysis to ensure quality and completeness. Studies that seek precise measurement of outdoor activity and travel, such as measuring outdoor physical activity or exposure to localized environmental hazards, would benefit from the use of GPS devices. Conversely, studies that aim to account for time within buildings at home or work, or those that document visits to particular places (such as supermarkets, medical facilities, or fast food restaurants), would benefit from the greater precision demonstrated by the mobile phone in recording indoor activities.

    JMIR Mhealth Uhealth 2018;6(8):e168

    doi:10.2196/mhealth.9771

    Keywords

    urban population; spatial behavior; mobile phone; environment and public health; data accuracy 


    Background

    Significant relationships between health and the places in which we live and work are now widely acknowledged, with associations having been found for health behaviors ranging from diet to physical activity to the use of health care services [1,2]. In addition, location-based data acquired from mobile devices can be used to assess physical activity [3], exposures to hazardous substances [4], and symptoms of mental health conditions such as depression [5-8]. Accordingly, there is growing interest in the use of location-tracking devices as a data collection tool for health research.

    Researchers investigating relationships between health, place, and mobility require location-tracking devices, which are both acceptable to users and accurate. To date, a variety of pilot and feasibility studies have examined user acceptance of devices such as wearable activity trackers [9,10], dedicated global positioning system (GPS) devices [11], and GPS-enabled mobile phones [12,13]. Although this research generally shows reasonable acceptance among varied user groups, there remain gaps in understanding the spatial accuracy of each of these devices, particularly those that are available on the consumer market and thus could facilitate population-level research. Therefore, building on prior health informatics research examining the accuracy of other types of devices used in research [14,15], we compared the accuracy of two widely available location-tracking devices that determine location using two different technical approaches (described further below).

    One of the key approaches adopted in health research that uses location-tracking data focuses on characterizing the spaces in which participants typically spend their time; this is typically used to overcome the limitations of determining participant location solely based on the place of residence [16]. This is important as recent research has shown that environmental characteristics of such nonresidential places are associated with health-related outcomes, such as self-rated health [17] and dietary intake [18-20]. Therefore, a growing number of studies on health, place, and mobility are using an analytical approach that involves constructing an activity space for each participant (eg, [21-24]). This concept, proposed by space-time geographers, describes the portion of the environment actually used by an individual to fulfill activities and travel between locations [25-27].

    Activity space construction requires detailed spatial information from participants, ideally records of travel through the environment collected in real time. Accordingly, researchers have used GPS devices to study the relationship between the environment and physical activity [28] and food environments and eating [29]. However, GPS devices pose a set of well-known research challenges: commercially available devices can have limited battery life and nonintuitive interfaces, are often physically bulky, and lose satellite signals indoors or in dense urban environments [30-32]. Mobile phones offer one potential alternative to dedicated GPS devices; they provide integrated location services through a combination of GPS, cellular tower triangulation, and geolocation of Wi-Fi networks. As mobile phone location information is acquired through multiple methods, these devices work in a variety of physical contexts and may result in more accurate data about activities taking place within and close to buildings. In addition, mobile phones may have other benefits such as greater acceptability by study participants which, in turn, may reduce data loss [13]. Although dedicated apps can collect location data, Android devices can record location information automatically via the integrated Google Location History feature, making the collection and analysis of mobility data feasible at the population level. Tracking studies such as this one raise important ethical concerns, such as those around the privacy of the data collected [33]. As described further below, we took typical steps to obtain informed consent and protect the privacy of the data collected. Although privacy is not the primary focus of this study, we briefly comment on this issue in the Discussion.

    Objectives

    In this study, we evaluated the quality of location data generated from mobile phones and a wearable GPS device, providing a novel direct comparison. The three specific comparative aspects of the mobile devices that we examined in this study were (1) data loss experienced, (2) accuracy of the gathered data, and (3) activity spaces generated using the data. We focused on people with diabetes, hypertension, and chronic kidney disease as spatially sensitive health behaviors such as physical activity, diet, medication, and health care appointment adherence are important drivers of outcomes in people with these conditions (eg, [34-36]).


    Participant Recruitment

    This study was conducted as part of a larger research project focused on big data methods for characterizing the relationship between place of residence and health, with a focus on new data sources such as social media [37,38] and location tracking using mobile devices. This study focused on diabetes, hypertension, and kidney disease, as these conditions often co-occur [39] and have outcomes that are influenced by health behaviors such as eating, physical activity, and treatment adherence [40-42]. Moreover, prior research has shown that these behaviors are related to neighborhood contextual features such as the food environment, physical activity resources, and local health care services [43-47]. Accordingly, location-tracking devices hold particular promise for studying the relationship between place, health behavior, and health outcomes in this patient group. Participants were recruited through a university portal for research participants at the University of Michigan. Eligible participants were 18 years or older and self-reported at least one of these conditions.

    Device Deployment

    Participants were provided with two consumer-oriented location-tracking mobile devices to carry for 28 days, although some kept the devices for longer based on our ability to schedule a final interview with them. We selected two mobile devices for this study—a GPS-enabled device and a mobile phone with location tracking enabled. The GPS device used was a Garmin fēnix 2 GPS Watch (henceforth referred to as the watch), whereas the mobile phone was a Samsung Galaxy S5 (henceforth referred to as the phone). As the phone is an Android device, it has an integrated Google Location History feature that was enabled to track locations as part of the study. These devices were chosen to represent consumer-oriented technologies that are widely available at reasonable price-points (US $399 for the watch and US $650 for the mobile phone without a contract) and that use the two prevalent methods of determining user location: GPS satellites as opposed to mobile phones’ use of a combination of cellular towers, Wi-Fi networks, and GPS triangulation.

    Participants were asked to keep the devices switched on for at least 8 hours daily, ideally from the time they awoke until they went to bed. Each device was enabled to capture digital traces of participant location. The watch was set to the Smart default-sampling rate, which records data every 4 to 7 seconds. According to product forums, the sampling rate for Location History is variable and depends on factors such as the strength of available signals, battery strength, and whether the Google Maps app is running in the foreground or background. They were asked to keep the devices charged and synchronize data from the watch to the mobile phone every day. Participants were trained in the use of the devices and were given instruction cards as a follow-up reminder. They were also given a phone number for the technical support provided by the research team, and the devices were returned at the end of the study. Participants earned US $3.57 for each day of data they uploaded, up to a maximum of US $100 for the full 28 days. The study received ethical approval from the Health Sciences and Behavioral Sciences Institutional Review Board at the University of Michigan (HUM00098270).

    Data Collection Methods

    In addition to the spatial information, a brief ecological momentary assessment (EMA) survey configured using the Personal Analytics Companion (PACO) software for Android phones presented two free-text survey questions to participants at 4 random times in a given day: “where are you?” and “what are you doing?” and prompted participants to take a photograph of their location using the mobile phone. Participants also took part in qualitative interviews and completed surveys twice during the study period—once after the first 14 days and then at the end of the 28-day period. In these two interviews, participants were asked about their experience using the devices and to review the phone and watch trace data on Web-based platforms designed for this purpose (Google Maps and the online website, Garmin Connect) for the 2-4 most recent days (the range depended on whether data were missing for recent days) and to compare the data with their memory of their activities on those days. Data were collected from summer to fall of 2015.

    Analysis Methods

    The analyses presented here rely on three data sources: (1) digital location information logged by each device, (2) results of the brief EMA survey that inquired about participants’ locations and activities, and (3) interview results concerning reasons for data loss. The phone data resulted in a line representing travel routes, with selected points recorded along the route corresponding to destinations. On the other hand, the watch data consisted of a route and regular waypoints. Due to this difference, only the route (or trace) information from each device was used in this analysis. Points contained in the Keyhole Markup Language files that are exported from the Google Location History service are named according to the assumed mode of travel (eg, “Walking,” “Driving”) or specific destination (eg, “Olson Park”) assigned to the user by Google’s software. In addition, additional information such as raw data can be viewed, but not downloaded, on the Location History website. Either may be useful for researchers. Without waypoints for the phone data, standard smoothing techniques could not be applied to the phone data.

    Missing Data Analysis

    Although participants were asked to carry both devices for 28 days, the number of days in which they acquired 8 hours of data varied. Data completeness was evaluated by calculating the proportion of missing data days, defined as the number of days in which the participant did not collect 8 hours of data divided by the participant’s number of days in the study. As an additional measure of the amount of data collected, the number of days where any spatial information was collected was also reported.

    The interview data containing user evaluations of the accuracy of the data contained user reflections on reasons for missing or incorrect data, which were coded using structural coding [48]. These coded data were compared with trace data for each participant for whom there was missing data, to identify the reasons for the specific missing data episodes. These reasons were then grouped into descriptive categories [48].

    Geographic Information System Data Procedures

    As described, the EMA surveys included a free-text field for the participants’ current location. Among the survey responses, 30.4% could be converted into a street address, including the terms “home” and “work,” or another identifiable location. Other locations included a park or campsite, business, theater, home of friend, health care organization, library, church, and gym. In other cases, respondents either provided no response to the other surveys or responses which could not be mapped. This resulted in 1375 geocoded destination points. Among these, 461 were collected on days in which spatial information was available from both the devices. The distance between the route data collected for that day and the associated survey locations was then computed using the spatial join tool in ArcGIS Desktop 10.3.1. The spatial join function was run using the “closest” option, which records the nearest location feature from either the phone or watch data to the point mapped from the PACO survey responses. The mean distances were then computed for each location category and for all locations combined.

    Activity Space Analysis

    Multiple methods have been proposed for converting raw spatial information into a representation of an activity space [22], such as the use of Census Tracts [23,49], the characteristics of known destinations [24], or constructing standard deviational ellipses from location information [50,51]. Tailored approaches include travel time polygons describing an area of potential travel, road network buffers of routes to regular destinations, or daily path areas constructed from actual routes taken [18,52]. We selected the daily path method because it utilizes the detailed route information collected from the devices and results in a representation of actual (vs potential) travel during the study period.

    Therefore, an activity space was constructed using the daily path area method, which buffers digital location traces with buffer distance depending on the geographic context and study aims [18,22]. The activity space analysis was conducted for comparison days only, where data were available from both devices. The average number of days per participant was 19.2, with a range of 5 to 33. A buffer was applied to the data for those days. We used 400 m as the buffer distance because it can be considered as the minimum walking distance to reach a destination in an urban environment [53,54]. The buffer was then clipped to the participant’s home county to exclude nonroutine activities such as vacation travel. The total area of the resulting polygon was then computed. No changes or corrections to either data sources were made for this analysis, except for the removal of one obviously errant line from participant 14’s phone data, described further below.

    In the activity space analyses, a kernel density function can be used to calculate a continuous surface from a set of known locations [55]. In a geographic information system, a kernel density function calculates a magnitude-per-unit area from a point or line feature using a kernel function to fit a smoothly tapered surface. The surface resulting from this analysis can be interpreted as a probability surface similar to that presented in the study by Downs et al [56]. We used this approach because unlike the buffering method, a kernel density function takes into account multiple traces in the same area, weighing them differently depending on the shape of the density function employed and the kernel density function bandwidth. In addition, unlike the buffer that delineates a specific area, the kernel density results in a continuous representation. As our purpose was to compare the data obtained from the 2 devices, the output of this analysis shows the difference between the density maps for each device. The method included the following steps: (1) clip the trace data to the participant’s home county, (2) compute the kernel density with a search radius of 400 m, (3) rescale the values in the density surface resulting from the phone and watch data so that they total to 1, and (4) compute the difference between the density surfaces.


    Characteristics of Participants

    As shown in Table 1 below, 57% (12/21) of participants were women, and the mean participant age was 52.4 (SD 11.36) years, with a range of 33 to 74. Majority of the participants (17/21, 81%) had a bachelor’s degree or higher and just over half were employed. Two-thirds of the population were white and about one-third had another racial or ethnic identity. In this sample of chronically ill participants, 76% (16/21) had hypertension, 62% (13/21) had diabetes, and 19% (4/21) had chronic kidney disease.

    Missing Data Analysis

    As shown in Table 2, the watch resulted in a much higher proportion of missing data days, primarily because of a large number of days on which data were collected for less than 8 hours (Z=3.920, P<.001). However, considering all days with any amount of valid trace data, the phone resulted in only slightly more data than the watch (t20=0.460, P=.65).

    Interviews with the study participants revealed that the differences in missing data were explained by technical differences between the devices as well as participant behaviors. Explanations for these differences revealed in the interviews included the following: participants forgetting to initiate data collection at the beginning of the day on their GPS watch, the GPS watch not being able to locate satellites in certain buildings, removing the watch during activities participants perceived to be unsafe for the watch (eg, sports and kitchen work), and troubles syncing the watch data to the mobile phone so that it could be recorded.

    Spatial Accuracy Analysis

    The mean distance from the points obtained from self-reported participant location based on the EMA survey data and the spatial data from each device was lower for the phone than for the watch overall and for each of the four categories considered (Table 3). The destination category with the smallest distance was home, followed by business. The two devices yielded marginally significantly different mean distances for all points (P=.07). When stratified by specific categories, the only statistically significant difference between the two devices has been found for home locations (P=.004).

    Activity Space Analysis

    The resulting daily path area from the buffer analysis from both devices was much larger for the phone than for the watch. As shown in Table 4, the average activity space for the phone was 18,084.74 ha, whereas it was 10,494.57 ha for the watch. A two-sample t test with unequal variances found the difference is statistically significant at the 99% level (t20=3.164, P=.003). On average, the watch showed 42.0% fewer hectares in participants’ activity spaces.

    Table 1. Participant demographics and technology ownership (N=21).
    Characteristicsn (%)
    Gender

    		Female12 (57)

    		Male9 (43)
    Racea

    		Black or African American5 (24)

    		White or European American17 (81)

    		Native American or Native Hawaiian or Pacific Islander1 (5)

    		Other1 (5)
    Ethnicity

    		Hispanic or Latino3 (14)

    		Non-Hispanic or Latino18 (86)
    Education

    		Some college3 (14)

    		Associate’s degree1 (5)

    		Bachelor’s degree6 (29)

    		Master’s degree or PhD8 (38)

    		Professional degree (eg, JD and MD)3 (14)
    Employmenta

    		Full-time employment (30+ hours per week)8 (38)

    		Part-time employment (<30 hours per week)3 (14)

    		Student2 (9)

    		Unemployed4 (19)

    		Disabled3 (14)

    		Retired4 (19)
    Health conditionsa

    		Hypertension16 (76)

    		Diabetes13 (62)

    		Chronic kidney disease4 (19)

    aMore than one response possible.

    Table 2. Missing data analysis results.
    MeasurePhoneWatchZ valuet value (df)P value
    Proportion of missing data days (<8 hours)0.030.543.920N/Aa<.001
    Mean valid data days23.522.2N/A0.460 (20).65

    aN/A: not applicable.

    Table 3. Spatial accuracy analysis.
    CategoriesPhone distance (m), mean (SD)Watch distance (m), mean (SD)Comparison
    Nt value (df)P value
    Home24.6 (38.6)106.2 (576.9)352−2.649 (351).004
    Work2318.0 (2982.1)2831.9 (3821.7)81−0.954 (80).17
    Business694.3 (1484.5)804.2 (1549.4)19−0.315 (18).38
    Other360.4 (493.4)1240.7 (2778.8)9−0.936 (8).19
    All461.7 (1547.1)636.0 (2023.5)461−1.470 (460).07
    Table 4. Activity space comparison from travel route buffer.
    Participant IDComparison daysPhone area (haa)Watch area (ha)Difference (ha)Difference (%)
    S11b2026,472557620,895.61−78.9
    S141232,454942623,027.38−71.0
    S711958337805803.16−60.6
    S252428,34112,19216,148.12−57.0
    S64815335704582.34−56.2
    S183229,25314,05415,199.08−52.0
    S151830,31016,23614,073.42−46.4
    S41119,97110,8589113.31−45.6
    S232126,85515,25611,598.97−43.2
    S31410,81166444166.75−38.5
    S223317,99011,1066883.89−38.3
    S51715,65210,1055547.28−35.4
    S1321923959743264.86−35.3
    S122929,72622,3467379.34−24.8
    S22014,95911,3413618.06−24.2
    S2117593749221014.76−17.1
    S262923,36419,4143949.83−16.9
    S243211,15498201334.41−12.0
    S17620,49419,0351458.29−7.1
    S27734723245227.60−6.6
    S91355925485107.14−1.9
    Mean—18,084.7410,494.577590.17−42.0

    a1 ha=10,000 m2.

    bS: subject.

    Illustrative examples of this analysis are shown in the first two columns of Figure 1 for participants with extreme (S14 and S23) and minor differences (S26 and S9) in daily paths. To facilitate visual comparison at the same map extent, the 3 participants from outside of Washtenaw County are excluded. This figure illustrates that the watch traces produced activity surfaces with travel closely following highway and street routes. The greater buffer areas produced by the phone are explained by two primary issues: the inclusion of activities in the phone data, which are missing from the watch data, and the phone’s inaccurate representation of highway travel, which resulted in straight lines that artificially inflated the activity space size. The kernel density analysis was conducted to create a more nuanced representation of the differences between the patterns, which can better account for the many overlapping features. The result is shown in the third column of Figure 1, and areas where the phone data resulted in greater density than the watch are shown in green and the reverse pattern in purple. The map can be interpreted as visualizing areas where the participant is more likely to be only because of the choice of device.

    ‎
    Figure 1. Illustrative activity space data for 4 participants residing in Washtenaw County. The third column shows the difference between the density surfaces computed for the watch and phone data; higher watch density is shown in purple and higher phone density in green. Base map source: Esri [57].
    View this figure
    ‎
    Figure 2. Trace data collected for participant S12 on one study day, illustrating greater spatial detail in watch data (purple) compared with phone data (green) for outdoor exercise (neighborhood walk). Source: Google Earth [58].
    View this figure

    The spatial quality of information about outdoor activities, in particular, was higher for the watch than for the phone. For example, as shown in Figure 2, participant S12 described engaging in evening walks near his home, at least one of which was clearly recorded in the watch but not in the phone data.


    Principal Findings

    Overall, the phone resulted in a lower proportion of missing data days. In addition, the phone data had a lower mean distance to the known location points and for each of the categories examined, although only the differences in distance to home was statistically significant. The activity space analysis reveals that the phone generated larger activity spaces than the watch. This was because of higher missing data for the watch and inaccurate recording of travel by the phone, which erroneously enlarged the activity space. The watch data resulted in much more accurate data when traveling outdoors, such as riding in an automobile or walking.

    Comparisons With Prior Work

    Our research showed that there were activities that were reflected in the phone data but not recorded by the GPS watch. As described in our related work [13], one factor contributing to this difference was user acceptance; as the phone is less obtrusive and it provided other benefits to the participants, they were more likely to carry it. In addition, the participants had difficulty in using the watch, particularly when syncing the device to store data for the study. Unlike the watch that must be synced daily, phone data were logged to a remote server automatically. Although using an alternative GPS device may reduce or eliminate some of these issues, other factors related to the GPS infrastructure, such as the delay in obtaining a satellite signal, would still hinder the widespread use of GPS devices for location tracking. Prior feasibility studies with GPS devices for location tracking in health have surfaced similar issues in use of such devices [32,59]. Moreover, previous work shows that GPS devices typically only function outdoors, where they can connect with multiple satellites, and perform best in places away from dense buildings [10,11].

    The spatial accuracy analysis highlights one strength of the phone, which is the improved quality of the collected spatial information about locations in buildings, probably because of the phone’s use of Wi-Fi signals to determine location. Future research could further investigate this issue for specific location categories. Although previous work has shown that a mobile phone–based app can generate accurate spatial data [21], this is the first study, to our knowledge, to empirically compare such devices with other prevailing technologies. Moreover, this study focused on a technology that is available on many mobile phones without requiring the downloading of additional software (Google Location History). The widespread adoption of this technology means that it holds special promise for population-level monitoring and surveillance.

    Previous research on the accuracy of location-tracking devices has focused on comparing different types of GPS devices [30,31,60]. This is the first study, to our knowledge, that compares GPS technology with the now-ubiquitous forms of location tracking available in mobile phones. This permitted the identification of sources of error in mobile phone data, which are likely to be increasingly used in research because of their ubiquity.

    Implications for Researchers

    The main conclusion we draw from the study is that there are important trade-offs between the use of these two types of devices in health research. Participants successfully collected more data with the phone, with less data loss. In addition, our analysis showed that the phone traces were closer to known destination points than the watch data. However, these benefits came with a significant trade-off, namely, the straight lines and inaccuracies for outdoor activities, described earlier for the phone data. As described earlier, a combination of user behaviors and technical issues explain these results.

    Therefore, the suitability of each category of a device depends on the specific research question of a study. Studies that seek precise measurement of outdoor activity and travel, such as measuring outdoor physical activity, characterizing mental health symptoms, or exposure to localized environmental hazards, would benefit from the use of GPS devices. Conversely, studies in which the aim is to account for time within buildings at home or work, or document visits to particular places (such as supermarkets, medical facilities, or fast food restaurants), would benefit from the phone’s demonstrated greater precision in recording indoor activities. For studies that only require the general location and duration of indoor activities, mobile phones may be a more practical data collection device than others that are available to collect this type of information [3]. Furthermore, the weaknesses of each device suggest steps that researchers should take in their research protocols to minimize the associated errors. Given the difficulty of syncing, alternative GPS devices that do not require this step may reduce data losses, if available.

    As described, the phone data often included straight-line features that appear to connect points for which detailed locations were obtained by the device. We speculate these lines may be produced through a low data collection rate compared with GPS watches at those times. Consequently, the trace data sometimes included implausible travel routes, which leads us to conclude that the device may have less accurate data for outdoor activities, particularly those that involve travel. Researchers using similar phone data in the future should develop procedures for identifying and removing the straight lines from their datasets. Alternatively, researchers could benefit from the development of a tailored mobile phone app to log location data automatically; this would allow researchers greater control over the nature of the spatial data (such as specifying the desired data collection rate) and allow survey responses to be linked with locations. At the same time, this comes with trade-offs, as these apps will not be adopted at a population level like Google Location History, which could be used to gain new insights into mobility patterns at a large scale.

    Locational Privacy

    Although our participants did not express concerns about the privacy of their data, this was primarily because of the use of the data for research purposes, accompanied by our use of ID numbers [13]. Furthermore, in this paper, we included only large-scale maps of the results to minimize the risk of identification [61]. Nevertheless, in general, location tracking has important privacy implications [61]. We acknowledge that studies such as ours raise a variety of issues that, although did not arise here, deserve greater attention from researchers engaging in location tracking in health research studies [33]. These include special considerations for vulnerable populations and what should be done if evidence of harm or illegal activities is observed in participant data [33]. Finally, the paper provides the opportunity to comment on broader privacy issues, as we demonstrate the usefulness of the Google Location History data, which are passively collected for many millions of users. Although Google provides users with the ability to deactivate and delete location history, the sensitivity of the information raises important questions about how this information should be managed in ways that minimize the risk of harm to participants and protect their anonymity and confidentiality.

    Study Limitations

    Several limitations of this study should be kept in mind. First, the difficulties that participants faced in using the GPS watch may not persist with newer generations of wearable GPS technology; this may reduce discrepancies in missing data. Second, the straight-line errors concerning travel routes had a differential impact based on the method of characterizing activity space. The buffer methodology, which does not account for the frequency of trips in any particular area, was particularly sensitive to this issue. However, the kernel density analysis somewhat reduced the effect of these features, particularly for participants who collected the most data. Finally, this study was also conducted with a small sample of relatively educated adults in an urban environment, who were recruited through online means. Therefore, user-related data accuracy difficulties may be even greater in populations with less education and technology experience. The generalizability of these results to areas with lower Wi-Fi or cellular tower density (eg, rural areas) is therefore unclear. Finally, although we are unaware of major changes to the technologies here, future improvements to GPS receivers or mobile phone location services may affect the future generalizability of these results.

    Conclusions

    Health research increasingly uses fine-grained spatial data gathered from mobile devices to evaluate relationships between health, place, and mobility. Such research, which may be conducted with wearable GPS devices or mobile phones, requires accurate spatial data for analysis. This study reports a direct comparison of the spatial information collected from each of such devices during a field study involving 21 participants. Mobile phones resulted in less missing data, spatial data closer to known destination points, and larger activity spaces. In contrast, the mobile phone data resulted in the recording of outdoor travel inaccurately, including physical activities such as walking. Therefore, the best device for health research depends on the particular study objectives, and data generated from both devices require careful analysis to ensure quality and completeness.

    Acknowledgments

    This study was funded in part by the Gordon and Betty Moore Foundation (grant #GBMF3943) to the University of Michigan; the Alfred P Sloan Foundation (grant #2014-5-05 DS); MCubed and the University of Michigan Office of Research; and the University of Michigan Rackham Graduate School via the Social Sciences Annual Institute Round 6. The authors would like to thank the study participants as well as Bonny Wang, Katherine James, and Russell Pildes who provided assistance with the spatial analysis.

    Authors' Contributions

    TV, XY, and JH coordinated the administration of the field trial. XY, TV, and RG processed the collected data. JH and TV conducted interviews. RG and TV conducted the missing data analysis, RG and Russell Pildes conducted spatial accuracy analysis, and RG conducted the activity space analysis. RG led writing the manuscript, with major contributions from TV, VGVV, and JH. VJB, DMR, PC, and ING-L provided input on the study methods and provided substantive revisions to the manuscript. All authors read and approved the final manuscript.

    Conflicts of Interest

    None declared.

    1. Vallée J, Chauvin P. Investigating the effects of medical density on health-seeking behaviours using a multiscale approach to residential and activity spaces: results from a prospective cohort study in the Paris metropolitan area, France. Int J Health Geogr 2012 Dec 26;11:54 [FREE Full text] [CrossRef] [Medline]
    2. Stimpson JP, Ju H, Raji MA, Eschbach K. Neighborhood deprivation and health risk behaviors in NHANES III. Am J Health Behav 2007;31(2):215-222. [CrossRef] [Medline]
    3. Loveday A, Sherar LB, Sanders JP, Sanderson PW, Esliger DW. Technologies that assess the location of physical activity and sedentary behavior: a systematic review. J Med Internet Res 2015 Aug 5;17(8):e192 [FREE Full text] [CrossRef] [Medline]
    4. Negi I, Tsow F, Tanwar K, Zhang L, Iglesias RA, Chen C, et al. Novel monitor paradigm for real-time exposure assessment. J Expo Sci Environ Epidemiol 2011;21(4):419-426 [FREE Full text] [CrossRef] [Medline]
    5. Saeb S, Zhang M, Karr CJ, Schueller SM, Corden ME, Kording KP, et al. Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: an exploratory study. J Med Internet Res 2015 Jul 15;17(7):e175 [FREE Full text] [CrossRef] [Medline]
    6. Canzian L, Musolesi M. Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis. 2015 Presented at: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing; September 07-11, 2015; Osaka, Japan p. 1293-1304. [CrossRef]
    7. Wahle F, Kowatsch T, Fleisch E, Rufer M, Weidt S. Mobile sensing and support for people with depression: a pilot trial in the wild. JMIR Mhealth Uhealth 2016 Sep 21;4(3):e111 [FREE Full text] [CrossRef] [Medline]
    8. Gruenerbl A, Osmani V, Bahle G, Carrasco JC, Oehler S, Mayora O, et al. Using smart phone mobility traces for the diagnosis of depressive and manic episodes in bipolar patients. 2014 Presented at: Proceedings of the 5th Augmented Human International Conference; March 7-8, 2014; Kobe, Japan. [CrossRef]
    9. Puri A, Kim B, Nguyen O, Stolee P, Tung J, Lee J. User acceptance of wrist-worn activity trackers among community-dwelling older adults: mixed method study. JMIR Mhealth Uhealth 2017 Nov 15;5(11):e173 [FREE Full text] [CrossRef] [Medline]
    10. Ridgers ND, McNarry MA, Mackintosh KA. Feasibility and effectiveness of using wearable activity trackers in youth: a systematic review. JMIR Mhealth Uhealth 2016 Nov 23;4(4):e129 [FREE Full text] [CrossRef] [Medline]
    11. Duncan DT, Kapadia F, Regan SD, Goedel WC, Levy MD, Barton SC, et al. Feasibility and acceptability of Global Positioning System (GPS) methods to study the spatial contexts of substance use and sexual risk behaviors among young men who have sex with men in New York City: a P18 cohort sub-study. PLoS One 2016 Feb 26;11(2):e0147520 [FREE Full text] [CrossRef] [Medline]
    12. Byrnes HF, Miller BA, Morrison CN, Wiebe DJ, Remer LG, Wiehe SE. Brief report: using global positioning system (GPS) enabled cell phones to examine adolescent travel patterns and time in proximity to alcohol outlets. J Adolesc 2016 Jul;50:65-68. [CrossRef] [Medline]
    13. Hardy J, Veinot TC, Yan X, Berrocal VJ, Clarke P, Goodspeed R, et al. User acceptance of location-tracking technologies in health research: implications for study design and data quality. J Biomed Inform 2018 Mar;79:7-19. [CrossRef] [Medline]
    14. Gomersall SR, Ng N, Burton NW, Pavey TG, Gilson ND, Brown WJ. Estimating physical activity and sedentary behavior in a free-living context: a pragmatic comparison of consumer-based activity trackers and ActiGraph accelerometry. J Med Internet Res 2016 Sep 7;18(9):e239 [FREE Full text] [CrossRef] [Medline]
    15. Gorny AW, Liew SJ, Tan CS, Müller-Riemenschneider F. Fitbit charge HR wireless heart rate monitor: validation study conducted under free-living conditions. JMIR Mhealth Uhealth 2017 Oct 20;5(10):e157 [FREE Full text] [CrossRef] [Medline]
    16. Chaix B. Geographic life environments and coronary heart disease: a literature review, theoretical contributions, methodological updates, and a research agenda. Annu Rev Public Health 2009;30:81-105. [CrossRef] [Medline]
    17. Inagami S, Cohen DA, Finch BK. Non-residential neighborhood exposures suppress neighborhood effects on self-rated health. Soc Sci Med 2007 Oct;65(8):1779-1791. [CrossRef] [Medline]
    18. Zenk SN, Schulz AJ, Matthews SA, Odoms-Young A, Wilbur J, Wegrzyn L, et al. Activity space environment and dietary and physical activity behaviors: a pilot study. Health Place 2011 Sep;17(5):1150-1161. [CrossRef] [Medline]
    19. Gustafson A, Christian JW, Lewis S, Moore K, Jilcott S. Food venue choice, consumer food environment, but not food venue availability within daily travel patterns are associated with dietary intake among adults, Lexington Kentucky 2011. Nutr J 2013 Jan 29;12:17 [FREE Full text] [CrossRef] [Medline]
    20. Shearer C, Rainham D, Blanchard C, Dummer T, Lyons R, Kirk S. Measuring food availability and accessibility among adolescents: moving beyond the neighbourhood boundary. Soc Sci Med 2015 May;133:322-330. [CrossRef] [Medline]
    21. Maddison R, Gemming L, Monedero J, Bolger L, Belton S, Issartel J, et al. Quantifying human movement using the Movn smartphone app: validation and field study. JMIR Mhealth Uhealth 2017 Aug 17;5(8):e122 [FREE Full text] [CrossRef] [Medline]
    22. Sherman JE, Spencer J, Preisser JS, Gesler WM, Arcury TA. A suite of methods for representing activity space in a healthcare accessibility study. Int J Health Geogr 2005 Oct 19;4:24 [FREE Full text] [CrossRef] [Medline]
    23. Jones M, Pebley AR. Redefining neighborhoods using common destinations: social characteristics of activity spaces and home census tracts compared. Demography 2014 Jun;51(3):727-752 [FREE Full text] [CrossRef] [Medline]
    24. Kestens Y, Lebel A, Daniel M, Thériault M, Pampalon R. Using experienced activity spaces to measure foodscape exposure. Health Place 2010 Nov;16(6):1094-1103. [CrossRef] [Medline]
    25. Kwan MP. Beyond space (as we knew it): toward temporally integrated geographies of segregation, health, and accessibility. Ann Assoc Am Geogr 2013;103(5):1078-1086. [CrossRef]
    26. Unwin DJ, Fisher P. What about people in geographic information science. In: Re-Presenting GIS. West Sussex, England: Wiley-Blackwell; 2005.
    27. Golledge RG, Stimson RJ. Spatial Behavior: A Geographic Perspective. New York, NY: Guilford Publications, Inc; 1996.
    28. Krenn PJ, Titze S, Oja P, Jones A, Ogilvie D. Use of global positioning systems to study physical activity and the environment: a systematic review. Am J Prev Med 2011 Nov;41(5):508-515 [FREE Full text] [CrossRef] [Medline]
    29. Cetateanu A, Jones A. How can GPS technology help us better understand exposure to the food environment? A systematic review. SSM Popul Health 2016 Dec;2:196-205 [FREE Full text] [CrossRef] [Medline]
    30. Duncan S, Stewart TI, Oliver M, Mavoa S, MacRae D, Badland HM, et al. Portable global positioning system receivers: static validity and environmental conditions. Am J Prev Med 2013 Feb;44(2):e19-e29. [CrossRef] [Medline]
    31. Schipperijn J, Kerr J, Duncan S, Madsen T, Klinker CD, Troelsen J. Dynamic accuracy of GPS receivers for use in health research: a novel method to assess GPS accuracy in real-world settings. Front Public Health 2014 Mar 10;2:21 [FREE Full text] [CrossRef] [Medline]
    32. Williams J, Townsend N, Duncan G, Drewnowski A. Participant experience using GPS devices in a food environment and nutrition study. J Hunger Environ Nutr 2016;11(3):414-427. [CrossRef]
    33. Fuller D, Shareck M, Stanley K. Ethical implications of location and accelerometer measurement in health research studies with mobile sensing devices. Soc Sci Med 2017 Oct;191:84-88. [CrossRef] [Medline]
    34. He X, Li J, Wang B, Yao Q, Li L, Song R, et al. Diabetes self-management education reduces risk of all-cause mortality in type 2 diabetes patients: a systematic review and meta-analysis. Endocrine 2017 Mar;55(3):712-731. [CrossRef] [Medline]
    35. Lin MY, Liu MF, Hsu LF, Tsai PS. Effects of self-management on chronic kidney disease: a meta-analysis. Int J Nurs Stud 2017 Sep;74:128-137. [CrossRef] [Medline]
    36. LeFevre ML, U.S. Preventive Services Task Force. Behavioral counseling to promote a healthful diet and physical activity for cardiovascular disease prevention in adults with cardiovascular risk factors: U.S. Preventive Services Task Force Recommendation Statement. Ann Intern Med 2014 Oct 21;161(8):587-593. [CrossRef] [Medline]
    37. Gomez-Lopez IN, Clarke P, Hill AB, Romero DM, Goodspeed R, Berrocal VJ, et al. Using social media to identify sources of healthy food in urban neighborhoods. J Urban Health 2017 Jun;94(3):429-436. [CrossRef] [Medline]
    38. Vydiswaran Vinod VG, Romero D, Zhao X, Yu D, Gomez-Lopez I, Lu JX, et al. 'Bacon bacon bacon': Food-related tweets and sentiment in metro Detroit. 2018 Presented at: 12th International AAAI Conference on Web and Social Media; 2018; Stanford, CA.
    39. Chen J, Muntner P, Hamm LL, Jones DW, Batuman V, Fonseca V, et al. The metabolic syndrome and chronic kidney disease in U.S. adults. Ann Intern Med 2004 Feb 3;140(3):167-174. [CrossRef]
    40. American Diabetes Association. 4. Lifestyle Management: Standards of Medical Care in Diabetes-2018. Diabetes Care 2018 Jan;41(Suppl 1):S38-S50. [CrossRef] [Medline]
    41. Eckel RH, Jakicic JM, Ard JD, de Jesus JM, Houston Miller N, Hubbard VS, American College of Cardiology/American Heart Association Task Force on Practice Guidelines. 2013 AHA/ACC guideline on lifestyle management to reduce cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol 2014 Jul 1;63(25 Pt B):2960-2984 [FREE Full text] [CrossRef] [Medline]
    42. Ricardo AC, Anderson CA, Yang W, Zhang X, Fischer MJ, Dember LM, CRIC Study Investigators. Healthy lifestyle and risk of kidney disease progression, atherosclerotic events, and death in CKD: findings from the Chronic Renal Insufficiency Cohort (CRIC) Study. Am J Kidney Dis 2015 Mar;65(3):412-424 [FREE Full text] [CrossRef] [Medline]
    43. Auchincloss AH, Diez Roux AV, Mujahid MS, Shen M, Bertoni AG, Carnethon MR. Neighborhood resources for physical activity and healthy foods and incidence of type 2 diabetes mellitus: the multi-ethnic study of atherosclerosis. Arch Intern Med 2009 Oct 12;169(18):1698-1704 [FREE Full text] [CrossRef] [Medline]
    44. Krishnan S, Cozier YC, Rosenberg L, Palmer JR. Socioeconomic status and incidence of type 2 diabetes: results from the black women's health study. Am J Epidemiol 2010 Mar 1;171(5):564-570 [FREE Full text] [CrossRef] [Medline]
    45. Rose KM, Suchindran CM, Foraker RE, Whitsel EA, Rosamond WD, Heiss G, et al. Neighborhood disparities in incident hospitalized myocardial infarction in four U.S. communities: the ARIC surveillance study. Ann Epidemiol 2009 Dec;19(12):867-874 [FREE Full text] [CrossRef] [Medline]
    46. Senteio C, Veinot T. Trying to make things right: adherence work in high-poverty, African American neighborhoods. Qual Health Res 2014 Dec;24(12):1745-1756. [CrossRef]
    47. Volkova N, McClellan W, Klein M, Flanders D, Kleinbaum D, Soucie JM, et al. Neighborhood poverty and racial differences in ESRD incidence. J Am Soc Nephrol 2008 Feb;19(2):356-364 [FREE Full text] [CrossRef] [Medline]
    48. Saldana J. The Coding Manual for Qualitative Researchers. London, UK: SAGE Publications Ltd; 2015.
    49. Ellis M, Wright R, Parks V. Work together, live apart? Geographies of racial and ethnic segregation at home and at work. Ann Assoc Am Geogr 2004 Sep;94(3):620-637. [CrossRef]
    50. Newsome TH, Walcott WA, Smith PD. Urban activity spaces: illustrations and application of a conceptual model for integrating the time and space dimensions. Transportation 1998;25(4):357-377. [CrossRef]
    51. Han D, Lee K, Kim J, Bennett DH, Cassady D, Hertz-Picciotto I. Development of time-location weighted spatial measures using global positioning system data. Environ Health Toxicol 2013 May 7;28:e2013005 [FREE Full text] [CrossRef] [Medline]
    52. Boruff BJ, Nathan A, Nijënstein S. Using GPS technology to (re)-examine operational definitions of 'neighbourhood' in place-based health research. Int J Health Geogr 2012 Jun 27;11:22 [FREE Full text] [CrossRef] [Medline]
    53. Larsen L, El-Geneidy AM. Beyond the quarter mile: re-examining travel distances by active transportation. Can J Urban Res 2010;19(1):70-88.
    54. Schlossberg M, Brown N. Comparing transit-oriented development sites by walkability indicators. Transp Res Rec 2004 Jan;1887(1):34-42. [CrossRef]
    55. Schönfelder S, Axhausen KW. Activity spaces: measures of social exclusion? Transport Policy 2003 Oct;10(4):273-286. [CrossRef]
    56. Downs JA, Horner MW, Tucker AD. Time-geographic density estimation for home range analysis. Annals of GIS 2011;17(3):163-171. [CrossRef]
    57. Esri.   URL: https://www.esri.com/en-us/home [WebCite Cache]
    58. Google Earth.   URL: https://www.google.com/earth/ [WebCite Cache]
    59. Zenk SN, Schulz AJ, Odoms-Young AM, Wilbur J, Matthews S, Gamboa C, et al. Feasibility of using global positioning systems (GPS) with diverse urban adults: before and after data on perceived acceptability, barriers, and ease of use. J Phys Act Health 2012 Sep;9(7):924-934. [CrossRef]
    60. Powell C, Donnelly AE, Lyons M, Anderson R. An Examination of the Accuracy and Reliability of Three GPS Devices. 2015 Presented at: International Conference on Ambulatory Monitoring of Physical Activity and Movement; June, 2015; Limerick, Ireland.
    61. Brownstein JS, Cassa CA, Mandl KD. No place to hide--reverse identification of patients from published maps. N Engl J Med 2006 Oct 19;355(16):1741-1742. [CrossRef] [Medline]

    ‎
    EMA: ecological momentary assessment
    GPS: global positioning system
    PACO: Personal Analysis Companion

    Edited by G Eysenbach; submitted 04.01.18; peer-reviewed by DI Stewart, K Tamura, M Bardus; comments to author 25.03.18; revised version received 16.05.18; accepted 21.06.18; published 13.08.18

    Copyright

    ©Robert Goodspeed, Xiang Yan, Jean Hardy, VG Vinod Vydiswaran, Veronica J Berrocal, Philippa Clarke, Daniel M Romero, Iris N Gomez-Lopez, Tiffany Veinot. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 13.08.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.