RefCheck Maintenance Notice

On Monday, December 3, 2018, from 16:00-18:00 EST, RefCheck will be undergoing maintenance. RefCheck is the process where, during copyediting, all references are extracted from the manuscript file, parsed, matched against various databases (eg, PubMed and CrossRef), and automatically corrected. For more information on RefCheck, please visit our Knowledge Base.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 19.11.18 in Vol 6, No 11 (2018): November

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/11012, first published May 20, 2018.

This paper is in the following e-collection/theme issue:

    Original Paper

    A Novel Approach to Evaluating Mobile Smartphone Screen Time for iPhones: Feasibility and Preliminary Findings

    Department of Pediatrics, School of Medicine and Public Health, University of Wisconsin - Madison, Madison, WI, United States

    Corresponding Author:

    Aubrey D Gower, BS, BA

    Department of Pediatrics

    School of Medicine and Public Health

    University of Wisconsin - Madison

    Suite 200

    2870 University Avenue

    Madison, WI, 53705

    United States

    Phone: 1 608 262 7103

    Email:


    ABSTRACT

    Background: Increasingly high levels of smartphone ownership and use pose the potential risk for addictive behaviors and negative health outcomes, particularly among younger populations. Previous methodologies to understand mobile screen time have relied on self-report surveys or ecological momentary assessments (EMAs). Self-report is subject to bias and unreliability, while EMA can be burdensome to participants. Thus, a new methodology is needed to advance the understanding of mobile screen time.

    Objective: The objective of this study was to test the feasibility of a novel methodology to record and evaluate mobile smartphone screen time and use: battery use screenshot (BUS).

    Methods: The BUS approach, defined for this study as uploading a mobile phone screenshot of a specific page within a smartphone, was utilized within a Web-based cross-sectional survey of adolescents aged 12-15 years through the survey platform Qualtrics. Participants were asked to provide a screenshot of their battery use page, a feature within an iPhone, to upload within the Web-based survey. Feasibility was assessed by smartphone ownership and response rate to the BUS upload request. Data availability was evaluated as apps per BUS, completeness of data within the screenshot, and five most used apps based on battery use percentage.

    Results: Among those surveyed, 26.73% (309/1156) indicated ownership of a smartphone. A total of 105 screenshots were evaluated. For data availability, screenshots contained an average of 10.2 (SD 2.0) apps per screenshot and over half (58/105, 55.2%) had complete data available. The most common apps or functions included Safari and Home and Lock Screen.

    Conclusions: Study findings describe the BUS as a novel approach for real-time data collection focused on iPhone screen time and use among young adolescents. Although feasibility showed some challenges in the upload capacity of young teens, data availability was generally strong across this large dataset. These data from screenshots have the potential to provide key insights into precise mobile smartphone screen use and time spent per mobile app. Future studies could explore the use of the BUS methodology on other mobile smartphones such as Android phones to correlate mobile smartphone screen time with health outcomes.

    JMIR Mhealth Uhealth 2018;6(11):e11012

    doi:10.2196/11012

    KEYWORDS



    Introduction

    Smartphones and their vast functionalities have become an integral part of individuals’ lives today [1]. In the United States alone, smartphone ownership has increased to 77%, with 95% of teens aged 13-17 years reporting access to or ownership of a smartphone (92%) [2,3]. Globally, similar trends are seen in smartphone ownership, including among emerging economies [4]. Among adolescent smartphone owners, 64% reported “everyday use” in a recent survey [5]. As ownership and accessibility to mobile smartphones have become ubiquitous, so has the need for research into the implications, such as positive and negative health consequences. Recent research suggests high screen media usage is associated with poor sleep and diminished academic performance among adolescents and adults [6-8]. Thus, accurate and feasible methodologies to study mobile screen time are necessary to further understand these relationships.

    Previous methodologies to understand mobile screen time have typically relied on traditional self-report and cross-sectional research design [6-10]. However, self-report is vulnerable to systematic and confounding bias [11]. Previous work has shown conflicting results related to media use time with the use of self-report. Some studies have found self-report app usage to underestimate app and smartphone usage [12]. On the other hand, studies have also found self-report by participants to overestimate Web-based time [13,14]. These inconsistencies have led some researchers to suggest that self-reported smartphone use should be interpreted with caution [15].

    Another approach to evaluate mobile media use is ecological momentary assessment (EMA). In this approach, participants are typically contacted multiple times per day to report their real-time screen use [16,17]. While this approach improves upon self-report biases, such as recall bias, it can be highly burdensome to participants [18]. In addition, these methodologies often fail to obtain large-scale and representative samples due to costs to researchers to provide the compensation necessary to attract participants [19]. Thus, a new methodology is needed to advance the assessment of mobile screen time that not only improves accuracy compared with self-report but is also not burdensome to participants.

    One possible approach to understanding mobile smartphone screen time while limiting participant burden is to leverage passive tracking that smartphones are programmed for via battery use reporting. Most smartphones, such as iPhones, track battery use per app and phone function (eg, Home and Lock Screen). A majority of smartphones will then report this battery use by time, including both active onscreen and background use. The “battery use” function and display, thus, serve as an indicator for real-time app and smartphone activity.

    In this research protocol, we present preliminary findings of the battery use screenshot (BUS) approach among young adolescents. The objective of this study was to test the feasibility of the BUS approach to obtain and evaluate iPhone screen time data.


    Methods

    Design

    Data for this study were collected as a planned protocol evaluation as part of a larger study related to technology rules and health behaviors among adolescents aged 12-15 years. The BUS approach was defined for this study as the upload of a mobile phone screenshot of the “battery use” page within the participant’s smartphone. To assess the feasibility of the BUS approach, this study was designed as a cross-sectional Web-based survey of 12- to 15-year-old adolescents. We collected data between June and July 2017 using the Qualtrics survey platform. The study was approved by the University of Washington Institutional Review Board.

    Participants and Recruitment

    Youth who were between the ages of 12 and 15 years and who could read English were eligible to complete the survey. As described in previous studies [20], Qualtrics draws upon previously established age panels within their Web-based database, allowing for targeted recruitment. Eligibility was assessed prior to beginning the Web-based informed consent process. Once informed consent from parents was obtained, participants could begin the survey. Compensation was provided to participants through Qualtrics for survey completion.

    Data Collection Process

    Variables
    Phone Ownership

    Participants were asked whether they currently had a smartphone capable of taking a screenshot. Participants were also asked to indicate whether the phone was their own, their parent’s smartphone, or that they did not own a smartphone.

    Demographics

    Age, gender, parental education, and race or ethnicity were assessed.

    Screenshot Upload

    Participants were provided an example BUS within the survey (Figure 1) and then asked to create their own screenshot from the phone they currently used, if they had one. Instructions included first asking the participant to go to the “Settings” section of their smartphone and clicking the “Battery” option. Once in the “Battery” section, participants were asked to locate the “battery usage” data displayed. For iPhones, participants were asked to click both the “Last x days” and the clock symbol in the right-hand corner to display both onscreen and background activity for each app listed. Participants were asked to compare their display to the example provided to ensure the correct data were viewable. Participants were then asked to screenshot this display by holding down the home and power button at the same time to capture the image. Once the screenshot was captured, participants were asked to upload the image, as a .jpg or .png, to a file dropbox within the survey.

    Figure 1. Example of an iPhone battery use screenshot from an Apple iPhone 6 with IOS 11; image was produced by first author.
    View this figure

    Analysis

    Descriptive statistics were used to analyze feasibility and data availability. The most commonly used apps were determined based on their frequency among the evaluated screenshots. Analysis focused on iPhone screenshots because of inconsistency among Android platforms in the display of battery usage. Screenshots were excluded if they contained anything other than the battery use page from a personal phone.

    Outcomes

    Feasibility

    Measures to assess feasibility included a survey question asking about personal smartphone ownership and response rate to BUS upload request.

    Data availability

    To characterize data availability, content analysis assessed apps or functions per screenshot and completeness of the screenshot including display of “onscreen” and “background” time and displayed percentage of battery use per app. Functions were characterized as iPhone functions such as Home and Lock Screen that use battery life but are not considered typical downloadable apps. The five most commonly used apps or functions among evaluated screenshots were assessed. The most used apps or functions for each screenshot were defined based on displayed battery use percentage.


    Results

    Demographics

    A total of 1156 adolescents with an average age of 13.6 (SD 1.09) years responded to the survey. The overall survey sample comprised 49.48% (572/1156) females and 72.84% (842/1156) Caucasian people. Among the sample of participants for which screenshots were evaluated, 52.3% (79/151) were females and 75.5% (114/151) were Caucasian people. Full demographics for both populations can be seen in Table 1.

    Feasibility

    Among the overall survey sample, 26.73% (309/1156) indicated they had their own phone. Among these adolescents, 48.9% (151/309) completed the BUS upload request (Figure 2).

    Table 1. Demographic characteristics of participants.
    View this table

    Data Availability

    A total of 105 iPhone screenshots, received as .jpg or .png images, were used for the evaluation of data availability. Each screenshot contained an average of 10.2 (SD 2.00) apps. More than half (58/105, 55.2%) had complete data availability, indicating successful implementation of instructions provided. Complete screenshots allowed for the ability to view the apps used, battery use percentage per app, and total minutes or hours of both “background” and “on screen” usage (Figure 1).

    Most Commonly Used Apps

    Figure 3 shows the frequency of the most common apps or functions to appear in the five most used apps or functions among the analyzed screenshots. Safari, an internet search engine, was the most common app among screenshots; 46.7% (49/105) of screenshots included Safari within the five most used apps.

    Figure 2. Protocol results flowchart.
    View this figure
    Figure 3. Most common apps or functions among analyzed screenshots.
    View this figure

    Discussion

    Principal Findings

    This study describes a novel BUS approach to test feasibility, data availability, and most common apps among a young adolescent population. The inclusion of the BUS approach within a Web-based survey adds the capacity to assess mobile smartphone screen time that is accessible for both participants and researchers in a highly technological environment. Battery use is automatically monitored by the operating systems of most smartphones [21], reducing both the bias of self-report as well as burden on participants to record real-time smartphone and app use. Compared with typical EMA approaches, this methodology can improve the capacity to deliver real-time data as well as allow for data collection from larger, Web-based samples [22].

    The feasibility of our approach was mixed with both strengths and challenges. Among the participants who did upload a screenshot, the images provided clear data that could be viewed, stored in a deidentified manner, and categorized for further analysis. Our challenges in feasibility may be explained by the rate of phone ownership in our young adolescent sample, which is lower than recent reports of 56% smartphone ownership among youth aged 8-18 years [23]. Among adolescents with their own phone, approximately half were willing or able to upload a screenshot. It is possible that a study population of older adolescents and adults may have higher phone ownership and better understanding and capacity to upload a screenshot. An additional explanation for this challenge may be the survey platform Qualtrics, which allows users to take surveys on both mobile phones and desktop computers. Participants who used a desktop computer to complete the survey may have experienced an additional burden in uploading a screenshot from a different device, which may have contributed to the overall feasibility of this study. Compensation of US $13 was determined by Qualtrics based on the initial suggested sample size for the larger study. Based on our results, low monetary compensation may be a factor in willingness to complete the screenshot task and should be considered when incorporating the BUS approach into future studies.

    Over half of the screenshots analyzed contained complete data including the display of “onscreen” versus “background” time per app. One possible reason for cases of incomplete data may be that participants had an older iOS operating system, as the battery usage feature is only available on iOS 9 and newer operating systems [24]. This should be taken into consideration in future studies utilizing this methodology in iPhones. In addition, this study relied on a single screenshot, which may not have captured total app usage. To strengthen overall data availability, future studies might require as many screenshots as necessary to provide the full range of apps used by a participant.

    While our study illustrates both strengths and challenges to the proposed research protocol, it serves as a valuable starting point for considering how to advance data collection methods to understand mobile smartphone screen time and media use in iPhones. Studies have concluded that smartphone apps can be beneficial in monitoring and evaluating patients [25-27] as well as increasing adherence to medical interventions [28,29]. The BUS approach offers the ability to take these studies further in understanding real-time use and overall time spent on apps as a factor that could contribute to health outcomes. This methodology offers a framework that could be adapted to Android phones, which offer varying displays of battery use per app and time spent per app. When data and display of battery use are available, a BUS approach may still be utilized as a data collection process. Instructions for the screenshot would need to be adjusted to reflect the varying battery use displays of Androids, and further exploration of these displays should be used to inform these instructions. By expanding the BUS approach to Android devices, future studies would also allow for greater sampling of socioeconomic status, with lower socioeconomic status individuals and families more likely to own Android devices.

    The BUS approach may also be combined with a variety of research methodologies including Web-based cross-sectional surveys, as was done in this study, or used as a tool for monitoring smartphone app use longitudinally. In a previous pilot study conducted using BUS, older adolescent iPhone users were asked to submit weekly screenshots of battery use for 9 weeks, with a 94% retention rate over 5 weeks and 60% retention rate over 9 weeks [30]. A further advantage of the BUS approach is the ability to collect comprehensive data related to mobile smartphone screen time without the need for an additional app or programming. Thus, this methodology is accessible for researchers without the means for software or app development.

    Limitations

    There are limitations to this feasibility study. The sample size of screenshots analyzed is limited and is not representative of the larger adolescent population. The sample overall may not be representative of the US racial or ethnic makeup for youth aged under 18 years because current US census records differ from our study’s demographics and estimate this population to be 51% white, 15% black or African American, and 25% Latino people [31]. In addition, the battery use page only displays phone use while an iPhone is not charging and may not account for the full time spent using a smartphone device. Furthermore, adolescents may have access to other phones, including their parents’, which may underestimate overall screen time. Finally, in this feasibility study, only iPhone screenshots were evaluated. Results may not generalize to all smartphones or mobile devices with battery use tracking. We did not test the BUS tracking method against other methods of tracking app use to assess its accuracy.

    Conclusion

    Though feasibility with the BUS methodology showed challenges in phone ownership rates and upload capacity of young teens, availability of data was generally strong across this large dataset. The data available from screenshots have the potential to provide key insights into precise mobile smartphone screen use and amount of time spent per mobile app. The BUS approach may provide an innovative and complementary approach to understanding smartphone screen use without the need for complex programming or mobile app development. Future studies could improve upon the BUS methodology to correlate mobile smartphone screen time with health outcomes.

    Acknowledgments

    This research was supported and funded by Seattle Children’s Research Institute. We would also like to thank Esther Lam for her assistance on this project.

    Conflicts of Interest

    None declared.

    References

    1. Smith A. Pew Research Center: Internet & Technology. 2015 Apr 01. U.S. Smartphone Use in 2015   URL: http://assets.pewresearch.org/wp-content/uploads/sites/14/2015/03/PI_Smartphones_0401151.pdf [accessed 2018-03-31] [WebCite Cache]
    2. Smith A. Pew Research Center. 2017 Jan 12. Record shares of Americans now own smartphones, have home broadband   URL: http://www.pewresearch.org/fact-tank/2017/01/12/evolution-of-technology/ [accessed 2018-03-30] [WebCite Cache]
    3. Anderson M, Jiang J. Pew Research Center: Internet & Technology. 2018 May 31. Teens, Social Media & Technology 2018   URL: http://www.pewinternet.org/2018/05/31/teens-social-media-technology-2018/ [accessed 2018-08-04] [WebCite Cache]
    4. Poushter J. Pew Research Center. 2016. Smartphone ownership and internet usage continues to climb in emerging economies   URL: http:/​/www.​pewglobal.org/​2016/​02/​22/​smartphone-ownership-and-internet-usage-continues-to-climb-in-emerging-economies/​ [WebCite Cache]
    5. Rideout V. Common Sense Media Incorporated. 2015. The common sense census: Media use by tweens and teens   URL: https://www.commonsensemedia.org/research/the-common-sense-census-media-use-by-tweens-and-teens [WebCite Cache]
    6. Hale L, Guan S. Screen time and sleep among school-aged children and adolescents: a systematic literature review. Sleep Med Rev 2015 Jun;21:50-58. [CrossRef] [Medline]
    7. Demirci K, Akgönül M, Akpinar A. Relationship of smartphone use severity with sleep quality, depression, and anxiety in university students. J Behav Addict 2015 Jun;4(2):85-92 [FREE Full text] [CrossRef] [Medline]
    8. Lee KE, Kim S, Ha T, Yoo Y, Han J, Jung J, et al. Dependency on Smartphone Use and Its Association with Anxiety in Korea. Public Health Rep 2016;131(3):411-419 [FREE Full text] [CrossRef] [Medline]
    9. Haug S, Castro RP, Kwon M, Filler A, Kowatsch T, Schaub MP. Smartphone use and smartphone addiction among young people in Switzerland. J Behav Addict 2015 Dec;4(4):299-307 [FREE Full text] [CrossRef] [Medline]
    10. Lenhart A. Pew Research Center. 2015. Teens, Social Media & Technology Overview 2015   URL: http://www.pewinternet.org/2015/04/09/teens-social-media-technology-2015/ [WebCite Cache]
    11. Mehl M. Why researchers should think "real-time": A cognitive rationale. In: Handbook of Research Methods for Studying Daily Life. New York: Guilford Press; 2013.
    12. Lin Y, Lin Y, Lee Y, Lin P, Lin S, Chang L, et al. Time distortion associated with smartphone addiction: Identifying smartphone addiction via a mobile application (App). J Psychiatr Res 2015 Jun;65:139-145. [CrossRef] [Medline]
    13. Moreno MA, Jelenchick L, Koff R, Eikoff J, Diermyer C, Christakis DA. Internet use and multitasking among older adolescents: An experience sampling approach. Computers in Human Behavior 2012 Jul;28(4):1097-1102. [CrossRef]
    14. Kobayashi T, Boase J. No Such Effect? The Implications of Measurement Error in Self-Report Measures of Mobile Communication Use. Communication Methods and Measures 2012 Apr;6(2):126-143. [CrossRef]
    15. Andrews S, Ellis DA, Shaw H, Piwek L. Beyond Self-Report: Tools to Compare Estimated and Real-World Smartphone Use. PLoS One 2015;10(10):e0139004 [FREE Full text] [CrossRef] [Medline]
    16. Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008;4:1-32. [Medline]
    17. Moskowitz DS, Young SN. Ecological momentary assessment: what it is and why it is a method of the future in clinical psychopharmacology. J Psychiatry Neurosci 2006 Jan;31(1):13-20 [FREE Full text] [Medline]
    18. Burke LE, Shiffman S, Music E, Styn MA, Kriska A, Smailagic A, et al. Ecological Momentary Assessment in Behavioral Research: Addressing Technological and Human Participant Challenges. J Med Internet Res 2017 Mar 15;19(3):e77 [FREE Full text] [CrossRef] [Medline]
    19. Stone AA, Mackie C, editors. Subjective well-being: Measuring happiness, suffering, and other dimensions of experience. In: Committee on National Statistics, Division of Behavioral and Social Sciences and Education. Washington, DC: National Academies Press; 2013:978.
    20. Len-Ríos ME, Hughes HE, McKee LG, Young HN. Early adolescents as publics: A national survey of teens with social media accounts, their media use preferences, parental mediation, and perceived Internet literacy. Public Relations Review 2016 Mar;42(1):101-108. [CrossRef]
    21. Falaki H, Mahajan R, Estrin D. SystemSens: a tool for monitoring usage in smartphone research deployments. Proceedings of the Sixth International Workshop on MobiArch - MobiArch 2011;11. [CrossRef]
    22. Soong A, Chen JC, Borzekowski DL. Using Ecological Momentary Assessment to Study Tobacco Behavior in Urban India: There's an App for That. JMIR Res Protoc 2015 Jun 24;4(2):e76 [FREE Full text] [CrossRef] [Medline]
    23. Lauricella AR, Cingel DP, Beaudoin-Ryan L, Robb MB, Saphir M, Wartella EA. Common Sense Media. 2016. The Common Sense census: Plugged-in parents of tweens and teens   URL: https:/​/www.​commonsensemedia.org/​research/​the-common-sense-census-plugged-in-parents-of-tweens-and-teens-2016 [accessed 2018-10-10] [WebCite Cache]
    24. Apple, Inc. Maximizing Battery Life and Lifespan   URL: https://www.apple.com/batteries/maximizing-performance/ [accessed 2018-03-29] [WebCite Cache]
    25. Torous J, Staples P, Onnela J. Realizing the potential of mobile mental health: new methods for new data in psychiatry. Curr Psychiatry Rep 2015 Aug;17(8):602 [FREE Full text] [CrossRef] [Medline]
    26. Tomlinson S, Behrmann S, Cranford J, Louie M, Hashikawa A. Accuracy of Smartphone-Based Pulse Oximetry Compared with Hospital-Grade Pulse Oximetry in Healthy Children. Telemed J E Health 2018 Jul;24(7):527-535. [CrossRef] [Medline]
    27. Karduck J, Chapman-Novakofski K. Results of the Clinician Apps Survey, How Clinicians Working With Patients With Diabetes and Obesity Use Mobile Health Apps. J Nutr Educ Behav 2018 Jan;50(1):62-69.e1. [CrossRef] [Medline]
    28. Zeng EY, Heffner JL, Copeland WK, Mull KE, Bricker JB. Get with the program: Adherence to a smartphone app for smoking cessation. Addict Behav 2016 Dec;63:120-124 [FREE Full text] [CrossRef] [Medline]
    29. Rathbone AL, Prescott J. The Use of Mobile Apps and SMS Messaging as Physical and Mental Health Interventions: Systematic Review. J Med Internet Res 2017 Aug 24;19(8):e295 [FREE Full text] [CrossRef] [Medline]
    30. Gower A, Moreno M. New Approaches to Understanding App Use among Adolescents. Journal of Adolescent Health 2018 Feb;62(2):S85. [CrossRef]
    31. United States Census Bureau. Washington; 2018. National Population by Characteristics 2010-2017   URL: https://www.census.gov/data/datasets/2017/demo/popest/nation-detail.html [accessed 2018-07-31] [WebCite Cache]


    Abbreviations

    BUS: battery use screenshot
    EMA: ecological momentary assessment


    Edited by G Eysenbach; submitted 20.05.18; peer-reviewed by Z Ma, D Romer, M Lucassen; comments to author 28.06.18; revised version received 06.08.18; accepted 27.08.18; published 19.11.18

    ©Aubrey D Gower, Megan A Moreno. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 19.11.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.