Background: Maximal oxygen consumption (VO2max) is one of the most predictive biometrics for cardiovascular health and overall mortality. However, VO2max is rarely measured in large-scale research studies or routine clinical care because of the high cost, participant burden, and requirement for specialized equipment and staff.
Objective: To overcome the limitations of clinical VO2max measurement, we aim to develop a digital VO2max estimation protocol that can be self-administered remotely using only the sensors within a smartphone. We also aim to validate this measure within a broadly representative population across a spectrum of smartphone devices.
Methods: Two smartphone-based VO2max estimation protocols were developed: a 12-minute run test (12-MRT) based on distance measured by GPS and a 3-minute step test (3-MST) based on heart rate recovery measured by a camera. In a 101-person cohort, balanced across age deciles and sex, participants completed a gold standard treadmill-based VO2max measurement, two silver standard clinical protocols, and the smartphone-based 12-MRT and 3-MST protocols in the clinic and at home. In a separate 120-participant cohort, the video-based heart rate measurement underlying the 3-MST was measured for accuracy in individuals across the spectrum skin tones while using 8 different smartphones ranging in cost from US $99 to US $999.
Results: When compared with gold standard VO2max testing, Lin concordance was pc=0.66 for 12-MRT and pc=0.61 for 3-MST. However, in remote settings, the 12-MRT was significantly less concordant with the gold standard (pc=0.25) compared with the 3-MST (pc=0.61), although both had high test-retest reliability (12-MRT intraclass correlation coefficient=0.88; 3-MST intraclass correlation coefficient=0.86). On the basis of the finding that 3-MST concordance was generalizable to remote settings whereas 12-MRT was not, the video-based heart rate measure within the 3-MST was selected for further investigation. Heart rate measurements in any of the combinations of the six Fitzpatrick skin tones and 8 smartphones resulted in a concordance of pc≥0.81. Performance did not correlate with device cost, with all phones selling under US $200 performing better than pc>0.92.
Conclusions: These findings demonstrate the importance of validating mobile health measures in the real world across a diverse cohort and spectrum of hardware. The 3-MST protocol, termed as heart snapshot, measured VO2max with similar accuracy to supervised in-clinic tests such as the Tecumseh (pc=0.94) protocol, while also generalizing to remote and unsupervised measurements. Heart snapshot measurements demonstrated fidelity across demographic variation in age and sex, across diverse skin pigmentation, and between various iOS and Android phone configurations. This software is freely available for all validation data and analysis code.
Expanding access to precision medicine will increasingly require patient biometrics to be measured in remote care settings. Traditionally, cardiovascular health has been assessed using risk scores such as the Framingham Risk Score , Reynolds Risk Score [ ], Qrisk [ ], and others, which integrate multiple factors including demographic data, comorbidities, and biometrics paired with imaging-based assessments measuring vascular blockage and blood flow in higher-risk and symptomatic individuals. Although these factors have a clear correlation with cardiovascular health, their inclusion in integrative risk calculations was promoted in part because they can be rapidly evaluated across many individuals. However, one of the most predictive biometrics for cardiovascular health [ ] and overall mortality [ ], maximal oxygen consumption (VO2max), is typically not incorporated in these risk calculators because of the high cost, participant burden, and specialized equipment and staff needed to obtain this measurement [ , ].
Cardiorespiratory fitness, as measured by VO2max, represents the integrated function of physiological systems involved in transporting oxygen from the atmosphere to the skeletal muscles to perform physical work. Existing gold standard techniques for measuring VO2max are based on protocols that use exercise on a treadmill or stationary bicycle paired with the direct measurement of oxygen consumption at various workloads, including maximal exertion [, ]. However, the requirement to exercise at the maximal aerobic threshold limits deployment in some populations for safety reasons, and the need for specialized equipment and personnel has prohibited widespread adoption of VO2max testing in research and clinical settings.
Limitations of gold standard VO2max measurements have led to the development of numerous ”silver standard”  VO2max estimation protocols that rely on simpler equipment or submaximal levels of exertion. These protocols trade off measurement accuracy for ease of deployment in a wider range of settings and for populations with differing levels of capacity [ ]. However, these protocols were typically developed and validated in small, homogeneous populations, and some subsequent validation studies have been criticized for demonstrating participant selection bias [ ]. To overcome these limitations, we aim to develop a digital VO2max estimation protocol that could be self-administered remotely using only the sensors within a smartphone, and we also aim to validate this measure within a broadly representative population. Previous efforts have used a smartphone-based approach to measure VO2max, but these validation studies are rarely conducted outside of clinical settings [ ]. Therefore, we aim to validate our measurements in remote, unsupervised real-world settings.
Development of Smartphone Sensor–Based Measurements of VO2max
Two silver standard VO2max estimation protocols were chosen as the basis for developing the smartphone tests. The first is the Cooper protocol , comprising a 12-minute run test (12-MRT), where individuals cover as much distance as possible in 12 minutes on a flat course. The Cooper protocol estimates VO2max from the total distance traveled during the 12 minutes. The other is the Tecumseh protocol [ ], which comprises a 3-minute step test (3-MST), where individuals step up and down an 8-inch step at a constant rate for 3 minutes. In the 3-MST protocol, VO2max was estimated from the heart rate measurements during the recovery period. In adopting these protocols for smartphones, we developed self-guided instructions with GPS to record distance during the 12-MRT and a smartphone camera to record heart rate during recovery for the 3-MST ( ).
VO2max Validation Cohort Procedures and Measures
All study procedures were approved by the University of California, San Diego (UCSD) Institutional Review Board (approval number 171815). All participants provided written informed consent and attended two in-person study visits at the Exercise and Physical Activity Resource Center (EPARC).
A convenience sample of 101 adults aged between 20 and 79 years was recruited, largely balanced across age deciles and sex (). Potential participants were contacted by trained EPARC staff via email or telephone and they underwent a screening to ascertain their eligibility. Participants were included if they were (1) able to consent and participate in the study using English; (2) aged between 20 and 79 years; (3) willing and able to attend two in-person study visits that included either a VO2max test or a 12-MRT and a 3-MST within a 2-week period; (4) willing and able to undertake up to three 12-MRT and 3-MST at home over a 2-week period; (5) willing and able to download the smartphone app developed to measure cardiorespiratory fitness on a compatible Android or iOS device and use it during all tests over a 2-week period; and (6) willing and able to download the Fitbit smartphone app on a compatible Android or iOS device and connect and wear a study-provided Fitbit Charge 2 during all tests over a 2-week period. Participants were excluded if they (1) were >12 weeks pregnant; (2) had a heart or cardiovascular condition, including coronary artery disease, congestive heart failure, diagnosed abnormality of heart rhythm, atrial fibrillation, and/or a history of myocardial infarction; (3) required the use of an external device to assist heart rhythm (eg, a pacemaker); (4) had a serious respiratory disease, including chronic obstructive pulmonary disease, exercise-induced asthma, and/or pulmonary high blood pressure; (5) required use of supplemental oxygen; (6) required use of a beta-blocker or other medications known to alter heart rate; and (7) answered “yes” to one or more questions in the American College of Sports Medicine’s Physical Activity Readiness Questionnaire and/or reported two or more risk factors for exercise testing and did not receive subsequent medical clearance. The Physical Activity Readiness Questionnaire is a widely accepted tool used to assess an individual’s fitness for tests involving cardiovascular exercise [ ].
Upon completion of the telephone screening (and, if necessary, receipt of medical clearance), potential participants were scheduled to attend the first testing session at the UCSD. They were asked to report to the testing session well hydrated and in an athletic attire. Participants were guided through the process of downloading and installing the smartphone app developed to measure cardiorespiratory fitness, as well as the Fitbit smartphone app, and they were fitted with a wrist-worn Fitbit Charge 2 according to the manufacturer’s recommendations. Participants were asked to provide their age, sex at birth, ethnicity, and race. Weight (to the nearest 0.1 kg) and height (to the nearest 0.1 cm) were measured using a calibrated digital scale and stadiometer (Seca 703, Seca GmbH & Co. KG). Both weight and height were measured with participants wearing lightweight clothes without shoes, and two separate measurements were averaged (if weight or height measurements differed by more than 1%, then a third measure was taken, and the average of the two measures that differed by less than 0.2 kg or 0.5 cm, respectively, was used).
At the first testing session, participants either undertook a VO2max test or an in-clinic 3-MST and 12-MRT. A randomization procedure implemented before the scheduling of the first testing session determined which test procedure participants undertook during the first testing session. The participants were then expected to complete the other test procedures during the second testing session.
Treadmill-Based Gold Standard VO2max Measurement
Participants completed a maximal graded exercise test on a Woodway 4Front treadmill (Woodway) calibrated monthly for accuracy of speed and grade. The maximal graded exercise test protocol began with a warm-up at a self-selected pace on a treadmill for 5 to 10 minutes. During the warm-up, EPARC staff explained how to use the Borg Rating of Perceived Exertion scale and reminded participants that they were expected to achieve their maximal level of exertion .
The participants were then equipped with a breath mask that covered the nose and mouth (KORR Medical Technologies) and a Bluetooth-enabled heart rate monitor worn on the chest (Garmin). The preprogrammed treadmill protocol began with the participants running at 5 mph with a 0% incline for 3 minutes. The workload was then increased by approximately 0.75, which is the metabolic equivalent of tasks every minute. This was achieved via an increase in speed (0.5 mph per min) each minute until the participant was 0.5 mph above their self-determined comfortable speed or until a maximal speed of 9 mph was reached. If the participant’s capacity allowed them to continue beyond this upper speed limit before reaching volitional fatigue, then the treadmill speed was kept constant, but the grade (ie, incline) of the treadmill was increased by 1% each minute until volitional fatigue was reached. The Borg Rating of Perceived Exertion scale was assessed during the final 10 seconds of each minute, and the protocol continued until the participant signaled to stop (ie, indication of volitional fatigue). Upon indication of volitional fatigue, the treadmill was immediately slowed to 2 mph, and participants were encouraged to walk until completely recovered. Breath-by-breath oxygen uptake (VO2) was continuously measured using an indirect calorimeter (COSMED) that was calibrated for gas volume and fractional composition immediately (ie, <30 min) before the start of the maximal graded exercise test protocol.
Tecumseh Test (3-MST) and Cooper Test (12-MRT) In-Clinic Procedure
All participants were fitted with a chest-worn heart rate monitor (Polar) that was used for real-time monitoring by trained EPARC staff throughout both the 12-MRT and 3-MST. For the 3-MST, participants were instructed to step up and down from a single step 8 inches in height at a rate of 24 steps per minute for 3 minutes . The cadence of stepping was monitored by trained EPARC staff. The radial pulse was measured from the 31st second to the 60th second after 3 minutes of stepping. Upon completion of the test, the participants were asked to sit in a chair and rest. After a minimum of 10 minutes of rest, participants completed a 5-minute self-determined light intensity warm-up. They were then instructed to cover as much distance as possible on a flat 400-m track for 12 minutes. The distance traveled was measured after 12 minutes [ ].
Distance Estimation Using Privacy-Preserving GPS Data
The distance recorded by the smartphone during the 12-MRT was validated against the actual distance. The smartphone recorded displacement information sampled at 1 Hz, which consists of relative location measurements, that is, the change in location with regard to the last recorded measurement. The iPhones (Apple Inc) measured displacement in meters whereas the Android smartphones measured relative changes in latitude and longitude, requiring an estimate of the absolute latitude and longitude to be added back into the measurements to obtain an accurate estimate of distance.
The first distance estimation method entailed summing the Euclidean distances between subsequent GPS points. As GPS measurements have a range error dependent on atmospheric effects and numerical errors, a second method was used to compute the distance after smoothing the trajectory of the GPS path using a Savitzky-Golay smoothing filter.
Camera-Based Heart Rate Estimation
Blood flow through the fingertip was measured through video with a rear-facing camera while the flash was on. The resting heart rate was captured with 20 seconds of recording, whereas the 3-MST required 60 seconds of recording. During the capture, we found it was important to fix the focal length to infinity, turn off any high dynamic range settings (if applicable), and set the frame rate to 60 Hz if possible, and if not, the default highest allowed by the phone. We did not record the video in order to preserve privacy associated with the inadvertent capture of identifiable objects in the frame before covering the lens with the finger, but instead summarized each video frame to the mean of all pixel intensities per color channel in the red, green, blue space.
These intensities yielded three time series, one for each color. These time series were filtered and mean-centered before being split into shorter 10-second windows. By assuming a periodic signal for these windows, the autocorrelation function (ACF) was used to estimate the period by finding the peaks and their corresponding lags. The relative magnitude of the peaks to the maxima of the ACF was used to generate a confidence score, which quantifies the extent to which the signal is periodic or if the peak at the fundamental frequency (ie, the peak with the highest magnitude) is a spurious peak. The ACF is calculated over a 10-second window, as this provides sufficient heart beat observations postprocessing to estimate heart rates ranging from 45 to 210 bpm.
To filter potentially spurious peaks, a magnitude threshold relative to the magnitude of the peak at zero lag was used. The confidence score was calculated as the ratio of the magnitude of the peak corresponding to the fundamental frequency to the next peak. The confidence score is an indicator of the periodicity of the signal, a property indicative of the heart rate signal in a short finite time window. The different color channels were merged by choosing the heart rate estimate from the channel (red or green) that had the maximum confidence score within a given window.
Estimation of VO2max
3-Minute Step Test
Multiple formulas for predicting VO2max from the Tecumseh step test and its variations have been developed ; here, we used the following established by Milligan [ ]:
where HB3060 is the number of beats between 30 and 60 seconds after the step test, age is the age of the subject, and sex is 0 if male and 1 if female.
12-Minute Run Test
VO2max for the 12-MRT is estimated from the following formula, where d12 is the distance covered in meters :
Heart Rate Calibration Study Procedures and Measures
All study procedures were approved by the UCSD Institutional Review Board (approval number 181820). All participants provided written informed consent and attended one in-person study visit at the EPARC.
A convenience sample of 120 adults, aged 18-65 years, of six different skin types were asked to participate in this study. We aimed to recruit an equal ratio of male and female participants, as well as an equal number of participants with each skin type, as determined by the Fitzpatrick scale. Participants were included if they were (1) able to consent and participate in the study in English and (2) aged between 18 and 65 years. Participants were excluded if they had (1) peripheral neuropathy or (2) tattoos or scarring at the measurement site (index finger and/or wrist). Potential participants were contacted by trained EPARC staff via email or telephone, and they were asked to complete the screening to ascertain their eligibility.
To establish the Fitzpatrick skin type of the cohort during recruitment, participants were asked to self-assess their Fitzpatrick skin type based on visual comparison with images of well-known celebrities with diverse pigmentation levels. As self-assessment of skin type can have variable accuracy [, ], spectrocolorimetry was also used as an objective standard [ ]. Spectrocolorimetry measurements were performed on the underside of the jaw using Pantone RM200QC. To calculate pigmentation in the individual typology angle color space, the L* and b* parameters from the spectrocolorimetry measurements were used according to the formula:
individual typology angle = [arctan((L*−50)/b*)] × 180/3.14159 (1)
Using this formula, skin color types can be classified into six groups, ranging from very light to dark skin: very light>55°>light>41°>intermediate>28°>tan>10°>brown>−30°>dark .
Upon completion of the telephone screening, potential participants were scheduled to attend the first testing session at the UCSD. Participants were asked to provide their age, sex at birth, ethnicity, and race. All participants were fitted with a chest-worn heart rate monitor that was used for real-time monitoring by trained EPARC staff throughout testing. Heart rate was also monitored using a finger-based pulse oximeter (Nonin Medical, Inc). The finger-based pulse oximeter was attached to the participants’ index finger, and the time was synchronized between the computer and the device. Trained research staff visually confirmed that the photoplethysmograph was reading accurately before starting measurements on smartphone devices.
Participants were then given the first of 8 smartphones: Huawei Mate SE, LG Stylo 4, Moto G6 Play, Samsung Galaxy J7, Samsung Galaxy S9+, iPhone8+, iPhoneSE, and iPhoneXS. They were instructed by trained research staff to stand still and gently cover the camera and flash on the back of the smartphone with their fingertip, as their heart rate was captured by our preloaded smartphone app. The time on the Polar app was recorded at the time the measurement began on the smartphone app. Measurements with each smartphone lasted 60 seconds in duration. Processed data from the finger-based pulse oximeter were parsed and transformed with custom scripts to generate continuous photoplethysmography data in a format suitable for comparison with the heart rates from the phones.
Demographic data were described using univariate summary statistics (eg, proportions, means, and SDs). Test validity for heart rate estimates and VO2max was visualized using Bland-Altman plots  and compared using the Lin concordance index [ ]. The heart rate errors were also compared using percent error. Analyses were performed in both R and Python.
iOS and Android Heart Snapshot Software Modules
The code for the heart snapshot modules and sample Android  and iOS [ ] apps are available under an open-source license.
Validation in a Clinical Setting
To assess the validity of the 3-MST and 12-MRT smartphone measurements, gold standard VO2max treadmill testing was performed with 101 participants distributed across age deciles 20-80 years. Every participant also performed the silver standard and smartphone 12-MRT and 3-MST protocols in the clinic, with three instances of each smartphone protocol performed over 2 weeks without supervision in the participant’s home environment ().
The in-clinic 12-MRT distance was measured on a 400-m track and by the smartphone GPS. The in-clinic heart rate was measured via radial pulse by trained research staff, a chest-worn Polar heart monitor, a wrist-worn Fitbit Charge 2, and a smartphone camera with the flash activated. Comparisons between the gold standard, silver standard, and smartphone-based protocols for VO2max estimation were performed using Bland-Altman analysis  and the Lin concordance index (pc). The concordance between gold standard VO2max and the silver standard Cooper protocol (pc=0.61; ) and the silver standard Tecumseh protocol (pc=0.70; ) were in line with previously published results [ - ]. Concordance of smartphone-based protocols with gold standard VO2max testing was pc=0.66 for the 12-MRT ( ) and pc=0.61 for the 3-MST ( ). The concordance of smartphone-based protocols with silver standard protocols was pc=0.96 for the 12-MRT and pc=0.94 for the 3-MST. These results demonstrate that the smartphone-based protocols fall short of recapitulating gold standard VO2max testing but are highly concordant with validated silver standard VO2max estimation protocols in a laboratory setting.
Validation in a Remote Setting
To investigate whether the concordance of in-clinic measurements would generalize to remote and unsupervised settings, the smartphone protocols were also performed up to three times at home by each participant. We observed an approximately equal test-retest reliability between the two tests (3-MST intraclass correlation coefficient=0.86; 12-MRT intraclass correlation coefficient=0.88). However, although the 3-MST translated well to an unsupervised setting (pc=0.61;), the 12-MRT demonstrated a pronounced drop in concordance (pc=0.25; ), despite a highly accurate distance measurement from the smartphone (pc=0.96) based on comparisons made in a clinical setting.
As the 12-MRT is dependent on maximal effort, participants were surveyed directly after their run about their performance. In 63.4% (137/216) of runs performed remotely, participants reported the run to be “their best effort.” Therefore, only 137 runs were used to estimate VO2max in our analysis.captures the results of all 216 runs subdivided by self-reported effort. Although the context-dependent failure of the 12-MRT in remote settings may be attributable to many factors, this result highlights the importance of both clinical and unsupervised real-world evidence for the validation of novel digital health measurement modalities.
Calibration of the Heart Snapshot Measurement for a Diverse Audience
The smartphone-based 3-MST protocol, hereafter referred to as heart snapshot, was generalizable between clinical and remote assessments and was robust over a large range of fitness levels. Maintaining high concordance during unsupervised measurements is necessary to achieve the scale intended for the targeted 1 million participants in the All of Us Research Program (AoURP) , which will use a “bring-your-own-device” strategy for remote self-measurement of VO2max. AoURP also aims to recruit a study population matching the full demographic diversity of the United States, emphasizing the inclusion of groups often underrepresented in biomedical research, such as ethnic and racial minorities. As prior studies have shown differing results as to whether optical techniques for heart rate detection (photoplethysmography) can be demographically biased [ , ], we aimed to investigate any differences in heart snapshot accuracy across variations in skin tone. A follow-up calibration study for heart rate measurements was conducted with 120 participants distributed approximately evenly across defined Fitzpatrick skin types [ ], using 8 different smartphones (3 iPhones and 5 Android smartphones ranging in cost from US $99 to US $999 at the time of writing). These phones were chosen to be representative of different operating systems, quality of sensors, processing speed, and camera configuration. Importantly, we observed no significant difference in heart rate measurement accuracy between categorical Fitzpatrick skin types or systematic measurement error proportional to skin color at either end of the spectrum ( ).
Internal Quality Control Procedures for Heart Snapshot
To facilitate quality control of the measurements across different smartphones, a confidence score was developed to provide a readout of the quality of the heart rate measurements. This confidence score is derived from the ACF of the heart rate signal across 10-second measurement windows. Using the calibration study results, a balance between the quality of measurements was weighed against the loss of data by choosing a filtration cutoff at a confidence level of ≥0.5. This resulted in a pc=0.95, in the calibration cohort between a pulse oximetry pulse measurement and the camera-estimated heart rate (). In selecting this confidence score as a cutoff, we observed that 80.41% (28,032/34,859) of all measurement windows were retained in this calibration cohort ( ). The same cutoff was used in the validation of heart snapshot against gold standard VO2max, where the heart rate concordance with a chest-worn Polar heart monitor was pc=0.95 and pc=0.83 when compared with a wrist-worn Fitbit Charge 2, both at home and in the clinic. This can be compared with pc=0.92 between Polar and Fitbit Charge 2 ( ).
Taken together, heart snapshot heart rate measurements in any of the combinations of the Fitzpatrick skin tones and 8 smartphones used in the calibration study resulted in a concordance greater than or equal to pc=0.84 (), which is in line with previous smartphone-based modalities for heart rate monitoring [ ]. Importantly, performance did not correlate with device cost, with all phones selling for under US $200 performing better than pc>0.92 for any skin tone.
In summary, heart snapshot measured VO2max with similar accuracy to supervised, in-clinic tests such as the Tecumseh or Cooper protocols, while also generalizing to remote and unsupervised measurements. Heart snapshot measurements demonstrated fidelity across demographic variation in age and sex, across diverse skin pigmentation, and between various iOS and Android phone configurations.
The results from our validation study performed in unsupervised, remote environments showed that heart snapshot, which is based on a 3-MST protocol, generalized to real-world settings but the 12-MRT protocol did not. Although it is difficult to definitively determine the reason for the poor concordance of 12-MRT, we suspect that this might be attributed to the Hawthorne effect, where people perform better when they are under constant observation at a track. It could also be purely environmental, where traffic, hills, and distractions impede uninterrupted running. This indicates the importance of testing and validating digital health measures in a representative setting.
An important limitation of this study is that we did not include any individuals in our cohort with a known irregular heart rhythm, so we cannot extend our claims of validity to that population. Similarly, although we made efforts to include individuals across different age deciles, we focused solely on adults (aged over 18 years) and our age decile from 60 to 70 years did not include participants older than 65 years. This work was limited to the biometrics of resting heart rate and VO2max, but using the same technology could also be extended to measure heart rate recovery in minute intervals after exertion, which would provide a valuable biometric that has been associated with prediction of overall mortality . Heart snapshot attempts to maximize concordance with gold standard methods for estimating VO2max, but it is worth noting that this analysis used an existing validated algorithm [ ] that was based on in-clinic procedures and measurement tools. Heart snapshot could become more personalized than traditional protocols, for example, adapting to a participant’s maximum step cadence as measured by smartphone accelerometry. Further concordance with gold standard measures may be achieved by optimizing the parameters of the traditional algorithm or including new variables, but this will require a distinct cohort to test any models that have been trained on this data set.
Comparison With Prior Work
Although multiple devices can estimate VO2max, including several currently marketed consumer devices , the underlying data and algorithms are usually not published. The lack of data and method transparency limits the utility of these approaches for discovery-based research, where reproducibility is paramount. In contrast, an open approach to method validation can also serve as a foundation for downstream research in different conditions or populations to generate normative data for interpreting results [ ].
As many dedicated hardware devices for digital health in the consumer sphere have experienced short half-lives of availability, we believe that the dependency only on a smartphone with a flash and camera may provide a greater degree of future-proofing for heart snapshot. This will be important for consistent, longitudinal measurements that may uncover patterns of VO2max variance over time, especially in large-scale studies such as the AoURP.
The emerging development of consumer technology provides unprecedented opportunities to evaluate the use of additional digital biomarkers to improve risk management strategies for population health and for precision health at the level of an individual. Paired with access to large population studies, such as the AoURP  that collects health questionnaires, electronic health records, physical measurements, biospecimens, and digital health technology data, we can rapidly test emerging digital health measures for their potential to advance precision medicine. The heart snapshot software is freely available with all validation data and analysis code [ ].
The authors would like to acknowledge Steve Steinhubl, Shannon Young, Nathaniel Brown, Joshua Liu, Erin Mounts, Stockard Simon, and Woody MacDuffie for their contributions to this work. Data are made available through Synapse (DOI: 10.7303/syn22107959).
DEW and LO wrote the first draft of the paper. LO, MK, and JG developed the study and protocol, and MT developed algorithms for heart rate measurements. LO and MT performed the analyses. MH, DW, and JG recruited the participants and performed all measurements in the laboratory. MK and DEW oversaw the design and development of the heart snapshot apps. EA, VK, MVM, EM, JO, and LM helped identify the protocols for generalization, provided expert input, and edited the paper together with MK, LO, JG, DW, MT, MH, and DEW. LO and MK contributed equally to this study
Conflicts of Interest
EA is a founder and advisor for Personalis and Deep Cell and collaborates scientifically with Apple Inc. MVM is currently employed at Google.
Self-guided instructions and screen workflow for performing the heart snapshot VO<sub>2</sub>max estimate.PNG File , 223 KB
Demographic data for the maximal oxygen consumption validation study.XLSX File (Microsoft Excel File), 29 KB
- Wilson PW, D'Agostino RB, Levy D, Belanger AM, Silbershatz H, Kannel WB. Prediction of coronary heart disease using risk factor categories. Circulation 1998 May 12;97(18):1837-1847. [CrossRef] [Medline]
- Ridker PM, Buring JE, Rifai N, Cook NR. Development and validation of improved algorithms for the assessment of global cardiovascular risk in women: the Reynolds Risk Score. J Am Med Assoc 2007 Feb 14;297(6):611-619. [CrossRef] [Medline]
- Hippisley-Cox J, Coupland C, Brindle P. Development and validation of QRISK3 risk prediction algorithms to estimate future risk of cardiovascular disease: prospective cohort study. Br Med J 2017 May 23;357:j2099 [FREE Full text] [CrossRef] [Medline]
- Laukkanen JA, Rauramaa R, Salonen JT, Kurl S. The predictive value of cardiorespiratory fitness combined with coronary risk evaluation and the risk of cardiovascular and all-cause death. J Intern Med 2007 Aug;262(2):263-272 [FREE Full text] [CrossRef] [Medline]
- Mandsager K, Harb S, Cremer P, Phelan D, Nissen SE, Jaber W. Association of cardiorespiratory fitness with long-term mortality among adults undergoing exercise treadmill testing. JAMA Netw Open 2018 Oct 05;1(6):e183605 [FREE Full text] [CrossRef] [Medline]
- Ross R, Blair SN, Arena R, Church TS, Després J, Franklin BA, American Heart Association Physical Activity Committee of the Council on LifestyleCardiometabolic Health, Council on Clinical Cardiology, Council on EpidemiologyPrevention, Council on CardiovascularStroke Nursing, Council on Functional GenomicsTranslational Biology, Stroke Council. Importance of assessing cardiorespiratory fitness in clinical practice: a case for fitness as a clinical vital sign: a scientific statement from the American Heart Association. Circulation 2016 Dec 13;134(24):653-699. [CrossRef] [Medline]
- Guo Y, Bian J, Li Q, Leavitt T, Rosenberg EI, Buford TW, et al. A 3-minute test of cardiorespiratory fitness for use in primary care clinics. PLoS One 2018;13(7):e0201598 [FREE Full text] [CrossRef] [Medline]
- Rippe JM, editor. Guidelines for exercise testing and prescription (ACSM). In: Encyclopedia of Lifestyle Medicine and Health. Thousand Oaks, California, United States: SAGE Publications Inc; 2012:1-1296.
- Balady GJ, Arena R, Sietsema K, Myers J, Coke L, Fletcher GF, et al. Clinician’s guide to cardiopulmonary exercise testing in adults. Circulation 2010 Jul 13;122(2):191-225 [FREE Full text] [CrossRef]
- McDavid A, Crane PK, Newton KM, Crosslin DR, McCormick W, Weston N, et al. Enhancing the power of genetic association studies through the use of silver standard cases derived from electronic medical records. PLoS One 2013;8(6):e63481 [FREE Full text] [CrossRef] [Medline]
- Noonan V, Dean E. Submaximal exercise testing: clinical application and interpretation. Phys Ther 2000 Aug;80(8):782-807. [Medline]
- Bennett H, Parfitt G, Davison K, Eston R. Validity of submaximal step tests to estimate maximal oxygen uptake in healthy adults. Sports Med 2016 May;46(5):737-750. [CrossRef] [Medline]
- Muntaner-Mas A, Martinez-Nicolas A, Lavie CJ, Blair SN, Ross R, Arena R, et al. A systematic review of fitness apps and their potential clinical and sports utility for objective and remote assessment of cardiorespiratory fitness. Sports Med 2019 Apr;49(4):587-600 [FREE Full text] [CrossRef] [Medline]
- Cooper KH. A means of assessing maximal oxygen intake. Correlation between field and treadmill testing. J Am Med Assoc 1968 Jan 15;203(3):201-204. [Medline]
- Hughes AD, Chaturvedi N. Estimation of maximal oxygen consumption and heart rate recovery using the tecumseh sub-maximal step test and their relationship to cardiovascular risk factors. Artery Res 2017 Jun;18:29-35 [FREE Full text] [CrossRef] [Medline]
- Goodman JM, Thomas SG, Burr J. Evidence-based risk assessment and recommendations for exercise testing and physical activity clearance in apparently healthy individuals. Appl Physiol Nutr Metab 2011 Jul;36 Suppl 1:14-32. [CrossRef] [Medline]
- Borg GA. Psychophysical bases of perceived exertion. Med Sci Sports Exerc 1982;14(5):377-381. [Medline]
- Montoye HJ, Block W, Keller JB, Willis PW. Fitness, fatness, and serum cholesterol: an epidemiological study of an entire community. Res Q Am Allian Health Phy Edu Recreat 2013 Mar 17;47(3):400-408 [FREE Full text] [CrossRef]
- Milligan G. Fitness standards for the Maritime and Coastguard Agency and the oil and gas industry. University of Portsmouth. 2013. URL: https://pdfs.semanticscholar.org/739c/d165a84c7d7146a745580d0ad8e593f4dd3c.pdf [accessed 2021-05-13]
- Eilers S, Bach DQ, Gaber R, Blatt H, Guevara Y, Nitsche K, et al. Accuracy of self-report in assessing Fitzpatrick skin phototypes I through VI. JAMA Dermatol 2013 Nov;149(11):1289-1294. [CrossRef] [Medline]
- Reeder AI, Hammond VA, Gray AR. Questionnaire items to assess skin color and erythemal sensitivity: reliability, validity, and "the dark shift". Cancer Epidemiol Biomarkers Prev 2010 May;19(5):1167-1173 [FREE Full text] [CrossRef] [Medline]
- Bino SD, Bernerd F. Variations in skin colour and the biological consequences of ultraviolet radiation exposure. Br J Dermatol 2013 Oct;169 Suppl 3:33-40. [CrossRef] [Medline]
- Bland JM, Altman D. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986 Feb;327(8476):307-310. [CrossRef]
- Lin LI. A concordance correlation coefficient to evaluate reproducibility. Biometrics 1989 Mar;45(1):255. [CrossRef]
- CardiorespiratoryFitness-Android. Sage-Bionetworks. URL: https://github.com/Sage-Bionetworks/CardiorespiratoryFitness-Android [accessed 2020-11-24]
- CardiorespiratoryFitness-iOS. Sage-Bionetworks. URL: https://github.com/Sage-Bionetworks/CardiorespiratoryFitness-iOS [accessed 2020-11-24]
- Milligan G, House J, Tipton M, Hildenbrand B, Maeso M. A recommended fitness standard for the oil and gas industry. In: Proceedings of the European HSE Conference and Exhibition. 2013 Presented at: European HSE Conference and Exhibition; April 2013; London, United Kingdom. [CrossRef]
- Bandyopadhyay A. Validity of Cooper's 12-minute run test for estimation of maximum oxygen uptake in male university students. Biol Sport 2015 Mar;32(1):59-63 [FREE Full text] [CrossRef] [Medline]
- Weisgerber M, Danduran M, Meurer J, Hartmann K, Berger S, Flores G. Evaluation of Cooper 12-minute walk/run test as a marker of cardiorespiratory fitness in young urban children with persistent asthma. Clin J Sport Med 2009 Jul;19(4):300-305. [CrossRef] [Medline]
- All of Us Research Program Investigators, Denny JC, Rutter JL, Goldstein DB, Philippakis A, Smoller JW, et al. The "All of Us" research program. N Engl J Med 2019 Aug 15;381(7):668-676. [CrossRef] [Medline]
- Shcherbina A, Mattsson CM, Waggott D, Salisbury H, Christle JW, Hastie T, et al. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. J Pers Med 2017 May 24;7(2):3 [FREE Full text] [CrossRef] [Medline]
- Bent B, Goldstein BA, Kibbe WA, Dunn JP. Investigating sources of inaccuracy in wearable optical heart rate sensors. NPJ Digit Med 2020;3:18 [FREE Full text] [CrossRef] [Medline]
- Fitzpatrick TB. The validity and practicality of sun-reactive skin types I through VI. Arch Dermatol 1988 Jun;124(6):869-871. [CrossRef] [Medline]
- Ridder BD, Van Rompaey B, Kampen JK, Haine S, Dilles T. Smartphone apps using photoplethysmography for heart rate monitoring: meta-analysis. JMIR Cardio 2018 Feb 27;2(1):e4 [FREE Full text] [CrossRef] [Medline]
- Klepin K, Wing D, Higgins M, Nichols J, Godino JG. Validity of cardiorespiratory fitness measured with Fitbit compared to V˙O2max. Med Sci Sports Exerc 2019 Nov;51(11):2251-2256 [FREE Full text] [CrossRef] [Medline]
- Avram R, Tison GH, Aschbacher K, Kuhar P, Vittinghoff E, Butzner M, et al. Real-world heart rate norms in the Health eHeart study. NPJ Digit Med 2019;2:58 [FREE Full text] [CrossRef] [Medline]
- CRF validation analysis. Sage-Bionetworks. URL: https://github.com/Sage-Bionetworks/CRF_validation_analysis [accessed 2020-11-06]
|3-MST: 3-minute step test|
|12-MRT: 12-minute run test|
|ACF: autocorrelation function|
|AoURP: All of Us Research Program|
|EPARC: Exercise and Physical Activity Resource Center|
|UCSD: University of California, San Diego|
|VO2max: maximal oxygen consumption|
Edited by L Buis; submitted 24.11.20; peer-reviewed by M Altini, CP Lau; comments to author 11.01.21; revised version received 04.02.21; accepted 12.04.21; published 04.06.21Copyright
©Dan E Webster, Meghasyam Tummalacherla, Michael Higgins, David Wing, Euan Ashley, Valerie E Kelly, Michael V McConnell, Evan D Muse, Jeffrey E Olgin, Lara M Mangravite, Job Godino, Michael R Kellen, Larsson Omberg. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 04.06.2021.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.