This paper is in the following e-collection/theme issue:

Digital Biomarkers and Digital Phenotyping (191) Clinical Information and Decision Making (1407) Decision Support for Health Professionals (1185) Machine Learning (1465) Ecological Momentary Assessment (EMA) (309) Depression and Mood Disorders; Suicide Prevention (1363)

Published on in Vol 7, No 10 (2019): October

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/14149, first published .
Depression Prediction by Using Ecological Momentary Assessment, Actiwatch Data, and Machine Learning: Observational Study on Older Adults Living Alone

Depression Prediction by Using Ecological Momentary Assessment, Actiwatch Data, and Machine Learning: Observational Study on Older Adults Living Alone

Depression Prediction by Using Ecological Momentary Assessment, Actiwatch Data, and Machine Learning: Observational Study on Older Adults Living Alone

Authors of this article:

Heejung Kim1, 2 Author Orcid Image ;   SungHee Lee3 Author Orcid Image ;   SangEun Lee4 Author Orcid Image ;   Soyun Hong1 Author Orcid Image ;   HeeJae Kang3 Author Orcid Image ;   Namhee Kim1 Author Orcid Image
Article Authors Cited by (74) Tweetations (8) Metrics

    Original Paper

    1College of Nursing, Yonsei University, Seoul, Republic of Korea

    2Mo-Im Kim Nursing Research Institute, Yonsei University, Seoul, Republic of Korea

    3BRFrame Inc, Seoul, Republic of Korea

    4Health-IT Acceleration Platform Technology Innovation Center, College of Medicine, Yonsei University Health System, Seoul, Republic of Korea

    Corresponding Author:

    Heejung Kim, GNP-BC, RN, PhD

    College of Nursing

    Yonsei University

    Room #603

    50-1 Yonsei-ro, Seodaemun-gu

    Seoul, 03722

    Republic of Korea

    Phone: 82 2 2228 3273

    Fax:82 2 2227 8303

    Email: hkim80@yuhs.ac


    Background: Although geriatric depression is prevalent, diagnosis using self-reporting instruments has limitations when measuring the depressed mood of older adults in a community setting. Ecological momentary assessment (EMA) by using wearable devices could be used to collect data to classify older adults into depression groups.

    Objective: The objective of this study was to develop a machine learning algorithm to predict the classification of depression groups among older adults living alone. We focused on utilizing diverse data collected through a survey, an Actiwatch, and an EMA report related to depression.

    Methods: The prediction model using machine learning was developed in 4 steps: (1) data collection, (2) data processing and representation, (3) data modeling (feature engineering and selection), and (4) training and validation to test the prediction model. Older adults (N=47), living alone in community settings, completed an EMA to report depressed moods 4 times a day for 2 weeks between May 2017 and January 2018. Participants wore an Actiwatch that measured their activity and ambient light exposure every 30 seconds for 2 weeks. At baseline and the end of the 2-week observation, depressive symptoms were assessed using the Korean versions of the Short Geriatric Depression Scale (SGDS-K) and the Hamilton Depression Rating Scale (K-HDRS). Conventional classification based on binary logistic regression was built and compared with 4 machine learning models (the logit, decision tree, boosted trees, and random forest models).

    Results: On the basis of the SGDS-K and K-HDRS, 38% (18/47) of the participants were classified into the probable depression group. They reported significantly lower scores of normal mood and physical activity and higher levels of white and red, green, and blue (RGB) light exposures at different degrees of various 4-hour time frames (all P<.05). Sleep efficiency was chosen for modeling through feature selection. Comparing diverse combinations of the selected variables, daily mean EMA score, daily mean activity level, white and RGB light at 4:00 pm to 8:00 pm exposure, and daily sleep efficiency were selected for modeling. Conventional classification based on binary logistic regression had a good model fit (accuracy: 0.705; precision: 0.770; specificity: 0.859; and area under receiver operating characteristic curve or AUC: 0.754). Among the 4 machine learning models, the logit model had the best fit compared with the others (accuracy: 0.910; precision: 0.929; specificity: 0.940; and AUC: 0.960).

    Conclusions: This study provides preliminary evidence for developing a machine learning program to predict the classification of depression groups in older adults living alone. Clinicians should consider using this method to identify underdiagnosed subgroups and monitor daily progression regarding treatment or therapeutic intervention in the community setting. Furthermore, more efforts are needed for researchers and clinicians to diversify data collection methods by using a survey, EMA, and a sensor.

    JMIR Mhealth Uhealth 2019;7(10):e14149

    doi:10.2196/14149

    Keywords

    elderly; one-person household; depression; ecological momentary assessment; actigraphy; machine learning 


    Challenges of Geriatric Depression

    Depression is one of the most prevalent mental health problems in older adults. Globally, it was the third leading cause of years lived with disability in 2015, increasing by 18.4% between 2005 and 2015 [1]. In particular, older adults living alone are most vulnerable to depression compared with those living with others [2,3] because 30.2% of Koreans living alone are reported to have significant symptoms of depression [4]. In Korea, the economic burden of individuals with depression increased by about 27.1% from 2009 to 2013, with an estimated total cost of Korean $27.1 billion [5]. Thus, early and accurate diagnosis is critical to initiate timely treatment and reduce further disease burden; however, it is difficult to diagnose geriatric depression [1,2].

    Underdiagnosis or inaccurate diagnosis of depression in older adults living alone remains a challenge [2]. Self-report and clinical interview are the primary methods to diagnose depression [6]; however, there are several challenges to overcome when diagnosing older adults living alone. First, no proxy currently exists that uses objective observations for reporting older adults’ depressive symptoms in their daily lives. Second, existing self-reporting instruments have a limitation to assess mood variability in response to daily stress in the natural environment, even the validity and reliability [6]. Third, atypical symptoms of depression are more common in older adults compared with younger adults [2,6,7]. Finally, older Asian adults are often hesitant to report their depressed mood and depressive symptoms because of social stigma or misconceptions [8]. Thus, it is vital to use diverse methods to collect additional data to fill the gaps contributing to the underdiagnosis of geriatric depression [2,6].

    Potential Methods to Identify Geriatric Depression

    Ecological momentary assessment (EMA) has been suggested as a promising instrument because it can detect an individual’s real-time experiences and mood in real-world settings over time and in different situations [9]. Currently, clinicians rely on the retrospective reports of patients’ depressed mood in unfamiliar examination rooms using standardized instruments [6,10]. However, EMA allows individuals to report their momentary mood in the right now and here, multiple times in their real and familiar environment [9,11], rather than in artificial settings or laboratories. Thus, health care professionals can collect high ecologically valid data that are more specific to the older adult’s contextual situation and readily applicable to lifestyle modification [9,11,12].

    As some older adults have difficulty using high-tech devices, one of the challenges with using EMA by older adults is the limited choices available when choosing a device [9]. Although a diverse number of smart devices are available, a wrist-worn Actiwatch is one method for collecting ecological momentary data [11] and other types of data. It has been primarily used to measure objective sleep and motor activity [13,14]. The usefulness of actigraphy has been well recognized and validated in individuals with depression [15] because of its familiarity, portability, and simple operation that involves pressing the device button to input the data [13]. Although actigraph has been suggested as being an advantageous device for use with older adults [16], few studies have used actigraphy to measure momentary mood or related problems in older adults with depression [17,18].

    EMA and actigraphy data require a new analytic approach rather than conventional analysis. Numerous studies have used machine learning with wearable sensor data to improve symptom detection and for monitoring in diverse populations of neuropsychiatric patients living in real-time and in diverse life contexts [19-21]. Specifically, the assessment of suicide risk and emotional distress was identified as a possibly applicable area for using social media text mining [22], predicting negative emotions using mobile phone usage pattern [23], and detecting everyday behavior related to clinically meaningful levels of depression using sensor data [24]. Machine learning involves an objective, data-driven, and situation-independent analysis, and it has also been applied in the analysis of sensor data for automated assessment of mental health [24-26]. Machine learning analytic techniques that computationally mine meaning from data and classify, detect, and segment meaningful patterns, associations, relationships, and trends between variables and simulation are used to build predictive and optimization models [25,27]. These data analytics can equally be applied to small data to extract and model insights [25,27]. Therefore, depression is an ideal construct to establish, validate, and clinically apply machine learning approaches using sensor data. Thus, this study aimed to develop a supervised machine learning algorithm to predict the classification of depression groups among older adults living alone using EMA data from older adults living with a depressed mood.


    Overview of Study Design

    On the basis of expert opinion [28] and a methodological guide [27], this study was conducted in 4 steps: (1) collecting data associated with depression, (2) data processing and representation, (3) data modeling (ie, feature engineering and selection), and (4) training and validation of the prediction model (Figure 1).

    ‎
    Figure 1. Construction prediction model.
    View this figure

    Data Collection

    Sample

    We recruited a convenience sample of 56 older adults living alone via a community health center in Korea between May 2017 and January 2018. Inclusion criteria were as follows: the participants (1) were aged 65 to 94 years, (2) understood Korean, (3) lived as a single household in the community, and (4) had at least mild levels of depressive symptoms (score ≥5 on the Short Geriatric Depression Scale). We excluded 3 individuals with significant cognitive impairment and a high risk of suicide according to the Korean versions of the Mini-Mental Status Examination [29] and Crisis Triage Ration Scale [30]. In addition, the data from 6 individuals were excluded from the analysis because of refusal to wear or incomplete wearing of an Actiwatch (n=5) and data loss because of device error (n=1). Thus, the final sample comprised 47 participants who constantly wore an Actiwatch and reported sufficient numbers of EMA (ie, at least once a day) for 2 weeks [31]. All participants provided written informed consent, and the institutional review board of the affiliated university (IRB 2017-0007-1) approved the study.

    Depression Measures

    To classify the depression and nondepression groups, the Korean versions of the Short Geriatric Depression Scale (SGDS-K) and the Hamilton Depression Rating Scale (K-HDRS) were used to assess self-reported and clinician-observed symptoms of depression at baseline and 2 weeks. The SGDS-K is a 15-item instrument to assess subjective depressive symptoms (0=symptom absent and 1=symptom present). The total score ranges from 0 to 15; a higher score indicates more severe levels of depression [32]. The K-HDRS is a 17-item instrument that is the most widely used observer rating scale for observing depressive symptoms and severity. The total score ranges from 0 to 52, and a higher score indicates more severe depression [33]. The diagnostic validity of SGDS-K and K-HDRS for screening has been reported in previous studies [33,34].

    Actigraphy Data and Ecological Momentary Assessment

    Physical activity and ambient light exposure were measured using a wrist-worn Actiwatch (Actiwatch Spectrum PRO, Philips Respironics). It is considered to be a valid and reliable accelerometer that continually detects wrist movements that reflect activities; sleep-wake patterns; light exposure to the red, green, and blue (RGB) spectral regions; and broad-spectrum white light [35,36]. Data were collected continuously in 30-second epochs for 14 consecutive days. Participants wore the Actiwatch on the nondominant wrist all the time and were instructed to take it off only when taking a bath or for a few minutes as needed. Furthermore, participants were instructed that long sleeves should not cover the light sensor in the Actiwatch. We used Actiware software (Philips Respironics) to export the data.

    Participants were instructed to rate their momentary mood using a button on the Actiwatch for 2 weeks. When the participants pressed the button, an increasing number was shown in the front window of the Actiwatch. The mood level was measured on a 10-point Likert scale (ranging from 1=very depressed to 10=not depressed) on the individualized preset time, as EMA reporting time in a day should be set in consideration of each individual’s lifestyle and convenience [37]. The Actiwatch included options for audible and vibrating alarms that were set to appear 4 times a day as a means to remind participants to complete the EMA regarding their current depressed mood. When a participant missed the alarm to complete the EMA, they received additional alarms over 5-min intervals until they responded. Research staff also provided a follow-up phone call to all participants after 1 week, and additional contact was provided for troubleshooting on an as-needed basis. Participants received gifts that were worth US $10 for completing the 2-week data collection.

    Data Processing and Representation

    Defining Depression

    The diagnosis of depression in older adults living alone was made using a decision-making model that is primarily used in the machine learning method [38]. To assess depression, SGDS-K and K-HDRS were administered at baseline and 2 weeks later. The data for a probable diagnosis of depression were based on the second measure at 2 weeks, during which the correlation between SGDS-K and K-HDRS was the highest (r=0.753; P=.01). To develop a diagnostic model, participants were classified into 2 groups: depression (SGDS-K≥7 and K-HDRS≥8) and nondepression (SGDS-K≤6 and K-HDRS≤7) groups [39-41]. Finally, 18 older adults were classified into the depression group and 29 were classified into the nondepression group (Figure 2).

    ‎
    Figure 2. Correlations between Short Geriatric Depression Scale (SGDS) and Hamilton Depression Rating Scale (HDRS) scores by the depression groups. White squares mean nondepression group, whereas the black squares mean depression group.
    View this figure
    Data Processing

    Data were collected through the Actiwatch for 2 weeks. Data preprocessing began with the downloading of raw data and conversion into usable data. In a participant’s activity time series, continuous data were collected by the Actiwatch every 30 seconds. Triaxial data were calculated as an activity count. On the basis of the characteristics of signal data collected in the time series at 30-second intervals, null or abnormal values because of user or device error were checked and excluded from the analysis.

    If a participant removed the device, the triaxial accelerometer would record values of 0 to indicate the duration of time for which it was not worn. Natural human behavior involves micromovements that are sensed by the accelerometer even during sleep, and therefore, periods with a continuous absence of movement indicate device removal. The raw accelerometer data were aggregated into minute-by-minute epochs using a script written in R (version 3.3.1). Data were considered as missing or being excluded from the analysis when (1) there were 0 measures in 5 min despite the indication of the wearing status or (2) more than 60% of a participant’s data were missing in a day.

    The processing of EMA scores was performed as follows: (1) exploring the pattern of each participant’s EMA scores of depressed mood at 4 different time points each day, (2) comparing the 4 EMA scores and the grand mean scores between 2 groups, (3) examining the overall patterns between 2 groups, and (4) computing a composite score of daily EMA score.

    Data Modeling of Depression Prediction

    Feature Engineering

    Feature engineering is a step of parameterizing the collected raw data. It is a data mining process that quantitatively and qualitatively characterizes the statistics of the measured values for each participant through data aggregation or pattern analysis [38]. Moreover, it is important to determine additional variables to consider for the prediction model during feature engineering [38]. The variables to be included in the prediction model are the original variables included in the existing data and the new types of variables created using these primitive variables. Through the feature engineering process, the existing and new variables are identified to specify the characteristics of the participants and improve the accuracy of the prediction models [38].

    After examining the daily fluctuations in the EMA, activity, and ambient light exposure, we compared both groups’ 4-hour mean differences in the selected variables using a Mann-Whitney U test and time series plot. To find additional variables to consider for the prediction model, we tested diverse types of sleep parameters, such as total time in bed, total sleep time, sleep efficiency, and wake-after-sleep-onset (WASO).

    Feature Selection

    This process selects and filters significant variables used in the prediction model. Owing to the small sample size, unnecessary variables in the process of predicting depression may decrease the model’s degree of freedom, which can negatively affect the explanatory power or the normal operation of the model [38]. Therefore, it is necessary to evaluate the significance of the processed variables through hypothesis testing and logistic regression analysis to select the most efficient combination of variables [38].

    The actual selection of the variables was performed by a mean difference test of the statistics of the depression and nondepression groups and by logistic regression analysis based on various combinations of variables to examine the fitness of the models and determine the final combination of explanatory variables to be used in the prediction [38]. We selected EMA score, activity, and ambient light exposure and sleep efficiency to perform a binary logistic regression.

    Training and Validation Test

    We evaluated training and validation data of the predictive model to classify depression groups based on the previously selected explanatory variables through the cross-validation process and assessed the validity of the final model [38]. Data from 47 participants were divided into training data and test data, and the machine learning method was applied to calculate the predictive power of the model. Specifically, the parameter value of the prediction model was calculated from the learning data and was applied to the test data, and the prediction level was evaluated using rxLogit function in Microsoft R package.

    Data Partitioning

    To train our models without overfitting and test their subsequent performance, we randomly partitioned the dataset. Each time series was randomly assigned to a partition while maintaining an even class distribution of the target variable, depression group. Data were split at a 0.65:0.35 ratio for training and testing, respectively. Thus, the data were divided as follows: 30 as training data (n=20 for the nondepression group and n=10 for the depression group) and 17 as test data (n=9 for the nondepression group and n=8 for the depression group) in consideration of the sample size. Ideally, to ensure the cross-validation of the model and the validity of the evaluation, the data resplitting process should be repeated 100 times or more at random (Figure 3).

    ‎
    Figure 3. Machine learning—training, validation, and test.
    View this figure
    Training the Models

    Machine learning techniques that were used for training and validation included the logit, decision tree, boosted trees, and random forest models. To test the validity of the prediction model, several indices were used such as accuracy, precision, recall (or sensitivity), specificity, F score, and area under receiver operating characteristic curve (AUC) in comparison between the machine learning model and a logistic regression, which are mainly used in the classification model [38]. Each indicator was calculated in the Confusion matrix. Our model showed that depression was positive and nondepression was negative.


    Descriptive Statistics of the Sample

    The average age of the 47 participants was 78 (SD 5.24) years; they were mainly women (44/47, 94%), had less than high school education (42/47, 89%), and had a moderate socioeconomic status (35/47, 74%). The sample characteristics of the 6 participants who were excluded from the analyses did not significantly differ from those of the 47 participants included in the final analyses.

    On the basis of the traditional depression assessment tools (SGDS-K and K-HDRS), 38% (18/47) of the participants were classified into the depression group. We performed the Mann-Whitney U test to compare the 2-week grand means of the depression and nondepression groups, and significant differences were identified. The depression group reported a significantly lower score of nondepressed mood and physical activity and higher levels of exposure to white and RGB light (all P values <.01). Data were used to identify the pattern of time series of signal data and for reference for interpretation (Table 1).

    Table 1. Mean differences tested by the Mann-Whitney U test.
    CharacteristicsNondepression group (n=29), mean (SD)Depression group (n=18), mean (SD)Differences, mean (SD)P value
    Ecological momentary assessment6.6 (1.55)5.1 (1.64)−1.5 (1.58).004
    Activity (counts)90.5 (32.76)67.4 (18.82)−23.1 (28.31).003
    Light exposure (lux)

    		White54.0 (36.54)81.5 (39.98)27.5 (37.88).008

    		Red69.9 (54.12)103.6 (63.95)33.7 (58.03).03

    		Green60.1 (43.09)99.9 (55.35)39.8 (48.09).005

    		Blue38.9 (28.84)62.0 (34.33)23.1 (31.03).006

    Feature Engineering and Selection

    Mean Differences in Different Sections of Time

    To obtain a descriptive picture of the daily fluctuations in EMA, activity, and ambient light exposure and compare the 4-hour mean differences of the 2 groups, we performed the Mann-Whitney U test and time series plot. The depression group reported lower levels of EMA scores and daily activity throughout the day. However, there were higher levels of white and RGB light exposures in the depression group compared with the nondepression group.

    On further examination of different time frames, both groups showed the highest levels of activity in the morning between 8:00 am and 12:00 pm. However, the highest levels of white and RGB light exposures were observed between 12:00 pm and 4:00 pm in the nondepression group and 8:00 am and 12:00 pm in the depression group. More activities were observed for the depression group after 9:00 pm compared with the nondepression group, although the difference was not significant (Figure 4). This finding suggests that 4-hour data could be considered for modeling (Table 2).

    ‎
    Figure 4. Daily time series plot of depression versus nondepression. Activity patterns for depression and nondepression groups. Y axis is average raw activity counts depending on each time of day and X axis is the time of day.
    View this figure
    Table 2. Mean differences in different sections of time.
    Variables12:00 am-4:00 am4:00 am-8:00 am8:00 am-12:00 pm12:00 pm-4:00 pm4:00 pm-8:00 pm8:00 pm-12:00 am
    Ecological momentary assessment

    		Nondepression—a6.46.66.66.6—

    		Depression—5.05.25.25.1—

    		Difference—−1.4−1.4−1.4−1.5—

    		P value—.02.009.01.005—
    Activity

    		Nondepression16.478.5141.2133.0120.154.1

    		Depression11.148.1107.199.494.844.1

    		Difference−5.3−30.4−34.1−33.6−25.3−10.0

    		P value.36.02.01.005.06.20
    White light

    		Nondepression1.014.5110.3137.450.710.4

    		Depression0.718.1196.3161.691.720.6

    		Difference−0.33.686.024.241.010.2

    		P value.51.42.02.08.005.10
    Red light

    		Nondepression0.617.1150.0181.764.25.8

    		Depression0.620.9269.6204.9112.113.4

    		Difference0.03.8119.623.247.97.6

    		P value.79.43.049.12.02.07
    Green light
    Nondepression1.117.0125.0154.254.38.9

    		Depression1.421.4250.2194.7103.028.5

    		Difference0.34.4125.240.548.719.6

    		P value.97.31.01.05.003.09
    Blue light

    		Nondepression0.410.381.9101.534.74.7

    		Depression0.413.7154.6126.264.812.3

    		Difference0.03.472.724.730.17.6

    		P value.77.33.01.07.006.08

    aNot applicable.

    Additional Variable: Sleep Efficiency

    As there were no differences in activity levels at night (see Figure 4) and no significant difference in other sleep components, sleep efficiency was chosen for modeling. Sleep efficiency is defined as the ratio of the total sleep time at night compared with the total amount of time spent in bed, which reflects night-time activity and the quality of sleep. We calculated sleep efficiency based on sleep time and WASO based on sleep component equations (Multimedia Appendix 1) [42].

    In this study, activity for more than 5 consecutive minutes during the sleep time was considered as wakefulness. The total sum of all moments of wakefulness is referred to as WASO, when smoothing intermittent movements of night-time activity. A cutoff of 85% or higher was used to determine good sleep efficiency [42]. On the basis the mean differences in sleep efficiency of the 2 groups, the nondepression group had a sleep efficiency of 86% (25/29), which was higher than the 85% cutoff, whereas the depression group showed 83% (15/18), lower than the cutoff. The between group difference was different at the P=.08 level regarding sleep efficiency.

    A binary logistic regression was performed to explore the best model fit using various combinations of variables (EMA score, activity, white and RGB light exposure, and sleep efficiency) depending on depression groups (nondepression group=0 and depression group=1). We compared diverse models using different means based on EMA and activity data. For example, we compared daily, morning-evening means, and all 4 scores as well as 4 different times of light exposure and other sleep components. Finally, we reached the conclusion that the variables of the final model were the best when using daily mean EMA score, daily mean activity level, white and RGB light at 4:00 pm to 8:00 pm exposure, and daily sleep efficiency. To consider collinearity between white and RGB light change and the small sample size, a computing score was calculated integrating means of white and RGB light between 4:00 pm and 8:00 pm. Table 3 shows goodness of fit depending on each variable. Our findings suggest that lower activity, higher EMA depressed mood, and exposure to white and RGB were associated with a higher likelihood of being classified as a depression group. Furthermore, this model showed a good model fit (accuracy: 0.705; precision: 0.770; specificity: 0.859; and AUC: 0.754) except 1 false-positive case.

    Table 3. Estimates of logistic regression.
    Variables, estimatorEstimatesP value
    Intercept.02

    		Coefficient35.200
    Activity.02

    		Coefficient−0.095

    		Odds ratio (95% CI)0.910 (0.84-0.98)

    		Marginal effect−0.016
    Computing score of white and red, green, and blue light.01

    		Coefficient0.024

    		Odds ratio (95% CI)1.025 (1.01-1.04)

    		Marginal effect0.004
    Sleep efficiency.08

    		Coefficient−25.300

    		Odds ratio (95% CI)<0.001 (<0.001-14.41)

    		Marginal effect−4.362
    Ecological momentary assessment.01

    		Coefficient−2.299

    		Odds ratio (95% CI)0.100 (0.02-0.58)

    		Marginal effect−0.397

    Comparison of Four Machine Learning Methods

    Table 4 shows the validation and test results for the prediction model based on machine learning. All variables included in the logistic regression were utilized (EMA score, activity, white and RGB light exposure, and sleep efficiency) to classify depression groups (nondepression group=0 and depression group=1). For cross-validation, bootstrapping with data partitioning and training models was performed 100 times. Among the 4 methods, the logistic regression model (accuracy: 0.910; precision: 0.929; and specificity: 0.940) had the best fit compared with the boosted trees and random forest models. Decision tree suffers from possible overestimated model fit because of sample size. boosted trees model showed relatively better fit compared with decision tree because of the modification process to correct errors through pruning. Random forest seemed less suitable for this study because of the small sample size and the limited number of tested variables [38].

    Table 4. Evaluation metrics.
    Evaluation metricsLogistic regressionDecision treeBoosted treesRandom forest
    Mean (SD)Minimum-maximumMean (SD)Minimum-maximumMean (SD)Minimum-maximumMean (SD)Minimum-maximum
    Accuracy0.91 (0.007)0.87-0.920.72 (0.03)0.64-0.780.78 (0.04)0.68-0.870.67 (0.05)0.53-0.75
    Precision0.93 (0.01)0.88-0.950.74 (0.04)0.63-0.810.84 (0.06)0.69-0.950.72 (0.11)0.50-1.02
    Recall/sensitivity0.88 (0.01)0.84-0.900.63 (0.05)0.55-0.730.66 (0.06)0.57-0.680.39 (0.07)0.23-0.50
    Specificity0.94 (0.01)0.90-0.960.80 (0.04)0.72-0.880.84 (0.05)0.78-0.980.88 (0.06)0.80-1.04
    F score0.90 (0.01)0.86-0.920.68 (0.03)0.59-0.750.74 (0.05)0.62-0.830.51 (0.05)0.38-0.62
    Area under receiver operating characteristic curve0.96 (0.03)0.91-0.990.66 (0.03)0.61-0.710.84 (0.03)0.79-0.890.71 (0.03)0.69-0.79

    Principal Findings

    The primary purpose of this study was to identify factors associated with geriatric depression in older adults living alone. We focused on developing a prediction model to classify the depression groups (probable depression vs nondepression) among older adults living alone. Along with the conventional instruments for depression screening, EMA of daily mood, actigraphy data of activity, and light exposure were utilized. Comparing diverse combinations of the selected variables, daily mean EMA score, daily mean activity, daily sleep efficiency, and exposure to white and RGB light between 4:00 pm and 8:00 pm for 2 weeks were selected for modeling. The cross-validation process was used to build a prediction model. Logit model showed compatible evaluation metrics compared with the traditional binary logistic regression. The use of both EMA and sensor data seems promising to develop a machine learning model for better identification of a probable depression among older adults [25].

    Comparison With Previous Studies

    The depression group reported higher levels of daily depressed mood than did the nondepression group. In a small-scale study [17], the major depressive disorder (MDD) group reported higher levels of diurnal symptom patterns of negative affect with great variability than did the control group. Our study found that even the daily average of depressed mood was significantly related to the classification of depression groups determined by conventional screening [2,43]. This could help overcome a clinical challenge in diagnosing a psychiatric disorder during the first medical examination or interview by unfamiliar clinicians [2]. It can also be difficult for a person with a serious mental illness to complete the self-reporting questionnaire and for clinicians to make a quick diagnosis with limited time [6,44]. The findings of this study suggest that individuals with these difficulties may complete self-reports of depressed mood daily in their home environment. A simple question, although repetitive, might be more helpful to classify the probable depression groups as opposed to the application of complex and multiple-item questionnaires.

    A significantly low level of daytime activity was observed in the depression group, similar to the findings of previous research [45]. A study [15] using actigraphy reported that patients with depression displayed less daytime motor activity than did individuals without depression. Related to the EMA of depression, high levels of momentary depressed mood had a lagged effect of prolonging the current status of being at home. Those who experience an increase in the average depressed mood the previous day tend to stay at home the following day [46]. Previous studies have reported that depressed people have decreased levels of daytime activity compared with healthy controls [2,15]. In adults aged over 60 years, depression is associated with lower levels of physical activity in global measure, compared with nondepressed individuals [47], similar to our study findings. In a meta-analysis of adults with MDD [48], more time was spent in sedentary behavior and less time in vigorous physical activities. Considering the relationship between physical activity and depression, promoting daytime physical activity could prevent the risk of depression in older adults [49].

    Furthermore, sleep efficiency may be a potential factor to aid in classifying depression groups. Existing studies have confirmed the association between disrupted sleep and depression in adults [50-52] because sleep disturbance is one of the common misinterpreted symptoms of geriatric depression [6]. A study of older adults living alone found that depressed participants reported sleep-related issues [53]. However, our study did not clearly indicate that sleep efficiency was associated with the depression group because the sample size had low power to detect the significance (P<.08). Comparing with the findings of previous studies [12,54], this discrepancy should be interpreted with caution because the previous studies measured sleep components once through self-report, whereas our study assessed daily sleep efficiency for 2 weeks through repeated measures using actigraphy. Older adults living alone may have more difficulty in the early detection of sleep disturbances than do those living with others because of the absence of a bedroom partner [55]. Thus, further research using both subjective and objective measures is needed to confirm the predictive value of sleep efficiency with the larger sample.

    Contrary to our expectation, higher levels of ambient light exposure were observed in the depression group, compared with the nondepression group. We expected that lower levels of ambient light exposure would be observed in the depression group compared with the nondepression group that had a less sedentary lifestyle and engaged in more outdoor activities [48]. There are limited explanations for this finding contrary to our hypothesis. A small-scale observational study [56] explored the subjective perception of lighting in depressed patients’ environment. When they were asked whether the lights in the surroundings seemed dimmer than usual, depressed patients answered that they perceived the environment to be dimmer than usual. Moreover, there was a significant association between depression severity and perception of dimness. Patients with severe (65%), moderate (21%), and mild (14%) depression responded that their ambient environment appeared dimmer than usual. To compensate for the perceived dim environment, they may turn on the lights at home most of the time or stay in places with more light. In addition, a depressed individual may turn on the lights to read books or do other things to compensate their awakening time at night. This behavior may affect heart rate variability, which is associated with mood regulation through ambient biofeedback [57]. Many relaxation methods or interventions use dimmed ambient lighting to soothe the patient [58], but individuals with depression may not prefer a dimmer environment that may increase the depressed mood.

    Implications for Geriatric Depression Research

    Our study findings support 3 major inferences: (1) diversifying data collection methods to build an accurate model of depression prediction, (2) emphasizing the need to assess depressed mood at different time points in a day, and (3) monitoring multiple symptoms continuously. First, inactivity and poor sleep have been known to be symptoms of geriatric depression; however, the assessment of these symptoms is limited to using subjective reports of inactivity, sedentary lifestyle, or night-time sleep. Our study emphasizes the need for collecting both subjective and objective data related to mood disorders and examining intraday change patterns. For example, it is difficult to apply the Pittsburgh Sleep Quality Index global score to depressed older adults. Thus, clinicians should evaluate sleep efficiency through actigraphy as an objective measure, which may prevent the misinterpretation of a suspected depression [6]. Second, time-specific assessment is required to capture the significant features of specific data. Our study findings confirmed group differences in daytime activity, light exposure in the late afternoon, and night-time sleep. Thus, we suggest the need to collect data throughout the day and identify features closely related to depression [12,45]. Third, we suggest using sensor data, such as Actiwatch or activity tracking, for monitoring purpose. For example, strategies to improve physical activity should be included in the treatment for geriatric depression [48]. Monitoring daily activity of people with mood disorders using Actiwatch may help diagnose depression depending on the activity-based interventions [15]. In addition, our study shows some potential to use environmental data, such as ambient light, in identifying depression in the community setting. Sensor devices have a great potential to continuously capture diverse mental health–related information from the environment or context [24,25] in mental health.

    Implications of Electronic Health for Older Adults

    EMA could be used as a diagnostic tool for depression in older adults. It has been used to assess multiple mental health indicators related to depressed mood [9]. In particular, older adults have less accurate retrospective memory, and therefore, the use of EMA for older adults can increase the accuracy of the assessment [10,59]. EMA has also been shown to have acceptability and feasibility for older adults, even those with cognitive and emotional difficulties [60]. In particular, EMA has the advantage of continuously reporting subjective symptoms according to the individual’s life patterns as digital phenotyping [44,61]. Thus, it is possible to collect personalized data, monitor the individual pattern, and examine fluctuations in the depressed mood within and between a day while reducing retrospective bias [10,11].

    However, a limitation of this method is that multiple and repeated reports in a day are associated with a high dropout rate [11]. When applying EMA to older adults, sufficient device training and the practice of technical details could maximize the usability and appropriateness of EMA for older adults [60]. In our study, a dropout rate of 9% (5/53) was observed; thus, preventing dropout is important to ensure that older adults with depression complete multiple reports during the day after careful training and educating about the significance of EMA [11,16,62]. Selection of valid questions to measure momentary depressed mood and standardizing the EMA protocols are also important. Therefore, geropsychiatric clinicians should prepare to select the proper device, train older adults, and prevent dropout [16].

    The paper-based diary approach has been traditionally used for older adults [6,63]; however, sometimes they do not accurately report their depressed mood because of response or retrospective bias or the social stigma associated with mental health illnesses [6,10,44,59]. Actigraphy is a noninvasive technique that provides simple and scientifically accurate data on a daily basis and can be used to improve health-related behaviors [64], thus suggesting its suitability for older adults. The 9% (5/53) dropout rate in our study indicates the acceptability and applicability of the Actiwatch for older adults, similar to a previous finding [11], especially as we identified a variety of subjective and objective factors that reflected an individual’s real-world environment, such as depressed mood, activity, sleep, and different light using a ubiquitous device.

    Actigraphy also measures fluctuating subjective mood on a daily basis in real time and a natural environment through continuous recording [9] along with physical and environmental data [11]. An integrated approach to passive, objective, and continuous measurement has been used in psychiatry practice and research [44]. Moreover, passive actigraphy data and active EMA responses can be useful for understanding the characteristics of depression, offering insight into biological and environmental mechanisms underlying the depression, and developing individualized interventions for older adults [65]. Considering the rapid development of technologies, various types of sensor data may be used in geropsychiatric care for screening, monitoring, and diagnosing mental health [66-68]. Therefore, we expect that new measures, such as using sensor data, will help diagnose depression quickly and improve mental health problems.

    Limitations

    Our study has several limitations. First, we used 2 screening instruments that relied on subjective reports to classify individuals in the 2 depression groups because these instruments had been widely used in community settings. However, a medical diagnosis based on Diagnostic and Statistical Manual of Mental Disorders–5 may be needed to define the clinically diagnosed depression group for data processing and representation [6]. In addition, further study may replicate our model including nondepressed older adults to establish screening models in general population. Although the EMA provides mood reports of older adults at the 4 time points every day for 2 weeks, our predictive model used daily grand mean that was relatively less frequent for EMA data collection. Replication studies that utilize data variability within a day should be tested over a longer time frame and use a more convenient mode to complete EMA to reduce subjective burden. Generalization of the EMA data and levels of activity is limited because every individual has different levels of normal with reference to a depressed mood or inactivity [6,11]. Thus, EMA with a real-life tagging system will be helpful to examine to what extent the data fluctuate from the average level for each individual. In addition, studies with larger samples are needed to ensure the generalizability of our findings considering the possible use of machine learning, which is an innovative method of feature extraction from data [21]. Specifically, the limited generalizability is expected for depressed men in older populations because the majority of older adults were women in Korea. Thus, it is necessary to oversample the groups of men for the next study on this topic [4].

    Conclusions

    This study provides evidences to support the feasibility of machine learning in classifying depression groups based on EMA and actigraphy data. Specifically, our machine learning approach is applicable for females and elderlies with depressive mood when living alone in the community setting. The study findings provide 2 major inferences: (1) diversifying data collection methods to build an accurate model of prediction and (2) emphasizing the need for assessments at different time points in a day to obtain diverse data. Future researchers and clinicians should consider EMA and actigraphy to obtain data on daily mood, levels of activity and ambient light exposure, and sleep components in depressed older adults living alone.

    Acknowledgments

    The authors express their appreciation to all study participants for their time and effort in completing the surveys. In addition, they appreciate Yeonsu-gu public health centers (Incheon, South Korea) for their support in recruiting participants. This study was supported by Basic Science Research Program through the National Research Foundation (NRF) of Korea funded by the Ministry of Education (NRF-2016R1D1A1B03932013) and the Ministry of Trade, Industry, and Energy Grant funded by the Korean government (Medical Device R&D Platform Project, Project Number: 10060085).

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Equation to calculate sleep efficiency based on sleep time and wake-after-sleep-onset.

    PDF File (Adobe PDF File), 26 KB
    1. GBD 2015 Disease and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet 2016 Oct 8;388(10053):1545-1602. [FREE Full text] [CrossRef] [Medline]
    2. Sözeri-Varma G. Depression in the elderly: clinical features and risk factors. Aging Dis 2012 Dec;3(6):465-471. [FREE Full text] [Medline]
    3. Kim H, Kwon S, Hong S, Lee S. Health behaviors influencing depressive symptoms in older Koreans living alone: secondary data analysis of the 2014 Korean longitudinal study of aging. BMC Geriatr 2018 Aug 20;18(1):186. [FREE Full text] [CrossRef] [Medline]
    4. Korea Institute for Health and Social Affairs. 2017. 2017 Korean Elderly Survey.   URL: https://data.kihasa.re.kr/micro/subject_view.jsp?grp_seq=64&project_seq=673 [accessed 2019-02-28] [WebCite Cache]
    5. Mobile Health Insurance Review & Assessment Service. 2017. Disease Information by Statistics.   URL: http://www.hira.or.kr/dummy.do?pgmid=HIRAA030502030000&ilnsCtgyNm=sixtyAge&sortSno=46 [accessed 2019-02-28] [WebCite Cache]
    6. Balsamo M, Cataldi F, Carlucci L, Padulo C, Fairfield B. Assessment of late-life depression via self-report measures: a review. Clin Interv Aging 2018;13:2021-2044. [FREE Full text] [CrossRef] [Medline]
    7. World Health Organization. 2017. Mental Health of Older Adults.   URL: https://www.who.int/en/news-room/fact-sheets/detail/mental-health-of-older-adults [accessed 2019-03-14] [WebCite Cache]
    8. Jang Y, Chiriboga DA, Okazaki S. Attitudes toward mental health services: age-group differences in Korean American adults. Aging Ment Health 2009 Jan;13(1):127-134. [FREE Full text] [CrossRef] [Medline]
    9. Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008;4:1-32. [CrossRef] [Medline]
    10. Ben-Zeev D, Young MA, Madsen JW. Retrospective recall of affect in clinically depressed individuals and controls. Cogn Emot 2009 Aug;23(5):1021-1040. [CrossRef]
    11. Wenze SJ, Miller IW. Use of ecological momentary assessment in mood disorders research. Clin Psychol Rev 2010 Aug;30(6):794-804. [CrossRef] [Medline]
    12. Parsey CM, Schmitter-Edgecombe M. Using actigraphy to predict the ecological momentary assessment of mood, fatigue, and cognition in older adulthood: mixed-methods study. JMIR Aging 2019 Jan 18;2(1):e11331. [FREE Full text] [CrossRef] [Medline]
    13. Acebo C, LeBourgeois MK. Actigraphy. Respir Care Clin N Am 2006 Mar;12(1):23-30, viii. [CrossRef] [Medline]
    14. Baune BT, Caliskan S, Todder D. Effects of adjunctive antidepressant therapy with quetiapine on clinical outcome, quality of sleep and daytime motor activity in patients with treatment-resistant depression. Hum Psychopharmacol 2007 Jan;22(1):1-9. [CrossRef] [Medline]
    15. Burton C, McKinstry B, Szentagotai Tatar A, Serrano-Blanco A, Pagliari C, Wolters M. Activity monitoring in patients with depression: a systematic review. J Affect Disord 2013 Feb 15;145(1):21-28. [CrossRef] [Medline]
    16. Kim H, Hong S, Kwon S, Kim N. Developing geriatric nursing competency using information and communication technology: focusing on a case of depression assessment. J Korean Gerontol Nurs 2018 Dec 31;20(Suppl 1):119-126. [CrossRef]
    17. Crowe E, Daly M, Delaney L, Carroll S, Malone KM. The intra-day dynamics of affect, self-esteem, tiredness, and suicidality in major depression. Psychiatry Res 2019 Sep;279:98-108. [CrossRef] [Medline]
    18. Kratz AL, Fritz NE, Braley TJ, Scott EL, Foxen-Craft E, Murphy SL. Daily temporal associations between physical activity and symptoms in multiple sclerosis. Ann Behav Med 2019 Jan 1;53(1):98-108. [FREE Full text] [CrossRef] [Medline]
    19. Goodwin M, Haghighi M, Qu T, Akcakaya M, Erdogmus D, Intille S. Moving Towards a Real-time System for Automatically Recognizing Stereotypical Motor Movements in Individuals on the Autism Spectrum Using Wireless Accelerometry. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 2014 Presented at: UbiComp'14; September 13-17, 2014; Seattle, Washington, USA p. 861-872. [CrossRef]
    20. Puiatti A, Mudda S, Giordano S, Mayora O. Smartphone-Centred Wearable Sensors Network for Monitoring Patients With Bipolar Disorder. In: 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 2011 Presented at: EMBC'11; August 30-September 3 2011; Boston, MA, USA p. 3644-3647. [CrossRef]
    21. Patel S, Lorincz K, Hughes R, Huggins N, Growdon J, Standaert D, et al. Monitoring motor fluctuations in patients with Parkinson's disease using wearable sensors. IEEE Trans Inf Technol Biomed 2009 Nov;13(6):864-873. [FREE Full text] [CrossRef] [Medline]
    22. Cheng Q, Li TM, Kwok C, Zhu T, Yip PS. Assessing suicide risk and emotional distress in chinese social media: a text mining and machine learning study. J Med Internet Res 2017 Jul 10;19(7):e243. [FREE Full text] [CrossRef] [Medline]
    23. Hung GC, Yang PC, Chang CC, Chiang JH, Chen YY. Predicting negative emotions based on mobile phone usage patterns: an exploratory study. JMIR Res Protoc 2016 Aug 10;5(3):e160. [FREE Full text] [CrossRef] [Medline]
    24. Wahle F, Kowatsch T, Fleisch E, Rufer M, Weidt S. Mobile sensing and support for people with depression: a pilot trial in the wild. JMIR Mhealth Uhealth 2016 Sep 21;4(3):e111. [FREE Full text] [CrossRef] [Medline]
    25. Mohr DC, Zhang M, Schueller SM. Personal sensing: understanding mental health using ubiquitous sensors and machine learning. Annu Rev Clin Psychol 2017 May 8;13:23-47. [CrossRef] [Medline]
    26. Berrouiguet S, Perez-Rodriguez MM, Larsen M, Baca-García E, Courtet P, Oquendo M. From eHealth to iHealth: transition to participatory and personalized medicine in mental health. J Med Internet Res 2018 Jan 3;20(1):e2. [FREE Full text] [CrossRef] [Medline]
    27. Han J, Pei J, Kamber M. Data Mining: Concepts and Techniques. Third edition. Waltham, MA: Elsevier; 2011.
    28. Luo W, Phung D, Tran T, Gupta S, Rana S, Karmakar C, et al. Guidelines for developing and reporting machine learning predictive models in biomedical research: a multidisciplinary view. J Med Internet Res 2016 Dec 16;18(12):e323. [FREE Full text] [CrossRef] [Medline]
    29. Kang Y, Na D, Hahn S. A validity study on the Korean Mini-Mental State Examination (K-MMSE) in dementia patients. J Clin Neurol 1997;15(2):300-308. [FREE Full text]
    30. Korea Suicide Prevention Center. 2013. Suicide crisis counseling manual.   URL: http:/​/www.​spckorea.or.kr/​s_board/​download.​php?OFileName=%C0%DA%BB%EC%C0%A7%B1%E2%BB%F3%B4%E3+%B8%C5%B4%BA%BE%F3.​pdf&FileName=130719054627_weblibrary_1340_4006_1.​pdf [accessed 2019-02-28]
    31. Eldahan AI, Pachankis JE, Jonathon Rendina H, Ventuneac A, Grov C, Parsons JT. Daily minority stress and affect among gay and bisexual men: a 30-day diary study. J Affect Disord 2016 Jan 15;190:828-835. [FREE Full text] [CrossRef] [Medline]
    32. Bae JN, Cho MJ. Development of the Korean version of the Geriatric Depression Scale and its short form among elderly psychiatric patients. J Psychosom Res 2004 Sep;57(3):297-305. [CrossRef] [Medline]
    33. Yi JS, Bae SO, Ahn YM, Park DB, Noh KS, Shin HK. Validity and reliability of the Korean version of the Hamilton Depression Rating Scale (K-HDRS). J Korean Neuropsychiatr Assoc 2005 Jul;44(4):456-465. [FREE Full text]
    34. Yesavage JA, Brink TL, Rose TL, Lum O, Huang V, Adey M, et al. Development and validation of a geriatric depression screening scale: a preliminary report. J Psychiatr Res 1982;17(1):37-49. [CrossRef] [Medline]
    35. Sadeh A. The role and validity of actigraphy in sleep medicine: an update. Sleep Med Rev 2011 Aug;15(4):259-267. [CrossRef] [Medline]
    36. Thorne HC, Jones KH, Peters SP, Archer SN, Dijk D. Daily and seasonal variation in the spectral composition of light exposure in humans. Chronobiol Int 2009 Jul;26(5):854-866. [CrossRef] [Medline]
    37. Vachon H, Bourbousson M, Deschamps T, Doron J, Bulteau S, Sauvaget A, et al. Repeated self-evaluations may involve familiarization: an exploratory study related to ecological momentary assessment designs in patients with major depressive disorder. Psychiatry Res 2016 Nov 30;245:99-104. [CrossRef] [Medline]
    38. Alpaydin E. Introduction To Machine Learning. Second edition. Cambridge, MA: The MIT Press; 2004.
    39. Jeon SW, Yoon SY, Ko YH, Joe SH, Kim YK, Han C, et al. Do somatic symptoms predict the severity of depression? A validation study of the Korean version of the depression and somatic symptoms scale. J Korean Med Sci 2016 Dec;31(12):2002-2009. [FREE Full text] [CrossRef] [Medline]
    40. Zimmerman M, Martinez JH, Young D, Chelminski I, Dalrymple K. Severity classification on the Hamilton Depression Rating Scale. J Affect Disord 2013 Sep 5;150(2):384-388. [CrossRef] [Medline]
    41. Lee SC, Kim WH, Chang SM, Kim BS, Lee DW, Bae JN. The use of the Korean version of Short Form Geriatric Depression Scale (SGDS-K) in the community dwelling elderly in Korea. J Korean Geriatr Psychiatry 2013 Jun;17(1):36-42. [FREE Full text]
    42. Sathyanarayana A, Joty S, Fernandez-Luque L, Ofli F, Srivastava J, Elmagarmid A, et al. Sleep quality prediction from wearable data using deep learning. JMIR Mhealth Uhealth 2016 Nov 4;4(4):e125. [FREE Full text] [CrossRef] [Medline]
    43. LiKamWa R, Liu Y, Lane ND, Zhong L. MoodScope: Building a Mood Sensor From Smartphone Usage Patterns. In: Proceeding of the 11th Annual International Conference on Mobile Systems, Applications, and Services. 2013 Presented at: MobiSys'13; June 25-28, 2013; Taipei, Taiwan p. 389-402. [CrossRef]
    44. Insel TR. Digital phenotyping: technology for a new science of behavior. J Am Med Assoc 2017 Oct 3;318(13):1215-1216. [CrossRef] [Medline]
    45. Tanaka T, Kokubo K, Iwasa K, Sawa K, Yamada N, Komori M. Intraday activity levels may better reflect the differences between major depressive disorder and bipolar disorder than average daily activity levels. Front Psychol 2018;9:2314. [FREE Full text] [CrossRef] [Medline]
    46. Ravesloot C, Ward B, Hargrove T, Wong J, Livingston N, Torma L, et al. Why stay home? Temporal association of pain, fatigue and depression with being at home. Disabil Health J 2016 Apr;9(2):218-225. [CrossRef] [Medline]
    47. Wassink-Vossen S, Collard RM, Oude Voshaar RC, Comijs HC, de Vocht HM, Naarding P. Physical (in)activity and depression in older people. J Affect Disord 2014 Jun;161:65-72. [CrossRef] [Medline]
    48. Schuch F, Vancampfort D, Firth J, Rosenbaum S, Ward P, Reichert T, et al. Physical activity and sedentary behavior in people with major depressive disorder: a systematic review and meta-analysis. J Affect Disord 2017 Mar 1;210:139-150. [CrossRef] [Medline]
    49. Seo JY, Chao Y. Effects of exercise interventions on depressive symptoms among community-dwelling older adults in the United States: a systematic review. J Gerontol Nurs 2018 Mar 1;44(3):31-38. [CrossRef] [Medline]
    50. Cong L, Dou P, Chen D, Cai L. Depression and associated factors in the elderly cadres in Fuzhou, China: a community-based study. International Journal of Gerontology 2015;9(1):29-33. [CrossRef]
    51. Ouyang P, Sun W. Depression and sleep duration: findings from middle-aged and elderly people in China. Public Health 2019 Jan;166:148-154. [CrossRef] [Medline]
    52. Triantafillou S, Saeb S, Lattie EG, Mohr DC, Kording KP. Relationship between sleep quality and mood: ecological momentary assessment study. JMIR Ment Health 2019 Mar 27;6(3):e12613. [FREE Full text] [CrossRef] [Medline]
    53. Kim HR. Comparison of prevalence of depression and its risk factors among the elderly female and male living alone in Korea. Korean Public Health Res 2014 Feb;40(1):13-27. [FREE Full text]
    54. Yu J, Rawtaer I, Fam J, Jiang M, Feng L, Kua EH, et al. Sleep correlates of depression and anxiety in an elderly Asian population. Psychogeriatrics 2016 May;16(3):191-195. [FREE Full text] [CrossRef] [Medline]
    55. Kang E, Lee M. Identifying the effect of living alone on life in later adulthood: comparison between living alone and those living with others with a propensity score matching analysis. Health Soc Welf Rev 2018 Dec;38(4):196-226. [CrossRef]
    56. Friberg TR, Borrero G. Diminished perception of ambient light: a symptom of clinical depression? J Affect Disord 2000 Dec;61(1-2):113-118. [CrossRef] [Medline]
    57. Yu B, Hu J, Feijs L. Design and Evaluation of an Ambient Lighting Interface of HRV Biofeedback System in Home Setting. In: Proceedings of the International Conference on Ubiquitous Computing and Ambient Intelligence. 2014 Presented at: UCAmI'14; December 2-5, 2014; Belfast, UK. [CrossRef]
    58. Yu B, Hu J, Funk M, Feijs L. DeLight: biofeedback through ambient light for stress intervention and relaxation assistance. Pers Ubiquit Comput 2018 May 23;22(4):787-805. [CrossRef]
    59. Rullier L, Atzeni T, Husky M, Bouisson J, Dartigues JF, Swendsen J, et al. Daily life functioning of community-dwelling elderly couples: an investigation of the feasibility and validity of ecological momentary assessment. Int J Methods Psychiatr Res 2014 Jun;23(2):208-216. [CrossRef] [Medline]
    60. Ramsey AT, Wetherell JL, Depp C, Dixon D, Lenze E. Feasibility and acceptability of smartphone assessment in older adults with cognitive and emotional difficulties. J Technol Hum Serv 2016;34(2):209-223. [FREE Full text] [CrossRef] [Medline]
    61. Cho CH, Lee T, Kim MG, In HP, Kim L, Lee HJ. Mood prediction of patients with mood disorders by machine learning using passive digital phenotypes based on the circadian rhythm: prospective observational cohort study. J Med Internet Res 2019 Apr 17;21(4):e11029. [FREE Full text] [CrossRef] [Medline]
    62. Ben-Zeev D, Scherer EA, Wang R, Xie H, Campbell AT. Next-generation psychiatric assessment: using smartphone sensors to monitor behavior and mental health. Psychiatr Rehabil J 2015 Sep;38(3):218-26. [FREE Full text] [CrossRef] [Medline]
    63. Cain AE, Depp CA, Jeste DV. Ecological momentary assessment in aging research: a critical review. J Psychiatr Res 2009 Jul;43(11):987-996. [FREE Full text] [CrossRef] [Medline]
    64. Düking P, Hotho A, Holmberg HC, Fuss FK, Sperlich B. Comparison of non-invasive individual monitoring of the training and health of athletes with commercially available wearable technologies. Front Physiol 2016;7:71. [FREE Full text] [CrossRef] [Medline]
    65. Merikangas KR, Swendsen J, Hickie IB, Cui L, Shou H, Merikangas AK, et al. Real-time mobile monitoring of the dynamic associations among motor activity, energy, mood, and sleep in adults with bipolar disorder. JAMA Psychiatry 2019 Feb 1;76(2):190-198. [CrossRef] [Medline]
    66. Collins S, Sabanovic S, Fraune M, Randall N, Eldridge L, Piatt JA. Sensing Companions: Potential Clinical Uses of Robot Sensor Data for Home Care of Older Adults with Depression. In: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. 2018 Presented at: HRI'18; March 5-8, 2018; Chicago, IL, USA p. 89-90. [CrossRef]
    67. Glenn T, Monteith S. New measures of mental state and behavior based on data collected from sensors, smartphones, and the Internet. Curr Psychiatry Rep 2014 Dec;16(12):523. [CrossRef] [Medline]
    68. Gordon I, Ling J, Robinson L, Hayes C, Crosland A. Talking about depression during interactions with GPs: a qualitative study exploring older people's accounts of their depression narratives. BMC Fam Pract 2018 Nov 3;19(1):173. [FREE Full text] [CrossRef] [Medline]

    ‎
    AUC: area under receiver operating characteristic curve
    EMA: ecological momentary assessment
    K-HDRS: Korean version of the Hamilton Depression Rating Scale
    MDD: major depressive disorder
    NRF: National Research Foundation
    RGB: red, green, and blue
    SGDS-K: Korean version of the Short Geriatric Depression Scale
    WASO: wake-after-sleep-onset

    Edited by G Eysenbach; submitted 29.03.19; peer-reviewed by Q Cheng, SM Kia, G Norman; comments to author 24.04.19; revised version received 30.07.19; accepted 30.08.19; published 16.10.19

    Copyright

    ©Heejung Kim, SungHee Lee, SangEun Lee, Soyun Hong, HeeJae Kang, Namhee Kim. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 16.10.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.