Published on 31.03.16 in Vol 4, No 1 (2016): Jan-Mar
Development of a Weight Loss Mobile App Linked With an Accelerometer for Use in the Clinic: Usability, Acceptability, and Early Testing of its Impact on the Patient-Doctor Relationship
Background: Although complications of obesity are well acknowledged and managed by clinicians, management of obesity itself is often difficult, which leads to its underdiagnosis and undertreatment in hospital settings. However, tools that could improve the management of obesity, including self-monitoring, engagement with a social network, and open channels of communication between the patient and doctor, are limited in a clinic-based setting.
Objective: The objective of our study was to evaluate the usability and acceptability of a newly developed mobile app linked with an accelerometer and its early effects on patient-doctor relationships.
Methods: From September 2013 to February 2014, we developed a mobile app linked with an accelerometer as a supportive tool for a clinic-based weight loss program. The app used information from electronic health records and delivered tailored educational material. Personal goal setting, as well as monitoring of weight changes and physical activity combined with feedback, are key features of the app. We also incorporated an interactive message board for patients and doctors. During the period of March 2014 to May 2014, we tested our mobile app for 1 month in participants in a hospital clinic setting. We assessed the app’s usability and acceptability, as well as the patient-doctor relationship, via questionnaires and analysis of app usage data.
Results: We recruited 30 individuals (18 male and 12 female) for the study. The median number of log-ins per day was 1.21, with the most frequently requested item being setting goals, followed by track physical activities and view personal health status. Scales of the depth of the patient-doctor relationship decreased from 27.6 (SD 4.8) to 25.1 (SD 4.5) by a Wilcoxon signed rank test (P=.02).
Conclusions: A mobile phone app linked with an accelerometer for a clinic-based weight loss program is useful and acceptable for weight management but exhibited less favorable early effects on patient-doctor relationships.
JMIR mHealth uHealth 2016;4(1):e24
In South Korea, management of obesity remains challenging within the current health care system [, ] despite the existence of numerous guidelines [ - ] and effective treatments [ , ]. Although the consequences of obesity, such as hypertension, type 2 diabetes, or knee osteoarthritis, are promptly evaluated and managed by clinicians in the hospital setting, the core disease itself is frequently underdiagnosed and undertreated. A retrospective analysis [ ] found significant disparities between the reported and true prevalence of obesity in outpatient departments, such as orthopedics (3% vs 25.1%), cardiology (4% vs 30%), and rheumatology (5% vs 20.2%).
Given obesity’s negative impact on premature death , socioeconomic costs [ - ], and quality of life [ ], it is important to manage obesity in hospital settings via a coordinated and multidisciplinary approach with a comprehensive lifestyle program [ ] that includes implementing a low-calorie diet, increasing physical activities through the use of behavioral strategies, and providing additional support from pharmacotherapy or surgical treatment in certain patients [ ]. However, there are several limitations to managing obesity in a clinic-based setting. From a patient’s perspective, clinic visits are time consuming and costly, and these problems are exacerbated by inadequate patient-doctor interaction time. Behavioral intervention strategies [ ], including self-monitoring of weight, diet, and physical activities, are key components of successful weight management. However, the tools required for self-monitoring and interactive feedback with clinicians are often limited in a clinic-based setting. Educating patients [ ] concerning the risk of obesity and their active participation remains the cornerstone of weight loss programs, which require a repetitive and considerable effort by the clinicians. Moreover, a patient’s social network, social influence, and social support [ , ] are important aspects to consider, and these factors are typically lacking in the clinical management of obesity.
Recently, given the exponential spread of mobile phones, the Internet and mobile apps have become widely accessible, anytime and anywhere. Mobile apps in health care  have been regarded as a potential tool for altering patients’ behavior and improving pretreatment regimens.
Particularly in a clinic-based weight loss program, a mobile phone app can be a great resource for both patients and clinicians. To a patient, self-monitoring and self-regulation via a mobile app may be a more effective method than a paper-based monitoring system [, ]. A mobile app can also serve as a tailored and customized educational tool for individualized services [ ] and as a social support and social engagement tool [ ] for weight loss. Considering the positive association [ ] between the patient-doctor relationship and treatment adherence, with better patient satisfaction and outcomes [ - ], a mobile app has the potential to strengthen the patient-doctor relationship by making clinicians more focused on the patient’s concerns and consequently spending less time obtaining or providing basic information. In general, patients are more likely to be actively involved in the management of their disease if they perceive that they are engaged in a good-quality interpersonal exchange and have increased out-of-office contact with their physician [ ]. Moreover, a mobile app may allow patients to play a more active role in the medical decision-making process, thus minimizing the knowledge gap between physicians and patients [ ].
Despite an enormous number of available health care apps, most apps are underused , with limited approaches for user engagement, limited adoption of evidence-based behavioral-change strategies or frameworks [ ], and limited evidence of clinically significant benefits derived from using the app [ ]. Results of previous studies of a mobile app for weight loss were controversial regarding weight changes. One study of a mobile phone app for intervention [ ] compared weight changes over 6 months between mobile app users and a control group. This study did not find significant weight loss in the intervention group, and a 42% dropout rate was noted within the first month. Another pilot study assessed a mobile phone app with a wearable monitoring device and compared the use of the app with a health education control group [ ]. A significant meaningful weight reduction was noted in the monitoring device group.
Only a few studies have examined the use of mobile apps in hospital- or clinic-based weight loss programs and assessed how these apps may have affected the patient-doctor relationship. In our study, given that the app was developed for supportive use in a clinic-based weight loss program, we decided to link an accelerometer to the app. Therefore, our study aims were to develop a mobile app linked with an accelerometer for a clinic-based weight loss program and to test its usability, acceptability, and early effects on the patient-doctor relationship.
Development Process of the Mobile App Linked With an Accelerometer
One aim of this study was to describe the development process of a mobile app linked with an accelerometer for a clinic-based weight loss program. This study was part of a project to develop a personalized media service using a device-cloud interconnection for improving patient-doctor communication, which was funded by a grant from the Korean Evaluation Institute of Industrial Technology Research Fund. The development of the mobile app was planned and organized by a multidisciplinary team, including a team from Xeron Healthcare Corporation (Seoul, Republic of Korea), app designers, and teams from the hospital staff (family physicians and dietitians with a research coordinator; Seoul National University Bundang Hospital, Seongnam, Republic of Korea) between September 2013 and February 2014.
The theoretical concept for this mobile app was mainly derived from social cognitive theory , which has played an important role in many weight loss clinical trials [ ]. Weight management involves numerous lifestyle changes, including diet and exercise, which must be sustained for a long time. For such changes to be achieved and maintained over the course of an individual’s life, participants should believe in the value of weight loss and that their desired outcome is achievable through implementation of the required behavioral changes. Furthermore, those changes can be made through a key mediator [ ]; self-regulation skills, such as goal setting, self-monitoring of behaviors (such as dietary intake or physical activities), or target outcomes (such as weight); and social support from important others [ ].
Other important behavioral strategies have been noted to aid weight loss , such as time management, stimulus control, self-reward, relapse prevention, and emotion-focused strategies or cognitive strategies, which are all important components of successful weight management. However, the aim of our mobile app was to support weight management in clinic-based settings. Therefore, we adopted four main features in our app: (1) increased knowledge by providing personalized educational materials, (2) personal goal setting for weight loss, (3) self-monitoring of weight and physical activity linked with an accelerometer, and (4) online social support from a peer group as well as Web-based communication channels with their clinicians.
Definition of Obesity-Related Problems and Development of a Web-Based Interface Using Information From Electronic Health Records in a Clinic-Based Weight Reduction Program
For the clinic-based weight loss program, we assessed patients and categorized their obesity-related problems [, ] into subclinical states, symptomatic physical dysfunction, and established obesity-related diseases. We developed a Web-based interface for the mobile app to provide obesity-related information based on electronic health records (EHRs) to provide patients with tailored content and assessment tools, as shows. From EHRs we obtained anthropometric measurements, such as height, weight, age, abdominal circumference, and blood pressure, as well as laboratory measurements, including blood glucose, uric acid, triglyceride levels, high-density lipoprotein cholesterol, and low-density lipoprotein cholesterol. A family physician input information regarding obesity-related comorbidities, such as coronary artery disease, stroke, hypertension, diabetes, dyslipidemia, nonalcoholic steatohepatitis, arthritis, gout, obstructive sleep apnea, and reflux esophagitis, from the initial assessment. Participants consulted with dietitians and were prescribed a weekly sample menu of a low-calorie diet consisting of 1200 to 1800 kcal/day that was based on their age, sex, activity level, and target weight. Moreover, in accordance with the target weight and prescribed daily calories, participants were advised to achieve a target level of physical activity each day.
Delivery of Tailored Educational Materials Via a Web-Based Interface Using Information From EHRs
We considered the delivery of tailored educational materials about diseases and the specific weight loss target for each person as an important function of the app. We developed educational videos (seefor the educational video for angina pectoris) for each obesity-related disease as part of the tailored educational materials. The educational videos featured a fictional scenario pertaining to a patient and an explanation of the mechanisms of the disease, as well as possible suggestions for weight loss. We set a target for the total running time for each video to be no greater than 1 minute and 30 seconds.
Participants could monitor their corresponding diseases through the app, and each disease was linked with educational videos that ran on their app. Additional educational materials could be viewed and downloaded on mobile phones running the Android operating system (Google) linked with the study app called My Health Diary. Within the app, each disease was also linked with corresponding nutritional information and recommendations. We provided general nutritional information about macronutrients, a low-salt diet, and low-calorie tips for shopping or dining out. We also provided dietary guidelines for specific diseases, such as dyslipidemia, diabetes, fatty liver, and hypertension, to patients in need (). We presented sample menus of healthy meals for 1week in accordance with the calorie targets prescribed by a dietitian ( ).
Personal Goal Setting, Self-monitoring, and Automatic Feedback on Weight and Physical Activities Using an Accelerometer
Participants could set their final weight goal and monthly weight goal. If they did not enter their goal, a default set of goals was automatically chosen: 10% reduction of their current weight as the final goal and a 2-kg reduction as the monthly goal. If the monthly goal was >5% of their current weight, information regarding the risk of rapid weight loss and advice for adjusting the target goal was provided.
If participants set their goal, the difference between their current weight and their target weight was automatically calculated in calories. Assuming participants adhered to their prescribed calorie targets, the app suggested daily and weekly target activity calories. Participants could select the target activity calories within a 10% range.
A wristband-type, 3-axis accelerometer (LG LifeGram, LG Electronics, Seoul, Republic of Korea) monitored the patients’ physical activity. This accelerometer analyzes the number of steps, distance, activity time, and intensity of the activity and calculates the calories burned by each activity on the basis of patients’ personal information, such as height, weight, age, and sex. We chose this accelerometer because it allowed us to use the database directly linked with the study app. Unfortunately, no studies regarding the validity of the LG LifeGram have been published.
Physical activities were monitored daily by the accelerometer, which synchronized with the mobile app. Automatic feedback messages were sent to patients in accordance with the protocols based on their monthly target weight loss goal, which included the recommended calorie consumption per day, target calories burned by activities, and previous physical activity records. If the accelerometer and the mobile app were not synchronized over a 24-hour period, an automated reminder message was sent to patients. Self-reporting of daily weight was encouraged. If no weight was reported for more than 2 days, an automated reminder message was sent to patients. Asshows, weekly graphical reports provided weight and physical activity summaries with messages of encouragement and assigned the goals for the next week.
Development of a Web-Based Communication Channel Between Patient and Doctor
We developed an interactive messaging board between doctors and patients. If a patient asked questions regarding their health status or condition via the message board, doctors received an automated message asshows. The message board was developed to promote effective and efficient communication, which would supplement the short interview time available during clinic visits. Doctors had a choice of answering questions either via the mobile app or directly during a scheduled clinic visit with patients. Doctors could also leave encouraging messages or target goals on the message board, and messages were sent to the corresponding patient’s mobile app. The message board was developed for one-to-one chatting with each patient’s doctor, and patients could not see the contents of other participants’ messages. On the doctor’s app screen, the message board looked like a list of emails from participants, but only one-to-one communication was possible so that the participants’ sensitive medical information remained secure.
Peer Support Group Using a Social Network Service
We set up a peer support group using a social networking service that was incorporated into our mobile app () that the participants could join. Participants could view each other’s physical activities and the percentage of their goals that they had completed, and they could communicate with each other via a peer-to-peer messaging system. Participants’ physical activities with their achievement goals were linked with the social networking service and viewable by other people by default. The default option was that only the username generated by each participant was visible in the social network service, but it was possible for the participants to upload their photo.
During the period of March 2014 to May 2014, we applied a pre-post single-group design to evaluate the usability and acceptability, as well as the early effects on patient-doctor relationship, of our newly developed mobile app, which was linked with an accelerometer. Usability assessments measured the technical effectiveness of the mobile app by asking whether the users could easily follow the steps without making any errors. We assessed acceptability by the users’ overall experience in using the mobile app, their perceived confidence in the information, and their satisfaction with the experience. Our aim was to implement a mobile app that runs on mobile phones as a clinical program. We did not provide telephone numbers, emails, or Web-based portal services to patients. A Web-based portal was only used for researchers to summarize participant’s anthropometric measurements, laboratory measurements, and corresponding obesity-related problems.
Flow of the Clinic-Based Weight Loss Program
We briefly outline the clinic-based weight loss program as follows.
If a patient came to the clinic, either on their own or referred from other departments, a family physician obtained the patient’s medical history, health behaviors, previous attempts at losing weight, preferences, and goals. Then, the patient was scheduled for a meeting with a dietitian and was evaluated regarding obesity-related problems, including screening questionnaires for depression and eating disorders, body composition measurements, and laboratory examinations, such as tests for glucose, cholesterol, liver function, and kidney function. The patient could be referred to specialists in accordance with the problems identified in their initial assessment. The patient then received a treatment program consisting of lifestyle-focused interventions, including a nutritional plan, targeted behavioral changes, and an exercise program. The patient was also provided with pharmacotherapy or was referred to a bariatric surgical team if their body mass index (BMI) was >35 kg/m2 with comorbidities, they had previously attempted lifestyle modification and pharmacotherapy without success, and they were interested in surgical treatment. A follow-up meeting with the physician was typically scheduled at 2- to 4-week intervals for the first 3 months.
We recruited 30 participants from patients who visited our clinic for weight loss programs. The World Health Organization’s Regional Office for the Western Pacific Region defines obesity in Asians as those with a BMI ≥25 kg/m2 . The Korean government officially uses this definition when defining and implementing health policies regarding obesity in Korea.
If patients met the following criteria, they were eligible for participation: BMI of ≥25 kg/m2, possession of an Android mobile phone, and between 20 and 70 years of age. Patients were excluded if they had been admitted to a hospital due to a cardiovascular disease in the previous 6 months, being immobile due to surgical procedures in the previous 3 months, being pregnant, having experienced weight fluctuations of >10% in the previous year, or having a history of alcohol use disorder, an eating disorder, or of using weight loss pills in the previous 3 months.
Patients who were eligible were identified and informed about the study. On their second visit to the clinic, patients were invited to participate and discuss their results from the initial assessment. If a patient agreed to participate and provided written informed consent, he or she was scheduled to contact a research staff member for instructions regarding the process of downloading, authenticating, and using the app, as well as other pertinent information, including receiving manuals and explanations for the accelerometer. Moreover, patients were followed up 4 weeks after downloading the study app.
We also explained the delay of pharmacotherapy or surgical treatment for the 1 month of the study period so that we could perform pilot testing of the app’s effect on weight changes. Patients received the equivalent of US $20 per visit as reimbursement. The study was approved by the Institutional Review Board of Seoul National University Bundang Hospital (B-1402-238-005).
The primary outcomes measured were the acceptability of our mobile app linked with an accelerometer and changes in the patient-doctor relationship after the intervention. We measured the usability of our mobile app linked with an accelerometer via a 5-point Likert scale by asking whether the users could easily follow every step without making errors and successfully complete all steps. We analyzed usage information of each module in our mobile app as follows. (1) mean number of log-ins per day: the mean number of log-ins to the mobile app per day during the study period, which represented how often a participant used the app in a day, (2) use of each module: the number of clicks per specific module divided by the total number of clicks in the mobile app during the study period, which represented how often a participant used a specific module in this app, (3) mean exercise calories per week: the mean exercise calories per week was recorded by an accelerometer during the study period, which represented the actual exercise activities recorded by an accelerometer in a week, (4) mean percentage of weekly exercise goals achieved: the mean percentage of actual exercise calories divided by suggested exercise goals per week, which represented the amount of exercise a participant achieved in a week, (5) total numbers of messages posted on the social network services: the numbers of messages, including replies participants posted on the social network services, which represented how frequently a participant used the social network services.
We evaluated the patient-doctor relationship by the scores of the Patient-Doctor Depth-of-Relationship Scale . This scale is an 8-item self-completed questionnaire for measuring 4 elements: knowledge, trust, loyalty, and respect. The survey instrument has good reported reliability (Cronbach alpha=.93).
The secondary outcomes were changes in weight and abdominal circumferences from before to after the study. A research nurse measured these when patients visited the clinic.
Protecting Patient Privacy and Security When Using the Mobile App
According to the Personal Information Protection Act in Korea, unique identifiers, social security numbers, and bioinformation should be safely encrypted when they are intended to be transferred via a network or subsidiary storage devices. In our mobile app, we stored all individual information on the internal server, where a firewall was installed to block unauthorized access. We also incorporated an additional layer of authentication using an email address and a password.
We used descriptive statistics to summarize the baseline characteristics of the study participants. We analyzed the information on use for each functional category in our mobile app along with the proportion of patients who achieved their first month’s target goal. For the acceptability tests, we present the percentages for each response. Changes in weight and abdominal circumferences were calculated using a paired t test, and changes in the patient-doctor relationship scales were tested using a Wilcoxon signed rank test. We performed all statistical analyses using Stata version 12.1 (StataCorp LP) and considered P<.05 to be statistically significant.
Baseline Characteristics of Study Participants
A total of 30 individuals agreed to participate in the study. At 1 month, 93% (28/30) of participants completed their follow-up surveys. Although 2 participants used the mobile app for 1 month, they were unable to attend their 1-month follow-up visit. Among the 30 participants, 60% (18/30) were male. Participants had a mean age of 49.07 (SD 8.84) years and a mean BMI of 27.64 (SD 2.14) kg/m2; 60% (18/30) of participants had dyslipidemia, 27% (8/30) had hypertension, and 10% (3/30) had diabetes mellitus. ()
Mobile App Use Information During the Intervention Period
All study participants used the mobile app at least once during the study period even if they did not complete the follow-up visits.presents usage information.
Participants used the study app for a median of 1.21 log-ins per day with a maximum of 6.38 log-ins per day. The most frequently used module was goal setting (median 199 times, 74%), followed by tracking of physical activities (median 30 times, 13.5%) and viewing of personal health status (median 34.5 times, 10.8%).
Most study participants achieved more than their recommended exercise; the median percentage of target exercise goals achieved per week was 125.9%. The mean number of messages posted on the social network service was 1 during the entire study period, and only 6 patients used the social network service.
Usability of Mobile App After 1 Month of Intervention
With regard to the app’s ease of use, participants reported a high rate of positive responses for the log-in process (25/28, 89%) and goal setting process (23/28, 82%), as presented in. However, the rate of positive responses for the message board was low, including posting (11/28, 39%) and replying (10/28, 36%) on the social network service. Additionally, the positive response rate for the educational videos was 46% (13/28).
Acceptability of the Mobile App and Patient-Doctor Relationship Scales
Asshows, regarding participants’ satisfaction with each module of the mobile app, setting personal goals had the highest positive response rate, at 75% (21/28). Ratings of satisfaction with the monitoring and feedback on physical activities were also highly positive. However, satisfaction with the social network service, educational videos, problem solving in case of errors, and reliability of the contents was approximately 50% (14/28, 14/28, 15/28, and 15/28), which was low relative to other modules. Nonetheless, most users (26/28, 93%) responded positively to receiving help with managing weight from the mobile app. Specifically, 75% (21/28) of users were willing to recommend this app to their family or friends, and 79% (22/28) (expressed interest in continuing to use this app for weight management.
Scales measuring the depth of the patient-doctor relationship decreased during the 1-month period from 27.6 (SD 4.8) to 25.1 (SD 4.5) by a Wilcoxon signed rank test (P=.02).
After the 1-month study period, the mean weight change was –0.1 kg (95% CI –0.6 to 0.8) and we observed no significant changes. However, abdominal circumference was significantly reduced by a mean of –1.84 cm (95% CI –3.3 to –0.4) (see).
|Male, n (%)||18 (60.0)|
|Age in years, mean (SD)||49.07 (8.84)|
|Weight in kg, mean (SD)||76.82 (8.38)|
|Abdominal circumference in cm, mean (SD)||93.55 (4.92)|
|BMIa in kg/m2, mean (SD)||27.64 (2.14)|
|Systolic blood pressure in mmHg, mean (SD)||111.07 (39.85)|
|Diastolic blood pressure in mmHg, mean (SD)||70.70 (25.40)|
|Fasting glucose in mg/dL, mean (SD)||86.87 (37.24)|
|Triglyceride in mg/dL, mean (SD)||121.90 (80.08)|
|HDLb cholesterol in mg/dL, mean (SD)||42.8 (20.17)|
|LDLc cholesterol in mg/dL, mean (SD)||102.97 (56.05)|
|Uric acid in mg/dL, mean (SD)||5.20 (2.59)|
|Hypertension, n (%)||8 (26.7)|
|Diabetes mellitus, n (%)||3 (10.0)|
|Dyslipidemia, n (%)||18 (60.0)|
|Ischemic heart disease, n (%)||1 (3.3)|
|Cerebrovascular disease (n, %)||1 (3.3)|
|Gastroesophageal reflux disease, n (%)||7 (23.3)|
|Obstructive sleep apnea, n (%)||5 (16.7)|
aBMI: body mass index.
bHDL: high-density lipoprotein.
cLDL: low-density lipoprotein.
|Aspect of use||Minimum||25th percentile||Median||Mean||75th |percentile||Maximum|
|Mean number of log-ins per daya||0.03||0.73||1.21||1.88||2.65||6.38|
|Numbers of clicks on each module, n (%)b|
|Goal setting||24.0 (36.0)||151.0 (61.5)||199.0 (74.4)||217.13 (71.3)||290.0 (77.9)||549.0 (98.8)|
|My personal health status||1 (0.6)||21.0 (8.9)||34.50 (10.8)||40.83 (12.3)||52.0 (16.0)||136.0 (33.7)|
|Educational videos and nutritional information||0.0 (0)||2 (0.9)||5.5 (1.9)||6.6 (2.1)||10.0 (2.8)||19.0 (6.7)|
|Tracking my physical activities||1 (0.6)||20.0 (9.6)||30.0 (13.5)||55.7 (14.3)||69.0 (18.4)||285.0 (31.9)|
|Mean exercise calories per weekc||46.0||1740.0||2575.0||2612.8||3211.5||7125.5|
|Mean percentage of weekly exercise goals achieved (%)d||3.4||87.9||125.9||141.1||167.1||601.7|
|Total numbers of messages posted on patient-doctor communication board||0||0||0||0.5||1||3|
|Total numbers of messages posted on social network servicee||0||0||0||1||0||10|
aThe number of days that patients logged into the mobile app at least once during the study period.
bUsage rate of each module is calculated as the percentage of the number of clicks on each module divided by the total number of clicks on all mobile app menus during the study period.
cThe mean calories expended in exercise per week recorded by the accelerometer during the study period.
dThe mean percentage of actual exercise calories divided by suggested exercise goals per week.
eThe numbers of messages including replies that participants posted on the social network service.
|Aspect of usability||Strongly agree||Agree||Neutral||Disagree||Strongly disagree|
|My personal health status||3||15||9||1||0|
|Educational videos and nutritional information||1||12||11||3||1|
|Tracking my physical activities||4||13||10||1||0|
|Posting comments on social network||1||10||15||2||0|
|Replying to comments on social network||2||8||16||2||0|
|Sharing information regarding physical activities through social network||3||11||13||1||0|
|Ease of learning each function||2||17||8||1||0|
|Aspect of acceptability||Strongly agree||Agree||Neutral||Disagree||Strongly disagree|
|Social network service||3||11||13||1||0|
|Tracking physical activities||7||13||7||0||1|
|Feedback on physical activities||6||14||5||2||1|
|Contents in mobile app||8||13||7||0||0|
|Convenience in using mobile app||5||15||8||0||0|
|Integration of each function||2||13||11||2||0|
|Font size and styles||4||15||8||1||0|
|Response to problems with using the app||2||13||12||1||0|
|Reliability of contents||3||12||13||0||0|
|Helpfulness in managing weight||9||17||2||0||0|
|Likelihood of recommending this app to family or friends||7||14||7||0||0|
To our knowledge, this was the first study to test the usability and acceptability of a mobile app linked with an accelerometer for a clinic-based weight loss program, and was also the first to evaluate such an app’s early effect on the patient-doctor relationship. Most participants used our mobile app during the 1-month study period, and the goal setting function with self-monitoring of physical activities linked with an accelerometer was the most frequently used module. As this was a pilot study for the purpose of further improving our mobile app, we focused on the usability and acceptability of our app, as well as on the preliminary findings concerning the patient-doctor relationship.
Development of a Mobile App Linked With an Accelerometer for a Clinic-Based Weight Management Program
In contrast with many other weight loss apps that target the general population as a health and fitness tool, our mobile app was targeted to the population that participates in a clinic-based weight management program. Our choice of target population was based on several factors that are particular to hospital settings.
Numerous different phenotypic presentations [, ] and risks that affect obesity-related mortality have been noted [ ], even within the same BMI. Therefore, recognizing obesity-related comorbidities and functional status is essential for treatment planning, as well as for prescribing exercise or nutrition. These evaluations are typically possible only in a clinic or hospital setting with a multidisciplinary health care team. Hence, management of weight loss should not only target weight loss itself but also aim at controlling obesity-related health problems. Consequently, a commercially available weight loss app cannot deliver tailored information to each patient. We attempted to incorporate medical information from EHRs to deliver the appropriate information to each patient in need via tailored education videos and nutritional information. Moreover, bariatric surgery continues to be the most effective method for initiating significant improvement in obesity-related comorbidities [ , ], and the need for multidisciplinary weight management is increasing in hospital settings for both pre- and postoperational care. Therefore, mobile technology can contribute to a precise assessment of obesity-related comorbidities, thereby enhancing the medical and surgical treatments.
Given that informed, active patients, or patients who have the motivation, knowledge, skill, and confidence, play a large role in improving their own health outcomes , as well as reducing health care costs [ ], our mobile app could have potential use as a tool for supporting patient activation in hospitals by providing tailored education along with self-management skills.
A mobile app linked with an accelerometer could be a good resource for clinicians for monitoring patient behaviors or physiological signals. In addition, if such information is recognized and used during a clinic or hospital visit, high-quality doctor-patient exchanges both inside and outside of the office visit can be achieved, which could favorably influence patients’ behavior and attitude .
Although our study did not use EHR-linked personal health records, our methods can be applied to incorporating them in chronic disease management, where patients require constant care and regular follow-ups.
Usability and Acceptability of the Mobile App
Based on app usage data, the most frequently used module was goal setting, as well as the monitoring of and feedback on physical activities, which was concordant with the subjective satisfaction measures reported in the questionnaires. The median number of log-ins per day was 1.2, and all participants used our app over the course of the 1-month intervention period. Furthermore, participants achieved more than their suggested activity amount. We linked an accelerometer to our mobile app automatically, which potentially contributed to its frequent use and the successful achievements within our app. The self-regulation function was the main feature of our program, and participants evaluated this feature as the most comfortable and helpful through both objective and subjective measurements. These results were consistent with other studies [, ], which further validates the benefit of mobile health apps in increasing physical activity. This increase may also result in a reduction in the abdominal circumferences of study participants by the end of the study period.
Conversely, we only provided nutritional guidelines that matched with the metabolic profiles of each participant, and we did not track nutrition, which may have affected the weight loss outcomes. Although abdominal circumferences were reduced by a mean of -1.84 cm during the study period, we noted no weight change. Research has demonstrated that frequent recording of dietary intake can contribute to weight loss . However, recording food intake has been the most laborious and challenging work in mobile phone apps or websites for weight loss [ ]. Healthy diet education via a mobile app did not affect weight loss. However, eliminating the food diary, which is time consuming, might also lead to a low attrition rate for mobile apps. Furthermore, a food recording function that is user friendly and less time consuming is necessary for achieving desirable outcome in a clinic-based weight loss program.
The satisfaction rate was low for the personalized mobile education module. We attempted to provide the study participants with tailored educational videos. Most participants did not download the educational videos from an Android operating system even if they received instructions on how to download the videos. The size of each educational video was between 31.8 and 52.4 MB. Therefore, the process of downloading and viewing educational videos may have been too difficult or too time consuming, or patients may have simply been in an area with no Internet or network connection.
Moreover, only a few participants used the social network service. Although social networking has been used extensively in intervention approaches, including those targeted at weight loss, no clear effect of social networking on weight change has been reported in randomized controlled trials . However, participants received more encouragement from the community in many weight loss intervention programs that used social network services [ ]. The low usage of this module combined with low satisfaction among our study participants may be attributed to several factors. The patients were all new users to our social network service, and no one had adequate experience to act as a facilitator. They study intervention period was only 1 month long, hindering the formation of a strong support group. Given the age and sex of our study participants, patients might not have been exposed to online social networking in general. The contents of the online networking in this study app might not have met participants’ needs, or the usability might not have been optimal, which is important for both user engagement and behavioral change [ ]. However, research into the theory and function of online social networking and its impact on health outcomes is still in early development, and more studies regarding the actual usability combined with the contextual factors of social networking are needed. According to a systematic review [ ], most studies reported that online social networking in attempts to change health behavior had poor retention and engagement.
Patient-Doctor Relationship Scales
Our mobile app had a unique feature: an interactive message board that was used to help patients share information with their doctors. However, according to the usage analysis, only a few participants used the interactive message board for communication. Family physicians in charge of patients left at least 2 messages for all participants under their care: 1 at the beginning of the study period to encourage behavioral change, and the other 2 weeks later to address questions about the weight loss program or process. Only 2 patients sent messages to their doctors: 1 pertained to how to take care of high blood pressure measured at home, and the other pertained to medication for controlling diabetes. Doctors replied to the participant’s question via the message board, but the participants were informed that the doctor’s reply may be instant or provided at the time of their scheduled session. Such misinformation may have inhibited the participants from using the interactive message board.
In our study, scales measuring the depth of the patient-doctor relationship decreased during the 1-month study period. This effect could reflect several aspects related to using the mobile app in a clinical setting. First, the doctor’s passive participation in the app, particularly in the interaction with a patient, might have been a factor in the decreased depth in the patient-doctor relationship. Second, the doctor’s encouragement or feedback regarding app usage might not have been recognized during the clinic visit, or the doctor’s feedback might not have been sufficiently positive. According to one survey regarding information technology and its impact on doctor-patient communication , panelists, including both medical professionals and patient advocates, expected improvement in the relationship. However, the lack of acceptance by doctors and issues of data security and monetary costs were regarded as barriers. Third, patient-doctor relationship scales might not adequately reflect short-term changes. Patient-doctor relationship scales were designed to measure the quality of the relationship in the context of continuity of care, whereas our study period was only 1 month. Fourth, empowering patients with self-management skills could make the patient-doctor relationship more complicated, and this phenomenon could have a negative effect on the short-term patient-doctor relationship if a doctor did not exhibit a supportive attitude toward using the apps. Moreover, cultural aspects of the relationship between a patient and his or her doctor in Korea may have played a role in preventing any improvement [ ].
This study had several limitations. It was a pilot study of a single group that used a pre-post intervention design, which only demonstrated the possibilities for further improvement and clarification of the app’s design and treatment functions. The research was performed in 1 clinic for a limited time using a small number of participants, which may not reflect the diverse population of patients with weight problems. We attempted to implement the function of self-monitoring of physical activity by synchronizing the accelerometer with the app, but LG LifeGram has not published its validity test, which might affect the usage pattern for this study app.
However, to our knowledge, this study is one of the first to demonstrate the usability and acceptability of a mobile app linked with an accelerometer for a clinic-based weight loss program and its potential impact on the doctor-patient relationship. The mean age of the study participants was 49.07 years, which is generally older than other mobile app studies [, ] with a greater proportion being male participants. This finding could potentially indicate that these were less-active users for a mobile weight loss app. However, all participants used the mobile app during the study period, achieved their suggested physical activity goals, and reported a high rate of satisfaction with the self-regulation function. One study [ ] suggested that men would be willing to use Web-based self-monitoring tools delivered by mobile phones if interventions were easy, quick, and simple to use but showed little interest in using the social networking service. Our study results confirm these observations to some degree. Further studies identifying a mediating effect of age and sex will be needed to deliver a tailored intervention through a mobile app.
This mobile app has the potential for furthering improvements in achieving weight loss if it includes more strategies for reaching dietary goals, improvements in pattern monitoring and stress management techniques , and improvements in its structure, ease of use, personalized features, and accessibility in technology and design [ ]. Further studies with a larger representative population and longer duration are needed.
In this study, we evaluated a mobile app linked with an accelerometer for a clinic-based weight loss program. Mobile health apps have the potential to be integrated into a clinic-based weight management program by empowering patients with self-regulation tools that enhance physical activity.
An easier method for recording daily food intake should be incorporated into the mobile app for better weight loss outcomes. Further reflection of the user’s needs with regard to the online social network and the patient-doctor relationship should also be considered.
This study was supported by grant No. 10042697 from the Ministry of Trade, Industry and Energy and Korean Evaluation Institute of Industrial Technology Research Fund. We would like to thank YooYoung Shin for her support for this work.
Conflicts of Interest
Multimedia Appendix 1
The educational video for angina pectoris.MP4 File (MP4 Video), 43MB
Multimedia Appendix 2
Changes in weight and abdominal circumference after a 1-month intervention.PDF File (Adobe PDF File), 29KB
- Alexander JA, Hearld LR, Mittler JN, Harvey J. Patient-physician role relationships and patient activation among individuals with chronic illness. Health Serv Res 2012 Jun;47(3 Pt 1):1201-1223 [FREE Full text] [CrossRef] [Medline]
- Annesi JJ, Tennant GA. Mediation of social cognitive theory variables in the relationship of exercise and improved eating in sedentary adults with severe obesity. Psychol Health Med 2013;18(6):714-724. [CrossRef] [Medline]
- Azar Kristen M J, Lesser LI, Laing BY, Stephens J, Aurora MS, Burke LE, et al. Mobile applications for weight management: theory-based content analysis. Am J Prev Med 2013 Nov;45(5):583-589. [CrossRef] [Medline]
- Balatsoukas P, Kennedy CM, Buchan I, Powell J, Ainsworth J. The role of social network technologies in online health promotion: a narrative review of theoretical and empirical factors influencing intervention effectiveness. J Med Internet Res 2015;17(6):e141 [FREE Full text] [CrossRef] [Medline]
- Bandura A. Social cognitive theory: an agentic perspective. Annu Rev Psychol 2001;52:1-26. [CrossRef] [Medline]
- Bassett J, International Diabetes Institute, World Health Organization, Regional Office for the Western Pacific, International Association for the Study of Obesity, International Obesity Task Force. The Asia-Pacific Perspective: Redefining Obesity and its Treatment. Sydney, Australia: Health Communications; 2000.
- Becker S, Miron-Shatz T, Schumacher N, Krocza J, Diamantidis C, Albrecht U. mHealth 2.0: experiences, possibilities, and perspectives. JMIR Mhealth Uhealth 2014;2(2):e24 [FREE Full text] [CrossRef] [Medline]
- Bragg R, Crannage E. Review of pharmacotherapy options for the management of obesity. J Am Assoc Nurse Pract 2015 Jun 25. [CrossRef] [Medline]
- Brindal E, Hendrie G, Freyne J, Coombe M, Berkovsky S, Noakes M. Design and pilot results of a mobile phone weight-loss application for women starting a meal replacement programme. J Telemed Telecare 2013 Mar 21. [CrossRef] [Medline]
- Caperchione CM, Kolt GS, Savage TN, Rosenkranz RR, Maeder AJ, Vandelanotte C, et al. WALK 2.0: examining the effectiveness of Web 2.0 features to increase physical activity in a 'real world' setting: an ecological trial. BMJ Open 2014;4(10):e006374 [FREE Full text] [CrossRef] [Medline]
- Carson TL, Eddings KE, Krukowski RA, Love SJ, Harvey-Berino JR, West DS. Examining social influence on participation and outcomes among a network of behavioral weight-loss intervention enrollees. J Obes 2013;2013:480630 [FREE Full text] [CrossRef] [Medline]
- Carter MC, Burley VJ, Nykjaer C, Cade JE. Adherence to a smartphone application for weight loss compared to website and paper diary: pilot randomized controlled trial. J Med Internet Res 2013;15(4):e32 [FREE Full text] [CrossRef] [Medline]
- Cleator J, Richman E, Leong KS, Mawdsley L, White S, Wilding J. Obesity: under-diagnosed and under-treated in hospital outpatient departments. Int J Obes Relat Metab Disord 2002 Apr;26(4):581-584. [Medline]
- Denis GV, Hamilton JA. Healthy obese persons: how can they be identified and do metabolic profiles stratify risk? Curr Opin Endocrinol Diabetes Obes 2013 Oct;20(5):369-376 [FREE Full text] [CrossRef] [Medline]
- Dilla T, Valladares A, Nicolay C, Salvador J, Reviriego J, Costi M. Healthcare costs associated with change in body mass index in patients with type 2 diabetes mellitus in Spain: the ECOBIM study. Appl Health Econ Health Policy 2012 Nov 1;10(6):417-430 [FREE Full text] [CrossRef] [Medline]
- Fanning J, Mullen SP, McAuley E. Increasing physical activity with mobile devices: a meta-analysis. J Med Internet Res 2012;14(6):e161 [FREE Full text] [CrossRef] [Medline]
- Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, et al. The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS Med 2013;10(1):e1001362 [FREE Full text] [CrossRef] [Medline]
- Frühbeck G, Toplak H, Woodward E, Halford Jason C G, Yumuk V, European Association for the Study of Obesity. Need for a paradigm shift in adult overweight and obesity management - an EASO position statement on a pressing public health, clinical and scientific challenge in Europe. Obes Facts 2014;7(6):408-416. [CrossRef] [Medline]
- Gorin AA, Powers TA, Koestner R, Wing RR, Raynor HA. Autonomy support, self-regulation, and weight loss. Health Psychol 2014 Apr;33(4):332-339. [CrossRef] [Medline]
- Greene J, Hibbard JH, Sacks R, Overton V, Parrotta CD. When patient activation levels change, health outcomes and costs change, too. Health Aff (Millwood) 2015 Mar 1;34(3):431-437. [CrossRef] [Medline]
- Greene J, Hibbard JH. Why does patient activation matter? An examination of the relationships between patient activation and health-related outcomes. J Gen Intern Med 2012 May;27(5):520-526 [FREE Full text] [CrossRef] [Medline]
- Haluza D, Jungwirth D. ICT and the future of health care: aspects of doctor-patient communication. Int J Technol Assess Health Care 2014 Jul;30(3):298-305. [CrossRef] [Medline]
- Hartmann-Boyce J, Johns DJ, Jebb SA, Aveyard P, Behavioural Weight Management Review Group. Effect of behavioural techniques and delivery mode on effectiveness of weight management: systematic review, meta-analysis and meta-regression. Obes Rev 2014 Jul;15(7):598-609 [FREE Full text] [CrossRef] [Medline]
- Højgaard B, Gyrd-Hansen D, Olsen KR, Søgaard J, Sørensen Thorkild I A. Waist circumference and body mass index as predictors of health care costs. PLoS One 2008;3(7):e2619 [FREE Full text] [CrossRef] [Medline]
- Jensen MD, Ryan DH, Apovian CM, Ard JD, Comuzzie AG, Donato KA, American College of Cardiology/American Heart Association Task Force on Practice Guidelines, et al. 2013 AHA/ACC/TOS guideline for the management of overweight and obesity in adults: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines and The Obesity Society. J Am Coll Cardiol 2014 Jul 1;63(25 Pt B):2985-3023 [FREE Full text] [CrossRef] [Medline]
- Kim SS, Park BK. Patient-perceived communication styles of physicians in rehabilitation: the effect on patient satisfaction and compliance in Korea. Am J Phys Med Rehabil 2008 Dec;87(12):998-1005. [CrossRef] [Medline]
- Korda RJ, Joshy G, Paige E, Butler James R G, Jorm LR, Liu B, et al. The relationship between body mass index and hospitalisation rates, days in hospital and costs: findings from a large prospective linked data study. PLoS One 2015;10(3):e0118599 [FREE Full text] [CrossRef] [Medline]
- Kuk JL, Ardern CI, Church TS, Sharma AM, Padwal R, Sui X, et al. Edmonton Obesity Staging System: association with weight history and mortality risk. Appl Physiol Nutr Metab 2011 Aug;36(4):570-576. [CrossRef] [Medline]
- Kwok CS, Pradhan A, Khan MA, Anderson SG, Keavney BD, Myint PK, et al. Bariatric surgery and its impact on cardiovascular disease and mortality: a systematic review and meta-analysis. Int J Cardiol 2014 Apr 15;173(1):20-28. [CrossRef] [Medline]
- Lagger G, Pataky Z, Golay A. Efficacy of therapeutic patient education in chronic diseases and obesity. Patient Educ Couns 2010 Jun;79(3):283-286. [CrossRef] [Medline]
- Laing BY, Mangione CM, Tseng C, Leng M, Vaisberg E, Mahida M, et al. Effectiveness of a smartphone application for weight loss compared with usual care in overweight primary care patients: a randomized, controlled trial. Ann Intern Med 2014 Nov 18;161(10 Suppl):S5-12. [CrossRef] [Medline]
- Lau David C W, Douketis JD, Morrison KM, Hramiak IM, Sharma AM, Ur E, Obesity Canada Clinical Practice Guidelines Expert Panel. 2006 Canadian clinical practice guidelines on the management and prevention of obesity in adults and children [summary]. CMAJ 2007 Apr 10;176(8):S1-13 [FREE Full text] [CrossRef] [Medline]
- Lo B, Parham L. The impact of web 2.0 on the doctor-patient relationship. J Law Med Ethics 2010;38(1):17-26. [CrossRef] [Medline]
- Ma J, Flanders WD, Ward EM, Jemal A. Body mass index in young adulthood and premature death: analyses of the US National Health Interview Survey linked mortality files. Am J Epidemiol 2011 Oct 15;174(8):934-944 [FREE Full text] [CrossRef] [Medline]
- Maddison R, Pfaeffli L, Whittaker R, Stewart R, Kerr A, Jiang Y, et al. A mobile phone intervention increases physical activity in people with cardiovascular disease: results from the HEART randomized controlled trial. Eur J Prev Cardiol 2015 Jun;22(6):701-709. [CrossRef] [Medline]
- Maher CA, Lewis LK, Ferrar K, Marshall S, De BI, Vandelanotte C. Are health behavior change interventions that use online social networks effective? A systematic review. J Med Internet Res 2014;16(2):e40 [FREE Full text] [CrossRef] [Medline]
- Martin CK, Miller AC, Thomas DM, Champagne CM, Han H, Church T. Efficacy of SmartLoss, a smartphone-based weight loss intervention: results from a randomized controlled trial. Obesity (Silver Spring) 2015 May;23(5):935-942. [CrossRef] [Medline]
- Martin DJ, Garske JP, Davis MK. Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review. J Consult Clin Psychol 2000 Jun;68(3):438-450. [Medline]
- World Health Organization Western Pacific Region, International Association for the Study of Obesity, International Obesity TaskForce. The Asia-Pacific Perspective: Redefining Obesity and its Treatment.: Health Communications Auustralia Pty Limited; 200 Feb. URL: http://www.wpro.who.int/nutrition/documents/docs/Redefiningobesity.pdf [accessed 2016-03-04] [WebCite Cache]
- Padwal RS, Pajewski NM, Allison DB, Sharma AM. Using the Edmonton obesity staging system to predict mortality in a population-representative cohort of people with overweight and obesity. CMAJ 2011 Oct 4;183(14):E1059-E1066 [FREE Full text] [CrossRef] [Medline]
- Pagoto S, Schneider K, Jojic M, DeBiasse M, Mann D. Evidence-based strategies in weight-loss mobile apps. Am J Prev Med 2013 Nov;45(5):576-582. [CrossRef] [Medline]
- Perugini RA, Malkani S. Remission of type 2 diabetes mellitus following bariatric surgery: review of mechanisms and presentation of the concept of 'reversibility'. Curr Opin Endocrinol Diabetes Obes 2011 Apr;18(2):119-128. [CrossRef] [Medline]
- Poncela-Casasnovas J, Spring B, McClary D, Moller AC, Mukogo R, Pellegrini CA, Nunes Amaral Luis A. Social embeddedness in an online weight management programme is linked to greater weight loss. J R Soc Interface 2015 Mar 6;12(104):20140686 [FREE Full text] [CrossRef] [Medline]
- Ridd MJ, Lewis G, Peters TJ, Salisbury C. Patient-doctor depth-of-relationship scale: development and validation. Ann Fam Med 2011 Dec;9(6):538-545 [FREE Full text] [CrossRef] [Medline]
- Riley WT, Rivera DE, Atienza AA, Nilsen W, Allison SM, Mermelstein R. Health behavior models in the age of mobile interventions: are our theories up to the task? Transl Behav Med 2011 Mar;1(1):53-71 [FREE Full text] [CrossRef] [Medline]
- Rusin M, Arsand E, Hartvigsen G. Functionalities and input methods for recording food intake: a systematic review. Int J Med Inform 2013 Aug;82(8):653-664. [CrossRef] [Medline]
- Ryan DH. The pharmacological and surgical management of adults with obesity. J Fam Pract 2014 Jul;63(7 Suppl):S21-S26. [Medline]
- Sama PR, Eapen ZJ, Weinfurt KP, Shah BR, Schulman KA. An evaluation of mobile health application tools. JMIR Mhealth Uhealth 2014;2(2):e19 [FREE Full text] [CrossRef] [Medline]
- Sharma AM, Kushner RF. A proposed clinical staging system for obesity. Int J Obes (Lond) 2009 Mar;33(3):289-295. [CrossRef] [Medline]
- Tang J, Abraham C, Stamp E, Greaves C. How can weight-loss app designers' best engage and support users? A qualitative investigation. Br J Health Psychol 2015 Feb;20(1):151-171. [CrossRef] [Medline]
- Taylor VH, Forhan M, Vigod SN, McIntyre RS, Morrison KM. The impact of obesity on quality of life. Best Pract Res Clin Endocrinol Metab 2013 Apr;27(2):139-146. [CrossRef] [Medline]
- Thande NK, Hurstak EE, Sciacca RE, Giardina EV. Management of obesity: a challenge for medical training and practice. Obesity (Silver Spring) 2009 Jan;17(1):107-113. [CrossRef] [Medline]
- Thompson L, McCabe R. The effect of clinician-patient alliance and communication on treatment adherence in mental health care: a systematic review. BMC Psychiatry 2012;12:87 [FREE Full text] [CrossRef] [Medline]
- Tsigos C, Hainer V, Basdevant A, Finer N, Fried M, Mathus-Vliegen E, Obesity Management Task Force of the European Association for the Study of Obesity. Management of obesity in adults: European clinical practice guidelines. Obes Facts 2008;1(2):106-116. [CrossRef] [Medline]
- Turner-McGrievy GM, Tate DF. Weight loss social support in 140 characters or less: use of an online social network in a remotely delivered weight loss intervention. Transl Behav Med 2013 Sep;3(3):287-294 [FREE Full text] [CrossRef] [Medline]
- Vandelanotte C, Caperchione CM, Ellison M, George ES, Maeder A, Kolt GS, et al. What kinds of website and mobile phone-delivered physical activity and nutrition interventions do middle-aged men want? J Health Commun 2013;18(9):1070-1083. [CrossRef] [Medline]
- Wadden TA, Berkowitz RI, Womble LG, Sarwer DB, Phelan S, Cato RK, et al. Randomized trial of lifestyle modification and pharmacotherapy for obesity. N Engl J Med 2005 Nov 17;353(20):2111-2120. [CrossRef] [Medline]
- Wannamethee SG, Atkins JL. Muscle loss and obesity: the health implications of sarcopenia and sarcopenic obesity. Proc Nutr Soc 2015 Nov;74(4):405-412. [CrossRef] [Medline]
- Wharton CM, Johnston CS, Cunningham BK, Sterner D. Dietary self-monitoring, but not dietary quality, improves with use of smartphone app technology in an 8-week weight loss trial. J Nutr Educ Behav 2014 Oct;46(5):440-444. [CrossRef] [Medline]
- Yaskin J, Toner RW, Goldfarb N. Obesity management interventions: a review of the evidence. Popul Health Manag 2009 Dec;12(6):305-316. [CrossRef] [Medline]
|BMI: body mass index|
|EHR: electronic health records|
Edited by G Eysenbach; submitted 21.04.15; peer-reviewed by J Fanning, E Brindal, M Cimperman, J Rawstorn, F Saigí-Rubió; comments to author 07.07.15; revised version received 25.08.15; accepted 04.01.16; published 31.03.16
©Seryung Choo, Ju Young Kim, Se Young Jung, Sarah Kim, Jeong Eun Kim, Jong Soo Han, Sohye Kim, Jeong Hyun Kim, Jeehye Kim, Yongseok Kim, Dongouk Kim, Steve Steinhubl. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 31.03.2016.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.