Published on in Vol 8, No 7 (2020): July

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/14778, first published .
Formative Evaluation of a Smartphone App for Monitoring Daily Meal Distribution and Food Selection in Adolescents: Acceptability and Usability Study

Formative Evaluation of a Smartphone App for Monitoring Daily Meal Distribution and Food Selection in Adolescents: Acceptability and Usability Study

Formative Evaluation of a Smartphone App for Monitoring Daily Meal Distribution and Food Selection in Adolescents: Acceptability and Usability Study

Original Paper

1The Innovative Use of Mobile Phones to Promote Physical Activity and Nutrition Across the Lifespan Research Group, Department of Biosciences and Nutrition, Karolinska Institutet, Huddinge, Sweden

2Lab of Computing, Medical Informatics and Biomedical Imaging Technologies, Department of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Greece

3Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece

4Internationella Engelska Gymnasiet, Stockholm, Sweden

Corresponding Author:

Billy Langlet, PhD

The Innovative Use of Mobile Phones to Promote Physical Activity and Nutrition Across the Lifespan Research Group

Department of Biosciences and Nutrition

Karolinska Institutet

Blickagången 16

Huddinge,

Sweden

Phone: 46 08 524 810 95

Email: billy.langlet@ki.se


Background: Obesity interventions face the problem of weight regain after treatment as a result of low compliance. Mobile health (mHealth) technologies could potentially increase compliance and aid both health care providers and patients.

Objective: This study aimed to evaluate the acceptability and usability and define system constraints of an mHealth system used to monitor dietary habits of adolescents in real life, as a first step in the development of a self-monitoring and lifestyle management system against adolescent obesity.

Methods: We recruited 26 students from a high school in Stockholm, Sweden. After a 30-minute information meeting and 5-minute individual instruction on how to use an mHealth system (smartphone with app and two external sensors), participants used it for 2-3 weeks to objectively collect dietary habits. The app and sensors were used by the participants, without supervision, to record as many main meals and snacks as possible in real life. Feasibility was assessed following the “mHealth evidence reporting and assessment checklist,” and usability was assessed by questionnaires. Compliance was estimated based on system use, where a registration frequency of 3 main meals (breakfast, lunch, and dinner) per day for the period of the experiment, constituted 100% compliance.

Results: Participants included in the analysis had a mean age of 16.8 years (SD 0.7 years) and BMI of 21.9 kg/m2 (SD 4.1 kg/m2). Due to deviations from study instructions, 2 participants were excluded from the analysis. During the study, 6 participants required additional information on system use. The system received a ‘Good’ grade (77.1 of 100 points) on the System Usability Scale, with most participants reporting that they were comfortable using the smartphone app. Participants expressed a willingness to use the app mostly at home, but also at school; most of their improvement suggestions concerned design choices for the app. Of all main meals, the registration frequency increased from 70% the first week to 76% the second week. Participants reported that 40% of the registered meals were home-prepared, while 34% of the reported drinks contained sugar. On average, breakfasts took place at 8:30 AM (from 5:00 AM to 2:00 PM), lunches took place at 12:15 PM (from 10:15 AM to 6:15 PM), and dinners took place at 7:30 PM (from 3:00 PM to 11:45 PM). When comparing meal occurrence during weekdays vs weekends, breakfasts and lunches were eaten 3 hours later during weekends, while dinner timing was unaffected.

Conclusions: From an infrastructural and functional perspective, system use was feasible in the current context. The smartphone app appears to have high acceptability and usability in high school students, which are the intended end-users. The system appears promising as a relatively low-effort method to provide real-life dietary habit measurements associated with overweight and obesity risk.

JMIR Mhealth Uhealth 2020;8(7):e14778

doi:10.2196/14778

Keywords



Obesity prevalence in children and adolescents between the ages of 5 and 19 increased 8-9 times between 1975 and 2016 [1]. Obesity, in turn, increases the risk of physical and mental health complications such as osteoarthritis, type 2 diabetes mellitus, and coronary heart disease [2], along with depression [3]. In addition, a lifetime of obesity increases the risk of disability and loss of income [4].

Comprehensive lifestyle interventions, targeting diet, physical activity, and lifestyle elements in tandem, are recommended by the American Heart Association, American Colleague of Cardiology, and The Obesity Society [5] as a means of accomplishing long-term weight loss and weight maintenance in adults. Indeed, studies have shown that lifestyle interventions can promote moderate weight reduction with low risk of adverse effects [6,7], even in children between the ages of 0 and 18 years, as reported in a recent Cochrane review [8]. However, most lifestyle interventions face the problems of low compliance and high drop-out rates, with interventions often reporting weight regains of almost 50% at the 1-year follow-up mark[9,10]. In primary care, while it seems possible for obesity treatment to be “relatively cost-effective” in the short term [11], long-term weight maintenance requires intensive management in the form of frequent visits and multiple contact hours [12,13]. Others have identified additional means for improving the effectiveness of interventions, including frequent and open communication among patients and health professionals, realistic behavioral goal setting, and continuous patient monitoring [14,15]. In practice though, the inherent time and monetary cost of involved health monitoring often shift the burden to the individuals, requiring them to self-monitor and self-manage their behaviors for longer periods of time [16]. However, this further increases the required effort from the side of the individual, potentially reducing compliance and increasing drop-outs.

To meet this challenge, novel mobile health (mHealth) tools can be developed to assist both patients and health professionals. Indeed, with the accessibility and use of smartphones greatly increasing [17], smartphones are a cheap, accessible option for implementing interventions. This is even more pronounced for interventions targeting children and adolescents since they are early adopters of new technology [18]. Additionally, smartphones (and other wearable electronic devices) create the opportunity for collecting information that may be difficult for users to self-report, such as exact times, locations, and types of behaviors [19], resulting in increased user compliance with smartphone-based interventions [19,20].

Current efforts for the development of large-scale, non-invasive dietary behavioral monitoring systems appropriate for use by children and adolescents in challenging real-life environments, like school, are limited [21]. However, novel methodologies are constantly being tested [22], including our own efforts for collection of large-scale Big Health Data about the dietary and physical activity habits of school children [23]. However, such large-scale deployments require conscious efforts for preliminary testing outside the lab, in the target use environment, to identify potential use constraints and optimize the deployed methodologies.

On a commercial level, smartphone apps claiming to promote weight loss have seen a huge increase recently, but their alleged effectiveness lacks support by large-scale, long-term clinical studies [24]. Meanwhile, the number of mHealth self-management programs against obesity constantly increases, but due to mHealth being in its infancy, evidence for their effectiveness is sparse [25]. Recent meta-analyses have concluded that mHealth interventions performed similarly, if not better, then traditional non-mHealth–based obesity interventions [26-28] but emphasized the heterogeneity in the quality of the existing evidence base. Realizing the lack of consensus on mHealth reports, the World Health Organization has developed a framework for what and how to report on the various components of an mHealth intervention, called the “mHealth evidence reporting and assessment checklist” (mERA), aimed at improving the quality of the existing evidence [25]. Once the risk population has been identified, interventions should identify ways to reach the population in question, performing a formative evaluation, focusing on gathering functional requirements, and developing and testing the technology in a descriptive way [29]. Evaluating the effectiveness of mHealth in the intended population requires the evaluation of at least three components: usage (objective), acceptability (subjective), and feasibility of implementation [25].

In this study, the aim was to evaluate the acceptability, usability, and constraints of a newly developed mHealth system used for monitoring eating behaviors and dietary habits of adolescents in real life, as a first step for the development of a more comprehensive self-monitoring and lifestyle management system. The evaluation of the system was conducted on two levels: subjective self-reports by users and objective compliance estimations of the study protocol (eg, frequency of registering eating events). The system’s evaluation followed the mERA checklist for a more transparent report of its feasibility and usability. At its core, the developed system employed a smartphone to collect data from a smartphone app and two additional sensors, and all data were automatically exported to a centralized data collection platform where the data were analyzed and results collected. The smartphone app allowed participants to self-report eating events throughout the day, while the two additional sensor modules enabled collection of additional objective eating behavior data. The development of these modules, a food scale, and a chewing sensor has been previously described elsewhere [30], and their use was complementary and fully integrated with the system described herein. Finally, this report presents population-level data on dietary habits associated with the development and maintenance of adolescent obesity (ie, frequency of meals consumed in restaurants, frequency of sugary beverage consumption, and analysis of meal timing across days during weeks vs weekends). The detailed analyses of these datasets provide additional evidence of the usefulness of the system, setting the basis for the development of future interventions against obesity in the targeted population.


Subjects

There were no specific inclusion or exclusion criteria, and all students from 6 classes of the collaborating school were informed of the study. The classes were selected together with the school administration based on their end-of-the-year scheduled obligations and their prior participation in a past relevant study [31]. With 26 system units (a smartphone together with a digital food scale and chewing sensor) available, a first-come-first-serve approach was used for recruitment. Participants 18 years or older provided written consent, while younger participants provided written assent together with written consent by their legal guardians. The forms to be signed were provided to the students after an informational meeting, where students could ask for clarifications regarding the protocol of the study. The researchers returned to the school on two later occasions to collect the signed forms. Ethical approval was provided by the Stockholm Regional Ethics Board (D.nr.: 2015/1824-31), and the presented practices followed the Declaration of Helsinki’s guidelines for human research. Participants who completed the study received cinema tickets as compensation for their participation. All the participating students had previously participated in a study including lunch recordings in a school cafeteria, which followed a protocol described elsewhere [31].

Experimental Design

During the study, the subjects participated in a data collection action lasting between 2 and 3 weeks that took place towards the end of the school year. During this period (varying for each student due to their individualized end-of-year obligations), the students were asked to register all their weekday and weekend meals. The basic meal registration was done using a smartphone, and participants could contribute additional eating behavior data by using either the food scale or chewing sensor.

Study Protocol

The protocol of the study was uncontrolled by design, aiming to capture the true dietary habits of the participants, diminishing the required effort on their part. All textual components of the system were in English, in agreement with the teaching language in the selected school. The study began by participants receiving information on system use and study protocol twice: first in a group meeting lasting for 30 minutes and then on an individual level for approximately 5 minutes. During the individual meeting, the students received information on system use, went through all the screens and options of the mobile app, and were handed the smartphone and complementary devices, also signaling the initiation of the data collection. The participants were requested to register all their meals as they happened (not retrospectively) during the study period using the provided smartphone app and were also asked to use the provided food scale to collect additional information for main meals (breakfast, lunch, and dinner) and the chewing sensor to collect information for main meals and snacks. Depending on the students’ school schedule and their individual school obligations for the end of the school year, the study duration ranged from 2 to 3 consecutive weeks, after individual arrangements with their supervising teachers. A researcher was available to provide technical and protocol support to the students from Monday to Friday (school days) throughout the study. After the predefined end of the data collection period per student, the participants returned the devices to the researchers and completed the system usability and user experience questionnaires.

Devices and Smartphone App

For the duration of the experiment, all participants were provided with an Android smartphone with the required smartphone app installed, as well as a food scale and chewing sensor [30]. We have previously published the methodology and development processes for the integrated sensors (for a system overview, see Figure 1). In summary, the user was presented with 3 options for registering any eating or drinking occurrence: self-register the event using only the mobile app, use the mobile app and food scale to record their plated meals through continuous registration of the food weight remaining on their plate [32], or wear the chewing sensor to record their eating or drinking event automatically through integrated photoplethysmography and acoustic analysis [28]. The provided smartphones did not have SIM cards, dictating the use of Wi-Fi networks (at school or home) to transmit the collected data. All other nonstudy-related smartphone apps and functions (ie, GPS) were turned off. Smartphones were provided to the students by the study because the high prevalence of iOS devices in Sweden [33] would prohibit the participation of otherwise motivated students, and we strived to homogenize the user experience for all the students, providing similar phone models to exclude parameters like varying device performance, custom device interfaces, and differing battery consumption rates.

Registering eating events was supported through a custom developed smartphone app available for the Android operating system. The app allowed registering either a meal or a drink separately (Figure 2) or registering a meal and adding complementary drinks. In all cases, irrespective of the means used, a timestamp was automatically generated and saved by the system. In the case of the chewing sensor, which automatically detected eating and drinking events, the system presented the user with a persistent notification asking for verification of the detection and allowing the user to fill in additional event information. For every meal, the participants were prompted to answer two additional questions: meal type (breakfast, lunch, dinner, or snack) and where the food was prepared or bought (home, retail store, or restaurant). The maximum number of registerable main meals (breakfast, lunch, and dinner, as characterized by the users) for each participant was 3 per day, with all the remaining eating occasions automatically registered as snacks. Participants could not use multiple methods to register a main meal (ie, self-registration, food scale, and chewing sensor). Once a meal had been registered with one method, it could not be registered again using a different method. However, the users were free to register less than 3 main meals per day, in cases where they skipped or forgot to register some main meals. During drink registration, the participants had the option to include additional information about the type of the consumed drink (sugary drink, coffee/tea, dairy/milk, or water). When the smartphone was connected to Wi-Fi, the registered meals were automatically uploaded online to a study server, allowing the researchers to supervise the progress of the study in real-time using a dedicated web interface. All the communications between the browser and server were encrypted. In conclusion, the system compiled an integrated matrix of meal and drinking event timestamps, irrespective of the registration method. The users were instructed to use the smartphone app and provided weighing scale throughout the day and charge them overnight. Battery concerns dictated the use of the chewing sensor only during the after-school hours (ie, between 5:00 pm and 11:00 pm) for registration of drinks and meals, with the device also being recharged overnight. The participants did not have to charge the provided scales, since a full charge lasted more than 3 weeks.

Figure 1. The system consists of a digital food scale, chewing sensor, smartphone app, and web app.
View this figure
Figure 2. Main screen of the smartphone app.
View this figure

System Usability and User Experience Questionnaires

System usability was reported using the System Usability Questionnaire (SUS) [34], and user experience was estimated based on a custom questionnaire developed in discussion with adolescents from the same school in a previous study. In the user experience questionnaire, the smartphone app, digital food scale, and chewing sensor were rated on how comfortable they were to use and if the users perceived that the device use affected their usual behavior, as well as if the technology was potentially usable ‘in school’, ‘at home’, or ‘outside’ on 10-point Likert scales, ranging from 0 for ‘Completely disagree’ to 9 for ‘Completely agree’. As part of the same questionnaire, participants also provided free-text answers on what they would improve for the system and its individual components (smartphone app, digital food scale, and chewing sensor). The questionnaire also contained a free-text question on the price of the system (smartphone app, food scale, chewing sensor, excluding server use), which was compared with the suggested pricing by the developers and manufacturers. The SUS has been validated on multiple occasions [35], while the custom behavior change and comfort questionnaire was previously used in similar studies [31].

Data Analysis

The presented figures were generated using R 3.5.1. Feasibility is presented based on the mERA guidelines, with the checklist available in Multimedia Appendix 1 [25]. Estimation of compliance was made by dividing the number of registered main meals with the maximum number of main meals each participant was expected to register, based on the functionality of the provided system and the provided study instructions (ie, 3 main meals per day: one breakfast, one lunch, and one dinner). The formula for daily participant compliance was compliance = registered main meals/3. Food type frequency and meal timing are presented on a population level, with daily meal distribution presented in 24-hour day cycles starting at 4:00 am (ie, meals reported between 00:00 am and 3:59 am were grouped with meals registered during the previous calendar day) following a previously used practice [36]. All the values presented in the text are mean (SD).


Subjects

Of the 26 adolescents that participated in the study, the datasets provided by 2 participants were excluded from the analysis due to significant deviations from the study protocol, such as device misuse (ie, prohibited use of the phone video camera in school, which is not supported by the current ethical application) and manually unlocking and using additional mobile features (eg, online mobile games). This resulted in 24 of the participants (24/26, 92%) being included in the analyzed study sample (Table 1).

Table 1. Group characteristics.
CharacteristicsTotal (n=24), mean (SD)Men (n=7), mean (SD)Women (n=17), mean (SD)
Age (years)16.8 (0.7)17.2 (0.5)16.6 (0.7)
Weight (kg)62.2 (14.4)75.7 (10.1)56.6 (12.1)
Height (cm)168.1 (10.3)181.3 (6.8)162.7 (5.3)
BMI (kg/m2)21.9 (4.1)23.3 (4.7)21.3 (3.8)

Feasibility

Analyzing the system feasibility based on the mERA checklist [25], in the current study, phones without SIM cards and with locked hosting features were provided to all participants to ensure user interaction was restricted to the research app and to better manage confidentiality issues, which was a sensitive issue due to data collection by adolescents and especially in the school environment. Conceptually however, since all participants owned a smartphone, the system could easily have been used on the participants’ own phones, but that would require that the smartphone app was developed for multiple operating systems and not only Android. The software ran well and displayed properly on Android smartphones with 1.0 GB RAM, 8.0 GB ROM, and at least a 1280x720 HD display. All students had access to Wi-Fi both at home and at school. The battery lives of the smartphone and food scale allowed recordings throughout the day, while battery limitations restricted chewing sensor recordings to 6 hours per day. No protocol adaptations were required during the study as a result of unexpected complications. In total, 6 participants required additional information from researchers on specifics of system use, and 2 food scales had to be replaced during the experiment due to equipment malfunction (excessive battery drainage). All malfunctions were identified and addressed within 1 day. The most time-sensitive and laborious period for the researcher during the study was at the initiation, when information was provided to participants while handing out smartphones and devices. The remainder of the study required limited additional effort, mostly in the form of short interactions with individual students to answer follow-up questions or when data from the web platform indicated equipment malfunction or low compliance. The companies developing the sensors suggested a single purchase cost of €200 for the system, including both sensors and the app. Meanwhile, the price suggested by participants for the system varied greatly, with a mean single purchase cost of €67 (ranging from €14 to €236) or a monthly cost of €6 (ranging from €0 to €19).

System Usability and User Experience

Participants rated the system usability between 47.5 and 97.5, with a mean value of 77.1, which corresponds to a grade B ‘Good’ rating, on the SUS. No adverse events were reported to researchers during the experiments or to school personnel after the experiment. The smartphone app and chewing sensor received the highest and lowest ratings for comfort, respectively. For perceived usability, all system components (smartphone app, food scale, and chewing sensor) scored highest at home and lowest outside home (Table 2).

Suggestions for improvements of the smartphone app fell into 4 categories: (1) 5 individuals suggested making it more responsive or faster, (2) 4 wanted a brighter color theme, (3) 3 wanted the function to retrospectively add meals, and (4) 3 requested better app interfaces, without specifying what was lacking.

Table 2. Perceived usability and acceptability of the smartphone app and devices, answered using 10-point Likert scales, ranging from 0 (completely disagree) to 9 (completely agree).
StatementsApp, mean (SD)Food scale, mean (SD)Chewing sensor, mean (SD)
I felt comfortable using the …7.3 (1.8)6.4 (2.3)3.9 (2.8)
Perceived behavioral change from using …4.0 (2.2)3.6 (2.6)3.9 (2.5)
Potential for use of ... in school6.3 (2.8)5.4 (3.2)3.5 (2.7)
Potential for use of … at home7.1 (2.3)7.1 (2.5)4.6 (3.1)
Potential for use of … outside5.4 (2.5)3.8 (2.3)3.1 (2.6)

Registering the Frequency of Main Meals

On average, participants collected data for 18.4 days (SD 1.3 days). On average, each participant registered 63.3 meals (SD 18.0 meals), of which 39.5 meals (SD 6.3 meals) were main meals (breakfast, lunch, and dinner) and 23.8 meals (SD 14.9 meals) were snacks. Of the 39.5 main meals, 12.6 meals (SD 4.0 meals) were breakfasts, 13.2 meals (SD 3.0 meals) were lunches, and 13.7 meals (SD 3.3 meals) were dinners. In 51% (775/1520) of the overall reported meals, participants used a sensor to provide additional data. Of these meals, 87% (674/775) were made using the food scale, and the remaining meals (101/775) were registered with the chewing sensor. The average estimated compliance per participant was 73% (2.2/3 main meals per day) across all study days. To measure changes in compliance over time, only data from the first 2 weeks of system use were compared, during which the mean number of registered meals per participant was 50.2 (SD 13.9 main meals). On the group level, the number of registered meals from the first week was 573, of which 355 were main meals and 218 were snacks. Meanwhile, during the second week, 632 meals were registered, of which 384 were main meals and 248 were snacks. This shows an increased registering frequency from 70% (355/504) to 76% (384/504) of the 3 expected main meals per day from week one to week two. There were large variations between individuals in the type of main meals that were registered in the study (Figure 3).

Figure 3. Frequency of meal registration per participant throughout the study, ranging from 0% to 100% per day for each main meal type.
View this figure

Population Food Selection Frequency

Regarding food preparation, 40% (608/1520) of the registered meals were ranked as home-cooked, 46% (699/1520) as purchased in food stores, and 14% (213/1520) as consumed in restaurants. Regarding drink types, 34% (314/924) of the registered drinks were sugary drinks, 15% (139/924) were dairy-based, 34% (314/924) were water, and 17% (157/924) were tea or coffee.

Population Mealtime Distribution

On average, breakfast took place at around 8:30 am, ranging from 5:00 am to 2:00 pm. On average, lunch took place around 12:15 pm, ranging from 10:15 am to 6:15 pm. Meanwhile, on average, dinners took place around 7:30 pm, ranging from 3:00 pm to 11:45 pm (Figure 4).

Figure 4. Histogram depicting the meal distribution of breakfast, lunch, dinner, and snacks across the day for all registered meals. Registration was done by 24 participants for a period of 2-3 weeks.
View this figure

Distribution of Meals Across Weekdays and Weekends

The majority of breakfasts were eaten earlier during weekdays compared to weekends, with a difference of 2 hours 49 minutes between the mean value for weekday and weekend breakfasts. Similarly, lunches were generally eaten earlier during weekdays than during weekends, with a difference of 2 hours 44 minutes. Dinners were eaten slightly earlier during weekdays than during weekends, with a difference of 17 minutes. There was a slight difference between the time (14 minutes) of reported snacks between weekends and weekdays, with snacking overall being spread out throughout the monitored days (Figure 5).

Figure 5. Histogram showing the distribution of all registered meals. Vertical lines in the graphs show the mean values of weekday (solid line) and weekend (dashed line) meal occasions.
View this figure

This study evaluated the perceived acceptability and usability by adolescent participants of a system composed of a smartphone app and two eating behavior sensors, while identifying system constraints for future large-scale deployments. The app was well received by the participants, while the sensors received lower scores of usability and acceptability. From a functional and infrastructural perspective, the system had easy-to-meet requirements, was easy to use, and had high scalability. The usefulness of the system also appeared high, with its ability to collect data on dietary behaviors associated with increased risk of obesity (ie, sugary beverage consumption, restaurant meals, and unstructured meal patterns). From a functional perspective, the technical requirements of the smartphone app were low, including battery consumption, ensuring that the presented app runs on most modern smartphones, with 99% of Swedish 16–25-year-olds using smartphones regularly and a little less than 95% of devices in Sweden fulfilling the 1 GB RAM and 8 GB ROM requirement [33]. In addition, in Sweden, smartphone coverage and accessibility to Wi-Fi and energy outlets are high, making a screening protocol, such as the one explored here, highly feasible from an infrastructural perspective [17], ensuring the scalability of the system. Concerning the system’s suggested cost, a discrepancy existed between the system creators and the end users, which is expected due to the targeted age group. For the researcher, little work was required to ensure proper use of the smartphone app and devices, with only one-fourth of participants requiring additional information on specific functions of the system despite the short duration of the initial information meetings. The dedicated research platform enabled real-time data inspection, which made the identification of malfunctioning devices easy and ensured high data retention throughout the study. Participants found the system easy to use, with the total system receiving a high system usability score. Some participants felt that the smartphone app was a bit slow and unresponsive at times, which could potentially have resulted in lower compliance, but this is not immediately evident in the output dataset. A recent study identified personalization options as a strategy to increase interaction and compliance [37], a potential answer to our user requests (7/24) for improved interfaces. Finally, the possibility of retrospectively registering meals is a feature often seen in comparable apps. Future versions of our system might integrate this functionality to reduce the risk of the user forgetting to report meals as they occur, an issue that might have affected the reported outcomes of this study. However, the addition of retrospective meal reporting has the potential to introduce additional recall bias, resulting in decreased accuracy for the collected measurements [38].

The high frequency of meal registration per individual makes us confident that the mealtime distribution results are representative of the population’s actual mealtime distribution. In addition, the increased number of reported meals from week one to week two suggests that a familiarization period, or more training in device use, might increase registering frequency. In a study with a similar sample population (ie, conducted in adolescents in Sweden) that employed a 7-day food record, the number of registered meals was 18% higher than in the current study [39], which might be related to the lack of functionality for retrospective meal reporting in our own system. However, due to the allowance of recall data and differences in main meal definitions (primarily breakfast) and methodology (recollection vs real-time registering) as well as a potentially higher socioeconomic status in the current sample, it is unlikely that these two studies are directly comparable. Future studies should therefore aim to compare the methods employed here with 24-hour/day automatic meal registration methods, such as the ones developed by Sazonov et al [40], Sun et al [41], and Kyritsis et al [42], which have the potential to remove recall and social desirability bias (eg, where individuals only register products that are viewed favorably by others) but may introduce other biases, such as comfort of use. This will be even more relevant once the chewing sensor allows recording for the entire day.

With regards to the sample’s frequency of food selection, we found that the number of home-cooked meals was low, with most meals being either store-bought or restaurant-bought, similar to previous reports [43]. Similarly, a large number (one-third) of the reported drinks contained sugar, with the actual portion potentially being even higher since other drink categories might also have contained added sugar (eg, milk/diary). These dietary habits have been associated with increased body weight [44,45]. Meanwhile, the meal timing across days suggests that Swedish adolescents eat their breakfasts and lunches later during weekends than during weekdays. This time shift is partly corroborated by a previous study in young adults, where the first caloric intake occurred later during weekends, while the last energy intake occurred at similar times during weekdays and weekends [36], potentially due to the de facto effect of the school schedule. Overall, due in part to methodological limitations and differences in definitions, there is currently no consensus regarding the effect of meal timing on health [46], with some studies reporting skipping breakfast may increase the risk of obesity and type 2 diabetes [47,48], while others reporting no such effects [49].

The main strengths of the study were a smartphone app designed to allow easy and accurate real-time meal registration, not relying on recall, and a protocol with no restrictions to participants’ real-life activities. Another strength, based on the results, was the high usage rate of the system. A strength of the system is its modular design, which enables the additional sensors, ensuring high contextual adaptability. In this study, a digital food scale and chewing sensor were used, but when investigating other diseases, such as diabetes, more appropriate sensors could be added, such as a blood glucose monitor.

One limitation of the study was the low number of available study devices, while a limitation for the generalizability of the results was the low number of male participants, which deviates from the Swedish average [50] but is more in line with the sex distribution of the school in question. Another potential limitation was the de facto assumption of 3 main meals per day for compliance estimation, since meal-skipping studies suggest that not everyone eats breakfast, lunch, and dinner [51]. However, the definition of meal skipping in previous studies varies greatly, causing a large range in the frequency of meal skipping (5% to 83%), which provides no reliable baseline for compliance estimation [51]. A potential alternative for measuring compliance would be to ask the user for meal occurrences in the past 30 minutes at random times during the day and then compare these results with spontaneously self-reported meals [36]. This method was avoided due to concerns that additional interaction with the smartphone app may result in reduced compliance. Another protocol limitation was that our study provided additional study smartphones for the app, but this practice was deemed necessary to include iOS users and homogenize the data collection experience. In addition, our reporting system lacked a dedicated category for reporting “noncaloric soft drinks,” which may have resulted in individuals either not reporting those items or reporting it in another category. It should also be noted that the minimalistic reporting approach in our study might introduce additional reporting bias in certain categories. For example, users were able to report milk/dairy-based drinks either in the dedicated category or as “sugary drinks” if they contained sugar. In future iterations of our system, additional user-reporting options can be introduced to resolve this issue (eg, adding the user-selected option to report “added sugar” or “no added sugar” within the milk/diary reports). Finally, one should not ignore the potential observer effect [52], something uniformly affecting the domain of behavioral monitoring, resulting in modification of the observed behaviors due to study participation.

Future studies should aim to repeat the feasibility study by enrolling larger samples and longer data collection periods in order to test the progress of registration compliance over longer periods. In a parallel study in the Netherlands, the chewing sensor received an average wearer comfort score of 3.7 by overweight adults, which is comparable to the score received in the current study [30]. Future studies may benefit from comparing differences in system perception and user compliance between obese and normal-weight individuals. Additionally, based on existing evidence showing that mHealth is more often used by individuals of higher socioeconomic status, additional studies should also aim to include individuals of lower socioeconomic characteristics [53]. Such deployments have a de facto interest for group-based behavioral comparisons but will also evaluate the scalability potential of the system. For validation purposes, the system should be compared to recall methods (eg, 7-day food record and meal habit questionnaires) as well as other automatic recording methods (eg, eButton and Automatic Ingestion Monitor) [41,54]. In practice, the presented methodologies have been the stepping stone for the extension of the data collection and analysis framework in a follow-up research effort [23]. Specifically, our renewed efforts focus on the collection of lifestyle Big Data from children and adolescents, in an effort to create population-level behavioral profiles (eg, meal frequency, food choice frequency), which will then be used by local and national public health authorities as a helpful tool in their efforts to tackle childhood obesity.

In conclusion, no system constraints related to infrastructure and function were identified for deploying the described smartphone-based system in adolescents of medium to high socioeconomic status in Sweden. Also, the identified population profiles regarding the differences in the timing of meals on weekdays vs weekends and the reported frequency of sugary drinks by adolescents provide valuable preliminary information about the dietary habits of the target population. Additionally, these data point towards the usefulness of comparable mHealth systems in providing health-related behavioral information for such populations. Regarding the system use, high school students are well-versed in the use of smartphones, resulting in high acceptability and usability of the smartphone app, with most suggested improvements being related to design rather than functionality. In line with this, the number of participants that required additional information on device use was low. The high registration frequency of main meals indicates the high usability of the system, which, if coupled with appropriate sensors, can facilitate the collection of reliable food intake data. Overall, the system appears promising as a low-effort method to provide accurate measurements of dietary habits, setting the base for future developments of individual-level and group-level mHealth interventions against adolescent obesity.

Acknowledgments

The work leading to these results received funding from the European Community's ICT Programmes: SPLENDID under Grant Agreement No. 610746 and BigO under Grant Agreement No. 610746. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; and in the decision to publish the results.

Authors' Contributions

Development of the study concept was handled by BL, AD, and II. Project administration was handled by RH, IL, and II, and supervision was handled by RH and II. Methodology and data curation were handled by BL and II. Investigation was performed by BL, PF, and II, and the formal analysis was performed by BL. Visualization of data and writing of the original draft was handled by BL, PF, and II; meanwhile, all authors reviewed and edited the final manuscript. Funding was acquired by AD, NM, and II, and resources were provided by AD, IL, CD, CM, NM, RH, and II.

Conflicts of Interest

During data collection, BL and II received part of their salaries from Mandometer AB (Stockholm, Sweden), owner of the IPR for the Mandometer®. This does not alter the authors’ adherence to journal policies.

Multimedia Appendix 1

mHealth evidence reporting and assessment (mERA) checklist.

PDF File (Adobe PDF File), 115 KB

  1. NCD Risk Factor Collaboration (NCD-RisC). Worldwide trends in body-mass index, underweight, overweight, and obesity from 1975 to 2016: a pooled analysis of 2416 population-based measurement studies in 128·9 million children, adolescents, and adults. Lancet 2017 Dec 16;390(10113):2627-2642 [FREE Full text] [CrossRef] [Medline]
  2. Kumar S, Kelly AS. Review of Childhood Obesity: From Epidemiology, Etiology, and Comorbidities to Clinical Assessment and Treatment. Mayo Clin Proc 2017 Feb;92(2):251-265. [CrossRef] [Medline]
  3. Brewis AA, Bruening M. Weight Shame, Social Connection, and Depressive Symptoms in Late Adolescence. Int J Environ Res Public Health 2018 May 01;15(5) [FREE Full text] [CrossRef] [Medline]
  4. Neovius K, Rehnberg C, Rasmussen F, Neovius M. Lifetime Productivity Losses Associated with Obesity Status in Early Adulthood. Applied Health Economics and Health Policy 2012 Sep 01;10(5):309-317. [CrossRef] [Medline]
  5. Jensen MD, Ryan DH, Apovian CM, Ard JD, Comuzzie AG, Donato KA, American College of Cardiology/American Heart Association Task Force on Practice Guidelines, Obesity Society. 2013 AHA/ACC/TOS guideline for the management of overweight and obesity in adults: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines and The Obesity Society. Circulation 2014 Jun 24;129(25 Suppl 2):S102-S138 [FREE Full text] [CrossRef] [Medline]
  6. Leblanc ES, O'Connor E, Whitlock EP, Patnode CD, Kapka T. Effectiveness of primary care-relevant treatments for obesity in adults: a systematic evidence review for the U.S. Preventive Services Task Force. Ann Intern Med 2011 Oct 04;155(7):434-447. [CrossRef] [Medline]
  7. Beaulac J, Sandre D. Critical review of bariatric surgery, medically supervised diets, and behavioural interventions for weight management in adults. Perspect Public Health 2017 May;137(3):162-172. [CrossRef] [Medline]
  8. Waters E, de Silva-Sanigorski A, Hall BJ, Brown T, Campbell KJ, Gao Y, et al. Interventions for preventing obesity in children. Cochrane Database Syst Rev 2011 Dec 07(12):CD001871. [CrossRef] [Medline]
  9. Fappa E, Yannakoulia M, Pitsavos C, Skoumas I, Valourdou S, Stefanadis C. Lifestyle intervention in the management of metabolic syndrome: could we improve adherence issues? Nutrition 2008 Mar;24(3):286-291. [CrossRef] [Medline]
  10. Jeffery RW, Drewnowski A, Epstein LH, Stunkard AJ, Wilson GT, Wing RR, et al. Long-term maintenance of weight loss: current status. Health Psychol 2000 Jan;19(1S):5-16. [CrossRef] [Medline]
  11. Olsen J, Willaing I, Ladelund S, Jørgensen T, Gundgaard J, Sørensen J. Cost-effectiveness of nutritional counseling for obese patients and patients at risk of ischemic heart disease. Int J Technol Assess Health Care 2005;21(2):194-202. [Medline]
  12. Walker O, Strong M, Atchinson R, Saunders J, Abbott J. A qualitative study of primary care clinicians' views of treating childhood obesity. BMC Fam Pract 2007 Sep 03;8:50 [FREE Full text] [CrossRef] [Medline]
  13. O'Connor EA, Evans CV, Burda BU, Walsh ES, Eder M, Lozano P. Screening for Obesity and Intervention for Weight Management in Children and Adolescents: Evidence Report and Systematic Review for the US Preventive Services Task Force. JAMA 2017 Jun 20;317(23):2427-2444. [CrossRef] [Medline]
  14. Fruh SM. Obesity: Risk factors, complications, and strategies for sustainable long-term weight management. J Am Assoc Nurse Pract 2017 Oct;29(S1):S3-S14 [FREE Full text] [CrossRef] [Medline]
  15. Bray G, Look M, Ryan D. Treatment of the obese patient in primary care: targeting and meeting goals and expectations. Postgrad Med 2013 Sep;125(5):67-77. [CrossRef] [Medline]
  16. Chen J, Guedes CM, Cooper BA, Lung AE. Short-Term Efficacy of an Innovative Mobile Phone Technology-Based Intervention for Weight Management for Overweight and Obese Adolescents: Pilot Study. Interact J Med Res 2017 Aug 02;6(2):e12 [FREE Full text] [CrossRef] [Medline]
  17. Kay M, Santos J, Takane M. mHealth: new horizons for health through mobile technologies. Switzerland: World Health Organization; 2011:66.
  18. Lauricella AR, Cingel DP, Blackwell C, Wartella E, Conway A. The Mobile Generation: Youth and Adolescent Ownership and Use of New Media. Communication Research Reports 2014 Oct 21;31(4):357-364. [CrossRef]
  19. Lee J, Piao M, Byun A, Kim J. A Systematic Review and Meta-Analysis of Intervention for Pediatric Obesity Using Mobile Technology. Stud Health Technol Inform 2016;225:491-494. [Medline]
  20. Chaplais E, Naughton G, Thivel D, Courteix D, Greene D. Smartphone Interventions for Weight Treatment and Behavioral Change in Pediatric Obesity: A Systematic Review. Telemed J E Health 2015 Oct;21(10):822-830. [CrossRef] [Medline]
  21. Vogel C, Zwolinsky S, Griffiths C, Hobbs M, Henderson E, Wilkins E. A Delphi study to build consensus on the definition and use of big data in obesity research. Int J Obes (Lond) 2019 Dec 17;43(12):2573-2586 [FREE Full text] [CrossRef] [Medline]
  22. Everson B, Mackintosh KA, McNarry MA, Todd C, Stratton G. Can Wearable Cameras be Used to Validate School-Aged Children's Lifestyle Behaviours? Children (Basel) 2019 Mar 01;6(2) [FREE Full text] [CrossRef] [Medline]
  23. Diou C, Ioakeimidis I, Charmandari E, Kassari P, Lekka I, Mars M, et al. BigO: Big Data Against Childhood Obesity. : European Society for Paediatric Endocrinology; 2018 Sep 27 Presented at: 57th Annual European Society of Pediatric Endocrinology; 27-29 September 2018; Athens, Greece   URL: https://abstracts.eurospe.org/hrp/0089/hrp0089p3-p127
  24. Istepanian R, Woodward B. M-health: fundamentals and applications, First edition. Hoboken: Wiley-IEEE Press; Oct 21, 2016.
  25. Agarwal S, LeFevre AE, Lee J, L'Engle K, Mehl G, Sinha C, WHO mHealth Technical Evidence Review Group. Guidelines for reporting of health interventions using mobile phones: mobile health (mHealth) evidence reporting and assessment (mERA) checklist. BMJ 2016 Mar 17;352:i1174. [CrossRef] [Medline]
  26. Bhardwaj NN, Wodajo B, Gochipathala K, Paul DP, Coustasse A. Can mHealth Revolutionize the Way We Manage Adult Obesity? Perspect Health Inf Manag 2017;14(Spring):1a [FREE Full text] [Medline]
  27. Chen J, Wilkosz ME. Efficacy of technology-based interventions for obesity prevention in adolescents: a systematic review. Adolesc Health Med Ther 2014;5:159-170 [FREE Full text] [CrossRef] [Medline]
  28. Flores Mateo G, Granado-Font E, Ferré-Grau C, Montaña-Carreras X. Mobile Phone Apps to Promote Weight Loss and Increase Physical Activity: A Systematic Review and Meta-Analysis. J Med Internet Res 2015 Nov 10;17(11):e253 [FREE Full text] [CrossRef] [Medline]
  29. Higgins DL, O'Reilly K, Tashima N, Crain C, Beeker C, Goldbaum G, et al. Using formative research to lay the foundation for community level HIV prevention efforts: an example from the AIDS Community Demonstration Projects. Public Health Rep 1996;111 Suppl 1:28-35 [FREE Full text] [Medline]
  30. van den Boer J, van der Lee A, Zhou L, Papapanagiotou V, Diou C, Delopoulos A, et al. The SPLENDID Eating Detection Sensor: Development and Feasibility Study. JMIR Mhealth Uhealth 2018 Sep 04;6(9):e170 [FREE Full text] [CrossRef] [Medline]
  31. Langlet B, Anvret A, Maramis C, Moulos I, Papapanagiotou V, Diou C, et al. Objective measures of eating behaviour in a Swedish high school. Behaviour & Information Technology 2017 May 06;36(10):1005-1013 [FREE Full text] [CrossRef]
  32. Esfandiari M, Papapanagiotou V, Diou C, Zandian M, Nolstam J, Södersten P, et al. Control of Eating Behavior Using a Novel Feedback System. J Vis Exp 2018 May 08(135) [FREE Full text] [CrossRef] [Medline]
  33. Davidsson P, Palm M, Melin Å. Svenskarna och internet 2018. Stockholm, Sweden: Internet Foundation in Sweden; 2018.
  34. Jordan P, Thomas B, McClelland I, Weerdmeester B. Usability evaluation in industry. Boca Raton: CRC Press; Jun 11, 1996.
  35. Bangor A, Kortum PT, Miller JT. An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction 2008 Jul 30;24(6):574-594. [CrossRef]
  36. Gill S, Panda S. A Smartphone App Reveals Erratic Diurnal Eating Patterns in Humans that Can Be Modulated for Health Benefits. Cell Metab 2015 Nov 03;22(5):789-798 [FREE Full text] [CrossRef] [Medline]
  37. Partridge SR, Redfern J. Strategies to Engage Adolescents in Digital Health Interventions for Obesity Prevention and Management. Healthcare (Basel) 2018 Jun 21;6(3) [FREE Full text] [CrossRef] [Medline]
  38. Dhurandhar NV, Schoeller D, Brown AW, Heymsfield SB, Thomas D, Sørensen TIA, Energy Balance Measurement Working Group. Energy balance measurement: when something is not better than nothing. Int J Obes (Lond) 2015 Jul 13;39(7):1109-1113 [FREE Full text] [CrossRef] [Medline]
  39. Sjöberg A, Hallberg L, Höglund D, Hulthén L. Meal pattern, food choice, nutrient intake and lifestyle factors in The Göteborg Adolescence Study. Eur J Clin Nutr 2003 Dec;57(12):1569-1578. [CrossRef] [Medline]
  40. Sazonov ES, Schuckers SAC, Lopez-Meyer P, Makeyev O, Melanson EL, Neuman MR, et al. Toward objective monitoring of ingestive behavior in free-living population. Obesity (Silver Spring) 2009 Oct;17(10):1971-1975 [FREE Full text] [CrossRef] [Medline]
  41. Sun M, Burke LE, Mao Z, Chen Y, Chen H, Bai Y, et al. eButton: A Wearable Computer for Health Monitoring and Personal Assistance. Proc Des Autom Conf 2014;2014:1-6 [FREE Full text] [CrossRef] [Medline]
  42. Kyritsis K, Tatli CL, Diou C, Delopoulos A. Automated analysis of in meal eating behavior using a commercial wristband IMU sensor. Conf Proc IEEE Eng Med Biol Soc 2017 Jul;2017:2843-2846. [CrossRef] [Medline]
  43. Nago ES, Lachat CK, Dossa RAM, Kolsteren PW. Association of out-of-home eating with anthropometric changes: a systematic review of prospective studies. Crit Rev Food Sci Nutr 2014;54(9):1103-1116. [CrossRef] [Medline]
  44. Popkin BM. Sugary beverages represent a threat to global health. Trends Endocrinol Metab 2012 Dec;23(12):591-593. [CrossRef] [Medline]
  45. Rolls BJ. The Supersizing of America: Portion Size and the Obesity Epidemic. Nutr Today 2003;38(2):42-53. [CrossRef] [Medline]
  46. Leech RM, Worsley A, Timperio A, McNaughton SA. Understanding meal patterns: definitions, methodology and impact on nutrient intake and diet quality. Nutr Res Rev 2015 Jun;28(1):1-21 [FREE Full text] [CrossRef] [Medline]
  47. Bi H, Gan Y, Yang C, Chen Y, Tong X, Lu Z. Breakfast skipping and the risk of type 2 diabetes: a meta-analysis of observational studies. Public Health Nutr 2015 Nov;18(16):3013-3019. [CrossRef] [Medline]
  48. St-Onge M, Ard J, Baskin ML, Chiuve SE, Johnson HM, Kris-Etherton P, American Heart Association Obesity Committee of the Council on Lifestyle Cardiometabolic Health, Council on Cardiovascular Disease in the Young, Council on Clinical Cardiology;, Stroke Council. Meal Timing and Frequency: Implications for Cardiovascular Disease Prevention: A Scientific Statement From the American Heart Association. Circulation 2017 Mar 28;135(9):e96-e121. [CrossRef] [Medline]
  49. Sievert K, Hussain SM, Page MJ, Wang Y, Hughes HJ, Malek M, et al. Effect of breakfast on weight and energy intake: systematic review and meta-analysis of randomised controlled trials. BMJ 2019 Jan 30;364:l42 [FREE Full text] [CrossRef] [Medline]
  50. Women and men in Sweden 2018 Facts and figures. Örebro, Sweden: Statistics Sweden; 2018.
  51. Pendergast FJ, Livingstone KM, Worsley A, McNaughton SA. Correlates of meal skipping in young adults: a systematic review. Int J Behav Nutr Phys Act 2016 Dec 01;13(1):125 [FREE Full text] [CrossRef] [Medline]
  52. Zhong C, House J. Hawthorne revisited: Organizational implications of the physical work environment. Research in Organizational Behavior 2012 Jan;32:3-22. [CrossRef]
  53. Carroll JK, Moorhead A, Bond R, LeBlanc WG, Petrella RJ, Fiscella K. Who Uses Mobile Phone Health Apps and Does Use Matter? A Secondary Data Analytics Approach. J Med Internet Res 2017 Apr 19;19(4):e125 [FREE Full text] [CrossRef] [Medline]
  54. Fontana JM, Farooq M, Sazonov E. Automatic ingestion monitor: a novel wearable device for monitoring of ingestive behavior. IEEE Trans Biomed Eng 2014 Jun;61(6):1772-1779 [FREE Full text] [CrossRef] [Medline]


mERA: mHealth evidence reporting and assessment checklist.
mHealth: mobile health.
SUS: System Usability Questionnaire.


Edited by G Eysenbach; submitted 22.05.19; peer-reviewed by J van den Boer, W Jia, J Coleman; comments to author 23.07.19; revised version received 14.09.19; accepted 14.05.20; published 21.07.20

Copyright

©Billy Langlet, Christos Maramis, Christos Diou, Nikolaos Maglaveras, Petter Fagerberg, Rachel Heimeier, Irini Lekka, Anastasios Delopoulos, Ioannis Ioakimidis. Originally published in JMIR mHealth and uHealth (http://mhealth.jmir.org), 21.07.2020.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.