Published on 22.12.17 in Vol 5, No 12 (2017): December
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/8791, first published Aug 20, 2017.
Insights From Google Play Store User Reviews for the Development of Weight Loss Apps: Mixed-Method Analysis
Background: Significant weight loss takes several months to achieve, and behavioral support can enhance weight loss success. Weight loss apps could provide ongoing support and deliver innovative interventions, but to do so, developers must ensure user satisfaction.
Objective: The aim of this study was to conduct a review of Google Play Store apps to explore what users like and dislike about weight loss and weight-tracking apps and to examine qualitative feedback through analysis of user reviews.
Methods: The Google Play Store was searched and screened for weight loss apps using the search terms weight loss and weight track*, resulting in 179 mobile apps. A content analysis was conducted based on the Oxford Food and Activity Behaviors taxonomy. Correlational analyses were used to assess the association between complexity of mobile health (mHealth) apps and popularity indicators. The sample was then screened for popular apps that primarily focus on weight-tracking. For the resulting subset of 15 weight-tracking apps, 569 user reviews were sampled from the Google Play Store. Framework and thematic analysis of user reviews was conducted to assess which features users valued and how design influenced users’ responses.
Results: The complexity (number of components) of weight loss apps was significantly positively correlated with the rating (r=.25; P=.001), number of reviews (r=.28; P<.001), and number of downloads (r=.48; P<.001) of the app. In contrast, in the qualitative analysis of weight-tracking apps, users expressed preference for simplicity and ease of use. In addition, we found that positive reinforcement through detailed feedback fostered users’ motivation for further weight loss. Smooth functioning and reliable data storage emerged as critical prerequisites for long-term app usage.
Conclusions: Users of weight-tracking apps valued simplicity, whereas users of comprehensive weight loss apps appreciated availability of more features, indicating that complexity demands are specific to different target populations. The provision of feedback on progress can motivate users to continue their weight loss attempts. Users value seamless functioning and reliable data storage.
JMIR Mhealth Uhealth 2017;5(12):e203
Mobile apps addressing health and fitness issues have emerged in large numbers over the last couple of years. In 2016, 231,000 mobile health (mHealth) apps were available on the Android and Apple app stores, of which nearly 100,000 had been added since 2015 . The total number of worldwide downloads was estimated at 3.2 billion by the end of 2016 [ ]. It is predicted that by 2020, over 2.5 billion people will have downloaded at least one health and fitness app onto their phone [ ]. Many of these mHealth apps claim to provide weight loss support.
Given the wide reach of mHealth apps, researchers have started to explore their quality. In several app reviews, researchers have criticized the limited extent to which mHealth app features are grounded in evidence [- ]. For instance, Pagoto and colleagues compiled 20 behavior change strategies from effective weight loss treatments and assessed how many of them were implemented by weight loss apps. They found that fewer than 20% of the strategies were used on average [ ]. It is argued that the paucity of established behavioral techniques incorporated in the apps may limit their effectiveness in supporting users to change their behavior [ ].
However, even the most evidence-based app is unlikely to be successful if it does not attract and retain users, as repeated and long-term interaction with an intervention is often critical for its effectiveness [- ]. This is especially the case for self-monitoring interventions, where frequent self-monitoring is associated with greater weight loss [ - ]. Moreover, research shows that the popularity of an app is not necessarily associated with the extent of its evidence base [ ]. Bardus and colleagues found that the popular mHealth apps on the app market were the ones that had good functionality and an appealing appearance, even though they were only of moderate quality content-wise [ ]. Hence, for a health app to be engaging and effective, attention has to be paid to its presentation and design, not just its content. User retention is particularly challenging as the app store is a constantly changing market [ ], meaning that users can easily switch apps. In fact, three-quarters of all downloaded health apps are used less than eleven times [ ].
This paper explores which aspects of mHealth apps affect user satisfaction to provide guidance on how to keep users engaged. User reviews on app stores offer an opportunity to gain such insights from a large pool of people. Reviews often contain complaints, suggestions of change, and innovative ideas [, ] and can therefore help identify the key aspects that affect user satisfaction. To the best of our knowledge, no academic analysis of user reviews on weight loss apps has yet been conducted. We aim to assess satisfaction with common features, explore user suggestions, and generate guidance for further weight loss app development. We focus on weight-tracking apps specifically, as the effectiveness of their main functionality, that is, self-monitoring, is dependent on the appeal and engagingness of the intervention [ - ]. Analyzing user reviews to improve likability and usability can therefore especially help improve the effectiveness of the respective apps. Moreover, self-monitoring is particularly likely to benefit from the technological advantages of smartphones, as they allow for instantaneous feedback, are easy and quick to use, are mobile and hence accessible most of the day, and their usage in social contexts is more acceptable than the usage of their nondigital alternatives [ - ]. Self-monitoring apps therefore provide an interesting example to study and advance developers’ capabilities in making use of the unique technological possibilities that mHealth apps provide to create appealing interventions.
In a first step, weight loss apps were sampled from the Google Play Store. The components of these apps were coded to attain an overview of the most common weight loss app features. In a second step, the sample was screened for weight-tracking apps, which underwent a second and more detailed component coding. Finally, reviews were sampled from the weight-tracking apps and qualitatively analyzed according to users’ liking and disliking of components.
Sampling Strategy—Weight Loss Apps
In March 2017, an electronic search on the Google Play Store was conducted using two search terms: weight loss and weight track*. The search was performed using an incognito browser in Google Chrome that was not connected to a Google account. Each search resulted in the display of 249 mobile apps. Due to the conceptual closeness of the search terms, the results partly overlapped.
For each results list, we sampled apps until no conceptually new apps were found. If saturation was not reached after the first 100 apps in the search results, more apps were considered from the list in batches of ten. This method resulted in the screening of 120 apps for the term weight loss and 110 apps for the term weight track*.
Where the same app was available in both a free and a paid version, we treated them as two separate apps. Properties of the mobile apps, such as app and developer name, app category, rating, number of reviews, number of downloads, version of the app, cost of the app, availability of in-app purchases, as well as the search term used and the position in each search results list were noted. The sampling process was conducted over 2 days, 1 day per search term.
First Screening and Component Coding—Weight Loss Apps
Each mobile app was screened for the following three criteria: (1) whether it was targeted at people who want to lose or monitor their weight; (2) whether it had stand-alone functionality, meaning that it is usable without a membership subscription or ownership of specific devices; and (3) whether it was available in the English language. This screening resulted in the exclusion of 25 apps. Two more mobile apps were initially recorded but could no longer be found on the Google Play Store at the time of the screening process.
Details concerning the remaining 179 apps can be found in. The mobile apps were manually coded by components using information available from the app description pages on the Google Play Store. We used an adapted version of the Oxford Food and Activity Behaviors (OxFAB) taxonomy ( ) that consists of 23 domains and can be used to classify self-help interventions for weight loss [ , ].
|Goal setting||Setting of a specific target, either behavioral or outcome-related; for example, weight loss goal||Goal setting|
|Feedback on goal progress||Feedback on the progress towards this target, quantifiable; for example, amount of weight left to lose to reach target||Non-existent|
|Impulse management||Components specifically designed to help users cope with impulses to eat or binge; for example, distraction||Impulse management: Acceptance|
|Impulse management: Awareness of motives|
|Impulse management: Distraction|
|Motivation||Components increasing motivation of users; for example, motivational quotes||Motivation|
|Planning content and scheduling of diet and activity||Components that provide support in planning and scheduling weight loss-related activities; for example, diet plans, physical activity challenges||Planning content|
|Scheduling of diet and activity|
|Physical activity||Advice on behavioral strategies related to physical activity that can help with weight loss; for example, raising knees higher during walking||Regulation: Allowances|
|Regulation: Rule setting|
|Dieting||Advice on behavioral strategies related to diet that can help with weight loss; for example, restricting portion sizes||Restraint|
|Physical activity||Information on the benefit of a specific physical activity; for example, which muscle groups are trained with an exercise||Non-existent|
|Dieting||Information on the nutritional value of foods; for example, amount of calories in a banana||Non-existent|
|Physical activity workout||Instructions for physical activity; for example, a workout||Non-existent|
|Menus||Instructions related to food; for example, recipes, shopping lists||Non-existent|
|Calorie calculator||Component that calculates the daily energy expenditure or maximum amount of daily calories allowed||Non-existent|
|Reframing||App reframes weight loss as, for example, a change in lifestyle||Reframing|
|Reward||Reward for reaching a specific outcome, usually a gamification element; for example, winning badges, unlocking new components||Reward|
|Weight tracking||Component that logs weight measurements over time||Self-monitoring|
|Body fat tracking||Component that logs body fat measurements over time||Self-monitoring|
|Body measurements tracking||Component that logs body measurements over time||Self-monitoring|
|Physical activity tracking||Component that logs physical activity over time||Self-monitoring|
|Diet tracking||Component that logs diet over time||Self-monitoring|
|Body fat calculator||Component that calculates body fat percentage||Self-monitoring|
|BMI calculator||Component that calculates BMI||Self-monitoring|
|Reminder setting||Component that allows to set a reminder; for example, reminds to enter weight measurement||Non-existent|
|Buddying||Social community component which allows users to link up with each other to pursue goals together; for example, compete with each other in a weight loss challenge||Support: Buddying|
|Motivational||Social media linkage which allows users to share their progress with their friends and family||Support: Motivational|
|Professional||Offers provision of direct support from a health professional; for example, possibility to chat to a dietician||Support: Professional|
|Weight management aids||Components that offer other weight management aids; for example, hypnosis, advice on weight loss body wraps||Weight management aids|
|Self-experimentation||App encourages users to try out different weight loss strategies; for example, experiment with different diets||Self-experimentation|
aOxFAB domains “Imitation (modeling)“ and “Information seeking” were deleted from the adapted version.
In many cases, the mobile apps offered in-app purchases that enabled access to premium features. For this component coding, all premium features that were mentioned on the app description pages were considered.
The component coding was performed by two coders for 10.1% (18/179) of the mobile apps. Prevalence-adjusted and bias-adjusted kappa (PABAK) scores assessing the agreement between the coders showed fair to good results (mean PABAK=0.91). Disagreements between the coders were mostly based on differences in the conceptual understanding of the domain definitions. The definitions were subsequently clarified, which resulted in a slightly higher PABAK score (0.94). One coder performed the rest of the component coding.
Second Screening and Component Coding—Weight-Tracking Apps
For the review analysis, the weight loss app sample was screened for weight-tracking apps. To be eligible, these apps (1) had to be primarily focused on weight-tracking (ie, have no other main function such as a detailed diet tracker or exercise instructor but could have additional minor features such as a body mass index [BMI] calculator and counter of glasses of water consumed), (2) had to have a user rating above 3 stars, and (3) had to have at least 1000 reviews. Of the 179 mobile apps that were coded by component, 15 met these criteria. We conducted another, more fine-grained coding of the components for the weight-tracking apps. Each app was downloaded from the Google Play Store to an HTC A9 smartphone (Android 7.0) and manually rated according to the existence of several features (). No paid versions of the apps were purchased. Premium features were coded according to their mentioning in the app description pages on the Google Play Store or in the app itself.
Review Sampling—Weight-Tracking Apps
In a next step, user reviews were sampled from the 15 mobile apps. Only reviews written in the English language were considered. A sampling to saturation strategy was employed, whereby we extracted the first 30 reviews displayed for each app when the reviews were sorted by helpfulness. If saturation was not reached after 30 reviews (ie, new aspects were still raised by the users in the last ten reviews), we continued extracting text from further reviews in batches of ten until no new information was gathered. For two of the 15 apps, less than 30 reviews included text, and thus, all available reviews with text were included in the analysis.displays the screening and sampling process for both the component coding and the review analysis.
Data was analyzed using a mixed-methods approach. Using data from the first component coding, Pearson correlations assessed the relationship between complexity of the app and popularity indicators (rating, number of reviews, and number of downloads). These calculations were performed using the Statistical Package for the Social Sciences (SPSS) version 24 (IBM Corp).
The reviews of weight-tracking apps were imported to and analyzed in NVivo (QSR International) using a framework and thematic analysis. With the framework analysis, our aim was to evaluate the popularity of the components present in weight-tracking apps. To this end, we set up a node structure, including main components from the second component coding. In the thematic analysis, further nodes, which were not covered by the framework analysis, were added according to emerging themes. Coding was performed by two independent coders for the first three apps, reaching high interrater reliability (κ=.83). The node structure was then collapsed, and the rest of the mobile apps were coded and analyzed by one researcher.
Component Analysis Weight Loss Apps
In the first component analysis, we applied the adapted version of the OxFAB domains to 179 weight loss and weight management apps from Google Play Store. The apps covered on average 5.15 domains (standard deviation [SD] 3.33). More than half of the mobile apps had weight-tracking and goal setting functionalities. Other frequent domains were the BMI calculator and feedback concerning the progress toward a set goal (). Considering only the five tracking domains (ie, weight, body fat, body measurements, diet, and exercise), we found that the apps covered 1.21 domains on average (SD 1.29). Approximately one-third (n=62) of the apps focused on one tracking function only, another third incorporated two or more tracking components (n=52), and the last third did not have a tracking function at all (n=65).
Using Pearson correlations, we found that the count of components was strongly positively correlated with rating (r=.25; P=.001), number of reviews (r=.28; P<.001), and number of downloads (r=.48; P<.001). Hence, the mobile apps that incorporated more components (ie, that were more complex) were more popular in our sample (see).
|1. Self-monitoring: weight-tracking||106 (59.2)|
|2. Goal setting||99 (55.3)|
|3. Self-monitoring: body mass index calculator||86 (48.0)|
|4. Feedback on goal progress||77 (43.0)|
|5. Planning content and scheduling of diet and activity||48 (26.8)|
|6. Prescriptive help: menus||48 (26.8)|
|7. Information: diet||44 (24.6)|
|8. Prescriptive help: physical activity||43 (24.0)|
|9. Calorie calculator||43 (24.0)|
|10. Reminder setting||37 (20.7)|
|11. Self-monitoring: physical activity tracking||35 (19.6)|
|12. Motivation||31 (17.3)|
|13. Self-monitoring: body measurements tracking||27 (15.1)|
|14. Behavioral strategies: diet||27 (15.1)|
|15. Self-monitoring: diet tracking||26 (14.5)|
|16. Self-monitoring: body fat calculator||26 (14.5)|
|17. Support: motivational||25 (14.0)|
|18. Self-monitoring: body fat tracking||23 (12.8)|
|19. Behavioral strategies: physical activity||19 (10.6)|
|20. Information: physical activity||16 (8.9)|
|21. Reward||14 (7.8)|
|22. Weight management aids||7 (3.9)|
|23. Support: buddying||6 (3.4)|
|24. Support: professional||3 (1.7)|
|25. Impulse management||3 (1.7)|
|26. Reframing||2 (1.1)|
|27. Self-experimentation||1 (0.6)|
|Popularity indicators and complexity||Rating||Reviews||Downloads||Count components|
Review Analysis Weight-Tracking Apps
After conducting the second screening, 15 mobile apps remained in the sample (). The apps’ ratings ranged from 3.6 to 4.6 (mean=4.21) on a scale from 1 (low) to 5 (high satisfaction). The number of reviews lay between 1196 and 121,871 (mean=22084.27), and the number of downloads ranged accordingly from 100,000-500,000 to 10,000,000-50,000,000. From these 15 mobile apps, 569 reviews were sampled for qualitative analysis.
In the framework analysis, we assessed the frequency and valence of comments addressing specific components of an app. The first most positively commented on group of components was related to weight-tracking and (graphical) feedback (components 1-6 in). The second most positively commented on group of components was related to reliable data storage (components 7-10 in ).
Detailed (Graphical) Feedback
Users frequently highlighted the importance of receiving graphical and nongraphical feedback on their weight loss journey. They appreciated seeing graphs of their weight over time, especially when additional visual cues such as a trend line were given. Comments included:
I like how it graphs out your weight loss to show your progress. It’s very motivating to see how far you have come from where you started.
The trend line is a neat feature to forecast when I’ll reach my goal weight.
Some mobile apps had a component that predicted the date by which the user would reach his or her goal. This function was remarked positively by several users:
I like the way it predicts the date for you to reach your goal and the timeline showing your percentage of progress. The graphs are great too! Very motivating.
Generally, users stated that the feedback provided them with motivation to keep going. Where weight loss success was lacking, users appreciated neutral feedback:
I love the cheering when you lose a bit of weight. That’s very sweet and makes you feel good.
even when you are going through a bad spell it seems non-judgy.
Reliable Storage of Data
Users emphasized the importance of reliable storage of their data that was often collected over a long period of time. When the data was lost through a malfunctioning update or a glitch, it caused frustration in the user:
New update deleted all my data. Horrible. What’s the point of making an account if your data doesn’t get stored? I’m so mad!
Back up doesn’t work! I’d been backing up my data weekly to my SD card. Just got my new phone yesterday, went to import database and it says “database empty”—3 years of data lost! Fantastic!
|Weight Loss Tracker, BMI||Easy Creation||4.6||1457||1.2.11||50,000-100,000|
|Weight Log & BMI Calculator||aktiWir||4.5||31,455||1.44||1,000,000-5,000,000|
|Weight Loss Tracker-RecStyle||Recruit Holdings Co., Ltd.||4.4||17,067||3.1.8||1,000,000-5,000,000|
|Monitor Your Weight||Husain Al-Bustan||4.4||91,617||4.9.2||5,000,000-10,000,000|
|Libra-Weight Manager||Daniel Cachapa||4.4||19,623||3.3.3||1,000,000-5,000,000|
|BMI and Weight Tracker||despDev||4.4||16,559||3.4.4||1,000,000-5,000,000|
|My Weight Tracker, BMI||b3c.apps||4.2||5276||3.4||500,000-1,000,000|
|Weight Tracker||Pig Dog Bay||4.2||1196||1.18.05||100,000-500,000|
|Simple Weight Recorder||Beyonj||4.2||3551||-||1000000-5000000|
|Weight Loss Tracker||Appovo||4.1||1537||22.214.171.124||100,000-500,000|
|BMI Calculator & Weight Loss||Appovo||4.0||121,871||4.2.4||10,000,000-50,000,000|
|Weight loss and fitness app||cryofy.com||3.8||13,464||1.3.6||1,000,000-5,000,000|
|A+ Weight Manager Lite||Mobileking, Inc.||3.6||2024||1.6||500,000-1,000,000|
|Component||Frequency of positive comments||Frequency of improvement comments|
|2. Graph feedback||51||22|
|3. Target line graph||48||0|
|4. Feedback goal||35||1|
|5. Prediction target date||34||0|
|6. Trend line graph||27||2|
|7. Google Drive||25||3|
|8. Sync Google Fit||22||12|
|9. Backup cloud server||19||1|
|10. Import data||18||9|
Themes and nodes
|Simplicity or ease of use|
|Easy to use||133|
|Right amount of complexity||14|
|Long-term app usage|
aN: the frequency of comments addressing the respective node.
Following the loss of data, many users stated that they would discontinue their usage of the app and switch to a different one:
Lost all of my tracking history upon update. Even update on 11/16/16 did not correct the issue. All tracking ID just gone. Time to uninstall.
I was using this track [sic] my weight loss over a year. Updated and lost everything. Going to try a different app now.
Users appreciated mobile apps that allowed them to protect their weight data with a password:
...love that can back up data and put password on it.
A pin code for privacy on the app would be great.
In addition to the comments that directly addressed specific components of the app, we also conducted inductive thematic coding of user comments. The three most frequently identified themes were simplicity and ease of use, smooth functioning, and long-term app usage ().
Simplicity and Ease of Use
Users of weight-tracking apps expressed a preference for simple apps, equipped with only a few key features. These key features were mostly weight logging and graphing. Elaborate additional components were perceived to add unnecessary complexity to the app:
Just what I needed and nothing more to clutter the screen. I was looking for an app to log my weight and graph it. This got it right.
I love this app because it is simple and just does exactly what I want instead of a bunch of extra stuff that I’m not going to use and is just going to be in the way.
Reviewers commonly expressed a preference for app designs that were intuitive and easy to use, allowing for efficient app usage:
I can log data in seconds without navigating through needless steps.
Smooth Functioning and Technical Issues
The smooth running of the app emerged as a main criterion for user satisfaction and was critical to user retention:
Been using for a few years, it runs smooth and does what it says it will, which is tough to find sometimes.
Most reports of technical issues reflected problems with an update of the app, suggesting developers were not always able to meet the needs and demands of their users when releasing a new version:
As seems to be the norm these days, every time a good app is “updated” it gets ruined. Updated on 11/11 and visibility is terrible and takes ages to display main screen.
Nov update has ruined this app. Won’t use anymore.
...lost all my data after upgrade, behaves really odd, locks up! used to love it...
In 54 of the 569 reviews, people commented on their intention to use a weight-tracking app on a long-term basis:
Been using it for years and always been reliable.
Has been my Go-To weight tracking app for several years now, can’t fault it :)
Once users found the app that best fits their needs, they were willing to remain loyal to the app and even downloaded it onto new devices:
Every time I change my phone, this app is a must to be downloaded.
There were several other less prominent themes. Users appreciated it when developers acted mindfully with memory space. Either keeping the size of the app to a minimum or storing the app onto the secure digital card automatically received positive attention by the users:
Does exactly what you need without it being a bloated app that gobbles up much needed memory.
As someone who gets annoyed with my tiny phone memory filling up, the fact that this not only can be stored on a SD card but actually automatically saves to it is brilliant.
Similarly, users appreciated the mindful deployment of advertisements. Inappropriate advertising (such as for a fast food chain) or impairment of app functionality through advertisements were criticized:
What’s up with the Duncan donut add every time I open.
Too many ads. Covers the page so you can’t enter stats.
Inaccuracy of in-app calculators (such as BMI and body fat) was perceived as frustrating. Users criticized the inaccuracy harshly and expressed disbelief:
I’m sevearly [sic] underweight and on and off I’ve been hospitalized for it so when I calculated my weight and height I was very shocked to see that apparently I’m overweight and my 139 pound friend is obese class 1.
Providing options to customize the appearance of the app and its functionality was well perceived. Users liked personalizing aspects such as background color, font style, or the amount of measurements to be tracked:
I wish you could customize the widget colors, font size, etc.
...love it if I could personalise the colours in the app.
Finally, we found that when users were satisfied with an app, they stated their willingness to spend money on premium features or blocking of advertisements:
Happily paid the few $ for the pro version after trying the free one for a couple months.
...but I haaaaate the update that has now put ads in the app. I totally understand the developer needing to make money, put I’d rather pay for a premium version to get rid of the ads.
Our results provide insights into the preferences of app users. In correlational analyses, including all weight loss apps, we found that more complex apps had higher ratings, more reviews, and more downloads, suggesting higher popularity. In our review analysis of weight-tracking apps, we found that components related to feedback on the weight loss journey were of high importance. Receiving positive feedback and visualizing weight loss success provided the user with positive reinforcement and thus increased motivation. Furthermore, users emphasized the importance of reliable data storage as they intended to use the app on a long-term basis. Users appreciated mobile apps that were specialized, with few additional components unrelated to weight-tracking and that were intuitive and easy to use. Users emphasized that the smooth functioning of the app is of immense importance. When technical issues arose, users appeared likely to discontinue using the app.
What Weight Loss Apps Offer
In our component analysis of general weight loss apps, we found that more than half had components related to weight-tracking and goal setting. Another 43.0% (77/179) of the apps provided users with feedback on their goal progress. This finding resembles previous content analyses of weight loss apps. For instance, Bardus and colleagues assessed behavior change techniques (BCTs) of weight management apps in 2015 and found that the most prominent ones were based on self-monitoring, goal setting, and feedback . Similarly, Pagoto’s review found that goal setting and self-monitoring were the most prominent behavioral strategies in their sample of weight loss apps in 2012 [ ]. This suggests that the content of weight loss apps is quite stable, as the same components remain prominent over time. Importantly, these three component types are well-studied BCTs that are known for their effectiveness in fostering a healthier lifestyle [ ].
Fewer than 20% of the 179 weight loss apps in our sample offered social support features. Social support can contribute to weight loss success, as has been shown in randomized studies comparing individual- with group-based approaches [, ]. It is therefore surprising that only few apps made use of the technological opportunities to connect users with other weight loss seekers around the world. The lack of social support components has already been criticized by Breton and colleagues in 2011 after they had conducted an app market review of weight control apps [ ]. However, the implementation of social support features in mobile apps is costly to build and maintain. It is therefore conceivable that only the most economically valuable (ie, popular) mobile apps such as Lose It! or MyFitnessPal, are able to offer these features.
What Users Find Important
In line with our results of the content analysis of weight loss app components, the most positively commented on components in the review analysis were also related to self-monitoring and feedback on goal progress. Our finding that users perceived feedback on and visualization of their weight loss progress as useful and motivating is consistent with the findings of other studies [, ]. Burke and colleagues showed that self-monitoring with feedback helps participants achieve more weight loss than self-monitoring alone [ ]. They suggest that feedback provides guidance and accountability to the user, regardless of the valence of this feedback. Although users in our sample did not state they felt accountable to their device, they did state that the feedback kept them on track with their weight loss goal. Users liked to receive as many details about their progress as possible to gain the most reward out of a satisfactory outcome. In a qualitative study by Dennison and colleagues, participants expressed their concern that they might find corrective feedback and lack of success particularly daunting and deterring in weight loss apps [ ]. The results of this review do not support these concerns; lack of success was mostly responded to with neutral feedback, and users did not feel negatively judged for their lack of progress.
Beyond the weight management components, users expected high levels of technical reliability and secure data storage. This is critical because users often intend to use a weight-tracking app on a long-term basis, meaning that these apps often cover years of data. This data is often of emotional value, as it provides motivation to the user and visualizes previous successes and hard work. Losing data that has been collected for several years is perceived as immensely frustrating and can lead to a loss of trust in the app.
In addition, reliable data storage is also important from a user retention perspective: there are many weight-tracking apps available on the app store market, so initially users can easily switch from one to another, and they often try out several at a time . Switching barriers are only created once a user starts collecting data in one app over a considerable amount of time, as this data is usually not transferable between mobile apps. A loss of data eradicates this additional value of the app, making it easier for users to switch to another app.
Reviewers highlighted the importance of an intuitive and simple app design, which is consistent with findings in the literature . A qualitative study by Dennison and colleagues showed that users do not have a lot of patience in dealing with mobile apps and quickly discard them when usage is perceived as complicated [ ]. Hence, a simple and straight-forward design is critical.
With regards to simplicity, we found conflicting results for the weight loss compared with the weight-tracking apps. Whereas the correlational analysis showed that complex weight loss apps are more popular than simple ones, the review analysis of weight-tracking apps indicated that users prefer simple and basic apps. One possible explanation for the finding that more complex weight loss apps had higher popularity ratings could be that these complex apps met the needs of more users. People seeking to download a weight loss app for the first time might settle for a more general and comprehensive app than a specific one in order to be able to test several strategies for weight loss. Once they have found the right features for them, they might download an app that is more specific to their needs. This could explain our finding that for weight-tracking apps, less complexity and fewer components were preferred by the users. Further research is needed to examine this.
A substantial amount of reviews contained complaints about the malfunctioning aspects of a given app. Most of these complaints were related to dissatisfaction with an update of the app. The topics of the reviews ranged from the emergence of technical issues and the lack of a previously existing feature to disliking of a new user interface design. This suggests that updated versions were premature and not sufficiently tested on users before they were made available to the public. Similarly, in a study analyzing complaints in user reviews from the top 20 apps on the iOS app store, Khalid and colleagues also found that a substantial number of comments originated from issues with an update . They concluded that developers should engage in more rigorous testing and work more closely with users before introducing new versions of an app. They warned that user frustration with an update can lead to bad ratings of an otherwise good app. On the other hand, we found that updates can also lead to positive outcomes. In our review, there were several cases in which reviewers commented on positive changes to issues they complained about or edited their negative ratings to more positive ones when problems were resolved. Similarly, a recent analysis showed that nearly 50% of user suggestions are implemented in app updates and that this consideration of user opinions is rewarded with higher app ratings [ ]. Hence, involving users in the development of an app is highly recommended.
Another approach to enhancing user satisfaction can be to allow for personalization of the app. In our review, users appreciated the opportunity to adapt the app to their needs and likes, for instance, by allowing for the choice of a theme or design. Similarly, Dennison and colleagues found in their study that users liked to be able to make personalized settings such as deciding when to receive reminders to weigh . Generally, allowing for personalization enables the developer to cater more needs and preferences and therefore attract more users.
Strengths and Limitations
A major strength of this app market review is that we analyzed the voices of a large and diverse sample of people. The content of app reviews is influenced by the needs and expectations of the user, as well as the context of usage and can therefore vary considerably. Asking only a small group of people, such as Dennison and colleagues’ focus group, can restrict the variety and representativeness of the data. With our large sample, we were able to see patterns and analyze which concerns are shared by most users and which ones are more specific. This allows us to make more reliable conclusions about what users like and dislike in mHealth apps. Importantly, to the best of our knowledge, we are the first to use this method of qualitatively analyzing user reviews of weight loss apps. We found this process to be very fruitful for gaining insights into user experience and opinion.
One limitation of our review is that not all of the recommendations we conclude from our results will be generalizable to other kinds of apps. That is, it is conceivable that the most important aspects that users are concerned about differ between app categories. For instance, the importance of feedback on a goal is most probably specific to self-monitoring apps and will not be of imminent importance for, for example, gaming apps. However, concerns about reliable data storage, ease of use, and app updates most probably pertain to other app categories.
It is also possible that people who write user reviews on the app store are not necessarily representative of the broader population of app users. Nevertheless, our approach to reviewing user experience allowed us to capture feedback from a large number of users and hence, provided us with a more diverse sample than would have been achieved through commonly used methods such as qualitative interviews or focus groups.
Another limitation of this review is that we only considered mobile apps from the Google Play Store. This decision was due to a lack of similar indexing methods and technological issues with the download of user reviews from the iOS store. However, a recent analysis of the mHealth marketplace has concluded that 75% of today’s health and fitness app developers produce mobile apps for both the Android and iOS market . The two markets therefore overlap substantially, and it is questionable whether we would have found any meaningful differences between the two stores. By searching the app store directly rather than through a search engine, our results are limited by the fact that the Google Play Store only displays 249 mobile apps per search term. Our approach was guided by the intention to analyze those mobile apps that users of the Google Play Store can find. However, several more apps would have been found when using a search engine.
Finally, our results are limited in that this review focused on popularity but not on the effectiveness of discussed mobile apps. However, reviews assessing the evidence-base and potential effectiveness of mHealth apps can be found elsewhere in the literature, where the occurrence of BCTs has been used to evaluate their quality . Moreover, when comparing our results with the literature, we find that effectiveness and popularity partly overlap, as well-accepted and effective BCTs such as self-monitoring and feedback [ , ] are particularly liked by users.
This review extends the literature by highlighting which facets of weight loss apps are especially important to users and should be considered when developing an app. In particular, findings from this review suggest several aspects of app design that developers of self-monitoring apps should consider. First, developers should focus on providing appropriate feedback on goal progress, as users appeared to respond favorably to detailed feedback on weight loss success and appreciated it when mobile apps remained neutral when success was lacking. Second, we recommend that developers make sure that data is stored reliably to enable people to use the app on a long-term basis. Third, developers should keep in mind who the chosen target audience is. A simple and basic app version may be sufficient when speaking to a specifically targeted audience. However, more comprehensive weight loss apps may attract more people, as they speak to anyone who is generally looking into weight loss support. Fourth, we recommend that developers incorporate users’ opinion in all design and development stages to ensure that the app fulfils users’ expectations. Furthermore, it is important to perform rigorous testing on an app before making it available to the public, as smooth functioning is critical to user satisfaction and long-term usage. Overall, we believe that our novel methodology and large sample size strengthen our conclusions. We recommend that future app market reviews assess user experience in addition to the evaluation of app components.
This research was funded by the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care Oxford (CLAHRC) at Oxford Health NHS Foundation Trust. KF’s time on this project was funded by NIHR CLAHRC Oxford at Oxford Health NHS Foundation Trust, Wolfson College, University of Oxford (Oxford-Wolfson Marriott-Primary Care Graduate Scholarship), and National Institute for Health Research School for Primary Care Research (NIHR SPCR). JHB’s time on this project was funded by the NIHR Oxford Biomedical Research Centre (BRC) Obesity, Diet and Lifestyle Theme. CA’s time on this project was funded by the NIHR SPCR. RN’s time on this project was funded by the NIHR CLAHRC Oxford. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health.
Conflicts of Interest
Multimedia Appendix 1
Details of all 179 weight loss apps.XLSX File (Microsoft Excel File), 18KB
Multimedia Appendix 2
Features of the second component coding.XLSX File (Microsoft Excel File), 31KB
- Research2guidance. 2016 Oct. mHealth app developer economics 2016: the current status and trends of the mHealth app market URL: https://research2guidance.com/r2g/r2g-mHealth-App-Developer-Economics-2016.pdf [accessed 2017-08-08] [WebCite Cache]
- Breton ER, Fuemmeler BF, Abroms LC. Weight loss-there is an app for that! But does it adhere to evidence-informed practices? Transl Behav Med 2011 Dec;1(4):523-529 [FREE Full text] [CrossRef] [Medline]
- Knight E, Stuckey MI, Prapavessis H, Petrella RJ. Public health guidelines for physical activity: is there an app for that? a review of android and apple app stores. JMIR Mhealth Uhealth 2015;3(2):e43 [FREE Full text] [CrossRef] [Medline]
- Rivera J, McPherson A, Hamilton J, Birken C, Coons M, Iyer S, et al. Mobile apps for weight management: a scoping review. JMIR Mhealth Uhealth 2016 Jul 26;4(3):e87 [FREE Full text] [CrossRef] [Medline]
- Chen J, Cade JE, Allman-Farinelli M. The most popular smartphone apps for weight loss: a quality assessment. JMIR Mhealth Uhealth 2015;3(4):e104 [FREE Full text] [CrossRef] [Medline]
- Azar KMJ, Lesser LI, Laing BY, Stephens J, Aurora MS, Burke LE, et al. Mobile applications for weight management: theory-based content analysis. Am J Prev Med 2013 Nov;45(5):583-589. [CrossRef] [Medline]
- Middelweerd A, Mollee JS, van der Wal CN, Brug J, Te Velde SJ. Apps to promote physical activity among adults: a review and content analysis. Int J Behav Nutr Phys Act 2014;11:97 [FREE Full text] [CrossRef] [Medline]
- Pagoto S, Schneider K, Jojic M, DeBiasse M, Mann D. Evidence-based strategies in weight-loss mobile apps. Am J Prev Med 2013 Nov;45(5):576-582. [CrossRef] [Medline]
- Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010;12(1):e4 [FREE Full text] [CrossRef] [Medline]
- Flores MG, Granado-Font E, Ferré-Grau C, Montaña-Carreras X. Mobile phone apps to promote weight loss and increase physical activity: a systematic review and meta-analysis. J Med Internet Res 2015;17(11):e253 [FREE Full text] [CrossRef] [Medline]
- Wadden TA, Berkowitz RI, Womble LG, Sarwer DB, Phelan S, Cato RK, et al. Randomized trial of lifestyle modification and pharmacotherapy for obesity. N Engl J Med 2005 Nov 17;353(20):2111-2120. [CrossRef] [Medline]
- Thomas SL, Hyde J, Karunaratne A, Kausman R, Komesaroff PA. “They all work...when you stick to them”: a qualitative investigation of dieting, weight loss, and physical exercise, in obese individuals. Nutr J 2008;7:34 [FREE Full text] [CrossRef] [Medline]
- VanWormer JJ, Martinez AM, Martinson BC, Crain AL, Benson GA, Cosentino DL, et al. Self-weighing promotes weight loss for obese adults. Am J Prev Med 2009 Jan;36(1):70-73. [CrossRef] [Medline]
- Butryn ML, Phelan S, Hill JO, Wing RR. Consistent self-monitoring of weight: a key component of successful weight loss maintenance. Obesity (Silver Spring) 2007 Dec;15(12):3091-3096. [CrossRef] [Medline]
- Burke LE, Sereika SM, Music E, Warziski M, Styn MA, Stone A. Using instrumented paper diaries to document self-monitoring patterns in weight loss. Contemp Clin Trials 2008 Mar;29(2):182-193 [FREE Full text] [CrossRef] [Medline]
- Bardus M, van Beurden SB, Smith JR, Abraham C. A review and content analysis of engagement, functionality, aesthetics, information quality, and change techniques in the most popular commercial apps for weight management. Int J Behav Nutr Phys Act 2016;13(1):35 [FREE Full text] [CrossRef] [Medline]
- Boudreaux ED, Waring ME, Hayes RB, Sadasivam RS, Mullen S, Pagoto S. Evaluating and selecting mobile health apps: strategies for healthcare providers and healthcare organizations. Transl Behav Med 2014 Dec;4(4):363-371 [FREE Full text] [CrossRef] [Medline]
- McLean V. Cision PRWeb. 2011 Apr 25. Motivating patients to use smartphone health apps URL: http://www.prweb.com/releases/2011/04/prweb5268884.htm [accessed 2017-08-08] [WebCite Cache]
- Iacob C, Harrison R. Retrieving and analyzing mobile apps feature requests from online reviews. 2013 Oct 10 Presented at: 10th IEEE Working Conference on Mining Software Repositories (MSR); May 18-19, 2013; San Francisco, CA p. 41-44. [CrossRef]
- Pagano D, Maalej W. User feedback in the appstore: an empirical study. 2013 Oct 21 Presented at: 21st IEEE International Requirements Engineering Conference; July 15-19, 2013; Rio de Janeiro, Brazil p. 125-134. [CrossRef]
- Semper HM, Povey R, Clark-Carter D. A systematic review of the effectiveness of smartphone applications that encourage dietary self-regulatory strategies for weight loss in overweight and obese adults. Obes Rev 2016 Sep;17(9):895-906. [CrossRef] [Medline]
- Liu C, Zhu Q, Holroyd KA, Seng EK. Status and trends of mobile-health applications for iOS devices: a developer's perspective. J Syst Softw 2011 Nov;84(11):2022-2033. [CrossRef]
- Burke LE, Conroy MB, Sereika SM, Elci OU, Styn MA, Acharya SD, et al. The effect of electronic self-monitoring on weight loss and dietary intake: a randomized behavioral weight loss trial. Obesity (Silver Spring) 2011 Feb;19(2):338-344 [FREE Full text] [CrossRef] [Medline]
- Hartmann-Boyce J, Aveyard P, Koshiaris C, Jebb SA. Development of tools to study personal weight control strategies: OxFAB taxonomy. Obesity (Silver Spring) 2016 Feb;24(2):314-320 [FREE Full text] [CrossRef] [Medline]
- Hartmann-Boyce J, Boylan A, Jebb SA, Fletcher B, Aveyard P. Cognitive and behavioural strategies for self-directed weight loss: systematic review of qualitative studies. Obes Rev 2017 Mar;18(3):335-349 [FREE Full text] [CrossRef] [Medline]
- Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol 2009 Nov;28(6):690-701. [CrossRef] [Medline]
- Renjilian DA, Perri MG, Nezu AM, McKelvey WF, Shermer RL, Anton SD. Individual versus group therapy for obesity: effects of matching participants to their treatment preferences. J Consult Clin Psychol 2001;69(4):717-721. [CrossRef]
- Wing RR, Jeffery RW. Benefits of recruiting participants with friends and increasing social support for weight loss and maintenance. J Consult Clin Psychol 1999 Feb;67(1):132-138. [Medline]
- Zhao J, Freeman B, Li M. Can mobile phone apps influence people's health behavior change? an evidence review. J Med Internet Res 2016 Oct 31;18(11):e287 [FREE Full text] [CrossRef] [Medline]
- Dennison L, Morrison L, Conway G, Yardley L. Opportunities and challenges for smartphone applications in supporting health behavior change: qualitative study. J Med Internet Res 2013;15(4):e86 [FREE Full text] [CrossRef] [Medline]
- Khalid H, Shihab E, Nagappan M, Hassan AE. What do mobile app users complain about? IEEE Software 2015 May;32(3):70-77. [CrossRef]
- Palomba F, Linares-Vasquez M, Bavota G, Oliveto R, Di Penta M, Poshyvanyk D. User reviews matter! tracking crowdsourced reviews to support evolution of successful apps. : IEEE; 2015 Nov 23 Presented at: 31st International Conference on Software Maintenance and Evolution (ICSME); September 29-October 1, 2015; Bremen, Germany p. 291-300. [CrossRef]
- Steinberg DM, Tate DF, Bennett GG, Ennett S, Samuel-Hodge C, Ward DS. The efficacy of a daily self-weighing weight loss intervention using smart scales and e-mail. Obesity (Silver Spring) 2013 Sep;21(9):1789-1797 [FREE Full text] [CrossRef] [Medline]
|BCT: behavior change technique|
|BMI: body mass index|
|mHealth: mobile health|
|OxFAB: Oxford Food and Activity Behaviors|
|PABAK: prevalence-adjusted and bias-adjusted kappa|
|SD: standard deviation|
Edited by G Eysenbach; submitted 20.08.17; peer-reviewed by M Bardus, T Brinker, PH Lin; comments to author 21.09.17; revised version received 16.10.17; accepted 29.10.17; published 22.12.17
©Kerstin Frie, Jamie Hartmann-Boyce, Susan Jebb, Charlotte Albury, Rebecca Nourse, Paul Aveyard. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 22.12.2017.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.