RefCheck Maintenance Notice

On Monday, December 3, 2018, from 16:00-18:00 EST, RefCheck will be undergoing maintenance. RefCheck is the process where, during copyediting, all references are extracted from the manuscript file, parsed, matched against various databases (eg, PubMed and CrossRef), and automatically corrected. For more information on RefCheck, please visit our Knowledge Base.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 24.05.18 in Vol 6, No 5 (2018): May

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/10034, first published Feb 04, 2018.

This paper is in the following e-collection/theme issue:

    Review

    Attention and Cognitive Bias Modification Apps: Review of the Literature and of Commercially Available Apps

    1National Addictions Management Service, Institute of Mental Health, Singapore, Singapore

    2Medical Board / Department of Development Psychiatry, Institute of Mental Health, Singapore, Singapore

    3Department of Family Medicine and Primary Care, Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore

    Corresponding Author:

    Melvyn Zhang, MBBS, MRCPsych

    National Addictions Management Service

    Institute of Mental Health

    10 Buangkok Green Medical Park

    Singapore, 539747

    Singapore

    Phone: 65 63892504

    Email:


    ABSTRACT

    Background: Automatic processes, such as attentional biases or interpretative biases, have been purported to be responsible for several psychiatric disorders. Recent reviews have highlighted that cognitive biases may be modifiable. Advances in eHealth and mHealth have been harnessed for the delivery of cognitive bias modification. While several studies have evaluated mHealth-based bias modification intervention, no review, to our knowledge, has synthesized the evidence for it. In addition, no review has looked at commercial apps and their functionalities and methods of bias modification. A review is essential in determining whether scientifically validated apps are available commercially and the proportion of commercial apps that have been evaluated scientifically.

    Objective: The objective of this review was primarily to determine the proportion of attention or cognitive bias modification apps that have been evaluated scientifically and secondarily to determine whether the scientifically evaluated apps were commercially available. We also sought to identify commercially available bias modification apps and determine the functionalities of these apps, the methods used for attention or cognitive bias modification, and whether these apps had been evaluated scientifically.

    Methods: To identify apps in the published literature, we searched PubMed, MEDLINE, PsycINFO, and Scopus for studies published from 2000 to April 17, 2018. The search terms used were “attention bias” OR “cognitive bias” AND “smartphone” OR “smartphone application” OR “smartphone app” OR “mobile phones” OR “mobile application” OR mobile app” OR “personal digital assistant.” To identify commercial apps, we conducted a manual cross-sectional search between September 15 and 25, 2017 in the Apple iTunes and Google Play app stores. The search terms used to identify the apps were “attention bias” and “cognitive bias.” We also conducted a manual search on the apps with published evaluations.

    Results: The effectiveness of bias modification was reported in 7 of 8 trials that we identified in the published literature. Only 1 of the 8 previously evaluated apps was commercially available. The 17 commercial apps we identified tended to use either an attention visual search or gamified task. Only 1 commercial app had been evaluated in the published literature.

    Conclusions: This is perhaps the first review to synthesize the evidence for published mHealth attention bias apps. Our review demonstrated that evidence for mHealth attention bias apps is inconclusive, and quite a few commercial apps have not been validated scientifically.

    JMIR Mhealth Uhealth 2018;6(5):e10034

    doi:10.2196/10034

    KEYWORDS



    Introduction

    Advances in experimental psychology have led to further research into cognitive bias modification. Cognitive biases refer to automatic attentional or interpretational tendencies toward certain stimuli [1]. Cognitive bias is an overarching term and includes other common cognitive biases, such as attentional biases, approach biases, and interpretative biases [2]. These unconscious processes are postulated to be involved in the psychopathologies of various disorders, including social anxiety disorder [3], alcohol use disorder [4], and tobacco use disorder [5]. Cognitive bias modification refers to the retraining of these automatic processes. For addictive disorders, theories such as the opponent process theory or the incentive-sensitization theory have been proposed to explain the causes of the vicious cycle of addiction [6]. However, more recently, the dual-process theory has postulated that, in addictive disorders, automatic processing of substance-related cues is increased, with a corresponding decrease in normal inhibitory control [7]. Thus, these automatic processes would cause an individual to relapse into substance use. While the dual-process model does not apply to other psychiatric disorders, other theoretical approaches have similarly proposed the presence of an enhanced threat-detection mechanism, and that this, in turn, results in socially anxious individuals to be hypervigilant toward threatening or anxiety-invoking stimuli [8].

    Experimental psychologists have developed various attention bias assessment tools, such as the dot-probe task, visual-probe task, visual search task, and cognitive bias interpretations [6]. In addition to assessment, these tools are commonly also used for bias modification. For the visual-probe task and the dot-probe task, individuals are required to respond to a probe that replaces either a neutral image or a substance-related image, or for affective conditions, images depicting positive or negative emotional states. Attentional biases are assessed to be present if individuals demonstrate a faster reaction time in responding to probes replacing images associated with high salience [6]. Cognitive bias modification for interpretations involves presenting individuals with ambiguous scenarios and with word fragments that help to disambiguate the scenarios in a positive way [9]. In the visual search task, individuals are required to identify the positive smiling picture among a range of other pictures with a range of emotions [10]. To date, further research has examined the efficacy of bias modifications, and a recent meta-analytical study synthesized the evidence for substance use disorders [11]. In their meta-analysis of trials involving participants with tobacco or alcohol addiction, Cristea et al [11] reported that cognitive bias interventions had a moderate effect on cognitive bias (Hedges g=0.60), but there was no effect of bias modification on other outcomes, such as cravings [11]. Jones and Sharpe [1] in their review of meta-analyses found that there is more evidence for cognitive bias modification in ameliorating anxiety symptoms than in ameliorating depressive symptoms. Jones and Sharpe [1] also reported that the long-term efficacy was evident only in addiction trials. It is essential to note that studies included in these meta-analytical reviews were trials conducted within the controlled environment of a laboratory [1]. Conducting attention bias modification in a laboratory setting reduces the risk of attrition to these highly repetitive tasks, but the results may not be replicable in a less-supervised clinical or community setting.

    In parallel with the development of the above, there have been major advances in both eHealth and mHealth technologies in the 21st century. eHealth, or electronic health, refers to the use of Web-based interventions [12] and mHealth, or mobile health, refers to the use of mobile devices, such as smartphones and their accompanying apps, for health care [12]. In psychiatric practice, both eHealth and mHealth technologies have been adopted for the delivery of psychological interventions for conditions such as depression and bipolar disorders to monitor patients’ mood state [13] and to reduce drinking among individuals with alcohol use disorder [14]. Advances in technologies have also transformed how conventional attention and cognitive bias modification tasks are being delivered. An evaluation of the efficacy of Web-based attention bias modification interventions by Wittekind et al [15] found that a Web-based approach and avoidance could retrain attention bias among individuals with tobacco use disorder and reported its efficacy in smoking reduction. In a study of individuals with social anxiety disorder, Sportel et al [16] compared the effectiveness of Web-based cognitive bias modification against conventional cognitive behavioral therapy and reported that both modalities of intervention were effective in reducing social anxiety symptoms. These studies highlighted the potential of Web-based bias interventions as an alternative to conventional laboratory-based attention bias modification. Given the proliferation of commercially available health apps and the increased recognition of the role of attention bias in medical and psychiatric disorders, more commercially developed apps that aim to manipulate attention bias are expected to become available. Studies have been published, such as that by Clarke et al [17], that have evaluated whether an attention bias modification task was helpful for individuals with insomnia.

    We know of no reviews to date that have synthesized the literature to determine the existing evidence for mHealth-based bias modification interventions. Also lacking is an understanding of the common functionalities and methods of bias modification used in these commercially available apps. By analyzing in parallel both the apps offered in commercial app stores and the apps evaluated in published works on attention and cognitive bias modification, we can determine whether scientifically validated apps are available commercially and estimate the proportion of commercial apps that have been evaluated scientifically.

    The primary objective of this review was to determine the proportion of attention or cognitive bias modification apps that have been evaluated scientifically. The secondary objective was to determine whether the scientifically evaluated apps were commercially available. In this review, we also sought to identify commercially available bias modification apps and determine the functionalities of these apps, the methods used for attention or cognitive bias modification, and whether these apps had been evaluated scientifically. The evidence from this review has important implications for clinical care, technological development, and research.


    Methods

    Phase 1: Identification of Attention and Cognitive Bias Modification Apps in the Published Literature

    To achieve the primary objective, we initially searched PubMed and MEDLINE for articles published from 2000 through to September 24, 2017. We performed an updated search from April 14 through 17, 2018 on PubMed and MEDLINE and 2 additional databases, PsycINFO and Scopus. We selected the year 2000 because, before this date, few people had access to personal digital assistants and mobile phones. The search terms we used were “attention bias” OR “cognitive bias” AND “smartphone” OR “smartphone application” OR “smartphone app” OR “mobile phones” OR “mobile application” OR mobile app” OR “personal digital assistant.” We included only English-language articles.

    The inclusion criteria were that (1) cognitive bias modification must have been delivered using a mobile device (mobile phone, smartphone, or personal digital assistant), and (2) delivery was in the form of a specific app or game. We excluded articles that simply described how a Web-based intervention could run on a mobile device.

    All the articles were initially screened based on their title and abstract by 2 independent authors (MZ and JY). Full copies of the shortlisted articles were then evaluated against the inclusion and exclusion criteria. Any disagreement between the 2 authors was resolved by discussion with the third author (GS). The rationale for inclusion and exclusion was captured on an electronic form, together with the following information: (1) publication details (names of the authors and the year of publication), (2) specific condition targeted, (3) description of the intervention, (4) method of delivery of attention bias or cognitive bias modification, and (5) main outcome and findings arising from the study.

    Phase 2: Identification of Commercially Available Apps

    We then conducted a manual cross-sectional search between September 15 and 25, 2017 on the apps stores iTunes (Apple Inc, Cupertino, CA, USA) and Google Play (Google LLC, Mountain View, CA, USA). The search terms we used were “attention bias” and “cognitive bias.” The manual search was supplemented in the same period with the use of a mobile app search engine, 42matters (42matters AG, Zurich, Switzerland), to search for all the available apps globally. If an app had both a free and paid version, we analyzed the paid version, as it is commonly recognized that paid versions have more functionalities; free versions of apps tend to offer only limited access to functionalities [18].

    We extracted the following information from the identified apps and recorded it on a standardized electronic data collation form: (1) app name, (2) general description of the app, (3) method of attention or cognitive bias modification, (4) other functionalities, (5) range of total downloads, (6) app ratings, (7) reference source, and (8) last date of modification. For the method of attention or cognitive bias modification, we recorded the tool that was being used (eg, visual-probe task, dot-probe task, or visual search).

    To determine whether commercially available apps had been evaluated scientifically, we cross-checked the extracted commercial app against those apps that we had previously identified in phase 1. Also, we assessed any references that were cited in either the description or within the app for any scientific evaluation of the app. We contacted developers of the respective apps via email on November 5, 2017 for further information as to whether the app had been evaluated scientifically.

    Phase 3: Availability in App Stores of Apps in the Published Literature

    We manually searched the app stores (Apple iTunes and Google Play) for the apps with published evaluations (phase 1). We supplemented the manual search with a mobile app search engine (42matters) to extend the search. We downloaded and evaluated available apps and extracted the following information: (1) app name, (2) general description of the app, (3) method of attention or cognitive bias modification, (4) total number of downloads (if available), (5) app ratings (if available), (6) reference source, and (7) last date of modification of the app.


    Results

    Figure 1 provides an overview of the study selection process. Our initial and updated search identified 743 citations. Of these, 73 were duplicates, and we screened the 670 remaining articles by their title and abstract, leaving 40 articles. We then downloaded these for further evaluation against the inclusion and exclusion criteria, leaving 8 articles suitable for qualitative review.

    The articles described mHealth apps for the delivery of attention or cognitive bias modification for following conditions: insomnia (n=1), social anxiety (n=1), anxiety disorder (n=3), alcohol use disorder (n=1), and tobacco use disorder (n=2). Table 1 [17,19-25] summarizes the main characteristics of the studies that we included. Nearly all of the trials used either the dot-probe or visual-probe task, except for 1 study that used cognitive bias for interpretation intervention, and another that did not specify the task applied. With regard to the outcomes, 7 studies reported effectiveness and only 1 reported no effect. Bias modification was found to be effective, as it helped improve symptoms of insomnia and cognitive symptoms of presleep arousal [17]; reduce subjective anxiety [20]; improve performance on stress task [21]; reduce attentional biases for cigarettes [22,25]; reduce the amount of alcohol consumed [24]; and reduce prenatal stress and anxiety [23]. However, Yang et al [19] reported that bias modification was not effective, as the bias scores among participants with social anxiety disorders were not reduced.

    Figure 1. Flowchart of article selection.
    View this figure

    Only 1 of the apps described in these articles was commercially available on the app stores (based on our phase 3 search).

    In phase 2, we retrieved a total of 15 apps from Google Play and 2 apps from iTunes; 5 of the apps were available in both stores. The flowchart in Figure 2 shows the app selection process from the commercial stores.

    We downloaded and further evaluated the commercial apps (n=17). Multimedia Appendix 1 summarizes the main characteristics of the commercially available attention bias or cognitive bias apps. Of 17 apps, 10 were free to download. Most of these apps claimed to target conditions such as stress (n=7), anxiety (n=3), tobacco (n=3), alcohol use disorders (n=2), and grief (n=1). One app (Bias Modification) did not specifically mention in the app description or in the app the targeted condition. Most used attention visual search in bias modification, with only 2 apps adopting the cognitive bias modification for interpretation method. A total of 4 apps used methods of bias modification that differed from visual probe, cognitive bias modification, and attention visual search tools. For the app Quitty, the bias modification task involved using a tobacco product as a projectile to hit other objects. For the apps Stop Smoking-Quit Smoking, Stay Sober, Stop Drinking, and ChimpShop, the paradigm involved an avatar running through an environment, and bias was retrained by avoiding the substances. There were limited additional functionalities for most of the included apps, with 5 apps including questionnaires or other functionalities, such as the ability to customize images (Spot Smile, brighten your day app) or the addition of reminders (AntiAnxiety), to allow for customization of the app for the individual user. Only 4 apps attributed a reference source within the app, of which 1 has been previously evaluated (ChimpShop). On the Android platform, 2 of the apps had been downloaded between 10,000 and 50,000 times. After contacting developers to find out whether their apps had been evaluated previously, 3 replied, but none of the developers were able to offer evidence demonstrating that their app had been evaluated in a prior study (Quitty, Happytap, and AntiAnxiety).

    Figure 3 provides a graphical overview of the target conditions for both validated scientific apps and commercial apps. Apps evaluated in a prior study targeted mainly tobacco use disorder and anxiety use disorder; while of the 17 commercially available apps, most targeted stress. Tobacco use disorder appeared to be a common disorder that both validated and commercial apps targeted, with a total of 2 and 3 validated and commercial apps, respectively.

    Table 1. Overview of attention and cognitive bias modification apps in the published literature.
    View this table
    Figure 2. Flowchart of the selection of apps from the commercial stores.
    View this figure
    Figure 3. Overview of conditions targeted by both commercial and validated apps.
    View this figure

    Discussion

    Principal Findings

    We reviewed all the cognitive bias modification apps that we identified to be available commercially and those evaluated in the research literature. The effectiveness of mHealth attention bias modification was reported in 7 of 8 previous trials. Only 1 of 8 previously evaluated apps was commercially available. The 17 commercial apps we identified in phase 2 tended to use either an attention visual search or a gamified task. Despite some commercial apps indicating a reference source, we managed to find only 1 app that had been evaluated previously in the published literature. None of the developers who replied could offer further evidence that their app had been validated through prior research.

    This review highlighted that the evidence for mHealth-based attention and cognitive bias modification is inconclusive, as we found only 1 trial [19] out of the 8 that reported no effectiveness for bias modification. Our findings are similar to those for Web-based attention bias modification, a precursor to mobile-based interventions. Notably, in psychiatry, Web-based attention bias modification interventions have been evaluated for addictive, depressive, and anxiety disorders [26-28]. For conditions such as tobacco use disorder, while some trials reported the effectiveness of approach and avoidance [15], others, such as Elfeddali et al [29], who administered an approach and avoidance bias modification intervention to 434 participants, reported that bias modification did not lead to a reduction in bias or in the absolute number of cigarettes smoked. Similarly, for anxiety disorders, some trials reported the effectiveness of Web-based interventions, but many reported that Web-based interventions had no effectiveness [30-34]. We postulate that the mechanism of delivery of bias modification could have resulted in some trials having negative results. Of significance, Jones and Sharpe [1], in their recent meta-analytical review of previously published meta-analysis, synthesized the evidence not just for effectiveness but also with regard to training locations. Jones and Sharpe [1] reported that most of their included studies recommended laboratory-based administration of attention bias modification interventions rather than remote administration. Web-based administration of attention bias modification is remote and less controlled than laboratory-based administration. Attention bias modification interventions do typically provide some form of guidance from a therapist at the onset of the intervention, as well as supervision during the intervention, in which the therapist offers feedback if too many erroneous responses are made.

    Our review suggests that, while some trials evaluated attention bias apps, only 1 of these apps appears to have progressed to being commercially available. In contrast, there are a variety of commercially available apps without scientific evaluation. Given this, individuals are highly likely to download other nonvalidated apps instead of those that have been validated, after searching for attention or cognitive bias apps in the app stores. In our case, we identified only 1 app that had been scientifically validated, but the download rates of the app were low, and hence it is likely to have ranked low in the stores. Similarly, Haskins et al [35], in their review of smoking cessation apps, reported that among the scientifically validated apps they found in commercial app stores, only 2 ranked among the top 50 apps in the store.

    Haskins et al [35] also highlighted that the fact that the numbers of commercially available apps far exceeded the numbers of scientifically validated apps implies that current evaluation strategies are no longer appropriate, as mHealth interventions can be rapidly developed and implemented [35]. While we agree that there need to be alternatives to evaluate the scientific evidence of commercially available apps, we are cautious given that there are very limited tools available for the evaluation of commercial apps, such the Mobile App Rating Scale [36] or the Silberg Scale [37]. We have in this research adopted a framework for such an evaluation, in that we attempted to search for commercial apps in the published literature and to search for any academic references in the app description and within the app itself. We also contacted the developers for further clarification. Our findings also suggest that there is a potential disconnect between academics and app developers. Our findings suggest that most commercial apps were developed independently by companies, based on the attributions of the references (as Multimedia Appendix 1 shows). While the developers of 2 of the apps (ChimpShop and AntiAnxiety) reported some form of collaboration with an academic or academic institution, we found only a trial involving ChimpShop in this review. Clinicians and other health care professionals are rarely involved in app development due to several factors, including the lack of time and technical skills [38]. Even if clinicians or other health care professionals are involved, their role is limited to ensuring that a workflow is appropriate. Taking these factors into consideration, Zhang et al [39] previously recommended strategies that health care professionals can use in the development of cost-effective apps. The involvement of health care professionals and academic centers in the conceptualization of apps is advantageous, given that evidence-based methods can be incorporated into the planned app. Involving health care professionals is one method to help bridge the academic commercial divide. Another method would be to involve not only health care professionals, but also service users or patients themselves in the joint design and conceptualization of evidence-based apps. There has been more recent research recognizing the importance of such a codesign approach [40,41].

    Strengths and Limitations

    One of the major strengths of our study is that we identified both scientifically validated mobile attention bias modification interventions and commercially available attention bias modification apps. However, our study had several limitations. We do acknowledge that, while we searched comprehensively across several databases, we did not search databases such as Google Scholar for relevant published works. However, we believe that the 4 databases that we searched would have covered all the published articles, and a search of Google Scholar would have yielded few additional articles. The identification of apps was confined to the Apple and Google app stores. While these are the 2 most widely used app stores, it is possible that different apps might be available in other stores, which we did not review. We acknowledge that we might have left out progressive Web apps from our search. We were unable to systematically search for progressive Web apps, as there was no webstore we could systematically search by keywords. Similarly, we searched only for English apps in our review. This might have excluded relevant apps on attention or cognitive biases that were not in English. We were not able to include apps in other languages, as we did not have the assistance of a translator in this study. Our search was confined to a total duration of a few weeks, which might have left out new apps, given how rapidly new apps are introduced into commercial app stores.

    Implications

    The most important clinical implication of this study is health care professionals’ need for caution when recommending cognitive bias modification apps to their patients. Moreover, as mentioned above, some of these apps presented users with self-assessment questionnaires. Hence, there is a possibility for some individuals to self-diagnose and take the intervention. It is very important to emphasize in any app conceptualization that an assessment by a medical professional is still important. Our work highlights the need for researchers to carefully consider the method of delivery of an attention bias intervention through an app and how the app could compares with the conventional delivery of such an intervention in a laboratory setting, as in this study we found apps that used unconventional methods of bias modification.

    Conclusions

    Our review highlighted that, while evidence for the effectiveness of mHealth attention bias apps is mixed, a variety of commercial apps are available, with most appearing not to have been evaluated. It is important for future research to take into consideration the findings of this study, in the design, implementation, and evaluation of mHealth attention bias apps.

    Acknowledgments

    MZ is supported by a grant under the Singapore Ministry of Health’s National Medical Research Council (grant number NMRC/Fellowship/0048/2017) for PhD training. The funding source had no involvement in any part of this project.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Characteristics of attention bias in commercial apps.

    PDF File (Adobe PDF File), 43KB

    References

    1. Jones EB, Sharpe L. Cognitive bias modification: a review of meta-analyses. J Affect Disord 2017 Dec 01;223:175-183. [CrossRef] [Medline]
    2. Field M, Cox WM. Attentional bias in addictive behaviors: a review of its development, causes, and consequences. Drug Alcohol Depend 2008 Sep 01;97(1-2):1-20. [CrossRef] [Medline]
    3. Heeren A, Mogoașe C, Philippot P, McNally RJ. Attention bias modification for social anxiety: a systematic review and meta-analysis. Clin Psychol Rev 2015 Aug;40:76-90. [CrossRef] [Medline]
    4. Cox WM, Fadardi JS, Intriligator JM, Klinger E. Attentional bias modification for addictive behaviors: clinical implications. CNS Spectr 2014 Jun;19(3):215-224. [CrossRef] [Medline]
    5. Lopes FM, Pires AV, Bizarro L. Attentional bias modification in smokers trying to quit: a longitudinal study about the effects of number of sessions. J Subst Abuse Treat 2014 Jul;47(1):50-57. [CrossRef] [Medline]
    6. Leeman RF, Robinson CD, Waters AJ, Sofuoglu M. A critical review of the literature on attentional bias in cocaine use disorder and suggestions for future research. Exp Clin Psychopharmacol 2014 Dec;22(6):469-483 [FREE Full text] [CrossRef] [Medline]
    7. Stacy AW, Wiers RW. Implicit cognition and addiction: a tool for explaining paradoxical behavior. Annu Rev Clin Psychol 2010;6:551-575 [FREE Full text] [CrossRef] [Medline]
    8. Cisler JM, Koster EHW. Mechanisms of attentional biases towards threat in anxiety disorders: an integrative review. Clin Psychol Rev 2010 Mar;30(2):203-216 [FREE Full text] [CrossRef] [Medline]
    9. de Voogd EL, de Hullu E, Burnett HS, Blackwell SE, Wiers RW, Salemink E. Imagine the bright side of life: a randomized controlled trial of two types of interpretation bias modification procedure targeting adolescent anxiety and depression. PLoS One 2017;12(7):e0181147 [FREE Full text] [CrossRef] [Medline]
    10. De Voogd EL, Wiers RW, Salemink E. Online visual search attentional bias modification for adolescents with heightened anxiety and depressive symptoms: a randomized controlled trial. Behav Res Ther 2017 Dec;92:57-67 [FREE Full text] [CrossRef] [Medline]
    11. Cristea IA, Kok RN, Cuijpers P. The effectiveness of cognitive bias modification interventions for substance addictions: a meta-analysis. PLoS One 2016;11(9):e0162226 [FREE Full text] [CrossRef] [Medline]
    12. Zhang MWB, Ho RCM. Enabling psychiatrists to explore the full potential of e-health. Front Psychiatry 2015;6:177 [FREE Full text] [CrossRef] [Medline]
    13. Van Ameringen M, Turna J, Khalesi Z, Pullia K, Patterson B. There is an app for that! The current state of mobile applications (apps) for DSM-5 obsessive-compulsive disorder, posttraumatic stress disorder, anxiety and mood disorders. Depress Anxiety 2017 Jun;34(6):526-539. [CrossRef] [Medline]
    14. Meredith SE, Alessi SM, Petry NM. Smartphone applications to reduce alcohol consumption and help patients with alcohol use disorder: a state-of-the-art review. Adv Health Care Technol 2015;1:47-54 [FREE Full text] [CrossRef] [Medline]
    15. Wittekind CE, Feist A, Schneider BC, Moritz S, Fritzsche A. The approach-avoidance task as an online intervention in cigarette smoking: a pilot study. J Behav Ther Exp Psychiatry 2015 Mar;46:115-120. [CrossRef] [Medline]
    16. Sportel BE, de Hullu E, de Jong PJ, Nauta MH. Cognitive bias modification versus CBT in reducing adolescent social anxiety: a randomized controlled trial. PLoS One 2013;8(5):e64355 [FREE Full text] [CrossRef] [Medline]
    17. Clarke PJF, Bedford K, Notebaert L, Bucks RS, Rudaizky D, Milkins BC, et al. Assessing the therapeutic potential of targeted attentional bias modification for insomnia using smartphone delivery. Psychother Psychosom 2016;85(3):187-189. [CrossRef] [Medline]
    18. Saborido R, Khomh F, Antoniol G, Gueheneuc YG. Comprehension of ads-supported and paid Android applications: are they different? 2017 Presented at: 25th International Conference on Program Comprehension; May 20-16, 2017; Buenos Aires, Argentina p. 143-153. [CrossRef]
    19. Yang R, Cui L, Li F, Xiao J, Zhang Q, Oei TPS. Effects of cognitive bias modification training via smartphones. Front Psychol 2017;8:1370 [FREE Full text] [CrossRef] [Medline]
    20. Dennis TA, O'Toole L. Mental health on the go: effects of a gamified attention bias modification mobile application in trait anxious adults. Clin Psychol Sci 2014 Sep 01;2(5):576-590 [FREE Full text] [CrossRef] [Medline]
    21. Dennis-Tiwary TA, Egan LJ, Babkirk S, Denefrio S. For whom the bell tolls: neurocognitive individual differences in the acute stress-reduction effects of an attention bias modification game for anxiety. Behav Res Ther 2016 Feb;77:105-117 [FREE Full text] [CrossRef] [Medline]
    22. Kerst WF, Waters AJ. Attentional retraining administered in the field reduces smokers' attentional bias and craving. Health Psychol 2014 Oct;33(10):1232-1240. [CrossRef] [Medline]
    23. Dennis-Tiwary TA, Denefrio S, Gelber S. Salutary effects of an attention bias modification mobile application on biobehavioral measures of stress and anxiety during pregnancy. Biol Psychol 2017 Jul;127:148-156. [CrossRef] [Medline]
    24. Cox M, Intrilligator J, Hillier C. Chimpshop and alcohol reduction - using technology to change behaviour. Perspect Public Health 2015 May;135(3):126-127. [CrossRef] [Medline]
    25. Robinson CD, Muench C, Brede E, Endrighi R, Szeto EH, Sells JR, et al. Effect of attentional retraining on cognition, craving, and smoking in African American smokers. Psychol Addict Behav 2017 Aug;31(5):636-646. [CrossRef] [Medline]
    26. Hoppitt L, Illingworth JL, MacLeod C, Hampshire A, Dunn BD, Mackintosh B. Modifying social anxiety related to a real-life stressor using online cognitive bias modification for interpretation. Behav Res Ther 2014 Jan;52:45-52 [FREE Full text] [CrossRef] [Medline]
    27. Wiers RW, Houben K, Fadardi JS, van Beek P, Rhemtulla M, Cox WM. Alcohol cognitive bias modification training for problem drinkers over the web. Addict Behav 2015 Jan;40:21-26. [CrossRef] [Medline]
    28. Pictet A, Jermann F, Ceschi G. When less could be more: investigating the effects of a brief internet-based imagery cognitive bias modification intervention in depression. Behav Res Ther 2016 Dec;84:45-51. [CrossRef] [Medline]
    29. Elfeddali I, de Vries H, Bolman C, Pronk T, Wiers RW. A randomized controlled trial of web-based attentional bias modification to help smokers quit. Health Psychol 2016 Dec;35(8):870-880. [CrossRef] [Medline]
    30. Andersson G, Westöö J, Johansson L, Carlbring P. Cognitive bias via the internet: a comparison of web-based and standard emotional Stroop tasks in social phobia. Cogn Behav Ther 2006;35(1):55-62. [CrossRef] [Medline]
    31. Carlbring P, Apelstrand M, Sehlin H, Amir N, Rousseau A, Hofmann SG, et al. Internet-delivered attention bias modification training in individuals with social anxiety disorder--a double blind randomized controlled trial. BMC Psychiatry 2012 Jun 25;12:66 [FREE Full text] [CrossRef] [Medline]
    32. Boettcher J, Hasselrot J, Sund E, Andersson G, Carlbring P. Combining attention training with internet-based cognitive-behavioural self-help for social anxiety: a randomised controlled trial. Cogn Behav Ther 2014;43(1):34-48 [FREE Full text] [CrossRef] [Medline]
    33. Carleton RN, Teale SMJN, Oriet C, LeBouthillier DM. Online attention modification for social anxiety disorder: replication of a randomized controlled trial. Cogn Behav Ther 2017 Jan;46(1):44-59. [CrossRef] [Medline]
    34. de Hullu E, Sportel BE, Nauta MH, de Jong PJ. Cognitive bias modification and CBT as early interventions for adolescent social and test anxiety: two-year follow-up of a randomized controlled trial. J Behav Ther Exp Psychiatry 2017 Jun;55:81-89 [FREE Full text] [CrossRef] [Medline]
    35. Haskins BL, Lesperance D, Gibbons P, Boudreaux ED. A systematic review of smartphone applications for smoking cessation. Transl Behav Med 2017 Jun;7(2):292-299 [FREE Full text] [CrossRef] [Medline]
    36. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015;3(1):e27 [FREE Full text] [CrossRef] [Medline]
    37. Zhang MW, Ho RC, Loh A, Wing T, Wynne O, Chan SWC, et al. Current status of postnatal depression smartphone applications available on application stores: an information quality analysis. BMJ Open 2017 Nov 14;7(11):e015655 [FREE Full text] [CrossRef] [Medline]
    38. Subhi Y, Todsen T, Ringsted C, Konge L. Designing web-apps for smartphones can be easy as making slideshow presentations. BMC Res Notes 2014;7:94 [FREE Full text] [CrossRef] [Medline]
    39. Zhang M, Cheow E, Ho CS, Ng BY, Ho R, Cheok CCS. Application of low-cost methodologies for mobile phone app development. JMIR Mhealth Uhealth 2014;2(4):e55 [FREE Full text] [CrossRef] [Medline]
    40. Lundin M, Mäkitalo A. Co-designing technologies in the context of hypertension care: negotiating participation and technology use in design meetings. Inform Health Soc Care 2017 Jan;42(1):18-31. [CrossRef] [Medline]
    41. Oliver JA, Hallyburton MB, Pacek LR, Mitchell JT, Vilardaga R, Fuemmeler BF, et al. What do smokers want in a smartphone-based cessation application? Nicotine Tob Res 2017 Aug 03 (forthcoming). [CrossRef] [Medline]

    Edited by G Eysenbach; submitted 04.02.18; peer-reviewed by D Leightley, C Robinson, R Leeman; comments to author 13.04.18; revised version received 19.04.18; accepted 10.05.18; published 24.05.18

    ©Melvyn Zhang, JiangBo Ying, Guo Song, Daniel SS Fung, Helen Smith. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 24.05.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.