Background: Advances in technology engender the investigation of technological solutions to opioid use disorder (OUD). However, in comparison to chronic disease management, the application of mobile health (mHealth) to OUD has been limited.
Objective: The overarching aim of our research was to design OUD management technologies that utilize wearable sensors to provide continuous monitoring capabilities. The objectives of this study were to (1) document the currently available opioid-related mHealth apps, (2) review past and existing technology solutions that address OUD, and (3) discuss opportunities for technological withdrawal management solutions.
Methods: We used a two-phase parallel search approach: (1) an app search to determine the availability of opioid-related mHealth apps and (2) a scoping review of relevant literature to identify relevant technologies and mHealth apps used to address OUD.
Results: The app search revealed a steady rise in app development, with most apps being clinician-facing. Most of the apps were designed to aid in opioid dose conversion. Despite the availability of these apps, the scoping review found no study that investigated the efficacy of mHealth apps to address OUD.
Conclusions: Our findings highlight a general gap in technological solutions of OUD management and the potential for mHealth apps and wearable sensors to address OUD.
On average, 5 people in the United States die every hour from an opioid overdose . In 2017 alone, over 70,000 deaths occurred due to drug overdose [ ]. This problematic pattern of opioid use often referred to as opioid use disorder (OUD), is considered a public health emergency [ , ] with significant negative impacts on health care [ , ] and criminal justice costs [ ]. Misuse of opioids can occur among patients who are initially exposed to opioids in the perioperative period—periods immediately before, during, and after a surgical operation—or through a prescription for the treatment of acute or chronic pain [ ]. In addition, opioids attract illegal users and individuals who profit by selling them unlawfully [ ]. Such illegitimate use of prescription opioids has exacerbated the increase in OUDs [ - ].
Treatment exists for OUD, comprising pharmacotherapy and behavioral therapies [, ]. Opioid-dependent users may experience challenging and often severe withdrawal symptoms, including restlessness, muscle aches, and depression, when they abruptly discontinue or reduce opioid intake [ ]. Irrespective of the OUD treatment path, opioid withdrawal management, which includes regularly monitoring patients for symptoms, is the crucial first step after opioid use cessation or dose reduction [ ]. A review of opioid withdrawal monitoring methods [ ] revealed that the current method of assessing opioid withdrawal using various scales (tools to monitor and rate common signs and symptoms of withdrawal) is self-reported, requires frequent observations, may suffer from recall bias (a study by Infante-Rivard and Jacques [ ] gives more details)—unintentional or intentional underreporting of information by respondents—and is ineffective outside of clinic or research environments. Moreover, opioid withdrawal scales differ with regard to the number of scale items and rating criteria. Although technologies such as electronic prescription systems for controlled substances [ ], medication history repositories, exchange of clinical records, and clinical direct messaging [ ] have been proposed as useful methods to address opioid management, an opioid monitoring method that noninvasively and continuously monitors patients’ symptoms as they occur in real time would provide several distinct advantages over the existing methods [ ].
Advancements in technology have allowed the continuous monitoring of diseases outside of clinical settings. Mobile health (mHealth), one such advancement, involves the use of mobile devices to collect health data, monitor signs and symptoms, deliver remote care, and/or educate patients . mHealth interventions allow medical content to be delivered anytime and anywhere to patients [ ]. mHealth apps have been used to manage chronic diseases, including monitoring and managing day-to-day symptoms of sickle cell disease [ , ]; monitoring patients undergoing cardiac rehabilitation [ ]; monitoring blood pressure measurements to control hypertension [ ]; monitoring blood glucose, blood pressure, and physical activity to prevent metabolic syndrome [ ]; and monitoring patients with chronic obstructive pulmonary disease [ ] (a study by Hamine et al [ ] gives a systematic review of mHealth apps for chronic disease management). However, in comparison to chronic disease management, the application of mHealth to OUD has been limited. Digital health technologies, including mHealth apps, have the potential to play a unique role in tackling OUD. These include enabling care providers to create digital profiles of patients to provide personalized care regardless of time and place, monitoring patients’ vital trends and issuing alerts to them or their caregivers, and providing insights into what triggers patients’ behaviors.
Inspired by this gap, the overarching aim of our research was to design OUD management technologies that utilize wearable sensors to provide continuous monitoring capabilities. In particular, this research addresses the missed opportunity in monitoring withdrawal symptoms, given their acute nature, salient physiological correlates, and their importance to long-term sobriety. As the first step in investigating novel technological solutions for remote monitoring and management of OUD and, in particular, withdrawal symptoms, we investigated the availability and evidence to support the efficacy of current mHealth and wearable sensor solutions for OUD. The objectives of this paper were to (1) document the currently available opioid-related mHealth apps, (2) review the past and existing technology solutions that address OUD, and (3) to discuss opportunities for technological withdrawal management solutions. To the best of our knowledge, no such review or landscape analysis of technologies that address OUD has been conducted to date.
A two-phase parallel search approach was used, which involved an app search to determine the availability of opioid-related mHealth apps, and a scoping review of relevant literature was undertaken to identify relevant technologies and mHealth apps used to address OUD. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews guidelines were used .
Mobile Health App Search Method
A search was conducted on the Apple App Store and Google Play for apps published until May 10, 2019, using a combination of search terms that included “opioid”, “opiate”, “substance use disorder”, “technology”, OR “addiction”. The inclusion criteria were as follows: relevance to opioid, opioid prescription, opioid training, opioid monitoring, opioid overdose, opioid addiction support, or substance use disorder (SUD), including opioids. Apps that used a non-English language, apps that solely addressed SUD but not specific to opioids, and apps that required a web browser to use were excluded.
Overall, 2 reviewers independently applied the inclusion and exclusion criteria and identified the final set of apps for review. For each app, the reviewers independently extracted the following: app name, app description, year published, publisher or seller, download estimate, rating, and price. The reviewers transferred the extracted data to a detailed Excel spreadsheet. Then, the reviewers coded the apps for the operating system, that is, Android operating system (henceforth Android) and iPhone operating system (henceforth iOS); clinical focus (opioid-specific or SUD including opioid); audience (patients, clinicians, or anyone); and function (medication-assisted treatment, education, prescription, professional support, peer support, withdrawal support, and patient monitoring;). Each app was assigned to one primary audience and clinical focus; however, each app could be categorized under more than one app function. Disagreements regarding exclusion/inclusion and coding of the apps were discussed with a third reviewer, and agreement was reached through discussion.
Scoping Review Method
PubMed, Excerpta Medica Database (EMBASE), and Google Scholar were searched for articles published from their inception until May 10, 2019, using a combination of search terms: (“wearable” OR “sensors” OR “technology” OR “mHealth” OR “app” OR “mobile”) AND (“opioid use disorder” OR “opioid” OR “opiate”). Studies were included if they (1) were in English, (2) were peer reviewed, and (3) employed wearable sensors and/or mHealth. Animal studies and studies that did not include opioids were excluded.
The selection of articles was conducted in 2 stages. In the first stage, 2 reviewers independently reviewed titles and abstracts against the inclusion and exclusion criteria using a web-based tool for systematic and scoping reviews called Rayyan . The decision to fully review an article was made when both reviewers agreed to include the abstract. The reviewers resolved disagreements regarding article eligibility by discussing with a third reviewer. In the second stage, full-text articles were reviewed to determine eligibility. Furthermore, backward and forward reference searches were conducted on all full-text articles that met the study selection criteria. shows the process of searching and selecting articles included in the review. Secondary searching yielded no unique results.
|Code and category||Description|
|Patient-facing||App supports patient interactions and engagement|
|Clinician-facing||App assists physician decision making|
|Anyone||App that is designed for general public, including patients and caregivers|
|Opioid-specific||App related to only opioids|
|Substance use disorder||App related to substances, including opioids|
|Medication-assisted treatment||App supports medication-assisted treatment of opioid use disorder|
|Education||App provides educational information|
|Conversion||App helps generate equivalent doses of various oral and intravenous opioids|
|Professional support||App provides connections to outside professional support, eg, sends a message through the app to seek immediate emergency assistance, finds services and resources that are available nearby|
|Peer support||App provides connections to peer support, including individuals undergoing rehabilitation|
|Withdrawal support||App supports patients as they go through withdrawal with, eg, reminders, supportive messages, symptom library|
|Patient monitoring||App prompts patients to self-evaluate and submit regular personal assessments directly for the purpose of tracking progress and patterns of behavior|
Furthermore, 2 reviewers independently read the full text of each article identified for inclusion in the review to extract pertinent data using a data extraction form. From each article, the reviewers independently extracted the following: technologies used, physiological parameters, functions, research methods employed, and study findings. The reviewers transferred the extracted data to a detailed Excel spreadsheet. The technologies used were further organized into ecological momentary assessment (EMA), GPS information, wearable sensors, machine learning, and biomedical devices.
Mobile Health App Search Results
The search yielded a total of 72 apps. Of the 72 apps, 62 apps (86%) were available for download at no cost. The remaining 10 (10/72, 12%), all clinician-facing apps, had prices ranging from US $0.99 to US $9.99.shows the number of apps that were made available from January 2009 to May 10, 2019, for both operating systems. shows the apps categorized by the audience and the operating system. Clinician-facing apps were most frequently available (31/72, 43%), followed by apps that could be used by patients, caregivers, or the general public (23/72, 32%). As shown in , most of the available apps were opioid-specific (62/72, 86%).
|Operating system||Apps categorized by audience, n (%)||Total apps, n|
|Android only||3 (23)||8 (61)||2 (15)||13|
|iOSa only||1 (5)||14 (82)||2 (11)||17|
|Both Android and iOS||14 (33)||9 (21)||19 (45)||42|
|Total||18 (25)||31 (43)||23 (32)||72|
aiOS: iPhone operating system.
|Operating system||Apps categorized by clinical focus, n (%)||Total apps, n|
|Opioid-specific||Substance use disorder|
|Android only||11 (84)||2 (15)||13|
|iOSa only||15 (88)||2 (11)||17|
|Both Android and iOS||36 (85)||6 (14)||42|
|Total||62 (86)||10 (13)||72|
aiOS: iPhone operating system.
Furthermore, apps were analyzed for utilities (). Although most apps provided opioid conversion support (25/72,35%) or educational content (21/72, 29%), only 2 opioid-specific apps (2/62, 3%), namely, FlexDek for medication-assisted treatment (MAT) and MATx by Substance Abuse and Mental Health Services Administration (SAMHSA), were designed to support medication-assisted treatment and 4 apps (4/72, 5%) provided support for patient monitoring.
Most apps (25/72, 35%), all clinician-facing and opioid-specific, were developed to convert from one opioid to another. These were also the most downloaded apps (). For example, Opioid Converter ( ), the app with the highest number of downloads, is a free app supported by Emory University and is designed to aid with opioid dose conversions. The app has a slider that allows for adjustments to be made for incomplete cross-tolerance. The opioids covered include buprenorphine, butorphanol, codeine, fentanyl, hydrocodone, morphine, and oxycodone.
|Clinical focus||App categorized as per their functionality, n (%)|
|Medication-assisted treatment||Education||Converter||Professional support||Peer support||Withdrawal support||Patient monitoring||Other|
|Opioid-specific (n=62)||2 (3)||16 (25)||25 (40)||8 (12)||4 (6)||2 (3)||4 (6)||1 (1)|
|Substance use disorder (n=10)||1 (10)||5 (50)||0 (0)||1 (10)||2 (20)||0 (0)||0 (0)||1 (10)|
|Total (n=72)||3 (4)||21 (29)||25 (35)||9 (12)||6 (8)||2 (2)||4 (5)||2 (2)|
|App name||Year published||Rating (out of 5)||Reviews, n||Estimated downloads, n|
|CDCa Opioid Guideline||2016||2.8||17||10,000+|
|FEND by Preventum||2018||4.2||32||5000+|
aCDC: Centers for Disease Control and Prevention.
Overall, 9 of the 72 apps (9/72, 12%) were designed to provide professional support, including connecting users with a network of service providers and finding naloxone carriers in an overdose emergency. Furthermore, 6 of the 72 apps (6/72, 8%) were designed to provide peer support in the form of reminders, supportive messages, and symptom library. In addition, 4 out of 72 apps (4/72, 6%) were designed to provide patient monitoring by prompting patients to self-evaluate and submit regular personal assessments directly for the purpose of tracking progress and patterns of behavior. Overall 2 out of 72 apps (2/72, 3%) were categorized as other. One of these apps, Diagnosis, Intractability, Risk, and Efficacy (DIRE), is designed for clinicians to use DIRE as a tool  in their decision-making process when considering prescribing opioids. The DIRE tool allows clinicians to rate 7 factors (diagnosis, intractability, psychological risk, chemical health risk, reliability risk, social support risk, and efficacy) on a scale of 1 to 3, with 1 being the least favorable case for prescribing opioids and 3 being the most favorable case for prescribing opioids. The total score (ie, the sum of the ratings) is used to determine a patient’s suitability for opioid maintenance analgesia. The other app is THRIVEE, a virtual platform system designed to help patients overcome addiction. THRIVEE delivers virtual MAT to addicts, including opioid users. It utilizes virtual telemedicine sessions such as video conferencing between patients and providers to leverage proven clinical practices.
The total number of downloads was used as a measure of app prevalence. Although the download statistics were not available for iOS apps, the statistics for Android apps varied from as low as 5+ downloads to as high as 50,000+ downloads (). shows the 6 most downloaded Android apps and their respective ratings.
Focused Review Results
Our initial search yielded 6459 articles. These were exported to the Zotero reference management software, where 842 duplicates were removed. Title and abstract screening resulted in the exclusion of 5593 articles. The remaining 24 articles were fully reviewed. Of these 24 articles, 18 met the inclusion criteria and were included in the final review.
Our search yielded 18 papers that documented relevant technologies used to address OUD. Of the 18 studies, 9 (50%) were laboratory-based studies, 8 (44%) were field studies, and 1 (6%) was a clinical trial. We did not find studies that employed mHealth apps to address OUD.presents a summary of the technologies identified in the scoping review.
|Epstein et al ||PDAa (Palm Zire, PZ21) and diary software||N/Ab||Monitoring||5 random prompts per day (5 weeks) and 2 random prompts per day (20 weeks)|
|Boyer et al ||Smartphones, wearable sensors, and machine learning||EDAc, acceleration, skin temperature, and heart rate||Real-time detection of drug craving and interventions||Self-annotation of physiological changes and machine learning|
|Epstein and Preston ||PDA (Palm Zire, Palm Zire 21) and diary software||N/A||Momentary ratings of stress in outpatients at work||5 random prompts per day (5 weeks) and 2 random prompts per day (20 weeks)|
|Kennedy et al ||PDA (Palm Zire, PZ21) and diary software||N/A||Gender-based treatment strategies||Random prompts (2-5 per day) for location, activities, and companions|
|Epstein et al ||PDA (PalmPilot) and GPS (BT-Q1000X)||N/A||Real-time monitoring of mood, stress, and drug craving||Time-stamped GPS data and EMAd ratings of mood, stress, and drug craving|
|Kennedy et al ||Biosensor (AutoSense) and smartphone||Heart rate||Continuous monitoring of heart rate||Wireless heart rate sensor data and self-reports|
|Carreiro et al ||Biosensor (Q sensor)||EDA, skin temperature, and acceleration||Real-time detection of drug use||Continuous monitoring of EDA, skin temperature, and acceleration|
|Linas et al ||PharmChek drugs of abuse patches, Palm Z22, and smartphone||Sweat patches detect traces of cocaine or heroin secreted in sweat during the period they are worn||Agreement of EMA methods with other methods (ie, biological and ACASIe) of assessing drug use||Palm Z22 PDA (3 trials) and Motorola Droid X2 phone (1 trial), self-reports of heroin or cocaine, sweat patches (weekly), and ACASI (weekly)|
|Mennis et al ||Smartphone and GPS||N/A||Integration of GPS information with EMA to study neighborhood effects on opioid use disorder||Combined GPS information with EMA to find association among neighborhood disadvantage, perceived stress, perceived safety, and substance use; generalized estimated equations for analysis|
|Sarker et al ||Biosensor, smartphone, GPS, and machine learning||ECGf and inspiratory to expiratory ratio||Time series health data to determine the timing of interventions and links to prevent drug craving and relapse||Smartphone initiated–32-item EMA (random); modeling R-R intervals and heart rate variability from ECG data|
|Carreiro et al ||Biosensor (Q sensor)||EDA, skin temperature, and acceleration||Biosensors may be used in drug addiction treatment and pain management||Hilbert transform analyses combined with paired t tests to compare biosensor data|
|Wang et al ||Biosensor (Q sensor), urine drug screens, and patient self-report of substance use||EDA, skin temperature, and acceleration||Detect and set up thresholds of parameters in real-time drug use event detection for wearable biosensor data streams||Sliding window technique to process data stream and distance-based outlier algorithm to detect substance use events|
|Chintha et al ||Biosensor (Empatica E4)||Skin temperature, acceleration, and heart rate||Identify physiologic change that marks wearing off of naloxone effect||90-min postnaloxone time point evaluated with Hilbert transform|
|Kowalczyk et al ||PalmOne Zire 21, Palm Tungsten E2, or HTC TyTN II smartphone||N/A||Investigate the relationship between opioid use and craving and affect||Mobile devices used to rate craving 4 times randomly each day|
|Mahmud et al ||Biosensor (Q sensor) and machine learning||EDA and skin temperature||Automatic detection of opioid intake and classification of pre- and postopioid health conditions||Time and frequency domain feature analysis; decision tree, k-nearest neighbors, and extreme gradient boosting classifiers|
|Moran et al ||Smartphone||N/A||Gender differences in the influence of stress on opioid use and craving||Entry was initiated, and causes, context, stress, and craving severity were rated each time the participant felt more stressed than usual|
|Preston et al ||Smartphone||N/A||Relationship between daily hassles and stressful events in opioid-dependent men and women||Randomly prompted entries, self-initiated reports of drug use, self-initiated reports of stressful events, and end-of-day entries|
|Miranda and Taca ||BRIDGE—an auricular neurostimulation device||Not reported||Treat opioid withdrawal symptoms without the use of antiopioids||Patients wore device behind the ear to stimulate nerves in brain and spinal cord|
aPDA: personal digital assistant.
bN/A: not applicable.
cEDA: electrodermal activity.
dEMA: ecological momentary assessment.
eACASI: audio computer-assisted self-interviewing.
Ecological Momentary Assessment
Overall, 6 studies (6/18, 33%), all field-based, employed EMA, a method that uses electronic diaries and/or questionnaires deployed on mobile devices  to monitor, in near real time, the craving for and use of opioids by outpatients receiving methadone treatment [ ]; assess stress in outpatients at work [ ]; investigate gender-based treatment strategies [ ]; study the relationship between opioid use and craving and affect [ ]; investigate gender differences in the influence of stress on opioid use and craving [ ]; and examine the relationship between daily hassles and stressful events in opioid-dependent men and women [ ]. Epstein and Preston [ ] found opioid-dependent outpatients to be less stressed at the workplace than elsewhere, demonstrating the utility of EMA to rate stress in outpatients. Kennedy et al [ ] found that males and females with SUD differ in their daily functioning during addiction treatment, highlighting the need to develop gender-based treatment strategies. Similarly, Moran et al [ ] found that stress-induced craving differs between opioid-dependent men and women, suggesting that gender-based tailoring of treatment should consider individual differences. Kowalczyk et al [ ] found that cravings increased when the participants were using opioids, indicating the utility of EMA to investigate the relationship between opioid use and craving. Overall, EMA has shown promise in enabling the measurement of momentary experiences and states of cravings and misuse in natural settings.
Overall, 2 studies (2/18, 11%), both field-based, combined EMA with GPS location information to monitor the real-time mood, stress, and drug craving in a geographical context  and to study neighborhood effects on substance use [ ]. EMA provided the participants’ momentary experience, whereas GPS provided the participants’ location during those experiences. Epstein et al [ ] found a negative association among environmental disorders (defined as a lack of order and social control within the neighborhood) [ ] and mood, stress, and drug craving, suggesting that mood, stress, and drug craving can be monitored in real time in a geographical context. Mennis et al [ ] found a significant positive association among neighborhood disadvantage, higher perceived stress, lower perceived safety, and greater substance use, suggesting that GPS information can be combined with EMA to study neighborhood effects on substance use.
The advances in wearable technologies have enhanced the ability of researchers to monitor physiological changes associated with opioid intake and/or drug craving. Overall, 8 out of the 18 studies (8/18, 44%) employed wearable sensors. Of these 8 studies, 3 (37%) studies [, , ] combined EMA and wearable sensors to detect drug cravings [ , ], deliver personalized prevention interventions [ ], and determine stress episodes among opioid users [ ]. Kennedy et al [ ] reported higher heart rates when participants reported craving compared with when they reported no craving, suggesting the potential efficacy of using heart rate data for continuous monitoring of craving. The iHeal system [ ]—a system architecture intended to provide personalized interventions—combines EMA, wearable sensors, and a deep belief network model to detect drug cravings and deliver personalized drug prevention interventions. However, this study did not implement their iHeal system.
The remaining 5 (5/8, 63%) studies [, , , , ] used wearable biosensors for real-time detection of opioid use [ , ] to detect physiological changes associated with opioid use [ ], evaluate physiological changes associated with the wearing off of naloxone [ ], and automatically detect opioid intake [ ]. Studies using Q sensors, worn on the participants’ wrists, have found that an increase in electrodermal activity (EDA) is associated with opioid use [ ], accurately detected substance use events within 30 min [ ] and significant within-subjects increase in skin temperature and decrease in locomotion immediately after opioid administration [ ]. Carreiro et al [ ] found that physiological changes varied among subjects with the levels of opioid use—heavy opioid users showed a greater decrease in fidgeting movements than nonheavy opioid users. Chintha et al [ ] used an E4 device (Empatica) worn on the participants’ wrists and found that heart rate and skin temperature differed significantly between before and after naloxone administration. Finally, Linas et al [ ] combined EMA and wearable sweat patches, PharmChek Drugs of Abuse Patches (PharmChem Inc), to concurrently collect momentary data and sweat in the field from 109 adults with recent opioid use and found moderate-to-good agreement of EMA to sweat patches and self-report methods in capturing drug use events.
Overall, 4 studies (4/18, 22%) used machine learning techniques to analyze and predict opioid use. Furthermore, 3 (3/18, 17%) of these studies [, , ] predicted opioid intake. The remaining study [ ] developed a model to provide personalized interventions. Sarker et al [ ] combined EMA; location information; the cStress model (reported on in a study by Hovsepian et al [ ]), which uses electrocardiogram (ECG) and respiration data; and the moving average convergence divergence method to predict stress episodes associated with opioid intake. Their model predicted stress episodes with an accuracy of 94.8% and kappa of 0.444. Wang et al [ ] used a sliding window technique to process streams of EDA, skin temperature, and acceleration data collected from a wrist-worn Q sensor and a distance-based outlier algorithm to detect substance use events. Their model accurately detected substance use events within 30 min. Using 2 parameters, movement in the z-axis and skin temperature collected from wrist-worn Q sensors, Mahmud et al [ ] compared the ability of 3 classifiers (decision tree, k-nearest neighbors, and extreme gradient boosting) to automatically detect opioid intake, obtaining an accuracy of 99.4% with extreme gradient boosting.
Miranda and Taca  investigated the effect of an auricular neurostimulation device, BRIDGE, in treating opioid withdrawal symptoms. The device was placed behind the ears of 73 opioid-dependent outpatients for a maximum of 5 days to treat opioid withdrawal symptoms by stimulating the nerves in the brain and spinal cord. A reduction in opioid withdrawal scores, measured with the clinical opioid withdrawal scale, was associated with the use of BRIDGE.
The goal of the app search in this study was to determine the availability of opioid-related mHealth apps. The search revealed the availability of 72 Android and iOS apps and revealed a steady rise in app development from January 2009 to May 10, 2019, with most apps designed to support clinicians. Our findings suggest that most of the apps have been developed to help clinicians convert from one opioid to another at an equianalgesic dose. Despite the availability of these apps, the scoping review found no study that investigated the efficacy of mHealth apps to address OUD.
Outcome Evaluation of Mobile Health App Search
Opioid conversion, a common but challenging clinical practice , is required when patients do not respond therapeutically, develop adverse effects to an opioid, or need an alternative route of administration [ ]. Prescription error has been identified as a significant risk factor for opioid-related deaths [ ]; therefore, opioid conversion apps that run on mobile devices may help improve patient safety [ ]. Although these apps are not geared toward OUD, they help primary care providers safely prescribe opioids.
The US Food and Drug Administration (FDA) has the mandate to regulate mHealth apps that meet certain statutory criteria as medical devices. Under the existing FDA regulatory framework, it is difficult to determine whether an mHealth app is a medical device . The FDA has long exempted apps considered as low-risk from its approval process [ ]. It is unclear how many opioid conversion apps identified in this study have been approved by the FDA. For example, although Pear reSET-O, a prescription app, was first published in 2016, it is only recently that the FDA cleared it as the first software-generated therapeutic intervention for patients with OUD [ ]. This app provides cognitive behavioral therapy to patients enrolled in an OUD treatment program.
Although most apps identified in this study are free to download, many health care providers and patients may not be aware of their availability. Future studies should investigate such awareness and adoption rates. The factors that influence the adoption of mHealth apps by health professionals include lack of clinical evidence , security [ ], and inability to integrate apps with other systems [ ]. The factors that influence patients’ adoption of mHealth apps include security and privacy concerns [ , ], social contacts [ ], and cost of smartphones and data plans [ , ]. Failure to balance system demands of apps with end user needs and resources undermines the adoption of mHealth apps [ ]. Conducting content analyses, usability testing, observational studies, and efficacy testing will contribute to the increased adoption of mHealth apps in clinical practice [ ].
Privacy of Mobile Health Apps
The privacy of mHealth apps, the right for users to know how their information is collected and used, is an issue worthy of discussion. In this study, most apps identified in the search were free to download. For users of these apps, there is a likelihood that their information is passed around to third parties, thereby exposing them to privacy risks . A recent study investigated data sharing practices in the mHealth ecosystem and found that 79% of the sampled apps shared user data with 55 entities, including third parties [ ]. This presents a major concern for mHealth users as they do not know how their data will be used and by whom. Furthermore, the aggressive medicolegal system in the United States deters many health care providers from using mHealth apps. Recent studies (eg, study by Hutton et al [ ]) have suggested the need for standards that can ensure mHealth app user privacy.
Outcome Evaluation of Focused Review
Despite the availability of opioid-related apps, this scoping review, which sought to document relevant technology solutions that address OUD, found no study that employed mHealth apps to address OUD. Most of the studies employed EMA to capture participants’ opioid use patterns as they occurred in real time. Few studies have combined EMA with a range of data types, including physiological changes and location information, to detect opioid intake. These findings highlight a general lack of empirical evidence to support the efficacy of mHealth apps for OUD management. However, our findings show the potential for wearable sensors, especially in opioid withdrawal management, to facilitate remote monitoring of the signs and symptoms of OUD.
Opioid withdrawal management, which includes regular monitoring of patients for symptoms, is the crucial first step after opioid use cessation or dose reduction . The relapse rates during inpatient treatment of opioid dependence indicate that as many as 91% of those in recovery experience an opiate relapse, 59% of whom relapse within the first week of sobriety, and 80% within a month after discharge from a detox program [ ]. The results from this scoping review revealed that most of the studies employed EMA or combined EMA with a range of data types to detect opioid usage patterns. These studies focused on opioid intake and usage patterns. Only one study [ ] focused on developing technology to help treat opioid withdrawal symptoms. Indeed, the BRIDGE device used in that study is the first of its kind approved by the FDA. It is crucial that technology solutions be provided not only to help health care professionals monitor and manage patients’ withdrawal symptoms but also to help the patients themselves as they go through withdrawal.
Gaps Identified in Outcome Evaluation of Technologies for Opioid Use Disorder Management
From the results of this study, it is evident that there is a gap in the technologies available to manage opioid withdrawal. Advances in wearable and machine learning technologies have enhanced the ability of researchers to monitor physiological changes associated with opioid intake and/or drug craving [, , ]. In the same vein, wearable sensors can be employed to detect temporal and spectral patterns of physiological responses associated with opioid withdrawal symptoms. For example, joint/muscle aches lead to elevated heart rate [ ], which can be measured with a wearable ECG; anxiety leads to elevated heart rate [ ] and change in skin conductance [ ], which can be measured using wearable ECG and EDA sensors, respectively; and cutis anserine, defined as goosebumps, leads to a change in skin conductance [ ], which can be measured with a wearable EDA sensor. Machine learning–based pattern detection algorithms may be used to explicitly detect and characterize specific features obtained from wearable sensor configurations and existing contextual information. This can provide real-time feedback to health care providers to facilitate interventions.
There are some limitations in the study that warrant discussion. First, the search may not be collectively exhaustive because of the limitations of the scoping review. The scoping review utilized relatively fewer, albeit relevant, number of search terms and databases to identify potentially eligible studies. Despite this limitation, we found saturation in the technologies used to address OUD, evidenced by the lack of additional results from the 19-article–based bibliographic secondary search. Second, the availability of information about app downloads was limited to Android apps only. However, the data presented in this study are relevant, given that Android has overtaken iOS as the number 1 operating system for mHealth apps . Third, although the app rating information is reported, it is difficult to determine how many of the ratings were legitimately written by people who used the apps. In addition, we were unable to determine how the apps were rated. Owing to this lack of information, this study did not include information on the quality of the apps. Furthermore, we did not focus on capturing the apps’ effectiveness. Given the proliferation of mHealth apps and technologies made available to target OUD, future studies should aim to investigate the quality and effectiveness of these apps on OUD management. Finally, developers may be reluctant to publish research on their apps for intellectual property reasons (if they have any); many of their results/algorithms may be considered proprietary.
This study showed the availability of opioid-relevant mHealth apps, most of which are opioid conversion apps. Despite the availability of these apps, the scoping review found no study that employed mHealth apps to address OUD. Most studies employed EMA to capture the participants’ opioid usage patterns as they occurred in real time. Few studies have combined EMA with a range of data types, including physiological changes and location information, to detect opioid intake. Our findings highlight the gap in technologies and the potential for using wearable sensors, especially in opioid withdrawal management, to address OUD.
This independent work was supported by the Texas A&M Triads for Transformation. The authors would like to thank Dr. Ethan Larsen for his assistance during the app review process.
RM and FS conceptualized the study, JN conducted and analyzed the reviews and drafted the initial manuscript, and RM and FS interpreted the review outcomes and refined the manuscript.
Conflicts of Interest
- Kosten TR, Baxter LE. Review article: effective management of opioid withdrawal symptoms: a gateway to opioid dependence treatment. Am J Addict 2019 Feb;28(2):55-62 [FREE Full text] [CrossRef] [Medline]
- Centers for Disease Control and Prevention. Drug Overdose Deaths URL: https://www.cdc.gov/drugoverdose/data/statedeaths.html [accessed 2019-02-01]
- Comer SD, Dworkin RH, Strain EC. Medical devices to prevent opioid use disorder: innovative approaches to addressing the opioid crisis. JAMA Psychiatry 2019 Apr 1;76(4):351-352. [CrossRef] [Medline]
- Florence CS, Zhou C, Luo F, Xu L. The economic burden of prescription opioid overdose, abuse, and dependence in the United States, 2013. Med Care 2016 Oct;54(10):901-906 [FREE Full text] [CrossRef] [Medline]
- McAdam-Marx C, Roland CL, Cleveland J, Oderda GM. Costs of opioid abuse and misuse determined from a medicaid database. J Pain Palliat Care Pharmacother 2010 Mar;24(1):5-18. [CrossRef] [Medline]
- Birnbaum HG, White AG, Schiller M, Waldman T, Cleveland JM, Roland CL. Societal costs of prescription opioid abuse, dependence, and misuse in the United States. Pain Med 2011 Apr;12(4):657-667. [CrossRef] [Medline]
- Soffin EM, Lee BH, Kumar KK, Wu CL. The prescription opioid crisis: role of the anaesthesiologist in reducing opioid use and misuse. Br J Anaesth 2019 Jun;122(6):e198-e208. [CrossRef] [Medline]
- Uhrig P. SureScripts. Changing the Course of the Opioid Epidemic: The Power and Promise of Proven Technology URL: https://surescripts.com/docs/default-source/intelligence-in-action/opioids/opioids-position-paper.pdf [accessed 2019-05-20]
- Adler JA, Mallick-Searle T. An overview of abuse-deterrent opioids and recommendations for practical patient care. J Multidiscip Healthc 2018;11:323-332 [FREE Full text] [CrossRef] [Medline]
- Dowell D, Haegerich TM, Chou R. CDC guideline for prescribing opioids for chronic pain-United States, 2016. J Am Med Assoc 2016 Apr 19;315(15):1624-1645 [FREE Full text] [CrossRef] [Medline]
- Paulozzi LJ, Kilbourne EM, Desai HA. Prescription drug monitoring programs and death rates from drug overdose. Pain Med 2011 May;12(5):747-754. [CrossRef] [Medline]
- Leshner AI, Dzau VJ. Medication-based treatment to address opioid use disorder. J Am Med Assoc 2019 Jun 4;321(21):2071-2072. [CrossRef] [Medline]
- Sofuoglu M, DeVito E, Carroll K. Pharmacological and behavioral treatment of opioid use disorder. Psychiatr Res Clin Pract 2019 Apr 5;1(1):4-15 [FREE Full text] [CrossRef]
- Schuckit M. Treatment of opioid-use disorders. N Engl J Med 2016 Jul 28;375(4):357-368. [CrossRef] [Medline]
- Nuamah JK, Sasangohar F, Erraguntla M, Mehta RK. The past, present and future of opioid withdrawal assessment: a scoping review of scales and technologies. BMC Med Inform Decis Mak 2019 Jun 18;19(1):113 [FREE Full text] [CrossRef] [Medline]
- Infante-Rivard C, Jacques L. Empirical study of parental recall bias. Am J Epidemiol 2000 Sep 1;152(5):480-486. [CrossRef] [Medline]
- Gabriel M, Smith J, Sow M, Joseph S, Wilkins T. Electronic prescribing of controlled substances: a tool to help promote better patient care. Am J Pharm Benefits 2016;8(5):185-189 [FREE Full text]
- Carreiro S, Wittbold K, Indic P, Fang H, Zhang J, Boyer EW. Wearable biosensors to detect physiologic change during opioid use. J Med Toxicol 2016 Sep;12(3):255-262 [FREE Full text] [CrossRef] [Medline]
- Schnall R, Rojas M, Bakken S, Brown W, Carballo-Dieguez A, Carry M, et al. A user-centered model for designing consumer mobile health (mhealth) applications (apps). J Biomed Inform 2016 Apr;60:243-251 [FREE Full text] [CrossRef] [Medline]
- Huffman JC, Adams CN, Celano CM. Collaborative care and related interventions in patients with heart disease: an update and new directions. Psychosomatics 2018;59(1):1-18 [FREE Full text] [CrossRef] [Medline]
- Jacob E, Duran J, Stinson J, Lewis MA, Zeltzer L. Remote monitoring of pain and symptoms using wireless technology in children and adolescents with sickle cell disease. J Am Assoc Nurse Pract 2013 Jan;25(1):42-54 [FREE Full text] [CrossRef] [Medline]
- Jonassaint CR, Shah N, Jonassaint J, de Castro L. Usability and feasibility of an mhealth intervention for monitoring and managing pain symptoms in sickle cell disease: the sickle cell disease mobile application to record symptoms via technology (SMART). Hemoglobin 2015;39(3):162-168. [CrossRef] [Medline]
- Frederix I, van Driessche N, Hansen D, Berger J, Bonne K, Alders T, et al. Increasing the medium-term clinical benefits of hospital-based cardiac rehabilitation by physical activity telemonitoring in coronary artery disease patients. Eur J Prev Cardiol 2015 Feb;22(2):150-158. [CrossRef] [Medline]
- McManus RJ, Mant J, Bray EP, Holder R, Jones MI, Greenfield S, et al. Telemonitoring and self-management in the control of hypertension (TASMINH2): a randomised controlled trial. Lancet 2010 Jul 17;376(9736):163-172. [CrossRef] [Medline]
- Stuckey M, Russell-Minda E, Read E, Munoz C, Shoemaker K, Kleinstiver P, et al. Diabetes and technology for increased activity (DaTA) study: results of a remote monitoring intervention for prevention of metabolic syndrome. J Diabetes Sci Technol 2011 Jul 1;5(4):928-935 [FREE Full text] [CrossRef] [Medline]
- Pedone C, Chiurco D, Scarlata S, Incalzi RA. Efficacy of multiparametric telemonitoring on respiratory outcomes in elderly people with COPD: a randomized controlled trial. BMC Health Serv Res 2013 Mar 6;13:82 [FREE Full text] [CrossRef] [Medline]
- Hamine S, Gerth-Guyette E, Faulx D, Green BB, Ginsburg AS. Impact of mhealth chronic disease management on treatment adherence and patient outcomes: a systematic review. J Med Internet Res 2015 Feb 24;17(2):e52 [FREE Full text] [CrossRef] [Medline]
- Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med 2018 Oct 2;169(7):467-473. [CrossRef] [Medline]
- Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev 2016 Dec 5;5(1):210 [FREE Full text] [CrossRef] [Medline]
- Belgrade MJ, Schamber CD, Lindgren BR. The DIRE score: predicting outcomes of opioid prescribing for chronic pain. J Pain 2006 Sep;7(9):671-681. [CrossRef] [Medline]
- Epstein DH, Willner-Reid J, Vahabzadeh M, Mezghanni M, Lin J, Preston KL. Real-time electronic diary reports of cue exposure and mood in the hours before cocaine and heroin craving and use. Arch Gen Psychiatry 2009 Jan;66(1):88-94 [FREE Full text] [CrossRef] [Medline]
- Boyer EW, Fletcher R, Fay RJ, Smelson D, Ziedonis D, Picard RW. Preliminary efforts directed toward the detection of craving of illicit substances: the iHeal project. J Med Toxicol 2012 Mar;8(1):5-9 [FREE Full text] [CrossRef] [Medline]
- Epstein DH, Preston KL. TGI Monday?: drug-dependent outpatients report lower stress and more happiness at work than elsewhere. Am J Addict 2012;21(3):189-198 [FREE Full text] [CrossRef] [Medline]
- Kennedy AP, Epstein DH, Phillips KA, Preston KL. Sex differences in cocaine/heroin users: drug-use triggers and craving in daily life. Drug Alcohol Depend 2013 Sep 1;132(1-2):29-37 [FREE Full text] [CrossRef] [Medline]
- Epstein DH, Tyburski M, Craig IM, Phillips KA, Jobes ML, Vahabzadeh M, et al. Real-time tracking of neighborhood surroundings and mood in urban drug misusers: application of a new method to study behavior in its geographical context. Drug Alcohol Depend 2014 Jan 1;134:22-29 [FREE Full text] [CrossRef] [Medline]
- Kennedy AP, Epstein DH, Jobes ML, Agage D, Tyburski M, Phillips KA, et al. Continuous in-the-field measurement of heart rate: correlates of drug use, craving, stress, and mood in polydrug users. Drug Alcohol Depend 2015 Jun 1;151:159-166 [FREE Full text] [CrossRef] [Medline]
- Carreiro S, Smelson D, Ranney M, Horvath KJ, Picard RW, Boudreaux ED, et al. Real-time mobile detection of drug use with wearable biosensors: a pilot study. J Med Toxicol 2015 Mar;11(1):73-79 [FREE Full text] [CrossRef] [Medline]
- Linas BS, Genz A, Westergaard RP, Chang LW, Bollinger RC, Latkin C, et al. Ecological momentary assessment of illicit drug use compared to biological and self-reported methods. JMIR Mhealth Uhealth 2016 Mar 15;4(1):e27 [FREE Full text] [CrossRef] [Medline]
- Mennis J, Mason M, Light J, Rusby J, Westling E, Way T, et al. Does substance use moderate the association of neighborhood disadvantage with perceived stress and safety in the activity spaces of urban youth? Drug Alcohol Depend 2016 Aug 1;165:288-292. [CrossRef] [Medline]
- Sarker H, Tyburski M, Rahman MM, Hovsepian K, Sharmin M, Epstein DH, et al. Finding significant stress episodes in a discontinuous time series of rapidly varying mobile sensor data. Proc SIGCHI Conf Hum Factor Comput Syst 2016 May;2016:4489-4501 [FREE Full text] [CrossRef] [Medline]
- Wang J, Fang H, Carreiro S, Wang H, Boyer E. A new mining method to detect real time substance use events from wearable biosensor data stream. Int Conf Comput Netw Commun 2017 Jan;2017:465-470 [FREE Full text] [CrossRef] [Medline]
- Chintha KK, Indic P, Chapman B, Boyer EW, Carreiro S. Wearable biosensors to evaluate recurrent opioid toxicity after naloxone administration: a Hilbert transform approach. Proc Annu Hawaii Int Conf Syst Sci 2018 Jan;2018:3247-3252 [FREE Full text] [Medline]
- Kowalczyk WJ, Moran LM, Bertz JW, Phillips KA, Ghitza UE, Vahabzadeh M, et al. Using ecological momentary assessment to examine the relationship between craving and affect with opioid use in a clinical trial of clonidine as an adjunct medication to buprenorphine treatment. Am J Drug Alcohol Abuse 2018;44(5):502-511 [FREE Full text] [CrossRef] [Medline]
- Mahmud M, Fang H, Wang H, Carreiro S, Boyer E. Automatic Detection of Opioid Intake Using Wearable Biosensor. In: Proceedings of the International Conference on Computing, Networking and Communications. 2018 Presented at: ICNC'18; March 5-8, 2018; Maui, HI, USA URL: https://doi.org/10.1109/ICCNC.2018.8390334 [CrossRef]
- Moran LM, Kowalczyk WJ, Phillips KA, Vahabzadeh M, Lin J, Mezghanni M, et al. Sex differences in daily life stress and craving in opioid-dependent patients. Am J Drug Alcohol Abuse 2018;44(5):512-523 [FREE Full text] [CrossRef] [Medline]
- Preston KL, Schroeder JR, Kowalczyk WJ, Phillips KA, Jobes ML, Dwyer M, et al. End-of-day reports of daily hassles and stress in men and women with opioid-use disorder: relationship to momentary reports of opioid and cocaine use and stress. Drug Alcohol Depend 2018 Dec 1;193:21-28 [FREE Full text] [CrossRef] [Medline]
- Miranda A, Taca A. Neuromodulation with percutaneous electrical nerve field stimulation is associated with reduction in signs and symptoms of opioid withdrawal: a multisite, retrospective assessment. Am J Drug Alcohol Abuse 2018;44(1):56-63. [CrossRef] [Medline]
- Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008;4:1-32. [CrossRef] [Medline]
- Milam AJ, Furr-Holden CD, Harrell PT, Whitaker DE, Leaf PJ. Neighborhood disorder and juvenile drug arrests: a preliminary investigation using the NIfETy instrument. Am J Drug Alcohol Abuse 2012 Nov;38(6):598-602 [FREE Full text] [CrossRef] [Medline]
- Hovsepian K, al'Absi M, Ertin E, Kamarck T, Nakajima M, Kumar S. cStress: towards a gold standard for continuous stress assessment in the mobile environment. Proc ACM Int Conf Ubiquitous Comput 2015 Sep;2015:493-504 [FREE Full text] [CrossRef] [Medline]
- Haffey F, Brady RR, Maxwell S. A comparison of the reliability of smartphone apps for opioid conversion. Drug Saf 2013 Feb;36(2):111-117. [CrossRef] [Medline]
- Quigley C. Opioid switching to improve pain relief and drug tolerability. Cochrane Database Syst Rev 2004(3):CD004847. [CrossRef] [Medline]
- Rich BA, Webster LR. A review of forensic implications of opioid prescribing with examples from malpractice cases involving opioid-related overdose. Pain Med 2011 Jun;12(Suppl 2):S59-S65. [CrossRef] [Medline]
- Plagge H, Ruppen W, Ott N, Fabbro T, Bornand D, Deuster S. Dose calculation in opioid rotation: electronic calculator vs manual calculation. Int J Clin Pharm 2011 Feb;33(1):25-32. [CrossRef] [Medline]
- Lee TT. Recommendations for regulating software-based medical treatments: learning from therapies for psychiatric conditions. Food Drug Law J 2018;73(1):66 [FREE Full text]
- US Food & Drug Administration. Device Software Functions Including Mobile Medical Applications URL: https://www.fda.gov/medicaldevices/digitalhealth/mobilemedicalapplications/default.htm [accessed 2019-06-06]
- Pear Therapeutics. Sandoz Inc And Pear Therapeutics Obtain FDA Clearance for Reset-O to Treat Opioid Use Disorder URL: https://peartherapeutics.com/sandoz-inc-and-pear-therapeutics-obtain-fda-clearance-for-reset-o-to-treat-opioid-use-disorder [accessed 2019-05-22]
- Byambasuren O, Sanders S, Beller E, Glasziou P. Prescribable mhealth apps identified from an overview of systematic reviews. NPJ Digit Med 2018;1:12 [FREE Full text] [CrossRef] [Medline]
- He D, Naveed M, Gunter CA, Nahrstedt K. Security concerns in Android mhealth apps. AMIA Annu Symp Proc 2014;2014:645-654 [FREE Full text] [Medline]
- Dehzad F, Hilhorst C, de Bie C, Claassen E. Adopting health apps, what’s hindering doctors and patients? Health 2014;6(16):2204-2217 [FREE Full text] [CrossRef]
- Atienza AA, Zarcadoolas C, Vaughon W, Hughes P, Patel V, Chou WS, et al. Consumer attitudes and perceptions on mhealth privacy and security: findings from a mixed-methods study. J Health Commun 2015;20(6):673-679. [CrossRef] [Medline]
- Zhou L, Bao J, Watzlaf V, Parmanto B. Barriers to and facilitators of the use of mobile health apps from a security perspective: mixed-methods study. JMIR Mhealth Uhealth 2019 Apr 16;7(4):e11223 [FREE Full text] [CrossRef] [Medline]
- Taylor DG, Voelker TA, Pentina I. Sacred Heart University Research. 2011. Mobile Application Adoption by Young Adults: A Social Network Perspective URL: https://digitalcommons.sacredheart.edu/cgi/viewcontent.cgi?referer=https://scholar.google.com/&httpsredir=1&article=1000&context=wcob_fac [accessed 2019-06-06]
- Rodriguez-Paras C, Tippey K, Brown E, Sasangohar F, Creech S, Kum H, et al. Posttraumatic stress disorder and mobile health: app investigation and scoping literature review. JMIR Mhealth Uhealth 2017 Oct 26;5(10):e156 [FREE Full text] [CrossRef] [Medline]
- Thies K, Anderson D, Cramer B. Lack of adoption of a mobile app to support patient self-management of diabetes and hypertension in a federally qualified health center: interview analysis of staff and patients in a failed randomized trial. JMIR Hum Factors 2017 Oct 3;4(4):e24 [FREE Full text] [CrossRef] [Medline]
- Jake-Schoffman DE, Silfee VJ, Waring ME, Boudreaux ED, Sadasivam RS, Mullen SP, et al. Methods for evaluating the content, usability, and efficacy of commercial mobile health apps. JMIR Mhealth Uhealth 2017 Dec 18;5(12):e190 [FREE Full text] [CrossRef] [Medline]
- Huckvale K, Prieto JT, Tilney M, Benghozi P, Car J. Unaddressed privacy risks in accredited health and wellness apps: a cross-sectional systematic assessment. BMC Med 2015 Sep 7;13:214 [FREE Full text] [CrossRef] [Medline]
- Grundy Q, Chiu K, Held F, Continella A, Bero L, Holz R. Data sharing practices of medicines related apps and the mobile ecosystem: traffic, content, and network analysis. Br Med J 2019 Mar 20;364:l920 [FREE Full text] [CrossRef] [Medline]
- Hutton L, Price BA, Kelly R, McCormick C, Bandara AK, Hatzakis T, et al. Assessing the privacy of mhealth apps for self-tracking: heuristic evaluation approach. JMIR Mhealth Uhealth 2018 Oct 22;6(10):e185 [FREE Full text] [CrossRef] [Medline]
- Smyth BP, Barry J, Keenan E, Ducray K. Lapse and relapse following inpatient treatment of opiate dependence. Ir Med J 2010 Jun;103(6):176-179. [Medline]
- Tousignant-Laflamme Y, Rainville P, Marchand S. Establishing a link between heart rate and pain in healthy subjects: a gender effect. J Pain 2005 Jun;6(6):341-347. [CrossRef] [Medline]
- Friedman BH. An autonomic flexibility-neurovisceral integration model of anxiety and cardiac vagal tone. Biol Psychol 2007 Feb;74(2):185-199. [CrossRef] [Medline]
- Rosebrock LE, Hoxha D, Norris C, Cacioppo JT, Gollan JK. Skin conductance and subjective arousal in anxiety, depression, and comorbidity. J Psychophysiol 2017 Oct 1;31(4):145-157 [FREE Full text] [CrossRef]
- Benedek M, Kaernbach C. Physiological correlates and emotional specificity of human piloerection. Biol Psychol 2011 Mar;86(3):320-329 [FREE Full text] [CrossRef] [Medline]
- Research2Guidance. 2017. 325,000 mobile health apps available in 2017 – Android now the leading mHealth platform URL: https://research2guidance.com/325000-mobile-health-apps-available-in-2017 [accessed 2020-04-28]
|DIRE: Diagnosis, Intractability, Risk, and Efficacy|
|EDA: electrodermal activity|
|EMA: ecological momentary assessment|
|FDA: Food and Drug Administration|
|iOS: iPhone operating system|
|mHealth: mobile health|
|OUD: opioid use disorder|
|SUD: substance use disorder|
Edited by G Eysenbach; submitted 02.08.19; peer-reviewed by B Greer, S Carreiro, F Lanfranchi; comments to author 15.10.19; revised version received 19.01.20; accepted 01.03.20; published 05.06.20Copyright
©Joseph Nuamah, Ranjana Mehta, Farzan Sasangohar. Originally published in JMIR mHealth and uHealth (http://mhealth.jmir.org), 05.06.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.