Published on in Vol 12 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/55663, first published .
Effect of a Smartphone App (S-Check) on Actual and Intended Help-Seeking and Motivation to Change Methamphetamine Use Among Adult Consumers of Methamphetamine in Australia: Randomized Waitlist-Controlled Trial

Effect of a Smartphone App (S-Check) on Actual and Intended Help-Seeking and Motivation to Change Methamphetamine Use Among Adult Consumers of Methamphetamine in Australia: Randomized Waitlist-Controlled Trial

Effect of a Smartphone App (S-Check) on Actual and Intended Help-Seeking and Motivation to Change Methamphetamine Use Among Adult Consumers of Methamphetamine in Australia: Randomized Waitlist-Controlled Trial

Original Paper

1The National Centre for Clinical Research on Emerging Drugs, University of New South Wales, Randwick, Australia

2St Vincent’s Hospital Alcohol and Drug Service, Sydney, Australia

3The National Drug and Alcohol Research Centre, The University of New South Wales, Sydney, Australia

4Institute for Global Health, University College London, London, United Kingdom

5Central and North-West London NHS Foundation Trust, London, United Kingdom

6University College London Hospitals NHS Foundation Trust, London, United Kingdom

7New South Wales Drug and Alcohol Clinical Research and Improvement Network, New South Wales Ministry of Health, Sydney, Australia

8Healthdirect Australia, Sydney, Australia

9School of Medicine and Public Health, College of Health, Medicine and Wellbeing, University of Newcastle, Newcastle, Australia

10ACON, Sydney, Australia

11The Kirby Institute, University of New South Wales, Sydney, Australia

12The Practice Healthcare, Sydney, Australia

13Clinical Research Unit for Anxiety and Depression, St Vincent's Hospital, Sydney, Australia

14LGBTIQ+ Health Australia, Sydney, Australia

Corresponding Author:

Krista J Siefried, RN, BSc, PhD

The National Centre for Clinical Research on Emerging Drugs

University of New South Wales

UNSW Randwick Campus

22/32 King Street

Randwick, 2031

Australia

Phone: 61 2 9065 7808

Email: krista.siefried@svha.org.au


Background: Interventions are required that address delays in treatment-seeking and low treatment coverage among people consuming methamphetamine.

Objective: We aim to determine whether a self-administered smartphone-based intervention, the “S-Check app” can increase help-seeking and motivation to change methamphetamine use, and determine factors associated with app engagement.

Methods: This study is a randomized, 28-day waitlist-controlled trial. Consenting adults residing in Australia who reported using methamphetamine at least once in the last month were eligible to download the app for free from Android or iOS app stores. Those randomized to the intervention group had immediate access to the S-Check app, the control group was wait-listed for 28 days before gaining access, and then all had access until day 56. Actual help-seeking and intention to seek help were assessed by the modified Actual Help Seeking Questionnaire (mAHSQ), modified General Help Seeking Questionnaire, and motivation to change methamphetamine use by the modified readiness ruler. χ2 comparisons of the proportion of positive responses to the mAHSQ, modified General Help Seeking Questionnaire, and modified readiness ruler were conducted between the 2 groups. Logistic regression models compared the odds of actual help-seeking, intention to seek help, and motivation to change at day 28 between the 2 groups. Secondary outcomes were the most commonly accessed features of the app, methamphetamine use, feasibility and acceptability of the app, and associations between S-Check app engagement and participant demographic and methamphetamine use characteristics.

Results: In total, 560 participants downloaded the app; 259 (46.3%) completed eConsent and baseline; and 84 (32.4%) provided data on day 28. Participants in the immediate access group were more likely to seek professional help (mAHSQ) at day 28 than those in the control group (n=15, 45.5% vs n=12, 23.5%; χ21=4.42, P=.04). There was no significant difference in the odds of actual help-seeking, intention to seek help, or motivation to change methamphetamine use between the 2 groups on the primary logistic regression analyses, while in the ancillary analyses, the imputed data set showed a significant difference in the odds of seeking professional help between participants in the immediate access group compared to the waitlist control group (adjusted odds ratio 2.64, 95% CI 1.19-5.83, P=.02). For participants not seeking help at baseline, each minute in the app increased the likelihood of seeking professional help by day 28 by 8% (ratio 1.08, 95% CI 1.02-1.22, P=.04). Among the intervention group, a 10-minute increase in app engagement time was associated with a decrease in days of methamphetamine use by 0.4 days (regression coefficient [β] –0.04, P=.02).

Conclusions: The S-Check app is a feasible low-resource self-administered intervention for adults in Australia who consume methamphetamine. Study attrition was high and, while common in mobile health interventions, warrants larger studies of the S-Check app.

Trial Registration: Australian New Zealand Clinical Trials Registry ACTRN12619000534189; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377288&isReview=true

JMIR Mhealth Uhealth 2024;12:e55663

doi:10.2196/55663

Keywords



Frequent use of methamphetamines is associated with adverse physical and mental health consequences [1,2], and Australia reports one of the highest rates of methamphetamine use and dependence in the world [2]. Since 2010, associated harms have been steadily increasing [3]. Psychosocial therapies are the primary mode of treatment for methamphetamine use disorder [4], especially as no pharmacotherapy has yet been shown to be effective [5]. Interventions such as cognitive behavioral therapy show modest effects [6], while contingency management has been demonstrated to be effective for outcomes associated both with methamphetamine use and with harm reduction for the duration of the intervention, but lacks widespread uptake [7]. Access to treatment is associated with more positive outcomes [8], but despite this, a gap of up to 10 years has been shown between the onset of problems related to methamphetamine use and presentation to health services for assistance [9].

Delays in access to health services can be due to a perception of “nonproblematic” methamphetamine use among people with methamphetamine use disorder [10,11]. Mental, physical, and social consequences can result from untreated persistent methamphetamine use disorder [9]. The development of a low-threshold intervention to encourage awareness of problems related to methamphetamine use could potentially change behavior and reduce the gaps between use, problems related to use, and treatment access. Health interventions supported by mobile devices (mHealth) are a promising mode of delivering early interventions to people who use drugs. As demonstrated in other mental health and substance use disorders, mHealth offers advantages in privacy and access over traditional face-to-face services and may facilitate help-seeking [12-16]. There are no mHealth interventions such as smartphone apps that have been shown to be effective in encouraging behavioral changes in people who use methamphetamine [17].

The S-Check intervention is targeted toward people who use methamphetamine, who do not necessarily identify problems related to its use [18], and are curious about the relationship between their use and other aspects of their health and well-being. Developed in 2011, the S-Check intervention consists of 4 sessions: a psychosocial assessment with a counsellor (based on Smout et al [19]); a physical health assessment with a medical officer; physical health feedback from a medical officer; and a biopsychosocial feedback, goal setting, and care planning session with a counsellor. The S-Check intervention aims to reduce harms associated with methamphetamine use, support behavior change, and encourage treatment seeking where indicated. When evaluated in 2018 [11], a majority of participants reported that the S-Check intervention was their first contact with general health services for issues related to methamphetamine use. Participants identified harm reduction, including education and advice about safer consumption practices, and the accessible and approachable environment to track their methamphetamine use patterns, as benefits of the model [11].

The S-Check intervention was translated into a smartphone app (“the S-Check app”) that uses the eHealth Behavior Management Model [20] to encourage help-seeking for methamphetamine use. The eHealth Behavior Management Model incorporates the transtheoretical model [20] and the behavioral intent aspect of the theory of planned behavior [21] to create systems that tailor health communication to meet the needs of individual app users through a set of predeveloped messages based on readiness to change. The S-Check app allows app users to assess the risks and harms associated with their methamphetamine use in 5 domains (sexual, lifestyle, physical, psychological, and cognitive health), track their use of methamphetamine and other health measures with an Ecological Momentary Intervention [22], and receive tailored feedback based on persuasive communication principles [20,23,24]. The S-Check app incorporates principles of efficacious behavioral change models [25,26] to reinforce engagement and positive change by encouraging S-Check app users to attend to messages; requesting further inputs from app users; and motivating app users toward change. The S-Check app was piloted with 10 consumers and found to be acceptable and usable by participants [27].

Following the development of the S-Check intervention and the translation to a usable smartphone app, we aimed to assess the effectiveness of the S-Check app to motivate help-seeking among people who use methamphetamine and its effect on motivation to change methamphetamine use. To do this, we undertook a randomized waitlist-controlled trial of the S-Check app.


Trial Design

This study was a digital randomized 28-day waitlist-controlled trial. Participants were allocated 1:1 to one of two study arms: immediate access to the S-Check app (intervention group) or access after a 28-day waitlist period (waitlist control group). The primary end point was day 28, and the primary outcome was between-group differences in help-seeking. Both groups had the option to use the S-Check app through to day 56. Optional qualitative interviews were conducted with consenting participants and will be reported elsewhere. This study is reported in line with the CONSORT (Consolidated Standards of Reporting Trials) guidelines [28], a checklist is available in Table S1 in Multimedia Appendix 1.

Ethical Considerations

This study was approved by the Human Research Ethics Committee of St Vincent’s Hospital, Sydney, Australia (HREC/18/SVH/196).

Participants

Inclusion criteria were adults (aged ≥18 years) living in Australia, who had self-reported methamphetamine use at least once in the month before study enrollment and private access to a smartphone (Android or Apple) to day 56 of follow-up. There were no exclusion criteria. Participants were recruited anonymously. This study was promoted through posters and leaflets at community (eg, people who use drugs) and partnering (eg, needle and syringe programs [NSP], medically supervised injecting center, sexual health clinics) organizations, alcohol and other drug service websites, and social media (including location-based dating apps).

Intervention

The S-Check app was available to download free of charge from Android and iOS app stores. Eligibility screening and provision of the participant information sheet and consent form were completed electronically within the app as an anonymous automated consent procedure [29].

Once accessed, the S-Check app home screen presented a dashboard (Figure 1) to access the S-Check app resources. These included 6 structured self-assessment tools (methamphetamine use, sexual health, social health, psychological well-being, physical health, and cognitive health; Table 1), provision of automated feedback (Figure 2), generation of a referral letter when appropriate to services or further support, relevant up-to-date information and resources about methamphetamine use, and a tool to track methamphetamine use and health impacts of methamphetamine over time (Figure 3).

Data were stored on a secure, encrypted password-protected Customer Relationships Management database integrated into the S-Check app’s unique Application Programming Interface.

Figure 1. S-Check app dashboard.
Table 1. S-Check app self-assessment layers and questionnaires.
ScaleS-Check app layerOutcome measuredQuestions, n
Self-assessment module: methamphetamine use

Based on ASSISTa-Lite List [30]My useFrequency of substance use (methamphetamine)8

SDSb [31]How I feel about my useMethamphetamine dependence5
Self-assessment module: psychological well-being

Derived from The Mental State Examination–Mood [32]My mood ratingPredominant emotion over the past 2 weeks1

World Health Organization 5 Well-Being Index Scale [33]My general well-beingMental well-being5

Kessler Psychological Distress Scale (K10) [34]Am I feeling ok?Mental distress10

Patient Health Questionnaire [35]My mental healthDepression9

Generalized Anxiety Disorder 7 [36]Stress and anxietyScreen for or severity of anxiety7
Self-assessment module: social health and lifestyle

Derived from the World Health Organization Quality of Life Scale [37]Overall satisfactionQuality of life3

Derived from S-Check Biopsychosocial assessment [18]Day-to-day activitiesImpact of use on social factors10
Self-assessment module: physical health

Derived from S-Check biopsychosocial and physical health assessment [18]How you take your [methamphetamine], your medical history, your family’s health, and your bodyEffect of drug use on physical health17
Self-assessment module: sexual health

Derived from S-Check biopsychosocial assessment [18]ChemSex, sexual behavior, and sex and drugsEffect of drug use on sexual health6
Self-assessment module: cognitive health

Quality of life in neurological disorders—cognitive function questionnaire [38]Cognitive healthCognitive function8

A 16-item version of the Prodromal Questionnaire (psychosis screener) [39]Reality checkRisk of psychosis16

aASSIST: Alcohol, Smoking and Substance Involvement Screening Test.

bSDS: Severity of Dependence Scale.

Figure 2. S-Check app generated tailored feedback.
Figure 3. Tracking health over time.

Outcomes and Measures

Help-seeking was measured by (1) the modified Actual Help Seeking Questionnaire (mAHSQ; recent help-seeking) [40], (2) the modified General Help Seeking Questionnaire (mGHSQ; intention to seek help) [40], and (3) the modified readiness ruler (mRR; motivation to change behavior). AHSQ and GHSQ are validated to measure intention for and actual help-seeking in mHealth interventions addressing substance use [41] and mental health [42-45]. Both problem-type and the help-source for AHSQ and GHSQ were modified for methamphetamine use [40] over 4 weeks, and for ease of use in the app, response options were collapsed into “professional” and “nonprofessional” help sources. The mAHSQ has 2 binary measures (yes or no) for help-seeking for a problem related to the use of methamphetamine in the past 4 weeks from (1) a professional source (eg, doctor, counsellor, psychologist, specialist, telephone or web-based counseling, etc) and (2) a nonprofessional source (eg, partner, friends, parents, other family members, colleagues, internet) [41,46]. The mGHSQ scale captures intent to seek professional and nonprofessional help in the next 4 weeks, rating each source of help on a 7-point Likert-type scale ranging from 1 (extremely unlikely) to 7 (extremely likely). The mRR is a measure that has demonstrated higher predictive validity than longer measures for readiness to change among people with substance use disorder [47-49]. Participants were asked: “how ready are you to change your use of [nickname of methamphetamine]?” with responses rated and scored on a 10-point Likert-type scale ranging from 1 (not ready) to 10 (trying hard to change). Primary outcomes were measured at baseline (day 0), day 28 (primary end point), and repeated at day 56 for both intervention and control groups.

Secondary outcomes were the most commonly accessed features of the S-Check app (number of times participants accessed each section); number of days of methamphetamine use in the past 28 days (collected at baseline, day 28, and day 56); feasibility and acceptability assessed by the number of participants retained to days 28 and 56 and a qualitative substudy (to be reported elsewhere). Associations were examined between S-Check app engagement over this study’s period (total minutes in-app use) and participant characteristics collected within the S-Check app: age, gender, sexual orientation, education, age of first use of methamphetamine, injection of methamphetamine in the last 4 weeks, treatment history, days of methamphetamine use in the past 28 days, and recent treatment.

For completion of the day 28 and day 56 surveys, participants in both the waitlist and control group were reimbursed with an AUS $25 (approximately US $19 at the time of enrollment) digital grocery voucher, redeemable through the S-Check app.

Sample Size

We determined the sample size required to evaluate the outcome of actual help-seeking at a power of 0.8 to detect a small to medium effect size (d=0.25), and α set at .05. A minimum of 510 participants was required [50] as we anticipated 50% attrition, and 255 participants to remain enrolled to the primary end point (day 28).

Randomization and Blinding

Randomization was automated within the S-Check app using a JavaScript (Refsnes Data) function whereby a random-access token was generated and participants were allocated to either immediate access to the S-Check app or a waitlist control group. Since participants were automatically enrolled and consented within the app, there was no risk of unblinding to the investigators.

Statistical Methods

We compared baseline characteristics between the 2 groups using χ2 for categorical variables, and the t test (2-tailed) or Mann-Whitney U test for continuous variables.

χ2 comparisons for the proportion of positive responses to the mAHSQ, mGHSQ (dichotomized to <5 being no intention to seek help and ≥5 being intention to seek help), and mRR (dichotomized to >8 indicating motivation to change) were conducted between the 2 groups at baseline and day 28.

For the mAHSQ, a logistic regression model compared the odds of recent help-seeking at day 28 between the intervention and the control groups, adjusted with the recent help-seeking status at baseline included as a covariate in the model. For the mGHSQ a logistic regression compared the intention of help-seeking score (derived from the mGHSQ dichotomized to <5 being no intention to seek help and ≥5 being intention to seek help) at day 28 between the intervention and control groups, adjusted with the intention to seek help status at baseline included as a covariate in the model. For the mRR, a logistic regression compared the motivation to change behavior (derived from the mRR with a score >8 indicating motivation to change) at day 28 between the 2 groups, adjusted for the corresponding baseline score, by including it as a covariate in the model.

Descriptive statistics were used to report participant access to layers within the app, methamphetamine use, and study retention at days 28 and 56. To analyze the association between demographics and methamphetamine use characteristics and S-Check app use, total engagement time for the intervention group was aggregated from the range of S-Check app use activities (from time of download to day 28). Multiple linear regression was applied to examine which baseline characteristics were predictive of more time engaged with the S-Check app, where engagement time as a dependent variable was log-transformed. The effect of time engaged with the S-Check app on help-seeking (mAHSQ and mGHSQ) and motivation to change (mRR) at day 28 were also examined. Dashboard activity time greater than 60 minutes was treated as outliers, as they were unlikely to accurately reflect true app engagement duration and be imputed with the sample median.

To handle missing data at follow-up, the analysis was conducted initially and primarily based on the retained cohort of observed data, following the recommendation of Jakobson et al [51]. Ancillary analysis based on the full intention-to-treat (ITT) cohort using multiple imputations by chained equations was performed under the missing at-random assumption. Variables in the multiple imputation model included the response to the primary outcome measure at baseline, as well as demographic and methamphetamine use variables in the collected data. The statistical significance level was set at 2-sided .05. Analyses were performed using SAS (SAS Institute) and R (R Foundation for Statistical Computing).


Participants

In total, 560 participants downloaded the app, of which 259 (46.3%) completed the eConsent process and baseline survey. Of these, 84 (32.4%) provided data on day 28. Further, 175 did not provide data at day 28, resulting in a 68% attrition from baseline. A participant flow diagram is presented in Figure 4.

Baseline participant features, summarized by intervention group or control group, are presented in Table 2. There was no significant difference observed between the 2 groups. The majority of the sample (n=159, 61.6%) had not previously accessed treatment services for methamphetamine use, while 55.8% (n=144) had injected methamphetamine in the prior 4 weeks.

Figure 4. Participant flow diagram.
Table 2. Baseline characteristics of the sample.
VariableTotal eligible participants (n=259)Participants retained to day 28 (n=84)

Control (n=117)Intervention (n=142)Total (n=258)aControl (n=50)Intervention (n=33)Total, n
Age (years), mean (SD)38.2 (10.2)38.9 (11.1)38.7 (10.7)39.3 (10.9)40.7 (10.2)83
Sexuality and gender identity, n (%)

Cis gay man58 (50)73 (51.4)131 (50.8)27 (54)19 (57.6)46

Cis heterosexual woman19 (16.4)20 (14.1)39 (15.1)5 (10)7 (21.2)12

Cis heterosexual man13 (11.2)23 (16.2)36 (13.9)4 (8)3 (9.1)7

Nonbinary queer or different9 (7.8)10 (7)19 (7.4)4 (8)1 (3)5

Cis bisexual woman8 (6.9)7 (4.9)15 (5.8)5 (10)1 (3)6

Cis bisexual man6 (5.2)8 (5.6)14 (5.4)3 (6)2 (6.1)5

Cis lesbian2 (1.7)1 (0.7)3 (1.2)2 (4)0 (0)2

Transgender heterosexual woman1 (0.9)0 (0)1 (0.4)0 (0)0 (0)0
Sex assigned at birth, n (%)

Male83 (71.6)110 (77.5)193 (74.8)37 (74)24 (72.7)61

Female33 (28.5)32 (22.5)65 (25.2)13 (26)9 (27.3)22
Intersex, n (%)

No114 (98.3)134 (94.4)248 (96.1)49 (98)32 (97)81

Prefer not to answer2 (1.7)3 (2.1)5 (1.9)1 (2)0 (0)1

Yes0 (0)5 (3.5)5 (1.9)0 (0)1 (3)1
Education, n (%)

Did not complete high school10 (8.6)16 (11.3)26 (10.1)4 (8)2 (6.1)6

High school26 (22.4)41 (28.9)67 (26)13 (26)9 (27.3)22

Trade certificate or diploma35 (30.2)37 (26.1)72 (27.9)13 (26)12 (36.4)25

Undergraduate degree27 (23.3)25 (17.6)52 (20.2)11 (22)7 (21.2)18

Postgraduate degree18 (15.5)23 (16.2)41 (15.9)9 (18)3 (9.1)12
MAb use, mean (SD)

MA use in the past 28 days (days)15.7 (8.8)14.3 (8.9)14.9 (8.9)15.8 (8.9)15.4 (8.2)c

Age of first MA use (years)26.4 (9.3)26.5 (10.6)26.4 (10)28.9 (9)27.5 (10.9)
History of treatment for problems related to MA use, n (%)

No74 (63.3)85 (59.9)159 (61.6)35 (68.6)24 (72.7)59

Yes43 (36.8)57 (40.1)100 (38.8)16 (31.4)9 (27.3)25
History of injecting MA in past 4 weeks, n (%)

No50 (42.7)65 (45.8)115 (44.6)21 (41.2)9 (27.3)30

Yes67 (57.3)77 (54.2)144 (55.8)30 (58.8)24 (72.7)54

aBaseline and day 28 demographic data on age, gender identity, sexuality, sex assigned at birth, intersex status, education, and days of methamphetamine use in the previous 28 days is missing for 1 participant.

bMA: methamphetamine.

cNot applicable.

Primary Outcomes

The primary outcomes for help-seeking were assessed using the 84 participants retained to day 28 including 33 (39.2%) participants in the intervention group and 51 (60.7%) participants in the control group.

Table 3 compares actual help-seeking (mAHSQ), intention to seek help (mGHSQ), and motivation to change (mRR) between the 2 groups at baseline and day 28. A greater proportion of participants in the intervention group recently sought professional help (mAHSQ) at day 28 than in the control group (n=15, 45.5% vs n=12, 23.5%; χ21=4.42; P=.04).

Regression analyses for mAHSQ, mGHSQ, and mRR are presented in Table 4. In the primary regression analyses, there was no statistically significant difference in the odds of actual help-seeking, intention to seek help, or motivation to change between the immediate access group and the waitlist control group on day 28.

Table 3. Help-seeking, intention to seek help, and motivation to change.

Actual help-seeking (mAHSQa)Intention to seek help (mGHSQb)cMotivation to change (mRRd)e

ProfessionalP valueNonprofessionalP valueProfessionalP valueNonprofessionalP valueMotivation to changeP value
Baseline, n (%).23
.22
.19
.43
≥.99

Control11 (21.6)
15 (29.4)
30 (58.8)
23 (45.1)
17 (33.3)

Intervention11 (33.3)
14 (42.4)
24 (72.7)
23 (36.4)
11 (33.3)
Day 28, n (%).04
.31
.45
.90
.09

Control12 (23.5)
22 (43.1)
32 (62.8)
27 (52.9)
14 (27.4)

Intervention15 (45.5)
18 (54.6)
28 (54.6)
27 (51.5)
15 (45.4)

amAHSQ: modified Actual Help Seeking Questionnaire.

bmGHSQ: modified General Help Seeking Questionnaire.

cModified General Help Seeking Questionnaire categorized as 1-4, no intention to seek help; 5-7, intention to seek help.

dmRR: modified readiness ruler.

eModified readiness ruler categorized as <8, not motivated to change; ≥8, motivated to change.

Table 4. Logistic regression for mAHSQa, mGHSQb, and mRRc.
Outcome measure and outcome response setAdjusted odds ratiod (95% CI)P value
mAHSQ

Professional help-seeking–actual2.72 (0.86-8.64).09

Nonprofessional help-seeking–actual1.21 (0.44-3.67).71
mGHSQe

Professional help-seeking–intention0.49 (0.17-1.32).17

Nonprofessional help-seeking–intention1.04 (0.42-2.64).93
mRRf

Motivation to change2.4 (0.89-6.47).08

amAHSQ: modified Actual Help Seeking Questionnaire.

bmGHSQ: modified General Help Seeking Questionnaire.

cmRR: modified readiness ruler.

dAdjusted for baseline response.

eScore on a 7-point Likert scale categorized as 1-4, no intention to seek help; 5-7, intending to seek help.

fmRR scored as <8, not motivated to change; ≥8, motivated to change.

Ancillary Analysis

Based on the multiple imputed data set, consisting of 10 baseline characteristics, an ancillary analysis was conducted. While overall the results were consistent with our observed case analysis, there was a significant difference in the odds of recent professional help-seeking between the immediate access group compared to the waitlist control group on this analysis (adjusted odds ratio [aOR] 2.64, 95% CI 1.19-5.83, P=.02; Table S2 in Multimedia Appendix 1).

Secondary Outcomes

The most commonly accessed features of the app over this study’s period are presented in Table S3 in Multimedia Appendix 1. The most accessed features were the dashboard feature, information, and methamphetamine tracking resources.

There were no between-group changes in days of methamphetamine use at day 28, as presented in Table S4 in Multimedia Appendix 1.

In a multivariable regression analysis with app engagement time as the response variable, participants who identified as gay males had 68% more app engagement time than all other participants (ratio 1.68, 95% CI 1.04-2.98, P=.03). It was not possible to analyze S-Check app engagement by other sexualities and gender identities due to small numbers. Greater days of methamphetamine use at baseline was also found to be a predictor of S-Check app engagement, with 3% more app engagement time for each additional day of methamphetamine use (ratio 1.03, 95% CI 1.00-1.06, P=.03). Participants who intended to seek professional help (mGHSQ) at baseline had 17% more S-Check app engagement than those who did not (ratio 1.17, 95% CI 1.03-1.32, P=.01). After adjusting for baseline days of methamphetamine use, a 10-minute increase in app engagement time over the 28-day intervention was associated with a decrease in days of methamphetamine use by 0.4 days (regression coefficient [β] –0.04, P=.02; intervention group: n=33). In a subgroup analysis of participants who were not seeking help at baseline, for every additional minute of S-Check app use, there was an 8% increase in the likelihood of seeking professional help at day 28 (ratio 1.08, 95% CI 1.02-1.22, P=.04).


Principal Findings

This study demonstrated that compared to waitlist controls, almost twice the proportion of participants with immediate access to the S-Check app sought professional help by day 28. Importantly, among participants not seeking help at baseline, each minute in the app was associated with seeking professional help by day 28, and there was an association between increased S-Check app use and decreased methamphetamine use over the 28 days among those in the immediate access group.

This study has limitations. We aimed to recruit 510 participants but we were only able to achieve a sample of 259. Retention to the primary end point was 32%, less than the expected 50%, which was likely unrealistic, given emerging evidence for this type of study suggests that when participants are enrolled in mHealth studies after downloading an app, retention is generally <30% [52]. Future research may include methods whereby participants are recruited before downloading the app; however, this design would affect the generalizability of the results to the population recruited. We learned important lessons about implementing an app-based trial. We underestimated the resources required to support a study of this nature. Keeping this study open longer may have increased our sample size. Budgeting for longer periods of recruitment and advertising may support higher enrollment in future trials. Apps to address substance use disorder should be co-designed with the community anticipated to benefit from their use. To this end, the stepped process of consultation with affected populations in transitioning from a clinical intervention to a smartphone app is a strength of the S-Check app. Further refinement of this resource or subsequent apps to address methamphetamine use should include active engagement with people who will use the app, to ensure alignment of what will benefit this population and what research and developers are delivering.

There is a possibility that this sample was already motivated toward change. Given the design of the app encourages people to understand more about their methamphetamine use and its impact, those who downloaded it likely had some interest in how their methamphetamine use was affecting them. In selecting a primary outcome, future studies of the S-Check app may therefore seek to examine how people use the app to better understand their methamphetamine use, identify which aspects of their use may be problematic for them, and how the app provides earlier insights into the relationships between methamphetamine use and aspects of their life. In the present study, assessing help-seeking and motivation to change is difficult given fixed time points and in binary measures as is demanded of a randomized controlled trial, while change is a fluid process. Engaging with the app may in itself have addressed concerns for participants, reducing the need or motivation to seek external help. Further exploration of the place of a self-administered information app such as the S-Check app within the broader treatment landscape in support of people who consume methamphetamine is warranted. A nuanced understanding of progress along the change continuum, an aim of the app, is required in future studies.

Sample characteristics limit the generalizability of the results to the broader Australian population of people who use methamphetamine. The majority of participants recruited to our study identified as male (69.9%) while 64% of past-month methamphetamine use occurs among men in Australia [53]. Our sample had a large proportion of participants who had undertaken higher level education (35.9% had a University degree), as compared to underlying population data (24%) [53]. In our study, neither ethnicity nor employment data were collected, therefore we cannot comment on the generalizability of these findings to a range of communities affected by methamphetamine use. This study recruited a large proportion of participants identifying as gay men (n=131, 50.8% of the sample), reflecting the recruitment strategy through targeted social media channels. The underrepresentation of women, transgender people, or other populations may be attributed to our recruitment strategy, but we do not have any way of knowing whether this is due to the design or content of the app. It is also possible that people did not want to use an app that would be associated with their drug use, particularly given the legal implications of drug use. Nevertheless, the anonymous nature of the S-Check app may reach participants who are reluctant to seek traditional or face-to-face treatment services due to barriers such as high cost, treatment access delays (eg, long waitlists), travel time to services, or fear of stigma.

The S-Check app recruited participants who had predominantly never sought treatment for methamphetamine use previously, and who reported injecting methamphetamine in the 4 weeks to baseline, a potential surrogate for severity of dependence. Furthermore, a higher proportion of those who were retained in the intervention group were people who injected methamphetamine. Previous studies have demonstrated greater methamphetamine-related service use among people who inject methamphetamine [54,55]. This may be due to the lack of treatment options for methamphetamine use disorders, whereas harm reduction services are more accessible, such as NSPs to reduce injection-related harms [56]. Our recruitment strategy included advertising through NSPs, and this may reflect that. However, our results suggest that the S-Check app can act as a feasible low-resource, early intervention for participants who may be reluctant to seek traditional or face-to-face services, or are not linked to services such as those by referral points that may be made available at NSPs.

While it was not designed to be a motivator for reducing methamphetamine use, participants who spent more time engaged with the S-Check app demonstrated a reduction in methamphetamine use from baseline to day 28. This finding is consistent with other mHealth apps that included self-monitoring for alcohol and other substance use [57], reinforcing the theory that supportive self-monitoring influences behavior change [58,59]. Importantly, participants who had more frequent methamphetamine use engaged for longer with the S-Check app than those with less frequent use; and those participants who reported injecting methamphetamine were more likely to be retained to day 28 if they were randomized to the intervention group than those who did not report injecting. These findings highlight a potential treatment gap that could be filled by an mHealth intervention such as the S-Check app, or at the very least the potential of the S-Check app to be an adjunct to other treatment and harm reduction services and an important and accessible resource for when those are not available. The S-Check app was intended as an early intervention but may be an attractive resource for those people who are more frequent or injecting consumers of methamphetamine as well.

Previous research has highlighted a need for targeted interventions to improve pathways to professional support among people who use methamphetamine [55]. While we collected baseline data on 259 participants, 560 people downloaded the app. Of those who completed screening, only 10 were ineligible. This suggests that the S-Check app was highly accessible, while perhaps recruitment into the research study was not favorable; for example, it is unknown if potential participants did not proceed due to the chance of being randomized to the waitlist control. While not statistically significant, a higher proportion of those randomized to the waitlist went on to complete the day 28 assessment. It cannot be inferred from our data whether this is related to satisfaction of those randomized to immediately access the app, or perhaps reflecting the context of the waitlist group wanting to access the app.

Future directions include exploring the incorporation of the S-Check app as part of a stepped-care approach to clinical treatment, within a range of clinical settings, or as a motivational and self-awareness tool to be provided to people waiting for care. Primary care and sexual health service use is high among people who use methamphetamine, but opportunities to intervene are often missed. A health economic analysis was not part of the scope of this project and as such more work is required to test and analyze the costing and implementation of the app. Further development of the S-Check app and dissemination more broadly as a freely accessible resource to support people in understanding their methamphetamine use is planned.

Conclusions

This study demonstrates the effectiveness of the S-Check app in motivating help-seeking, particularly among treatment-naïve populations. The S-Check app was shown to be a feasible, low-resource, self-administered intervention for adults in Australia who use methamphetamine. Using supportive self-monitoring, the S-Check app assists people who use methamphetamine to identify problem use, shifting people along the motivational pathway, and promoting treatment seeking. As an early intervention, the S-Check app has the potential to facilitate the first step in a stepped-care approach to treatment, reducing treatment delays and avoiding more serious adverse health outcomes. Further work is required to demonstrate the generalizability of the S-Check app among people who use methamphetamine in Australia and to increase access to other internet-enabled devices.

Acknowledgments

The authors wish to thank all participants who took part in this study. In addition, we wish to acknowledge contributions from the investigators and research team (Ms Jessica Wilson, Mr Duncan Graham, Dr Emily Li, Ms Victoria Malone, Mr Quoc Nguyen, Ms Lauren Rogers, Dr Samineh Sanatkar) and the S-Check study advisory group (Mr Thomas Capell-Hattam, Dr Hila Haskelberg, Ms Ruth Hennessy, Dr Suzie Hudson, Ms Debbie Kaplan, Ms Chris Keyes, Associate Professor Anna McNulty). This study was funded by a New South Wales Health Early Intervention and Innovation Fund Grant (number A280560), the National Centre for Clinical Research on Emerging Drugs (which is funded by the Australian Department of Health and Aged Care), and the St Vincent’s Hospital Sydney Inclusive Health Program.

Conflicts of Interest

None declared.

Multimedia Appendix 1

CONSORT (Consolidated Standards of Reporting Trials) checklist and tables.

DOCX File , 24 KB

Multimedia Appendix 2

CONSORT eHEALTH checklist V 1.6.1.

PDF File (Adobe PDF File), 1146 KB

  1. Hillhouse MP, Marinelli-Casey P, Gonzales R, Ang A, Rawson RA, Methamphetamine Treatment Project Corporate Authors. Predicting in-treatment performance and post-treatment outcomes in methamphetamine users. Addiction. 2007;102 Suppl 1:84-95. [CrossRef] [Medline]
  2. Farrell M, Martin NK, Stockings E, Bórquez A, Cepeda JA, Degenhardt L, et al. Responding to global stimulant use: challenges and opportunities. Lancet. 2019;394(10209):1652-1667. [FREE Full text] [CrossRef] [Medline]
  3. Man N, Sisson SA, McKetin R, Chrzanowska A, Bruno R, Dietze PM, et al. Trends in methamphetamine use, markets and harms in Australia, 2003-2019. Drug Alcohol Rev. 2022;41(5):1041-1052. [CrossRef] [Medline]
  4. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. Arlington, Virginia. American Psychiatric Association; 2013.
  5. Siefried KJ, Acheson LS, Lintzeris N, Ezard N. Pharmacological treatment of methamphetamine/amphetamine dependence: a systematic review. CNS Drugs. 2020;34(4):337-365. [FREE Full text] [CrossRef] [Medline]
  6. Stuart AM, Baker AL, Denham AM, Lee NK, Hall A, Oldmeadow C, et al. Psychological treatment for methamphetamine use and associated psychiatric symptom outcomes: a systematic review. J Subst Abuse Treat. 2020;109:61-79. [FREE Full text] [CrossRef] [Medline]
  7. Brown HD, DeFulio A. Contingency management for the treatment of methamphetamine use disorder: a systematic review. Drug Alcohol Depend. 2020;216:108307. [CrossRef] [Medline]
  8. Brensilver M, Heinzerling KG, Swanson AN, Shoptaw SJ. Placebo-group responders in methamphetamine pharmacotherapy trials: the role of immediate establishment of abstinence. Exp Clin Psychopharmacol. 2012;20(5):430-435. [FREE Full text] [CrossRef] [Medline]
  9. Lee NK, Harney AM, Pennay AE. Examining the temporal relationship between methamphetamine use and mental health comorbidity. Adv Dual Diagn. 2022;5(1):23-31. [FREE Full text] [CrossRef]
  10. Quinn B, Stoové M, Papanastasiou C, Dietze P. An exploration of self-perceived non-problematic use as a barrier to professional support for methamphetamine users. Int J Drug Policy. 2013;24(6):619-623. [CrossRef] [Medline]
  11. Brener L, Lea T, Rance J, Wilson H, Bryant J, Ezard N. Providing a model of health care service to stimulant users in Sydney. Drugs: Educ, Prev Policy. 2016;25(2):130-137. [CrossRef]
  12. Kazemi DM, Borsari B, Levine MJ, Li S, Lamberson KA, Matta LA. A systematic review of the mHealth interventions to prevent alcohol and substance abuse. J Health Commun. 2017;22(5):413-432. [FREE Full text] [CrossRef] [Medline]
  13. Dick S, Whelan E, Davoren MP, Dockray S, Heavin C, Linehan C, et al. A systematic review of the effectiveness of digital interventions for illicit substance misuse harm reduction in third-level students. BMC Public Health. 2019;19(1):1244. [FREE Full text] [CrossRef] [Medline]
  14. Luxton DD, McCann RA, Bush NE, Mishkind MC, Reger GM. mHealth for mental health: integrating smartphone technology in behavioral healthcare. Prof Psychol: Res Pract. 2011;42(6):505-512. [CrossRef]
  15. Giroux I, Goulet A, Mercier J, Jacques C, Bouchard S. Online and mobile interventions for problem gambling, alcohol, and drugs: a systematic review. Front Psychol. 2017;8:954. [FREE Full text] [CrossRef] [Medline]
  16. Poushter J. Smartphone ownership and internet usage continues to climb in emerging economies. Pew Research Center. 2016;22(1):1-44. [CrossRef]
  17. Chapman C, Champion KE, Birrell L, Deen H, Brierley M, Stapinski LA, et al. Smartphone apps about crystal methamphetamine ("Ice"): systematic search in app stores and assessment of composition and quality. JMIR mHealth uHealth. 2018;6(11):e10442. [FREE Full text] [CrossRef] [Medline]
  18. Sullivan F, Bascombe F, Ezard N. St vincent's s-check clinic model of care. Sydney: The University of New South Wales and St Vincent's Health Australia. Technical Report Number 2019/02. 2019. URL: https://nccred.org.au/wp-content/uploads/2019/12/2019-02_NCCRED_S-checkModelofCare.pdf [accessed 2024-06-06]
  19. Smout MF, Longo M, Harrison S, Minniti R, Cahill S, Wickes W, et al. The psychostimulant check-up: a pilot study of a brief intervention to reduce illicit stimulant use. Drug Alcohol Rev. 2010;29(2):169-176. [CrossRef] [Medline]
  20. Bensley RJ, Mercer N, Brusk JJ, Underhile R, Rivas J, Anderson J, et al. The eHealth behavior management model: a stage-based approach to behavior change and management. Prev Chronic Dis. 2004;1(4):A14. [FREE Full text] [Medline]
  21. Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Processes. 1991;50(2):179-211. [CrossRef]
  22. Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol. 2010;15(Pt 1):1-39. [FREE Full text] [CrossRef] [Medline]
  23. Trull TJ, Ebner-Priemer UW. Using experience sampling methods/ecological momentary assessment (ESM/EMA) in clinical assessment and clinical research: introduction to the special section. Psychol Assess. 2009;21(4):457-462. [FREE Full text] [CrossRef] [Medline]
  24. Salazar A, de Sola H, Failde I, Moral-Munoz JA. Measuring the quality of mobile apps for the management of pain: systematic search and evaluation using the mobile app rating scale. JMIR mHealth uHealth. 2018;6(10):e10718. [FREE Full text] [CrossRef] [Medline]
  25. Tomczyk S, Schomerus G, Stolzenburg S, Muehlan H, Schmidt S. Ready, willing and able? An investigation of the theory of planned behaviour in help-seeking for a community sample with current untreated depressive symptoms. Prev Sci. 2020;21(6):749-760. [FREE Full text] [CrossRef] [Medline]
  26. Gajecki M, Berman AH, Sinadinovic K, Rosendahl I, Andersson C. Mobile phone brief intervention applications for risky alcohol use among university students: a randomized controlled study. Addict Sci Clin Pract. 2014;9(1):11. [FREE Full text] [CrossRef] [Medline]
  27. Herman D, Ferrari M, Moran-Pryor A, Malone V, Ezard N. Usability and acceptability of S-Check app: a harm reduction and early intervention smartphone application to engage people who use methamphetamine and are not-in-treatment. 2018. Presented at: NADA Conference Exploring Therapeutic Interventions; June 7-8, 2018; Sydney, NSW.
  28. Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Ann Intern Med. 2010;152(11):726-732. [FREE Full text] [CrossRef] [Medline]
  29. Nguyen Q, Middleton P, Herman D, Li K, Grundy E, Li E. What's in an app? Incorporating an automated consent procedure to recruit those who use methamphetamine to a harm reduction and early intervention smartphone-based application clinical trial'. Drug Alcohol Rev. 2019;38(S1):S77-S77. [FREE Full text]
  30. Ali R, Meena S, Eastwood B, Richards I, Marsden J. Ultra-rapid screening for substance-use disorders: the Alcohol, Smoking and Substance Involvement Screening Test (ASSIST-Lite). Drug Alcohol Depend. 2013;132(1-2):352-361. [CrossRef] [Medline]
  31. Gossop M, Darke S, Griffiths P, Hando J, Powis B, Hall W, et al. The Severity of Dependence Scale (SDS): psychometric properties of the SDS in English and Australian samples of heroin, cocaine and amphetamine users. Addiction. 1995;90(5):607-614. [CrossRef] [Medline]
  32. NA. Mental State Examination. In: Clinical Practice Guidelines. Melbourne. The Royal Children's Hospital Melbourne; 2018.
  33. Wellbeing measures in primary health care/the DEPCARE project: report on a WHO meeting. World Health Organization. 1998. URL: https://iris.who.int/bitstream/handle/10665/349766/WHO-EURO-1998-4234-43993-62027-eng.pdf [accessed 2024-06-06]
  34. Kessler RC, Barker PR, Colpe LJ, Epstein JF, Gfroerer JC, Hiripi E, et al. Screening for serious mental illness in the general population. Arch Gen Psychiatry. 2003;60(2):184-189. [CrossRef] [Medline]
  35. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606-613. [FREE Full text] [CrossRef] [Medline]
  36. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092-1097. [CrossRef] [Medline]
  37. The Whoqol Group. The world health organization quality of life assessment (WHOQOL): development and general psychometric properties. Soc Sci Med. 1998;46(12):1569-1585. [CrossRef] [Medline]
  38. Cella D, Lai J, Nowinski CJ, Victorson D, Peterman A, Miller D, et al. Neuro-QOL: brief measures of health-related quality of life for clinical research in neurology. Neurology. 2012;78(23):1860-1867. [FREE Full text] [CrossRef] [Medline]
  39. Ising HK, Veling W, Loewy RL, Rietveld MW, Rietdijk J, Dragt S, et al. The validity of the 16-item version of the prodromal questionnaire (PQ-16) to screen for ultra high risk of developing psychosis in the general help-seeking population. Schizophr Bull. 2012;38(6):1288-1296. [FREE Full text] [CrossRef] [Medline]
  40. Wilson C, Deane F, Ciarrochi J, Rickwood D. Measuring help-seeking intentions: properties of the general help-seeking questionnaire. Canadian J Counselling. 2005;39(1):15-28. [CrossRef]
  41. Tait RJ, McKetin R, Kay-Lambkin F, Bennett K, Tam A, Bennett A, et al. Breakingtheice: a protocol for a randomised controlled trial of an internet-based intervention addressing amphetamine-type stimulant use. BMC Psychiatry. 2012;12:67. [FREE Full text] [CrossRef] [Medline]
  42. Beiwinkel T, Hey S, Bock O, Rössler W. Supportive mental health self-monitoring among smartphone users with psychological distress: protocol for a fully mobile randomized controlled trial. Front Public Health. 2017;5:249. [FREE Full text] [CrossRef] [Medline]
  43. Cheng VWS, Davenport T, Johnson D, Vella K, Mitchell J, Hickie IB. Naturalistic evaluation of a sport-themed mental health and wellbeing app aimed at men (MindMax), that incorporates applied video games and gamification. Internet Interv. 2020;20:100306. [FREE Full text] [CrossRef] [Medline]
  44. Gulliver A, Griffiths KM, Christensen H, Mackinnon A, Calear AL, Parsons A, et al. Internet-based interventions to promote mental health help-seeking in elite athletes: an exploratory randomized controlled trial. J Med Internet Res. 2012;14(3):e69. [FREE Full text] [CrossRef] [Medline]
  45. Rickwood D, Thomas K, Bradford S. Review of help-seeking measures in mental health: an evidence check rapid review brokered by the Sax Institute for Beyondblue. Sax Institute for Beyondblue. 2012:1-35.
  46. Rickwood DJ, Braithwaite VA. Social-psychological factors affecting help-seeking for emotional problems. Soc Sci Med. 1994;39(4):563-572. [CrossRef] [Medline]
  47. Bowling A. Just one question: if one question works, why ask several? J Epidemiol Community Health. 2005;59(5):342-345. [FREE Full text] [CrossRef] [Medline]
  48. LaBrie JW, Quinlan T, Schiffman JE, Earleywine ME. Performance of alcohol and safer sex change rulers compared with readiness to change questionnaires. Psychol Addict Behav. 2005;19(1):112-115. [CrossRef] [Medline]
  49. Hesse M. The readiness ruler as a measure of readiness to change poly-drug use in drug abusers. Harm Reduct J. 2006;3:3. [FREE Full text] [CrossRef] [Medline]
  50. Cohen J. A power primer. Psychol Bull. 1992;112(1):155-159. [CrossRef] [Medline]
  51. Jakobsen JC, Gluud C, Wetterslev J, Winkel P. When and how should multiple imputation be used for handling missing data in randomised clinical trials - a practical guide with flowcharts. BMC Med Res Methodol. 2017;17(1):162. [FREE Full text] [CrossRef] [Medline]
  52. Staiger PK, O'Donnell R, Liknaitzky P, Bush R, Milward J. Mobile apps to reduce tobacco, alcohol, and illicit drug use: systematic review of the first decade. J Med Internet Res. 2020;22(11):e17156. [FREE Full text] [CrossRef] [Medline]
  53. National Drug Strategy Household Survey 2019. Canberra. Australian Institute of Health and Welfare; 2019.
  54. McKetin R, Kelly E. Socio-demographic factors associated with methamphetamine treatment contact among dependent methamphetamine users in Sydney, Australia. Drug Alcohol Rev. 2007;26(2):161-168. [CrossRef] [Medline]
  55. Quinn B, Stoové M, Dietze P. Factors associated with professional support access among a prospective cohort of methamphetamine users. J Subst Abuse Treat. 2013;45(2):235-341. [CrossRef] [Medline]
  56. Nielsen S, Bruno R, Lintzeris N, Fischer J, Carruthers S, Stoové M. Pharmaceutical opioid analgesic and heroin dependence: how do treatment-seeking clients differ in Australia? Drug Alcohol Rev. 2011;30(3):291-299. [CrossRef] [Medline]
  57. Aharonovich E, Stohl M, Cannizzaro D, Hasin D. HealthCall delivered via smartphone to reduce co-occurring drug and alcohol use in HIV-infected adults: a randomized pilot trial. J Subst Abuse Treat. 2017;83:15-26. [FREE Full text] [CrossRef] [Medline]
  58. Michie S, Whittington C, Hamoudi Z, Zarnani F, Tober G, West R. Identification of behaviour change techniques to reduce excessive alcohol consumption. Addiction. 2012;107(8):1431-1440. [CrossRef] [Medline]
  59. Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol. 2009;28(6):690-701. [CrossRef] [Medline]


CONSORT: Consolidated Standards of Reporting Trials
ITT: intention-to-treat
mAHSQ: modified Actual Help Seeking Questionnaire
mGHSQ: modified General Help Seeking Questionnaire
mRR: modified readiness ruler
NSP: needle and syringe program


Edited by L Buis; submitted 19.12.23; peer-reviewed by S Kershaw, AJ Saxon; comments to author 18.01.24; revised version received 23.01.24; accepted 10.05.24; published 03.07.24.

Copyright

©Krista J Siefried, Florence Bascombe, Brendan Clifford, Zhixin Liu, Peter Middleton, Frances Kay-Lambkin, Jack Freestone, Daniel Herman, Michael Millard, Maureen Steele, Liam Acheson, Carl Moller, Nicky Bath, Nadine Ezard. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 03.07.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.