This paper is in the following e-collection/theme issue:

mHealth for Treatment Adherence (397) mHealth for Symptom and Disease Monitoring, Chronic Disease Management (1399) Design and Formative Evaluation of Mobile Apps (694) Usability of Apps and User Perceptions of mHealth (974) Asthma Education and Self-Management in Childhood and Adolescence (71)

Published on in Vol 9, No 5 (2021): May

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/26442, first published .
Feasibility and Acceptability of an Asthma App to Monitor Medication Adherence: Mixed Methods Study

Feasibility and Acceptability of an Asthma App to Monitor Medication Adherence: Mixed Methods Study

Feasibility and Acceptability of an Asthma App to Monitor Medication Adherence: Mixed Methods Study

Authors of this article:

Cristina Jácome1, 2 Author Orcid Image ;   Rute Almeida1, 2 Author Orcid Image ;   Ana Margarida Pereira1, 2, 3 Author Orcid Image ;   Rita Amaral1, 2, 4, 5 Author Orcid Image ;   Sandra Mendes1 Author Orcid Image ;   Magna Alves-Correia3 Author Orcid Image ;   Carmen Vidal6 Author Orcid Image ;   Sara López Freire6 Author Orcid Image ;   Paula Méndez Brea6 Author Orcid Image ;   Luís Araújo3 Author Orcid Image ;   Mariana Couto3 Author Orcid Image ;   Darío Antolín-Amérigo7 Author Orcid Image ;   Belén de la Hoz Caballer7 Author Orcid Image ;   Alicia Barra Castro7 Author Orcid Image ;   David Gonzalez-De-Olano7 Author Orcid Image ;   Ana Todo Bom8 Author Orcid Image ;   João Azevedo9 Author Orcid Image ;   Paula Leiria Pinto10 Author Orcid Image ;   Nicole Pinto10 Author Orcid Image ;   Ana Castro Neves10 Author Orcid Image ;   Ana Palhinha10 Author Orcid Image ;   Filipa Todo Bom11 Author Orcid Image ;   Alberto Costa12 Author Orcid Image ;   Cláudia Chaves Loureiro13 Author Orcid Image ;   Lilia Maia Santos14 Author Orcid Image ;   Ana Arrobas13 Author Orcid Image ;   Margarida Valério13 Author Orcid Image ;   João Cardoso15 Author Orcid Image ;   Madalena Emiliano15 Author Orcid Image ;   Rita Gerardo15 Author Orcid Image ;   José Carlos Cidrais Rodrigues16 Author Orcid Image ;   Georgeta Oliveira16 Author Orcid Image ;   Joana Carvalho16 Author Orcid Image ;   Ana Mendes17 Author Orcid Image ;   Carlos Lozoya18 Author Orcid Image ;   Natacha Santos19 Author Orcid Image ;   Fernando Menezes20 Author Orcid Image ;   Ricardo Gomes20 Author Orcid Image ;   Rita Câmara21 Author Orcid Image ;   Rodrigo Rodrigues Alves22 Author Orcid Image ;   Ana Sofia Moreira22 Author Orcid Image ;   Diana Bordalo1, 23 Author Orcid Image ;   Carlos Alves24 Author Orcid Image ;   José Alberto Ferreira25 Author Orcid Image ;   Cristina Lopes26, 27 Author Orcid Image ;   Diana Silva28 Author Orcid Image ;   Maria João Vasconcelos28 Author Orcid Image ;   Maria Fernanda Teixeira29 Author Orcid Image ;   Manuel Ferreira-Magalhães1, 2, 29 Author Orcid Image ;   Luís Taborda-Barata30, 31 Author Orcid Image ;   Maria José Cálix32 Author Orcid Image ;   Adelaide Alves33 Author Orcid Image ;   João Almeida Fonseca1, 2, 3, 34 Author Orcid Image
Article Authors Cited by (19) Tweetations (11) Metrics

    Original Paper

    1Center for Health Technology and Services Research, Faculty of Medicine, University of Porto, Porto, Portugal

    2Department of Community Medicine, Faculty of Medicine, Information and Health Decision Sciences, University of Porto, Porto, Portugal

    3Allergy Unit, Instituto and Hospital CUF, Porto, Portugal

    4Department of Cardiovascular and Respiratory Sciences, Porto Health School, Porto, Portugal

    5Department of Women’s and Children’s Health, Paediatric Research, Uppsala University, Uppsala, Sweden

    6Servicio de Alergia, Complejo Hospitalario Universitario de Santiago, Santiago de Compostela, Spain

    7Servicio de Alergia, Hospital Universitario Ramón y Cajal, Instituto Ramón y Cajal de Investigación Sanitaria, Madrid, Spain

    8Serviço de Imunoalergologia, Centro Hospitalar e Universitário de Coimbra, Coimbra, Portugal

    9Imunoalergologia, Centro Hospitalar de Leiria, Leiria, Portugal

    10Serviço de Imunoalergologia, Hospital de Dona Estefânia, Centro Hospitalar Universitário de Lisboa Central, Lisboa, Portugal

    11Serviço de Pneumologia, Hospital Beatriz Ângelo, Loures, Portugal

    12Serviço de Pediatria, Hospital da Senhora da Oliveira, Guimarães, Portugal

    13Serviço Pneumologia, Centro Hospitalar e Universitário de Coimbra, Coimbra, Portugal

    14Serviço de Pneumologia, Hospital Distrital da Figueira da Foz, Figueira da Foz, Portugal

    15Serviço de Pneumologia, Hospital Santa Marta, Centro Hospitalar Universitário de Lisboa Central, Lisboa, Portugal

    16Serviço de Pediatria, Hospital Pedro Hispano, Unidade Local de Saúde de Matosinhos, Matosinhos, Portugal

    17Serviço de Imunoalergologia, Hospital de Santa Maria, Centro Hospitalar Universitário Lisboa Norte, Lisboa, Portugal

    18Serviço de Imunoalergologia, Hospital Amato Lusitano, Unidade Local de Saúde de Castelo Branco, Castelo Branco, Portugal

    19Serviço de Imunoalergologia, Centro Hospitalar Universitário do Algarve, Portimão, Portugal

    20Serviço de Pneumologia, Hospital Garcia de Orta, Almada, Portugal

    21Serviço de Imunoalergologia, Serviço de Saúde da Região Autónoma da Madeira, Funchal, Portugal

    22Serviço de Imunoalergologia, Hospital do Divino Espírito Santo, Ponta Delgada, Portugal

    23Serviço de Pediatria, Unidade Hospitalar de Famalicão, Centro Hospitalar do Médio Ave, Vila Nova de Famalicão, Portugal

    24Serviço de Pneumologia, Hospital Nossa Senhora do Rosário, Centro Hospitalar Barreiro Montijo, Barreiro, Portugal

    25Serviço de Imunoalergologia, Unidade I, Centro Hospitalar Vila Nova de Gaia/Espinho, Vila Nova de Gaia, Portugal

    26Unidade de Imunoalergologia, Hospital Pedro Hispano, Unidade Local de Saúde de Matosinhos, Matosinhos, Portugal

    27Imunologia Básica e Clínica, Faculdade de Medicina, Universidade do Porto, Porto, Portugal

    28Serviço de Imunoalergologia, Centro Hospitalar Universitário de São João, Porto, Portugal

    29Serviço de Pediatria, Centro Materno Infantil do Norte, Centro Hospitalar Universitário do Porto, Porto, Portugal

    30Department of Allergy & Clinical Immunology, Cova da Beira University Hospital Centre, Covilhã, Portugal

    31Environment & Health Study Group, Faculty of Health Sciences, Health Sciences Research Centre, University of Beira Interior, Covilhã, Portugal

    32Serviço de Pediatria, Hospital de São Teotónio, Centro Hospitalar Tondela–Viseu, Viseu, Portugal

    33Serviço de Pneumologia, Unidade I, Centro Hospitalar Vila Nova de Gaia/Espinho, Vila Nova de Gaia, Portugal

    34Medicina, Educação, Investigação, Desenvolvimento e Avaliação, Porto, Portugal

    Corresponding Author:

    Cristina Jácome, PhD

    Center for Health Technology and Services Research

    Faculty of Medicine

    University of Porto

    Rua Dr Plácido da Costa

    Porto, 4200-450

    Portugal

    Phone: 351 225 513 622

    Fax:351 225 513 668

    Email: cristinajacome.ft@gmail.com


    Background: Poor medication adherence is a major challenge in asthma, and objective assessment of inhaler adherence is needed. The InspirerMundi app aims to monitor adherence while providing a positive experience through gamification and social support.

    Objective: This study aimed to evaluate the feasibility and acceptability of the InspirerMundi app to monitor medication adherence in adolescents and adults with persistent asthma (treated with daily inhaled medication).

    Methods: A 1-month mixed method multicenter observational study was conducted in 26 secondary care centers from Portugal and Spain. During an initial face-to-face visit, physicians reported patients’ asthma therapeutic plan in a structured questionnaire. During the visits, patients were invited to use the app daily to register their asthma medication intakes. A scheduled intake was considered taken when patients registered the intake (inhaler, blister, or other drug formulation) by using the image-based medication detection tool. At 1 month, patients were interviewed by phone, and app satisfaction was assessed on a 1 (low) to 5 (high) scale. Patients were also asked to point out the most and least preferred app features and make suggestions for future app improvements.

    Results: A total of 107 patients (median 27 [P25-P75 14-40] years) were invited, 92.5% (99/107) installed the app, and 73.8% (79/107) completed the 1-month interview. Patients interacted with the app a median of 9 (P25-P75 1-24) days. At least one medication was registered in the app by 78% (77/99) of patients. A total of 53% (52/99) of participants registered all prescribed inhalers, and 34% (34/99) registered the complete asthma therapeutic plan. Median medication adherence was 75% (P25-P75 25%-90%) for inhalers and 82% (P25-P75 50%-94%) for other drug formulations. Patients were globally satisfied with the app, with 75% (59/79) scoring ≥4,; adherence monitoring, symptom monitoring, and gamification features being the most highly scored components; and the medication detection tool among the lowest scored. A total of 53% (42/79) of the patients stated that the app had motivated them to improve adherence to inhaled medication and 77% (61/79) would recommend the app to other patients. Patient feedback was reflected in 4 major themes: medication-related features (67/79, 85%), gamification and social network (33/79, 42%), symptom monitoring and physician communication (21/79, 27%), and other aspects (16/79, 20%).

    Conclusions: The InspirerMundi app was feasible and acceptable to monitor medication adherence in patients with asthma. Based on patient feedback and to increase the registering of medications, the therapeutic plan registration and medication detection tool were redesigned. Our results highlight the importance of patient participation to produce a patient-centered and engaging mHealth asthma app.

    JMIR Mhealth Uhealth 2021;9(5):e26442

    doi:10.2196/26442

    Keywords

    mHealth; smartphone; technology assessment; medication adherence; self-management; gamification; patient participation 


    Inhaled preventive medications are the cornerstone of effective asthma treatment, reducing symptoms and exacerbations [1]. Yet in the last three decades, rates of adherence among patients with asthma remained unchanged, ranging from 19% to 64% [2]. Poor medication adherence is thus a major challenge in asthma [2,3] and is a leading driver of poor health outcomes, including emergency department visits, hospitalizations, and increased health care costs [4]. Based on this significant burden, medication adherence is a top priority for disease management [1] and policy agendas [5,6].

    Research efforts to tackle medication nonadherence have not led to the much needed improvement [7]. Behavioral and educational interventions had modest effects, possibly because most propose one-size-fits-all solutions for distinct nonadherence phenotypes (erratic, unwitting, intelligent) [8]. These interventions also failed to consider facilitators for real-world implementation [8]. The objective measurement of inhaler adherence is another major problem [9]. Electronic monitoring devices are available but their dissemination in real-world practice is difficult and costly [10].

    Mobile health (mHealth) technologies may be promising to support medication adherence as they are easily integrated into patients’ everyday lives, especially if using only smartphone embedded sensors [11]. mHealth allows the combination of computation, communication, and interactive display that makes it possible to use gamification and peer support tools with the potential to inspire behavior changes and offer treatment adherence quantification [11,12]. Moreover, patients with asthma have increasingly high smartphone ownership levels and are interested in using disease-specific apps [13,14].

    The InspirerMundi app development was grounded in previous research and cooperation with patients with asthma and physicians [15]. The app aims to transform adherence to inhalers into a positive experience through gamification and social support while allowing for verified inhaler adherence monitoring. The concept and gameplay of the InspirerMundi app derive from promoting user social interaction in a quest to help other users increase inhaler adherence (while being an example of good adherence). The user’s goal is to become an Inspirer to increase the sphere of positive influence by coaching an expanding network of Warriors (as Warriors progress and keep good medication adherence, they can become Inspirers themselves). The most innovative app technology is the medication detection tool based on advanced processing of inhaler images captured with the smartphone camera [16].

    The app development process was iterative with real-life tests and improvements based on user feedback. The first version was previously tested in a usability study, and improvements were made [17]. It is believed that the InspirerMundi app is innovative in measuring and improving medication adherence in patients with asthma. Before studying its effectiveness, however, there is a need for feasibility studies to monitor its use and evaluate its acceptability. Thus, this study aimed to evaluate the feasibility and acceptability of the InspirerMundi app to monitor medication adherence in adolescents and adults with asthma.


    Study Design

    A multicenter observational study with one initial face-to-face visit and a telephone interview at 1 month was conducted [18]. During the study, an additional telephone interview at 1 week for additional data collection and 3 text messages (at 2, 14, and 21 days) to promote app engagement were added. A convenience sample of adolescents and adults with persistent asthma was recruited between November 2017 and April 2019 at 26 allergy, pulmonology, and pediatric secondary care centers in Portugal (North, Centre, Lisbon, Algarve, Azores, and Madeira regions) and Spain (Galicia and Madrid regions). Centers were asked to recruit at least 2 patients as a minimum of 20 adolescents and 20 adults were targeted [19,20]. The study protocol was approved by the ethics committees of all participating centers. The study was conducted in accordance with the ethical standards established in the Declaration of Helsinki. Eligible patients were approached by physicians during medical visits and invited to participate in a study on the use of an app to register their asthma medication daily intake. Written informed consent was obtained before enrollment in the study. Adult patients signed a consent form; adolescents signed an assent form and a parental consent form was also obtained. The study is reported according to STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) guidelines [21].

    Participants

    Patients were included if they (1) had a previous medical diagnosis of persistent asthma, (2) were at least 13 years old (13 to 17 years for adolescents; 18 years and older for adults), (3) were able to use mobile apps and had access to a mobile device with internet access, and (4) had an active prescription for a daily inhaled controller medication for asthma. All inhaled controller treatments were allowed, and there was no change in any prescribed medication as a result of the participation in this study. Patients were excluded if they had a diagnosis of a chronic lung disease other than asthma or a diagnosis of another significant chronic condition with possible interference with the study aims.

    InspirerMundi App

    The InspirerMundi app is focused on supporting patient medication management and promoting treatment adherence. The InspirerMundi app is grounded on the Fogg behavior model, which states that a behavior is performed when 3 elements converge in a given moment: motivation, ability, and trigger (Table 1) [22]. The app includes registration of the therapeutic plan, which activates notifications when a medication is due (trigger) and allows recording of performed intakes through a medication detection tool that uses the smartphone camera. The medication detection tool is based on advanced image processing techniques and identifies the inhaler through template matching [15]. At the time of the study, the tool could detect 6 inhaler devices containing numeric dose counters (Diskus/Accuhaler [GlaxoSmithKline PLC], Ellipta [GlaxoSmithKline PLC], Flutiform pMDI [Napp Pharmaceuticals LTD], Novolizer/Genuair [AstraZeneca], Spiromax [Teva Pharmaceutical Industries LTD], Turbohaler [AstraZeneca]). The medication detection tool can also be applied to other types of inhalers or other drug formulations (eg, blister or other recipients) but the template matching feature cannot. In the app version tested, a scheduled intake was considered taken when patient presented the medication (inhaler, blister, or other drug formulation) to the detection tool (10 seconds). Adherence statistics are provided to the user in the form of circular progress graphs (motivator: self-monitoring; ability: simplifies adherence measurement). Besides planned medication, the user may also record relief medication intake events that are not considered for treatment adherence assessment. Physician involvement is also supported by providing the user with the possibility of sharing the registered therapeutic plan and respective adherence data. Medication management is supported by a timeline that reflects the registered therapeutic plan. The timeline also includes events related to gamification and symptom monitoring. Patients are invited to answer 3 types of questionnaires related to their symptoms and asthma control: daily questionnaire (daily after 6 PM), weekly questionnaire (once per week), and Control of Allergic Rhinitis and Asthma Test (CARAT, by default once per month but can be personalized by the patient to weekly or every 2 weeks) [23] (motivator: self-monitoring, personalization; ability: simplifies assessment of asthma control). CARAT total score is calculated by summing the 10 questions resulting in a range of 0 to 30 points. A score >24 indicates good disease control [24], and this classification is presented to the patient (motivator: anticipation/hope of a health improvement). This questionnaire is available in multiple languages, and its psychometric properties are established [25].

    The concept and gamification dynamics are twofold: achievement challenges and social interaction (motivator: belonging, social acceptance, app as a social actor). Gameplay and mechanics included in the app derive from achievement points and badges (triggers) and by promoting social interaction based on a story of evolving from a Warrior (beginner player, level 1) to an Inspirer (advanced player, an example of good adherence, available from level 10 onward), who can motivate Warriors to improve adherence (motivators: cooperation, competition, recognition). The main components that support the game are points earned when users take certain actions (motivator: sensation of pleasure, positive reward) such as registering a new medication, registering scheduled medication intakes at the right time, answering symptom questionnaires, or getting a positive assessment from other users in their network. Registering events of relief medication does not generate additional points. When registering a relief medication intake, patients are invited to rate the severity of symptoms experienced on a visual analog scale (VAS; 0 to 100) and report any use of health care. Another encouragement for user interaction is the attribution of virtual badges (12 available; motivator: sensation of pleasure, positive reward). Whenever the user reaches a certain goal (eg, Role Model badge when the user links to the first Warrior) or does something special (eg, Big Influencer badge when the user reaches 5 Warriors), they will be rewarded and get a virtual badge for their actions. The app, developed in Portuguese, English, and Spanish, is available in the App Store (version 1.1) and Google Play (versions 1.1.x); app is only available for download in Portugal and Spain. Screenshots of the app version tested (version 1.1) are presented in Figure 1, and videos are available [26-29].

    ‎
    Figure 1. InspirerMundi app screenshots (version 1.1).
    View this figure
    Table 1. Elements of the Fogg behavior model in the InspirerMundi app.
    Elements and description of the Fogg behavior modelApp featureApp component
    Trigger

    		Facilitator of adherenceSignal: notification appears when a medication intake is dueMedication management

    		Facilitator of medication intake registrationSignal: intake icon flashes when a medication intake is dueMedication management

    		Facilitator of asthma control assessmentSignal: questionnaire icon flashes when a response is dueCARATa, daily questionnaire, and weekly questionnaire

    		Facilitator of adherenceSignal: buzzes when an Inspirer sends a medication reminder to a WarriorMedication management, gamification

    		Facilitator of adherenceSignal: icon of message appears (exchange between Inspirer and Warrior)Gamification
    Ability

    		Simplifies adherence measurementAdherence statistics: circular progress graphMedication management

    		Simplifies assessment of asthma controlAsthma control classificationCARAT
    Motivator

    		Self-monitoringAdherence statistics: circular progress graphMedication management

    		Self-monitoring, personalizationPersonalized frequencyCARAT

    		Anticipation/hope of a health improvementAsthma control classificationCARAT

    		Belonging, social acceptance, app as a social actorSocial interactionGamification

    		Cooperation, competition, recognitionInspirer and Warrior playersGamification

    		Sensation of pleasure, positive rewardPointsGamification

    		Sensation of pleasure, positive rewardVirtual badgesGamification

    aCARAT: Control of Allergic Rhinitis and Asthma Test.

    Data Collection

    During the initial face-to-face visit, physician recorded if it was a first or follow-up appointment; patient’s asthma control according to the Global Initiative for Asthma (GINA) [1]; number of exacerbations in the previous year (defined as episodes of progressive increase in shortness of breath, cough, wheezing, and/or chest tightness requiring a change in maintenance therapy [30]); and use of health care resources in the previous year (ie, number of unscheduled medical visits to primary care, secondary care, or emergency department and number of hospital admissions). Physician also recorded patient’s current asthma treatment, including inhaled and oral medication, allergen immunotherapy, and biologic therapy. At the visit, patient answered written questionnaires on demographic data (age, gender, BMI, smoking habits), adherence to inhaled controller asthma medication during the previous week, and perception of the correctness of inhaler technique (using a 100 mm VAS), asthma control during the previous 4 weeks (using CARAT), perception of their overall health (using the EuroQol 5-Dimension [EQ-5D] VAS [31]), and previous use of health and fitness apps.

    At 1 week and 1 month, patients were asked in a telephone interview about their adherence to inhaled controller medication during the previous week (on a 0 to 100 scale) and their asthma control with CARAT. At 1 month, they were asked to rate the app usability using 4 items of the System Usability Scale (ease of use, function integration, confidence in using, would use frequently) [32]. Patients were also asked about their general satisfaction with the app and app components (gamification, peer support, symptom monitoring, medication detection tool, adherence monitoring), their willingness to recommend the app to others, and the impact of the app on the motivation to adhere to the inhaler. All these satisfaction questions were assessed using a 1 (low) to 5 (high) scale. Patients were asked open questions on the most and least preferred app features and asked to make suggestions for app improvements. These telephone interviews could also provide support regarding any technical issues with the app or study-related doubts. Nonscheduled telephone contacts could also occur, as patients were provided with email and telephone contacts to use in case of any app technical issue; this was rarely used. Interviews were performed by a central team of trained health professionals and lasted around 15 minutes. An interview guide was used to standardize data collection across all patients.

    Data Analysis

    Descriptive statistics were used to characterize the sample and app use. The normality of each variable was investigated with Kolmogorov-Smirnov tests and visual analysis of histograms. The app use rate was taken as the ratio between the number of days with app use and the period of use (31-day period). Adherence to medication measured by the app was calculated using 2 methods: considering the medication taken only on days with app use and considering the medication taken regardless of app use (ie, considering all medication scheduled for the 31-day period). Comparison of the characteristics of patients installing the app versus those not installing, using the app for more than 1 day versus single-day use, completing the study versus dropouts, and adolescents versus adults were performed using independent samples t tests, Mann-Whitney U tests for continuous variables, and chi-square tests for categorical variables. A Fisher test was used to compare adherence to inhalers measured by the app with patient self-reports (at the initial visit, 1 week, and 1 month). The Wilcoxon test and McNemar test were used to analyze differences in CARAT total score and CARAT control classification, respectively. Statistical analyses were performed using SPSS (version 26.0, IBM Corp) and plots were created using GraphPad Prism (version 6.0, GraphPad Software). The level of significance was set at .05. A thematic qualitative analysis of patient feedback (ie, opinions, suggestions) about the app collected during the 1-month telephone interview was also conducted. Notes from the interviews were read, and emerging themes were grouped. Description of patient feedback in major themes is supported with translated representative statements.


    Participants

    A total of 107 patients were included: 77 from 24 Portuguese centers and 30 from 2 Spanish centers. Patients included mostly adults (77/107; 72.0%) and females (63/107; 58.9%). Most were on inhaled corticosteroid/long-acting beta-agonist combination therapy (90/107; 84.1%) and used only one inhaler (67/107; 62.6%). Based on GINA classification, almost half (52/107; 48.6%) of the participants did not have their asthma well controlled. Characteristics of the participants are shown in Table 2.

    Table 2. Participant baseline characteristics (n=107).
    CharacteristicTotal (n=107)Did not install app (n=8)App used 1 day (n=25)App used >1 day (n=74)
    Age (years), median (P25-P75a)27 (17-40)40 (28-46)22 (16-40)26.5 (17-39)
    Adults, n (%)77 (72.0)8 (100)15 (60)54 (73)
    Female, n (%)63 (58.9)6 (75)10 (40)47 (64)
    BMI (kg/m2), median (P25-P75)23.1 (21-27)26.2 (22-27)24 (22-29)22.8 (21-26)
    Smoking status, n (%)




    		Never smoker79 (73.8)5 (63)17 (68)57 (77)

    		Ex-smoker19 (17.8)3 (37)5 (20)11 (15)

    		Current smoker9 (8.4)03 (12)6 (8)
    Inhaled medication, n (%)




    		ICSb/LABAc90 (84.1)6 (75)23 (92)61 (82)

    		SABAd26 (24.3)3 (38)9 (36)14 (19)

    		ICS13 (12.1)1 (13)2 (8)10 (14)

    		LAMAe10 (9.3)01 (4)9 (12)
    Single inhaler, n (%)67 (62.6)4 (50)15 (60)48 (65)
    VASf self-reported inhaler adherence (0-100)g80 (60-90)83 (59-91)79 (53-90)85 (65-90)

    		High (81-100), n (%)51 (47.7)4 (50)7 (28)40 (54)

    		Medium (51-80), n (%)37 (34.6)3 (38)12 (48)22 (30)

    		Low (0-50), n (%)15 (14.0)1 (12)4 (16)10 (14)
    VAS correctness of inhaler technique (0-100)99 (90-100)92.5 (89-99)90 (80-100)99.5 (90-100)
    Oral medication, antileukotriene, n (%)42 (39.3)08 (32)34 (46)
    Allergen immunotherapy, n (%)19 (17.8)2 (25)5 (20)12 (16)
    Biologic therapy, n (%)8 (7.5)01 (4)7 (9)
    GINAh assessment symptom controli, n (%)




    		Well controlled53 (49.5)3 (38)11 (44)39 (53)

    		Partly controlled/uncontrolled52 (48.6)4 (50)13 (52)35 (47)
    CARATj total score, mean (SD)21 (17-23)14.5 (9-27)20 (16-22)21 (17-24)
    ≥1 exacerbation past year, n (%)52 (48.6)6 (75)16 (64)30 (41)
    ≥1 unscheduled medical visit past year, n (%)27 (25.2)2 (25)10 (40)15 (20)
    EQ-5Dk VAS, mean (SD)80 (70-90)80 (58-89)75 (65-85)82 (70-90)
    First medical visit, n (%)23 (21.5)4 (50)8 (32)11 (15)
    Previous use of health and fitness apps, n (%)58 (54.2)5 (63)12 (50)41 (55)

    aP25-P75: percentile 25 to percentile 75.

    bICS: inhaled corticosteroid.

    cLABA: long-acting beta-agonist.

    dSABA: short-acting beta-agonist.

    eLAMA: long-acting muscarinic receptor antagonist.

    fVAS: visual analog scale.

    g4 missing values.

    hGINA: Global Initiative for Asthma.

    i2 missing values.

    jCARAT-T: Control of Allergic Rhinitis and Asthma Test total score.

    kEQ-5D: EuroQol 5-Dimension test.

    App Use

    In total, 92.5% (99/107) of patients installed the app. The 8 patients who did not install the app were more frequently in a first medical appointment with that physician (P=.02) and tended to be older (P=.05) than those who installed the app. No other significant differences were observed between the 2 groups. More than half (64/99; 65%) of patients installed the app on the recruitment day or the following day (median 0 [P25-P75 0-5]; Figure 2).

    ‎
    Figure 2. Percentage of users installing the app per study day.
    View this figure

    Patients interacted with the app a median of 9 (P25-P75 1-24) days: 25% (25/99) only 1 day and 10% (10/99) all 31 days (Figure 3). A median use rate of 29% (P25-P75 3%-77%) was observed. Patients interacting only 1 day were more frequently male (P=.04), had a worse perception of their health status (P=.045), and had more exacerbations in the previous year (P=.04) in comparison with patients interacting more than 1 day. Although not reaching statistical significance, these patients had a higher need for unscheduled medical visits in the previous year (P=.05), more frequent short-acting beta-agonist prescribed in their therapeutic plan (P=.09, physician-reported), and more frequent depression symptoms (P=.09).

    A total of 78% (77/99) of patients scheduled medication in the app (median 2 [P25-P75 1-3] medications) for 25 (P25-P75 17-31) days: 74% (73/99) registered at least 1 inhaler and 42% (42/99) at least another medication (eg, pills, nasal spray). The asthma therapeutic plan reported by the physician included a median of 2 (P25-P75 1.8-2) medications. A total of 53% (52/99) of participants registered all prescribed inhalers and 34% (34/99) registered the complete asthma therapeutic plan (inhaler and other drug formulations). Two (2%) patients also used the app to register medications not related to asthma.

    Median inhaler adherence assessed through the app was 81% (P25-P75 58%-92%) when considering only days with app use and 62% (P25-P75 23%-81%) when considering all scheduled inhalations for the 31-day period (P<.001). Higher estimates were observed when patients self-reported adherence at initial visit (85 [P25-P75 63-90]), 1-week (95 [P25-P75 80-100]) and 1-month (100 [P25-P75 90-100]) interviews (P<.001; all pairwise comparisons P<.009 with exception of 1-week and 1-month interview that were not different). Median adherence for other drug formulations was 83% (P25-P75 50%-94%) when considering only days with app use and 73% (P25-P75 26%-94%) when considering all scheduled inhalations for the 31-day period (P<.001).

    A total of 17% (17/99) registered the use of relief medication for at least 1 day (median 1 [P25-P75 1-2]): 13% (13/99) used inhalers, 4% (4/99) other drug formulations (pills, nasal spray), and 1% (1/99) inhaler plus others. During these episodes, symptom severity reached a median VAS of 43 (P25-P75 29-60), with 2% (2/99) of patients reporting emergency department visits and 1% (1/99) an unscheduled medical appointment.

    A total of 63% (62/99) of patients answered symptom questionnaires: 62% (61/99) answered at least one CARAT (median 1 [P25-P75 1-2]), 58% (57/99) answered weekly symptom questionnaires (median 4 [P25-P75 2-4]), and 42% (42/99) answered daily symptom questionnaires (median 9.5 [P25-P75 4-13.3]). A total of 76% (75/99) received at least one badge (2 [P25-P75 2-3]), 63% (62/99) achieved 1000 points, and 21% (21/99) achieved 10,000 points. A total of 6% (6/99) of users became Inspirers, a role achieved between 5 and 28 days of app use.

    ‎
    Figure 3. Daily participant engagement with the InspirerMundi app (n=97, 2 users with missing information). Each dot represents a day with interaction, and each color represents a participant.
    View this figure

    App Satisfaction

    A total of 74% (79/107) of patients completed the 1-month interview (28/107; 26% dropout rate). After 1 month, CARAT scores improved (21 [P25-P75 16-23] vs 25 [P25-P75 22-27]; P<.001), with the proportion of patients with controlled asthma increasing from 20% (16/79) to 53% (42/79; P<.001). Patients were globally satisfied with the app, with 75% (59/79) scoring ≥4 on a 1 to 5 scale (33% [26/79] scored 4 and 42% [33/79] scored 5), with the adherence monitoring, symptom monitoring, and gamification being the most highly scored components (Figure 4). Only 14% (11/79) were not satisfied with the app (score ≤2). Patients found the app easy to use, considered the functions well integrated, felt confident using the app, and would like to use it frequently. A total of 77% (61/79) of patients would recommend the app to other patients, and 53% (42/79) believed the app had motivated them to improve adherence to inhaled medication. In general, adolescents were more satisfied with the app than adults (Figure 4).

    ‎
    Figure 4. App feedback from adolescents and adults (n=79). Data are presented as box plots (lines inside the boxes represent the medians; bounds of boxes, first and third quartiles; bars, 95% confidence interval). *Significant differences between adolescents and adults.
    View this figure

    App Features Feedback

    All patients provided feedback on the app, 95% (75/79) pointed out the aspects that they valued most, 73% (58/79) mentioned aspects least preferred, and 62% (49/79) made improvement suggestions. Patient feedback was reflected in 4 major themes: medication-related features (67/79, 85%), gamification and social network (33/79, 42%), symptom monitoring and physician communication (21/79, 27%), and other aspects (16/79, 20%). These themes are described in detail below.

    Medication-Related Features

    Patients pointed out the notifications for the medication (47/79, 59%) and adherence statistics (18/79, 23%) as strengths of the app. Yet 2 patients reported problems in receiving notifications, and 2 suggested improvements such as making notifications clearer, sending a second notification if the medication was not taken within 1 hour, and allowing the confirmation of medication intake without entering the app. The available time to confirm the medication intake (2 hours after the notification) was considered inflexible (13/79, 16%) as it did not allow for confirmation if the medication was taken earlier (before the notification) or later. This was seen as a disadvantage as it compromised the game and adherence statistics. Patients asked for the possibility to also confirm medications when outside of scheduled hours (15/79, 19%).

    [Notifications] It helped me to remember to take the medication.
    With the adherence statistics, I have a better perception of my real adherence.
    I lost points because I took the medication out of the scheduled hours, and I was not able to confirm it.

    The need to use the medication detection tool to confirm each medication intake was seen as a weak point (22/79, 28%), mainly due to the predefined time to capture the image, perceived as long. This was especially burdensome for patients with more complex medication regimens (eg, more than one control medication per day). Patients suggested that the medication detection tool could be faster in detecting the dose counter (5/79, 6%), provide feedback of the identified number (2/79, 3%), and be activated only at certain time points (eg, every 5 days or with personalized frequency; 4/79, 5%). Two patients would like the app to include educational content related to asthma and inhalation technique.

    The time I need to wait for the app to take the picture of the inhaler...
    There could be an option that allows you not to have to take a photo of the inhaler daily, but to take it, for example, on the first day and after 5 or 7 days.
    The app could include a demonstration on how to use the inhaler using images.

    Registration of controller or relief medication was reported as difficult by 4 patients and they asked for a simpler process, suggesting, for example, selecting the medication from a provided list, not needing to insert a new medication when a new inhaler is bought, and personalizing scheduled times depending on the day of the week (eg, during weekends).

    I found it difficult to register an SOS intake; I need more information to be able to use this feature.
    When the inhaler is over, it would be nice not to have to register a new inhaler with all the data.
    Gamification and Social Network

    Opinions differed with regard to the gamification and social network components: 18% (14/79) of patients (both adolescents and adults) were happy and stated that these components were an additional motivation to improve adherence; 13% (10/79, 9 adults) felt these components were unnecessary or not adding benefit. Two patients reported the gamification approach as confusing, and others did not like the Inspirers avatar.

    The game increases my motivation to take the medication.
    I don’t have any interest in using the game or to share experiences in the social network.
    Symptom Monitoring and Physician Communication

    Patients pointed out the advantages of symptom monitoring (10/79, 13%), with three acknowledging that it increased their perception of disease control (n=3). Three patients also highlighted the utility of the app to share clinical information (use of relief medication, symptoms) with the physician (n=3). One patient suggested a more direct connection with the physician through a chat, for example, to receive recommendations, clarify doubts, and even schedule appointments, and another suggested the addition of features to compare symptom evolution.

    I liked the symptom questionnaire and interpretation. The questionnaires were simple to fill in.
    The possibility to have a reliable registration of my disease trajectory and to be able to show to a health professional. I hope to have benefits with this registration!
    It would be good to chat with my physician, clarify doubts, and schedule appointments.
    I would like to compare the results of the questionnaires to be able to notice if there was any improvement in symptoms or not.
    Others

    Patients reported experiencing technical difficulties/bugs (during log-in, registration of symptom questionnaires, medication detection tool; sometimes the app crashed or closed unexpectedly [8/79, 10%]) and two patients reported that the app used significant storage space (n=2). Other suggestions were a timeline showing the present events by default, simplified log-in (eg, touch ID), and improved access to Definitions and Profile menus.

    The app could be smaller.
    Log-in could be simplified, and could be with smartphone biometry.

    App Changes Based on Patient Use and Feedback

    Based on patient feedback, two major changes were implemented in a new Android app (version 1.2): redesign of the therapeutic plan registration module and medication detection tool. Now, to register an inhaler, the patient is provided with images of the most common inhalers available on the Portuguese and Spanish markets and once the patient selects the inhaler type, a drop-up list presents all names/dosages of medications available on the market. The patient can also select different schedules on different days, allowing the personalization requested. To allow the registration of the complete asthma therapeutic plan, the patient can indicate if the controller inhaler can also be used as relief and how many inhalations are recommended in that case. Also, as registering medications is the only way the app produces notifications, this is now the first task asked once the patient enters the app.

    When a medication is due, notifications provide information on the medication and posology and the patient can select 1 of 3 options: confirm medication was taken, delay medication intake (from 5 to 120 minutes), or decide not to take it. Patients now have until the end of the day to confirm medication was taken. The medication detection tool is currently able to detect 12 inhaler devices containing numeric dose counters available on the Portuguese and the Spanish markets. The medication detection tool is activated daily only for inhalers (not for other drug formulations) to reduce the users’ burden. When the patient confirms medication was taken, an initial screen with instructions on how to match the inhaler with the template is provided, but in the current version instead of an example figure, we use a short video demonstrating the task (patients can decide to inactivate these instructions whenever they want to accelerate the process). A feature to provide feedback on the identified number in the inhaler was already developed [16] allowing the user to correct the number, and it will be introduced in a future app version. Reasons for deciding not to take a medication can also be registered (eg, medication is empty, this dose is not needed, secondary effects). Screenshots with these app changes are presented in Figure 5, and videos are available [33,34].

    ‎
    Figure 5. InspirerMundi app screenshots (version 1.2).
    View this figure

    Principal Findings

    The InspirerMundi app was found to be feasible to monitor medication adherence and positively evaluated by patients with persistent asthma. The results of this study provide an understanding of the feasibility and acceptability of this mHealth technology in this population. The study contributed to identify improvements for a better user experience before effectiveness studies are undertaken.

    Patient use rate of the app is similar to a previous mHealth asthma observational study (median of 12 days in the first 3 months) [35,36], and it is within the range described in digital health studies (median 6 days, range 2 to 26, in the first 3 months) [36]. Nevertheless, we consider the patient use rate lower than expected as the app was directly recommended by a physician and app use was reinforced by 3 text messages and a telephone interview. This low engagement may be linked to the real-world nature of these studies and the low previous use of asthma apps (<5%) [13]. Importantly, it may also be related to the low level of maturity of some of the app technologies. Less than one-third of patients interacted with the app only 1 day, which is lower than previously described behaviors [36]. These patients were found to be the ones with worst asthma outcomes, such as unscheduled medical visits and exacerbations, and worst perception of health status. Chan et al [35] also observed that the group of patients with fewer interactions with an asthma app were the ones with higher hospitalization rates and emergency department visits. Male patients were also associated with lower interaction, in accordance with previous observations of male patients to be less likely to adopt health apps [37]. These observations need to be considered in the design of mHealth-based interventions to improve adherence to medications.

    A small proportion of patients entered the study but did not install the app (8%), which is in line with previous studies with asthma apps [38]. It was not surprising to observe that these patients were older and most commonly were in a first medical appointment. In fact, older patients are the least represented in digital health studies [36,39] and are also less likely to adopt health apps [37]. First appointments with a health care provider are linked to a greater discordance between patients and physicians [40], which may contribute to reducing the known role of physician recommendation as a facilitator of mHealth adoption [36,41]. The total dropout rate (26%) is in accordance with rates in feasibility studies with digital interventions [42] but higher than previously described in clinical trials [38]. This dropout rate was expected given the real-world nature of the feasibility study involving patients from a large number of secondary care centers (26 in total), very diverse in terms of settings—secondary and tertiary care, public and privately owned, dimension, geographic regions, and medical specialties (allergy, pulmonology, and pediatrics). This is contrasted with clinical trials, which are most often conducted in well-selected academic centers with more homogeneous samples and a high number of face-to-face visits.

    More than three-quarters of patients used the app for medication management and adherence monitoring, which were the primary aims of app use, and a median score of 4 out of 5 was obtained for this app feature. Self-reported inhaler adherence at the initial visit, 1-week and 1-month interview overestimated adherence measured with the app. This was somewhat expected as self-reports had a near to perfect treatment adherence behavior, which is unlikely to be the case [40]. Overestimation of adherence measured by the app is also possible, as no objective confirmation of the inhaler dose counter was performed in this version. New versions of the app should assess inhaler adherence more objectively by validating inhaler use through dose tracking. The medication detection tool is currently working with 13 inhaler devices containing numeric dose counters available on the Portuguese and Spanish markets [16]. To improve the generalizability of the app and its use in multicenter international studies, inhalers available in other countries will be added in future versions of the app.

    Patient evaluations were positive: three-quarters were globally satisfied (75%), reporting scores of 4 (33%) and 5 (42%). The InspirerMundi app acceptability was similar to that described in other feasibility studies of mHealth apps [43-45]. Notifications for medication intake were considered helpful [20,46]. Patients made important contributions for improvement such as the need to make notifications clearer and registration of medications easier. These requested changes are in line with user reviews for other adherence apps [46] and were implemented in the InspirerMundi Android version 1.2, currently being tested by patients recruited at primary care centers. Patients also suggested improvements to the medication detection tool, which led to the tool’s redesign, including feedback on the identified number.

    Symptom monitoring, used by almost two-thirds of patients, was one of the most highly scored components, with patients stating that it increased their perception of asthma control [20]. Patients valued the feature of sharing information with physician [20,46] and requested other patient-physician partnership tools. In the tested version, patients could send data on the therapeutic plan registered in the app and respective adherence to their physician by email. New simple and easily read reports (including graphs/charts) have been designed, and a tool for remote personalized feedback is being planned. We believe these upgrades will facilitate the integration of app data into clinical workflow and strengthen the patient-physician partnership.

    Based on patient feedback, improvements on gamification, social support and monitoring features, and integration of educational content are needed to ensure ongoing digital engagement. The team is considering the integration of new gamification dynamics and mechanics (eg, avatar personalization, progression bars, boosters, exchange points, other tangible rewards), social support features (eg, discussion forums, mentoring, group actions), and educational features (eg, training videos on inhalation technique) [20]. There were opposing opinions regarding the gamification and social network components, also observed in a previous study with adolescents with asthma [20]. To accommodate these differences, and as personalized strategies to treatment adherence have better results [47,48], gamification and social network features of the app will become optional and patients not willing to use these features will be able to turn them off. This modification is in line with previous work advocating that flexible apps may better meet the needs of a broader range of patients [49,50].

    Limitations

    This study has limitations. As a feasibility study, a control group was not included, and the sample size was not powered. This was a deliberate choice to test the feasibility and acceptability of the app for the first time. As the study was conducted at secondary care centers from Portugal and Spain, results may not be generalized to other settings or countries. An updated version of the app is being tested in Portuguese primary care centers. Participation in the study was restricted to patients who have access to a smartphone. Although smartphones are increasingly prevalent in patients with asthma [13], this requirement excluded otherwise eligible patients and limits the generalizability to smartphone owners. Using an app to improve treatment adherence will not be a solution for all patients, as happens with most, if not all, approaches. With this study, previous ones, and others planned it should be possible to identify those patients who may benefit from InspirerMundi app strategies. The use of two methods to calculate medication adherence may also be seen as a limitation of the study, yet it was a mitigation plan to overcome the absence of a standardized method to measure adherence [9].

    Conclusion

    In conclusion, the InspirerMundi app was feasible and acceptable to monitor medication adherence in adolescents and adults with asthma. Based on patient feedback, redesign of the therapeutic plan registration and the medication detection tool have already been implemented, and other changes to the app are being considered. This study is part of a continuous development cycle that will continue with its multiple improvement and evaluation phases grounded on the interaction with end users, aiming to produce a patient-centered and engaging mHealth asthma app.

    Acknowledgments

    We thank the participants and centers involved in this study. We would also like to acknowledge all members of the Inspirers group [51] and Mundipharma-Portugal for supporting the dissemination of the InspirerMundi app. This work was funded by the European Regional Development Fund through the operations: POCI-01-0145-36 FEDER-029130 (mINSPIRE–mHealth to measure and improve adherence to medication in chronic obstructive respiratory diseases: generalization and evaluation of gamification, peer support, and advanced image processing technologies) and cofunded by COMPETE2020 (Programa Operacional Competitividade e Internacionalização) and Portugal 2020 and with Portuguese funds through Fundação para a Ciência e a Tecnologia.

    Conflicts of Interest

    JAF is the co-founder of SME, which owns the InspirerMundi app.

    1. Global strategy for prevention, diagnosis and management of COPD. Global Initiative for Chronic Obstructive Lung Disease. 2020.   URL: https://goldcopd.org/wp-content/uploads/2019/12/GOLD-2020-FINAL-ver1.2-03Dec19_WMV.pdf [accessed 2021-05-15]
    2. Bender BG. Nonadherence to asthma treatment: getting unstuck. J Allergy Clin Immunol Pract 2016;4(5):849-851. [CrossRef] [Medline]
    3. Hassan M, Davies SE, Trethewey SP, Mansur AH. Prevalence and predictors of adherence to controller therapy in adult patients with severe/difficult-to-treat asthma: a systematic review and meta-analysis. J Asthma 2020 Dec;57(12):1379-1388. [CrossRef] [Medline]
    4. Mäkelä MJ, Backer V, Hedegaard M, Larsson K. Adherence to inhaled therapies, health outcomes and costs in patients with asthma and COPD. Respir Med 2013 Oct;107(10):1481-1490 [FREE Full text] [CrossRef] [Medline]
    5. van Boven JFM, Lavorini F, Dekhuijzen PNR, Blasi F, Price DB, Viegi G. Urging Europe to put non-adherence to inhaled respiratory medication higher on the policy agenda: a report from the First European Congress on Adherence to Therapy. Eur Respir J 2017 May;49(5):1 [FREE Full text] [CrossRef] [Medline]
    6. Khan R, Socha-Dietrich K. Investing in medication adherence improves health outcomes and health system efficiency: adherence to medicines for diabetes, hypertension, and hyperlipidaemia. OECD Health Working Papers No 105. Paris: OECD Publishing; 2018.   URL: https:/​/www.​oecd-ilibrary.org/​deliver/​8178962c-en.​pdf?itemId=%2Fcontent%2Fpaper%2F8178962c-en&mimeType=pdf [accessed 2021-05-15]
    7. Kleinsinger F. The unmet challenge of medication nonadherence. Perm J 2018;22:18-033 [FREE Full text] [CrossRef] [Medline]
    8. Nieuwlaat R, Wilczynski N, Navarro T, Hobson N, Jeffery R, Keepanasseril A, et al. Interventions for enhancing medication adherence. Cochrane Database Syst Rev 2014;11:CD000011. [CrossRef] [Medline]
    9. Pednekar PP, Ágh T, Malmenäs M, Raval AD, Bennett BM, Borah BJ, et al. Methods for measuring multiple medication adherence: a systematic review-report of the ISPOR Medication Adherence and Persistence Special Interest Group. Value Health 2019 Feb;22(2):139-156 [FREE Full text] [CrossRef] [Medline]
    10. Howard S, Lang A, Sharples S, Shaw D. What are the pros and cons of electronically monitoring inhaler use in asthma? A multistakeholder perspective. BMJ Open Respir Res 2016;3(1):e000159 [FREE Full text] [CrossRef] [Medline]
    11. Pereira AM, Jácome C, Almeida R, Fonseca JA. How the smartphone is changing allergy diagnostics. Curr Allergy Asthma Rep 2018 Oct 25;18(12):69. [CrossRef] [Medline]
    12. Haase J, Farris KB, Dorsch MP. Mobile applications to improve medication adherence. Telemed J E Health 2016 Jun 01;23(2):75-79. [CrossRef] [Medline]
    13. Jácome C, Almeida R, Pereira A, Araújo L, Correia M, Pereira M, et al. Asthma app use and interest among patients with asthma: a multicenter study. J Investig Allergol Clin Immunol 2020 Apr 23;30(2):137-140 [FREE Full text] [CrossRef] [Medline]
    14. Jácome C, Marques F, Paixão C, Rebelo P, Oliveira A, Cruz J, et al. Embracing digital technology in chronic respiratory care: surveying patients access and confidence. Pulmonology 2020;26(1):56-59 [FREE Full text] [CrossRef] [Medline]
    15. Jácome C, Almeida R, Teixeira J, Vieira-Marques P, Vilaça R, Fernandes J, et al. Inspirers: an app to measure and improve adherence to inhaled treatment. In: IADIS International Conference e-Health 2017 (part of MCCSIS 2017).: IADIS Press; 2017 Presented at: IADIS International Conference e-Health; 2017; Lisbon p. 135-139   URL: http:/​/www.​iadisportal.org/​digital-library/​inspirers-an-app-to-measure-and-improve-adherence-to-inhaled-treatment
    16. Vieira-Marques P, Almeida R, Teixeira JF, Valente J, Jácome C, Cachim A, et al. InspirerMundi: remote monitoring of inhaled medication adherence through objective verification based on combined image processing techniques. Methods Inf Med 2021 Apr 27:1. [CrossRef] [Medline]
    17. Ferreira A, Almeida R, Jácome C, Fernandes J, Fonseca J, Vieira-Marques P. How inspiring is your app: a usability take on an app for asthma medication adherence. In: IADIS International Conference e-Health 2019 (part of MCCSIS 2019).: IADIS Press; 2019 Presented at: Proceedings of the 11th International Conference e-Health; 2019; Lisbon p. 225-229. [CrossRef]
    18. Jácome C, Guedes R, Almeida R, Teixeira J, Pinho B, Vieira-Marques P, et al. [mINSPIRERS: Feasibility of a mobile application to measure and improve adherence to inhaled controller medications among adolescents and adults with persistent asthma. Protocol for a multicentre observational study]. Rev Port de Imunoalergologia 2018;26(1):47-61 [FREE Full text] [CrossRef]
    19. Billingham SAM, Whitehead AL, Julious SA. An audit of sample sizes for pilot and feasibility trials being undertaken in the United Kingdom registered in the United Kingdom Clinical Research Network database. BMC Med Res Methodol 2013;13:104 [FREE Full text] [CrossRef] [Medline]
    20. Schneider T, Baum L, Amy A, Marisa C. I have most of my asthma under control and I know how my asthma acts: users' perceptions of asthma self-management mobile app tailored for adolescents. Health Informatics J 2019 Feb 08;26(1):342-353. [CrossRef] [Medline]
    21. Vandenbroucke JP, von Elm E, Altman DG, Gøtzsche PC, Mulrow CD, Pocock SJ, STROBE Initiative. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. Int J Surg 2014 Dec;12(12):1500-1524 [FREE Full text] [CrossRef] [Medline]
    22. Fogg B. A behavior model for persuasive design. 2009 Presented at: Proceedings of the 4th International Conference on Persuasive Technology; 2009; Claremont p. 40. [CrossRef]
    23. Fonseca JA, Nogueira-Silva L, Morais-Almeida M, Azevedo L, Sa-Sousa A, Branco-Ferreira M, et al. Validation of a questionnaire (CARAT10) to assess rhinitis and asthma in patients with asthma. Allergy 2010 Aug;65(8):1042-1048. [CrossRef] [Medline]
    24. Fonseca JA, Nogueira-Silva L, Morais-Almeida M, Sa-Sousa A, Azevedo LF, Ferreira J, et al. Control of Allergic Rhinitis and Asthma Test (CARAT) can be used to assess individual patients over time. Clin Transl Allergy 2012 Aug 30;2(1):16 [FREE Full text] [CrossRef] [Medline]
    25. Azevedo P, Correia DSJ, Bousquet J, Bugalho-Almeida A, Del Giacco SR, Demoly P, WHO Collaborative Center for AsthmaRhinitis‚ Montpellier. Control of Allergic Rhinitis and Asthma Test (CARAT): dissemination and applications in primary care. Prim Care Respir J 2013 Mar;22(1):112-116 [FREE Full text] [CrossRef] [Medline]
    26. InspirerMundi version 1.1 inhaler registration.   URL: https://www.youtube.com/watch?v=wZ5yRhpzSbo [accessed 2021-05-16]
    27. InspirerMundi version 1.1 intake registration.   URL: https://www.youtube.com/watch?v=NTuOKJ1ZEtc [accessed 2021-05-16]
    28. InspirerMundi version 1.1 CARAT questionnaire.   URL: https://www.youtube.com/watch?v=9EXsZouE9Ro [accessed 2021-05-16]
    29. InspirerMundi version 1.1 Inspirer request.   URL: https://www.youtube.com/watch?v=8Q72VWVH5pU [accessed 2021-05-16]
    30. Loymans RJB, Ter Riet G, Sterk PJ. Definitions of asthma exacerbations. Curr Opin Allergy Clin Immunol 2011 Jun;11(3):181-186. [CrossRef] [Medline]
    31. Pickard AS, Wilke C, Jung E, Patel S, Stavem K, Lee TA. Use of a preference-based measure of health (EQ-5D) in COPD and asthma. Respir Med 2008 Apr;102(4):519-536 [FREE Full text] [CrossRef] [Medline]
    32. Martins AI, Rosa AF, Queirós A, Silva A, Rocha NP. European Portuguese Validation of the System Usability Scale (SUS). Procedia Comput Sci 2015;67:293-300. [CrossRef]
    33. InspirerMundi version 1.2 inhaler registration.   URL: https://www.youtube.com/watch?v=OlI_ln3RPbs [accessed 2021-05-16]
    34. InspirerMundi version 1.2 intake registration.   URL: https://youtu.be/E2qP2enArqE [accessed 2021-05-16]
    35. Chan YY, Wang P, Rogers L, Tignor N, Zweig M, Hershman SG, et al. The Asthma Mobile Health Study, a large-scale clinical observational study using ResearchKit. Nat Biotechnol 2017 Mar 13;35(4):354-362. [CrossRef] [Medline]
    36. Pratap A, Neto EC, Snyder P, Stepnowsky C, Elhadad N, Grant D, et al. Indicators of retention in remote digital health studies: a cross-study evaluation of 100,000 participants. NPJ Digit Med 2020 Feb 17;3(1):21 [FREE Full text] [CrossRef] [Medline]
    37. Carroll JK, Moorhead A, Bond R, LeBlanc WG, Petrella RJ, Fiscella K. Who uses mobile phone health apps and does use matter? A secondary data analytics approach. J Med Internet Res 2017 Apr 19;19(4):e125 [FREE Full text] [CrossRef] [Medline]
    38. Kosse RC, Bouvy ML, Belitser SV, de Vries TW, van der Wal PS, Koster ES. Effective engagement of adolescent asthma patients with mobile health-supporting medication adherence. JMIR Mhealth Uhealth 2019 Mar 27;7(3):e12411 [FREE Full text] [CrossRef] [Medline]
    39. Neves A, Jácome C, Taveira-Gomes T, Pereira AM, Almeida R, Amaral R, et al. Determinants of use of health and fitness mobile apps by patients with asthma: a secondary analysis of observational studies. J Med Internet Res 2021:1 (forthcoming) [FREE Full text] [CrossRef]
    40. Jácome C, Pereira AM, Almeida R, Ferreira-Magalhaes M, Couto M, Araujo L, Inspirers group. Patient-physician discordance in assessment of adherence to inhaled controller medication: a cross-sectional analysis of two cohorts. BMJ Open 2019 Nov 07;9(11):e031732 [FREE Full text] [CrossRef] [Medline]
    41. VonHoltz LAH, Hypolite KA, Carr BG, Shofer FS, Winston FK, Hanson CW, et al. Use of mobile apps: a patient-centered approach. Acad Emerg Med 2015 Jun;22(6):765-768 [FREE Full text] [CrossRef] [Medline]
    42. Merchant R, Inamdar R, Henderson K, Barrett M, Su JG, Riley J, et al. Digital health intervention for asthma: patient-reported value and usability. JMIR Mhealth Uhealth 2018 Jun 04;6(6):e133 [FREE Full text] [CrossRef] [Medline]
    43. Hoogland J, Wijnen A, Munsterman T, Gerritsma CL, Dijkstra B, Zijlstra WP, et al. Feasibility and patient experience of a home-based rehabilitation program driven by a tablet app and mobility monitoring for patients after a total hip arthroplasty. JMIR Mhealth Uhealth 2019 Jan 31;7(1):e10342 [FREE Full text] [CrossRef] [Medline]
    44. Davidson S, Fletcher S, Wadley G, Reavley N, Gunn J, Wade D. A mobile phone app to improve the mental health of taxi drivers: single-arm feasibility trial. JMIR Mhealth Uhealth 2020 Jan 15;8(1):e13133 [FREE Full text] [CrossRef] [Medline]
    45. Huberty J, Eckert R, Larkey L, Kurka J, Rodríguez De Jesús SA, Yoo W, et al. Smartphone-based meditation for myeloproliferative neoplasm patients: feasibility study to inform future trials. JMIR Form Res 2019 Apr 29;3(2):e12662 [FREE Full text] [CrossRef] [Medline]
    46. Park JYE, Li J, Howren A, Tsao NW, De Vera M. Mobile phone apps targeting medication adherence: quality assessment and content analysis of user reviews. JMIR Mhealth Uhealth 2019 Jan 31;7(1):e11919 [FREE Full text] [CrossRef] [Medline]
    47. Etminani K, Tao Engström A, Göransson C, Sant'Anna A, Nowaczyk S. How behavior change strategies are used to design digital interventions to improve medication adherence and blood pressure among patients with hypertension: systematic review. J Med Internet Res 2020 Apr 09;22(4):e17201 [FREE Full text] [CrossRef] [Medline]
    48. Car J, Tan WS, Huang Z, Sloot P, Franklin BD. eHealth in the future of medications management: personalisation, monitoring and adherence. BMC Med 2017 Apr 05;15(1):73 [FREE Full text] [CrossRef] [Medline]
    49. Hui CY, Walton R, McKinstry B, Pinnock H. Time to change the paradigm? A mixed method study of the preferred and potential features of an asthma self-management app. Health Informatics J 2019 Jun 13:1460458219853381. [CrossRef] [Medline]
    50. Hui C, Walton R, McKinstry B, Pinnock H. What features do patients "want" in a mobile asthma app? A qualitative study. Eur Respir J 2017;50(suppl 61):PA3874. [CrossRef]
    51. Inspirers group.   URL: https://paceit.med.up.pt/sample-page/inspirers-group/ [accessed 2021-05-16]

    ‎
    CARAT: Control of Allergic Rhinitis and Asthma Test
    EQ-5D: EuroQol 5-Dimension questionnaire
    GINA: Global Initiative for Asthma
    mHealth: mobile health
    STROBE: Strengthening the Reporting of Observational Studies in Epidemiology
    VAS: visual analog scale

    Edited by L Buis; submitted 14.12.20; peer-reviewed by A( Kassavou, HL Tam; comments to author 11.01.21; revised version received 26.01.21; accepted 09.04.21; published 25.05.21

    Copyright

    ©Cristina Jácome, Rute Almeida, Ana Margarida Pereira, Rita Amaral, Sandra Mendes, Magna Alves-Correia, Carmen Vidal, Sara López Freire, Paula Méndez Brea, Luís Araújo, Mariana Couto, Darío Antolín-Amérigo, Belén de la Hoz Caballer, Alicia Barra Castro, David Gonzalez-De-Olano, Ana Todo Bom, João Azevedo, Paula Leiria Pinto, Nicole Pinto, Ana Castro Neves, Ana Palhinha, Filipa Todo Bom, Alberto Costa, Cláudia Chaves Loureiro, Lilia Maia Santos, Ana Arrobas, Margarida Valério, João Cardoso, Madalena Emiliano, Rita Gerardo, José Carlos Cidrais Rodrigues, Georgeta Oliveira, Joana Carvalho, Ana Mendes, Carlos Lozoya, Natacha Santos, Fernando Menezes, Ricardo Gomes, Rita Câmara, Rodrigo Rodrigues Alves, Ana Sofia Moreira, Diana Bordalo, Carlos Alves, José Alberto Ferreira, Cristina Lopes, Diana Silva, Maria João Vasconcelos, Maria Fernanda Teixeira, Manuel Ferreira-Magalhães, Luís Taborda-Barata, Maria José Cálix, Adelaide Alves, João Almeida Fonseca. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 25.05.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.