Published on 15.08.17 in Vol 5, No 8 (2017): August
Developing and Evaluating JIApp: Acceptability and Usability of a Smartphone App System to Improve Self-Management in Young People With Juvenile Idiopathic Arthritis
Background: Flare-ups in juvenile idiopathic arthritis (JIA) are characterized by joint pain and swelling and often accompanied with fatigue, negative emotions, and reduced participation in activities. To minimize the impact of JIA on the physical and psychosocial development and well-being of young people (YP), it is essential to regularly monitor disease activity and side effects, as well as to support self-management such as adherence to treatment plans and engagement in general health-promoting behaviors. Smartphone technology has the potential to engage YP with their health care through convenient self-monitoring and easy access to information. In addition, having a more accurate summary of self-reported fluctuations in symptoms, behaviors, and psychosocial problems can help both YP and health care professionals (HCPs) better understand the patient’s condition, identify barriers to self-management, and assess treatment effectiveness and additional health care needs. No comprehensive smartphone app has yet been developed in collaboration with YP with JIA, their parents, and HCPs involved in their care.
Objectives: The objective of this study was to design, develop, and evaluate the acceptability and usability of JIApp, a self-management smartphone app system for YP with JIA and HCPs.
Methods: We used a qualitative, user-centered design approach involving YP, parents, and HCPs from the rheumatology team. The study was conducted in three phases: (1) phase I focused on developing consensus on the features, content, and design of the app; (2) phase II was used for further refining and evaluating the app prototype; and (3) phase III focused on usability testing of the app. The interview transcripts were analyzed using qualitative content analysis.
Results: A total of 29 YP (aged 10-23, median age 17) with JIA, 7 parents, and 21 HCPs were interviewed. Major themes identified as the ones that helped inform app development in phase I were: (1) remote monitoring of symptoms, well-being, and activities; (2) treatment adherence; and (3) education and support. During phase II, three more themes emerged that informed further refinement of the app prototype. These included (4) adapting a reward system to motivate end users for using the app; (5) design of the app interface; and (6) clinical practice integration. The usability testing during phase III demonstrated high rates of overall satisfaction and further affirmed the content validity of the app.
Conclusions: We present the development and evaluation of a smartphone app to encourage self-management and engagement with health care for YP with JIA. The app was found to have high levels of acceptability and usability among YP and HCPs and has the potential to improve health care and outcomes for this age group. Future feasibility testing in a prospective study will firmly establish the reliability, efficacy, and cost-effectiveness of such an app intervention for patients with arthritis.
JMIR Mhealth Uhealth 2017;5(8):e121
- juvenile idiopathic arthritis;
- young adult;
- mobile applications;
- qualitative research;
Juvenile idiopathic arthritis (JIA) is one of the most common chronic diseases with an early onset in childhood or adolescence. It causes articular inflammation, which in turn leads to pain, swelling, and stiffness of the joints . The progression of JIA into adulthood is common in the majority of teenagers with JIA [ ] and, if not treated effectively during the childhood and adolescent years, it can lead to disability and complications related to educational, psychosocial, and physical development in later life [ ]. There are now effective therapies for JIA that have the potential to transform the quality of life for young people (aged 10-24 years; YP) [ ] with the disease [ ]. If optimal treatment is instigated, it can improve JIA prognosis and negate the need for further health care input such as joint replacement surgery, which was often required in YP before the advent of new therapies [ - ].
However, treating JIA requires patients to take regular medications and attend frequent hospital appointments for monitoring disease progression and side effects. In addition, successful treatment often relies on a holistic approach such as engaging YP in appropriate physical exercises and maintaining psychological well-being [- ]. Health outcomes are thus highly dependent on self-management behaviors to facilitate adherence of YP to treatment protocols and engagement in behaviors that promote physical and emotional well-being [ - ]. As YP mature and transition from pediatric to adult services, they are expected to become more independent and responsible for their own health care. Unfortunately, health service provision often fails to offer the type of support and skills that YP need to manage their JIA, especially during times of significant change [ - ], which may explain the poor adherence to treatment and disengagement with services in YP [ - ]. It is therefore essential for health care professionals (HCPs) to adopt effective and innovative ways to promote self-management promptly and effectively [ , - ].
According to a model known as the COM-B system  that emerged from a systematic review of behavior change theories, behavior (B) may depend on an interaction between three important components: capability (C), opportunity (O), and motivation (M). When one component is not fulfilled, it could impose barriers to self-management; this has been used to explain issues with adherence [ ] and applied in several interventions [ , ]. The COM-B model can explain why providing educational information aimed at increasing skills and understanding alone, which was the main focus of previous self-management interventions, has not been sufficient in engaging YP and that additional intervention functions may be necessary [ , ]. These may require sending reminders, monitoring problems and achievements, or offering incentives in ways that are acceptable and appropriate for YP.
An ideal resource-efficient way of improving self-management is by incorporating multiple intervention functions to address all three sources of behaviors through smartphone technology. In general, YP are already familiar and comfortable using smartphone apps in their everyday lives. It is estimated that 75% of adolescents over the age of 13 years in the United Kingdom use smartphones on a daily basis, and smartphone ownership is highest among YP . Capitalizing on the popularity of smartphone-based entertainment in adolescents, health apps may represent an important means of increasing self-management through remote monitoring and access to information [ - ]. For example, health management behaviors can be integrated with daily activities, using technologies that can track information “on the go.” Apps used to monitor symptoms remotely also have considerable potential in helping HCPs deliver safe and timely health care, as it provides more accurate and frequent reports of health status compared with using paper diaries [ - ]. Reliable and secure electronic data collection of symptoms and emotions not only benefits clinical assessments, but it is also an established method for validly collecting daily data in research as well [ - ] and can help advance knowledge on factors influencing disease progression.
However, recent systematic reviews of the literature exploring the effectiveness of mobile apps designed to support the management of chronic physical conditions by YP [- ] found a limited number of apps in the scientific database. This is in stark contrast to the thousands of commercial apps available that have not been developed in close partnership with end users. Only one app [ - ] has been developed for JIA patients, but it did not involve parents and HCPs in the development process and its function is limited to monitoring symptoms. The app is also targeted for patients in pediatric clinics (<18 years), whose needs and preferences may differ from YP who have already transitioned to adult clinics (18-24 years). Moreover, previous reviews did not identify a single app for YP that designed a clinician interface jointly with the patient app portal, and none had a sound theoretical rationale.
Therefore, this study aimed to address issues with self-management and engagement with health care in YP by developing and evaluating a comprehensive smartphone-based app system for, and in collaboration with, (1) YP with JIA and (2) HCPs involved in their care. We followed a theory- and user-driven approach [- ], where user feedback helped understand optimal ways of delivering intervention functions that have been identified in the COM-B model to overcome barriers to self-management in YP. This approach is in line with the United Kingdom Medical Research Council (MRC) guidelines, which highlight the importance of identifying appropriate theory to inform the development of a complex intervention [ - ].
Patients were eligible for recruitment to the study when they fulfilled the following criteria: (1) a diagnosis of JIA, defined as arthritis of unknown etiology lasting more than 6 weeks and of onset at less than 16 years ; (2) were aged 10 to 24 years; (3) were able to read and speak English; and (4) were seen at the Great Ormond Street Hospital (GOSH) or University College London Hospital (UCLH) rheumatology clinics. Patients were excluded if they had severe cognitive impairments or major comorbid medical or psychiatric illnesses that would preclude their ability to participate in focus group discussions (FGDs). Parents of patients were eligible if they could read and understand English. Patient demographics and disease-related data collected were age at time of study, age at diagnosis, classification of JIA category, and current medication. The HCPs working in the multidisciplinary team at the two recruiting centers were eligible to participate if they had worked in pediatric/adolescent rheumatology for at least 6 months according to self-report. Participants were able to take part in all three phases of the study. summarizes which patient participated multiple times.
The overall project adopted a qualitative, user-centered approach as per the standard published guidance [- ]. The study was conducted in three phases (see ). Phase I focused on developing consensus on the features and content of the app. This involved understanding barriers and enablers to self-management in YP, and, as suggested by the MRC guidance [ - ], identifying intervention functions from the COM-B model that should be incorporated in the app. Phase II was used to further refine and evaluate the functionalities and improve the design of the app prototype and the Web application for HCPs. Phase III focused on usability testing of the final app interface for YP. Purposive sampling was used to encompass variations in opinions because of demographic characteristics (age, gender, and ethnicity), disease duration, and JIA subtype. Both YP and parents were approached by a member of the research team in clinics before the rheumatology appointment. The families who agreed to participate gave informed consent or age-appropriate assent with parental consent for those aged under 16 years. Thereafter, YP were offered a group based on their age for phases I and II. The study was approved by the Local Ethics Committee (NRES Committee London – Queen Square, 15/LO/1288).
|Phase||Patient ID||Age, in years||Gender||JIAa subclassification||Disease duration, in years||Current medication|
|I||1||21||F||Persistent oligoarticular JIA||17||Nil. Previously treated with intra-articular steroid injections|
|2||18||M||ERAb||3||Methotrexate (15 mg/m2 scc weekly)|
|3||17||M||Persistent oligoarticular JIA||4||Nil. Previously treated with intra-articular steroid injections|
|4||18||M||ERA||7||Etanercept (0.8 mg/kg sc weekly) and methotrexate (15 mg/m2 sc weekly)|
|5||18||F||Polyarticular JIA||15||Methotrexate (15 mg/m2 sc weekly) and adalimumab (40 mg sc fortnightly)|
|6||10||M||Extended oligoarticular JIA||4||Methotrexate (15 mg/m2 sc weekly)|
|7||14||F||Systemic JIA||3||Methotrexate (15 mg/m2 sc weekly)|
|8||12||M||Extended oligoarticular JIA||7||Nil. Previously treated with intra-articular steroid injections|
|9||11||M||Systemic JIA||2||Tocilizumab (8 mg/kg fortnightly) and methotrexate (15 mg/m2 sc weekly)|
|10||12||F||Psoriatic arthritis||0.4||Methotrexate (15 mg/m2 sc weekly)|
|II||2||18||M||ERA||3||Methotrexate (20 mg/m2 sc weekly) and humira (40 mg sc weekly)|
|6||10||M||Extended oligoarticular JIA||5||Methotrexate (15 mg/m2 sc weekly)|
|7||14||F||Systemic JIA||3||Methotrexate (15 mg/m2 sc weekly)|
|8||12||M||Extended oligoarticular JIA||7||Nil|
|9||12||M||Systemic JIA||3||Tocilizumab (8 mg/kg fortnightly) and methotrexate (15 mg/m2 sc weekly)|
|10||13||F||Psoriatic arthritis||0.8||Methotrexate (15 mg/m2 sc weekly)|
|11||23||F||Bilateral inflammatory hip arthritis||11||Methotrexate (10 mg/m2 sc weekly)|
|12||17||F||Systemic JIA||2||Hydroxychloroquine (400 mg orally daily)|
|13||20||F||Persistent oligoarticular JIA||5||Methotrexate (20 mg orally weekly)|
|14||16||F||Extended oligoarticular JIA||14||Methotrexate (15 mg/m2 sc weekly)|
|15||17||F||Polyarticular JIA||9||Etanercept (25 mg sc weekly)|
|16||14||F||Psoriatic arthritis||12||Adalimumab (40 mg sc fortnightly)|
|17||12||F||Persistent oligoarticular JIA||8||Methotrexate (15 mg/m2 sc weekly)|
|III||4||18||M||ERA||8||Methotrexate (15 mg/m2 sc weekly)|
|19||12||M||Polyarticular JIA||4||Methotrexate (25 mg orally weekly)|
|20||14||F||Psoriatic arthritis||8||Methotrexate (12.5 mg/m2 sc weekly)|
|21||15||M||Extended oligoarticular JIA||8||Naproxen (500 mg twice a day)|
|22||17||F||Extended oligoarticular JIA||15||Methotrexate (15 mg/m2 sc weekly) and folic acid (5 mg orally weekly)|
|23||13||F||Oligoarticular JIA||10||Methotrexate (15 mg/m2 sc weekly) and humira (40 mg fortnightly)|
|24||15||F||Systemic JIA||3||Methotrexate (27.5 mg/m2 sc weekly), anakinra (150 mg sc daily), and folic acid (5 mg orally weekly)|
|26||23||M||Extended oligoarticular JIA ||21||Keppra (500 mg twice a day)|
|27||15||F||ERA||3||Methotrexate (15 mg/m2 sc weekly) and folic acid (5 mg orally weekly)|
|28||16||M||Polyarticular JIA||1||Methotrexate (15 mg orally weekly) and folic acid (5 mg orally weekly)|
|29||18||F||Polyarticular JIA||2||Enbrel (50 mg sc weekly) and methotrexate (7.5 mg orally weekly)|
aJIA: juvenile idiopathic arthritis.
bERA: enthesitis-related arthritis.
Phase I: Design and Development
For phase I, we used a nominal group technique to develop consensus on the app content and features. This included a number of separate FGDs for HCPs, younger patients (aged 10-15 years) and their parents, and older patients (aged 16-24 years). Following an introductory presentation on the overall goals of the meeting, YP and parents were asked what features and information will help them or their child better follow their treatment plans and cope with arthritis-related symptoms and consequences. The HCPs were asked what data can be collected remotely to help with understanding and assessing patient’s condition and treatment effectiveness. All participants were also questioned regarding the design and aesthetics of the user interface. Lists of questions posed to each of the groups are summarized in. Consensus was considered as having been achieved when 75% of the participants endorsed a given answer. Answers that did not reach 75% endorsement were discarded or reformulated through discussion.
Participants’ answers to the questions posed during phase I FGDs were used to generate a catalog of initial system requirements. An app prototype was then developed in collaboration with the Computer Science Department at UCLH. The agreed set of features were iteratively built into the app codebase by a developer from the Computer Science Department. When clarification of the data generated was required, participants were queried by email and phone to provide further feedback (see). The prototype was developed using open frameworks for cross-platform compatibility and runs on both the Google Android (version 4.4.1 and above) and the Apple iOS (version 8 and above) operating systems.
Phase II: Evaluation and Integration Into Clinical Practice
The FGDs were again conducted with HCPs and YP with JIA during phase II to vet and refine the requirements of the phase I app prototype. Participants were able to test and navigate through the app’s various features using a smartphone to improve their understanding of the app and focus on their recommendations. Screenshots of important pages in the app were also shown to examine whether YP and HCPs liked or disliked the design and the question format. They were asked to provide further suggestions for improvement, and technical problems with the app were also recorded.
Both HCPs and YP were also asked whether the information collected would be useful during consultations, and how clinically relevant information reported by patients should be imported to, summarized, and displayed in a Web application for HCPs. Also, what data recorded by patients and information on app usage should be stored for research were discussed. Semistructured interview questions that were developed based on the Usefulness, Satisfaction, and Ease of Use questionnaire  were used to guide the FGDs (see ). The design of the app was modified and new screenshots were generated and evaluated until no further changes were suggested. All FGDs were conducted with each participant group until point of data redundancy or point of no proposed new data [ ] and lasted between 60 and 90 min. System analysis and final design were done in joint effort with the developer from the Computer Science Department.
Phase III: Usability and Acceptability Pilot
Following the development of the final app, the usability and acceptability of the user interface, as well as the registration and data extraction process were tested with YP during phase III. The interviews with YP took place on a one-to-one basis and YP were shown the app on a smartphone. The researcher explained that the purpose of the study was to pilot ease of use and evaluate its features and encouraged YP to input information in all sections of the app at least once. After navigating the various features of the app and using it for 10 to 15 min, YP answered a usability and acceptability questionnaire  where they rated on 5-point scales their general impressions of the app, its user-friendliness, clarity of information provided, and whether or not they found the app useful and would recommend it to other YP (see ). In addition, YP answered qualitative questions regarding the specific features of the app, and how it can help them improve self-management (see ). Each interview lasted between 25 and 45 min. Discussions were audio-recorded for all phases of the project, and field notes were made for phase III. At all FGDs, RAC and HC were present as interview leader and observer, respectively.
All audio recordings were transcribed and qualitative content analysis [, ] was applied. Qualitative data from transcripts and field notes were carefully reviewed to develop a coding system that reflected perceptions and suggestions for the smartphone-based JIA app. Data were then assigned with codes based on their content. Codes with similar content were grouped into meaningful categories. RAC and HC read and analyzed the transcripts separately and then compared the results. Differences from the separate analyses were discussed until consensus was reached. The coding system and analytic process were further discussed with DE, an experienced pediatric rheumatologist. The final analysis organized the categories together into overarching themes that were developed and refined by discussions between RAC, HC, and DE. Discussions were also held between the researchers on how each category mapped onto the COM-B model. In addition, content analysis was performed according to the age group of YP (10-15 years and 16-24 years) to identify any age-specific differences in opinion. All qualitative data were analyzed using NVivo software (NVivo version 10, QSR International, 2012) [ ].
For phase I, a total of 10 patients were recruited and were separated into two groups: group A included 5 patients (median age 12 years, range 10-14 years, 2 females) and group B included 5 patients (median age 18 years, range 17-21 years, 2 females). A separate FGD was conducted with 7 parents of patients from group A. Two patient FGDs were again conducted for phase II: group A included 7 patients (median age 12 years, range 10-14 years; 4 females) and group B included 6 patients (median age 18 years, range 16-23 years, 5 females). Phase III interviewed 13 YP. Demographics and disease characteristics of YP included in the study are shown in. The participants had a variety of JIA categories with a median time since diagnosis of 4 years (range 5 months-17 years) for patients in phase I, 5 years (range 10 months-14 years) for patients in phase II, and 8 years (range 1-21 years) for patients in phase III. The participants were also diverse in ethnicity (62% white, 24% Asian, 10% black, 3% Hispanic).
Two FGDs with HCPs were also conducted for phases I and II. For phase I, a total of 19 HCPs with a median of 7 years (range 1-20 years) of experience in pediatric/adolescent rheumatology participated. These HCPs included 7 medical consultants, 4 clinical nurse specialists, 4 rheumatology trainees, 2 research nurses, 1 physiotherapist, and 1 clinical psychologist. For phase II, a total of 15 HCPs with a median of 8 years (range 1 to 20 years) of experience participated. The group included 6 medical consultants, 3 rheumatology trainees, 2 clinical nurse specialists, 2 research nurses, and 2 research fellows.
Phase I: Design and Development
It was apparent that YP with JIA wanted a multifaceted way to help them manage their condition. Transcript analysis of data collected during phase I revealed three distinct themes that guided the development of this app (see).
Theme 1: Self-Monitoring
The first theme was self-monitoring, as all participants thought that tracking certain information will (1) help them understand what influences their JIA symptoms and (2) provide better data for HCPs to use during assessments. This theme included six initial categories for monitoring; however, only those for which there was >75% agreement on its importance among YP, parents, and HCPs were included in the app. These were monitoring (1) symptoms, (2) general well-being, (3) activities, and (4) sleep. Categories that did not achieve this concordance were related to tracking (5) weather and (6) nutrition.
All participants identified tracking of joint symptomatology, including stiffness, swelling, and pain as very important, particularly as this varies in intensity, location, and duration over time. They felt that using the app would reduce recall bias and enable both patients and clinicians to monitor symptoms in real time:
I want to note the dates of when I have symptoms before I forget them, so that I can show the doctors, and help them better understand my illness and what is really going on.
One patient stated:
Daily monitoring of pain is better than giving a monthly average at the clinic.
Participants indicated that the app should include continuous visual analog scales (VAS) to indicate the intensity of JIA-related symptoms by moving a bar across a horizontal line in preference to categorical selections. One adolescent stated:
Instead of choosing just one number, I want to be able to choose a range between the numbers, like between 6 to 7.
As requested by YP, each scale was accompanied with a cartoon face that changed facial expressions from extremely positive at the left to extremely negative at the right. Psychometric properties of the VAS have been widely explored with children as young as 8 years of age and have confirmed its test-retest reliability, construct validity, and criterion-related validity [, ].
Additionally, YP wanted to use a body map to indicate how painful and swollen a specific joint is. Body maps can facilitate children’s reports of location of pain [, ], and electronic versions have been used successfully with children as young as 8 years old [ ]. The app will include a simple body map (see ) with circles at major joint areas in the body, mirroring what is used in routine clinical assessments [ ]. YP can click on a joint that is painful or stiff and use a VAS to indicate the intensity of their pain and stiffness, and the joint’s color will then change accordingly. This is important to include, as YP often experience different pain intensities from different joints, and their stiffness intensity also vary by location and time of day. Both YP and HCPs thought that recording this will help them better explain their symptoms and assess whether treatment is required (eg, physiotherapy exercises targeting specific joints). Lastly, YP requested an open text area where they can input additional details regarding their symptoms and add comments about the type of pain, with one of the patients stating the following reason:
It’s about how you feel and how you describe it instead of just having a number.
Being able to monitor general well-being such as mood, fatigue, and functional health were also identified as important. For example, YP indicated:
Tracking stressful events and mood and how that impacts your symptoms is most important.
Three positive (excited, energetic, happy) and three negative emotions (anxiety/fear, sad, angry) were chosen together with YP and HCPs, which were adapted from the Positive and Negative Affect Schedule for Children . These were assessed using the VAS and the horizontal line ranged from “not at all” on the left to “extremely” on the right. A stress scale was also included, but a verbal rating scale for stress (VRSS) was preferred by YP instead of a VAS. The VRSS was found to be more reliable than the VAS and can be easily understood and completed by children as young as 7 years old [ ]. It measures stress on a scale from zero to five with responses describing an increase in stress levels. In addition, YP wanted an electronic version of a JIA-related childhood health-assessment questionnaire (CHAQ) [ ], which is a widely used functional health status measure in YP with JIA and is administered during routine clinic consultations. They recognized that completing it once every 3 to 6 months during clinic consultations may provide unreliable responses, as it does not reflect variations over time:
I’d like to track more precisely because the answers to those questionnaires can change every day, or even every hour.
Digital CHAQs have been developed and tested in previous studies  and were found to yield similar outcomes when compared with the paper form of CHAQ.
Recording activities such as participation in school and physical exercise and sports was another important area for YP. One YP said,
Exercise usually makes me feel better afterwards and doing sports takes the pain away.
I want to be able to write down what type of exercise I did, such as swimming.
YP suggested that the app should provide visual feedback of their data so that they can see how different factors impacted their condition, and what techniques were helpful in managing their symptoms.
Theme 2: Treatment Adherence
Participants were interested in using the app to improve treatment adherence by setting reminders for when to take regular medications, request repeat prescriptions, complete physiotherapy exercises, and attend hospital appointments for important assessments and tests (eg, regular blood tests). One of the patients said,
Sometimes when life gets busy I do forget, so having a reminder would be really useful.
However, some participants felt that these reminders should be optional to avoid any disengagement with the app because of annoyance from compulsory reminders. Furthermore, YP were interested in recording when medication doses were missed, reasons for missing doses, side effects, medication change, and whether they took any additional medicines such as analgesics or antibiotics and anti-emetics (see). Regarding physiotherapy exercises, YP could select which ones they were assigned or would like to perform from a list of possible exercises recommended by physiotherapists at GOSH and could input the number of sets and repetitions. Additionally, both patients and HCPs wanted a section where patients could input their blood test results, with an indication of whether these results were normal and what the tests measured:
I think it’s interesting to have your blood results on the app, together with the doctor’s comments such as there’s nothing to worry about or that something might be a problem.
Theme 3: Education and Support
Besides wanting to learn more about their condition, YP wanted to have a discussion forum in the app with other patients. Also, YP from all age groups highlighted the need to have easy access via the app to condition- and treatment-related information, news about research, and social support:
The app should have information on arthritis…also news about research, involvement, and being able to talk to other people.
Additionally, YP said that learning different ways of managing their stress and pain from peers, and knowing that they are not alone, will make them feel more empowered and confident. Moreover, YP mentioned that their arthritis symptoms tend to worsen during times of stress and exams and would like information on how to better manage stressful situations and pain. Therefore, the app will include general information regarding JIA, medications, physiotherapy exercises, and practical coping advice, with links to more detailed and trusted Web resources (see). It will also signpost users to information regarding support groups that are reputable and age-appropriate, as well as possible involvement activities organized by local organizations and charities.
Older patients (18-24 years) requested additional information on how to become more independent as they become an adult and what support is available for higher education and work. The app will provide general information covering these topics, with links to how other YP with JIA overcame challenges of growing up. In addition, there is a diary section where YP can write down any questions or comments that they have and can easily refer to during consultations.
Phase II: Evaluation and Integration Into Clinical Service
During phase II, three more themes emerged (see), which related to incentives, design, and integration.
Theme 4: Incentives
It was observed that YP wanted to be rewarded for using the app, and they preferred a reward-based rather than a punitive system. One of the patients stated:
You should get points to buy rewards for using the app but you shouldn’t get points taken away, even if you don’t use it for a while.
Therefore, the app will incorporate a point-based reward system and include encouraging video messages from celebrities and athletes. However, this was more appealing to the younger group rather than the older group. Older group enjoyed choosing reward pictures (eg, of landscapes, animals, and sports) to use as their wallpaper and motivational quotes that they could display on the home page.
Theme 5: Design of Patient Interface
In terms of designing the user interface, three aspects were important for YP and HCPs: (1) data security, (2) visual appeal/clarity, and (3) convenience. First, as the app will contain patient’s personal details, it needs to be password-protected:
Arthritis is quite personal so some things you might not want to share with other people.
Also, YP wanted the option of diarizing information that would not necessarily be shared with clinicians:
Some things might be a bit personal, and just for me to look at in a diary format.
Second, YP wanted a colorful visual display, easy-to-read fonts, and pictures and were keen on being able to personalize colors and backgrounds. One participant stated,
It’s important to have pictures and as little words as possible.
Participants also suggested that scales should include faces to represent different pain or fatigue levels:
Using faces and cartoon will brighten it up a bit
Moreover, YP wanted more space on the home page to display reward videos and pictures on the bottom; therefore, the home page displays a dial (instead of a drop-down ladder) to count down the number of days that are left until the next weekly deadline (see).
Lastly, there was a consensus among YP that it should typically take less than 10 min to input all required information:
Input must be very quick to do and not feel like a chore.
Moreover, YP felt that there needed to be an agreed minimum input to provide clinicians with interpretable data. One adolescent stated:
Even if you have no pain, you can just indicate “no pain” so that doctors know that you didn’t just forget about the app.
It was agreed by both YP and HCPs that the most important data to collect were arthritis-related symptoms, CHAQ, and mood, which should be provided at least once a week. The frequency of completion of other sections should be decided by the YP themselves to give them control over the process.
Ease of use was thus improved in several important ways. First, YP were now able to access the three main monitoring components of the app (symptoms, CHAQ, and mood) directly from the home page rather than from the menu bar. Second, after submitting each input, YP were presented with a pop-up showing how many days ago was their last input for each of the other section, which allowed them to quickly select another section that had not been completed recently. Similarly, hyperlinks were added within the app itself to facilitate access to relevant tips and advice. YP confirmed that these changes made inputting data and finding relevant information faster and more convenient. Lastly, YP requested a calendar display of entries, and the ability to input data retrospectively. One patient said,
Sometimes we have a bad day and we’re tired so we don’t want to the use the app, but we might want to go back and re-enter it later.
All the themes and their associated app functionalities were mapped onto the COM-B model (see).
Theme 6: Clinical Practice Integration
The HCPs discussed how JIApp can be integrated seamlessly into clinical practice and how reports from patients will be received. Clinically relevant data collected from the app will be automatically aggregated and presented in table and graphical summaries (see) on a clinician Web interface. The interface was optimized for usability and data are presented in an intuitive format such that any changes over time or associations between various factors (eg, pain and mood) are visually presented to aid comprehension. illustrates the system, where raw data recorded by YP are stored and clinically relevant information can be summarized and displayed on the clinician interface.
The within-application workflow was also aligned with clinician’s regular work streams. For example, HCPs can access the Web interface via a patient’s existing electronic health records, which can increase the likelihood of integration and access from all multidisciplinary members of the rheumatology team. Information can also be downloaded by HCPs and used to populate clinic letters.
The HCPs also identified possible barriers to integration such as accessibility to all patients and demands for additional resources. For example, HCPs proposed that a desktop version of the app will be beneficial to allow access to YP without a mobile phone. In addition, HCPs were concerned about the additional time needed to monitor remote symptom deteriorations and interpret additional information collected from the app. It was agreed that HCPs are only expected to review the data during or right before a clinic consultation. Therefore, before downloading the app, participants will be informed that data will not be monitored in real time for this stage of the project but will be reviewed during clinic consultations. This is also explicitly explained on the app with a disclosure statement. The HCPs suggested that the effect of app use on HCP-patient interactions and cost-effectiveness of the intervention should be formally assessed in the next stages of the project during a prospective pilot study.
|Theme 1: |
|Self-awareness and understanding patterns||Perception of illness and self-efficacy|
|Better patient-clinician communication|
|Theme 2: Treatment adherence||Reminders for treatment adherence||Recording past adherence can stimulate action|
|Theme 3: Education and support||Knowledge of juvenile idiopathic arthritis and treatments||Confidence in skills and empowerment|
|Knowledge of self-management skills and emotion regulation|
|Theme 4: Incentives||Expectation of rewards|
|Theme 5: Design of user interface||Convenient monitoring |
|Convenient access to reliable information and support|
Phase III: Usability and Acceptability Pilot
All YP endorsed the app and thought that it would be beneficial for them right from the point of initial diagnosis (mean acceptability rating=4.29; standard deviation, SD=0.70). Also, YP were able to input important data within 10 min and found it intuitive to use and easy to navigate (mean usability rating=4.25, SD=0.79).
The usefulness of each of the app functionality was reviewed using qualitative interviews. It was apparent that there were multiple reasons for using the app such as its potential to provide YP with opportunities for better self-management, as all YP discussed the importance of having medication reminders and easy access to information, advice, and support. Furthermore, YP commented on how the app made them feel as if all the information they need is now at their “fingertips,” which makes managing their arthritis seem less difficult and increases the likelihood of actually reading the information and engaging in recommended behaviors and self-monitoring. They also appreciated how the information displayed was relevant to their condition and concise. One patient said,
I like the way the sections are organized, and how it is not too overwhelming, but how I do have the option of finding out more if I want to.
In terms of improving motivation to self-manage, YP believed that through self-monitoring, they were able to understand the importance of their own behaviors and how factors under their control can influence disease activity:
I never know when I will flare up…so if this can help me see if what I do can “actually” affect my arthritis, then that would be very helpful.
Moreover, YP emphasized how reading about other people’s successes and having a record of their own past success with managing pain and adhering to treatments can increase their confidence in being able to effectively cope with future challenges.
Also, YP were especially interested in doctors acknowledging their input and using data collected from the app to make better assessments and improve their care. They were enthusiastic about integrating the app into their care, as it will make it easier to discuss issues and symptoms that were recorded beforehand:
This app can help me remember what I wanted to say to my doctors, which I often forget by the time I come to the hospital…it will make it easier for me to show them what I mean.
Improving communication and patient-clinician relationship can in turn motivate further engagement with health care. Lastly, YP thought the reward system makes it enjoyable to use and is simple, yet engaging:
The app itself is already beneficial to the users, but the images as rewards is actually pretty nice and simple. I like it.
Most of the YP also fed back on how using the app can improve areas related to self-management capability, as reading reliable recommendations regarding pain management techniques will teach them better coping strategies:
Sometimes there’s nothing you can do except deal with it yourself, and this app can help you do that.
Patients also highlighted the fact that recording symptoms the moment they occur using the app enables better understanding of their condition and treatment beyond what can be provided by education alone. One of the patients said,
The app is a good way to keep track of my symptoms and should be given by doctors, especially when you’re first diagnosed.
They believed that each individual is different, and inputting data on a regular basis can help them become aware of their personal triggers and feel more in control of their arthritis:
I like visual information and to see how my stress levels interact with my arthritis.
This study presents the design and development of a smartphone app to remotely record symptoms and encourage self-management and engagement with health care for YP of all ages (10-24 years) with JIA. We worked closely with YP, parents, and HCPs to identify a catalog of initial requirements for the app system and the necessary changes needed to improve the functionalities of the app and its ease of use. Phase III usability testing demonstrated high rates of overall satisfaction with the app among YP and further affirmed the theoretical validity of the choices made in its design.
Through this app, YP are now able to record numerous additional parameters relating to their physical and psychological well-being, access relevant educational information and social support forums, receive treatment-related reminders, and improve communication with HCPs. More importantly, clinically relevant data is collected by YP themselves in the real-world environment rather than by the HCPs in the hospital environment and is owned by the patient, thus fostering the concept of independent management of health care as the YP mature [- ]. Moreover, having a clear theoretical basis allows future studies to identify which functions of the app system are driving improvements in self-management.
From the HCP perspective, this app also has the potential to standardize the way reports of clinical symptoms and medication adherence are captured in natural settings and enable fine-grained monitoring of arthritis in a way that is impossible to obtain with occasional clinic visits. Having a more accurate and holistic overview of the symptoms and problems of YP may improve the dynamics of consultation, as time spent on gathering information can be directed to discussing issues that are of concern to the patient. Such a system may also allow systematic collection of a clinically relevant standardized dataset, intended to ensure uniform data collection in the clinical setting  that can then inform NHS commissioning processes such as monitoring the efficacy of biologic therapy and the impact of such therapies on patient’s functional status. We also wish to prospectively assess in the next stages of the project the feasibility of collecting and processing additional mood- and pain-related data for HCPs, and the impact this has on future resource use (efficient use of consultation time, early identifications of problems, and efficient referrals), treatment effectiveness (whether it facilitates joint decision making with YP and the patient-doctor relationship), and, ultimately, health-related outcomes.
From the health care information technology perspective, the effort was not limited to a standalone app. JIApp is the front-end data-collection and patient-interaction component of a larger platform, involving a substantial back-end architecture, which includes (1) a flexible database mechanism that synchronizes cached phone data to the data repository, (2) a YP reward service, (3) user feedback and issue tracking system, and (4) secure transport of data from devices to the back-end. Most importantly, the platform also comprises a Web-based clinician’s interface to facilitate retrieval and presentation of patient data in a suitable and efficient manner for HCPs.
Moreover, this is not purely a bespoke app for GOSH and UCLH Rheumatology, and the development efforts did not limit the system design to this domain. For example, the software component for the questionnaires could generate any form of questionnaire with a variety of answer options such as optional/blank, single, multiple, free-text, slider-based, and so on. One could reuse such components for rapid development and deployment of similar data-oriented health care apps. The front-end JIApp will be made available via popular app stores (Google Play and Apple).
Comparison With Prior Work
To our knowledge, this study is the first to report a theory-driven and user-centered approach to develop a smartphone-based multifunctional app system for HCPs as well as YP with JIA. Previous JIA-related apps have only focused on monitoring symptoms [- ] and have not considered how the app can be integrated into clinical practice. It is also the only app developed that addresses all components of the COM-B model for self-management.
Similar self-management apps have been developed for chronic pediatric conditions other than JIA, particularly for YP with diabetes [, ], asthma [ , ], and cancer [ , ]. Themes that emerged from previous studies were related to what YP with JIA discussed in terms of ease of use, information sharing, rewards, and design. However, medication reminders and tracking missed medications and blood test results were not discussed by YP with other chronic conditions. This shows how certain requirements are unique to JIA patients and highlights the importance of developing condition-specific apps.
In terms of app effectiveness, some asthma and diabetes apps have been shown to benefit YP by increasing asthma control  and frequency of blood glucose monitoring [ ], whereas others have found no benefits of mobile apps [ , ]. Research in this area is still scarce, and more studies with larger sample sizes and longer follow-ups are needed to evaluate the impact of apps on self-management in YP. However, it is likely for apps that go through iterative development cycles involving both YP and HCPs to be more effective.
Our user groups were diverse, even though relatively small, with participating patients having different JIA subtypes at various stages of their treatment and from different ethnical backgrounds. The app’s design and evaluation were not affected by the characteristics of YP, but participation bias may have influenced the themes that emerged from our FGDs and interviews. For example, all study participants were computer literate and had easy access to smartphones; whether further refinements of the app are necessary for patients who are less familiar with this technology needs to be established. We considered this limitation by using open frameworks to develop the app so that it can be deployed as a desktop version (running on most modern browsers such as Chrome, Safari, and Firefox) with minimal effort. It is important for future studies to evaluate patient’s smartphone usage/ownership and its association with recruitment, app usage, and app satisfaction to ensure that the intervention is suitable and easily accessible for all YP.
In summary, a qualitative user-centered approach was used to develop the first comprehensive smartphone app for YP with JIA. Next steps will involve long-term feasibility testing of the app to establish its effect on patient’s self-management skills, disease outcomes, and general well-being, as well as the cost-effectiveness of such an intervention. In addition, patient’s app usage will be monitored to assess long-term sustainability and understand reasons for disengagement.
We would like to thank the young people, families, and health care professionals who took part in the design and evaluation of the smartphone app. This work was supported by Academic Health Sciences Centre grant, Arthritis Research UK Strategic Award 20164, UCL Proof of Concept grant PoC-13-027, and The Health Foundation Innovating for Improvement program. YI is supported by the National Institute for Health Research University College London Hospitals Biomedical Research Centre. LRW is supported by National Institute for Health Research Great Ormond Hospital Biomedical Research Centre and Great Ormond Street Children’s Charity. RAC, DE, and YI are supported by Arthritis Research UK Grant 20164.
Conflicts of Interest
Multimedia Appendix 1
Interview questions.PDF File (Adobe PDF File), 31KB
Multimedia Appendix 2
Usability questionnaire.PDF File (Adobe PDF File), 38KB
- Prakken B, Albani S, Martini A. Juvenile idiopathic arthritis. The Lancet 2011 Jun;377(9783):2138-2149. [CrossRef]
- Vidqvist K, Malin M, Varjolahti-Lehtinen T, Korpela MM. Disease activity of idiopathic juvenile arthritis continues through adolescence despite the use of biologic therapies. Rheumatology (Oxford) 2013 Nov;52(11):1999-2003 [FREE Full text] [CrossRef] [Medline]
- Selvaag AM, Aulie HA, Lilleby V, Flatø B. Disease progression into adulthood and predictors of long-term active disease in juvenile idiopathic arthritis. Ann Rheum Dis 2016 Jan;75(1):190-195. [CrossRef] [Medline]
- World Health Organization. WHO. Geneva, Switzerland: World Health Organization; 2001. The second decade: improving adolescent health and development URL: http://apps.who.int/iris/bitstream/10665/64320/1/WHO_FRH_ADH_98.18_Rev.1.pdf [accessed 2017-08-10] [WebCite Cache]
- Webb K, Wedderburn LR. Advances in the treatment of polyarticular juvenile idiopathic arthritis. Curr Opin Rheumatol 2015 Sep;27(5):505-510 [FREE Full text] [CrossRef] [Medline]
- Oberle EJ, Harris JG, Verbsky JW. Polyarticular juvenile idiopathic arthritis - epidemiology and management approaches. Clin Epidemiol 2014 Oct;6:379-393 [FREE Full text] [CrossRef] [Medline]
- Kim KN. Treatment of juvenile rheumatoid arthritis. Korean J Pediatr 2010 Nov;53(11):936-941 [FREE Full text] [CrossRef] [Medline]
- Ansell B. Prognosis in juvenile arthritis. Adv Exp Med Biol 1999;455:27-33. [CrossRef] [Medline]
- Kasapçopur Ö, Barut K. Treatment in juvenile rheumatoid arthritis and new treatment options. Turk Pediatri Ars 2015 Mar;50(1):1-10 [FREE Full text] [CrossRef] [Medline]
- Long AR, Rouster-Stevens KA. The role of exercise therapy in the management of juvenile idiopathic arthritis. Curr Opin Rheumatol 2010 Mar;22(2):213-217. [CrossRef] [Medline]
- Haverman L, Grootenhuis MA, van den Berg JM, van VM, Dolman KM, Swart JF, et al. Predictors of health-related quality of life in children and adolescents with juvenile idiopathic arthritis: results from a Web-based survey. Arthritis Care Res (Hoboken) 2012 May;64(5):694-703 [FREE Full text] [CrossRef] [Medline]
- April KT, Feldman DE, Zunzunegui MV, Duffy CM. Association between perceived treatment adherence and health-related quality of life in children with juvenile idiopathic arthritis: perspectives of both parents and children. Patient Prefer Adherence 2008 Feb 02;2:121-128 [FREE Full text] [Medline]
- Len CA, Miotto e Silva VB, Terreri MT. Importance of adherence in the outcome of juvenile idiopathic arthritis. Curr Rheumatol Rep 2014 Apr;16(4):410. [CrossRef] [Medline]
- Iversen MD, Hammond A, Betteridge N. Self-management of rheumatic diseases: state of the art and future perspectives. Ann Rheum Dis 2010 Jun;69(6):955-963. [CrossRef] [Medline]
- Feldman DE, De CM, Dobkin PL, Malleson PN, Meshefedjian G, Duffy CM. Effects of adherence to treatment on short-term outcomes in children with juvenile idiopathic arthritis. Arthritis Rheum 2007 Aug 15;57(6):905-912 [FREE Full text] [CrossRef] [Medline]
- Shaw KL, Southwood TR, McDonagh JE, British Society of PaediatricAdolescent Rheumatology. Young people's satisfaction of transitional care in adolescent rheumatology in the UK. Child Care Health Dev 2007 Jul;33(4):368-379. [CrossRef] [Medline]
- Dean AJ, Walters J, Hall A. A systematic review of interventions to enhance medication adherence in children and adolescents with chronic illness. Arch Dis Child 2010 Sep;95(9):717-723. [CrossRef] [Medline]
- Stringer E, Scott R, Mosher D, MacNeill I, Huber AM, Ramsey S, et al. Evaluation of a rheumatology transition clinic. Pediatr Rheumatol Online J 2015 Jun 11;13:22 [FREE Full text] [CrossRef] [Medline]
- April KT, Feldman DE, Platt RW, Duffy CM. Comparison between children with juvenile idiopathic arthritis and their parents concerning perceived treatment adherence. Arthritis Rheum 2006 Aug 15;55(4):558-563 [FREE Full text] [CrossRef] [Medline]
- Rapoff MA. Management of adherence and chronic rheumatic disease in children and adolescents. Best Pract Res Clin Rheumatol 2006 Apr;20(2):301-314. [CrossRef] [Medline]
- Lawson EF, Hersh AO, Applebaum MA, Yelin EH, Okumura MJ, von SE. Self-management skills in adolescents with chronic rheumatic disease: a cross-sectional survey. Pediatr Rheumatol Online J 2011 Dec 06;9(1):35 [FREE Full text] [CrossRef] [Medline]
- Hazel E, Zhang X, Duffy CM, Campillo S. High rates of unsuccessful transfer to adult care among young adults with juvenile idiopathic arthritis. Pediatr Rheumatol Online J 2010 Jan 11;8:2 [FREE Full text] [CrossRef] [Medline]
- Rapoff MA, Lindsley CB. Improving adherence to medical regimens for juvenile rheumatoid arthritis. Pediatr Rheumatol Online J 2007 May 18;5:10 [FREE Full text] [CrossRef] [Medline]
- Ruperto N, Garcia-Munitis P, Villa L, Pesce M, Aggarwal A, Fasth A, Paediatric Rheumatology International Trials Organisation, Paediatric Rheumatology European Society. PRINTO/PRES international website for families of children with rheumatic diseases: www.pediatric-rheumatology.printo.it. Ann Rheum Dis 2005 Jul;64(7):1101-1106 [FREE Full text] [CrossRef] [Medline]
- Lorig KR, Ritter PL, Laurent DD, Plant K. The internet-based arthritis self-management program: a one-year randomized trial for patients with arthritis or fibromyalgia. Arthritis Rheum 2008 Jul 15;59(7):1009-1017 [FREE Full text] [CrossRef] [Medline]
- White M, Stinson JN, Lingley-Pottie P, McGrath PJ, Gill N, Vijenthira A. Exploring therapeutic alliance with an internet-based self-management program with brief telephone support for youth with arthritis: a pilot study. Telemed J E Health 2012 May;18(4):271-276. [CrossRef] [Medline]
- Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci 2011;6:42 [FREE Full text] [CrossRef] [Medline]
- Jackson C, Eliasson L, Barber N, Weinman J. Applying COM-B to medication adherence: a suggested framework for research and interventions. Eur Heal Psychol 2014;16:7-17.
- Barker F, Atkins L, de LS. Applying the COM-B behaviour model and behaviour change wheel to develop an intervention to improve hearing-aid use in adult auditory rehabilitation. Int J Audiol 2016 Jul;55(Suppl 3):S90-S98. [CrossRef] [Medline]
- Alexander KE, Brijnath B, Mazza D. Barriers and enablers to delivery of the healthy kids check: an analysis informed by the theoretical domains framework and COM-B model. Implement Sci 2014 May 23;9:60 [FREE Full text] [CrossRef] [Medline]
- Pai AL, McGrady M. Systematic review and meta-analysis of psychological interventions to promote treatment adherence in children, adolescents, and young adults with chronic illness. J Pediatr Psychol 2014 Sep;39(8):918-931 [FREE Full text] [CrossRef] [Medline]
- Livingstone S, Haddon L, Vincent J, Mascheroni G, Olafsson K. LSE. London: London School of Economics and Political Science; 2014. Net children go mobile: the UK report URL: https://www.lse.ac.uk/media@lse/research/EUKidsOnline/EU%20Kids%20III/Reports/NCGMUKReportfinal.pdf [accessed 2017-08-10] [WebCite Cache]
- Parmanto B, Pramana G, Yu DX, Fairman AD, Dicianno BE, McCue MP. iMHere: a novel mhealth system for supporting self-care in management of complex and chronic conditions. JMIR Mhealth Uhealth 2013 Jul 11;1(2):e10 [FREE Full text] [CrossRef] [Medline]
- Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, et al. The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS Med 2013 Jan;10(1):e1001362 [FREE Full text] [CrossRef] [Medline]
- Applebaum MA, Lawson EF, von SE. Perception of transition readiness and preferences for use of technology in transition programs: teens' ideas for the future. Int J Adolesc Med Health 2013;25(2):119-125. [CrossRef] [Medline]
- de la Vega R, Roset R, Galán S, Miró J. Fibroline: a mobile app for improving the quality of life of young people with fibromyalgia. J Health Psychol 2016 May 24:- Epub ahead of print. [CrossRef] [Medline]
- Nishiguchi S, Ito H, Yamada M, Yoshitomi H, Furu M, Ito T, et al. Self-assessment of rheumatoid arthritis disease activity using a smartphone application. development and 3-month feasibility study. Methods Inf Med 2016 Sep;55(1):65-69. [CrossRef] [Medline]
- Palermo TM, Valenzuela D, Stork PP. A randomized trial of electronic versus paper pain diaries in children: impact on compliance, accuracy, and acceptability. Pain 2004;107(3):213-219. [CrossRef]
- Stinson JN, Jibb LA, Lalloo C, Feldman BM, McGrath PJ, Petroz GC, et al. Comparison of average weekly pain using recalled paper and momentary assessment electronic diary reports in children with arthritis. Clin J Pain 2014 Dec;30(12):1044-1050. [CrossRef] [Medline]
- Bromberg MH, Connelly M, Anthony KK, Gil KM, Schanberg LE. Self-reported pain and disease symptoms persist in juvenile idiopathic arthritis despite treatment advances: an electronic diary study. Arthritis Rheumatol 2014 Feb;66(2):462-469 [FREE Full text] [CrossRef] [Medline]
- Connelly M, Bromberg MH, Anthony KK, Gil KM, Franks L, Schanberg LE. Emotion regulation predicts pain and functioning in children with juvenile idiopathic arthritis: an electronic diary study. J Pediatr Psychol 2012 Oct;37(1):43-52 [FREE Full text] [CrossRef] [Medline]
- Fisher RS, Blum DE, DiVentura B, Vannest J, Hixson JD, Moss R, et al. Seizure diaries for clinical research and practice: limitations and future prospects. Epilepsy Behav 2012 Jul;24(3):304-310. [CrossRef] [Medline]
- Connelly M, Anthony KK, Sarniak R, Bromberg MH, Gil KM, Schanberg LE. Parent pain responses as predictors of daily activities and mood in children with juvenile idiopathic arthritis: the utility of electronic diaries. J Pain Symptom Manage 2010 Mar;39(3):579-590 [FREE Full text] [CrossRef] [Medline]
- Lalloo C, Jibb LA, Rivera J, Agarwal A, Stinson JN. “There's a Pain App for That”: review of patient-targeted smartphone applications for pain management. Clin J Pain 2015 Jun;31(6):557-563. [CrossRef] [Medline]
- Majeed-Ariss R, Baildam E, Campbell M, Chieng A, Fallon D, Hall A, et al. Apps and adolescents: a systematic review of adolescents' use of mobile phone and tablet apps that support personal management of their chronic or long-term physical conditions. J Med Internet Res 2015 Dec;17(12):e287 [FREE Full text] [CrossRef] [Medline]
- de la Vega R, Miró J. mHealth: a strategic field without a solid scientific soul. a systematic review of pain-related apps. PLoS One 2014 Jul;9(7):e101312 [FREE Full text] [CrossRef] [Medline]
- Stinson JN, Petroz GC, Tait G, Feldman BM, Streiner D, McGrath PJ, et al. e-Ouch: usability testing of an electronic chronic pain diary for adolescents with arthritis. Clin J Pain 2006;22(3):295-305. [CrossRef] [Medline]
- Stinson JN, Petroz GC, Stevens BJ, Feldman BM, Streiner D, McGrath PJ, et al. Working out the kinks: testing the feasibility of an electronic pain diary for adolescents with arthritis. Pain Res Manag 2008;13(5):375-382. [CrossRef]
- Stinson JN, Stevens BJ, Feldman BM, Streiner D, McGrath PJ, Dupuis A, et al. Construct validity of a multidimensional electronic pain diary for adolescents with arthritis. Pain 2008 Jun;136(3):281-292. [CrossRef] [Medline]
- Anderson R. New MRC guidance on evaluating complex interventions. BMJ 2008 Oct 22;337:a1937. [CrossRef]
- Mackenzie M, O'Donnell C, Halliday E, Sridharan S, Platt S. Do health improvement programmes fit with MRC guidance on evaluating complex interventions? BMJ 2010 Feb 01;340:c185. [CrossRef]
- Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. Int J Nurs Stud 2013 May;50(5):587-592. [CrossRef] [Medline]
- Petty RE, Southwood TR, Manners P, Baum J, Glass DN, Goldenberg J, International League of Associations for Rheumatology. International league of associations for rheumatology classification of juvenile idiopathic arthritis: second revision, Edmonton, 2001. J Rheumatol 2004 Feb;31(2):390-392. [Medline]
- Marshall NJ, Wilson G, Lapworth K, Kay LJ. Patients' perceptions of treatment with anti-TNF therapy for rheumatoid arthritis: a qualitative study. Rheumatology (Oxford) 2004 Aug;43(8):1034-1038 [FREE Full text] [CrossRef] [Medline]
- Krueger R, Casey M. Focus Groups: A Practical Guide for Applied Research. Thousand Oaks, CA: SAGE Publications; 2000.
- Kidd PS, Parshall MB. Getting the focus and the group: enhancing analytical rigor in focus group research. Qual Health Res 2000 May 01;10(3):293-308. [CrossRef]
- Lund AM. Measuring usability with the USE questionnaire. Usability Interface 2001;8:3-6.
- Guest G. How many interviews are enough?: an experiment with data saturation and variability. Field Methods 2006 Feb 01;18(1):59-82. [CrossRef]
- Hsieh H, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res 2005 Nov;15(9):1277-1288. [CrossRef] [Medline]
- Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today 2004 Feb;24(2):105-112. [CrossRef] [Medline]
- QSR International Pty Ltd. 2012. NVivo qualitative data analysis software version 10 URL: http://www.qsrinternational.com/nvivo-product [accessed 2017-07-03] [WebCite Cache]
- Huguet A, Stinson JN, McGrath PJ. Measurement of self-reported pain intensity in children and adolescents. J Psychosom Res 2010 Apr;68(4):329-336. [CrossRef] [Medline]
- Geerdink LM, Prince FH, Looman CW, van Suijlekom-Smit LW. Development of a digital childhood health assessment questionnaire for systematic monitoring of disease activity in daily practice. Rheumatology (Oxford) 2009 Aug;48(8):958-963 [FREE Full text] [CrossRef] [Medline]
- Schanberg LE, Sandstrom MJ. Causes of pain in children with arthritis. Rheum Dis Clin North Am 1999 Feb;25(1):31-53. [CrossRef]
- Schanberg LE, Anthony KK, Gil KM, Maurin EC. Daily pain and symptoms in children with polyarticular arthritis. Arthritis Rheum 2003 May;48(5):1390-1397 [FREE Full text] [CrossRef] [Medline]
- Consolaro A, Ruperto N, Bazso A, Pistorio A, Magni-Manzoni S, Filocamo G, Paediatric Rheumatology International Trials Organisation. Development and validation of a composite disease activity score for juvenile idiopathic arthritis. Arthritis Rheum 2009 May 15;61(5):658-666 [FREE Full text] [CrossRef] [Medline]
- Laurent J, Catanzaro SJ, Joiner TE, Rudolph KD, Potter KI, Lambert S, et al. A measure of positive and negative affect for children: scale development and preliminary validation. Psychol Assessment 1999;11(3):326-338. [CrossRef]
- Alfvén G, Nilsson S. Validity and reliability of a new short verbal rating scale for stress for use in clinical practice. Acta Paediatr 2014 Apr;103(4):e173-e175. [CrossRef] [Medline]
- Singh G, Athreya BH, Fries JF, Goldsmith DP. Measurement of health status in children with juvenile rheumatoid arthritis. Arthritis Rheum 1994 Dec;37(12):1761-1769. [Medline]
- Sawyer SM, Aroni RA. Self-management in adolescents with chronic illness. What does it mean and how can it be achieved? Med J Aust 2005 Oct 17;183(8):405-409. [Medline]
- Von Korff M. Collaborative management of chronic illness. Ann Intern Med 1997 Dec 15;127(12):1097. [CrossRef]
- Lorig KR, Holman HR. Self-management education: history, definition, outcomes, and mechanisms. Ann Behav Med 2003 Aug;26(1):1-7. [CrossRef]
- Armitt G, Cobb J, Shoop S, Rashid A, Sunil S, Douglas S, et al. CAPTURE-JIA Patient Status Dataset: a consensus-derived core dataset to improve clinical care for childrenyoung people with Juvenile Idiopathic Arthritis. Proceedings of the British Society for AdolescentPaediatric Rheumatology Annual Conference. 2015 Presented at: Proceedings of the British Society for Adolescent and Paediatric Rheumatology Annual Conference; September 24-25, 2015; Belfast, UK.
- Cafazzo JA, Casselman M, Hamming N, Katzman DK, Palmert MR. Design of an mHealth app for the self-management of adolescent type 1 diabetes: a pilot study. J Med Internet Res 2012 May;14(3):e70 [FREE Full text] [CrossRef] [Medline]
- Frøisland DH, Arsand E, Skårderud F. Improving diabetes care for young people with type 1 diabetes through visual learning on mobile phones: mixed-methods study. J Med Internet Res 2012 Aug 06;14(4):e111 [FREE Full text] [CrossRef] [Medline]
- Burbank AJ, Lewis SD, Hewes M, Schellhase DE, Rettiganti M, Hall-Barrow J, et al. Mobile-based asthma action plans for adolescents. J Asthma 2015 Jan;52(6):583-586. [CrossRef] [Medline]
- Ryan D, Price D, Musgrave SD, Malhotra S, Lee AJ, Ayansina D, et al. Clinical and cost effectiveness of mobile phone supported self monitoring of asthma: multicentre randomised controlled trial. BMJ 2012;344:e1756 [FREE Full text] [Medline]
- Aldiss S, Taylor R, Soanes L, Maguire R, Sage M, Kearney N, et al. Working in collaboration with young people and health professionals. A staged approach to the implementation of a randomised controlled trial. J Res Nurs 2011 Nov;16(6):561-576. [CrossRef]
- Stinson JN, Jibb LA, Nguyen C, Nathan PC, Maloney AM, Dupuis LL, et al. Development and testing of a multidimensional iPhone pain assessment application for adolescents with cancer. J Med Internet Res 2013 Mar;15(3):e51 [FREE Full text] [CrossRef] [Medline]
|CHAQ: Childhood Health Assessment Questionnaire|
|ERA: enthesitis-related arthritis|
|FGD: focus group discussion|
|GOSH: Great Ormond Street Hospital|
|HCP: health care professional|
|JIA: juvenile idiopathic arthritis|
|SD: standard deviation|
|UCLH: University College London Hospital|
|VAS: visual analog scales|
|VRSS: verbal rating scale for stress|
|YP: young people|
Edited by G Eysenbach; submitted 02.01.17; peer-reviewed by E Lawson, R Grainger; comments to author 02.02.17; revised version received 13.03.17; accepted 14.04.17; published 15.08.17
©Ran A Cai, Dominik Beste, Hema Chaplin, Socrates Varakliotis, Linda Suffield, Francesca Josephs, Debajit Sen, Lucy R Wedderburn, Yiannakis Ioannou, Stephen Hailes, Despina Eleftheriou. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 15.08.2017.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.