Published on in Vol 8, No 6 (2020): June

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/15086, first published .
Patients’ Measurement Priorities for Remote Measurement Technologies to Aid Chronic Health Conditions: Qualitative Analysis

Patients’ Measurement Priorities for Remote Measurement Technologies to Aid Chronic Health Conditions: Qualitative Analysis

Patients’ Measurement Priorities for Remote Measurement Technologies to Aid Chronic Health Conditions: Qualitative Analysis

Original Paper

1Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom

2Merck Research Labs IT, Merck Sharpe & Dohme, Prague, Czech Republic

3Janssen Pharmaceuticals, LLC, Titusville, NJ, United States

4RADAR-CNS, London, United Kingdom

Corresponding Author:

Sara Simblett, PhD, DClinPsy

Institute of Psychiatry, Psychology and Neuroscience

King's College London

Henry Wellcome Building, Psychology Department, 2nd Floor

London

United Kingdom

Phone: 44 2078480762

Email: sara.simblett@kcl.ac.uk


Background: Remote measurement technology (RMT), including the use of mobile phone apps and wearable devices, may provide the opportunity for real-world assessment and intervention that will streamline clinical input for years to come. In order to establish the benefits of this approach, we need to operationalize what is expected in terms of a successful measurement. We focused on three clinical long-term conditions where a novel case has been made for the benefits of RMT: major depressive disorder (MDD), multiple sclerosis (MS), and epilepsy.

Objective: The aim of this study was to conduct a consultation exercise on the clinical end point or outcome measurement priorities for RMT studies, drawing on the experiences of people with chronic health conditions.

Methods: A total of 24 participants (16/24 women, 67%), ranging from 28 to 65 years of age, with a diagnosis of one of three chronic health conditions―MDD, MS, or epilepsy―took part in six focus groups. A systematic thematic analysis was used to extract themes and subthemes of clinical end point or measurement priorities.

Results: The views of people with MDD, epilepsy, and MS differed. Each group highlighted unique measurements of importance, relevant to their specific needs. Although there was agreement that remote measurement could be useful for tracking symptoms of illness, some symptoms were specific to the individual groups. Measuring signs of wellness was discussed more by people with MDD than by people with MS and epilepsy. However, overlap did emerge when considering contextual factors, such as life events and availability of support (MDD and epilepsy) as well as ways of coping (epilepsy and MS).

Conclusions: This is a unique study that puts patients’ views at the forefront of the design of a clinical study employing novel digital resources. In all cases, measuring symptom severity is key; people want to know when their health is getting worse. Second, symptom severity needs to be placed into context. A holistic approach that, in some cases, considers signs of wellness as well as illness, should be the aim of studies employing RMT to understand the health of people with chronic conditions.

JMIR Mhealth Uhealth 2020;8(6):e15086

doi:10.2196/15086

Keywords



It is estimated that by 2020, chronic health conditions will contribute to approximately 57% of the global burden of disease [1]. There is a need for innovative ways to support all these people in accessing clinical care and in managing their long-term conditions, in the context of limited resources. A case has been made for the use of mobile technology (eg, mobile phone apps and wearable technology) to provide real-world assessment and intervention that will both streamline clinical input and, where possible, promote independent self-management [2,3]. As an example, remote measurement technology (RMT) can gather data that may enable the early detection of worsening symptoms with the potential to offer rapid interventions. A recent systematic review identified an emergence of studies in this area [4]. In order to establish the benefits of using RMT, we need to clarify what is expected in terms of a successful outcome. The selection of outcomes measured is often determined by the interests of researchers, which may in part be driven by the availability of valid and reliable tools. More and more, people are advocating for the involvement of the people who receive or provide health services in translational research design [5]. The recent Academy of Medical Sciences’ report [6], Our data-driven future in healthcare: People and partnerships at the heart of health-related technologies, recommends that patients and the public should be active partners in agreeing on priorities for, and determining the acceptability of, data-driven technologies as part of an ongoing process.

The aim of this study was to conduct a consultation exercise on measurements of interest in RMT studies. We identified three clinical groups where there is a strong case for the potential benefits of RMT for measuring and managing recurrent and persistent chronic health conditions: major depressive disorder (MDD), a mood disorder characterized by a persistent feeling of sadness or a lack of interest in outside stimuli with a high risk of reoccurrence [7]; multiple sclerosis (MS), a relapsing or progressive demyelinating disease in which the insulating covers of nerve cells in the brain and spinal cord are damaged over time; and epilepsy, a long-term neurological condition causing frequent seizures (see Table 1). These clinical groups are varied and have different presenting characteristics, but they are all long-term, highly variable conditions that are costly to manage with largely unknown mechanisms precipitating relapse. Monitoring symptoms over time could assist with developing a better understanding of these relapse mechanisms and patterns of variability; this could potentially lead to the early identification of relapse or deterioration with the ability to intervene more quickly. Previous consultation exercises with people living with these three health conditions—MDD [8,9], MS [10], and epilepsy [11]—have identified overlapping themes that are pertinent to the introduction of mobile technologies, including the importance of self-management, prevention or prediction of symptoms, and early intervention. None of these consultations so far have asked specifically about people’s views on what might be important to measure when implementing mobile technologies. This information is crucial for being able to design systems that engage users, under the assumption that measurement of meaningful information is necessary for sustained engagement [4]. The aim of this paper is to extend previous work and focus on the use of RMT.

Table 1. Case examples of the use of remote measurement technology.
Health conditionCase example
Major depressive disorder (MDD)Symptom recall for people with MDD is frequently interrupted and biased by poor cognition and dysfunctional perceptions. Reliance on self-report measures alone leads to imprecise and inefficient estimations of effects in clinical trials. Mobile technology, including wearable sensors, may allow for more momentary and continuous assessment of factors associated with MDD (eg, reduced activity or change in speech patterns and other physiology). Signs of relapse may be able to be detected before a person is fully aware of their declining mood.
Multiple sclerosis (MS)There is emerging evidence for the reliability and validity of mobility and gait assessment using wearable activity monitoring (ie, accelerometry) for modelling relapse in MS. Use of mobile sensors, combined with more frequent (eg, daily or weekly) self-reported outcomes to contextualize changes in activity, may provide early indicators of relapse that have not been detectable in the past.
EpilepsyRoutine electroencephalogram electrode technology for monitoring health state in epilepsy cannot be implemented for more than a few days at a time. There is scope to integrate mobile technology into clinical assessment that will allow collection of continuous data to track, and possibly predict, seizure occurrence as part of daily life. Other mobile sensors (eg, wearable heart rate and activity monitors) are being investigated as alternative, potentially less obtrusive, options.

Design

A qualitative approach using a thematic analysis was employed to elicit views on measurement priorities from service users. Themes and subthemes were identified following grounded-theory methods.

Context

Researcher Characteristics

Six focus groups were facilitated by two women—a clinical psychologist and a health psychologist—who were not involved in the participants’ clinical care.

Participant Characteristics

Participants were identified by convenience sampling and their eligibility to participate. Participants were included if they were over the age of 18 and had received a diagnosis of MS, epilepsy, or MDD (within the past 2 years for MDD). People with MS and epilepsy were recruited through third-sector organizations (ie, the MS Society and Epilepsy Action) and local clinics; people with MDD were recruited from a register of people who had given prior consent to be contacted about research studies and had been screened on a self-report measure of MDD: the World Health Organization's Composite International Diagnostic-Short Form [12]. Table 2 displays the characteristics of this sample in terms of their gender and age, as well as the time postdiagnosis for each health condition.

Table 2. Sample characteristics across the three health conditions.
CharacteristicMajor depressive disorder (n=8)Epilepsy (n=7)Multiple sclerosis (n=9)
Gender (female), n (%)5 (63)5 (71)6 (67)
Age (years), mean (SD)51.9 (9.4)44.4 (15.8)43.4 (9.5)
Time postdiagnosis (years), mean (SD)8.3 (10.3)19.1 (16.2)2.9 (1.6)
Ethnicity, n (%)



Caucasian5 (63)6 (86)6 (67)

Black2 (25)N/AaN/A

Asian1 (13)N/AN/A

OtherN/A1 (14)3 (33)
Theme-checking group follow-up, n (%)6 (75)5 (71)5 (56)

aN/A: not applicable.

Focus Group Procedure

A local research ethics committee (REC) approved these procedures (REC reference No. 16/LO/1513). All participants were screened for their eligibility to take part and, if eligible, were invited to a focus group session, for which travel expenses were covered. In this session, they first completed a consent form and a demographics questionnaire. We conducted separate focus groups for people with a diagnosis of MDD, MS, and epilepsy. For each, the main discussion was semistructured using a prespecified topic guide (available on request). The discussion was designed based on the existing literature and through consultation with health care professionals and service users to elicit ideas about what was important to people in terms of their physical and mental health and well-being (eg, whether measuring relapse was important). In the topic guide, we referenced long-term conditions but also focused separately on symptoms of MDD, symptoms of MS, and seizure occurrence, tailoring this to the ones most relevant to the group. The open-discussion format allowed people to share a breadth of experiences, including what was important to their health and well-being, as well as suggestions for important areas to measure using RMT. Each group’s main discussion lasted 60-120 minutes and was combined with a conversation about potential barriers and facilitators to engagement, the content of which has been published elsewhere [13-15]. We invited all participants to comment on the themes extracted from the main discussion in a second focus group. This member-checking process allowed us to validate the themes that had been extracted from the main discussion. The results from this second session were combined with the first session to add further depth and to clarify the points raised.

Data Analysis

Focus group discussions were audio recorded and transcribed verbatim. For each health condition, analyses were conducted by two researchers working independently using the software package NVivo 11 (QSR International) [16]. Themes emerging from the data were identified in the final analysis. Disagreements in coding were resolved as a pair, and a joint decision was made about the allocation of a code to each quotation.


Overview

A total of 24 participants, ranging from 28 to 65 years of age, took part in three focus groups; 67% (16/24) of participants were women. Of the 24 participants, 16 (67%) returned for a further member-checking session to verify the findings. This meant that six focus groups were run in total. There was a similar distribution of men and women across the focus groups. However, participants with a history of MDD were, on average, slightly older. The time spent living with the chronic health condition varied; the people with MS had, on average, been living with their condition for the shortest amount of time.

The focus groups identified several factors important to health and well-being across the three health conditions. We have divided these results into the measurement priorities important for each clinical group separately. For MDD and MS, the discussions centered around the importance of detecting signs of relapse or deterioration in health; for epilepsy, the focus was on the detection of seizures. For all groups, there was a consideration of how RMT may support well-being as well as symptoms of illness and contextual factors.

Major Depressive Disorder

Participants were asked what was important to their health and well-being and what factors may be important to measure using RMT. They reported a plethora of possible symptoms commonly associated with relapse in MDD, including negative thoughts (ie, about being dissatisfied with themselves, unsupported, and burnt out); poor sleep; changes in appetite (ie, for some, this included experience of eating disorders); withdrawal from activities, including social activities and self-care; and anxiety, including fear of relapse.

I was thinking probably when I don’t sleep well … that’s a sign. You can get these tracker things now and I was thinking getting one myself, that’s supposed to track your sleep. I thought maybe something as simple as that might actually be helpful.
[MDD participant #8, regarding poor sleep as a sign of relapse]

In addition to relapse, some participants valued a focus on remission or maintenance of wellness. For measurable signs of wellness, participants had several suggestions, including being more active, such as participating in more social and other leisure activities (ie, moderate physical activity) and engaging in employment; eating well; feeling in control and actively coping with situations; feeling good about oneself; and experiencing a sense of achievement.

I like recording what keeps me well, not what makes me ill. I’d much prefer contemplating to think more positively. To think, “oh these things work.” I like to keep focused on the positive side.
[MDD participant #4, regarding measuring wellness]

Contextual factors that included life events, such as bereavement, problems with employment, and financial difficulties, were seen to be important to monitor. Additional physical health problems and availability of support in the context of barriers, such as social isolation, were mentioned as potentially stress-inducing contextual factors. One person mentioned the importance of tracking information that might be useful for medication management.

I could see that if um the tracking information would be useful for my doctor, to help with trying to find the right medication.
[MDD participant #6, regarding the importance of tracking medication use]

Multiple Sclerosis

Participants with a diagnosis of MS also endorsed using RMT to measure and predict relapse but mostly in the context of a diagnosis of relapsing-remitting MS. For participants with a diagnosis of progressive forms of MS, relapse was less important because this did not reflect their experience of living with their condition.

The other thing I’d find useful would be to be able to sort of track how much worse I’m getting, it’s very hard to know, because it’s very gradual in a way, the deterioration I’m getting.
[MS participant #8, regarding measuring deterioration]

This suggests that a focus on change in severity of symptoms would still be of importance to measure when using RMT. Deterioration in mobility and gait were key symptoms highlighted. However, participants emphasized the importance of measuring additional symptoms, such as vision (ie, for some, optic neuritis was an early symptom of MS relapse), fatigue, and social functioning. Mental health was also thought to be important to measure. Participants highlighted specific times that may be associated with greater distress, including the time before their diagnosis, and periods of relief afterward. These key moments in the trajectory of people’s illness may be particularly important targets for remote measurement and intervention.

In addition to symptoms of illness, some participants spoke of the value in measuring signs of wellness, for instance, eating well and being active. Individual contextual factors such as outlook or attitude modified their experience, with active attempts to cope being potentially protective for well-being.

If there’s something that monitors everything that you’ve eaten that day and what you’ve been doing that day and then it’s like, “okay that’s been a good day,” then you’ll have that information to think, “well maybe I’ll do more of that to try and increase the amount of good days.”
[MS participant #9, regarding measuring wellness]

Epilepsy

Participants with epilepsy saw the potential importance of RMT in its ability to measure the frequency of seizures, as well as preseizure symptoms or predictors. The unpredictable nature of seizure occurrence was discussed among participants, including the potential value for technology to provide more control.

I get warnings before my seizures but they’re not very long, so if I can predict it even before that, it might change the way I plan my day.
[Epilepsy participant #6, regarding value of predicting seizures]

Perhaps due to the uncertainty surrounding predictors of seizure, different participants raised different parameters of importance. Those most frequently mentioned included change in emotions, including anger, anxiety, and more positive emotions such as excitement, as well as altered sleep, including sleep deprivation and irregular sleep patterns. Physiological signals, such as heart rate and brain activity (eg, electroencephalography), were mentioned to help detect seizures.

It is important to note that some participants felt that a singular focus on seizures may be problematic. Participants spoke of epilepsy having an impact on their life in a more holistic way. Contextual factors such as effects on working life may be just as important to track as seizure frequency. These contextual factors were framed in terms of the losses that people with epilepsy experience as a result of their health condition (eg, loss of employment).

It’s actually the 23 hours of every day when you’re not having a fit, that’s the time that the epilepsy has the biggest effect.
[Epilepsy participant #4, regarding importance of context]
I don’t want that constant reminder when I’m having a good day.
[Epilepsy participant #6, regarding importance of the ability to forget diagnosis on well days]

Despite the importance of a holistic approach, the group did not think that focusing on signs of wellness would always be of help. One person stated that it might be annoying to be constantly reminded that they had a diagnosis of epilepsy on days when they felt well. This linked to a discussion that acceptance of their own health condition was hard and potentially influenced by a felt sense of stigma. The psychosocial impact of epilepsy may be important to track.

Comparison Across Health Conditions

From Figure 1, it is apparent that the views of people with MDD, epilepsy, and MS differed. Each group highlighted unique measurements of importance, relevant to their specific needs. Although there was agreement that remote measurement could be useful for tracking symptoms of illness, some symptoms were specific to the individual groups: for MDD this included negative thoughts; for MS it was reduced mobility and poor vison; and for epilepsy it was change in physiological parameters, such as heart rate and activity in the brain. That said, some symptoms were shared across the groups, including poor sleep (MDD and epilepsy), reduced social functioning (MDD and MS), as well as diet and anxiety (MDD, epilepsy, and MS). Measuring signs of wellness were mentioned more by people with MDD than by people with MS and epilepsy. However, there was some overlap between MDD and MS, with increased activity being important to both. Overlap also emerged when considering contextual factors, such as life events, and availability of support (MDD and epilepsy), as well as ways of coping (epilepsy and MS).

Figure 1. The unique and overlapping outcomes of importance for three chronic health conditions: major depressive disorder (ie, depression), epilepsy, and multiple sclerosis. Grey areas outside of the overlapping sections represent contextual factors either shared or uniquely mentioned by members of the focus groups.
View this figure

Principal Findings

When participants in this consultation exercise were asked what they thought would be a successful measurement for the implementation of RMT, they endorsed the idea of detecting and predicting relapse (for MDD and relapsing-remitting MS) or negative change in health state (ie, deterioration for progressive forms of MS and seizure occurrence for epilepsy). Symptoms of relapse or negative change in health as described in the focus groups have been well documented; they form the basis of clinical assessment interviews and self-report tools that have been validated to measure severity of MDD (eg, the nine-item Patient Health Questionnaire) [17], MS (eg, the UK Functional Independence Measure and Functional Assessment Measure) [18], and epilepsy (eg, the Liverpool Seizure Severity Scale) [19]. These are very clearly measurements of interest for studies using RMT. If symptoms can be identified early, timely interventions may be offered, before these symptoms become more severe.

A Holistic and Context-Specific Approach

It is important to view the conditions MDD, MS, and epilepsy both separately and holistically, meaning that we choose end points that can help us to understand people as unique individuals experiencing complex health conditions and environments. People with MDD did not only want to be monitored for symptoms of MDD, but also anxiety. In addition, they wanted to measure their physical health. This is in line with existing research on the importance of physical health as a risk factor for MDD [20-22]. For people with MS and epilepsy, the combination of measuring mental health as well as physical health emerged too. MDD and anxiety are prevalent disorders among people with both MS [23] and epilepsy [24,25], and may contribute to early signs of relapse or deterioration in the health state. Using RMT to actively measure fluctuations in mood disorder and anxiety in real time may help to gather more reliable findings. RMTs are uniquely positioned to be able to address problems with recall bias introduced when there is a delay in self-reporting of experiences.

For MDD and MS, there were discussions about maintaining wellness and what this looked like, most commonly, in terms of increased activity, positive social functioning, and access to support. There may be an argument for including real-time measures of well-being (eg, the Warwick-Edinburgh Mental Well-being Scale) [26] and quality of life (eg, the EuroQol five-dimension questionnaire) [27] for RMT studies conducted for these groups. Passive measures of functioning gained through an analysis of mobile phone usage and wearable devices (eg, call logs and step counts) may also be of value. For people with epilepsy, there was little focus on maintaining wellness; people spoke about their illness being out of their control with unpredictable triggers in terms of how they were living their life. Difficulties establishing triggers for seizures has been a well-documented finding within the previous literature [28]. For people with epilepsy, being able to receive a warning of their seizure early was of most importance to them. This highlights a difference between the needs of people with epilepsy compared to the two other chronic health conditions.

Strengths and Limitations

The strengths of this study include the opportunity for an open and in-depth discussion with people who have first-hand experience of living with one of three chronic health conditions. This enabled a rich exploration of the health measurements of importance and allowed us to identify similarities and differences between the groups. The employed member-checking methods allowed validation of the results generated from the main discussion. Given the qualitative approach, we are limited in our ability to quantify the numbers of people wanting to measure specific outcomes or to run any statistical analyses to explore the significance of group differences, including factors such as diagnosis, age, ethnicity, and other characteristics not quantified, like the previous use of mHealth resources and income. This work has generated ideas that will inform the design of RMT studies. These RMT studies will test the relationships between the measurements of interest, including those identified in these focus groups.

Conclusions

In this consultation exercise, we identified measurements of importance when using RMT for three chronic health conditions: MDD, MS, and epilepsy. This is a unique study that puts patients’ views at the forefront of the design of a clinical study employing novel digital resources. We draw the following conclusions. First, in all cases, measuring symptom severity is key; people want to know when their health is getting worse. Second, symptom severity needs to be placed in context. When monitoring someone with a mental health condition such as MDD, social and physical health outcomes should also be considered, and vice versa for physical health conditions such as MS and epilepsy. A holistic approach that considers situational and attitudinal factors (eg, employment, social status, acceptance of health condition, eating patterns, and ways of coping) will enable a more complete picture of how unwell a person is feeling. For some people with MDD and MS, factors that maintain well-being are just as important as factors that contribute to relapse or deterioration in health status.

Acknowledgments

This paper was written as part of the development of useful mHealth and RMT systems in the Remote Assessment of Disease and Relapse – Central Nervous System (RADAR-CNS) project. The RADAR-CNS project has received funding from the Innovative Medicines Initiative (IMI) 2 Joint Undertaking (grant agreement No. 115902). This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation programme and the European Federation of Pharmaceutical Industries and Associations (EFPIA) [29] with one pharmaceutical company supporting the preparation of this manuscript as part of this precompetitive public and private partnership. This communication reflects the views of the RADAR-CNS Consortium [30], and neither IMI nor the European Union and EFPIA are liable for any use that may be made of the information contained herein. This paper also represents independent research partly funded by the National Institute for Health Research (NIHR) Biomedical Research Centre at South London and Maudsley National Health Service (NHS) Foundation Trust and King’s College London. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health and Social Care. Professor Til Wykes (TW) would specifically like to acknowledge support from the NIHR for their Senior Investigator Awards.

Authors' Contributions

TW, MH, and VN conceived of the project and oversaw how the study was conducted. SS conducted the research with the assistance of FM, BG, and HC and wrote the first draft of the manuscript. Further contributions to the writing of this draft were made by JN, AP, JF, and PG. All authors reviewed and commented on the final draft.

Conflicts of Interest

None declared.

  1. Rodgers A, Vaughan P, Prentice T, Tan-Torres Edejer T, Evans D, Lowe J. The World Health Report: Reducing Risks, Promoting Healthy Life. Geneva, Switzerland: World Health Organization; 2002.   URL: https://www.who.int/whr/2002/en/whr02_en.pdf?ua=1 [accessed 2020-01-27]
  2. Piwek L, Ellis DA, Andrews S, Joinson A. The rise of consumer health wearables: Promises and barriers. PLoS Med 2016 Feb;13(2):e1001953 [FREE Full text] [CrossRef] [Medline]
  3. Wicks P, Hotopf M, Narayan VA, Basch E, Weatherall J, Gray M. It's a long shot, but it just might work! Perspectives on the future of medicine. BMC Med 2016 Nov 07;14(1):176 [FREE Full text] [CrossRef] [Medline]
  4. Simblett S, Greer B, Matcham F, Curtis H, Polhemus A, Ferrão J, et al. Barriers to and facilitators of engagement with remote measurement technology for managing health: Systematic review and content analysis of findings. J Med Internet Res 2018 Jul 12;20(7):e10480 [FREE Full text] [CrossRef] [Medline]
  5. Callard F, Rose D, Wykes T. Close to the bench as well as at the bedside: Involving service users in all phases of translational research. Health Expect 2012 Dec;15(4):389-400 [FREE Full text] [CrossRef] [Medline]
  6. Our Data-Driven Future in Healthcare: People and Partnerships at the Heart of Health Related Technologies. London, UK: The Academy of Medical Sciences; 2018 Nov.   URL: https://acmedsci.ac.uk/file-download/74634438 [accessed 2020-01-27]
  7. Mueller T, Leon AC, Keller MB, Solomon DA, Endicott J, Coryell W, et al. Recurrence after recovery from major depressive disorder during 15 years of observational follow-up. Am J Psychiatry 1999 Jul;156(7):1000-1006. [CrossRef] [Medline]
  8. Hollis C, Sampson S, Simons L, Davies EB, Churchill R, Betton V, et al. Identifying research priorities for digital technology in mental health care: Results of the James Lind Alliance Priority Setting Partnership. Lancet Psychiatry 2018 Oct;5(10):845-854. [CrossRef]
  9. MQ. Depression   URL: https://www.mqmentalhealth.org/mental-health/conditions/depression [accessed 2020-01-27]
  10. Crowe S. Research Matters. London, UK: MS Society; 2014. Finding the top 10 research priorities   URL: http:/​/www.​jla.nihr.ac.uk/​news-and-publications/​downloads/​Research-Matters-Newsletter-Jan_Feb-2014.​pdf [accessed 2020-01-27]
  11. Hughes EG, Thomas RH. Epilepsy treatment priorities: Answering the questions that matter. J Neurol Neurosurg Psychiatry 2017 Nov;88(11):999-1001. [CrossRef] [Medline]
  12. Kessler RC, Andrews G, Mroczek D, Ustun B, Wittchen H. The World Health Organization Composite International Diagnostic Interview short-form (CIDI-SF). Int J Methods Psychiatr Res 2006 Nov;7(4):171-185. [CrossRef]
  13. Simblett S, Matcham F, Siddi S, Bulgari V, Barattieri di San Pietro C, Hortas López J, RADAR-CNS Consortium. Barriers to and facilitators of engagement with mHealth technology for remote measurement and management of depression: Qualitative analysis. JMIR Mhealth Uhealth 2019 Jan 30;7(1):e11325 [FREE Full text] [CrossRef] [Medline]
  14. Simblett SK, Bruno E, Siddi S, Matcham F, Giuliano L, López JH, RADAR-CNS Consortium. Patient perspectives on the acceptability of mHealth technology for remote measurement and management of epilepsy: A qualitative analysis. Epilepsy Behav 2019 Aug;97:123-129. [CrossRef] [Medline]
  15. Simblett SK, Evans J, Greer B, Curtis H, Matcham F, Radaelli M, RADAR-CNS Consortium. Engaging across dimensions of diversity: A cross-national perspective on mHealth tools for managing relapsing remitting and progressive multiple sclerosis. Mult Scler Relat Disord 2019 Jul;32:123-132. [CrossRef] [Medline]
  16. QSR International. NVivo   URL: https://www.qsrinternational.com/nvivo/home [accessed 2020-01-27]
  17. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: Validity of a brief depression severity measure. J Gen Intern Med 2001 Sep;16(9):606-613 [FREE Full text] [CrossRef] [Medline]
  18. Turner-Stokes L, Siegert RJ. A comprehensive psychometric evaluation of the UK FIM + FAM. Disabil Rehabil 2013;35(22):1885-1895 [FREE Full text] [CrossRef] [Medline]
  19. Baker GA, Smith DF, Jacoby A, Hayes JA, Chadwick DW. Liverpool Seizure Severity Scale revisited. Seizure 1998 Jun;7(3):201-205. [CrossRef]
  20. Ames ME, Leadbeater BJ. Depressive symptom trajectories and physical health: Persistence of problems from adolescence to young adulthood. J Affect Disord 2018 Nov;240:121-129. [CrossRef] [Medline]
  21. Beekman A, Penninx B, Deeg D, Ormel J, Braam A, van Tilburg W. Depression and physical health in later life: Results from the Longitudinal Aging Study Amsterdam (LASA). J Affect Disord 1997 Dec;46(3):219-231. [CrossRef]
  22. Bruce M, Hoff RA. Social and physical health risk factors for first-onset major depressive disorder in a community sample. Soc Psychiatry Psychiatr Epidemiol 1994 Jul;29(4):165-171. [CrossRef] [Medline]
  23. Boeschoten RE, Braamse AM, Beekman AT, Cuijpers P, van Oppen P, Dekker J, et al. Prevalence of depression and anxiety in multiple sclerosis: A systematic review and meta-analysis. J Neurol Sci 2017 Jan 15;372:331-341. [CrossRef] [Medline]
  24. Fiest KM, Dykeman J, Patten SB, Wiebe S, Kaplan GG, Maxwell CJ, et al. Depression in epilepsy: A systematic review and meta-analysis. Neurology 2012 Nov 21;80(6):590-599. [CrossRef]
  25. Wiglusz MS, Landowski J, Cubała WJ. Prevalence of anxiety disorders in epilepsy. Epilepsy Behav 2018 Feb;79:1-3. [CrossRef] [Medline]
  26. Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, et al. The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): Development and UK validation. Health Qual Life Outcomes 2007 Nov 27;5:63 [FREE Full text] [CrossRef] [Medline]
  27. Kind P, Hardman G, Macran S. UK Population Norms for EQ-5D. York, UK: Centre for Health Economics, University of York; 1999 Nov.   URL: https:/​/www.​york.ac.uk/​media/​che/​documents/​papers/​discussionpapers/​CHE%20Discussion%20Paper%20172.​pdf [accessed 2020-01-27]
  28. Schulze‐Bonhage A, Kühn A. Unpredictability of seizures and the burden of epilepsy. In: Schelter B, Timmer J, Schulze-Bonhage A, editors. Seizure Prediction in Epilepsy: From Basic Mechanisms to Clinical Applications. Weinheim, Germany: WILEY-VCH; 2008:1-10.
  29. Innovative Medicines Initiative (IMI).   URL: https://www.imi.europa.eu/ [accessed 2020-01-27]
  30. RADAR-CNS.   URL: https://www.radar-cns.org/ [accessed 2020-01-27]


EFPIA: European Federation of Pharmaceutical Industries and Associations
IMI: Innovative Medicines Initiative
MDD: major depressive disorder
MS: multiple sclerosis
NHS: National Health Service
NIHR: National Institute for Health Research
RADAR-CNS: Remote Assessment of Disease and Relapse – Central Nervous System
REC: research ethics committee
RMT: remote measurement technology


Edited by G Eysenbach; submitted 26.06.19; peer-reviewed by M Aanestad, J Hunter; comments to author 01.10.19; revised version received 31.10.19; accepted 15.12.19; published 10.06.20

Copyright

©Sara Simblett, Faith Matcham, Hannah Curtis, Ben Greer, Ashley Polhemus, Jan Novák, Jose Ferrao, Peter Gamble, Matthew Hotopf, Vaibhav Narayan, Til Wykes, Remote Assessment Of Disease And Relapse – Central Nervous System (RADAR-CNS) Consortium. Originally published in JMIR mHealth and uHealth (http://mhealth.jmir.org), 10.06.2020.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.