Original Paper
Abstract
Background: Electronic health diaries hold promise in complementing standardized surveys in prospective health studies but are fraught with numerous methodological challenges.
Objective: The study aimed to investigate participant characteristics and other factors associated with response to an electronic health diary campaign in persons with multiple sclerosis, identify recurrent topics in free-text diary entries, and assess the added value of structured diary entries with regard to current symptoms and medication intake when compared with survey-collected information.
Methods: Data were collected by the Swiss Multiple Sclerosis Registry during a nested electronic health diary campaign and during a regular semiannual Swiss Multiple Sclerosis Registry follow-up survey serving as comparator. The characteristics of campaign participants were descriptively compared with those of nonparticipants. Diary content was analyzed using the Linguistic Inquiry and Word Count 2015 software (Pennebaker Conglomerates, Inc) and descriptive keyword analyses. The similarities between structured diary data and follow-up survey data on health-related quality of life, symptoms, and medication intake were examined using the Jaccard index.
Results: Campaign participants (n=134; diary entries: n=815) were more often women, were not working full time, did not have a higher education degree, had a more advanced gait impairment, and were on average 5 years older (median age 52.5, IQR 43.25-59.75 years) than eligible nonparticipants (median age 47, IQR 38-55 years; n=524). Diary free-text entries (n=632; participants: n=100) most often contained references to the following standard Linguistic Inquiry and Word Count word categories: negative emotion (193/632, 30.5%), body parts or body functioning (191/632, 30.2%), health (94/632, 14.9%), or work (67/632, 10.6%). Analogously, the most frequently mentioned keywords (diary entries: n=526; participants: n=93) were “good,” “day,” and “work.” Similarities between diary data and follow-up survey data, collected 14 months apart (median), were high for health-related quality of life and stable for slow-changing symptoms such as fatigue or gait disorder. Similarities were also comparatively high for drugs requiring a regular application, including interferon beta-1a (Avonex) and glatiramer acetate (Copaxone), and for modern oral therapies such as fingolimod (Gilenya) and teriflunomide (Aubagio).
Conclusions: Diary campaign participation seemed dependent on time availability and symptom burden and was enhanced by reminder emails. Electronic health diaries are a meaningful complement to regular structured surveys and can provide more detailed information regarding medication use and symptoms. However, they should ideally be embedded into promotional activities or tied to concrete research study tasks to enhance regular and long-term participation.
doi:10.2196/38709
Keywords
Introduction
Background
Electronic health diaries are consumer- or patient-facing electronic tools to record personal health-relevant information prospectively [
]. Flexibility and ease of use make electronic health diaries an attractive option for self-learning, patient empowerment, and health care management support [ ]. Electronic health diaries are also used in research contexts where they offer more timely or even real-time reporting of health-related indicators and can thus meaningfully complement medical records or retrospective questionnaires [ ]. In addition, free-text entries of diary studies can offer a window into a person’s emotions [ - ] and daily-life contexts.Electronic health diaries have also found application in multiple sclerosis (MS) research, where they have been used as logbooks of physical activity sessions [
] or to record disability- or health-related quality of life scores [ - ]. Furthermore, health diaries have also been explored in the context of self-management improvement programs for persons with MS [ , ], as well as to monitor and enhance medication adherence to disease-modifying treatments (eg, through reminder functionalities) [ , ].However, numerous methodological and user challenges have been highlighted [
, ]. First, keeping health diaries over extended periods (ie, months or even years) demands continual intrinsic and extrinsic motivation, as well as substantial support from study investigators [ , ]. Second, studies relying on free-text entries require special analytical methods [ , ] that involve substantial manual data preprocessing. Finally, to increase compliance, the number of diary questions needs to be relatively small—thus limiting the depth of health information that can realistically be collected (eg, regarding a person’s disease history).Objectives
In light of these challenges, we aimed to explore the applicability and usability of electronic health diary data collected by the Swiss Multiple Sclerosis Registry (SMSR) during a week-long health diary campaign. Specifically, we aimed to compare the characteristics of the participants in the health diary campaign with eligible nonparticipants of the SMSR campaign (aim 1). Furthermore, we intended to analyze the content of the diary free-text field section by applying 2 different natural language processing methods (aim 2). Finally, we aimed to evaluate the diary-collected health-related quality of life, symptoms, and treatment information by comparing it with corresponding survey-based information (aim 3).
These investigations were guided by several literature- and research-based assumptions. Recent research has revealed that younger age is linked to a more frequent adoption of mobile health technologies [
, ]. Therefore, we hypothesized that the electronic health diary campaign participants would be younger than nonparticipants with access to the registry’s web-based platform. Furthermore, although there is usually very good intraindividual consistency of stable symptoms, treatments, or side effects among semiannual surveys [ , ], the health diary may be better able to capture dynamic symptoms and treatment effects in a more comprehensive and fine-grained fashion.Methods
Study Context
The electronic health diary data were collected by the SMSR as part of a nested campaign entitled “A week in the life of persons with MS,” which ran from March 9, 2019, to March 17, 2019. The SMSR is a nationwide, patient-centered registry for persons with MS (trial registration: ClinicalTrials.gov NCT02980640) [
, ]. The registry was launched in June 2016 as a collaboration between the Swiss Multiple Sclerosis Society and the University of Zurich with the aim to create a patient-centered registry for adult persons with MS living in Switzerland.Since its launch in 2016, the SMSR has been collecting and updating standard information on MS symptoms, treatment histories, and health-related quality of life in semiannual surveys [
]. As of July 13, 2019, a total of 2350 participants had contributed data to the SMSR. Participants can either enroll for digital participation (approximately 80% of all participants), or they can choose to complete the surveys on paper (approximately 20%). The baseline assessment has 2 stages. First, participants complete a short survey (initial questionnaire) that collects basic sociodemographic characteristics and core data on MS diagnosis, as well as symptom and treatment histories. A second, more extensive survey (baseline questionnaire) collects current symptoms and treatments, as well as detailed information on education, work, health care use, comorbidities, and MS status [ , ].The electronic health diary is a separate feature on the digital SMSR study platform, available in German, French, and Italian, and specifically developed to work on PCs and mobile devices. The diary was semistructured (Figures S1-S6 in
). It contained a free-text field where participants could describe their current health status and any other information that they deemed relevant. There were no restrictions on the number of characters. In addition, the diary included structured questions that mirrored corresponding survey items from the longitudinal surveys, namely the EQ-5D-5L and the EuroQol visual analog scale (EQ-VAS; 0-100 scale), as well as current MS symptoms (checkboxes) and current use of immunomodulatory and complementary therapies (checkboxes; Figures S5 and S6 in ). Visually, the diary was organized as a calendar sheet that allowed retrospective entries.Description of the Nested Electronic Health Diary Campaign
To promote the release of the electronic health diary, the SMSR launched a campaign entitled “A week in the life of persons with MS,” which ran from March 9, 2019, to March 17, 2019. All web-based participants were invited to make daily diary entries in the free-text field and complete the structured questions on current symptoms and medication intake (
). Participants were encouraged to share positive and negative experiences as well as self-management strategies.The campaign included different communication activities (
, red numbers). First, a general announcement was issued by email on January 28, 2019. One month later (February 28, 2019), a personal invitation was sent by email to all web-based participants, followed by a reminder on March 8, 2019 (ie, the day before the launch of the campaign). A final motivational reminder was sent through email on March 14, 2019. An announcement and daily campaign updates were posted on the SMSR website as well as on the public website and the Facebook page of the Swiss Multiple Sclerosis Society. The daily campaign updates included visual summaries of different health diary items (average EQ-VAS score, percentage of participants with a specific mood, the 3 most frequent symptoms, percentage of users of complementary therapies, and the 3 most frequent complementary therapies).Study Population
Of the 1550 SMSR enrollees who had completed the baseline assessments, 1318 (85.03%) participated through the SMSR web platform (
). Paper-and-pencil participants were excluded a priori because the health diary was only available on the web. After the application of inclusion criteria and data quality checks, we included 96.66% (1274/1318) of the web-based enrollees with baseline assessments completed until 1 week after the campaign ended (March 26, 2019). This time frame was chosen because a small number of participants (n=21) joined the SMSR during the diary campaign but completed the baseline assessment only a few days after the campaign ended. Of these 1274 enrollees, 658 (51.65%) had completed the next semiannual survey in the spring of 2020—hereafter follow-up survey—that included all standardized assessments from the diary (health-related quality of life, symptoms, and medication use). Among these 658 enrollees, 134 (20.4%) had made a nonempty free-text entry in the electronic health diary collected between February 27, 2019 (1 day before the invitation to the campaign was emailed), and March 19, 2019 (2 days after the official end of the campaign), including retrospective entries ( ). This analysis time frame was chosen because the first campaign announcement on February 28, 2019, had already triggered numerous entries ( ). Entries for retrospective dates were included if they were created during the analysis time frame.Measures
We analyzed 3 different types of data items that were collected both in the diary and the follow-up survey. The first data item consisted of textual diary entries describing notable daily events or current physical and mental well-being. Only German diary entries containing at least one word were considered for the analysis. The second analysis included the EQ-5D-5L index (derived from French reference value sets [
- ]) and the EQ-VAS. The third type of data pertained to current symptoms and the use of immunomodulatory medications [ , ].In the diary and in the follow-up survey, participants were asked to indicate their current MS symptoms and the MS symptoms they had experienced within the last 12 months, respectively, from the following list: visual impairments, speech disorders, swallowing difficulties (dysphagia), weakness, signs of paralysis, fatigue, paresthesia (eg, deafness and tingling), dizziness, pain, gait disorder, vestibular disorders, bladder disorders (eg, bladder weakness), spasms (muscle cramps), convulsions and tics, tremor, intestinal disorders (eg, constipation), epileptic convulsions, sexual disorders, memory disorders, depression, concentration problems, problems with spatial orientation, affective lability or lack of control over emotions, or other unspecified symptoms.
Any current use of an immunomodulatory MS drug (diary and follow-up survey) and use of an immunomodulatory MS drug within the last 6 months (follow-up survey) were collected based on the following medication list: teriflunomide (Aubagio), interferon beta-1a (Avonex), interferon beta-1b (Betaferon), glatiramer acetate (Copaxone), cyclophosphamide (Endoxan), interferon beta-1b (Extavia), fingolimod (Gilenya), azathioprine (Imurek), alemtuzumab (Lemtrada), rituximab (MabThera), laquinimod (Nerventra), mitoxantrone (Novantron), ocrelizumab (Ocrevus), peginterferon beta-1a (Plegridy), interferon beta-1a (Rebif), cyclosporine (Sandimmun), tetracosactide (Synacthen), dimethyl fumarate (Tecfidera), natalizumab (Tysabri), and other unspecified medications.
Statistical Analyses
Baseline characteristics of diary campaign participants (that is, persons with at least one valid health diary entry during the analysis time frame) and nonparticipants were compared descriptively (aim 1). Continuous data were analyzed by medians and IQRs and categorical information by frequency counts and percentages. Using visual plots, we analyzed the frequency and patterns of diary use over time, intending to learn more about the impact of reminders on participants’ behavior.
For aim 2, the content of diary text entries was analyzed using the Linguistic Inquiry and Word Count (LIWC) 2015 software (Pennebaker Conglomerates, Inc) [
, ] using a German dictionary [ ]. On the basis of this dictionary, the LIWC program scores the texts according to 118 word attributes and categories by dividing the number of words belonging to a specific attribute or category by the number of words within a text entry to standardize for diary entry length [ ]. The following seven categories related to health and personal experience were selected for further inspection: (1) health, (2) body, (3) family, (4) friends, (5) work, (6) positive emotions (eg, happy, good, and love), and (7) negative emotions (eg, sadness, anger, and fear). Using these 7 word categories, we calculated the percentage of entries containing at least one category-specific keyword across all diary entries. In addition, we analyzed an LIWC-integrated summary score for emotional tone by plotting its distribution across all diary entries in a histogram. The LIWC-generated emotional tone score represents the overall emotional tone of a text, ranging from 0 (negative) to 100 (positive). The score is computed based on the difference between dictionary-based positive and negative emotion scores, but details of this proprietary algorithm are not publicly available [ , ].Furthermore, German diary text entries containing at least 10 words were analyzed descriptively by visualizing them as a word cloud of the 100 most frequent words in Python (version 3.7; Python Software Foundation) in the Spyder integrated development environment (version 4.1.5). The text entries were prepared for the visualization in several preprocessing steps. Stop words (ie, words without a specific meaning such as and or the) were removed using an open-source German stop word list [
]; numerals and punctuation marks were removed as well. The remaining words were filtered to retain only nouns, adjectives, and verbs. Words with the same meaning were replaced manually by 1 unique word (eg, the word work replaced the following words: occupation, job, company, office, workplace, work hours, work colleagues, etc). The words were then lemmatized using the Python library spaCy (version 2.2.2) [ ]. Lemmatization refers to the removal of inflectional endings to obtain the dictionary form of a word [ ]. Vowels followed by an e (such as oe) were replaced by a vowel with an umlaut (in this specific case, ö) as commonly used in German. Capital letters were then replaced by lowercase letters. Finally, all lemmatized entries were translated into English using DeepL Pro (DeepL SE).Moreover, we evaluated the individual-level similarity of health-related quality of life indices (EQ-5D-5L and EQ-VAS), symptoms, and medication use between the structured diary data and follow-up survey data (aim 3). Similarity was expressed by the Jaccard index, which reflects the proportion of persons with the concurrent mention of a specific attribute value (eg, a symptom) in the diary and the follow-up survey (overlap), divided by the number of persons with at least one mention of the same attribute value in either the diary or the follow-up survey (union) [
, ]. The Jaccard index was chosen over standard percentages because it is less affected by the rarity of an attribute value. In case a participant had several complete health diary entries, the health-related quality of life indices of the closest follow-up survey were used for the similarity analyses. The diary-based categorical symptom and medication use variables were compared with similar follow-up survey information on symptoms and medication use. The continuous EQ-5D-5L and EQ-VAS scores were dichotomized using median splits to calculate the Jaccard indices. The respective medians were computed from the follow-up survey of all included SMSR participants (n=658).All descriptive analyses were conducted in R (version 4.0.3), using the RStudio integrated development environment (version 1.4.1103). Text preprocessing and word cloud visualization were performed using Python (version 3.7) in the Spyder integrated development environment (version 4.1.5). The dictionary-based text categorizations were performed using the LIWC software [
, ]. All text analyses were conducted using the original German text entries, and the results were subsequently translated into English for presentation using DeepL Pro.Ethics Approval
The SMSR has been approved by the responsible ethics committee (Zurich Cantonal Ethics Committee; study number PB-2016-00894), and informed consent was obtained from all participants.
Results
Study Populations and Diary Use
After we had applied our inclusion and exclusion criteria, our study population comprised 658 persons with MS, of whom 134 (20.4%) had used the electronic health diary between February 27, 2019, and March 19, 2019 (
). During this period, 815 nonempty, unique diary entries written in German (n=632, 77.5%), French (n=135, 16.6%), and Italian (n=48, 5.9%) were collected ( ).The median time span between the last diary entry written by each diary campaign participant and the follow-up survey was 14 (IQR 13-15) months.
Participant Characteristics
Characteristics of the SMSR web-based study enrollees who participated in the campaign by completing at least one electronic health diary entry (n=134; henceforth referred to as participants) and those who did not (n=524; henceforth referred to as nonparticipants) are compared in
. The median age of the participants (52.5, IQR 43.25-59.75 years) was higher than that of the nonparticipants (47, IQR 38-55 years). Of the 134 participants, 101 (75.4%) were women, whereas of the 524 nonparticipants, 356 (67.9%) were women. The median time since the diagnosis of MS was 9 (IQR 4-19 for participants and IQR 4-16 for nonparticipants) years for both groups. Persons with primary progressive MS (PPMS) and secondary progressive MS (SPMS) tended to be more represented among participants (PPMS: 18/134, 13.4%; SPMS: 32/134, 23.9%) than among nonparticipants (PPMS: 50/524, 9.5%; SPMS: 79/524, 15.1%). In addition, the participants’ group contained proportionally fewer persons in the lowest Self-Reported Disability Status Scale stratum (84/134, 62.7%) than the nonparticipants’ group (381/524, 72.7%).The nonparticipants’ group comprised a somewhat larger percentage of persons with higher professional education (including with an applied university or university degree; 250/524, 47.7%, vs 57/134, 42.5%, for participants). However, there were fewer people working >40% of weekly working hours among the participants (45/134, 33.6%, vs 252/524, 48.1%, for nonparticipants). Nonparticipants seemed to talk more openly about their MS with their relatives (485/524, 92.5%, vs 116/134, 86.6%, for participants).
Regarding symptoms experienced within the last 12 months, participants reported a higher percentage for the 10 most frequent symptoms. The largest differences in percentages were observed for the following symptoms: gait disorder (52/134, 38.8%, vs 138/524, 26.3%, for nonparticipants), spasms (45/134, 33.6%, vs 119/524, 22.7%, for nonparticipants), and bladder disorders (40/134, 29.9%, vs 109/524, 20.8%, for nonparticipants). Furthermore, a higher proportion of diary campaign participants reported no use of a disease-modifying drug within the last 6 months (53/134, 39.6%, vs 156/524, 29.8%, for nonparticipants). The full list of symptoms and disease-modifying medications is available in
.Characteristics | Participants in health diary campaign (n=134) | Nonparticipants (n=524) | P value | |
Age (years), median (IQR) | 52.5 (43.25-59.75) | 47 (38-55) | <.001b | |
Sex, n (%) | .12c | |||
Female | 101 (75.4) | 356 (67.9) | ||
Male | 33 (24.6) | 168 (32.1) | ||
Language, n (%) | <.001c | |||
German | 100 (74.6) | 433 (82.6) | ||
French | 25 (18.7) | 73 (13.9) | ||
Italian | 9 (6.7) | 18 (3.5) | ||
MSd duration (years), median (IQR) | 9 (4-19) | 9 (4-16) | .17b | |
MS type, n (%) | <.001c | |||
CISe | 2 (1.5) | 10 (1.9) | ||
PPMSf | 18 (13.4) | 50 (9.5) | ||
RRMSg | 79 (59) | 352 (67.2) | ||
Transition | 3 (2.2) | 16 (3.1) | ||
SPMSh | 32 (23.9) | 79 (15.1) | ||
Missing information | N/Ai | 17 (3.2) | ||
Marital status, n (%) | <.001c | |||
Unmarried | 43 (32.1) | 174 (33.2) | ||
Registered partnership or married | 71 (53) | 273 (52.1) | ||
Separated or divorced | 17 (12.7) | 59 (11.3) | ||
Widowed | 1 (0.7) | 8 (1.5) | ||
Missing information | 2 (1.5) | 10 (1.9) | ||
Education, n (%) | .59c | |||
Partial or completed mandatory schooling | 3 (2.2) | 8 (1.5) | ||
Apprenticeship or qualification to study at university level (Matura diploma) | 68 (50.8) | 250 (47.7) | ||
Higher professional education, applied university, or university | 57 (42.5) | 250 (47.7) | ||
Other | 1 (0.8) | 7 (1.4) | ||
Missing information | 5 (3.7) | 9 (1.7) | ||
Work situation or work percentage, n (%) | .02c | |||
Not working | 63 (47) | 184 (35.1) | ||
1% to 40% | 22 (16.4) | 69 (13.2) | ||
41% to 80% | 27 (20.2) | 138 (26.3) | ||
81% to full time | 18 (13.4) | 114 (21.8) | ||
Missing information | 4 (3) | 19 (3.6) | ||
Talk about MS with...j | .87c | |||
...relatives | 116 (86.6) | 485 (92.6) | ||
...friends | 109 (81.3) | 412 (78.6) | ||
...boss | 48 (35.8) | 179 (34.2) | ||
...work colleagues | 46 (34.3) | 189 (36.1) | ||
...leisure-time partners | 36 (26.9) | 131 (25) | ||
...other | 7 (5.2) | 23 (4.4) | ||
...nobody | 6 (4.5) | 13 (2.5) | ||
SRDSSk score, n (%) | .02c | |||
0 to 3.5 | 84 (62.7) | 381 (72.7) | ||
4 to 6.5 | 37 (27.6) | 90 (17.2) | ||
≥7 | 13 (9.7) | 39 (7.4) | ||
Missing information | N/A | 14 (2.7) | ||
Ten most frequent symptoms within the last 12 monthsj,l, n (%) | .42c | |||
None | 50 (37.3) | 227 (43.3) | ||
Fatigue | 57 (42.5) | 210 (40.1) | ||
Gait disorder | 52 (38.8) | 138 (26.3) | ||
Paresthesia (eg, numbness and tingling) | 50 (37.3) | 187 (35.7) | ||
Spasms (muscle cramps) | 45 (33.6) | 119 (22.7) | ||
Vestibular disorders | 43 (32.1) | 135 (25.8) | ||
Weakness | 40 (29.9) | 129 (24.6) | ||
Pain | 40 (29.9) | 143 (27.3) | ||
Bladder disorders (eg, bladder weakness) | 40 (29.9) | 109 (20.8) | ||
Concentration problems | 35 (26.1) | 127 (24.2) | ||
Intestinal disorders (eg, constipation) | 29 (21.6) | 83 (15.8) | ||
Other | 64 (47.8) | 193 (36.8) | ||
Ten most frequent disease-modifying medications within the last 6 monthsj,l, n (%) | .20c | |||
None | 53 (39.6) | 156 (29.8) | ||
Ocrelizumab (Ocrevus) | 28 (20.9) | 87 (16.6) | ||
Fingolimod (Gilenya) | 15 (11.2) | 90 (17.2) | ||
Dimethyl fumarate (Tecfidera) | 10 (7.5) | 54 (10.3) | ||
Interferon beta-1a (Rebif) | 6 (4.5) | 19 (3.6) | ||
Glatiramer acetate (Copaxone) | 6 (4.5) | 18 (3.4) | ||
Interferon beta-1b (Betaferon) | 5 (3.7) | 14 (2.7) | ||
Teriflunomide (Aubagio) | 5 (3.7) | 15 (2.9) | ||
Natalizumab (Tysabri) | 3 (2.2) | 40 (7.6) | ||
Rituximab (MabThera) | 3 (2.2) | 15 (2.9) | ||
Interferon beta-1a (Avonex) | 2 (1.5) | 10 (1.9) | ||
Other | 1 (0.7) | 10 (1.9) |
aComparison between participants in the Swiss Multiple Sclerosis Registry electronic health diary campaign (defined by having at least one valid diary entry; column 2) and nonparticipants (column 3).
bTwo-tailed t test conducted.
cChi-square test conducted.
dMS: multiple sclerosis.
eCIS: clinically isolated syndrome.
fPPMS: primary progressive multiple sclerosis.
gRRMS: relapsing-remitting multiple sclerosis.
hSPMS: secondary progressive multiple sclerosis.
iN/A: not applicable.
jMultiple answers possible.
kSRDSS: Self-Reported Disability Status Scale.
lFull list of symptoms and disease-modifying medications available in
.Health Diary Use Patterns
The use of the electronic health diary was monitored over 21 days between February 27, 2019, and March 19, 2019 (
). Over these 21 days, a total of 815 unique electronic health diary entries were collected from 134 diary campaign participants. Of note, more health diary entries were collected on days when email invitations or reminders were sent than on the adjacent days; for example, the final reminder sent on March 14, 2019 (bar marked by a red numeral 3 in ), displayed the largest number of entries (n=130) of the whole observation period. In addition, the electronic health diary was used more intensively during the official health diary campaign period (striped bars in ).As shown in
, 23.1% (31/134) of the participants wrote only 1 entry in the diary, and 11.2% (15/134) wrote 2. Moreover, 15.7% (21/134) of the participants had ≥10 entries (reflecting ≥1 entry every 2 days). The highest number of entries written by 1 person was 32 (including retrospective entries made during the analysis time frame). summarizes the completeness of health diary entries.Number of entries in the health diary per participant | Participants, n (%) |
1 | 31 (23.1) |
2 | 15 (11.2) |
3 | 6 (4.5) |
4 | 5 (3.7) |
5 | 6 (4.5) |
6 | 6 (4.5) |
7 | 9 (6.7) |
8 | 16 (11.9) |
9 | 19 (14.2) |
10 | 6 (4.5) |
11 | 5 (3.7) |
12 | 2 (1.5) |
13 | 1 (0.7) |
15 | 2 (1.5) |
17 | 1 (0.7) |
18 | 1 (0.7) |
19 | 1 (0.7) |
20 | 1 (0.7) |
32 | 1 (0.7) |
Content Analysis of the Textual Diary Data
The 134 electronic health diary campaign participants provided a total of 815 electronic health diary entries (in German: n=632, 77.5%; in French: n=135, 16.6%; and in Italian: n=48, 5.9%). For the subsequent analysis, we only used the German health diary entries, provided by 100 participants. The emotional scores of the 632 diary entries were low overall, reflecting negative emotions such as very anxious, sad, or hostile tone [
]. Of the 632 diary entries, 163 (25.8%) scored between 0 and 10, and 420 (66.5%) scored between 20 and 30. Furthermore, positive emotions were expressed in only 7.6% (48/632) of the entries, whereas words related to negative emotions were used in 30.5% (193/632) of the entries ( ). Other frequent LIWC-based topic categories pertained to the body (191/632, 30.2%), health (94/632, 14.9%), and work (67/632, 10.6%).Of the 632 German electronic health diary entries, 526 (83.2%; written by 93 participants) contained at least 10 words and were used to create a 100-word word cloud (
; refer to for the frequency of the 25 most common words). As shown in and , the words “good” and “day” occur most often, followed by “work,” “up,” “go,” “sleep,” and “tired.” Among the 25 most frequent words, some refer to time, including “day,” “evening,” “morning,” “hour,” “time,” and “afternoon.” Other words pertained to activities or movement, such as “work,” “go,” “walk,” “make,” and “errand.” Several frequent words also related to body parts, physical well-being, and health issues; for example, “tired,” “leg,” “pain,” “therapy,” and “feel.” Although comparatively fewer words were associated with social contacts, some were very common in diary entries, such as “contact” or “family.” A word cloud and the frequency of the most common words for each MS type (ie, PPMS, relapsing-remitting multiple sclerosis, transition, and SPMS) are available in .Characteristics | Values, n (%) |
Negative emotion | 193 (30.5) |
Body | 191 (30.2) |
Health | 94 (14.9) |
Work | 67 (10.6) |
Positive emotion | 48 (7.6) |
Friends | 10 (1.6) |
Family | 8 (1.3) |
Similarities Between Structured Electronic Health Diary Data and Questionnaire-Based Data
The responses to the electronic health diary and the follow-up survey exhibited several notable differences and similarities quantified by the Jaccard index (
). The EQ-5D-5L (Jaccard indices: 0.73 and 0.63 below and above the median, respectively) and the EQ-VAS (Jaccard indices: 0.59 and 0.49, respectively) presented the highest Jaccard indices. Furthermore, the electronic health diary and the follow-up survey methods converged for the evaluation of gait disorder, signs of paralysis, and fatigue (Jaccard indices: 0.5, 0.5, and 0.49, respectively). By contrast, several symptoms, including pain, vestibular disorder, weakness, spasms, bladder disorders, and concentration problems displayed comparatively lower Jaccard indices (<0.4), despite being reported quite frequently (n>45; refer to the column Union in and the Ten most frequent symptoms within the last 12 months section in ) and at least once in the diary and the survey. The injectable immunomodulatory drugs interferon beta-1a (Avonex) and glatiramer acetate (Copaxone), as well as the oral drugs fingolimod (Gilenya) and teriflunomide (Aubagio), exhibited the highest similarities across both assessment methods (Jaccard indices between 0.5 and 1; refer to for the complete list of disease-modifying medications). Of note, despite currently being used frequently, ocrelizumab (Ocrevus) was not mentioned in the diary.Characteristics | Overlap | Union | Jaccard index | |
EQ-5D-5L | ||||
EQ-5D-5L: ≤0.71 (overall median) | 52 | 71 | 0.73 | |
EQ-5D-5L: >0.71 | 33 | 52 | 0.63 | |
EQ-VASb | ||||
EQ-VAS: ≤80 (overall median) | 34 | 58 | 0.59 | |
EQ-VAS: >80 | 23 | 47 | 0.49 | |
Symptoms | ||||
Gait disorder | 33 | 66 | 0.50 | |
Signs of paralysis | 12 | 24 | 0.50 | |
Fatigue | 39 | 80 | 0.49 | |
Paresthesia (eg, numbness and tingling) | 34 | 73 | 0.47 | |
Tremor | 8 | 18 | 0.44 | |
Intestinal disorders (eg, constipation) | 14 | 34 | 0.41 | |
Weakness | 22 | 58 | 0.38 | |
Vestibular disorders | 23 | 62 | 0.37 | |
Pain | 22 | 63 | 0.35 | |
Affective lability and lack of control over emotions | 5 | 15 | 0.33 | |
Spasms (muscle cramps) | 18 | 56 | 0.32 | |
Memory disorders | 9 | 28 | 0.32 | |
Bladder disorders (eg, bladder weakness) | 16 | 51 | 0.31 | |
Convulsions and tics | 5 | 17 | 0.29 | |
Sexual disorders | 5 | 19 | 0.26 | |
Visual impairments | 7 | 30 | 0.23 | |
Problems with spatial orientation | 7 | 30 | 0.23 | |
Dizziness | 7 | 32 | 0.22 | |
Speech disorders | 4 | 20 | 0.20 | |
Swallowing difficulties (dysphagia) | 3 | 15 | 0.20 | |
Depression | 3 | 16 | 0.19 | |
Concentration problems | 7 | 46 | 0.15 | |
Other | 0 | 10 | 0 | |
Epileptic convulsions | 0 | 1 | 0 | |
Ten most frequent disease-modifying medications c | ||||
Interferon beta-1a (Avonex) | 2 | 2 | 1 | |
Glatiramer acetate (Copaxone) | 5 | 7 | 0.71 | |
Fingolimod (Gilenya) | 12 | 21 | 0.57 | |
Teriflunomide (Aubagio) | 4 | 8 | 0.50 | |
Interferon beta-1b (Betaferon) | 2 | 5 | 0.40 | |
Dimethyl fumarate (Tecfidera) | 1 | 32 | 0.03 | |
Ocrelizumab (Ocrevus) | 0 | 36 | 0 | |
Other | 0 | 33 | 0 | |
Interferon beta-1a (Rebif) | 0 | 6 | 0 | |
Natalizumab (Tysabri) | 0 | 6 | 0 | |
Rituximab (MabThera) | 0 | 3 | 0 |
aThe Jaccard index was used to measure the similarities (reporting overlap) among the different sources (0=no similarity and 1=maximum similarity). The column Overlap represents the number of participants with overlapping reports in the diary and in the follow-up survey. The column Union represents the total number of participants who reported a specific data item at least once in the diary or the follow-up survey collecting the symptoms experienced within the last 12 months and the medication used within the last 6 months. The column Jaccard index represents the quotient of the Overlap values and the Union values. The EQ-5D-5L index and the EuroQol visual analog scale index were dichotomized using the respective medians of all included Swiss Multiple Sclerosis Registry enrollees with completed follow-up survey (n=658).
bEQ-VAS: EuroQol visual analog scale.
cThe full list of disease-modifying medications is available in
.Discussion
Principal Findings
On the basis of a health diary campaign nested into the SMSR, our study sought to explore the factors associated with electronic health diary use as well as the added value of diary entries vis-à-vis survey-collected information. By comparing the characteristics of 134 health diary campaign participants with those of 524 nonparticipants, our study revealed that women, persons with a more advanced disease state, those with a lower work percentage, or those without higher education (eg, a university degree) were more likely to devote time to the electronic health diary.
Contrary to our initial expectations, electronic health diary participants were on average 5 years older than the nonparticipants, more likely to be women, less likely to have completed higher education, and more frequently had an advanced Self-Reported Disability Status Scale score (≥4). In addition, a larger proportion of participants reported experiencing diverse MS symptoms within the last 12 months, in particular from more strongly hindering symptoms such as fatigue, gait disorder, spasms, and vestibular disorders. Not only are these symptoms disabling, but they may also lead to a more confined life at home. These findings may seem counterintuitive at first glance because studies comparing characteristics between web-based and paper-and-pencil study participants (including a study from the SMSR) usually found younger age, higher education, and less disease severity to be associated with a higher probability of web-based participation [
, ]. However, this study focused entirely on web-based participants. Thus, the stratification by health diary use reflects a further segmentation of this population. In our analysis, persons with a higher symptom burden and not working full time, which are two factors associated with older age, were more likely to contribute to the electronic health diary campaign. This finding overlaps with an independent SMSR analysis showing that, based on a set of standardized questions, persons with a high affinity for using digital tools for MS management also tended to be older (but still middle-aged) and to have a higher disease burden (Nittas, unpublished data, March 2022). It can be speculated that an elevated disease burden seems to come with more time at disposal and a stronger desire to tell one’s story as well as to understand one’s disease.When analyzing the content of health diary entries, participants’ reports mainly addressed themes related to the body, health, and work, as confirmed by the LIWC and word cloud analytic approaches. Moreover, the frequent mention of words such as “sleep” or “tired” corresponds well with frequent reports of fatigue in the diary as well as in the SMSR follow-up survey (
).A substantial number of participant reports had a negative emotional coloration and were referring to, for example, the adverse effects of MS on their body and daily life activities. Indeed, keywords from the LIWC categories negative emotion and body appeared in the same proportion of diary entries and were thus possibly co-occurring. Diary participants seemed to rather express concerns—possibly about their disease affecting their body and their active life. Whereas a larger proportion of the nonparticipants talk about MS to their relatives, diary participants seemed to confide their worries in the diary [
].Of further note, the comparison of structured information from the electronic health diary and the follow-up survey generally exhibited good overlaps for health-related quality of life aspects, relatively stable and frequent symptoms, and—to a lesser extent—for medications with a frequent intake schedule (eg, injectable or oral drugs). The health-related quality of life index EQ-5D-5L revealed the highest overlap, which is consistent with the general notion that this indicator is not very responsive to smaller health status changes. The more subjective EQ-VAS showed somewhat smaller overlaps, possibly because the EQ-VAS is more responsive to daily fluctuations [
]. The Jaccard index was also relatively high for stable or slow-changing symptoms such as gait disorder, signs of paralysis, and fatigue. By contrast, the similarity analysis of medication use mostly yielded low Jaccard indices, suggesting little overlap. Nonetheless, older, established injection therapies for relapsing-remitting MS, such as interferon beta-1a (Avonex) [ ] and glatiramer acetate (Copaxone) [ ], although not used by a large proportion of our study participants, displayed the highest Jaccard indices, demonstrating little change in medication. Furthermore, more modern and convenient treatments such as fingolimod (Gilenya) and teriflunomide (Aubagio), which are two oral therapies with daily intake for relapsing-remitting MS, also exhibited relatively high Jaccard indices. Nonetheless, other modern MS drugs administered in monthly (natalizumab [Tysabri]) infusions at clinics demonstrated low Jaccard indices because of the diary instructions that asked participants for MS medication in the previous day only. Furthermore, the frequently used infusion drug ocrelizumab (Ocrevus) was only widely prescribed in Switzerland after the health diary campaign ended [ ].To the best of our knowledge, this is the first study to assess the similarities between data collected through a web-based survey and data collected by means of an electronic diary. The different person and disease characteristics associated with electronic health diary use can help refine the target population for implementing electronic health diary tools in research contexts. Furthermore, the findings suggest that health diaries can form a meaningful complement to regular surveys by providing additional insights into daily life topics and timely updates on health-related quality of life or symptom and medication status of persons with MS. Although ecological momentary assessment research has highlighted the possible risk of retrospection bias in retrospectively reporting symptoms averaged over longer times [
], subjective perceptions of illnesses vary strongly and meaningfully across people [ ]. Indeed, evaluating subjective views with regard to, for example, symptoms of people with MS not only adds value to standardized assessments pertaining to personalized treatment planning but also helps to explain adherence to treatment regimens [ ]. Moreover, free-text questions as implemented in our diary can complement regular standardized assessments by providing additional levels of detail. Furthermore, being given the opportunity to report on their experiences in their own words is often appreciated by study participants and, as suggested by the extensive expressive writing literature, may even be of therapeutical value in itself [ ]. Our electronic health diary combines the known advantages of ecological momentary assessment with the advantage of not restricting answers to forced, given choices.The study was also informative on a methodological level. Although the health diary has been part of the SMSR platform since its launch, voluntary use was very low, on average <1 entry per day per participant. By contrast, we noticed that the use of the electronic health diary was enhanced after motivational emails were sent to the participants. These experiences suggest that health diary studies may benefit from being embedded into a campaign with clear aims and a limited time frame, as revealed by previous studies [
, ].Strengths and Limitations
Our study benefited from a large, diverse, well-documented study base for enrollment [
, ]. Moreover, this is the first health diary study in MS to use a blend of different analytical approaches (descriptive statistics and natural language processing) to glean insights into health diary use patterns and daily life aspects; for example, closer inspection of diary entries revealed novel aspects such as the stress imposed by application procedures for disability insurance or individual coping strategies for well-being by persons with MS (not shown). Therefore, diary studies harbor a significant untapped potential for hypothesis generation and inspiration for research topics.However, some limitations should be noted. First, our study excluded persons who preferred paper-and-pencil surveys. This excluded group reflects a population with more advanced disease states and possibly lower digital literacy (Nittas, unpublished data, March 2022). However, similar to our study, earlier investigations also observed that at an early stage of the disease, persons with MS are less likely to engage in research studies (Nittas, unpublished data, March 2022), [
], hypothetically because they are in denial regarding their disease or do not entirely realize the scope of it yet. In addition, the distance in time between the health diary campaign and the follow-up survey completion was relatively long. Hence, the MS symptomatology, as well as treatment strategies, may have changed in the meantime (eg, ocrelizumab [Ocrevus] has started to be widely prescribed in Switzerland after the end of the health diary campaign). It is important to mention that the results could be replicated using different comparison data provided by the SMSR. Future research would benefit from further investigating the added value of such free-text health diaries by comparing entries with standardized instruments of physical and mental well-being assessed in parallel. Furthermore, among the 658 eligible web-based SMSR participants, only a fraction (n=134, 20.4%) took part in the diary study, thus limiting the generalizability of the results. Besides, the vast majority (113/134, 84.3%) of the participants made <1 entry every 2 days in the diary, and 34% (46/134) contributed only once or twice to the diary campaign. This lack of regularity in diary use was also a limitation to our study. The implementation of a diary with automated reminders [ ] might be a promising way forward to increase participation [ , ]. Nevertheless, these limitations observed in our study may also hinder a broader application of electronic diaries in ecological momentary assessments.Therefore, a better understanding of participant needs, motivational factors, and the effectiveness of incentives is urgently needed to enable a broader application and long-term use of health diaries in health research and disease management. In addition, in light of recent advances in fields such as natural language processing [
] and speech recognition [ ] (eg, Hugging Face [ ]) based on machine learning or wearable sensor technologies (eg, fitness trackers) [ , , ], future studies should examine how health diaries could be optimally combined with novel technologies.Conclusions
To summarize, our study suggests that health diaries can be a valuable complement to regular, structured questionnaires in the context of MS research. However, they should ideally be embedded into a campaign with motivational activities such as email reminders or regular data feedback. Our findings further suggest that a topical focus on daily life aspects, health-related quality of life, and stable symptoms elicited more similar responses to standardized assessments and were thus less informative than medication diaries. Hence, medication diaries for daily dispensed (oral or injectable) drugs may offer opportunities for drug intake compliance tracking and unwanted drug effect occurrence monitoring.
Acknowledgments
The authors are most grateful to all participants of the Swiss Multiple Sclerosis Registry (SMSR) who dedicated their time and thereby made a crucial contribution to this research. The authors would further like to thank the participant board of the SMSR for their contribution to the development and validation of a multiple sclerosis–related dictionary. Furthermore, the authors’ gratitude goes to the Swiss Multiple Sclerosis Society for funding the SMSR and for its continuous support. The members of the SMSR are Bernd Anderseck, PC, Andrew Chan, Claudio Gobbi, Roger Häussler, CPK, Jürg Kesselring (President), Jens Kuhle (Chair of the Clinical and Laboratory Research Committee), Roland Kurmann, Christoph Lotter, Kurt Luyckx, Patricia Monin, Stefanie Müller, Krassen Nedeltchev, CP, Milo A Puhan, Irene Rapold, Anke Salmen, Klaas Enno Stephan, Zina-Mary Manjaly, Claude Vaney (Chair of Patient and Population Research Committee), VvW (Chair of the IT and Data Committee), and CZ. The SMSR is supported by the scientific advisory board of the Swiss Multiple Sclerosis Society.
Conflicts of Interest
Ente Ospedaliero Cantonale (CZ’s employer) received compensation for CZ’s speaking activities, consulting fees, or research grants from Almirall, Biogen Idec, Bristol Meyer Squibb, Genzyme, Lundbeck, Merck, Novartis, Teva Pharma, and Roche.
Electronic health diary of the Swiss Multiple Sclerosis Registry.
DOCX File , 764 KB
Invitation letters to the electronic health diary campaign for the Swiss Multiple Sclerosis Registry participants.
DOCX File , 38 KB
Number of entries made per day in the electronic health diary between February 27, 2019, and March 19, 2019 (N=815). The striped bars (March 9, 2019, to March 17, 2019) correspond to the official health diary campaign period. The red numbers indicate when the Swiss Multiple Sclerosis Society sent emails to its participants: (1) invitation email for the campaign sent out to all Swiss Multiple Sclerosis Registry participants and information released as a news item on the public web page of the Swiss Multiple Sclerosis Society, (2) reminder email sent out to all participants informing them that the campaign was about to start, and (3) motivational email that provided some statistical information about the health diary campaign and reminded participants to contribute.
PNG File , 93 KB
Flowchart of the Swiss Multiple Sclerosis Registry enrollees and the electronic health diary participants.
DOCX File , 432 KB
Full list of the symptoms experienced within the last 12 months and the disease-modifying medications used within the last 6 months.
DOCX File , 41 KB
Completeness of the diary entries.
DOCX File , 38 KB
Word cloud of the 100 most frequent words appearing in the electronic health diary entries of a minimum length of 10 words (n=526). The font size reflects the frequency of the words’ occurrence.
PNG File , 322 KB
Word frequency of the 25 most frequent words of the word cloud.
DOCX File , 78 KB
Word cloud of 100 words and word frequency of the 25 most frequent words throughout the electronic health diary entries per multiple sclerosis type.
DOCX File , 994 KB
Jaccard indices of the full disease-modifying medication list.
DOCX File , 16 KBReferences
- Verbrugge LM. Health diaries. Med Care 1980 Jan;18(1):73-95. [CrossRef] [Medline]
- Al-Ubaydli M, Paton C. The doctor's PDA and smartphone handbook. Personal digital assistant. J R Soc Med 2005 Nov;98(11):494-495 [FREE Full text] [Medline]
- Pennebaker JW. Putting stress into words: health, linguistic, and therapeutic implications. Behav Res Ther 1993 Jul;31(6):539-548. [CrossRef] [Medline]
- Pennebaker JW, Barger SD, Tiebout J. Disclosure of traumas and health among Holocaust survivors. Psychosom Med 1989;51(5):577-589. [CrossRef] [Medline]
- Smyth JM. Written emotional expression: effect sizes, outcome types, and moderating variables. J Consult Clin Psychol 1998 Feb;66(1):174-184. [CrossRef] [Medline]
- Frattaroli J. Experimental disclosure and its moderators: a meta-analysis. Psychol Bull 2006 Nov;132(6):823-865. [CrossRef] [Medline]
- Sebastião E, McAuley E, Shigematsu R, Adamson BC, Bollaert RE, Motl RW. Home-based, square-stepping exercise program among older adults with multiple sclerosis: results of a feasibility randomized controlled study. Contemp Clin Trials 2018 Oct;73:136-144. [CrossRef] [Medline]
- Freeman J, Hendrie W, Jarrett L, Hawton A, Barton A, Dennett R, et al. Assessment of a home-based standing frame programme in people with progressive multiple sclerosis (SUMS): a pragmatic, multi-centre, randomised, controlled trial and cost-effectiveness analysis. Lancet Neurol 2019 Aug;18(8):736-747 [FREE Full text] [CrossRef] [Medline]
- Parkin D, Rice N, Jacoby A, Doughty J. Use of a visual analogue scale in a daily patient diary: modelling cross-sectional time-series data on health-related quality of life. Soc Sci Med 2004 Jul;59(2):351-360. [CrossRef] [Medline]
- Bove R, Secor E, Healy BC, Musallam A, Vaughan T, Glanz BI, et al. Evaluation of an online platform for multiple sclerosis research: patient description, validation of severity scale, and exploration of BMI effects on disease course. PLoS One 2013;8(3):e59707 [FREE Full text] [CrossRef] [Medline]
- Jongen PJ, Sinnige LG, van Geel BM, Verheul F, Verhagen WI, van der Kruijk RA, et al. The interactive web-based program MSmonitor for self-management and multidisciplinary care in multiple sclerosis: concept, content, and pilot results. Patient Prefer Adherence 2015;9:1741-1750 [FREE Full text] [CrossRef] [Medline]
- Golan D, Sagiv S, Glass-Marmor L, Miller A. Mobile-phone-based e-diary derived patient reported outcomes: association with clinical disease activity, psychological status and quality of life of patients with multiple sclerosis. PLoS One 2021;16(5):e0250647 [FREE Full text] [CrossRef] [Medline]
- Jongen PJ, Sinnige LG, van Geel BM, Verheul F, Verhagen WI, van der Kruijk RA, et al. The interactive web-based program MSmonitor for self-management and multidisciplinary care in multiple sclerosis: utilization and valuation by patients. Patient Prefer Adherence 2016;10:243-250 [FREE Full text] [CrossRef] [Medline]
- Zettl UK, Bauer-Steinhusen U, Glaser T, Czekalla J, Hechenbichler K, Limmroth V, et al. Adherence to long-term interferon beta-1b injection therapy in patients with multiple sclerosis using an electronic diary. Adv Ther 2016 May;33(5):834-847. [CrossRef] [Medline]
- Richardson A. The health diary: an examination of its use as a data collection method. J Adv Nurs 1994 Apr;19(4):782-791. [CrossRef] [Medline]
- Gajofatto A, Benedetti MD. Treatment strategies for multiple sclerosis: when to start, when to change, when to stop? World J Clin Cases 2015 Jul 16;3(7):545-555 [FREE Full text] [CrossRef] [Medline]
- Ciotti JR, Cross AH. Disease-modifying treatment in progressive multiple sclerosis. Curr Treat Options Neurol 2018 Apr 07;20(5):12. [CrossRef] [Medline]
- Puhan MA, Steinemann N, Kamm CP, Müller S, Kuhle J, Kurmann R, Swiss Multiple Sclerosis Registry Smsr. A digitally facilitated citizen-science driven approach accelerates participant recruitment and increases study population diversity. Swiss Med Wkly 2018;148:w14623 [FREE Full text] [CrossRef] [Medline]
- Steinemann N, Kuhle J, Calabrese P, Kesselring J, Disanto G, Merkler D, Swiss Multiple Sclerosis Registry. The Swiss Multiple Sclerosis Registry (SMSR): study protocol of a participatory, nationwide registry to promote epidemiological and patient-centered MS research. BMC Neurol 2018 Aug 13;18(1):111 [FREE Full text] [CrossRef] [Medline]
- Barin L, Salmen A, Disanto G, Babačić H, Calabrese P, Chan A, Swiss Multiple Sclerosis Registry (SMSR). The disease burden of Multiple Sclerosis from the individual and population perspective: which symptoms matter most? Mult Scler Relat Disord 2018 Oct;25:112-121. [CrossRef] [Medline]
- Matter-Walstra K, Klingbiel D, Szucs T, Pestalozzi BC, Schwenkglenks M. Using the EuroQol EQ-5D in Swiss cancer patients, which value set should be applied? Pharmacoeconomics 2014 Jun;32(6):591-599. [CrossRef] [Medline]
- Perneger TV, Combescure C, Courvoisier DS. General population reference values for the French version of the EuroQol EQ-5D health utility instrument. Value Health 2010 Aug;13(5):631-635 [FREE Full text] [CrossRef] [Medline]
- McGinley MP, Goldschmidt CH, Rae-Grant AD. Diagnosis and treatment of multiple sclerosis: a review. JAMA 2021 Feb 23;325(8):765-779. [CrossRef] [Medline]
- Pennebaker J, Boyd R, Jordan K, Blackburn K. The development and psychometric properties of LIWC2015. University of Texas. 2015. URL: https://repositories.lib.utexas.edu/bitstream/handle/2152/31333/LIWC2015_LanguageManual.pdf [accessed 2022-09-19]
- Welcome to LIWC-22. LIWC. URL: https://www.liwc.app/ [accessed 2022-08-26]
- Meier T, Boyd R, Pennebaker J, Mehl M, Martin M, Wolf M, et al. “LIWC auf Deutsch”: the development, psychometrics, and introduction of DE- LIWC2015. PsyArXiv 2019 Feb 14. [CrossRef]
- Cohn MA, Mehl MR, Pennebaker JW. Linguistic markers of psychological change surrounding September 11, 2001. Psychol Sci 2004 Oct;15(10):687-693. [CrossRef] [Medline]
- Diaz G. GitHub - stopwords-iso/stopwords-de: German stopwords collection. GitHub. 2020 Mar 6. URL: https://github.com/stopwords-iso/stopwords-de [accessed 2022-07-23]
- Honnibal M, Montani I. spaCy 2: natural language understanding with Bloom embeddings, convolutional neural networks and incremental parsing. Spacy. 2017. URL: http://citebay.com/how-to-cite/spacy/ [accessed 2022-07-23]
- Ahn I, Na W, Kwon O, Yang DH, Park G, Gwon H, et al. CardioNet: a manually curated database for artificial intelligence-based research on cardiovascular diseases. BMC Med Inform Decis Mak 2021 Jan 28;21(1):29 [FREE Full text] [CrossRef] [Medline]
- Jaccard P. The distribution of the flora in the alpine zone. New Phytol 1912 Feb;11(2):37-50. [CrossRef]
- Rhee S, Liu TF, Holmes SP, Shafer RW. HIV-1 subtype B protease and reverse transcriptase amino acid covariation. PLoS Comput Biol 2007 May;3(5):e87 [FREE Full text] [CrossRef] [Medline]
- Pennebaker J, Booth R, Boyd R, Francis M. Linguistic inquiry and word count: LIWC2015. Pennebaker Conglomerates. 2015. URL: https://www.researchgate.net/publication/337731895_Linguistic_Inquiry_and_Word_Count_LIWC2015 [accessed 2022-09-19]
- Potdar R, Thomas A, DiMeglio M, Mohiuddin K, Djibo DA, Laudanski K, et al. Access to internet, smartphone usage, and acceptability of mobile health technology among cancer patients. Support Care Cancer 2020 Nov;28(11):5455-5461. [CrossRef] [Medline]
- Fox G, Connolly R. Mobile health technology adoption across generations: narrowing the digital divide. Info Systems J 2018 Jan 29;28(6):995-1019. [CrossRef]
- Grose J, Freeman J, Skirton H. Value of a confidant relationship in psychosocial care of people with multiple sclerosis. Int J MS Care 2012;14(3):115-122 [FREE Full text] [CrossRef] [Medline]
- Why Avonex. Avonex. URL: https://www.avonex.com/en_us/home/why-avonex/about.html [accessed 2022-07-24]
- Wynn DR. Enduring clinical value of Copaxone® (Glatiramer Acetate) in multiple sclerosis after 20 years of use. Mult Scler Int 2019;2019:7151685 [FREE Full text] [CrossRef] [Medline]
- Roche’s OCREVUS (ocrelizumab) approved in Switzerland for primary progressive and relapsing forms of multiple sclerosis. Roche. 2017 Sep 28. URL: https://www.roche.ch/en/media-switzerland/informationen/med-ch-2017-09-28.htm [accessed 2022-07-28]
- Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008;4:1-32. [CrossRef] [Medline]
- Petrie KJ, Jago LA, Devcich DA. The role of illness perceptions in patients with medical conditions. Curr Opin Psychiatry 2007 Mar;20(2):163-167. [CrossRef] [Medline]
- Wendrich K, van Oirschot P, Martens MB, Heerings M, Jongen PJ, Krabbenborg L. Toward digital self-monitoring of multiple sclerosis: investigating first experiences, needs, and wishes of people with MS. Int J MS Care 2019;21(6):282-291 [FREE Full text] [CrossRef] [Medline]
- Pennebaker J, Chung CK. Expressive writing, emotional upheavals, and health. In: Foundations of Health Psychology. Oxford, UK: Oxford University Press; 2007.
- Greenhalgh J, Ford H, Long AF, Hurst K. The MS Symptom and Impact Diary (MSSID): psychometric evaluation of a new instrument to measure the day to day impact of multiple sclerosis. J Neurol Neurosurg Psychiatry 2004 Apr;75(4):577-582 [FREE Full text] [CrossRef] [Medline]
- Hellard ME, Sinclair MI, Forbes AB, Fairley CK. A randomized, blinded, controlled trial investigating the gastrointestinal health effects of drinking water quality. Environ Health Perspect 2001 Aug;109(8):773-778 [FREE Full text] [CrossRef] [Medline]
- Zhao Y, Ni Q, Zhou R. What factors influence the mobile health service adoption? A meta-analysis and the moderating role of age. Intl J Inform Manag 2018 Dec;43:342-350. [CrossRef]
- Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR. Patient compliance with paper and electronic diaries. Control Clin Trials 2003 Apr;24(2):182-199. [CrossRef] [Medline]
- Zhang A, Xing L, Zou J, Wu JC. Shifting machine learning for healthcare from development to deployment and from models to data. Nat Biomed Eng 2022 Jul 04 (forthcoming). [CrossRef] [Medline]
- Koops S, Brederoo SG, de Boer JN, Nadema FG, Voppel AE, Sommer IE. Speech as a biomarker for depression. CNS Neurol Disord Drug Targets 2021 Dec 13 (forthcoming). [CrossRef] [Medline]
- Wolf T, Debut L, Sanh V, Chaumond J, Delangue C, Moi A, et al. Transformers: state-of-the-art natural language processing. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 2020 Presented at: 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations; Oct, 2020; Online. [CrossRef]
- Thorpe J, Forchhammer BH, Maier AM. Adapting mobile and wearable technology to provide support and monitoring in rehabilitation for dementia: feasibility case series. JMIR Form Res 2019 Oct 17;3(4):e12346 [FREE Full text] [CrossRef] [Medline]
- Cornet VP, Holden RJ. Systematic review of smartphone-based passive sensing for health and wellbeing. J Biomed Inform 2018 Jan;77:120-132 [FREE Full text] [CrossRef] [Medline]
Abbreviations
EQ-VAS: EuroQol visual analog scale |
LIWC: Linguistic Inquiry and Word Count |
MS: multiple sclerosis |
PPMS: primary progressive multiple sclerosis |
SMSR: Swiss Multiple Sclerosis Registry |
SPMS: secondary progressive multiple sclerosis |
Edited by L Buis; submitted 13.04.22; peer-reviewed by PJ Jongen, I Ahn, M Clarysse; comments to author 25.05.22; revised version received 29.07.22; accepted 24.08.22; published 05.10.22
Copyright©Chloé Sieber, Deborah Chiavi, Christina Haag, Marco Kaufmann, Andrea B Horn, Holger Dressel, Chiara Zecca, Pasquale Calabrese, Caroline Pot, Christian Philipp Kamm, Viktor von Wyl, Swiss Multiple Sclerosis Registry. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 05.10.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.