Background: With a wide range of use cases in both research and clinical domains, collecting continuous mobile health (mHealth) streaming data from multiple sources in a secure, highly scalable, and extensible platform is of high interest to the open source mHealth community. The European Union Innovative Medicines Initiative Remote Assessment of Disease and Relapse-Central Nervous System (RADAR-CNS) program is an exemplary project with the requirements to support the collection of high-resolution data at scale; as such, the Remote Assessment of Disease and Relapse (RADAR)-base platform is designed to meet these needs and additionally facilitate a new generation of mHealth projects in this nascent field.
Objective: Wide-bandwidth networks, smartphone penetrance, and wearable sensors offer new possibilities for collecting near-real-time high-resolution datasets from large numbers of participants. The aim of this study was to build a platform that would cater for large-scale data collection for remote monitoring initiatives. Key criteria are around scalability, extensibility, security, and privacy.
Methods: RADAR-base is developed as a modular application; the backend is built on a backbone of the highly successful Confluent/Apache Kafka framework for streaming data. To facilitate scaling and ease of deployment, we use Docker containers to package the components of the platform. RADAR-base provides 2 main mobile apps for data collection, a Passive App and an Active App. Other third-Party Apps and sensors are easily integrated into the platform. Management user interfaces to support data collection and enrolment are also provided.
Results: General principles of the platform components and design of RADAR-base are presented here, with examples of the types of data currently being collected from devices used in RADAR-CNS projects: Multiple Sclerosis, Epilepsy, and Depression cohorts.
Conclusions: RADAR-base is a fully functional, remote data collection platform built around Confluent/Apache Kafka and provides off-the-shelf components for projects interested in collecting mHealth datasets at scale.
The opportunity in health care for continuous monitoring of patients has steadily grown in parallel with the widespread availability of smartphones, more capacious mobile networks, and development of new wearable sensors that are able to continuously measure a growing set of physiological and phenomenological parameters. Many of these devices are currently in the lifestyle or fitness domain; however, vendors are increasingly developing these devices for medical-grade applications. If these streams of data can be reliably collected, analyzed, and acted on, it opens up the possibility of better understanding disease etiology, diagnosis, prognosis, and detecting relapse in most disease areas.
Existing mobile health (mHealth) platforms include some form of questionnaires, phone (Android, iOS) sensor data collection, wearables integration, backend infrastructure, and management user interface, but few presently include all or are scalable solutions. Moreover, 2 such examples are the Open source AWARE Framework, an Android platform for mobile phone–based context sensing , and the Health Insurance Portability and Accountability Act of 1996-compliant Bridge platform, which supports biomedical studies conducted through smartphones [ ].
The Euro 26 million Innovative Medicines Initiative (IMI) Remote Assessment of Disease and Relapse -Central Nervous System (RADAR-CNS) is a major international academic-industry research program aimed at developing novel methods and infrastructure for monitoring major depressive disorder (MDD), epilepsy (Epi), and multiple sclerosis (MS) using wearable devices and smartphone technology . Beyond supporting the initial goals of the 3 disorder areas in RADAR-CNS, the RADAR-base platform aims to provide a highly extensible platform for mHealth applications [ ].
To facilitate adoption by the wider mHealth community, the RADAR-base platform was released under an open source Apache 2 license in January 2018. RADAR-base is composed of backend infrastructure and 2 Android mobile apps: a cross-platform Cordova app for active monitoring of participants (active remote monitoring technology, aRMT) through conscious action (eg, questionnaires, audio questions, timed tests) and a native Android app for passive monitoring via phone and wearable sensors (passive remote monitoring technology, pRMT). RADAR-base also includes capabilities for data aggregation, management of studies, and real-time visualizations.
A key differentiator of RADAR-base platform is that it makes use of Confluent technologies (based around Apache Kafka) to provide an end-to-end solution for remote monitoring use cases (eg, participant management and data analysis) that scales horizontally through the use of Kafka and Confluent ecosystem. Other approaches to centralize information flow and decouple systems exist, in particular Messaging Queues and Enterprise Service Bus/Service Oriented Architecture (SOA) type architectures, which have a number of overlapping and differentiating factors compared with Confluent/Kafka, in particular around routing, scaling, performance, and ecosystem [, ]. Kafka and the Confluent ecosystem have become the de facto industry standard for high-throughput event streaming data applications. More specifically, it is appropriate for building real-time streaming/transforming data pipelines that reliably move data between systems at scale. The RADAR-base platform has a number of requirements: first, data must flow from sensors or data sources into the platform through mobile devices and second, to transform these data (eg, restructured for Cold Storage, Hot Storage, aggregating data based on time windows and monitor the data coming in. This Kafka based pipeline, along with data schematization makes the platform flexible and open to a variety of devices, types of data, velocity, and throughput.
The RADAR-base platform can be deployed both in local settings, such as a hospital, for local data collection or for ambulatory studies through remote deployment for centralized data collection. The RADAR-base backend has been deployed on various platforms (cloud, bare-metal, etc) as a set of microservices using Docker containers. Both scenarios are used in RADAR-CNS.
The RADAR-base platform is a scalable, secure, open source Internet of Things (IoT) platform for real-time remote sensor data collection in the context of mHealth clinical studies.
The RADAR-base platform consists of following major categories of components:
- Data Collection Ecosystem
- Data sources
- Data Processing and Visualization
- Study management and Security
and show the integration and communication between different components of the RADAR-base platform.
shows the Technical Overview of the RADAR-base Platform Stack Platform Capabilities:
- High throughput, low latency data collection
- Generalized device integration for passive data sources
- Abstracted and composable integration mechanism for sensor devices
- Third-Party RESTful (Representational State Transfer) data source integration
- Configurable data sources at runtime
- Schema evolution
- Real-time data processing and analytics
- Hot and cold storage
- Data access (Representational State Transfer [REST]-API)
- Modular, extensible dashboards
- Electronic Case Report Form (eCRF) integration (REDCap)
- Remote configuration
- Cohort Management Portal
shows an overview of the RADAR-base platform. Current data sources are as follows: Empatica E4, Pebble 2, Fitbit, Biovotion, Faros, Active aRMT Questionnaire app, and Passive pRMT app.
These functionalities are delivered through the following components:
- Data ingestion: Recognizing and registering data sources (including smartphones and wearable devices), collecting the data via a direct Bluetooth connection or through a third-party application protocol interface (API), and streaming in near-real-time to the server (green box in ). Using Apache Kafka, the collected data are streamed to dedicated topics in real-time where the data are schematized using Apache AVRO and the Schema Registry. More details about data source mapping and integration can be found in the Data Sources and Study Management Sections below. Detailed further on the platform's documentation wiki [ ].
- Data storage and management: Consists of 2 centralized storage systems behind an authorized security layer. The cold storage, based on Hadoop Distributed File System (HDFS), that is scalable and fault-tolerant, focused on storing large volumes of raw data, and the hot storage, based on MongoDB, for storing aggregated data to provide a near real-time overview of the raw data, principally for the data dashboards.
- Data sharing: Visualizing aggregated data in a live dashboard and exporting raw data for further analyses in various formats including AVRO, JSON, and CSV.
Data Collection Ecosystem
The entire RADAR-base backend is deployable as a set of microservices based on Docker containers .
Representational State Transfer Proxy
As the platform is based on Apache Kafka, we can either send data directly into Kafka via a native Producer or using HTTP and the Confluent REST proxy.
The data sent into the platform from the data source will be converted into AVRO format before going into Kafka topics. To convert our data to AVRO, the REST proxy needs to know the schema (or format) of the data being sent. These schemas are stored in the Schema Registry to reduce the payload size of each request.
Backend Streams and Monitors
Event-by-event stream processing is built on top of Kafka Streams. It provides an abstract layer to monitor and analyze streams of data and write aggregated/transformed data into Kafka topics. The data are produced (into Processed Topics) and consumed (from Data Source Topics) in Apache Avro format using the schema stored inside the Schema Registry. This capability provides real-time analytics and is used to trigger real-time interventions (eg, providing real-time data source statistics and sending notifications on source disconnection).
The data coming into Kafka is extracted into storage systems such as the HDFS and MongoDB with the help of Kafka Sink Connectors. The HDFS Sink Connector takes raw data coming into the system and deposits it into the HDFS storage in AVRO format (this time with the schema embedded, so the data are self-describing), which can be used for archival storage and historical analysis. The MongoDB sink connector takes aggregated data coming into Kafka from the Streams app’s Processed Topics and deposits it into the MongoDB storage.
The AVRO schema is a JSON format specification of the fields and data types, which data values can hold. The schema itself can be embedded in the message or a reference held to the schema stored in a Schema Registry. AVRO is a particularly convenient format for managing schema evolution in RADAR-base, as schema changes can occur frequently and without warning, especially where third-party data sources are concerned.
For illustration purposes, the schema for the phone acceleration is shown in.
Data Sources represent a wide variety of systems able to send data into the RADAR-base platform; these include devices containing sensors, mobile phones, questionnaires and digital games/assessments, and Web-APIs data portals.
In RADAR-base, passive data sources are collected via the pRMT app, active data sources via the aRMT app, and third-party data sources via the THINC-it app in RADAR-CNS.
Another type of data source includes middleware connecting a vendor’s Web API to the RADAR-base platform. For example, Fitbit does not provide a mobile Software Development Kit (SDK) to stream data to the pRMT app directly; instead, all the data are uploaded to the vendor data warehouse and provided to developers via a Web API. Getting these data into the RADAR system is achieved by implementing a server-side Kafka Source Connector, which continuously queries data from the vendor’s Web API and dumps it into Kafka inside the RADAR-base platform; this approach can be used to integrate other Web API/OAuth2 data sources .
Passive Remote Monitoring App: Sensor Data Collection
The native passive Android application (pRMT) has been designed to passively collect data from sensors on the user’s smartphone as well as to integrate wearable devices that offer SDKs. Its enhanced modularity (via pRMT plugins) allows easy integration of new devices/sensors. It currently supports Empatica E4 Wristband, Pebble 2 Smartwatch, and Biovotion VSM devices.
shows the pRMT app interface after login.
Active Remote Monitoring App: Composable Questionnaire Delivery
The primary goal for the aRMT mobile app is to allow users to submit questionnaires through the user’s smartphone at a notified time. The questionnaire definitions and their regimen are defined by simple JSON configuration files, which are Web-served and therefore remotely configurable. New questionnaire configuration files can be easily created either manually or authored as REDCap data dictionaries and parsed via a simple script. The regimen or protocol configuration file defines the sequence of the questionnaires delivered and the local notifications or Firebase Cloud Messaging push notifications used to alert the user.
The aRMT app was designed as a hybrid Cordova app and usable on both iOS and Android. Furthermore, it includes Cordova plugins to collect active audio responses to questions, allowing active samples of raw speech audio to be collected for analysis. Finally, the aRMT app also serves as a means of providing time markers to data collected in parallel by the pRMT app, such as start and end labels of walking and balance tests used in the MS study in RADAR-CNS.shows a selected interface of the aRMT app.
Third-Party App Integration: THINC-it
THINC-it is a third-party mobile app that makes use of 5 quick interactive tests to assess memory, concentration, and attention .
The THINC-it app uses the RADAR-base platform backend infrastructure as part of the RADAR-CNS project. It also provides a reasonable paradigm for other third-party app integration into the RADAR-base platform.
Data Processing and Visualization
Historic Raw Data Processing and Visualization
A common task is the exploration of collected raw data. In addition to the near-real-time visualization through the dashboard, the RADAR platform includes a python package for the processing and visualization of historic data. The package provides standard tooling for exploratory visualization of RADAR-base data (see) and the easy implementation of preprocessing pipelines to take data exported from a RADAR-base project and output the processed data, with any accompanying labels, in a format suitable for use in standard machine learning libraries. Dask, a python library for parallel and larger-than-memory computing [ ], is primarily used as the backbone. The potential for large longitudinal studies collecting high-frequency data necessitates the ability to distribute computation or to work on subsets. Moreover, the use of existing libraries allows straightforward integration with the rest of the python data science ecosystem.
The package can make use of the common structure of RADAR-base data through the defined AVRO schema and specification for each modality. A schema describes data types, allowing automatic parsing of modalities stored without type. Each data source integrated into RADAR also contains a specification listing associated sensors with information on each. That information includes field names and units, allowing visualizations to be labeled automatically. As the specifications give the device and type of sensor for the associated data, those data can be mapped to relevant processing pipelines. For example, the Biovotion VSM1 device provides all its data in 1-second batches. These batches are ordered and so can be upsampled. Using the device specification, a function to upsample the data can be mapped to all the relevant data modalities. Alternatively, an analyst may wish to map a function to sensors of the same type across different devices, which is also made simple by using the specification to identify data from sensors of the same type.
Real-Time Data Processing and Representational State Transfer (RESTful)Application Protocol Interface
The RADAR platform exposes RESTful Services implemented using Jersey 2 and deployed on Grizzly server. Data collected in the platform are processed in real-time by a Kafka Streams application to provide aggregations (mean, max, etc) at various time resolutions (second, minute, hour, day, and week) and stored in MongoDB, which is served through the REST-API. The REST-API provides various API endpoints, which can be used to request the aggregated data in near-real-time and allows various combinations of queries. All the endpoints are secured; therefore, only a valid user or a client registered with the management portal with appropriate permissions/scopes can access these endpoints. All REST endpoints have been documented following OpenAPI specifications using Swagger: a powerful open source framework offering a large ecosystem of tools that help to design, build, document, and consume RESTful-APIs.
The REST-API also exposes some real-time information about the current status (connected or disconnected) of the sources registered for a particular subject along with when a data source was last detected sending data. All this information is used by the Dashboard to provide a real-time visualization of the current state of the studies/projects to project admins.
Real-Time Visualization Via Dashboards
Overview and visualization are provided by a clear, customizable user interface with an emphasis on exploring different aggregation and zoom levels in the data. The RADAR-base dashboards use Angular, RxJS, and D3 to construct views on data from the REST-API. These presently provide management project/study lists, compliance views, and participant-level visualization of longitudinal data.shows an example data view. More detailed figures are given in the .
Study Management and Security
The management portal Web application is the main user interface for creating and organizing RADAR projects, enrolling participants, and managing the association of participants with corresponding data sources.shows the management portal interface.
Authentication, authorization, deidentification, and encryption are compulsory due to the sensitive information collected by the platform and to manage additional unknown risks associated with IoT using large numbers of network edge devices and endpoints. These are implemented for these following elements:
Quick Response Code Authentication
The management portal is used to issue a Quick Response (QR) code or Token for data-source to participant registration. This QR code can be scanned with the embedded QR code scanner in the integrated apps or alternatively a token can be entered directly as text. The decoded QR code provides some valuable information required by clients including sources, user ID, roles, scopes.
Open Authentication 2
To provide authorization and authentication, we utilize the OAuth2 workflow, an industry standard protocol for authorization. In the mobile apps, we use the Refresh Token grant type , and for other internal clients, we use the client credentials grant type. For instance, the gateway and the REST-API use the latter, whereas the mobile apps use the former.
For the mobile apps, an access token from the management portal is required for authorization across the platform. Without this token, data sources can neither register nor send data into the platform. The management portal provides a Refresh Token in the form of a QR code associated with a subject. This QR code can be scanned by the mobile apps to obtain a URL to a JSON Web Token, which embeds a Refresh Token and the authorization endpoint as a Bearer Token in an HTTP(S) request to obtain a new Refresh-token and Access token pair. This access token can then be used to access and post data according to the resources, roles, and scopes specified. Once the Access token expires, the most recently obtained Refresh Token is used to obtain a new (Refresh-token+Access token) pair.
The RADAR-base platform provides utilities for clients to easily manage the OAuth2 authorization flow . An online manual is available, which specifies a step-by-step process of integrating new apps along with a list of utilities and libraries for QR code and OAuth [ ]. The pRMT Android app uses OpenID Connect for authorization and authentication [ ].
As discussed in eCRF Integration and REDCap Integration WebApp Sections, the strongly identifiable information is saved in a separate eCRF system, which is isolated from the RADAR-base platform . Only the nonidentifiable data are saved in the platform. The 2 separated datasets are linked to each other as pseudonymized data only via RADAR-base Universally Unique ID.
An nginx web server is used to proxy traffic into the platform and provide Cross-Origin Resource Sharing. Furthermore, the reverse proxy (nginx web server) can also be configured to act as a mitigation against Distributed Denial‑of‑Service attacks or using it as an HTTP load balancer.
This component controls access to the Confluent Kafka REST Proxy for posting data from clients to Kafka through HTTP POST requests. It performs authentication and authorization, content validation, and decompression if needed. It also verifies if the access token sent in the HTTP POST request is valid and has the required privileges to perform the POST request for the specified resource, role, and scope.
The various components of RADAR-base keep activity logs at levels appropriate for that component. As the management portal keeps track of all study-related information, device assignments, and participant enrollment information, it keeps the most detailed audit logs. Any modification to the management portal database is stored in an audit record. These audit records store the user who made the modification, the time at which the modification was made, as well as the old and new state of the modified entity, allowing the complete history of all study metadata to be tracked or roll back modifications when necessary. Finally, the management portal also logs when, to what application, and for which user access tokens are being granted. It is important to note that this log is only there for the purposes of auditing. Validation of the tokens is not handled by the management portal. Instead, clients can use the management portal’s public key to validate the digital signature embedded in the access token. This way, components in RADAR-base can horizontally scale up, without the need for the management portal to scale up with them just to be able to keep up with validation requests. Seefor audit log figure.
REDCap eCRF Integration
Optional integration of one or more REDCap eCRFs servers is provided with RADAR-base. REDCap is a secure 21 CFR Part 11, FISMA, and HIPAA-compliant Web application for building and managing online surveys and databases . When used in this mode, subject creation is linked automatically between the REDCap and RADAR-base.
User Registration Workflow
A brief workflow of the registration is shown in. A subject or recruiter will register a new record in REDcap (optional). Creating this record will trigger the creation of a corresponding subject in the management portal via RESTful-API calls. From the management portal subject, the project admin (recruiter) will be able to register apps via a QR code (aRMT and pRMT). Apps can be downloaded from the playstore, and registration QR codes can be obtained and scanned from the management portal for the particular subject. Once the apps get registered, the relevant subject will start streaming wearables and phone data.
The entire RADAR-base platform is freely available at github repository as open source software . The details of the platform can be read at the official RADAR-base website [ ]. A detailed quickstart, deployment details, and developer documentation are made available at Confluence Wiki [ ]. The Docker images for all the components are available at Docker Hub [ ].
Multiple instances of RADAR-base are deployed and in use for real-world studies of Epilepsy, MS, and MDD under the umbrella of RADAR-CNS [, ].
The catalog of devices currently integrated into the pRMT app include onboard Android smartphone sensors, Empatica E4, Pebble 2 smartwatch, BiovotionEverion, Faros 180, and Fitbit; a list is maintained here . Pluggable capability is provided to integrate new wearable devices offering a native SDK (eg, Empatica E4) or through third-party vendors’ REST-API (eg, Fitbit). The aRMT app provides highly extensible aRMT functionality to the platform, rendering questionnaires from a JSON configuration file, for example, questionnaires using RADAR-CNS include RSES, PHQ8, and ESM. shows the contiguity of data collected from an MDD study participant’s phone over a 6-month period. There are daily patterns visible even at this resolution; topics that rely on user interaction are typically not collected during the night, creating a striped pattern in the figure.
Remote Assessment of Disease and Relapse-Base Current Deployments
The current deployments of RADAR-base for the different disorders are explained below.
Major Depression Disorder
The RADAR-base platform has been deployed centrally to collect active (questionnaires) and passively generated (wearable Fitbit and smartphone sensor) data remotely for participants recruited to 3 sites of the MDD study. The sites include King’s College Hospital, London; Centro de Investigacion Biomedica en Red, Barcelona; and VU University Medical Center, the Netherlands. The objective being to collect regular self-reported symptoms and metrics such as sleep and ambulatory behavior. High-resolution data are being collected over a period of up to 2 years for each participant. More details about the MDD studies and preliminary data analysis are provided in our study .
The Radar-base platform has been successfully tested and deployed in the Clinical Neurophysiology Department, King’s College London, and the Epilepsy Center, Medical Center University of Freiburg, in their respective video electroencephalograms monitoring units, and it is currently in active use in London and Freiburg with enrolled participants.
Latest participants have the facility to wear 3 devices (Faros, Biovotion, and E4) concurrently. We have explained the detailed deployment of the platform for Epilepsy studies and initial collected data in our study .
MS studies using RADAR-base are underway at different partner sites across Europe. Participant recruitment has been started and data are being streamed to central deployment. An important focus here is to collect data from the Faros 180 devices used for several mobility and balance tests in addition to similar ambulatory behavior collected in the depression study.
These 3 studies expose the versatility of the RADAR-base platform and generate data with very different complexity, volume, velocity, and durations.
Several technical challenges were addressed, including:
- High throughput, volume, and velocity of the data.
- Processing data in real time.
- Optimizing phone resources to handle data collection and streaming (particularly high-resolution sensors).
- Privacy concerns particularly around Global Positioning System data used to track location or audio exposing identifiable information. For this, the RADAR-base platform calculates and sends the relative location from a reference point. Similarly, background audio sampling is one-way-mapped to a vector representation of features using an OpenSmile plugin [ ]; in this way, raw background audio is not exposed while retaining useful information content for analytics purposes.
- Identifiable information is kept separate from sensor data to make it pseudonymized.
- Security (authorization and authentication) is also a major concern for sensitive data collected from participants. Access to data is provided via a secure data transfer protocol.
- With the huge amount of raw data the platform is built to collect, it is essential to have efficient compression. All the data collected and stored are compressed and encrypted.
- Maintaining performance and behavior of the data source pRMT and aRMT apps in an ever-changing Android landscape of OS versions, handsets vendors, and form factors.
Comparison With Prior Work
A summary of other platforms comparing salient features with the RADAR-base platform are provided here. The recently developed mental health Nonintrusive Individual Monitoring Architecture platform, a prototype implementation used alongside an investigation of the key features required of a mHealth data collection platform; these include integrating data sources, a focus on privacy, and flexible user permissions . Intel's Context Sensing SDK is a library for Android and Windows with specific context states; it, however, only provides front-end components [ ]. The EmotionSense app is developed by the University of Cambridge to sense emotions with implications for psychological therapy and improving well-being; however, it is only focused on depression [ ]. Medopad provides solutions for different health care issues with symptom tracking; this is a commercial solution and mainly focuses on phone sensors and active monitoring methods [ ]. PHIT allows users to build health apps based on existing infrastructure [ ]. ResearchKit, an open source framework for building apps specifically for iOS, makes it easier to enroll participants and conduct studies. However, new wearable device integration requires strong programming skills and it does not include a data management solution [ ].
ResearchStack is an SDK and UX framework for building research study apps on Android, with a similar application domain as ResearchKit . Both ResearchKit and ResearchStack provide software libraries, frameworks, and development tools that require extensive programming skills to create apps. A framework to create observational medical studies for mobile devices without extensive programming skills was presented [ ]. Further comparison of currently available sensing platforms/apps is provided in .
A key differentiator in the RADAR-base platform is the use of the Confluent platform technologies  (based around Apache Kafka) as the underlying infrastructure to provide a highly scalable end-to-end solution for event-driven messaging, which is able to satisfy a wide variety of use cases, for example, high throughput, low latency messaging, real-time data processing, and fault tolerance/robustness. The platform can be deployed as microservices with Docker containers and with minimal effort extended to integrate new sensors and data sources.
Future Works and Conclusions
RADAR-base aims to stimulate the field of mHealth by providing an off-the-shelf platform for general remote data collection at scale. The project has long-term goals to improve participant care with use cases including predicting and pre-empting relapses and improving outcome measures in trials through the use of remote assessment technologies in a wide variety of disorder areas. Beyond RADAR-CNS, RADAR-base is being deployed across a number of other large EU IMI2–funded programs including RADAR-Alzheimer’s Disease and is presently deployed for BigData@Heart for remote monitoring in an atrial fibrillation treatment trial (the UK National Institute for Health Research—NIHR—funded RATE-AF NCT02391337).
This study has received support from the EU/EFPIA IMI Joint Undertaking 2 (RADAR-CNS grant No 115902) . This communication reflects the views of the RADAR-CNS consortium, and neither IMI nor the European Union and EFPIA are liable for any use that may be made of the information contained herein. Backend infrastructure facilities were provided by King’s College London Open Stack Cloud “Rosalind.” Rosalind was funded with the following capital equipment grants: GSTT Charity reference: STR130505 and Maudsley Charity reference 980. The authors receive funding support from the NIHR Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health. The authors also acknowledge the support of NIHR University College London Hospitals Biomedical Research Centre.
Conflicts of Interest
Multimedia Appendix 1
Better resolution figures.PDF File (Adobe PDF File), 1MB
Multimedia Appendix 2
Available sensing platform.PDF File (Adobe PDF File), 27KB
- Ferreira D, Kostakos V, Dey AK. AWARE: mobile context instrumentation framework. Front ICT 2015 Apr 20;2 [FREE Full text] [CrossRef]
- The Bridge Platform. URL: https://developer.sagebridge.org/index.html [accessed 2019-03-04] [WebCite Cache]
- RadarCNS. URL: https://www.radar-cns.org/ [accessed 2019-03-04] [WebCite Cache]
- Ranjan Y, Kerz M, Rashid Z, Böttcher S, Dobson RJ, Folarin AA. RADAR-base: A Novel Open Source m-Health Platform. In: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. New York, New York, USA: ACM Press; 2018 Presented at: UbiComp'18; October 08-12, 2018; Singapore, Singapore p. 223-226. [CrossRef]
- Waehner K. Confluent Internet. Apache Kafka vs Enterprise Service Bus (ESB) – Friends, Enemies or Frenemies? URL: https://www.confluent.io/blog/apache-kafka-vs-enterprise-service-bus-esb-friends-enemies-or-frenemies/ [accessed 2019-03-04] [WebCite Cache]
- Loya SR, Kawamoto K, Chatwin C, Huser V. Service oriented architecture for clinical decision support: a systematic review and future directions. J Med Syst 2014 Dec;38(12):140 [FREE Full text] [CrossRef] [Medline]
- RADAR-base. Catalogue of Passive Data Sources URL: https://radar-base.atlassian.net/wiki/spaces/RAD/pages/87359489/Data+Source+Catalog [accessed 2019-03-04] [WebCite Cache]
- GitHub. RADAR-base/RADAR-Docker URL: https://github.com/RADAR-base/RADAR-Docker [accessed 2019-03-04] [WebCite Cache]
- GitHub. RADAR-base/RADAR-REST-fitbit URL: https://github.com/RADAR-base/RADAR-REST-fitbit [accessed 2019-03-04] [WebCite Cache]
- Progress in Mind. THINC-it® cognition screening tool now clinically validated URL: https://progress.im/en/content/thinc-it-cognition-screening-tool-now-clinically-validated [accessed 2019-03-04] [WebCite Cache]
- Dask Development Team. 2016. Dask: Library for dynamic task scheduling URL: http://docs.dask.org/en/latest/cite.html [accessed 2019-03-04] [WebCite Cache]
- OAuth 2.0 Servers. Access Tokens URL: https://www.oauth.com/oauth2-servers/access-tokens/ [accessed 2019-03-04] [WebCite Cache]
- GitHub. RADAR-base/ManagementPortal URL: https://github.com/RADAR-base/ManagementPortal/tree/master/oauth-client-util [accessed 2019-03-04] [WebCite Cache]
- OAuth Community Site. RFC 6750: OAuth 2.0 Bearer Token Usage URL: https://oauth.net/2/bearer-tokens/ [accessed 2019-03-04] [WebCite Cache]
- OpenID. Welcome to OpenID Connect URL: https://openid.net/connect/ [accessed 2019-03-04] [WebCite Cache]
- RADAR-base. URL: https://radar-base.org/ [accessed 2019-03-04] [WebCite Cache]
- REDCap. URL: https://projectredcap.org/ [accessed 2019-03-04] [WebCite Cache]
- GitHub. RADAR-base URL: https://github.com/RADAR-base [accessed 2019-03-04] [WebCite Cache]
- Atlassian. RADAR-base - Confluence URL: https://radar-base.atlassian.net/wiki/spaces/RAD/overview [accessed 2019-03-04] [WebCite Cache]
- Rashid Z, Stewart C, Böttcher S, Ranjan Y, Dobson R, Folarin AA. RADAR-base: Epilepsy Case Study. In: Proceedings of the 20 ACM International Joint Conference and 20 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers - UbiComp ?. New York, New York, USA: ACM Press; 2018 Presented at: UbiComp'18; October 8-12, 2018; Singapore, Singapore p. 227-230. [CrossRef]
- Stewart C, Rashid Z, Ranjan Y, Sun S, Dobson R, Folarin A. RADAR-base: Major Depressive Disorder and Epilepsy Case Studies. In: Proceedings of the 20 ACM International Joint Conference and 20 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers - UbiComp ?. New York, New York, USA: ACM Press; 2018 Presented at: UbiComp/ISWC’18; October 8-12, 2018; Singapore, Singapore p. 18. [CrossRef]
- RADAR-base. Supported Devices URL: https://radar-base.org/index.php/data-sensors/supported-devices/ [accessed 2019-03-04] [WebCite Cache]
- audiEERING. OpenSMILE URL: https://www.audeering.com/opensmile/ [accessed 2019-03-04] [WebCite Cache]
- Aledavood T, Triana HAM, Alakörkkö T, Kaski K, Saramäki J, Isometsä E, et al. Data collection for mental health studies through digital platforms: requirements and design of a prototype. JMIR Res Protoc 2017 Jun 9;6(6):e110 [FREE Full text] [CrossRef] [Medline]
- Intel Software. Context Sensing SDK URL: https://software.intel.com/en-us/context-sensing-sdk [accessed 2019-03-04] [WebCite Cache]
- University of Cambridge. Mood-tracking app paves way for pocket therapy URL: https://www.cam.ac.uk/research/news/mood-tracking-app-paves-way-for-pocket-therapy [accessed 2019-03-04] [WebCite Cache]
- Medopad. URL: https://medopad.com/ [accessed 2019-03-04] [WebCite Cache]
- Eckhoff RP, Kizakevich PN, Bakalov V, Zhang Y, Bryant SP, Hobbs MA. A platform to build mobile health apps: the Personal Health Intervention Toolkit (PHIT). JMIR Mhealth Uhealth 2015 Jun;3(2):e46 [FREE Full text] [CrossRef] [Medline]
- Jardine J, Fisher J, Carrick B. Apple's ResearchKit: smart data collection for the smartphone era? J R Soc Med 2015 Aug;108(8):294-296 [FREE Full text] [CrossRef] [Medline]
- ResearchStack. URL: http://researchstack.org/ [accessed 2019-03-04] [WebCite Cache]
- Zens M, Grotejohann B, Tassoni A, Duttenhoefer F, Südkamp NP, Niemeyer P. Development of a modular research platform to create medical observational studies for mobile devices. JMIR Res Protoc 2017 May 23;6(5):e99 [FREE Full text] [CrossRef] [Medline]
- Confluent. Confluent Hub URL: https://www.confluent.io/product/connectors/ [accessed 2018-06-04]
- Innovative Medicines Initiative. URL: https://www.imi.europa.eu/ [accessed 2019-03-04] [WebCite Cache]
|API: application protocol interface|
|aRMT: active remote monitoring technology|
|CNS: Central Nervous System|
|HDFS: Hadoop Distributed File System|
|IMI: Innovative Medicines Initiative|
|MDD: major depressive disorder|
|mHealth: mobile health|
|MS: multiple sclerosis|
|NIHR: National Institute for Health Research|
|pRMT: passive remote monitoring technology|
|RADAR: Remote Assessment of Disease and Relapse|
|REST: Representational State Transfer|
|SDK: Software Development Kit|
|QR: quick response|
Edited by G Eysenbach; submitted 29.08.18; peer-reviewed by S Zheng; comments to author 12.10.18; revised version received 28.11.18; accepted 09.12.18; published 01.08.19Copyright
©Yatharth Ranjan, Zulqarnain Rashid, Callum Stewart, Pauline Conde, Mark Begale, Denny Verbeeck, Sebastian Boettcher, The Hyve, Richard Dobson, Amos Folarin, The RADAR-CNS Consortium. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 01.08.2019.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.