This paper is in the following e-collection/theme issue:

mHealth for Wellness, Behavior Change and Prevention (2922) Mobile Health (mhealth) (2982) mHealth for Treatment Adherence (404)

Published on in Vol 4, No 1 (2016): Jan-Mar

A Mobile App for Hypertension Management Based on Clinical Practice Guidelines: Development and Deployment

A Mobile App for Hypertension Management Based on Clinical Practice Guidelines: Development and Deployment

A Mobile App for Hypertension Management Based on Clinical Practice Guidelines: Development and Deployment

Authors of this article:

Hannah Kang1 Author Orcid Image ;   Hyeoun-Ae Park1 Author Orcid Image
Article Authors Cited by (62) Tweetations (5) Metrics

    Original Paper

    Systems Biomedical Informatics Research Center, College of Nursing, Seoul National University, Seoul, Republic Of Korea

    Corresponding Author:

    Hyeoun-Ae Park, RN, PhD, FAAN

    Systems Biomedical Informatics Research Center

    College of Nursing

    Seoul National University

    103 Daehak-ro, Jongno-gu

    Seoul,

    Republic Of Korea

    Phone: 82 2 740 8827

    Fax:82 2 765 4103

    Email: hapark@snu.ac.kr


    Background: Hypertension is a chronic and lifestyle-related disease that requires continuous preventive care. Although there are many evidence-based clinical practice guidelines (CPGs) for hypertension management, applying them to daily management can be difficult for patients with hypertension. A mobile app, based on CPGs, could help patients with hypertension manage their disease.

    Objective: To develop a mobile app for hypertension management based on CPGs and evaluate its effectiveness in patients with hypertension with respect to perceived usefulness, user satisfaction, and medication adherence.

    Methods: The hypertension management app (HMA) was developed according to the Web-Roadmap methodology, which includes planning, analysis, design, implementation, and evaluation phases. The HMA was provided to individuals (N=38) with hypertension. Medication adherence was measured before and after using the HMA for 4 weeks. The perceived usefulness and user satisfaction were surveyed in the patients who completed the medication adherence survey.

    Results: Of the 38 study participants, 29 (76%) participated in medical adherence assessment. Medication adherence, as measured by the Modified Morisky Scale, was significantly improved in these patients after they had used the HMA (P=.001). The perceived usefulness score was 3.7 out of 5. The user satisfaction scores, with respect to using the HMA for blood pressure recording, medication recording, data sending, alerting, recommending, and educating about medication were 4.3, 3.8, 3.1, 3.2, 3.4, and 3.8 out of 5, respectively, in the 19 patients.

    Conclusions: This study showed that a mobile app for hypertension management based on CPGs is effective at improving medication adherence.

    JMIR mHealth uHealth 2016;4(1):e12

    doi:10.2196/mhealth.4966

    Keywords

    mobile health; clinical practice guideline; hypertension; self-management 


    Introduction

    Hypertension is a disease that can lead to myocardial infarction, cerebral infarction, and heart failure [1], and its prevalence rate is 29.2% among males and 24.8% among females [2]. Controlling blood pressure is essential in hypertension care.

    The two main branches of hypertension care are lifestyle improvement and drug treatment. According to the 2014 Evidence-Based Guideline for the Management of High Blood Pressure in Adults of the Eighth Joint National Committee [1], lifestyle management is the first step in hypertension care for patients older than 18 years. The second step is setting a blood pressure target based on the patient’s age, presence of diabetes mellitus, and chronic renal disease status, and reaching that target through drug treatment. This indicates the importance of helping patients with hypertension to maintain lifestyle improvements and drug treatments in order to keep their blood pressure in check by fostering self-management skills.

    The use of mobile health care is becoming increasingly popular in the self-care of chronic diseases such as hypertension. Mobile health care refers to the delivery of health care services via mobile communication devices [3]. The widespread availability of mobile phones with app capabilities means that they can be used to facilitate mobile health care via various types of interventions. According to an analysis of the current state of mobile health care, mobile phones can now be used to provide health care intervention strategies, such as tracking patient data, providing tailored self-management, leveraging social influence, and utilizing entertainment [4].

    This expansion of mobile health care led to approximately 20,000 commercial health care apps appearing on the iPhone App Store in 2013 [5]. The main functions of most hypertension management apps are measuring blood pressure and managing records. Providing users with more clinically helpful functions requires the use of evidence-based knowledge when developing apps. For this purpose, a paper-based clinical practice guideline (CPG) needs to be converted into a computer-interpretable guideline and applied to the delivery system. In other words, hypertension management, through mobile health care, requires the development of an app that provides tailored information and recommendations on lifestyle management based on accurate evidence while also improving the hypertension medication adherence of the user. The development and correct utilization of such an app could help patients with hypertension improve their lifestyle and increase their medication adherence through drug education and medication reminders.

    The aim of this study is to develop and evaluate a mobile app for hypertension management based on CPG knowledge, and then apply the developed hypertension management app (HMA) to patients with hypertension and evaluate its effects with respect to perceived usefulness, user satisfaction, and medication adherence.


    The HMA was first developed based on CPG knowledge, and evaluated by experts. The HMA was then applied to patients with hypertension to investigate the perceived usefulness and user satisfaction, while its effect on medication adherence was evaluated using a one-group pre- and posttest design.

    Development of the HMA

    The HMA was developed using the planning, analysis, design, implementation, and evaluation phases of the Web-Roadmap methodology of information science [6].

    Phase I: Planning

    The CPGs for providing the evidence for hypertension management were selected in consultation with experts whilst also considering the credibility of the publisher, year of publication, and inclusion criteria of the information. After selecting each CPG, knowledge was extracted from it that would improve the adherence to treatment for hypertension management.

    The Web-Roadmap methodology of information science [6] was used as a reference to define the data, process, and interface domains of the planning, analysis, design, and implementation phases, which in turn were used to plan the tasks and products of each phase (Figure 1).

    ‎
    Figure 1. Development stages of the HMA.
    View this figure
    Phase II: Analysis

    In the data domain, the data necessary for the system were extracted from the CPG and grouped. Data dictionaries were developed for each item.

    In the process domain, rules to serve as judgment criteria for each intervention were identified and summarized. These rules were later used for algorithm development. In addition, extracted data and rules were organized into the hypertension management ontology to apply the content of hypertension management according to the nursing process. Data and rules were also used to compile a list of tailored recommendations to make to patients with hypertension.

    In the interface domain, the required functions of the HMA were extracted by analyzing the requirements of the HMA. The requirements for the user interface were presented in a use-case diagram.

    Phase III: Design

    In the data domain, an entity-relation diagram was created to design a database for the data extracted in the analysis phase. Data entities of the system were identified and presented in tables with their attributes then connected with lines based on their relationships. This procedure revealed the data organization of the system.

    In the process domain, knowledge extracted in the analysis phase was elaborated in algorithmic form for use in system operations. In the interface domain, the layout of the user interface was designed to implement essential functions extracted in the analysis phase.

    Phase IV: Implementation

    In the implementation phase, the database, algorithms, and user interface were realized through coding.

    Phase V: Evaluation

    The HMA was first evaluated on the accuracy of the knowledge base and then mobile heuristics. The system development stage was completed by reflecting the evaluations of experts in revising the app.

    Accuracy of the Knowledge Base

    The degree of consistency between recommendations provided by experts and by the HMA was evaluated based on a previous study [7]. This evaluation was performed by 3 nurses, holding doctor of philosophy degrees (PhDs) in adult health nursing, and who have a special interest in chronic diseases. The accuracy of the knowledge base was evaluated using the process depicted in Figure 2.

    Seven scenarios were created to ensure that all possible judgments in decision-making nodes appeared at least once. Knowledge extracted from the CPG was documented as reference rules and provided to experts. Scenarios were presented to the evaluators, who were then asked to write recommendations in a free-text format. The same data were entered into the system, and the recommendations produced by the system were compared with those of the clinical experts and checked for inconsistencies. If inconsistencies between the recommendations or their details were found, the opinions of the experts were used to improve the system.

    ‎
    Figure 2. Process used to evaluate the accuracy of the knowledge base.
    View this figure
    Mobile Heuristics Evaluation

    The expert evaluations of the usability of the HMA were performed by applying mobile heuristics evaluation. In accordance with Nielsen’s recommendation to involve 3-5 experts [8], 5 evaluators took part in the mobile heuristics evaluation. The evaluators were experts with at least a PhD in nursing informatics and medical informatics, and with prior experience in medical system development. The mobile heuristics was evaluated using the 8 principles of mobile heuristics [9], which is a modification of the 10 principles of heuristics evaluation [8] modified appropriately for assessing mobile software. Each evaluation item was scored on a severity ranking scale to diagnose the number and distribution of flaws in the software and the opinions of the evaluators. The Korean version of the tool was used for this study [10]. The eight principles of mobile heuristics evaluation were introduced to the evaluators, who were provided with Android-based mobile phones that included the HMA. After using the HMA, the experts were asked to freely comment on any issues about usability pertaining to items on the heuristics, and evaluate the severity of each problem on a scale from 0 to 4. Items were indicated as faulty if 2 or more people scored them as 1 point or higher on the severity ranking scale. Any items that received 4 points were considered to have major usability problems and required revision. The system was revised for these items.

    Deployment of the HMA

    Subjects

    The minimum number of subjects for this study was found to be 38 based on the requisite for a t test with an effect size of 0.55, alpha of .05, and a power level of .95, as proposed in a previous study [11]. All calculations were performed using the software G*Power. Patients with hypertension visiting cardiovascular clinics at tertiary hospitals in Seoul, South Korea who were taking 1 or more antihypertensive drug(s) were recruited in person. Those who possessed a mobile phone, were able to use a mobile app without outside help, understood the purpose of this study, and volunteered their participation were chosen as subjects.

    Procedure

    The study participants were briefed on its purpose and their initial medication adherence was examined in person. The researcher installed the HMA on the participant's mobile phone, and then taught the participant how to use it. The study participants were then asked to use the HMA for 4 weeks. The perceived usefulness, user satisfaction, and final medication adherence were then examined via a phone call or in a face-to-face interview. The participants kept following their treatment plans as advised by health care providers during the study period.

    Measurement Scales
    Perceived Usefulness

    The perceived usefulness of the HMA was evaluated using 6 questions pertaining to perceived usefulness from Davis’ perceived usefulness and perceived ease-of-use measurement scales [12]. Cronbach alpha for the 6 perceived usefulness items was .98. There were significant correlations of .63 and .85 between perceived usefulness and self- reported current usage and self-predicted future usage, respectively [12]. The Korean version of the tool [13] was used. Perceived usefulness was measured on a scale from 1 (“strongly disagree”) to 5 (“strongly agree”). The final score for usefulness was defined as the mean of the scores for all of the questions.

    User Satisfaction

    User satisfaction was evaluated with respect to using the HMA for blood pressure recording, medication recording, data sending, alerting, recommending, and educating about medication, on a scale from 1 (“very dissatisfied”) to 5 (“very satisfied”). Cronbach alpha for the 6 user satisfaction items in this study was .78. The score for each question was defined as the user satisfaction for the relevant function.

    Medication Adherence

    Medication adherence was measured using the Modified Morisky Scale (MMS) [14]. MMS has two factors: motivation subscale items (factor 1), and knowledge subscale items (factor 2). Cronbach alphas for the two factors were .722 and .691, respectively, in a previous study [15]. The scale is composed of 6 questions using a yes-or-no survey, with 0 or 1 point assigned to each choice. The final MMS score was the sum of the answers to these 6 questions.

    Statistical Analysis

    The obtained data was analyzed using Microsoft Excel and SPSS. Subjects’ demographics and hypertension characteristics were analyzed using real numbers, percentages, means, and standard deviations, while the perceived usefulness, user satisfaction, and MMS scores were analyzed using means and standard deviations. The one-group pre- and posttest MMS scores for medication adherence were measured via a non-parametric Wilcoxon signed-rank test.

    Ethics and Informed Consent

    This study was approved by Samsung Medical Center Institutional Review Board (IRB No. 2014-03-130-005), where the participants were recruited. The informed consents contained the purpose, procedure, and measurement scales of this study. They were obtained at cardiovascular clinics of Samsung Medical Center in Seoul, South Korea, by paper. For safety and security reasons, personal identifiers were encoded and collected data were kept in a secured storage location to restrict access.


    Development of the HMA

    Phase I: Planning
    Selection of CPGs

    The hypertension CPGs were selected by searching well-known CPG search websites such as the National Guideline Clearinghouse [16], the Guidelines International Network[17], and the National Institute for Health and Care Excellence [18], using the following keywords: “hypertension management,” “hypertension,” “hypertension treatment,” and “high blood pressure.” Consulting with an expert group majoring in nursing informatics and considering the publisher’s credibility, year of publication, and inclusion criteria, 5 CPGs were selected (Table 1).

    Extraction of Hypertension Management Interventions

    Of the 5 CPGs, 4 (80%) included a hypertension diagnosis by the physicians and principles of anti-hypertensive drug prescriptions. These were omitted from the present study because they were not under the purview of the HMA. What interventions the HMA could provide in terms of nursing and self-management were used to extract intervention categories and items for hypertension management (Table 2) and the target systolic blood pressure for hypertension treatment (Table 3).

    Table 1. CPGs selected for the HMA.
    CPGPublisherCountryDateReference
    2014 Evidence-based guideline for the management of high blood pressure in adultsAmerican Medical Association, The Eighth Joint National CommitteeUnited States2014[1]
    2013 Hypertension guideline of the Korea Society of HypertensionThe Korea Society of HypertensionRepublic of Korea2013[19]
    European Society of Hypertension (ESH) and European Society of Cardiology (ESC) guidelines for the management of arterial hypertensionEuropean Society of Hypertension and European Society of CardiologyMembers of the European Union2013[20]
    The clinical management of primary hypertension in adultsNational Institute for Health and Care Excellence (former National Institute for Health and Clinical Excellence)United Kingdom2011[21]
    Nursing management of hypertensionRegistered Nurses’ Association of OntarioCanada2005[22]
    Table 2. Intervention categories and targets [20,22].
    CategoryTarget
    Lifestyle intervention


    		DietSodium intake of 65-100 mmol/day

    		Body weightBody mass index(BMI) <25 kg/m2


    		Waist circumference <102 cm (men)


    		Waist circumference <88 cm (women)

    		ExerciseDynamic exercise (more than moderate effort) for
    >30–60 min 4-7 times/week

    		AlcoholMaximum of 2 standard drinks/day or 14 standard drinks/week (men)


    		Maximum of 1 standard drink/day or 9 standard drinks/week (women)

    		SmokingSmoking cessation

    		StressSusceptibility scale score <30a
    Medications
    		Obtaining users’ medication history


    		Providing education about medications that are prescribed for users
    Monitoring and follow-up
    		Receiving appropriate follow-up
    Documentation
    		Documenting and sharing information with the user and health care team

    aTo learn how to cope with stress effectively.

    Table 3. Target systolic blood pressure [1].
    Characteristics of the patientTarget systolic blood pressure
    Age <60 years140 mmHg
    Age ≥60 years with underlying diseasea140 mmHg
    Age ≥60 years without underlying disease150 mmHg

    aDiabetes mellitus and/or chronic renal disease.

    Phase II: Analysis
    Data Domain

    A total of 41 data items were extracted for hypertension management in the planning phase. The extracted data were categorized into two groups: input data and calculated data. Data dictionaries of each data item were developed by specifying the type, values, and unit.

    To facilitate obtaining data on sodium intake and stress level from the users, 2 questionnaires that were not part of the CPGs were used as replacements for the criteria listed in Table 2. For sodium intake, a diet behavior questionnaire [23], with 12 items, was developed in order to classify groups with high and low sodium intakes. Whereas for stress level, the Brief Encounter Psychosocial Instrument, Korean version (BEPSI-K) scale [24], containing 5 items, was used.

    Process Domain

    For the process domain, rules were extracted from the CPG to provide tailored recommendations for each participant. For setting the targets for each hypertension management item according to the participant's demographic data, 8 rules were extracted (Table 4), and 20 rules were extracted for tailored recommendations based on preset target and input data.

    Hypertension Management Ontology and Tailored Recommendation List

    To allow the hypertension management flow of the HMA to be visualized by linking concepts with the nursing process, an ontology for hypertension management (Figure 3) was developed based on a previous study [25]. The ontology is made up of three levels where concepts of the analytical level are linked to the nursing-process-categories level according to their roles in the HMA. Nursing process categories are linked to data, judgment, and action concepts, which constitute the hypertension management concept of the HMA.

    A tailored recommendations list was developed based on CPG knowledge by combining data extracted from the data domain and rules extracted from the process domain. This process produced 17 tailored recommendations including one maintenance recommendation and one modification recommendation each for the 7 target items of blood pressure, sodium intake, exercise, alcohol, smoking, body weight, and waist circumference, as well as 3 recommendations for low, moderate, and high stress levels. In addition, optional detailed recommendations were made for subgroups of each recommendation when necessary. Each tailored recommendation comprises the following 3 parts: (1) informing the target of the item, (2) providing the evaluation result, and (3) providing the recommendation. The evaluation-result sentence provides the result of input data analysis, and the recommendation sentence provides evidence and recommendations from the clinical guidelines.

    ‎
    Figure 3. Hypertension management ontology of the HMA.
    View this figure
    Interface Domain

    Forming an expert group and extracting the functions necessary for the HMA yielded 9 functions, which are presented in a use-case diagram (Figure 4) and are described in Textbox 1.

    The use-case diagram shows the actors, use cases, and their relationship in the HMA. The 3 actors outside of the system are the system database, the knowledge database, and user. The system contains 9 use cases that are connected to actors according to their interactions.

    Description of HMA function.
    1. Visit: visit from the system
    2. Register: register the user to the system
    3. Input data: input user’s initial, medication, blood pressure, and lifestyle data
    4. View data: view patient’s saved data as a chart, calendar, and graph
    5. Send data: send patient’s saved data via e-mail
    6. Set alert: set an alert for a medication time or hospital visit date
    7. Alert: alert about a medication time or hospital visit date
    8. Recommend: give user targets and recommendations
    9. Educate: provide education about the medication
    Textbox 1. Description of HMA function.
    ‎
    Figure 4. Use-case diagram of the HMA.
    View this figure
    Table 4. Rules of setting targets of the HMA [20,22].
    Target categoryRules for set targets
    Blood pressureIf ≥60 years with no underlying disease, then systolic BP <150 mmHg

    		Else systolic BP <140 mmHg
    Sodium intakeDiet behavior score <5
    Body weightBody weight (kg) <25 × height2 (m2)
    AlcoholIf male and weight ≥60 kg, then alcohol intake ≤2 glasses/day and ≤14 glasses/week

    		Else alcohol intake ≤1 glasses/day and ≤9 glasses/week
    Smoking<1 cigarette/day
    StressBrief Encounter Psychosocial Instrument, Korean version score ≤1.6
    Waist circumferenceIf male, then waist circumference <102 cm

    		Else waist circumference <88 cm
    ExerciseExercise frequency >4 times/week, exercise duration >60 min, exercise intensity >moderate effort
    Phase III: Design
    Data Domain

    The data structure is documented in an entity-relation diagram (Figure 5). Separate tables were prepared for the data and knowledge domains, and the data domain tables were further divided according to the change cycle of data values.

    ‎
    Figure 5. Entity-relation diagram of the HMA.
    View this figure
    Process Domain

    By linking the 8 rules for setting the target and the 20 rules for tailored recommendations, 8 algorithms were developed. The algorithms were used to set targets for each intervention item and provide tailored recommendations based on the target and input data. As an example, the algorithm for evaluating the waist circumference is shown in Figure 6. When a user inputs his/her waist circumference, depending on the user’s sex and target waist-circumference evaluation (T7 or T8), the evaluation result (E19 or E20) and recommendation (R19 or R20) will be presented to the user.

    In the case of a female user whose waist circumference is 92 cm, a recommendation composed of T8 (“Your target waist circumference is 88 cm”), E20 (“Your waist circumference is 92 cm, 4 cm over the target”), and R20 (“For a hypertension patient, maintaining the proper waist circumference is necessary to lower blood pressure. Reduce your waist circumference to 88 cm”) will be received.

    ‎
    Figure 6. Algorithm for waist-circumference evaluation.
    View this figure
    Interface Domain

    The user interface screens were designed around a menu containing essential functions extracted in the analysis phase. In total, 34 user interface screens were designed.

    Phase IV: Implementation
    System Environment

    The HMA was developed using the Android SDK Platform 4.4.2 Java Development Kit and Eclipse. The database management program was developed using MYSQL. The system works on mobile phones running the Android operating system versions 2.3 to 4.4.

    System UI Implementation

    The HMA developed in this study was implemented with 5 basic menus at its core (Textbox 2).

    The five basic menus of the HMA.
    1. My records, which shows the most recent blood pressure and hypertension medication usage records in a graph (Figure 7).
    2. Blood pressure management, which can be used to check the target blood pressure, makes input blood pressure measurements, receive tailored blood pressure management recommendations, and review blood pressure records.
    3. Medication management, which can be used to browse for the user’s hypertension medication information, enter the medication schedule to be provided with reminders, record the taking of medication, and review the adherence on a weekly and monthly basis (Figure 7).
    4. Lifestyle management, which provides tailored recommendations in response to the user’s answers to questions regarding the 7-lifestyle management items (ie, sodium intake, body weight, waist circumference, exercise, alcohol, smoking, and stress). This menu displays a pop-up window once a month to alert the patients to input lifestyle data.
    5. Settings, whose basic functions include information management, alert settings, password settings, and data sending via e-mail.
    Textbox 2. The five basic menus of the HMA.
    ‎
    Figure 7. User interfaces of the "my records" (left) and "medication management" (right) menus.
    View this figure
    Phase V: Evaluation
    Knowledge-Base Accuracy Evaluation

    In this evaluation, 2 assistant professors teaching adult health nursing and 1 senior nursing researcher participated. All 3 evaluators had more than 10 years of clinical practice experience. There were no inconsistencies in the broader recommendations produced by the evaluators and the HMA. However, the evaluators proposed the following three additional detailed recommendations: (1) adding the option to input the daily amount of alcohol intake in addition to the existing weekly amount of intake, (2) more specific comments on sodium intake, and (3) adding “get advice from a professional” to stress management. These three recommendations were added to the HMA.

    Mobile Heuristics Evaluation

    The mobile heuristics was evaluated by 5 nursing informatics, medical informatics, and computer programming experts with PhDs. They flagged 33 usability-related problems related to the mobile heuristics items, of which 3 problems that were related to a severity score of 4, and 7 problems that were flagged by more than 2 evaluators were revised after reflecting on the evaluators’ comments.

    Deployment of the HMA

    Demographics of Study Subjects

    Initially 38 study participants were recruited, of which 29 (76%) participated in the medication adherence survey and 19 (50%) participated in the perceived usefulness and user satisfaction surveys. The mean age of the subjects was 56.0 years, with the highest percentage (48%, 14/29) of them being in the age group of 50-59 years. Most (66%, 19/29) of the participants were male, 62% (18/29) were educated to higher than a bachelor’s degree, 62 % (18/29) were employed full-time, 62% (18/29) were religious, 93% (27/29) were married, and 72% (21/29) were living with their spouse and children.

    Hypertension-Related Characteristics of Study Participants

    Hypertension-related characteristics of the study participants are presented in Table 5. A mean of 106.2 months had passed since the participants were diagnosed with hypertension, and 101.2 months since they had started taking hypertension medication. Most of the participants (79%, 23/29) reported taking a hypertension medication, and 90% (26/29) took medication once a day. Of the participants, only 5 (17%, 5/29) experienced side effects of hypertension drugs, 55% (16/29) had a family history of hypertension, and 66% (19/29) had previously received education about hypertension. The two main sources of hypertension information were hospitals (52%, 15/29) followed by the Internet (28%, 8/29).

    Table 5. Hypertension-related characteristics of the study participants (N=29).
    CharacteristicNumber or responsen (%)
    Number of antihypertensive drug taken per day123 (79)

    		22 (7)

    		34 (14)
    Medication frequency per day126 (90)

    		23 (10)
    Number of pills taken per day123 (79)

    		22 (7)

    		34 (14)
    Experience of side effectsYes5 (17)

    		No24 (83)
    Prior education about hypertensionYes19 (66)

    		No10 (34)
    Source of hypertension informationHospital15 (52)

    		Community health center1 (3)

    		TV, radio, newspaper4 (14)

    		Internet8 (28)

    		Book2 (7)

    		Other sources3 (10)

    		Non-response2 (7)
    Survey Results
    Perceived Usefulness

    The overall mean perceived usefulness score was 3.7 out of 5. The items with the highest score (3.9) and lowest score (3.4) were “I would find the HMA useful in my hypertension management” and “Using the HMA in my hypertension management would increase my productivity,” respectively. The mean score for perceived usefulness of each item is listed in Table 6.

    User Satisfaction

    The mean user satisfaction scores for 6 functions were (1) 4.3 for blood pressure recording; (2) 3.8 for medication recording; (3) 3.1 for data sending; (4) 3.2 for alerting; (5) 3.4 for recommending; and (6) 3.8 for educating about medication.

    Medication Adherence

    The mean (SD) MMS scores increased significantly (P=.001) between before and after using the HMA, from 4.2 (1.3) to 5.2 (1.1), respectively.

    Table 6. Perceived usefulness score by item.
    NumberItemMean score
    1Using the HMA in my hypertension management would enable me to accomplish tasks more quickly3.5
    2Using the HMA would improve my hypertension management performance3.8
    3Using the HMA in my hypertension management would increase my productivity3.4
    4Using the HMA would enhance my effectiveness in hypertension management3.8
    5Using the HMA would make it easier to manage my hypertension3.8
    6I would find the HMA useful in my hypertension management3.9

    Development of the HMA

    In the knowledge extraction phase, it was necessary to decide from which CPG, and to what extent knowledge needs to be extracted, in order to form the knowledge base for the HMA. After selecting multiple CPGs, knowledge on hypertension diagnosis and drug therapy required for health care providers to make decisions was excluded. Instead, the following knowledge relevant to a patient’s self-management of hypertension was included: target blood pressure, lifestyle management intervention, and evidence for tailored recommendations.

    The system development stage involved converting the knowledge extracted from the CPG into a computer-interpretable form so that it could be applied to the system. Data and rules were extracted from the text-formatted CPG, then coded so that both the user and the system could understand them. The process of making the CPG knowledge understandable to computers requires cooperation between clinical experts and computer developers [26]. This process would be more efficient if a knowledge modeling tool and system development methodology, specialized for the development of a CPG-based mobile system, are developed.

    The evaluation of the knowledge-base accuracy indicated that the recommendations proposed by the experts were more detailed than those suggested by the HMA. Since the accuracy of the knowledge base was evaluated after the HMA had been developed, coding needed to be performed twice to reflect this change. This extra coding step could be avoided if the expert evaluation of the knowledge base was performed in the algorithm development stage.

    In the mobile heuristics evaluation, diverse expert opinions were sought from evaluators with diverse backgrounds, such as nursing, medical informatics, and computer programming. The various evaluators made different numbers of comments on different heuristics items. Since the capability of each evaluator acts as an important variable in mobile heuristics evaluation [27], including diverse experts from several fields facilitated the identification of usability problems.

    Deployment of the HMA

    The users found the HMA useful. According to Davis [12], there is a positive correlation between system acceptance and perceived usefulness. Although system acceptance was not directly measured in the present study, we assume that users will have a positive attitude toward using an app for measuring hypertension.

    Users rated that they were highly satisfied with the HMA’s blood pressure and medication recording functions. This is in accordance with a previous study on a chronic disease management mobile app [28], which found patients suffering from chronic diseases to be very interested in its recording functions. Recording functions are especially useful for those who need to record and monitor their health information on a chronic basis.

    The education provided about medicine information also received a high score of 3.8 in the user satisfaction survey, which is attributed to the HMA being connected to an external database and provides the latest information on hypertension medicine in real-time, including visual information. The quality of information is an important factor in determining the success of information systems [29]. This is consistent with the present study where users were satisfied with the well-constructed knowledge base because it provided quality information on medicine.

    On the other hand, users showed a lower user satisfaction for the data sending function. The purpose of this function was not only to store, but also to send the users’ records to the users’ health care providers for feedback. However, because the HMA manages the users’ blood pressure records, provides tailored recommendations, and offers analysis of their medications, the users may have not found it necessary to send their records to their health care provider, resulting in a lower score for the data sending function. The HMA was rated as useful but inefficient for hypertension care in the survey of the perceived usefulness. The users were satisfied with the monitoring functions themselves (eg, blood pressure and medication recording), but rated the efficiency aspect of the HMA poorly due to the additional act of recording, since the users previously did not have to do this.

    This study found that the HMA improved medication adherence. However, an attrition bias [30] may have been present since 9 of the 38 participants (24%) dropped out during the 4-week study period. Those who answered the posttest survey may have represented a high-adherence group, and thus not representative of the entire survey cohort. Results that are more accurate are likely to be obtained in a future study that includes both control and experimental groups with similar initial adherence rates.

    Limitations

    Implications of the study findings are limited, as we did not measure the direct effects of the HMA on parameters such as actual medication adherence, lifestyle improvement, and change in blood pressure. A future study should measure the actual medication adherence using digital adherence measuring equipment [31], and evaluate lifestyle improvements and blood pressure changes over the long term. A future app with wireless medical sensors and technologies for better data collection and transmission will allow this future study possible.

    There is the possibility that those with low medication adherence refused to participate in the survey. Thus, it is necessary to explore the reasons for the withdrawals to evaluate selection bias on the medical adherence survey. In addition, it is arguable that the 4-week intervention was too short and the number of participants involved was not sufficient to measure the effectiveness of the HMA. This will certainly introduce bias in the measurements. A future study with a longer intervention period and a larger study cohort is recommended.

    Finally, we did not assess patient engagement and use of the HMA for their hypertension management, which should be taken into consideration in future studies.

    Conclusions

    This study describes the development of a mobile HMA based on CPGs that allows patients with hypertension to conduct appropriate self-management. CPGs were used as the knowledge base of the HMA, and critical functions were constructed to aid 2 factors of hypertension management: lifestyle improvement and drug treatment. The developed HMA was evaluated based on the accuracy of the HMA’s knowledge base and its mobile heuristics, was applied to a cohort of patients with hypertension patients, and evaluated for its perceived usefulness and user satisfaction. The HMA scored 3.7 out of 5 for perceived usefulness, and with respect to user satisfaction, it scored 4.3 for blood pressure recording, 3.8 for medication recording, 3.1 for data sending, 3.2 for alerting, 3.4 for recommending, and 3.8 for educating about medication. The findings also demonstrated that medication adherence increased significantly after using the HMA (P=.001).

    This study is significant not only in that it developed a mobile app for hypertension management based on CPGs, but also evaluated the developed system and its effects on patients with hypertension over a 4-week period. Further studies are necessary to determine the direct effects of the HMA on patients with respect to actual medication adherence, lifestyle improvement, and change in blood pressure.

    Acknowledgments

    This work was supported by a grant from the National Research Foundation of Korea (NRF) funded by the Korean government (MSIP) (No. 2010-0028631).

    Conflicts of Interest

    None declared.

    1. James PA, Oparil S, Carter BL, Cushman WC, Dennison-Himmelfarb C, Handler J, et al. 2014 evidence-based guideline for the management of high blood pressure in adults: report from the panel members appointed to the Eighth Joint National Committee (JNC 8). JAMA 2014 Feb 5;311(5):507-520. [CrossRef] [Medline]
    2. World Health Organization. World Health Statistics 2014. Geneva, Switzerland: World Health Organization; 2014:1-178.
    3. Torgan C. The mHealth Summit: Local & Global Converge. 2009.   URL: http://caroltorgan.com/mhealth-summit/ [accessed 2015-07-13] [WebCite Cache]
    4. Klasnja P, Pratt W. Healthcare in the pocket: mapping the space of mobile-phone health interventions. J Biomed Inform 2012 Feb;45(1):184-198 [FREE Full text] [CrossRef] [Medline]
    5. Aitken M, Gauntlett C. Patient apps for improved healthcare. From novelty to mainstream. Parsippany, NJ: IMS Institute for Healthcare Informatics; 2013 Oct.   URL: http://www.obroncology.com/imshealth/content/IIHI%20Apps%20report%20231013F_interactive.pdf [accessed 2015-12-17] [WebCite Cache]
    6. Jung B, Kim D, Song J, Hwang C. Development and application of analysis & design methodology for Web-based system. KISS(C): Computing Practices and Letters 2002;8(2):155-166 [FREE Full text]
    7. Martins SB, Lai S, Tu S, Shankar R, Hastings SN, Hoffman BB, et al. Offline testing of the ATHENA Hypertension decision support system knowledge base to improve the accuracy of recommendations. AMIA Annu Symp Proc 2006:539-543 [FREE Full text] [Medline]
    8. Nielsen J. In: Nielsen J, Mack RL, editors. Usability Inspection Methods. New York, NY: John Wiley & Sons; 1994.
    9. Bertini E, Gabrielli S, Kimani S. Appropriating and assessing heuristics for mobile computing. 2006 Presented at: AVI 2006 Advanced Visual Interfaces; May 23-26; Venezia, Italy. [CrossRef]
    10. Jeon E. Development Smartphone Application for Clinical Guideline Based Obesity Management. Seoul; 2013.   URL: http://dlps.nanet.go.kr/SearchDetailView.do?cn=KDMT1201327614&sysid=nhn [accessed 2015-12-17] [WebCite Cache]
    11. Rife KM, Ginty SE, Hohner EM, Stamper HR, Sobota KF, Bright DR. Remember your MEDS: medication education delivers success. Innovations in Pharmacy 2012;3(1) [FREE Full text]
    12. Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly 1989 Sep;13(3):319-340. [CrossRef]
    13. Choi W. A structural study of consumer satisfaction on internet electronic commerce. Seoul, Korea: Korea University; 2001.   URL: http://dlps.nanet.go.kr/SearchDetailView.do?cn=KDMT1200136719&sysid=nhn [accessed 2015-12-17] [WebCite Cache]
    14. Case Management Society of America. Case Management Adherence Guidelines 2.0 Korean. Seoul, Korea: Hyunmoonsa; 2007.
    15. Ljubotina A, Mićović V, Kapović M, Ljubotina M, Popović B, Materljan E. Perception of stress, depression, hypertension and myocardial infarction as predictors of adherence to hypertension drug treatment. Coll Antropol 2014 Dec;38(4). [Medline]
    16. National Guideline Clearing house.: U.S. Department of Health & Human Services   URL: http://www.guideline.gov [accessed 2015-12-17] [WebCite Cache]
    17. Guidelines International Network.   URL: http://www.g-i-n.net/ [accessed 2015-12-17] [WebCite Cache]
    18. NICE National Institute for Health and Care Excellence.   URL: http://www.nice.org.uk/ [accessed 2015-12-17] [WebCite Cache]
    19. The Korean Society of Hypertension. Hypertension Guideline. 2013.   URL: http://14.63.223.46/bbs/content_view?post_num=4&bbs=guideline [accessed 2015-12-17] [WebCite Cache]
    20. European Heart Journal. 2013 ESH/ESC Guidelines for the Management of Arterial Hypertension: The Task Force for the Management of Arterial Hypertension of the European Society of Hypertension (ESH) and of the European Society of Cardiology (ESC)   URL: http://eurheartj.oxfordjournals.org/content/ehj/34/28/2159.full.pdf [WebCite Cache]
    21. Hypertension: the clinical management of primary hypertension in adults. Update of clinical guidelines 18 and 34. London, UK: National Clinical Guideline Centre; 2011 Aug.   URL: http://www.ncbi.nlm.nih.gov/pubmedhealth/PMH0047679/pdf/PubMedHealth_PMH0047679.pdf [WebCite Cache]
    22. Nursing Best Practice Guideline: Shaping the Future of Nursing. Toronto, ON: Heart and Stroke Foundation of Ontario and Registered Nurses’ Association of Ontario; 2005 Oct. Nursing management of hypertension   URL: http://www.spitjudms.ro/_files/protocoale_terapeutice/nursing/607_bpg_hypertension.pdf [accessed 2015-07-14] [WebCite Cache]
    23. Son SM. Pilot Study for Low Salt Consumption Projects for Korean People. Seoul, Korea: Ministry of Health and Welfare; 2009.
    24. Bae JM, Jeong EK, Yoo TW, Huh BY, Kim CH. A quick measurement of stress in outpatient clinic setting. J Korean Acad Fam Med 1992 Oct;13(10):809-820.
    25. Kim H, Park H, Min YH, Jeon E. Development of an obesity management ontology based on the nursing process for the mobile-device domain. J Med Internet Res 2013;15(6):e130 [FREE Full text] [CrossRef] [Medline]
    26. Tu SW, Campbell JR, Glasgow J, Nyman MA, McClure R, McClay J, et al. The SAGE Guideline Model: achievements and overview. J Am Med Inform Assoc 2007;14(5):589-598 [FREE Full text] [CrossRef] [Medline]
    27. Park J, Han S, Park J, Park W, Kim H, Hang S. Comparison of usability evaluation methods for mobile application. Journal of Ergonomics Society of Korea 2012 May 16:154-157 [FREE Full text]
    28. Leijdekkers P, Gay V. User adoption of mobile apps for chronic disease management: a case study based on myFitnessCompanion®. In: Impact Analysis of Solutions for Chronic Disease Prevention and Management. Heidelberg, Germany: Springer Berlin Heidelberg; 2012:42-49.
    29. Delone WH, McLean ER. The DeLone and McLean model of information systems success: a ten-year update. Journal of Management Information Systems 2003;19(4):9-30.
    30. Polit DF, Beck CT. Essentials of Nursing Research: Appraising Evidence for Nursing Practice 8th edition. Philadelphia, US: Lippincott Williams & Wilkins; 2013.
    31. Kim B. Development of a smart pillbox and improvement of the medication adherence for the efficient management of medicine administration. The Journal of the Korea Institute of Electronic Communication Sciences 2013 Sep 30;8(9):1391-1397. [CrossRef]

    ‎
    BEPSI-K: Brief Encounter Psychosocial Instrument, Korean version
    BMI: body mass index
    CPG: clinical practice guideline
    HMA: hypertension management app
    MMS: Modified Morisky Scale

    Edited by C Dias; submitted 22.07.15; peer-reviewed by S Tak, O Adebola, K Blondon; comments to author 21.08.15; revised version received 08.09.15; accepted 09.10.15; published 02.02.16

    Copyright

    ©Hannah Kang, Hyeoun-Ae Park. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 02.02.2016.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.