This paper is in the following e-collection/theme issue:

mHealth for Symptom and Disease Monitoring, Chronic Disease Management (1301) mHealth in a Clinical Setting (579) mHealth for Health Administration (136) Clinical Informatics (904) Personal Health Records, Patient-Accessible Electronic Health Records, Patient Portals (538) Clinical Communication, Electronic Consultation and Telehealth (542) Design of Processes and Workflows (86) Digital Health, Telehealth and e-Innovation in Clinical Settings (340)

Published on in Vol 12 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/54642, first published .
Use of Mobile Technologies to Streamline Pretriage Patient Flow in the Emergency Department: Observational Usability Study

Use of Mobile Technologies to Streamline Pretriage Patient Flow in the Emergency Department: Observational Usability Study

Use of Mobile Technologies to Streamline Pretriage Patient Flow in the Emergency Department: Observational Usability Study

Authors of this article:

Panzhang Wang1 Author Orcid Image ;   Lei Yu1 Author Orcid Image ;   Tao Li1 Author Orcid Image ;   Liang Zhou1 Author Orcid Image ;   Xin Ma2 Author Orcid Image
Article Authors Cited by Tweetations (4) Metrics

    Original Paper

    1Department of Medical Informatics, Shanghai Sixth People's Hospital, Shanghai, China

    2Department of Orthopedics, Shanghai Sixth People's Hospital, Shanghai, China

    *these authors contributed equally

    Corresponding Author:

    Xin Ma, MD, PhD

    Department of Orthopedics

    Shanghai Sixth People's Hospital

    600 Yishan Rd

    Shanghai, 200233

    China

    Phone: 86 38297230

    Fax:86 38297230

    Email: maxinsix@sina.com


    Background: In emergency departments (EDs), triage nurses are under tremendous daily pressure to rapidly assess the acuity level of patients and log the collected information into computers. With self-service technologies, patients could complete data entry on their own, allowing nurses to focus on higher-order tasks. Kiosks are a popular working example of such self-service technologies; however, placing a sufficient number of unwieldy and fixed machines demands a spatial change in the greeting area and affects pretriage flow. Mobile technologies could offer a solution to these issues.

    Objective: The aim of this study was to investigate the use of mobile technologies to improve pretriage flow in EDs.

    Methods: The proposed stack of mobile technologies includes patient-carried smartphones and QR technology. The web address of the self-registration app is encoded into a QR code, which was posted directly outside the walk-in entrance to be seen by every ambulatory arrival. Registration is initiated immediately after patients or their proxies scan the code using their smartphones. Patients could complete data entry at any site on the way to the triage area. Upon completion, the result is saved locally on smartphones. At the triage area, the result is automatically decoded by a portable code reader and then loaded into the triage computer. This system was implemented in three busy metropolitan EDs in Shanghai, China. Both kiosks and smartphones were evaluated randomly while being used to direct pretriage patient flow. Data were collected during a 20-day period in each center. Timeliness and usability of medical students simulating ED arrivals were assessed with the After-Scenario Questionnaire. Usability was assessed by triage nurses with the Net Promoter Score (NPS). Observations made during system implementation were subject to qualitative thematic analysis.

    Results: Overall, 5928 of 8575 patients performed self-registration on kiosks, and 7330 of 8532 patients checked in on their smartphones. Referring effort was significantly reduced (43.7% vs 8.8%; P<.001) and mean pretriage waiting times were significantly reduced (4.4, SD 1.7 vs 2.9, SD 1.0 minutes; P<.001) with the use of smartphones compared to kiosks. There was a significant difference in mean usability scores for “ease of task completion” (4.4, SD 1.5 vs 6.7, SD 0.7; P<.001), “satisfaction with completion time” (4.5, SD 1.4 vs 6.8, SD 0.6; P<.001), and “satisfaction with support” (4.9, SD 1.9 vs 6.6, SD 1.2; P<.001). Triage nurses provided a higher NPS after implementation of mobile self-registration compared to the use of kiosks (13.3% vs 93.3%; P<.001). A modified queueing model was identified and qualitative findings were grouped by sequential steps.

    Conclusions: This study suggests patient-carried smartphones as a useful tool for ED self-registration. With increased usability and a tailored queueing model, the proposed system is expected to minimize pretriage waiting for patients in the ED.

    JMIR Mhealth Uhealth 2024;12:e54642

    doi:10.2196/54642

    Keywords

    overcrowding; overcrowded; crowding; smartphone; queueing; pretriage; self-service; triage; emergency; urgent; ambulatory; mHealth; mobile health; workflow; health care management; hospital 


    For outpatients, registration at the hospital is completed online via appointments initiated by the patients themselves. However, for patients arriving at the emergency department (ED), registration is normally completed by triage nurses who communicate with patients and then interact with computers for data entry. Such nurse-led registration often takes time and slows down the triage process [1,2].

    When a patient presenting at the ED is seen, others have to wait [2]. During peak hours, pretriage waiting tends to be prolonged and unpredictable [2-4], representing one of the main factors contributing to ED overcrowding [5,6]. An extended waiting time in the ED has been associated with increased morbidity and mortality rates [7,8].

    Recently, based on the experience in other industries [9], there has been research interest in the use of self-service technologies (SSTs) such as kiosks [10] in the ED setting. For example, Sinha et al [11] demonstrated that the registration process can be easily completed by patients or their proxies using kiosks. However, unlike unmanned retail stores [12], there is no evidence that the use of kiosks can completely replace human-based triage (ie, triage nurses). Without proper control, full self-triage could lead to disparities. For instance, some younger and more computer-literate patients would easily jump ahead of the older, frail, less educated, and less computer-facile patients.

    Using ED kiosks requires patients, nurses, and machines to work together. For example, self-awareness and path-finding are required for new arrivals. Otherwise, a referring service is required from triage staff [13], which directs the patient flow to a specific location to complete self-registration. Kiosks could break down at any time, which interrupts the work of the triage staff to handle technical failures [13]. In addition, triage staff need to monitor the kiosk area because long lines at the kiosk could delay patient identification [13].

    The coworking context has an impact on the overall triage efficiency, and kiosks work well in offline EDs, but there are still some barriers to overcome for their use as an effective SST. Outside the ED setting, more and more online medical encounters are based on mobile SSTs (ie, smartphones) via social apps [14-18]. For example, smartphones could improve data quality by reducing registration errors [19]. In China, WeChat is the most popular social app, which has more than 1000 million monthly active users [20]. WeChat is not only a popular app but can also serve as a platform to host other web-based apps [21,22]. These apps are built into WeChat and do not need a separate installation on patient smartphones. The apps can even be opened directly when the owner scans an eligible QR code. Beyond medical encounters, a mobile SST is also widely used in the context of mobile payment [23,24]. During COVID-19, the Chinese government used QR technologies to engage its citizens to fight the pandemic [25,26].

    For security reasons, patient smartphones cannot be connected to ED triage servers, which limits the exploration of mobile SSTs in EDs. In a previous study, we used a tailored security architecture to send patient-reported data from patients’ smartphones to hospital networks via an offline QR code reader [27]. Subsequently, Song et al [28] used a similar approach to transfer medical data to hospital information systems. In this study, we expanded on this work to explore a self-registration tool based on the stack of QR technologies and WeChat. To measure the impact on pretriage patient flow, we compared the use of mobile self-registration with the use of kiosks in a real-world setting. Our goal was to investigate the use of mobile technologies to improve pretriage flow in EDs.


    Rationale

    In March 2020, kiosks were introduced at a busy metropolitan ED in Shanghai with an annual census of 306,000 patients. In the crowded greeting area, the ED set up four kiosks to direct nonambulance arrivals for self-registration. With increasing uptake, lines to access the kiosk were frequently observed, prompting development of an alternative method.

    Coworking Flow

    This study was inspired by the concept of industry 5.0 [29]. With the increasing use of SSTs, the roles of nurses, patients, and machines were redefined in a coworking context (Figure 1A). Some repeated tasks shifted from nurses to tools and patients. Electronic forms were used to replace paper-based forms. The tool guides patients to complete some paperwork that was previously conducted by triage staff.

    A patient needs to travel from the front end to the back end of the system, whether via kiosks (Figure 1B) or via smartphones (Figure 1C). The workflow was broken down into five different steps (Table 1). For kiosks, patients swipe their health cards on the front end for registration and present a paper document with a barcode to a triage nurse. After scanning the code with a hand-held device, the nurse quickly finds the record and then updates it with an acuity level based on the “quick-lookup” result [30-32].

    For smartphone users, WeChat is used to scan a QR code at the front end. After filling out the form, the result is encoded into a QR code on patient smartphones using a structured format (Figure 1C). Patients show the digital proof to a triage nurse at the back end. The nurse scans the QR code and automatically creates a record after extracting the structured content. The nurse then uses the “quick-lookup” tool to assign an acuity level for patient triage.

    ‎
    Figure 1. Coworking context for self-registration at the emergency department. (A) The roles in the coworking context. (B) The kiosk-led pretriage flow. (C) The smartphone-led pretriage flow.
    Table 1. Comparison of the workflow in self-registration at the emergency department using a kiosk and a smartphone.
    StepKioskSmartphone
    ReachWith or without a referral, a patient walks a certain distance to the kiosk area and finds an available machine for registrationWith or without a referral, a patient scans a QR code posted along the route using WeChat. A web-based registration page is then displayed and they need to find a site nearby for registration
    InitiateA patient navigates to the homepage to find the launching icon and swipes a card for log-in or manually inputs the information when the card is not on hand or card-swiping failsThe patient enters the associated phone number to start
    InputOn the public touchscreenOn the patient’s smartphone
    PrintThe result is printed into a paper documentThe result is printed into a QR code on the smartphone
    SubmitThe patient brings the printed paper result to the registration desk. The triage nurse uses a personal digital assistant equipped with a scanner to read the barcode.The patient brings the smartphone to the registration desk. The triage nurse uses a personal digital assistant equipped with a scanner to read the QR code. A short confirmation message is sent to the patient via their registered contact number

    Self-Registration Content

    For registration, patients have to enter some personal information and the presenting reason for the ED visit (Table 2). With autocomplete-based suggestions for presenting problems [19], the system helps patients enter their chief complaints more efficiently and accurately. For kiosks, swiping a card is useful for saving time by avoiding having to input repeated data. However, when the card is not on hand, for security reasons, the patient has to enter all of the information manually. For kiosk users, the contact number is optional, thereby relying on triage nurses for patient validation. For smartphone users, the contact number is mandatory. When the content is scanned into the ED system by the triage staff, a confirmation message is sent to the patient according to the contact number. For experimental purposes, patients were required to fill out a field to indicate whether self-registration followed a referring service from clinical staff.

    Technically, it is possible to use self-triage algorithms to assign an acuity level for a given patient condition [10]. However, this might lead to queue-jumping when the evaluation process is controlled by the patients themselves. In this study, the system was set up so that the evaluation result was not immediately available to patients after self-registration, but rather appeared as a suggestion to the triage staff on the hand-held screen. The triage nurse had the right to modify the result after human-based evaluation. The whole process was designed to mitigate paperwork burdens for triage staff.

    Table 2. Content of the registration form.
    Element codeElement description
    PhoneContact telephone number
    NamePatient name
    SexPatient sex
    AgePatient age
    RacePatient race
    ComplaintsA list of standardized codes for chief complaints, separated by commas
    ReasonPatient narrative text to explain the reason for presenting to the emergency department
    ReferredUsing the self-registration tool after being referred by an assistant

    Security Architecture

    For kiosks, the platform and the collected data were completely hosted in the hospital private network. Attacks from the internet were handled by the hospital firewall.

    For smartphones, the front-end registration page was completely disconnected from the back end. Technically, this was designed as a static webpage hosted by the WeChat platform, which rendered a web form to allow patients to complete the registration online. However, the platform handled data submission in a different manner. Instead of transmitting the collected data over the internet, the data were saved to the local storage on the patient’s smartphone, being displayed as a QR result. The QR result could then be read via the scanner held by the triage nurse. Thus, the data flow was executed from online to offline in a smart and secure manner. Since no third-party servers are involved, data security and privacy can be well protected. Hosting the static webpage on a mature platform with WeChat had benefits for both availability and scalability.

    Multilingual Support

    As a public machine, it is difficult for a kiosk to determine the language preference of an upcoming user. Therefore, a button for language switching was installed on the public screen. By contrast, for smartphone users, the system can automatically detect the language preference based on the location setting.

    Signage

    Based on best practice [13,33], the kiosk area was placed inside the ED (Figure 2A), visible from the registration desk. Roadmaps were provided. For smartphones, the signage was printed out as QR symbols, which were posted in four different places, inside and outside the entrance (Figure 2B). The size of the signage was appropriately determined so that it could be easily scanned within a distance (Figure 2D). These QR codes encoded a link to the self-service app.

    ‎
    Figure 2. Signage and queueing. (A) Signage and patient flow in the kiosk group. (B) Signage and patient flow in the smartphone group. (C) Queues in the kiosk group. (D) Queues in the smartphone group.

    Study Design

    The evaluation was performed during peak hours from 5 PM to 9 PM in three EDs. In each center, an assistant was recruited to work near the entrance to make sure patients traveled to the service quickly by offering a referral service. Patients were told they could bypass self-registration and go directly to the registration desk. Both patients and their proxies were allowed to use the self-registration tools. Data were collected during a 20-day period in each center. Random days were chosen for the use of kiosks and smartphones. At a given time, only one digital tool was evaluated to direct the patient flow. For example, when kiosks were evaluated, the signs with QR codes were removed from the entrance.

    In each center, assistants (N=4) were recruited to work at the self-service area to assist patients for self-registration. All of the assistants had a background in qualitative research, and they were trained on how to handle technical issues related to self-registration that could result in triage interruptions [34]. Their observations were documented at the end of each day. Two authors (TL and LY) with expertise in informatics, human factors, quality and safety, and qualitative research served as coders and reviewers. These authors worked with the assistants for coding. Once coding was complete, thematic analysis [35] was used to group codes. Discrepancies were discussed by both the coders and the assistants and reconciled by consensus prior to final analysis.

    To evaluate timeliness and usability, medical students (N=210) were recruited to simulate ED arrivals. They received no training and were asked to arrive randomly. Upon arrival, the timestamp (Tarrive) was recorded. When they received an acuity result from triage staff, the timestamp, or Tend, was recorded. The interval (Tend–Tarrive) was used to denote pretriage waiting times. For usability evaluation, the After-Scenario Questionnaire (ASQ) [36] was used, which is a standard questionnaire with three questions: “ease of task completion,” “satisfaction with completion time,” and “satisfaction with support.” The ASQ has been validated and is commonly used in studies related to mobile health [37]; this tool is particularly suitable in scenarios where a user might finish a task despite not successfully completing the task. Scale options were set according to a range of 1 to 7, with higher scores representing a higher degree of satisfaction. Two additional assistants were recruited to work in certain posttriage areas to administer paper-based ASQs. An unanswered question was treated in the same manner as a “not applicable” (NA) question. Since the study was designed to evaluate self-services, most participants might complete a session without any help, leaving the question of “satisfaction with support” unanswered. However, since “satisfaction with support” was designed to measure the level of self-service received, these “NA” answers were treated as the highest score in this study. For “ease of task completion” and “satisfaction with completion time,” records with “NA” were treated as invalid feedback.

    During the evaluation, triage nurses (N=30) were recruited to work on a shift in each group and two nurses were assigned to the triage unit on each shift. The Net Promoter Score (NPS) [38] was used to solicit the nurses’ opinions in using the tool to handle patient flow, including questions such as “On a scale from 0 to 10, how likely are you to recommend this tool to ED managers to deal with pretriage patient flow?” Participants scoring 9 or 10 were classified as “promoters,” those providing a rating of 7 or 8 were classified as “passives,” and those providing a rating from 0 to 6 were classified as “detractors.” The final NPS was calculated by subtracting the percentage of detractors from the percentage of promoters (excluding the passives). The result could range between –100% and +100%, and the performance was marked as “good” for scores above 50% [39].

    Statistical Analysis

    Data analysis was performed using SPSS software (version 27.0). The χ2 test was used to analyze proportion data. All analyses were based on a two-sided P value, with P<.05 considered statistically significant.

    Ethical Considerations

    According to regulations of the Shanghai Ethics Committee for Clinical Research [40], the requirement for ethical approval was exempt since the hospital only exports deidentified data for study purposes. Participants were informed about the study orally. Individual and privacy-related data were not used in this study.


    Primary Results

    The recruitment flow of real patients is displayed in Figure 3 and the participant characteristics are summarized in Table 3. Within the study time frame, 5928 of 8575 patients (69.13%) performed self-registration on kiosks and 7330 of 8532 patients (85.91%) checked in on their smartphones, representing a significant difference (P<.001). There was also a statistically significant difference in the percentage of patients referred to kiosks and smartphone self-registration (Table 3).

    Timeliness and usability were evaluated using simulated arrivals (N=210) in each group. Compared to kiosks, pretriage waiting times were significantly reduced in the smartphone group, whereas the smartphone group scored significantly higher in the usability items “ease of task completion,” “satisfaction with completion time,” and “satisfaction with support” (Table 3).

    The NPS was calculated based on feedback obtained from triage nurses (N=30) in each group. According to their scores, there were 14 promoters, 6 passives, and 10 detractors in the kiosk group, whereas there were 28 promoters, 2 passives, and 0 detractors in the smartphone group. The use of smartphones significantly improved the final NPS compared to the use of kiosks (Table 3).

    ‎
    Figure 3. Recruitment flowchart. SST: self-service technology.
    Table 3. Comparison of baseline characteristics across groups.
    CharacteristicsKioskSmartphoneP value
    Real patients

    		Total patients assessed, n85758532—a

    		Self-registrations, n (%)5928 (69.1)7330 (85.9)<.001

    		Age (years), mean (SD)42.1 (21.1)43.1 (20.6).91

    		Male sex, n (%)2727 (46.0)3291 (44.9).20

    		Sessions completed with referring, n (%)2591 (43.7)645 (8.8).001
    Simulated patients

    		Participants, n210210—

    		Age (years), mean (SD)22.5 (3.2)22.6 (2.9).75

    		Male sex, n (%)106 (50.5)101 (48.1).63

    		Pretriage waiting time (minutes), mean (SD)4.4 (1.7)2.9 (1.0).001

    		Ease of task completion, mean (SD)4.4 (1.5)6.7 (0.7).001

    		Satisfaction with completion time, mean (SD)4.5 (1.4)6.8 (0.6).001

    		Satisfaction with support, mean (SD)4.9 (1.9)6.6 (1.2).001
    Triage nurses

    		Participants, n3030—

    		Age (years), mean (SD)36.8 (9.3)36.0 (8.8).73

    		Male sex, n (%)3 (10)4 (13.3).69

    		Promoters, n1428—

    		Passives, n62—

    		Detractors, n100—

    		NPSb, %13.393.3 .001

    aNot applicable.

    bNPS: Net Promoter Score.

    Patient Flow

    While kiosk users competed with each other while waiting in lines (Figure 2C) for check-in, smartphone users encircled (Figure 2D) a posted QR symbol to start using the tool. After scanning, smartphone users quickly dispersed around the ED to use their devices privately; thus, no queues were formed in the smartphone group. As illustrated in Figure 4, there were 4 paths in the kiosk group: (1) patients skipped self-registration and walked directly to triage staff, (2) patients walked to the kiosk area for self-registration, (3) patients left the kiosk area to see triage staff, and (4) patients switched to the self-registration line after arriving at the traditional registration desk. By comparison, there was only 1 path in the smartphone group: all patients followed the same path for self-registration and triage.

    ‎
    Figure 4. Paths in the pretriage flow. (A) Patient flow in the kiosk group. (B) Patient flow in the smartphone group.

    Reach

    Compared to the kiosk area, the posted QR symbols appeared to be easily seen by arrivals and then resulted in followers. Assistant B4 described that “It is good for patients to find and follow, especially posted outside.” By contrast, in relation to kiosks, the assistant indicated that “the roadmap seems not working that well.”

    Although patients waited to be triaged in no particular order, the crowded situation in front of the registration desk could be seen from a distance. In the kiosk area, patients had to wait in order of their arrival, and the lines were also easily seen from the triage area. The two endpoints attracted patients and sometimes resulted in extra traffic of switching. Assistant A2 commented: “It is fine but I have a concern for patient safety when these two lines compete for patients.” This concern was not found in the smartphone group.

    Patient proxies were allowed to perform the actual data entry. However, in the kiosk group, the proxy often stepped into the line for the kiosk with the patient, resulting in a more crowded area. Although this is helpful for conversation-based data entry, it definitely increased the density of the self-service area. Indeed, assistant B2 advocated that “queue discipline is a must for kiosks.” For smartphones, the proxy simply went ahead with scanning the QR code and then returned to the patient in an open area for collaborative data entry. The assistant then concluded, “the queue disappeared and it’s privacy-friendly.”

    A kiosk might break down at any time. When this occurs, the clinical staff should be notified in a timely manner so that an “under repair” sign can be set up. However, this was not often the case in practice; instead, as described by assistant C3, “some patients just switched to another line or simply quit.” In the case of smartphones, most interruptions were related to a low battery or bad signal. A smartphone failure would not cause a delay for other patients.

    Initiate

    Kiosks can be used not only for self-registration but also for other purposes [33], and each case requires its own launching icon on the homepage. Patients faced burdens with respect to page navigation and language switching. For example, the previous session might not end as expected, which would prevent appropriately resetting the screen to the homepage.

    Card swiping was considered to be convenient but was also associated with intermittent failures such as an inability to read the card or swiping on the wrong side. Manual input was provided in case of any failure. However, this required some cognition effort, as described by assistant A1: “some patients spent too much time on trying.” Patients who forgot their cards could also use the manual input option; however, this caused some issues, as described by assistant B3: “some patients blocked the line and stood too much time in front of a kiosk for searching.”

    By comparison, it was more straightforward for smartphone users to get started. After scanning, the page showed up right away without requiring any additional information to be input such as a password.

    Input

    During data entry, a kiosk failure was so disruptive that the entire line was impacted. Assistant C2 logged the following: “the entire line was moved to another.” No failures were logged for smartphones in this step.

    Print

    After data entry was complete, the record was materialized as a proof. Namely, kiosks generated a paper document and smartphones used a QR code. With this proof, patients could confirm with the triage nurse that self-registration had been completed. However, patients had to spend some time to tear the paper document carefully from the printer. In some cases, the workflow was paused due to jammed paper, partially torn paper, or the printer being out of paper or ink. These delays were disruptive, as reported by assistant C1: “it really takes time to recover and most patients cannot wait.” By contrast, printing QR codes on smartphones was instant and no failures were reported.

    Submit

    As mentioned above, patients needed to tear off the paper document from the printer before leaving the kiosk area. However, there were some cases in which more than one document was left in the printer. Consequently, some patients took the wrong record for submission, as logged by assistant A3: “Today, a record was marked with a wrong acuity level. It turned out that the patient took a wrong document.” Such an out-of-sequence issue was never found in the smartphone group.

    In the kiosk group, some printouts were occasionally found to be left on the floor. No such data privacy issues were observed in the smartphone group.


    Principal Findings

    ED overcrowding is an unresolved issue worldwide [5,41], which threatens patient safety and public health [42]. Therefore, it is an urgent need to address the long pretriage waiting time, as it is associated with an increased level of morbidity and mortality [7,8]. Patient registration becomes a bottleneck when data entry is completed by triage nurses. With SSTs, triage nurses can focus on higher-order tasks [10,43] and enable rapid assessment [44] in EDs.

    Unlike outpatients, registration is not a prerequisite for ED patients. This study thus contributes to improving ED self-registration in two ways. The first is related to the actual device provider. Instead of using in-house devices for registration, patients can use their own smartphones with advantages of flexibility and scalability. The second contribution is related to improved digital interaction. “Scan-to-process” should be easy for nurses, as this is already a ubiquitous technique in medical settings (eg, barcode-based medication administration) [45]. During COVID-19, QR codes were widely used for contact tracing [46,47]. Therefore, visitors are now familiar with the rule of “scan to enter” before stepping into public buildings. Accordingly, we applied this concept for patients to adapt to the new workflow of ED check-in.

    EDs are space-constrained areas [48] and thus patient flow occurs in an often crowded setting. In addition to the registration desk, the use of a self-registration kiosk introduces another point of convergence. Kiosks cannot be positioned too close together in the case of a sudden increase in arrivals. Theoretically, one flow will start at the ED entrance, pass through to the kiosks, and finally meet up with triage nurses, while the other flow is directly from the entrance to the triage area. In reality, there may be a third path in which patients might return to the kiosk area for registration from the line formed at the registration desk to see a human after balancing out the potential waiting times. Passing through kiosks is helpful for reducing triage burden, but the increased movement within the ED and midway congestion might be detrimental to patient safety [49], especially for patients with potential critical illnesses. Smartphones barely have an impact on the incoming flow. Outside the entrance, scanning takes only a few seconds, and then patients can walk into the ED and complete registration while waiting to be triaged in front of nurses. In this way, experienced nurses could have a better chance of quickly scanning the patients to determine who should be treated first, even if the registration is not complete.

    Although there was not a substantial difference in terms of completion time, using smartphones for self-registration could completely eliminate the prominent waiting issue caused by limited resources in EDs, as it enables an infinite-server queueing model [50]. Thus, serviceability and scalability could be refined from a different lens.

    Usability is a key factor for users’ continuance intention. Some patients who have experienced kiosk malfunctions or delayed help may not use the kiosk area the next time they have to visit the ED. This can explain the low number of participants in the kiosk group. In China, WeChat and QR technologies are frequently used [20]; therefore, patients will be familiar with a QR-based interaction when approaching the ED entrance. Smartphone users also encounter few failures during the process, which might enhance their willingness to continue using the mobile check-in service.

    Indeed, the triage nurses gave the smartphones a higher usability score than the kiosks. There could be several reasons for this difference. First, kiosks generate more interruptions than smartphones, which is supported by the ASQ results and observations. Triage staff have to pause their work to handle any kiosk-related interruptions. Second, the overall observation could have an impact, as arrivals are directed in a flow for self-registration and triage. Third, with respect to the signage, the kiosk area is more challenging as a prerequisite for registration compared to the ED entrance, resulting in high referring effort. Finally, smartphones could cause less delay for patient identification than kiosks.

    Smartphones increase hospitality in the pretriage flow [51]. First, compared to public screens, smartphones honor patient privacy. Second, the use of personal devices ensures hygiene and cleanliness, which are more difficult to maintain when using shared kiosk touchscreens. Third, social distancing is important in the ED, which could pose a challenge when lining up at kiosks to compete for timely identification. Finally, smartphones are more user-friendly in multilingual scenarios.

    Although smartphones have numerous benefits, a computer-literate arrival can still choose to use a kiosk when a smartphone is not at hand. In addition, those who are not comfortable with SSTs can still register at the human-based line. Thus, providing numerous options in EDs can help to improve triage efficiency, especially during peak hours.

    Limitations

    Our study has limitations. First, this study was performed in three metropolitan ED centers in Shanghai; hence, our findings do not represent other disparate geographical areas with different ED volumes. For example, scanning QR codes might not be a common behavior adopted by patients in other countries. Second, due to the limited time frame of observation, some issues might not have been disclosed. Third, the smartphone-based tool was developed for the purpose of this evaluation and more features should be added in the future, such as integrating the tool with mobile sensors and using algorithms to predict triage results for decision-making. The lack of such features may have affected the usability results but could also serve as a basis to measure future enhancements.

    Conclusions

    EDs are overcrowded with long waiting times for registration and triage. Patient registration is managed in a single thread when completed by a triage team. Therefore, using SSTs would ease the burden on triage nurses and allow them to focus on higher-order tasks. Compared to kiosks, smartphones seem to be more convenient and suitable as a pretriage SST. However, it is recommended to offer multiple options of self-registration services in EDs.

    Acknowledgments

    The authors would like to thank the respondents for sharing their experiences and thoughts. This study is funded by Shanghai Sixth People's Hospital under project number DY2019015.

    Data Availability

    The data sets used or analyzed during this study are available from the corresponding author upon reasonable request.

    Authors' Contributions

    XM and PW designed the study. XM had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. LZ performed the evaluation and assembled the data. PW, LY, and TL wrote the manuscript.

    Conflicts of Interest

    None declared.

    1. Bijani M, Rakhshan M, Fararouei M, Torabizadeh C. Development and psychometric assessment of the triage nurses' professional capability questionnaire in the emergency department. BMC Nurs. Sep 01, 2020;19(1):82. [FREE Full text] [CrossRef] [Medline]
    2. Sedgman R, Aldridge E, Miller J, Fleming D, Buntine P. Pre-triage wait times for non-ambulance arrivals in the emergency department: a retrospective video audit. Australas Emerg Care. Jun 2022;25(2):126-131. [CrossRef] [Medline]
    3. Houston C, Sanchez L, Fischer C, Volz K, Wolfe R. Waiting for triage: unmeasured time in patient flow. West J Emerg Med. Jan 01, 2015;16(1):39-42. [FREE Full text] [CrossRef] [Medline]
    4. Yuzeng S, Hui LL. Improving the wait time to triage at the emergency department. BMJ Open Qual. Feb 2020;9(1):e000708. [FREE Full text] [CrossRef] [Medline]
    5. Pearce S, Marr E, Shannon T, Marchand T, Lang E. Overcrowding in emergency departments: an overview of reviews describing global solutions and their outcomes. Intern Emerg Med. Mar 02, 2024;19(2):483-491. [CrossRef] [Medline]
    6. Fekonja Z, Kmetec S, Fekonja U, Mlinar Reljić N, Pajnkihar M, Strnad M. Factors contributing to patient safety during triage process in the emergency department: a systematic review. J Clin Nurs. Sep 2023;32(17-18):5461-5477. [CrossRef] [Medline]
    7. Berg LM, Ehrenberg A, Florin J, Östergren J, Discacciati A, Göransson KE. Associations between crowding and ten-day mortality among patients allocated lower triage acuity levels without need of acute hospital care on departure from the emergency department. Ann Emerg Med. Sep 2019;74(3):345-356. [CrossRef] [Medline]
    8. Pearce S, Marchand T, Shannon T, Ganshorn H, Lang E. Emergency department crowding: an overview of reviews describing measures causes, and harms. Intern Emerg Med. Jun 01, 2023;18(4):1137-1158. [FREE Full text] [CrossRef] [Medline]
    9. Mullangi S, Ibrahim AM, Chopra V. Toward patient-centered hospital design: what can airports teach us? Ann Intern Med. Jul 04, 2017;167(1):48-49. [CrossRef] [Medline]
    10. Joseph MJ, Summerscales M, Yogesan S, Bell A, Genevieve M, Kanagasingam Y. The use of kiosks to improve triage efficiency in the emergency department. NPJ Digit Med. Feb 03, 2023;6(1):19. [CrossRef] [Medline]
    11. Sinha M, Khor K, Amresh A, Drachman D, Frechette A. The use of a kiosk-model bilingual self-triage system in the pediatric emergency department. Pediatr Emerg Care. Jan 2014;30(1):63-68. [CrossRef] [Medline]
    12. Jeon J, Kang S, Lee H, Kim J. A retail object classification method using multiple cameras for vision-based unmanned kiosks. IEEE Sensors J. Nov 15, 2022;22(22):22200-22209. [CrossRef]
    13. Ackerman SL, Tebb K, Stein JC, Frazee BW, Hendey GW, Schmidt LA, et al. Benefit or burden? A sociotechnical analysis of diagnostic computer kiosks in four California hospital emergency departments. Soc Sci Med. Dec 2012;75(12):2378-2385. [CrossRef] [Medline]
    14. Zhao M, Song S, Zhao Y. Health information seeking on social apps among older adults living with chronic conditions. Proc Assoc Inf Sci Technol. Oct 13, 2021;58(1):878-880. [CrossRef]
    15. Zhang J, Wu Q, Wang X, Zhang Y, Helena van Velthoven M. High response rate and low cost of WeChat-based data collection of infant and young child feeding data in rural Qinghai Province, China. J Glob Health. Oct 21, 2022;12:11011. [FREE Full text] [CrossRef] [Medline]
    16. Zhang W, Zhang J, Ma R, Chen H, Huang J, Xu B. Patient expectations and awareness of information regarding adverse reactions in drug labelling in China. Int J Clin Pharm. Feb 20, 2021;43(1):174-180. [CrossRef] [Medline]
    17. Zhang X, Wen D, Liang J, Lei J. How the public uses social media wechat to obtain health information in china: a survey study. BMC Med Inform Decis Mak. Jul 05, 2017;17(Suppl 2):66. [FREE Full text] [CrossRef] [Medline]
    18. Chen X, Zhou X, Li H, Li J, Jiang H. The value of WeChat application in chronic diseases management in China. Comput Methods Programs Biomed. Nov 2020;196:105710. [FREE Full text] [CrossRef] [Medline]
    19. Xie W, Cao X, Dong H, Liu Y. The use of smartphone-based triage to reduce the rate of outpatient error registration: cross-sectional study. JMIR Mhealth Uhealth. Nov 11, 2019;7(11):e15313. [FREE Full text] [CrossRef] [Medline]
    20. Monthly active users of the leading apps in China. Statista. URL: https://www.statista.com/statistics/1032630/china-leading-apps-by-monthly-active-users/ [accessed 2024-05-24]
    21. Cheng A, Ren G, Hong T, Nam K, Koo C. An exploratory analysis of travel-related WeChat Mini Program usage: affordance theory perspective. In: Pesonen J, Neidhardt J, editors. Information and Communication Technologies in Tourism. Cham. Springer; 2018:333-334.
    22. Duan Y, Li X, Guo L, Liang W, Shang B, Lippke S. A WeChat Mini Program-based intervention for physical activity, fruit and vegetable consumption among Chinese cardiovascular patients in home-based rehabilitation: a study protocol. Front Public Health. Mar 22, 2022;10:739100. [FREE Full text] [CrossRef] [Medline]
    23. QR code payment. WeChat. URL: https://pay.weixin.qq.com/wechatpay_h5/pages/product/qrcode.shtml [accessed 2024-05-24]
    24. Yan L, Tan G, Loh X, Hew J, Ooi K. QR code and mobile payment: the disruptive forces in retail. J Retail Consum Serv. Jan 2021;58:102300. [CrossRef]
    25. Lei T, Deng J, Xie Y, Tian Y. Using health QR code to fight against COVID-19: Chinese government's new way of collaborative governance with enterprises. Adv Econ Bus Manag Res. 2020;153(Proceedings of the 2020 International Conference on Management, Economy and Law (ICMEL 2020)):194-198. [CrossRef]
    26. Radhi AA. Use QR code and IoT mobile devices to prevent the spread of an epidemic (COVID-19). Int J Interact Mob Technol. Jun 21, 2022;16(12):127-136. [CrossRef]
    27. Wang P, Li T, Yu L, Zhou L, Yan T. Towards an effective framework for integrating patient-reported outcomes in electronic health records. Digit Health. Jul 13, 2022;8:20552076221112152. [FREE Full text] [CrossRef] [Medline]
    28. Song C, Kakuta Y, Negoro K, Moroi R, Masamune A, Sasaki E, et al. Collection of patient-generated health data with a mobile application and transfer to hospital information system via QR codes. Comput Methods Programs Biomed Update. 2023;3:100099. [CrossRef]
    29. Özdemir V, Hekim N. Birth of Industry 5.0: making sense of big data with artificial intelligence, "The Internet of Things" and next-generation technology policy. Omics. Jan 2018;22(1):65-76. [CrossRef] [Medline]
    30. Betz M, Stempien J, Wilde A, Bryce R. A comparison of a formal triage scoring system and a quick-look triage approach. Eur J Emerg Med. Jun 2016;23(3):185-189. [CrossRef] [Medline]
    31. Abolhassani M, Jacobsen KL. Purification of an acid-stable bovine leukocyte interferon. Vet Immunol Immunopathol. Aug 1991;29(1-2):171-181. [CrossRef] [Medline]
    32. Lin Y, Chen K, Wang J, Lai P. Simple triage and rapid treatment protocol for emergency department mass casualty incident victim triage. Am J Emerg Med. Mar 2022;53:99-103. [CrossRef] [Medline]
    33. Maramba ID, Jones R, Austin D, Edwards K, Meinert E, Chatterjee A. The role of health kiosks: scoping review. JMIR Med Inform. Mar 29, 2022;10(3):e26511. [FREE Full text] [CrossRef] [Medline]
    34. Johnson K, Gillespie G, Vance K. Effects of interruptions on triage process in emergency department: a prospective, observational study. J Nurs Care Qual. 2018;33(4):375-381. [FREE Full text] [CrossRef] [Medline]
    35. Vaismoradi M, Turunen H, Bondas T. Content analysis and thematic analysis: implications for conducting a qualitative descriptive study. Nurs Health Sci. Sep 11, 2013;15(3):398-405. [CrossRef] [Medline]
    36. Lewis JR. Psychometric evaluation of an after-scenario questionnaire for computer usability studies. SIGCHI Bull. Jan 1991;23(1):78-81. [CrossRef]
    37. Hajesmaeel-Gohari S, Khordastan F, Fatehi F, Samzadeh H, Bahaadinbeigy K. The most used questionnaires for evaluating satisfaction, usability, acceptance, and quality outcomes of mobile health. BMC Med Inform Decis Mak. Jan 27, 2022;22(1):22. [FREE Full text] [CrossRef] [Medline]
    38. Reichheld FF. The one number you need to grow. Harv Bus Rev. Dec 2003;81(12):46-54. [Medline]
    39. Hamilton DF, Lane JV, Gaston P, Patton JT, Macdonald DJ, Simpson AHRW, et al. Assessing treatment outcomes using a single question: the net promoter score. Bone Joint J. May 2014;96-B(5):622-628. [FREE Full text] [CrossRef] [Medline]
    40. Ethical regulations. Shanghai Ethics Committee for Clinical Research. URL: http://www.seccr.cn/resource.php [accessed 2024-06-03]
    41. Butun A, Kafdag EE, Gunduz H, Zincir V, Batibay M, Ciftci K, et al. Emergency department overcrowding: causes and solutions. Emerg Crit Care Med. Feb 8, 2023;3(4):171-176. [CrossRef] [Medline]
    42. Kelen G, Wolfe R, D’Onofrio G, Mills A, Diercks D, Stern S. Emergency department crowding: the canary in the health care system. NEJM Catalyst. 2021;2(5):1-4. [CrossRef]
    43. Mahmood A, Wyant DK, Kedia S, Ahn S, Powell MP, Jiang Y, et al. Self-check-in kiosks utilization and their association with wait times in emergency departments in the United States. J Emerg Med. May 2020;58(5):829-840. [CrossRef] [Medline]
    44. Anderson JS, Burke RC, Augusto KD, Beagan BM, Rodrigues-Belong ML, Frazer LS, et al. The effect of a rapid assessment zone on emergency department operations and throughput. Ann Emerg Med. Feb 2020;75(2):236-245. [CrossRef] [Medline]
    45. Grailey K, Hussain R, Wylleman E, Ezzat A, Huf S, Franklin BD. Understanding the facilitators and barriers to barcode medication administration by nursing staff using behavioural science frameworks. A mixed methods study. BMC Nurs. Oct 12, 2023;22(1):378. [FREE Full text] [CrossRef] [Medline]
    46. Nakamoto I, Wang S, Guo Y, Zhuang W. A QR code-based contact tracing framework for sustainable containment of COVID-19: evaluation of an approach to assist the return to normal activity. JMIR Mhealth Uhealth. Sep 07, 2020;8(9):e22321. [FREE Full text] [CrossRef] [Medline]
    47. Chambers T, Anglemyer A, Chen A, Baker M. An evaluation of the COVID-19 self-service digital contact tracing system in New Zealand. Health Policy. Apr 17, 2024;144:105073. [FREE Full text] [CrossRef] [Medline]
    48. Hance K, Lyttle M, Humphreys S. 045 We’re going to need a bigger boat! Evening opening of mothballed outpatient areas to reduce crowding in a children’s emergency department. Emerg Med J. Nov 21, 2019;36(12):805-806. [CrossRef]
    49. Pryce A, Unwin M, Kinsman L, McCann D. Delayed flow is a risk to patient safety: a mixed method analysis of emergency department patient flow. Int Emerg Nurs. Jan 2021;54:100956. [CrossRef] [Medline]
    50. Worthington D, Utley M, Suen D. Infinite-server queueing models of demand in healthcare: a review of applications and ideas for further work. J Operational Res Soc. May 31, 2019;71(8):1145-1160. [CrossRef]
    51. Pillai S, Haldorai K, Seo W, Kim W. COVID-19 and hospitality 5.0: Redefining hospitality operations. Int J Hosp Manag. Apr 30, 2021;94:102869. [FREE Full text] [CrossRef] [Medline]

    ‎
    ASQ: After-Scenario Questionnaire
    ED: emergency department
    NA: not applicable
    NPS: Net Promoter Score
    SST: self-service technology

    Edited by L Buis; submitted 16.11.23; peer-reviewed by E Benjamin, C Eccher; comments to author 15.12.23; revised version received 02.01.24; accepted 22.05.24; published 07.06.24.

    Copyright

    ©Panzhang Wang, Lei Yu, Tao Li, Liang Zhou, Xin Ma. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 07.06.2024.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.