Published on in Vol 3, No 2 (2015): Apr-Jun

Can Standards and Regulations Keep Up With Health Technology?

Can Standards and Regulations Keep Up With Health Technology?

Can Standards and Regulations Keep Up With Health Technology?


1UCL Interaction Centre, University College London, London, United Kingdom

2Future Interaction Technologies Lab, Department of Computer Science, Swansea University, Swansea, Wales, United Kingdom

*all authors contributed equally

Corresponding Author:

Christopher James Vincent, BSc, PhD

UCL Interaction Centre

University College London

Gower Street

London, WC1E 6BT

United Kingdom

Phone: 44 (0)203 108 7057 ext 57057

Fax:44 (0)20 7387 1397


Technology is changing at a rapid rate, opening up new possibilities within the health care domain. Advances such as open source hardware, personal medical devices, and mobile phone apps are creating opportunities for custom-made medical devices and personalized care. However, they also introduce new challenges in balancing the need for regulation (ensuring safety and performance) with the need to innovate flexibly and efficiently. Compared with the emergence of new technologies, health technology design standards and regulations evolve slowly, and therefore, it can be difficult to apply these standards to the latest developments. For example, current regulations may not be suitable for approaches involving open source hardware, an increasingly popular way to create medical devices in the maker community. Medical device standards may not be flexible enough when evaluating the usability of mobile medical devices that can be used in a multitude of different ways, outside of clinical settings. Similarly, while regulatory guidance has been updated to address the proliferation of health-related mobile phone apps, it can be hard to know if and when these regulations apply. In this viewpoint, we present three examples of novel medical technologies to illustrate the types of regulatory issues that arise in the current environment. We also suggest opportunities for support, such as advances in the way we review and monitor medical technologies.

JMIR mHealth uHealth 2015;3(2):e64



In recent years, there has been a rapid, major, and continued advance in scientific discovery and technology proliferation that provides the means to support health care in new ways. For example, the percentage of UK adults who own a mobile phone has risen from 39% to 51% in just 1 year [1]. The proliferation of mobile phones and pervasiveness of health apps [2] allow patients to manage and track their health conditions on the go, which turns mobile phones into a tool for health-related behavior change [3]. This means that care can be provided outside of clinical settings [4,5] and technology can be used to address growing health care demands, such as an increasing prevalence of chronic conditions and aging populations [6].

A growing number of medical and health-related technologies becoming available can be adapted to support personal care, both in terms of customized hardware and software. For example, electronic devices are not only becoming ubiquitous, but are also easier to make; three-dimensional printers are becoming significantly cheaper (the market is predicted to grow by 500% in 5 years [7]). Three-dimensional printers are devices that create three-dimensional objects based on an electronic data source containing a three-dimensional model. As a result, these printers have opened up the possibility to produce custom-made medical devices as needed, where needed [8], which is sometimes referred to as “hyperlocal micro manufacturing” [9]. These types of advances will continue to provide solutions to health care problems that seemed near impossible to solve a decade ago, and they generate their own unique considerations about how these technologies fit into existing regulatory frameworks.

The need for regulation has long been established in the health care domain and has led to manufacturers considering safety during the design and evaluation of medical devices [10] (for a US perspective on ethical standards, see [11]). Medical device manufacturers often use medical device standards (eg, [12]) to guide their design and production processes and to comply with regulatory requirements. For example, the IEC 60601 [13] series puts in place requirements relating to safety and effectiveness, focusing on various aspects of the product (eg, electrical integrity, alarms). The IEC 62366 [14] standard describes a usability engineering process, to satisfy similar requirements, which is linked to a risk analysis standard (ISO 14971 [15]).

Unfortunately, novel and personal medical technologies do not always fit into the process specified in standards because they move away from what is currently and generally accepted as good practice to a situation in which there may be little or no precedent for comparison. Health care technology innovation may be hurt by the current regulatory system [16]. Sometimes standards do not provide sufficient design and evaluation criteria for novel technologies that differ significantly from equivalent predecessors; sometimes regulation may stifle innovation to the point where new technology cannot benefit the health care system (eg, through the time or cost constraints); however, sometimes existing systems may not be applied at all, or they are not applicable when it comes to modern technology.

In this paper, we open a discussion about the challenges to existing regulatory systems posed by novel and personal health care technologies. By presenting three examples that we have encountered as part of our research, we highlight some of the issues. First, we describe an open source infusion pump that raises questions about how to control the quality of custom-made medical devices. Next, we present our research on mobile medical devices that challenges the methods of evaluation set out in current medical usability standards. Finally, we discuss the design of a mobile phone app for medication adherence that may or may not be governed by the existing regulations. Although papers focusing on regulatory challenges have already been published (eg, [17]), we contribute to the discussion by introducing three case studies, outlining the issues with standards and regulations, and proposing ways to address these issues.


The following examples describe the tension between health care innovation and regulation. They come from research conducted as a part of the Computer-Human Interaction for Medical Devices (CHI + MED) project, focusing on developing tools to support safe and usable health technology (medical devices). The following section presents three technologies: open source hardware, mobile health care technologies, and health-related mobile phone apps. It describes the regulatory challenges that may be encountered in the development of these kinds of devices, and identifies opportunities for addressing these issues.

Example 1: Open Source Medical Devices


Open source hardware is an emerging business model where the design files of a product, including the circuit schematics, source code, and physical design, are made publicly available under a license so that anyone can study, modify, distribute, make, and sell the design or hardware based on that design. In recent years, three-dimensional printers have made possible a rapid production of customized medical devices [8], from fitted mechanical limbs [18] and mobile phone-connected microscopes [19] to parts for syringe pumps (as shown in Figure 1). Coupled with an open source approach, more can be achieved with less cost, because production can occur in-house, based on a freely available design.

Building on work of the Michigan Tech Open Sustainability Technology (MOST) group [20], we are demonstrating the process of building an open source syringe pump that implements design principles and interface guidelines published as part of the CHI + MED project. We are creating a complete open platform for further research and development [21]. Design files and software made public by MOST, under an open source license, are at the core of the project. The approach not only leads to economic savings through a reduction in the life-cycle cost [22], but also it allows others to improve on the design, share the improvements with others, and get rapid feedback from the end user. This openness can benefit multiple stakeholders and lead to effective technology and improved patient outcomes (for equivalent arguments relating to open source software, see [23]). It can also allow staff from hospital departments such as medical physics and clinical engineering to repair and customize their own devices, reducing a reliance on external providers.

Figure 1. Three-dimensional printing technology (image credit Gerrit Niezen; image license CC-BY).
View this figure
Regulatory Challenges

The ability to modify someone else’s designs and the ease of rapid and unique production could interfere with formal quality-control processes, implicit in the existing medical device regulation. Although three-dimensional printing is a tool for prototyping and not for long-term use and reuse, it is possible to see how this technology could be used for the latter purpose.

Existing standards may not be practical as the documentation required for review and approval may be disproportionate when the design is limited to a very small number of production units. While the steps that are followed during the development and testing of medical devices are specified and controlled by standards (in the European Union, those listed in [12]), the process followed during the aforementioned activities may be ad hoc. For example, processes specified in medical device standards were created with traditional manufacturing process in mind. At a certain point, a design would be frozen and considered complete. This is not the case when devices can be continuously improved upon by the creator and others. The need for documentation and testing that closely adheres to standards may remove the flexibility that novel approaches bring. Repeated design changes and the requirement for oversight from a review body may be cumbersome on both sides. Although there are many advantages to realizing the benefits of existing process, systems need to be made agile and proportionate.


With an open source approach, there is an opportunity to share the rationale behind the design, the process used to derive the design, as well as the design itself. For example, online documentation tools such as wikis and version control software can be adapted to provide a better overview of the development workflow and process that has been followed. It is also possible to share evaluation results; if a component or design has evolved over time, knowing how and why this has happened could help those at distance understand the constraints of a solution. Through sharing and periodically updating these documents, duplication of effort can be avoided. For example, it does not always make sense for the same component to undergo the same testing by multiple parties. Moreover, documentation can be scrutinized by multiple specialists, without being confounded by the proprietary nature of “closed” solutions. Therefore, rather than requiring the same documentation as that for traditionally manufactured devices, regulation could involve transparent records of all components and changes made to those components, including the rationale and assumptions. This would help to support the quality of such devices without stifling innovation, with the onus being on those implementing a solution to check and review these documents.

Example 2: Mobile Health Care Technologies and Home Use Devices


Given the need to support care outside of clinical settings, technologies are also being developed to provide increasing autonomy and self-care. Our research on CHI + MED investigates how people use technology to manage their health care needs during their day-to-day lives. One such set of technologies includes devices used in the self-management of type 1 diabetes, a complex chronic condition that requires significant personal responsibility over a lifetime [24]. A common form of diabetes technology is the glucose meter that is used to measure blood glucose levels for everyday medication dose calculations, as well as for identifying high and low blood sugar levels, which are dangerous in the long term and potentially fatal in the short term, respectively [25]. Thanks to advances in technology and human factors engineering, glucose meters can be used by people with minimal or no training. They are easier to carry, easier to use, and can store results. This empowers people with diabetes and grants independence [26].

However, our work shows that complexities of everyday life such as people’s work life, romantic life, friendships, hobbies, travel, holidays [27], or whom they are with [28,29] impact on the use of these devices (Figure 2). Understanding these factors is incredibly complex [30], but necessary to ensure glucose meters are reliable and meet users needs. The problem is that the evaluation methods suggested by standards are not adequate in addressing everyday use, as they have been developed with a focus on technology used in clinical environments, where there is more certainty about the characteristics of the work place and levels of training.

Figure 2. Everyday life and a glucose meter (image credit Aisling Ann O'Kane; image license CC-BY).
View this figure
Regulatory Challenges

Mobile health care technologies used for self-management, such as glucose meters used by people with diabetes, are medical devices and are regulated as such. Standard usability engineering process applies, such as IEC 62366 [14], for these cases.

These personal health care devices are used in the context of people’s everyday lives, yet the design and evaluation involves the same usability standards as medical devices found in hospitals. The definition of usability is the same (see [14]). The focus is on the device’s effectiveness, efficiency, ease of learning, and user satisfaction, in what is assumed to be a controlled context. This standardized usability evaluation practice makes it difficult to support the range of individual needs of users outside clinical environments: in their homes, on the go, as a part of their everyday life. This can be seen by accounts of the application of standard usability engineering process [31], such as IEC 62366 [14]. Although such standards are voluntary, and the techniques are illustrative, many companies feel that they have little option but to adhere to their content [32].

Although standards such as IEC 62366 [14] suggest taking context into account using techniques such as task analysis, contextual inquiry, functional analysis, testing in simulated clinical environments, and field testing, how they might be adapted or tailored to represent the unstable context of everyday life is not elaborated on. These methods may not capture the influences that a person’s life might have on the safe use and adoption of these devices, outside the confines of a hospital. Influences could include the emotional aspects of self-care or the social impact of bystanders, when using a device in front of others.

Likewise, it can be unmanageable to scope everyday health care technologies, for the purposes of making assumptions about their use. Pervasive technologies are used by all sorts of people, in all sorts of situations, and in all sorts of contexts. Individual differences are inevitable, and they have been shown to impact users’ experience and challenge the design and development of products [33]. This raises concerns for health care technologies where differences might result in safety risks.

These concerns can be addressed by limiting the scope to a certain user profile or context, but this may not be possible for medical technologies designed for a particular condition, not for a particular user group. Another approach is to configure products based on user needs, for example, allowing customization of the exterior shell [34] and/or allowing configuration of the user interface. This poses a dilemma for evaluation in that as the number of possible configurations increases, the burden associated with management, evaluation, and support also increases [35,36]. On the one hand, allowing for flexibility reduces the chance of nonadoption or noncompliance; on the other hand, complexity in the product adds to the resource required to develop and maintain it.


One option would be to increase emphasis on postmarket assessment, such as monitoring the use of equipment in context (including self-report), alongside conducting research to understand how users are really experiencing this type of equipment. Exploratory qualitative methods have been applied in other domains to focus on the situated use of interactive devices and they are also relevant here.

For instance, diary studies [37] involve users taking note of when, where, how, and why they use their device in their everyday life. They avoid the invasiveness of observation. Autoethnography, a form of self-study, is a quick and easy way to probe the everyday use of mobile medical devices [30]. Even though there has been progress toward using exploratory methods to investigate the context of use [38], standards are lacking in their treatment of situated user experience. Situated user experience relates to the notion that the localized context is an important factor in determining how people will experience and interact with technology. As it has been shown that context influences the use of pervasive health care technologies [30], testing technology away from this context (e.g. in a laboratory) does not anticipate how well the technology will meet the needs of the user. There is therefore an opportunity for standards to support consideration of a broader range of context, given the mobile nature of devices, and use outside of clinical settings. The inclusion of exploratory qualitative methods would allow for this by probing context of use and revealing of individual differences.

Example 3: Health-Related Mobile Phone Apps


Whereas personal medical technologies can provide benefits to those who require specific equipment, dedicated mobile phone apps have potential to be advantageous to almost anyone. People have access to thousands of free health-related mobile phone apps [39,40]. They range from behavior change apps supporting people who want to improve their health and well-being [3], for example, apps supporting smoking cessation (eg, SmokeFree28 [41]), or providing informed choice regarding alcohol intake (eg, Drinks Meter [42]), to apps focusing on specific conditions (eg, pain management [43]). They can be used to prevent forgetfulness (eg, medication reminder apps [44]) and general adherence support apps [45]. As people tend to keep their mobile phones close and hardly ever switch them off, health apps can provide useful functions at any time. They are always at hand to help track the on-going behavior.

Another (currently unreleased) example would be a software app to support oral contraception adherence. We are currently researching how mobile phone apps could be used to reduce unintentional nonadherence. This involves developing a medication reminder app that supports the formation of medication-taking habits and assists users as they search for the best way to embed medication taking into their daily routine; how this could be achieved is described in [44]. One of the major challenges to understanding the approach required to evaluate this type of software is the fact that it is not entirely clear whether an app should be regulated as a medical device.

Regulatory Challenges

During our research we have identified many issues concerning the certification of health-related apps. One example relates to the wording that is used to describe them. Many apps make medical claims and by doing so, could pose a serious public health issue, especially they are if ineffective or inaccurate [40]. Regulation is required and although guidance on health-related software and apps exists [46-49], it may not be clear whether such apps should be covered by regulations. Moreover, when considering the market as a whole, regulations may be bypassed and in some cases, ignored. In the European Union, in some cases, health-related apps fall under the control of the medical devices directive. In this scheme, assuming the software is not an accessory to a device, classification rules can treat medical standalone software as a comparatively low risk [49]:

“The classification rules were not written with software in mind. Due to the restrictive nature of Rules 9-11 of Annex IX to Directive 93/42/EEC, a large number of software devices therefore fall in Class I, where compliance is based on self-declaration, ie, no third party assessment.”

As a result, the product can be self-certified by the organization producing it. This raises concerns about the level of peer review and testing that this type of software receives.

In other cases, software can be used in a medical context, but not for a medical purpose, and not considered to be a medical device. For example, based on similar UK Medicines and Health Care Products Regulatory Agency (MHRA) advice, an app could use an accelerometer or gyroscope to detect falls in epileptic patients and therefore be regulated as a medical device. However, if the same technology is used to measure steps or detect whether an elderly person has got up from a chair or a bed in a social care context, the regulation would not apply [47]. This is important because it impacts on the type of testing that would apply (both in terms of usability and general safety and performance requirements), as well as the approach to monitoring the device in situ.

To help determine whether an app should be treated as a medical device, the MHRA has produced the following list of keywords and phrases that if used in the app’s description indicate that it should be regulated: amplify, analysis, interpret, alarms, calculates, controls, converts, detects, diagnose, measures, and monitors [47]. Take the example of an app that aims to send alerts to users to check whether they have taken their medication and records how many times they say they did not. Based on this information, it can suggest changes to the routine. Therefore, it could be said that the app monitors users and occasionally alarms when their behavior needs to be modified. Does it mean the app should be certified?

If the app is labeled as a tool for supporting medication-taking habits, then the answer is likely to be yes. However, if the wording changes to simply habits, then even though the functionality stays the same, does the answer become no? Such a small change in wording could be enough to avoid device regulations, but it might not even be needed. Some developers simply publish their health apps without worrying about regulations at all, whereas others add liability disclaimers to app descriptions [40]. Based on the US guidance relating to mobile medical applications [46], “Mobile apps that keep track of medications and provide user-configured reminders for improved medication adherence” are an example of “ apps for which FDA intends to exercise enforcement discretion” [46].

Based on both US and UK frameworks, this type of app may or may not be regulated. This problem has been covered in recent UK media reports [50], where there are several examples of gray areas and products that sit on the boundary. In many respects there is not anything new about technologies that sit on the boundary between regulated and unregulated products. The concern is that the assumptions used to determine whether technology is regulated as a medical device may not reflect how the technology is actually used (eg, unregulated apps being used in a context when a regulated app is appropriate).

Of specific concern is the quality of the software code and process used during programming, which may be invisible once the software has been released. Even if there is intent to follow medical device standards, they may be difficult to realize in practice. For example, the medical device usability standard IEC 62366 [14] combines evaluation of safety and usability, which may be in opposition to each other [35]. Other standards may be insufficient when it comes to the testing of software: they may not require exhaustive testing, complete coverage, or proof that a solution is correct by construction [51]. This is evident in the number of software-related defects observed in medical device user interfaces [52].


Because of the intangible nature of apps and the fact that they can be easily updated in situ, assessment and classification at a single point in time may not be feasible or appropriate. Obiodu and Obiodu [40] suggest that one way to deal with the issue of certification might be producing evidence-based guidelines for designing health apps rather than trying to strictly regulate them. We agree with this point, but would see an opportunity to take this further. Rather than just relying on guidelines issued by authorities, patient groups could produce best practice guidelines for specific conditions and, by following the example of open hardware initiatives, publish them openly to encourage collaboration with other patient groups, app developers, and mobile phone manufacturers, who are already starting to release health care kits [53].

For medical technology, standards and regulations are needed to ensure safety, protect the public, and guarantee that products are fit for purpose. However, in the context of novel and personal medical technologies, the current approach to regulation is not only infeasible and difficult to enforce, but also work against health care innovation. Given that it is inevitable that three-dimensional-printed components, mobile devices, and apps will be used to support and deliver health care, as well as have impact on medical practice, regulators may need to rethink their approach.

Based on our work, we have presented the benefits of new technologies and personal medical devices. In many cases, growing pressure on health services makes their introduction inevitable. At the same time, we have outlined some of the regulatory challenges. For example, by allowing for rapid manufacturing of bespoke components, three-dimensional printing raises concerns regarding quality control; the standards underpinning the usability of personal mobile medical devices are not enough to guarantee the “design meets users’ needs” concept; in addition, mobile phone apps may or may not be certified, depending on how a product is described. These challenges open up new possibilities and encourage new ways of thinking.

The health care domain is not the only one feeling the impact of these technologies. The situation resembles the issues with touch-screen tablets being used in the office environment. Although office work and office equipment are regulated (eg, computer workstations), the health and safety regulations are unlikely to apply to tablet computers when it is not possible to easily control how or where they are being used [54]. Rather than trying to regulate them, different, more flexible approaches are needed. For example, by shifting focus away from the introduction of technology, and toward educating users about the implications of using it (eg, raising awareness of human factors), we allow those in different environments to make sure their technology is safe and fits their needs. Although due diligence occurs during the design of technology, continual research and review aims to tailor the properties of equipment with the needs of users and characteristics of the work environment.

The same could apply to novel and personal health care technologies. When it comes to testing for usability, we cannot predict every possible combination of user and usage before the deployment of technology. The alternative is to conduct research into how equipment is really used. We then realize that improvement will occur when a device is in situ, and this will be specific to a given context. As we can rapidly iterate a design, we can continually improve and share the benefit of this improvement. Much of the existing guidance concerning safety and usability needs updating to accommodate this approach. There also needs to be a consideration of how adequate levels of safety can be guaranteed, without making it prohibitive for small organizations to create products with relatively short life cycles. The problem with the existing approach to regulation is that historically, those producing technology would be likely to stay in business for extended periods, compared with the hobbyists and small organizations producing apps, who would rapidly develop and release technology, but then may not be in place to support it in the future. In the past, we had traceability and accountability, whereas in the present we have little recompense if something goes wrong.

We suggest ways of addressing these challenges, such as publishing documentation and making it openly available to review, therefore increasing transparency; adding situated methods to usability standards to cover people's everyday use of personal health technology, and allowing patient groups to review mobile phone apps, draft their own guidelines, and collaborate with each other and with app developers. This would help to ensure that patients’ needs are met. Realizing a code of practice for app developers, such as PAS 277 [55], would help to build confidence. There is also an opportunity to educate those buying and using such technology on requirements relating to safety and usability.

If there is a need to comply with medical device software process standards (eg, IEC 62304 [56]), there have been recent developments in guidance. There are now worked examples of assessment process (ISO 33030 [57]); and support for process tailored to the safety class of the software (IEC/TR 80002-3 [58]). There are groups such as Medi SPICE [59].

This viewpoint represents a series of observations from our own research on the challenges of regulating health technology. We hope to start a discussion about the obstacles and opportunities in addressing the design of novel technologies within regulatory frameworks. Given the need to address the increasing pressures on health services, this discussion is urgently required. Future research could apply a structured methodology to review this context and a case study approach [60], to articulate practical, balanced, and proportionate approaches in line with this discussion.


We would like to thank our reviewers and other members of the team that have helped conduct the research presented in this paper. Our work is a part of the CHI + MED: Multidisciplinary Computer-Human Interaction Research for the Design and Safe Use of Interactive Medical Devices project, supported by the UK Engineering and Physical Sciences Research Council (EP/G059063/1). We would like to thank Professor Harold Thimbleby and Ms Kate Michi Ettinger for their feedback on an earlier version of this work.

Conflicts of Interest

None declared.

  1. Ofcom. Communications Market Report 2013. 2013 Aug 01.   URL: [accessed 2014-09-30] [WebCite Cache]
  2. Roberts M. GPs ‘To Prescribe Health Apps’. London, UK: BBC; 2012 Feb 22.   URL: [accessed 2014-09-30] [WebCite Cache]
  3. Dennison L, Morrison L, Conway G, Yardley L. Opportunities and challenges for smartphone applications in supporting health behavior change: Qualitative study. J Med Internet Res 2013;15(4):e86 [FREE Full text] [CrossRef] [Medline]
  4. UK Department of Health (DoH). Ten Things You Need to Know About Long Term Conditions. London, UK: UK Department of Health (DoH); 2013.   URL: http:/​/webarchive.​​20130107105354/​http:/​/www.​​en/​Healthcare/​Longtermconditions/​tenthingsyouneedtoknow/​index.​htm [accessed 2014-09-30] [WebCite Cache]
  5. RAND. Health and Well-Being in the Home.: RAND; 2010.   URL: [accessed 2014-09-30] [WebCite Cache]
  6. Tunstall-Pedoe H. Preventing Chronic Diseases: A Vital Investment. Geneva, Switzerland: WHO; 2005.   URL: [accessed 2014-09-30] [WebCite Cache]
  7. Clinch M. 3-D Printing Market to Grow 500% in 5 Years. Englewood Cliffs, NJ: CNBC; 2014.   URL: [accessed 2014-10-03] [WebCite Cache]
  8. Schubert C, van Langeveld CM, Donoso LA. Innovations in 3D printing: A 3D overview from optics to organs. Br J Ophthalmol 2014 Feb;98(2):159-161. [CrossRef] [Medline]
  9. Dotz D. Open Science at Tech4Dev.: OKF Open Science Working Group; 2014.   URL: [accessed 2014-10-01] [WebCite Cache]
  10. Vincent C. Mind the Gap: What Interactive Medical Device Manufacturers Need. London, UK: BCS; 2010.   URL: [accessed 2014-10-03] [WebCite Cache]
  11. Coleman C, Menikoff J, Goldner J, Dubler N. Ethics and Regulation of Research on Human Subjects. San Francisco, CA: LexisNexis; 2012.   URL: [accessed 2014-10-01] [WebCite Cache]
  12. European Commission (EC). Summary List of Titles and References Harmonised Standards under Directive 93/42/EEC for Medical Devices. Brussels, Belgium: European Commission; 2014.   URL: http:/​/ec.​​enterprise/​policies/​european-standards/​harmonised-standards/​medical-devices/​index_en.​htm [accessed 2014-10-01] [WebCite Cache]
  13. International Electrotechnical Commission. Medical Electrical Equipment-All Parts IEC 60601. Geneva, Switzerland: International Electrotechnical Commission; 1977.   URL: [accessed 2015-06-02]
  14. International Organization for Standardization. Medical Devices: Application of Usability Engineering to Medical Devices 62366:2007. Geneva, Switzerland: International Organization for Standardization; 2007.   URL: [accessed 2015-05-27] [WebCite Cache]
  15. International Organization for Standardization. Medical Devices: Application of Risk Management to Medical Devices 14971:2007. Geneva, Switzerland: International Organization for Standardization; 2007.   URL: [accessed 2015-06-02]
  16. Longhurst CA, Landa HM. Health information technology and patient safety. BMJ 2012 Feb 20;344:e1096. [CrossRef] [Medline]
  17. Vincent C, Blandford A. Maintaining the Standard: Challenges in Adopting Best Practice When Designing Medical Devices and Systems. Washington, DC: American Medical Informatics Association (AMIA); 2011.   URL: [accessed 2015-05-27] [WebCite Cache]
  18. Robohand. Robohand. Centurion, Gauteng, South Africa: Robohand; 2014.   URL: [accessed 2014-09-30] [WebCite Cache]
  19. Lee WM, Upadhya A, Reece PJ, Phan TG. Fabricating low cost and high performance elastomer lenses using hanging droplets. Biomed Opt Express 2014 May 01;5(5):1626-1635 [FREE Full text] [CrossRef] [Medline]
  20. Wijnen B, Hunt EJ, Anzalone GC, Pearce JM. Open-source syringe pump library. PLoS One 2014;9(9):e107216 [FREE Full text] [CrossRef] [Medline]
  21. Niezen G. Openpump. Wales, UK: Openpump; 2014.   URL: [accessed 2014-10-02] [WebCite Cache]
  22. Wittbrodt B, Glover A, Laureto J, Anzalone G, Oppliger D, Irwin J, et al. Life-cycle economic analysis of distributed manufacturing with open-source 3-D printers. Mechatronics 2013 Sep;23(6):713-726. [CrossRef]
  23. Reynolds CJ, Wyatt JC. Open source, open standards, and health care information systems. J Med Internet Res 2011;13(1):e24 [FREE Full text] [CrossRef] [Medline]
  24. O'Kane AA, Mentis HM, Thereska E. Non-static nature of patient consent over time: Diabetic patients' changing privacy perspectives. In: Proceedings of the 16th ACM Conference on Computer Supported Cooperative Work and Social Computing (ACM CSCW 2013). New York, USA: ACM; 2013 Presented at: ACM CSCW 2013; February 23-27, 2013; San Antonio, Texas, USA p. 553-562   URL: [CrossRef]
  25. Diabetes UK. Type 2 Diabetes: Treatment, Food, Lifestyle: What You Need to Know. London, UK: Diabetes UK; 2013.   URL: [accessed 2014-10-03] [WebCite Cache]
  26. Clarke SF, Foster JR. A history of blood glucose meters and their role in self-monitoring of diabetes mellitus. Br J Biomed Sci 2012;69(2):83-93. [Medline]
  27. O'Kane AA, Rogers Y, Blandford A. Gaining empathy for non-routine mobile device use through autoethnography. In: Proceedings of the 32nd ACM Conference on Human Factors in Computing Systems. New York, USA: ACM; 2014 Presented at: ACM CHI 2014; April 29, 2014; Toronto, ON, Canada p. 987-990   URL: [CrossRef]
  28. O'Kane AA, Rogers Y, Blandford A. Concealing or revealing mobile medical devices? Designing for onstage and offstage presentation. In: Proceedings of the 33rd ACM Conference on Human Factors in Computing Systems. New York, USA: ACM; 2015 Presented at: ACM CHI 2015; April 21, 2015; Seoul, Korea p. 1689-1698   URL: [CrossRef]
  29. Owen T, Buchanan G, Thimbleby H. Understanding user requirements in take-home diabetes management technologies. In: Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers. London, UK: British Computer Society; 2012 Presented at: BCS-HCI 12; Sept 12, 2012; Birmingham, UK p. 268-273.
  30. O'Kane AA. Using a Third-Wave HCI Approach for Researching Mobile Medical Devices. Toronto, ON, Canada: ACM; 2014.   URL: [accessed 2015-05-27] [WebCite Cache]
  31. Zenni TRL, Flores MP, Soares EME. Functional and emotional dimensions: Method to measure through data collection instruments for new products in healthcare. In: 2013 Proceedings of PICMET'13. New York, USA: IEEE; 2013 Presented at: Technology Management in the IT-Driven Services (PICMET); Jul 28-Aug 1, 2013; San Jose, CA p. 2551-2563.
  32. Vincent C, Blandford A. Designing for safety and usability: User-centered techniques in medical device design practice. Santa Monica, CA: Human Factors and Ergonomics Society; 2011 Presented at: Proceedings of the Human Factors and Ergonomics Society Annual Meeting; Sept 19-23, 2011; Las Vegas, NV p. 793-797. [CrossRef]
  33. Law ELC, Roto V, Hassenzahl M, Vermeeren APOS, Kort J. Understanding, scoping and defining user experience: A survey approach. New York, USA: ACM CHI 2009; 2009 Presented at: Proceedings of the 27th Annual ACM Conference on Human Factors in Computing Systems; Apr 4-9, 2009; Boston, MA p. 719-728. [CrossRef]
  34. Cordrey K. ‘Skinit’ Decorative Meter Skins Customize Freestyle Blood Monitors. 2010 Sep 07. 2011   URL: [accessed 2014-09-30] [WebCite Cache]
  35. Vincent CJ, Li Y, Blandford A. Integration of human factors and ergonomics during medical device design and development: It's all about communication. Appl Ergon 2014 May;45(3):413-419. [CrossRef] [Medline]
  36. McCaffery F, O’Connor R, Coleman G. Mapping medical device standards against the CMMI for configuration management. In: Filipe J, Shishkov B, Helfert M, editors. Software and Data Technologies: First International Conference, ICSOFT 2006, Setubal, Portugal, September 11-14, 2006, Revised Selected Papers. Berlin, Germany: Springer; 2008:153-164.
  37. Rieman J. The diary study: A workplace-oriented research tool to guide laboratory efforts. In: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems. New York, USA: ACM; 1993 Presented at: ACM CHI 93; April 24-29, 1993; Amsterdam, The Netherlands p. 321-326.
  38. Sharples S, Martin J, Lang A, Craven M, O’Neill S, Barnett J. Medical device design in context: A model of user–device interaction and consequences. Displays 2012 Oct;33(4-5):221-232. [CrossRef]
  39. Laird S. How Smartphones Are Changing Healthcare. 2012 Sep 26.   URL: [accessed 2014-09-30] [WebCite Cache]
  40. Obiodu V. An empirical review of the top 500 medical apps in a European Android market. J Mob Technol Med 2012 Dec 22;1(4):22-37. [CrossRef]
  41. Ubhi HK, Michie S, Kotz D, Wong WC, West R. A mobile app to aid smoking cessation: Preliminary evaluation of SmokeFree28. J Med Internet Res 2015;17(1):e17 [FREE Full text] [CrossRef] [Medline]
  42. National Institute for Health Research. Drinks Meter. London, UK: National Institute for Health Research; 2015.   URL: [accessed 2015-03-05] [WebCite Cache]
  43. Rosser BA, Eccleston C. Smartphone applications for pain management. J Telemed Telecare 2011;17(6):308-312. [CrossRef] [Medline]
  44. Stawarz K, Cox AL, Blandford A. Don't forget your pill!: Designing effective medication reminder apps that support users' daily routines. In: Proceedings of the 32nd ACM Conference on Human Factors in Computing Systems. New York, USA: ACM; 2014 Presented at: ACM CHI 2014; April 29, 2014; Toronto, Canada p. 2269-2278   URL: [CrossRef]
  45. Dayer L, Heldenbrand S, Anderson P, Gubbins PO, Martin BC. Smartphone medication adherence apps: Potential benefits to patients and providers: Response to Aungst. J Am Pharm Assoc (2003) 2013;53(4):345. [CrossRef] [Medline]
  46. Food and Drug Administration. Mobile Medical Applications. Silver Spring, MD: Food and Drug Administration; 2015.   URL: http:/​/www.​​downloads/​MedicalDevices/​DeviceRegulationandGuidance/​GuidanceDocuments/​UCM263366.​pdf [accessed 2015-03-05] [WebCite Cache]
  47. Medicines and Healthcare Products Regulatory Agency (MHRA). Guidance on Medical Device Stand-Alone Software (Including Apps). London, UK: Medicines and Healthcare Products Regulatory Agency (MHRA); 2014 Aug 08.   URL: [accessed 2014-09-30] [WebCite Cache]
  48. Royal College of Physicians. Appwardly Mobile. London, UK: Royal College of Physicians; 2015.   URL: [accessed 2015-03-06] [WebCite Cache]
  49. Ebenezer N. The Regulation of Standalone Software as a Medical Device. London, UK: Medicines and Healthcare Products Regulatory Agency (MHRA); 2011.   URL: [accessed 2014-10-01] [WebCite Cache]
  50. Graham F. Health Tech: When Does an App Need Regulating?. London, UK: BBC; 2014.   URL: [accessed 2015-03-05] [WebCite Cache]
  51. Praxis High Integrity Systems Ltd. Correct By Construction. Bath, England: Praxis High Integrity Systems Ltd; 2010.   URL: [accessed 2014-10-01] [WebCite Cache]
  52. Masci P, Oladimeji P, Curzon P, Thimbleby H. Using PVSio-web to demonstrate software issues in medical user interfaces. In: Proceedings of the 4th International Symposium on Foundations of Health Information Engineering and Systems. Berlin: Springer-Verlag; 2015 Presented at: FHIES/SEHC 2014; July 17th-18th, 2014; Washington DC   URL:
  53. Forbes. Apple Gives Epic And Mayo Bear Hug With HealthKit. 2014.   URL: [accessed 2014-09-30] [WebCite Cache]
  54. Stawarz K, Benedyk R. Bent necks and twisted wrists: Exploring the impact of touch-screen tablets on the posture of office workers. In: Proceedings of the 27th International BCS Human Computer Interaction Conference.: British Computer Society; 2013 Presented at: BCS HCI 2013; September 9-13, 2013; London, UK   URL:
  55. British Standards Institution. Health and wellness apps: Quality criteria across the life cycle–Code of practice PAS 277. London, UK: British Standards Institution; 2015.   URL: [accessed 2015-05-28] [WebCite Cache]
  56. International Organization for Standardization. Medical Device Software: Software Life Cycle Processes IEC 62304:2006. Geneva, Switzerland: International Organization for Standardization; 2006 May 01.   URL: [accessed 2015-06-02]
  57. International Organization for Standardization. Documented Assessment Process ISO 33030. Geneva, Switzerland: International Organization for Standardization; 2010.   URL: [accessed 2015-06-02]
  58. International Organization for Standardization. Medical Device Software. Part 3: Process Reference Model of Medical Device Software Life Cycle Processes IEC 62304 IEC/TR 80002-3. Geneva, Switzerland: International Organization for Standardization; 2014.   URL: [accessed 2015-06-02]
  59. Medi SPICE. Medi SPICE. 2015.   URL: [accessed 2015-03-05] [WebCite Cache]
  60. Schramm W. Notes on Case Studies of Instructional Media Projects. Stanford, CA: Institute for Communication Research, Stanford University; 1971 Dec.   URL: [accessed 2015-05-27] [WebCite Cache]

CHI+MED: Computer-Human Interaction for Medical Devices
MHRA: Medicines and Health Care Products Regulatory Agency
MOST: Michigan Tech Open Sustainability

Edited by G Eysenbach; submitted 04.10.14; peer-reviewed by R O'Connor, L Dayer; comments to author 22.02.15; revised version received 07.03.15; accepted 23.03.15; published 03.06.15


©Christopher James Vincent, Gerrit Niezen, Aisling Ann O'Kane, Katarzyna Stawarz. Originally published in JMIR Mhealth and Uhealth (, 03.06.2015.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.