Published on in Vol 4, No 2 (2016): Apr-Jun

Theory-Based Design and Development of a Socially Connected, Gamified Mobile App for Men About Breastfeeding (Milk Man)

Theory-Based Design and Development of a Socially Connected, Gamified Mobile App for Men About Breastfeeding (Milk Man)

Theory-Based Design and Development of a Socially Connected, Gamified Mobile App for Men About Breastfeeding (Milk Man)

Original Paper

1School of Public Health, Curtin University, Perth, Australia

2Reach Health Promotion Innovations, Perth, Australia

3Collaboration for Evidence, Research and Impact in Public Health (CERIPH), Curtin University, Perth, Australia

4Telethon Kids Institute, University of Western Australia, Perth, Australia

Corresponding Author:

Jane A Scott, BAppSc, GradDipDiet, MPH, PhD

School of Public Health

Curtin University

GPO Box U1987

Bentley

Perth, 6845

Australia

Phone: 61 8 9266 9050

Fax:61 8 9266 2958

Email: jane.scott@curtin.edu.au


Background: Despite evidence of the benefits of breastfeeding, <15% of Australian babies are exclusively breastfed to the recommended 6 months. The support of the father is one of the most important factors in breastfeeding success, and targeting breastfeeding interventions to the father has been a successful strategy in previous research. Mobile technology offers unique opportunities to engage and reach populations to enhance health literacy and healthy behavior.

Objective: The objective of our study was to use previous research, formative evaluation, and behavior change theory to develop the first evidence-based breastfeeding app targeted at men. We designed the app to provide men with social support and information aiming to increase the support men can offer their breastfeeding partners.

Methods: We used social cognitive theory to design and develop the Milk Man app through stages of formative research, testing, and iteration. We held focus groups with new and expectant fathers (n=18), as well as health professionals (n=16), and used qualitative data to inform the design and development of the app. We tested a prototype with fathers (n=4) via a think-aloud study and the completion of the Mobile Application Rating Scale (MARS).

Results: Fathers and health professionals provided input through the focus groups that informed the app development. The think-aloud walkthroughs identified 6 areas of functionality and usability to be addressed, including the addition of a tutorial, increased size of text and icons, and greater personalization. Testers rated the app highly, and the average MARS score for the app was 4.3 out of 5.

Conclusions: To our knowledge, Milk Man is the first breastfeeding app targeted specifically at men. The development of Milk Man followed a best practice approach, including the involvement of a multidisciplinary team and grounding in behavior change theory. It tested well with end users during development. Milk Man is currently being trialed as part of the Parent Infant Feeding Initiative (ACTRN12614000605695).

JMIR Mhealth Uhealth 2016;4(2):e81

doi:10.2196/mhealth.5652

Keywords



Breastfeeding

Breastfeeding is universally recognized as the optimal way for babies to receive nutrition, and breastfeeding offers many well-documented health benefits for both mother and baby [1-4]. Despite concerted effort in policy, research, and community and hospital practice, breastfeeding rates in Australia at 6 months, and in particular rates of exclusive breastfeeding, remain low [5]. Breastfeeding initiation rates are generally good, with 96% of Australian women initiating breastfeeding. However, rates decline steadily thereafter, with only 15% of babies exclusively breastfed at 5 months [5].

Targeting Fathers

The influence of the father has been identified as one of the most significant factors influencing the breastfeeding behavior of the mother [6-10]. Scott et al reported that a woman’s partner has an important influence on the mother’s decision to initiate and to continue breastfeeding [11]. These findings were reinforced in 2015 with data from the Australian Infant Feeding Survey, which found that multiple factors have an impact on breastfeeding cessation, with the most influential factors being the partner’s views, the use of pacifiers, and maternal obesity [6].

Relatively few father-focused breastfeeding interventions have robustly evaluated breastfeeding outcomes using a randomized controlled trial (RCT) design. However, the Fathers Infant Feeding Initiative (FIFI), conducted by members of our team, trialed a male-facilitated antenatal class for expectant fathers and a follow up social support component consisting of age-relevant information being mailed out to participants [12]. The FIFI RCT reported a significant difference between intervention and control groups in the percentage of babies who received any breastmilk at 6 weeks of age (intervention: 81.6%, control: 75.2%) [12]. The researchers recommended extending the study to 6 months and separating the social support intervention from the male facilitator-led antenatal sessions to measure the relative effect. The study also reported that fathers expressed a preference for Internet, email, and video to be used as a basis for the delivery of information [13].

Mothers have reported that partner support makes a difference to their confidence, as well as helping them to achieve their breastfeeding goals [14,15], and fathers typically indicate they are supportive of breastfeeding and want to be involved [13,14,16,17]. Involving fathers and increasing their support for breastfeeding has been recommended repeatedly in the literature [10,11,16-19]. However, despite fathers generally being supportive of breastfeeding, the literature highlights several factors that can affect the level of support they are equipped to offer. These factors include social support, knowledge, empowerment, and other specific barriers (see Textbox 1 [13,14,16,17,19-29]).

Factors affecting the support fathers offer to their breastfeeding partners.

Social support [13,14,16,20-23]

  • Insufficient social support
  • Frequent exclusion from family support programs
  • Lack of opportunities to learn and share
  • Lack of peer support

Gaps in knowledge [13,14,16,17,19,22,24,25]

  • Expectations about breastfeeding, bonding with baby, and about how life changes after baby arrives
  • Health and other benefits of breastfeeding
  • Practical suggestions to help family
  • Professional services available, for mothers and fathers

Empowerment [14,16,19,20,22,26]

  • Lack of recognition of paternal role
  • Lack of understanding of importance of paternal support for breastfeeding
  • Need for more information and practical advice on how men can better support their family

Barriers [14,16,17,22,23,26-29]

  • Concerns around having to postpone bonding with baby until breastfeeding has finished, or around other ways to bond with baby besides feeding
  • Public breastfeeding
  • Feeling left out of the relationship (with their partner and with the baby)
Textbox 1. Factors affecting the support fathers offer to their breastfeeding partners.

Mobile Technology and Health Promotion

While specific recommendations from the FIFI study focused on the use of the Internet and DVDs, the technological landscape has changed markedly since the FIFI study was implemented in 2008. Smartphone usage is now virtually ubiquitous in Australia. In July 2014, Deloitte estimated that 81% of Australians aged 14 years and over owned a smartphone [30]. App usage is also prevalent, with the Australian Communications and Media Authority finding that 75% of Australian smartphone users had downloaded an app to their smartphone in a 6-month period [31]. Data from the United States in 2014 revealed that Android and iOS smartphone users were spending 65% more time using apps than they had 2 years previously, equating to 30 hours and 15 minutes each month per user [32]. Australians now spend more time accessing the Internet from smartphones than they do from desktop computers [33].

Mobile technology has been incorporated into health promotion programs targeting various health behaviors. Initiatives have targeted new parents [34], physical activity and nutrition [35-37], alcohol [38], suicide prevention [39], and mental health [40,41]. The use of smartphones offers specific benefits in terms of high user engagement [42], including the opportunity to deliver ecological momentary interventions [43]. These are interventions that occur as people participate in their daily lives and happen in real time [43]. As mobile users become increasingly savvy about app usage [44], their expectations grow, and it is important that apps developed for research purposes match the usability and sophistication that users expect from other “real-world” apps.

Developing mHealth interventions in multidisciplinary teams is a best practice approach recommended by many researchers [45-47]. It is important to design apps that are a good fit for user expectations and that make effective use of the devices on which they are deployed. Working with app development professionals early in the process can help to ensure that apps are well planned and executed [48]. This involvement can also identify trends in app development and user behavior, which may be incorporated into an app-based health intervention. In the case of Milk Man, we included push notifications, social connectivity, and gamification as engagement and motivational strategies.

Push Notifications

Push notifications are a means by which mobile apps can send information or alerts to users [49]. Compared with other notification methods, such as email, push notifications are immediate and quick to act upon; swiping the notification takes the users directly to the app, and even into the specific context referenced by the notification. Notifications remain in a list until they are acted upon or removed, meaning they can potentially act as triggers for later action. Use of push notifications means that the onus is not solely on a participant to remember to engage with the service; to some extent the service comes to them.

Social Connectivity

The use of technology for information gathering has changed markedly over the last 20 years. Increasingly, people want to interact with technology and use it to socially connect rather than simply passively receiving static information [50]. Many people are now socially connected throughout the day, over a number of platforms. Australians are enthusiastic users of social media, with approximately 68% of Internet users having at least one social media profile [51]. Breastfeeding research with fathers shows that peer support and peer connection is highly valued [14,16,21,23], and results from the FIFI study demonstrated that this approach can affect women’s breastfeeding duration [12].

Socially connected mobile technology can encourage people to reach out to each other and build communities [52-55]. Encouraging results have been reported in studies of online social support communities in interventions across a broad spectrum of health areas, including weight management [52,56], physical activity [57], and social anxiety [58]. For example, a focus group study that investigated the feasibility of an app for overweight adults suggested that social support networks that create a virtual community could be the primary component in creating a successful healthy lifestyle app [52].

Gamification

Gamification is the practice of using game-like components to motivate and encourage people in non-game contexts, and it is becoming increasingly popular in health and fitness apps [59]. Gamification elements include badges, leaderboards, points, and challenges [60]. Evidence about the increasing use of gamified apps in health is emerging [47,61,62]. A review of physical activity and nutrition apps found that the use of gamification was widespread; however, behavior change theory was not widely incorporated and there was no industry standard for developers [62]. Several studies have noted the need for further investigation of the potential for gamified health apps to effect behavior change [47,61-63]. Australian mental health research with young men suggested that gamification may be of value in enhancing engagement and enjoyment with using technology [64].

Parent Infant Feeding Initiative

We developed the Milk Man app to be trialed as part of the Parent Infant Feeding Initiative (PIFI), which has been previously described [65] (ACTRN12614000605695). The PIFI study is a 4-armed RCT comprising 1 control group, 2 medium-intensity intervention groups, and 1 high-intensity intervention group. Participants are being recruited from antenatal classes at hospital sites in metropolitan Perth, Western Australia. The control group has access to the usual care provided by the hospital. One medium-intensity group receives a male-facilitated antenatal class, while the other has access to the Milk Man app. The high-intensity group has access to both the male facilitator-led antenatal class and the Milk Man app.

One of the largest intervention breastfeeding studies to target male partners, the PIFI study will be conducted between 2015 and 2017 and is expected to provide valuable insights into infant feeding outcomes. This paper focuses on the Milk Man app, with particular emphasis on the formative research underpinning its design, development, and preliminary testing.

This research adds to the literature by describing the design and development of, to our knowledge, the first breastfeeding app targeted at men. The app uses carefully considered mobile strategies to engage men with an issue that is typically seen as the domain of women, and the results will add to the literature on mHealth and health promotion, particularly with respect to what works for targeting men with breastfeeding initiatives.


App Design

We developed the Milk Man app as a socially connected information and support resource for men. It is focused on breastfeeding and infant feeding, but includes broader information on topics including early parenting, being a supportive partner, and local service providers. It is based on evidence about the main factors affecting fathers’ support of their breastfeeding partners and is informed by social cognitive theory (SCT). As part of the formative research process, we completed a marketing audit of current advertising campaigns investigating how health messages, products, and services were being designed for the target group. This information helped guide the design of the app. Breastfeeding interventions are often targeted at the mother, resulting in fathers reportedly feeling excluded from family support programs [14,16,19]. Milk Man was explicitly designed for, and targeted toward, fathers, and this was a key consideration in encouraging men to access and use the information.

Milk Man was informed by focus groups with men in the target group, in addition to consultation with health professionals. We refined it through a testing phase comprising beta testing and user testing with men in the target group. User testing involved participants completing a think-aloud walkthrough, as well as completing the Mobile Application Rating Scale (MARS) [66] (see Testing and Iteration sections below). Figure 1 illustrates the Milk Man development process.

Figure 1. Development process for Milk Man.
View this figure

Theoretical Framework

SCT is a social learning model that operates at the interpersonal level, assuming an interaction between the social environment, the psychosocial determinants of behavior, and the individual [67,68]. In seeking to understand and predict human behavior, SCT can help to inform strategies for interventions to motivate and enable people to adopt healthier behaviors [69,70].

Reciprocal determinism is a key principle of SCT, describing the influence of both personal factors and the social environment on a person’s behavior. The factors that affect fathers’ decisions about and capacity to support breastfeeding are broad and include a combination of environmental and personal influences. Two specific social environmental factors that have been identified in the literature for this target group are the sometimes complex issues related to public breastfeeding, and the role that health professionals can have [16]. SCT acknowledges the impact these influences can have rather than simply focusing on the individual. In recognition of this, SCT has been recommended in the literature as a useful framework for breastfeeding interventions that target fathers [22,71]. It was used as the basis for the FIFI study, particularly in designing the male-facilitated antenatal sessions, which considered the constructs of self-efficacy and observational learning. It also helped researchers to understand the potential interrelation of different factors, including the overestimation of parental capacity and the underestimation of potential problems with breastfeeding.

We based the design of the Milk Man app and its engagement model on SCT constructs, to address the key issues affecting men’s support for their breastfeeding partners. The specific constructs of observational learning and goal setting were key components. In seeking to address self-efficacy, the app encourages problem solving between couples. Table 1 describes the theoretical framework underpinning the app and how the key engagement techniques used address the key factors identified in the literature.

Table 1. Milk Man engagement techniques mapped to social cognitive theory (SCT).
Key factorsSCT constructsEngagement technique in Milk Man app
Social support

Men feel they do not receive enough social support with pregnancy and early parenting.Observational learning
Goal setting
Self-efficacy
Connected social support function via the guided “conversation” feature.
App was specifically designed for, and targeted towards men.
Gamification functions to encourage inclusion, engagement, and positive feedback.
Knowledge


Men have gaps in knowledge around breastfeeding, pregnancy, and early parenthood.Outcome expectations
Goal setting
Self-efficacy
Provision of information via the library, including practical solutions and support service contact details.
Regular, age-relevant topics sent out as push notifications.
Empowerment


Men report lack of recognition of paternal role and understanding of their supportive role.Self-efficacy
Self-regulation
Outcome expectations
Focus on empowering men to understand their role through the library and the conversation.
Provision of practical advice Encouragement to discuss issues with partner.
Barriers


Men report specific barriers, including bonding postponement, public breastfeeding, and feeling left out.Self-regulation
Self-efficacy
Observational learning
Outcome expectations
Goal setting
Forum for men to share information and an opportunity for discussion about solutions to barriers.
Provision of information and strategies on public breastfeeding.
Provision of information on specific barriers and solutions with the aim of establishing realistic outcome expectations.

Engagement Strategies

We specifically designed the app to be attractive and engaging to the target group. The app is contemporary, delivers important information in a fun and lighthearted manner, and contains quirky imagery throughout. Milk Man contains engagement strategies that aim to keep men interested in using the app. The main engagement strategies are the use of push notifications, social connectivity via a guided conversation, an information library, and gamification.

Push Notifications

The Milk Man app has new content being added in the form of conversation topics twice a week. Push notifications are used to alert users to new discussion topics.

Social Connectivity Through Conversation

Milk Man aims to socially connect men by engaging them in a guided conversation. The conversation consists of a series of topics initiated by the app administration team twice a week. Participants receive a push notification alerting them to new topics and inviting them to participate in the conversation. On swiping the notification, they are taken directly to that conversation within the app. Topics are either posts or polls. A post, shown in Figure 2, consists of a question, usually with a link to a static information article in the library component of the app.

Users can add comments to the conversation, and “upvote” (that is, like or recommend) other users’ comments. A poll is a multiple choice question, where users can choose an answer and view the aggregated responses of other users. Users are placed into conversation groups on the basis of the estimated due date of their baby, enabling age-relevant information to be sent at appropriate times.

Figure 2. Milk Man conversation function.
View this figure
Information Library

The app also contains a library of static, evidence-based information tailored specifically to fathers (see Figure 3). This includes information on preparing for fatherhood, breastfeeding and infant feeding, managing expectations, and how to seek support. The library uses the progressive disclosure technique [72], where information is sequenced so the initial information is concise, then progressively more detailed as the user requests further information. External links provide further information from service providers, including the Australian Breastfeeding Association [73] and the Raising Children Network [74]. We restricted the length of the articles to approximately 150 words to ensure content is succinct and minimal scrolling is required to see the whole article.

Gamification

The app uses leaderboards, badges, and points to encourage engagement with both the social conversation and the static library of information. Users are awarded points for commenting on posts, contributing to the conversation, voting on polls, receiving upvotes from other users, and reading library articles. Users can see their score and rank on the leaderboard. Figure 4 shows these features.

Figure 3. Milk Man library.
View this figure
Figure 4. Gamification features used in Milk Man.
View this figure

Formative Research to Inform Development of the App

Focus Groups With Target Group

Following internal review with the research team, we tested the initial app concept with members of the target group in a series of 3 focus groups. We recruited a purposive sample of men (n=18) through existing networks, including through the university staff and student body and a local playgroup. Participants were required either to be expecting a baby or to have a baby under the age of 6 months. The focus groups aimed to investigate the acceptability of the engagement strategies, provide guidance in the framing of the app, and ensure the proposed approach and content were appropriate. Participants were asked to complete a brief demographic survey before starting the session. The lead author recorded, transcribed, and reviewed the focus groups to maintain dependability [75].

Consulting Health Professionals

We held 2 separate consultative sessions with health professionals from 2 of the maternity hospital sites (1 public and 1 private) participating in the PIFI study. Before the session, we developed an outline of the library content to be included within the app, and this outline formed the basis for the discussion with stakeholders. We invited health professionals to comment on the proposed design, engagement strategies, and content of the app.

Testing and Iteration of the App Prototype Phase

App testing was divided into 2 phases: beta testing and user testing. The beta testing involved providing early versions of the app to experienced app testers, who examined it for errors, crashes, layout issues, software bugs, or other problems. Beta testing was not carried out by members of the target group, as we were not seeking design and functionality feedback at this stage. Rather, it was tested by 4 experienced software testers, as well as members of the research team. We incorporated feedback into successive iterations of the app.

The second phase of testing, user testing, involved obtaining feedback on the app’s functionality, design, and usability. It was important that this phase of testing was carried out by members of the target group, as the objective was to gain an indication of the way in which the app was likely to be used and received by those for whom it was intended. Therefore, we invited participants to the testing phase if they were either expecting a baby or had a baby under the age of 6 months, and had previously expressed interest in the focus groups, but had not attended an earlier group. Once they had consented, we first asked participants to undertake a think-aloud walkthrough of the app, and then to complete the MARS [66,76]. We recruited 4 users to this testing phase. A previous study into think-aloud testing recommended that 4 to 5 test users is generally sufficient to identify up to 75% of usability issues, with the value of additional participants decreasing exponentially as the number increases [77].

Think-Aloud Walkthrough

Think-aloud walkthroughs are an industry standard approach in software development and a well-recognized way of testing mobile health apps [35,78-81]. In this study, after observing a researcher-led example using a different health app, participants were asked to spend a minimum of 10 minutes using Milk Man and to verbalize their thought processes as they navigated through the app. As the researcher wanted to observe the natural flow of app usage and observe organic navigation, the initial instruction was simply for users to “use and open the app as you would exploring any app for the first time.”

As the participants explored the app independently, the researcher monitored a checklist of 10 tasks and marked each off as it was completed. At the completion of the walkthrough, we specifically asked users to complete any tasks on the checklist that they had not completed unprompted. In keeping with best practice in conducting think-aloud studies, the researcher remained quiet throughout the study, speaking only to remind the participant to keep talking aloud and to issue tasks at the end. We recorded and transcribed the think-aloud sessions.

Mobile Application Rating Scale

Released in December 2014, the MARS is a comprehensive questionnaire used for rating mobile health apps with reference to 5 key criteria. The first 4 objective quality subscales give a measure of aesthetics, engagement, functionality, and information, while the fifth criterion is a subjective quality subscale and seeks users’ views on whether they would recommend the app, asks how often they would use it, and asks for an overall rating [66,76]. The MARS is scored by calculating the average of the 4 objective subscales. The MARS comprises 2 different versions, one for professionals, and a simplified version for app users. The app user version comprises 20 questions over the 5 criteria, with a final section asking 6 questions designed to describe the potential for impact on a user’s knowledge, attitudes, and intention to change [76]. After completing the think-aloud study, users were asked to independently complete the app user version of this scale.


Focus Groups With Target Group

A total of 18 men attended the 3 focus groups. Participants were aged between 30 and 43 years. Most were married (n=14), just under half were expecting a baby (n=8), and just over half had a new baby aged under 6 months (n=10).

All men owned either an iPhone or Android smartphone, and all said that they kept their phone close at hand and referred to it throughout the day. All participants had some third-party apps on their smartphone. Most participants were positive about the idea of apps for new fathers. Most of the comments about the use of push notifications were positive, although some mentioned that they should be used judiciously and the content should be relevant.

I think the lesson really is notification fatigue. You know some people like them, some people don’t. I suppose if you got far too many you just become disinterested and that can actually be more dangerous than not getting a notification.
[Focus group 1]

There was a mixed response to the idea of a discussion forum for men to connect to each other. Some participants were very enthusiastic about the idea, while others stated they would not use it. Some of the reasons participants gave for ambivalence about a forum were not trusting the information, preferring to talk to people in real life, and that information on forums can be alarmist and cause unnecessary concern.

I don’t know, I wouldn’t talk to a stranger for starters on an app and then I mean you go, we go to barbeques and friends’ house and their kids are ratbags or this and that and you can’t tell your mate how to look after their kid, it’s their kid. You don’t know what they’ve been through the night before, you don’t know what they’ve eaten the night before, so I wouldn’t ask someone for advice on my child in that sense.
[Focus group 3]
We stopped trusting anything that wasn’t from a doctor ’cause we got 50 opinions and my wife ended up freaking out.
[Focus group 1]

Some participants suggested that humor and a lighthearted tone would be appropriate, and that the app should be quick and easy to use.

For me lighthearted would be better. Even the best baby I think that first period is probably strap in and get through it kind of time. So if I have to read a textbook of really...dry text I’m probably not going to do it. But if it’s something quick and easy that...tells me that what I’m seeing in front of me is correct [I’m more likely to use it].
[Focus group 1]
Push notifications can add that element to the humor.
[Focus group 2]

Reinforcing findings from the literature, men were also clear on wanting practical tips for helping their partner, with information ideally delivered in short, summarized formats, including bullets points and checklists. Access to more detailed information could be provided via links.

I want bullet points and if I want to read into it more I’ll look into it more if I’ve got the time.
[Focus group 2]
Checklists, perhaps a list of [reasons why] my baby won’t stop crying and then people could maybe leave suggestions. Doing an upvoting, downvoting vetted type system. Say “try this top answer, this worked really well” [or] “that didn’t work, give me another thing on the list to try.”
[Focus group 1]

Participants’ experiences with mobile apps were varied, as were responses to the proposed engagement strategies. Some participants had experience sourcing and using apps for parenting and pregnancy, while others identified specific barriers to their use, including issues with trusting information and preferring face-to-face interaction. In general, fathers supported targeting fathers with such an approach, and the focus groups provided good insights into how to structure the app’s engagement strategies.

Consulting Health Professionals

To provide input about the content and engagement strategies proposed for the app, 16 health professionals attended 1 of 2 sessions. All participants were hospital-based midwives working with new and expectant parents. Some had additional, specialist roles: they were lactation consultants or parent educators, or they were in charge of discharge and follow-up of patients. Some specialized in working with aboriginal families, with young families, or with families requiring complex care relating to issues with alcohol and other drugs, or mental health problems.

The health professionals were generally enthusiastic about the app, and in particular about having men as the focus of the intervention.

Knowing the success of the woman’s breastfeeding experience is single-handedly influenced more by the support that [partners] give at home, than any other factor...makes [partners] feel like, “hey, I can do something to help.”
They want to help, but they don’t know how they can help.

The health professionals offered views that reinforced those from the focus groups, about keeping the tone of the app lighthearted, and ensuring the information provided was short and to the point.

Lighthearted and informative, because otherwise you’ll lose them, and they won’t come back if they’re finding it too heavy and judgmental.
Are you using dot form? Because I just find, they won’t read a whole big [article]. You just need dot points [and] keywords.
Pictures and dot points will work well.

Health professionals also offered specific content recommendations, including websites and online videos they typically used with new parents. They further advised the need to include information about postnatal depression for fathers and to focus on the message that every breastfeeding is a success.

Testing and Iteration of App Prototype Phase

A total of 4 new or expectant fathers participated in the user testing phase. Of these 4 recruited participants, 3 had a baby aged under 6 months, while 1 was expecting a child. The age range was 34–44 years.

Think-Aloud Walkthrough

User testing via the think-aloud walkthrough identified 6 issues related to usability and functionality. Usability issues included text in the comments section being too small, a lack of clarity about how the points system worked, and the need for an important icon to be more prominent. In terms of functionality, 3 additional features were suggested: the ability for users to post their own questions, the inclusion of a tutorial or walkthrough to explain the different sections of the app, and the ability to later change the avatar they had selected on creating a user profile.

Most participants completed the 10 tasks on the walkthrough checklist while independently using the app, without needing to be prompted. In each case, they completed all of the remaining items when prompted.

Mobile Application Rating Scale

We averaged the MARS scores from each user list them in Table 2. All 4 participants said they would recommend the app, and they all gave the app a 4- or 5-star rating.

Table 2. Average (out of 5) Mobile Application Rating Scale (MARS) scores for each category applied to the Milk Man breastfeeding app.
MARS criterionAverage score
Aesthetics4.3
Engagement3.8
Functionality4.6
Information4.5
Total average score4.3

Developing and Refining Milk Man

Formative research was a critical component of the development process used for the Milk Man app. Guided by the existing literature, and theoretically underpinned by the SCT, the app content and functionality were refined and focused through feedback and input from clinical health professionals, members of the target group, and a multidisciplinary team of professionals. These professionals included breastfeeding researchers, health promotion professionals, nutritionists, and a midwife, as well as an app designer and developer. Qualitative data from the formative evaluative phase provided insight into the use of mobile technology by members of the target group and into what engagement strategies might be most effective. While this was not intended to be an exhaustive qualitative study to thematic saturation, there were many overlapping themes and participants provided rich insight to help guide the app development.

The testing phase identified 6 issues, 5 of which we addressed before starting the PIFI trial. The one identified issue that we did not act on was the suggestion that users could post their own conversation topics. We deemed this to be outside the scope of this research and a potential risk, in that topics could be poorly informed and contain inaccurate or misleading information. We added a brief tutorial (usually known as an onboarding exercise), to be displayed to users on first launching the app. This addressed several of the identified issues, including a description of the points system, an explanation of how the app worked, and an explanation of how users would be assigned to a group.

MARS scores were high, indicating good user acceptability, usability, and functionality. While still high, the engagement score was slightly lower. This appeared to relate to participants’ stated need for further instructions, explanations, and the ability to change avatars to better customize their user account, all issues that we addressed in the next iteration of the app.

Next Steps for Milk Man

We have developed a comprehensive evaluation plan to measure the acceptability and effectiveness of the Milk Man app in the PIFI RCT. We will collect data through a mixed methods approach, including a customized analytics framework built into the app and a self-report questionnaire, which users will complete when their baby is 6 weeks old, and again at 26 weeks.

Evaluating adaptive technological interventions such as this requires a comprehensive approach, and we based the evaluation framework for this research on the one proposed by O’Grady et al [82]. This framework includes indicators for app users, content analysis, technology, computer-mediated interaction (user interaction with the interface), and broader health system integration.

While the use of mobile technology in public health interventions has grown significantly, there are still too few high-quality, adequately powered RCTs evaluating the use of such apps [83,84]. This large RCT will add to the evidence about the efficacy of mobile technology in delivering health interventions. The robust evaluation design will have broader relevance to public health interventions looking to use mobile technology to reach target groups.

Limitations

This study sought to include the views of members of the target group in the app design and development through focus groups. Participants in the focus groups were aged between 30 and 43 years, meaning that younger fathers were not represented in this sample. This was due to the purposive sampling method used. However, this research builds on the aforementioned FIFI study, in which both younger and older fathers were consulted.

Although we recruited only 4 participants for the testing phase, this number has been previously shown to be effective in identifying most usability issues [77], and indeed participants’ reported issues overlapped significantly. While the MARS has been found to provide a reliable indicator of app quality when used by trained raters, the reliability of the app user version is being evaluated [66]. As such and because of the small number of users rating the app, these results should be interpreted with caution.

Technology changes quickly. There is a balance to be struck between developing health intervention apps in a thorough, methodical fashion and moving quickly to minimize the risks associated with a changing technological environment. To minimize these risks, we proceeded to the RCT without a pilot study. A larger pilot study of the app, before starting the PIFI study, would have been of value in providing further insight into the way in which men would use the app in a real setting. This may be particularly true of the more interactive components of the app, such as the conversation and the leaderboard; observing men engaging with these features may have further assisted refinement. However, we will be able to monitor this throughout and make those recommendations at the trial’s conclusion.

Conclusion

Milk Man is a theoretically grounded app that provides information and support for the antenatal and postnatal periods and aims to socially connect fathers around a central theme of breastfeeding. We anticipate that providing a platform for men to discuss, share, and support each other through the breastfeeding journey will positively affect the support they offer their partners.

To our knowledge, Milk Man is the first breastfeeding app developed specifically for men. It uses innovative strategies to encourage user engagement. The development of Milk Man has involved stages of formative research, testing, and iteration. The process of design, development, and testing described here follows a best practice approach to app development, including being developed by a multidisciplinary team, being based on behavior change theory, and a having a design process centered on the user.

The comprehensive evaluation plan includes indicators for the app’s engagement strategies, as well as psychosocial and health outcomes up to 6 months after the birth of a child. This will provide valuable insights into what works for reaching the target group, and will ensure that the findings are transferable and that the data will be broadly relevant to future mobile health interventions. We expect results from the PIFI study in 2017.

Acknowledgments

The research on which this paper is based is being conducted as part of the Parent Infant Feeding Initiative (PIFI). The study was funded by a Healthway Health Promotion Research Grant (No. 24023). We are grateful to those who have participated, and are participating, in this research.

Conflicts of Interest

None declared.

  1. National Health and Medical Research Council. Infant Feeding Guidelines. Canberra: National Health and Medical Research Council; 2012.   URL: https:/​/www.​nhmrc.gov.au/​_files_nhmrc/​publications/​attachments/​n56_infant_feeding_guidelines_150917.​pdf [accessed 2016-01-13] [WebCite Cache]
  2. World Health Organization. Global Strategy for Infant and Young Child Feeding, The Optimal Duration of Exclusive Breastfeeding. Geneva: WHO; 2001.   URL: http://apps.who.int/gb/archive/pdf_files/WHA54/ea54id4.pdf [accessed 2016-01-13] [WebCite Cache]
  3. Horta B, Victora C. Long-Term Effects of Breastfeeding: A Systematic Review. Geneva: WHO; 2013.   URL: http://apps.who.int/iris/bitstream/10665/79198/1/9789241505307_eng.pdf?ua=1 [accessed 2016-01-28] [WebCite Cache]
  4. Ip S, Chung M, Raman G, Chew P, Magila N, DeVine D, et al. Breastfeeding and Maternal and Child Health Outcomes in Developed Countries. Rockville, MD: Agency for Healthcare Research and Quality; 2007.   URL: http://archive.ahrq.gov/downloads/pub/evidence/pdf/brfout/brfout.pdf [accessed 2016-01-13] [WebCite Cache]
  5. Australian Institute of Health and Welfare. 2010 Australian National Infant Feeding Survey: Indicator Results. Canberra: AIHW; 2011.   URL: http://www.aihw.gov.au/WorkArea/DownloadAsset.aspx?id=10737420925 [accessed 2016-01-13] [WebCite Cache]
  6. Ayton J, van der Mei I, Wills K, Hansen E, Nelson M. Cumulative risks and cessation of exclusive breast feeding: Australian cross-sectional survey. Arch Dis Child 2015 Sep;100(9):863-868. [CrossRef] [Medline]
  7. Kong SKF, Lee DTF. Factors influencing decision to breastfeed. J Adv Nurs 2004 May;46(4):369-379. [CrossRef] [Medline]
  8. Scott JA, Binns CW, Aroni RA. The influence of reported paternal attitudes on the decision to breast-feed. J Paediatr Child Health 1997 Aug;33(4):305-307. [Medline]
  9. Scott JA, Binns CW, Graham KI, Oddy WH. Temporal changes in the determinants of breastfeeding initiation. Birth 2006;33:37-45. [CrossRef]
  10. Wolfberg AJ, Michels KB, Shields W, O'Campo P, Bronner Y, Bienstock J. Dads as breastfeeding advocates: results from a randomized controlled trial of an educational intervention. Am J Obstet Gynecol 2004 Sep;191(3):708-712. [CrossRef] [Medline]
  11. Scott JA, Landers MC, Hughes RM, Binns CW. Factors associated with breastfeeding at discharge and duration of breastfeeding. J Paediatr Child Health 2001 Jun;37(3):254-261. [Medline]
  12. Maycock B, Binns CW, Dhaliwal S, Tohotoa J, Hauck Y, Burns S, et al. Education and support for fathers improves breastfeeding rates: a randomized controlled trial. J Hum Lact 2013 Nov;29(4):484-490. [CrossRef] [Medline]
  13. Tohotoa J, Maycock B, Hauck Y, Howat P, Burns S, Binns C. Supporting mothers to breastfeed: the development and process evaluation of a father inclusive perinatal education support program in Perth, Western Australia. Health Promot Int 2011 Sep;26(3):351-361 [FREE Full text] [CrossRef] [Medline]
  14. Tohotoa J, Maycock B, Hauck YL, Howat P, Burns S, Binns CW. Dads make a difference: an exploratory study of paternal support for breastfeeding in Perth, Western Australia. Int Breastfeed J 2009;4:15 [FREE Full text] [CrossRef] [Medline]
  15. Mannion CA, Hobbs AJ, McDonald SW, Tough SC. Maternal perceptions of partner support during breastfeeding. Int Breastfeed J 2013;8(1):4 [FREE Full text] [CrossRef] [Medline]
  16. Brown A, Davies R. Fathers' experiences of supporting breastfeeding: challenges for breastfeeding promotion and education. Matern Child Nutr 2014 Oct;10(4):510-526 [FREE Full text] [CrossRef] [Medline]
  17. Sherriff N, Hall V, Pickin M. Fathers' perspectives on breastfeeding: ideas for intervention. Br J Midwifery 2009 Apr;17(4):223-227. [CrossRef]
  18. Pisacane A, Continisio GI, Aldinucci M, D'Amora S, Continisio P. A controlled trial of the father's role in breastfeeding promotion. Pediatrics 2005 Oct;116(4):e494-e498. [CrossRef] [Medline]
  19. Rempel LA, Rempel JK. The breastfeeding team: the role of involved fathers in the breastfeeding family. J Hum Lact 2011 May;27(2):115-121. [CrossRef] [Medline]
  20. Halle C, Dowd T, Fowler C, Rissel K, Hennessy K, MacNevin R, et al. Supporting fathers in the transition to parenthood. Contemp Nurse 2008 Dec;31(1):57-70. [Medline]
  21. Hannula L, Kaunonen M, Tarkka M. A systematic review of professional support interventions for breastfeeding. J Clin Nurs 2008 May;17(9):1132-1143. [CrossRef] [Medline]
  22. Mitchell-Box K, Braun KL. Fathers' thoughts on breastfeeding and implications for a theory-based intervention. J Obstet Gynecol Neonatal Nurs 2012;41(6):E41-E50. [CrossRef] [Medline]
  23. Schmied V, Myors K, Wills J, Cooke M. Preparing expectant couples for new-parent experiences: a comparison of two models of antenatal education. J Perinat Educ 2002;11(3):20-27 [FREE Full text] [Medline]
  24. Cohen R, Lange L, Slusser W. A description of a male-focused breastfeeding promotion corporate lactation program. J Hum Lact 2002 Feb;18(1):61-65. [Medline]
  25. Susin LR, Giugliani ER. Inclusion of fathers in an intervention to promote breastfeeding: impact on breastfeeding rates. J Hum Lact 2008 Nov;24(4):386-92; quiz 451. [CrossRef] [Medline]
  26. Nyström K, Ohrling K. Parenthood experiences during the child's first year: literature review. J Adv Nurs 2004 May;46(3):319-330. [CrossRef] [Medline]
  27. Gamble D, Morse JM. Fathers of breastfed infants: postponing and types of involvement. J Obstet Gynecol Neonatal Nurs 1993;22(4):358-365. [Medline]
  28. Jordan PL, Wall VR. Breastfeeding and fathers: illuminating the darker side. Birth 1990 Dec;17(4):210-213. [Medline]
  29. Shaker I, Scott JA, Reid M. Infant feeding attitudes of expectant parents: breastfeeding and formula feeding. J Adv Nurs 2004 Feb;45(3):260-268. [Medline]
  30. Deloitte. Media Consumer Survey. 2014.   URL: http:/​/landing.​deloitte.com.au/​rs/​deloitteaus/​images/​Deloitte_Media_Consumer_Survey_2014.​pdf?mkt_tok= 3RkMMJWWfF9wsRonua%2FPce% 2FhmjTEU5z16egsWK%2B%2Bh4kz2EFye%2BLIHETpodcMTcVnN73YDBceEJhqyQJxPr3CKtEN09dxRhLgAA%3D%3D [accessed 2016-01-13] [WebCite Cache]
  31. Australian Communications Media Authority. Communications Report 2013-2014 Series: Report 1 - Australians' Digital Lives.: ACMA; 2015.   URL: http:/​/www.​acma.gov.au/​~/​media/​Research%20and%20Analysis/​Research/​pdf/​Australians%20digital%20livesFinal%20pdf.​pdf) [accessed 2016-01-13] [WebCite Cache]
  32. Smartphones: So Many Apps, So Much Time.: Neilsen; 2014.   URL: http://www.nielsen.com/us/en/insights/news/2014/smartphones-so-many-apps--so-much-time.html [accessed 2016-01-13] [WebCite Cache]
  33. The Australian Online Landscape Review: October 2015.: Neilsen; 2015.   URL: https:/​/www.​iabaustralia.com.au/​uploads/​uploads/​2015-11/​1447884000_7d8fa7ea358371f846c06af75016a09d.​pdf [accessed 2016-01-13] [WebCite Cache]
  34. Hearn L, Miller M, Lester L. Reaching perinatal women online: the Healthy You, Healthy Baby website and app. J Obes 2014;2014:573928 [FREE Full text] [CrossRef] [Medline]
  35. Boushey CJ, Harray AJ, Kerr DA, Schap TE, Paterson S, Aflague T, et al. How willing are adolescents to record their dietary intake? The mobile food record. JMIR Mhealth Uhealth 2015;3(2):e47 [FREE Full text] [CrossRef] [Medline]
  36. Dunford E, Trevena H, Goodsell C, Ng KH, Webster J, Millis A, et al. FoodSwitch: a mobile phone app to enable consumers to make healthier food choices and crowdsourcing of national food composition data. JMIR Mhealth Uhealth 2014;2(3):e37 [FREE Full text] [CrossRef] [Medline]
  37. Knight E, Stuckey MI, Prapavessis H, Petrella RJ. Public health guidelines for physical activity: is there an app for that? A review of android and apple app stores. JMIR Mhealth Uhealth 2015;3(2):e43 [FREE Full text] [CrossRef] [Medline]
  38. Yang C, Linas B, Kirk G, Bollinger R, Chang L, Chander G, et al. Feasibility and acceptability of smartphone-based ecological momentary assessment of alcohol use among African American men who have sex with men in Baltimore. JMIR Mhealth Uhealth 2015;3(2):e67 [FREE Full text] [CrossRef] [Medline]
  39. Shand FL, Ridani R, Tighe J, Christensen H. The effectiveness of a suicide prevention app for indigenous Australian youths: study protocol for a randomized controlled trial. Trials 2013;14:396 [FREE Full text] [CrossRef] [Medline]
  40. Beiwinkel T, Kindermann S, Maier A, Kerl C, Moock J, Barbian G, et al. Using smartphones to monitor bipolar disorder symptoms: a pilot study. JMIR Ment Health 2016;3(1):e2 [FREE Full text] [CrossRef] [Medline]
  41. Kenny R, Dooley B, Fitzgerald A. Feasibility of “CopeSmart”: a telemental health app for adolescents. JMIR Ment Health 2015 Aug;2(3):e22 [FREE Full text] [CrossRef] [Medline]
  42. Klasnja P, Pratt W. Healthcare in the pocket: mapping the space of mobile-phone health interventions. J Biomed Inform 2012 Feb;45(1):184-198 [FREE Full text] [CrossRef] [Medline]
  43. Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol 2010 Feb;15(Pt 1):1-39 [FREE Full text] [CrossRef] [Medline]
  44. Dennison L, Morrison L, Conway G, Yardley L. Opportunities and challenges for smartphone applications in supporting health behavior change: qualitative study. J Med Internet Res 2013;15(4):e86 [FREE Full text] [CrossRef] [Medline]
  45. Becker S, Miron-Shatz T, Schumacher N, Krocza J, Diamantidis C, Albrecht U. mHealth 2.0: experiences, possibilities, and perspectives. JMIR Mhealth Uhealth 2014;2(2):e24 [FREE Full text] [CrossRef] [Medline]
  46. Middelweerd A, Mollee JS, van der Wal CN, Brug J, te Velde SJ. Apps to promote physical activity among adults: a review and content analysis. Int J Behav Nutr Phys Act 2014;11:97 [FREE Full text] [CrossRef] [Medline]
  47. Payne HE, Moxley VB, MacDonald E. Health behavior theory in physical activity game apps: a content analysis. JMIR Serious Games 2015;3(2):e4 [FREE Full text] [CrossRef] [Medline]
  48. Dialogue Consulting. Guidelines For Developing Healthy Living Apps. Melbourne: VicHealth; 2015.   URL: https://www.vichealth.vic.gov.au/media-and-resources/app-developers [accessed 2016-02-10] [WebCite Cache]
  49. Mohr DC, Schueller SM, Montague E, Burns MN, Rashidi P. The behavioral intervention technology model: an integrated conceptual and technological framework for eHealth and mHealth interventions. J Med Internet Res 2014;16(6):e146 [FREE Full text] [CrossRef] [Medline]
  50. Chou WY, Prestin A, Lyons C, Wen KY. Web 2.0 for health promotion: reviewing the current evidence. Am J Public Health 2013 Jan;103(1):e9-18. [CrossRef] [Medline]
  51. Sensis Social Media Report May 2015.: Sensis; 2015.   URL: https://www.sensis.com.au/assets/PDFdirectory/Sensis_Social_Media_Report_2015.pdf [accessed 2016-01-13] [WebCite Cache]
  52. Fukuoka Y, Kamitani E, Bonnet K, Lindgren T. Real-time social support through a mobile virtual community to improve healthy behavior in overweight and sedentary adults: a focus group analysis. J Med Internet Res 2011;13(3):e49 [FREE Full text] [CrossRef] [Medline]
  53. Gay G, Pollak J, Adams P, Leonard JP. Pilot study of Aurora, a social, mobile-phone-based emotion sharing and recording system. J Diabetes Sci Technol 2011 Mar;5(2):325-332 [FREE Full text] [Medline]
  54. Kamal N, Fels S, Fergusson M. Online social networks for health behaviour change: designing to increase socialization. Comput Hum Behav 2014 Dec;41:444-453. [CrossRef]
  55. Proudfoot J, Parker G, Hadzi PD, Manicavasagar V, Adler E, Whitton A. Community attitudes to the appropriation of mobile phones for monitoring and managing depression, anxiety, and stress. J Med Internet Res 2010;12(5):e64 [FREE Full text] [CrossRef] [Medline]
  56. Hwang KO, Ning J, Trickey AW, Sciamanna CN. Website usage and weight loss in a free commercial online weight loss program: retrospective cohort study. J Med Internet Res 2013 Jan;15(1):e11 [FREE Full text] [CrossRef] [Medline]
  57. Richardson CR, Buis LR, Janney AW, Goodrich DE, Sen A, Hess ML, et al. An online community improves adherence in an internet-mediated walking program. Part 1: results of a randomized controlled trial. J Med Internet Res 2010 Dec;12(4):e71 [FREE Full text] [CrossRef] [Medline]
  58. Indian M, Grieve R. When Facebook is easier than face-to-face: social support derived from Facebook in socially anxious individuals. Pers Individual Differences 2014 Mar;59:102-106. [CrossRef]
  59. King D, Greaves F, Exeter C, Darzi A. 'Gamification': influencing health behaviours with games. J R Soc Med 2013 Mar;106(3):76-78. [CrossRef] [Medline]
  60. Zichermann G, Cunningham C. Gamification by Design: Implementing Game Mechanics in Web and Mobile Apps. Sebastopol, CA: O'Reilly; 2011.
  61. Miller AS, Cafazzo JA, Seto E. A game plan: gamification design principles in mHealth applications for chronic disease management. Health Inform J 2014 Jul 1. [CrossRef] [Medline]
  62. Lister C, West JH, Cannon B, Sax T, Brodegard D. Just a fad? Gamification in health and fitness apps. JMIR Serious Games 2014;2(2):e9 [FREE Full text] [CrossRef] [Medline]
  63. Koivisto J, Hamari J. Demographic differences in perceived benefits from gamification. Comput Hum Behav 2014 Jun;35:179-188. [CrossRef]
  64. Ellis LA, Collin P, Hurley PJ, Davenport TA, Burns JM, Hickie IB. Young men's attitudes and behaviour in relation to mental health and technology: implications for the development of online mental health services. BMC Psychiatry 2013;13:119 [FREE Full text] [CrossRef] [Medline]
  65. Maycock BR, Scott JA, Hauck YL, Burns SK, Robinson S, Giglia R, et al. A study to prolong breastfeeding duration: design and rationale of the Parent Infant Feeding Initiative (PIFI) randomised controlled trial. BMC Pregnancy Childbirth 2015;15:159 [FREE Full text] [CrossRef] [Medline]
  66. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015;3(1):e27 [FREE Full text] [CrossRef] [Medline]
  67. Bandura A. Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs, NJ: Prentice-Hall; 1986.
  68. Luszczynska A, Schwarzer R. Social cognitive theory. In: Conner M, Norman P, editors. Predicting Health Behaviour: Research and Practice With Social Cognition Models. Second edition. Maidenhead, UK: Open University Press; 2005.
  69. Bandura A. Health promotion by social cognitive means. Health Educ Behav 2004 Apr;31(2):143-164. [CrossRef] [Medline]
  70. Bandura A. Cultivate self-efficacy for personal organizational effectiveness. In: Locke E, editor. Handbook of Principles of Organizational Behavior: Indispensable Knowledge for Evidence-Based Management. Second edition. Chichester, UK: John Wiley & Sons Ltd; 2009:179-200.
  71. Sharma M, Petosa R. Impact of expectant fathers in breast-feeding decisions. J Am Diet Assoc 1997 Nov;97(11):1311-1313. [CrossRef] [Medline]
  72. Spillers F. Progressive Disclosure: The Glossary of Human Computer Interaction. Denmark: Interaction Design Foundation   URL: https:/​/www.​interaction-design.org/​literature/​book/​the-glossary-of-human-computer-interaction/​progressive-disclosure [accessed 2016-02-10] [WebCite Cache]
  73. Australian Breastfeeding Association. Australian Breastfeeding Association. 2015.   URL: https://www.breastfeeding.asn.au/ [accessed 2016-01-13] [WebCite Cache]
  74. Raising Children Network. Raising Children: The Australian Parenting Website. 2015.   URL: http://raisingchildren.net.au [accessed 2016-01-13] [WebCite Cache]
  75. Bryman A. Social Research Methods. Second edition. Oxford, UK: Oxford University Press; 2004.
  76. Hides L, Kavanagh D, Stoyanov S, Zelenko O, Tjondroegoro D, Mani M. Mobile Application Rating Scale (MARS): A New Tool For Assessing the Quality of Health Mobile Applications. Melbourne, Australia: Young and Well Cooperative Research Centre; 2014.   URL: http://www.youngandwellcrc.org.au/wp-content/uploads/2015/03/MARS-REPORT_FINAL_181214.pdf [accessed 2016-06-18] [WebCite Cache]
  77. Nielsen J. Estimating the number of subjects needed for a thinking aloud test. Int J Hum Comput Stud 1994 Sep;41(3):385-397. [CrossRef]
  78. Al Ayubi SU, Parmanto B, Branch R, Ding D. A persuasive and social mHealth application for physical activity: a usability and feasibility study. JMIR Mhealth Uhealth 2014;2(2):e25 [FREE Full text] [CrossRef] [Medline]
  79. Atwal A, Money A, Harvey M. Occupational therapists' views on using a virtual reality interior design application within the pre-discharge home visit process. J Med Internet Res 2014;16(12):e283 [FREE Full text] [CrossRef] [Medline]
  80. Lim J, Cloete G, Dunsmuir DT, Payne BA, Scheffer C, von Dadelszen P, et al. Usability and feasibility of Piers on the Move: an mHealth app for pre-eclampsia triage. JMIR Mhealth Uhealth 2015;3(2):e37 [FREE Full text] [CrossRef] [Medline]
  81. Nikolaus S, Bode C, Taal E, Vonkeman HE, Glas CA, van de Laar MA. Acceptance of new technology: a usability test of a computerized adaptive test for fatigue in rheumatoid arthritis. JMIR Human Factors 2014 Dec 04;1(1):e4. [CrossRef]
  82. O'Grady L, Witteman H, Bender JL, Urowitz S, Wiljer D, Jadad AR. Measuring the impact of a moving target: towards a dynamic framework for evaluating collaborative adaptive interactive technologies. J Med Internet Res 2009;11(2):e20 [FREE Full text] [CrossRef] [Medline]
  83. Baskerville NB, Struik LL, Hammond D, Guindon GE, Norman CD, Whittaker R, et al. Effect of a mobile phone intervention on quitting smoking in a young adult population of smokers: randomized controlled trial study protocol. JMIR Res Protoc 2015;4(1):e10 [FREE Full text] [CrossRef] [Medline]
  84. Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, et al. The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS Med 2013;10(1):e1001362 [FREE Full text] [CrossRef] [Medline]


FIFI: Fathers Infant Feeding Initiative
MARS: Mobile Application Rating Scale
PIFI: Parent Infant Feeding Initiative
RCT: randomized controlled trial
SCT: social cognitive theory


Edited by G Eysenbach; submitted 15.02.16; peer-reviewed by R Davies, J Thrul, K Heffernan; comments to author 06.04.16; revised version received 17.05.16; accepted 04.06.16; published 27.06.16

Copyright

©Becky K White, Annegret Martin, James A White, Sharyn K Burns, Bruce R Maycock, Roslyn C Giglia, Jane A Scott. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 27.06.2016.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.