Published on in Vol 7, No 8 (2019): August

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/13309, first published .
Using Telemedicine to Diagnose Surgical Site Infections in Low- and Middle-Income Countries: Systematic Review

Using Telemedicine to Diagnose Surgical Site Infections in Low- and Middle-Income Countries: Systematic Review

Using Telemedicine to Diagnose Surgical Site Infections in Low- and Middle-Income Countries: Systematic Review

Review

1Faculty of Health Sciences, University of Bristol, Bristol, United Kingdom

2Centre for Informatics, Usher Institute, Edinburgh, United Kingdom

3Department of Surgery, Services Institute of Medical Sciences, Lahore, Pakistan

4Bristol Centre for Surgical Research, Population Health Sciences, Bristol Medical School, Bristol, United Kingdom

5NIHR Bristol Biomedical Research Centre, Bristol, United Kingdom

6University Hospitals Bristol NHS Foundation Trust, Bristol, United Kingdom

Corresponding Author:

Charlotte E J Sandberg, BSc

Faculty of Health Sciences

University of Bristol

First Floor

5 Tyndall Avenue

Bristol, BS8 1UD

United Kingdom

Phone: 44 117 928 9000

Email: cs14961@bristol.ac.uk


Background: A high burden of preventable morbidity and mortality due to surgical site infections (SSIs) occurs in low- and middle-income countries (LMICs), and most of these SSIs occur following discharge. There is a high loss to follow-up due to a wide geographical spread of patients, and cost of travel can result in delayed and missed diagnoses.

Objective: This review analyzes the literature surrounding the use of telemedicine and assesses the feasibility of using mobile phone technology to both diagnose SSIs remotely in LMICs and to overcome social barriers.

Methods: A literature search was performed using Medline, Embase, CINAHL, PubMed, Web of Science, the Cochrane Central Register of Controlled Trials and Google Scholar. Included were English language papers reporting the use of telemedicine for detecting SSIs in comparison to the current practice of direct clinical diagnosis. Papers were excluded if infections were not due to surgical wounds, or if SSIs were not validated with in-person diagnosis. The primary outcome of this review was to review the feasibility of telemedicine for remote SSI detection.

Results: A total of 404 articles were screened and three studies were identified that reported on 2082 patients across three countries. All studies assessed the accuracy of remote diagnosis of SSIs using predetermined telephone questionnaires. In total, 44 SSIs were accurately detected using telemedicine and an additional 14 were picked up on clinical follow-up.

Conclusions: The use of telemedicine has shown to be a feasible method in remote diagnosis of SSIs. Telemedicine is a useful adjunct for clinical practice in LMICs to decrease loss to postsurgical follow-up.

JMIR Mhealth Uhealth 2019;7(8):e13309

doi:10.2196/13309

Keywords



Surgical site infections (SSIs) cause preventable morbidity and mortality. The etiology of SSIs is multifactorial and is due to various perioperative factors such as: antibiotic use, cleanliness of surgical equipment and postoperative wound care [1]. The greatest burden is seen in low- and middle-income countries (LMICs) [2], and therefore investigating factors to reduce the incidence of SSIs should be a clinical priority.

Primary prevention of infection plays a significant role in decreasing morbidity and mortality; however, complete eradication of SSIs is not possible. Therefore, to minimize the morbidity of SSIs, timely management is required. This proves challenging in LMICs, as most SSIs are diagnosed after discharge [3]. The surgical population experiences a high loss to follow-up, ranging between 32-75% [3,4,5], which increases the proportion of infections that go undetected and untreated. The wide geographic spread, as a result of poor healthcare infrastructure, is a significant factor in the high loss to follow-up. Specifically, patients report long journey times, with high associated costs and loss of income as the key reasons behind nonattendance [6].

While this highlights a wider problem surrounding access to healthcare facilities in LMICs, one practical solution to improve patient follow-up after discharge is the use of telemedicine. This is possible because LMICs have seen exponential expansion of mobile phone infrastructure in recent years, allowing for greater implementation of telemedicine [7].

Previous studies reporting the use of telemedicine in LMICs have described improvement in cancer clinic attendance rates [8] and long-term surgical follow-up of cleft palate surgeries [9]. Currently, the only systematic review available that details the use of telemedicine for surgical follow-up for SSI detection is based solely within developed countries [10].

A number of studies describe the use of telemedicine in LMICs using telephone questionnaires [3-5]; however, to the authors’ knowledge, a review comprehensively summarizing the use of telemedicine within an LMIC setting has yet to be performed. Thus, the authors aimed to review the feasibility of telemedicine for diagnosis of SSIs in LMICs and the associated financial costs.


Overview

The electronic search was conducted according to the preferred reporting items for systematic reviews and meta-analysis (PRISMA) guidelines [11] (Figure 1). The search was conducted independently by two authors (CS and SK) and included the databases Medline, Embase, CINAHL, PubMed, Web of Science, the Cochrane Central Register of Controlled Trials and Google Scholar.

MeSH search terms used were: [“developing country*” OR “LEDC” OR “resource poor setting*” OR “lower economically developed” OR “LMIC” OR “Low* and middle income” OR “low* middle income” OR “less developed” OR “global south” OR “low* income” OR “third world” OR “global health” OR “rural”] AND [“surgical site infection*” OR “surgical wound infection*” OR “SSI” OR “Surgical wound dehiscence” OR “Wound infection*” OR “Complication*” OR “Postsurgical” OR “postoperative complication*” OR “wound healing*”] AND [“phone” OR “telephone” OR “cellphone” OR “text message*” OR “phone call” OR “telephone call” OR “text” OR “telemedicine” OR “smartphone” OR “interviews as topic” OR “telephone interview*”]. Bibliographic references for each article were directly searched to identify additional studies not found in the primary electronic search. The last search date was June 2019.

Figure 1. Preferred reporting items for systematic reviews and meta-analysis flow diagram.
View this figure

Definitions

LMICs are defined as belonging to the World Health Organization (WHO) classification of a low or low-middle income country [12] at the time of study. Low-income countries are defined as a country with a gross national income (GNI) per capita of 1025 United States Dollars (USD) or less, and low-middle income countries are defined as having a GNI per capita between 1026-4035 USD [12]. Telemedicine is defined as the use of telecommunication devices for remote delivery of medical care [13].

SSIs are defined in line with the Centers for disease control and prevention (CDC) criteria [14], stipulating infection must have occured within 30 days of primary incision and can only involve the skin and soft tissues surrounding the incision site. At least one of any of the following signs of infection must also be present: purulent discharge, positive organism cultures, heat, erythema, local edema or pain.

Inclusion Criteria

Literature reviews and original research published in English in peer-reviewed journals were eligible for inclusion. Studies included reported the use of telephone communication for detection and diagnosis of SSIs, in comparison to the current practice of direct clinical diagnosis. All operations requiring a skin incision and overnight stay were included. All types of anesthesia were included.

Exclusion Criteria

Animal studies, case reports, grey literature, trial protocols, editorials and expert opinion articles were excluded. Two papers were excluded due to full texts being unavailable. Conference reports and proceedings were excluded due to the high probability of incomplete data. Articles not in the English language were also excluded. Studies where telemedicine was not validated by in-person physician diagnosis were excluded. Similarly, studies that did not report SSI incidence rate or did not report on infections from surgical wounds were excluded. In the instance that multiple studies referred to the same dataset, the publication with the most complete dataset was used.

Outcome Measures

The primary outcome measure was the number of SSIs diagnosed using telephone interviews as a proportion of the total number of SSIs diagnosed. Secondary outcome measures included determining the proportion of patients who were able to be contacted using telephone follow-up, as well as the cost of the intervention itself for the healthcare provider and the patient.

Data Extraction

Data were extracted independently by two researchers (CS and SK) from the included studies using a standardized pro forma. All differences in data extraction were highlighted and discussed between the two authors. If a consensus was not reached, SP was consulted and given the deciding vote. The data were categorized as study demographics (ie, geographical location, number of included patients, follow-up time, number of follow-ups, method of telephone use), patient demographics (ie, study population, type of surgical procedures) and infection demographics (ie, SSI diagnosis criteria, SSI incidence).

Outcome data was collected in groups relating to patient characteristics (ie, number of patients with a mobile phone, number of patients participating in the telemedicine intervention, proportion of patients who were successfully followed up with using telemedicine), SSI characteristics (ie, total number of SSIs, proportion of SSIs diagnosed using telemedicine), and economic outcomes relating to the cost of telemedicine intervention.

Quality Assessment

Objective measurement of quality and risk of bias was independently analyzed using the Methodological index for nonrandomized studies (MINORS) criteria [15] by two authors (CS and SK). In addition, the effectiveness and ability of each study to be replicated in a wider setting was assessed using the WHO mobile health evidence and reporting assessment (mERA) checklist [16].


Study Selection

The search criteria retrieved 404 articles, of which seven were duplicates. Following screening, a total of 18 articles were identified for full text review. Three full text articles met the inclusion criteria.

Included studies were performed in Kenya [5], India [4] (low-middle income countries) and Tanzania [3] (low income country). A total of 2082 patients were included, with 172 SSIs reported overall and a mean SSI rate of 8.75%. All studies assessed the use of telephone calls to diagnose SSIs (Table 1).

Table 1. Included study characteristics.
CharacteristicsAiken et alNguhuni et alPathak et al
Publication year201320172015
Geographic locationKenyaTanzaniaIndia
Number of included patients1172374536
Study populationAll patients undergoing surgical procedureObstetric patientsAll patients undergoing surgical procedure
Included surgical proceduresCaesarean section, laparotomy, hernia repair, orthopedic lower limb surgery, salpingectomy, cystectomyCaesarean section onlyHernia repair, colonic and urogenital surgery
Method of telemedicine interventionTelephone calls with predetermined questionnaireTelephone calls with predetermined questionnaireTelephone calls with predetermined questionnaire
Follow-up frequency231
Follow up performedDays 14 & 28Days 6, 12 & 28Day 30
Length of follow up30 days30 days30 days
SSIa diagnosis criteriaCDCb criteria for diagnosis of SSICDC criteria for diagnosis of SSILocal SSI criteria
SSI rate7.90%12.0%6.34%

aSSI: surgical site infection

bCDC: centers for disease control and prevention

Table 2. Summary of findings.
FindingsAiken et alNguhuni et alPathak et al
Patients providing a telephone number, %>9084100
Patients with ≥1 successful telephone follow up who had provided a telephone number, %Not stated8771
Patients contacted by phone and seen in clinic, %Not stated7369
Patients undergoing surgical procedure8948410
Patients with SSIsa that participated in telephone screening, %Not stated72Not stated
SSIs detected over phone or clinic review at day 7Not stated11/14Not stated
SSIs detected over phone or by clinical review at day 14Not stated7/11Not stated
SSIs detected over phone or by clinical review at day 30Not stated0/0Not stated
Total SSIs detected over phone or by clinical review16 / 2318 / 2510 / 10

aSSI: surgical site infection

Accuracy of Telephone Follow-Up Diagnosis

Of all the cases, 44 SSIs were diagnosed over the phone [3,4,5], and all were confirmed as SSIs on clinical follow-up. However, 14 additional SSIs were not detected over the phone and only diagnosed on clinical follow-up (Table 2).

Number of Patients Able to be Contacted by Phone

A total of 172 SSIs were recorded across the three studies [3,4,5]; however, only 58 of these SSIs occurred in populations who took part in telephone follow-up. The remaining 114 SSIs were diagnosed in follow-up clinics and involved patients not contacted via telemedicine.

Within the three studies, between 84-100% of patients provided a telephone number [3,4,5]; however, 13-29% of these patients were unable to be contacted. Loss to follow-up occurred due to patients not returning to clinic after telemedicine communication. This resulted in an inability to confirm SSI diagnosis.

Cost Analysis

Only one study [3] commented on the cost of intervention. Phone calls were recorded as lasting between 3-5 minutes, and it was estimated that each phone call cost approximately 0.50 USD. As each patient was followed up with on days 7, 14 and 28, this would be equivalent to 1.50 USD per patient (0.23% of Tanzanian gross domestic product [GDP] per capita at the time of calculation). In a reflection of the cost for in-person outpatient appointments, 2008 data supplied by the WHO documents one hospital outpatient appointment in Tanzania as costing a minimum of 1.27 USD [17], which is 2.54 times more expensive than if telephone follow up were to be used.

Quality Assessment of Studies

Each of the studies was assessed using the MINORS criteria [15] to determine their quality. As they were all comparative prospective studies, the maximum score was 24. The individual study scores were between 14-19 (Table 3).

The MINORS criteria assess whether the paper has a clearly stated aim, if it includes all eligible patients, if it collected data according to a preestablished protocol, if there was an appropriate endpoint to the aim of the study, if there was an unbiased assessment of the study endpoint, if it had an appropriate follow-up period, whether it had a loss to follow up less than 5%, if it prospectively calculated the study size, whether or not it utilized an adequate control group, if the study group was managed during the same time period as the control, if there was a baseline equivalence of the two groups and if there is adequate statistical analysis.

When each text was compared against the WHO mERA checklist (Table 4), they scored between eight to nine points out of a possible 16. The mERA checklist requires authors to present the availability of infrastructure to support the intervention and justify its use; to describe how the intervention can integrate into existing health information systems and how this will be delivered; to describe formative research on the intervention; to provide user feedback; to provide a description of how people are informed of the program; to mention barriers to access and costs assessment; and, finally, they must evaluate the limitations of delivery at scale and of adapting the intervention to other populations.

Table 3. Methodological index for nonrandomized studies criteria for each paper.
CriteriaStudies
Aiken et al [5]Nguhuni et al [3]Pathak et al [4]
ScoreDescriptionScoreDescriptionScoreDescription
1a2b22
2c21Did not state reason some patients were excluded1No inclusion criteria stated
3d1References a pilot study0Doesn\'t report a pilot or protocol0No pilot or protocol mentioned
4e2SSIsf diagnosed in reference to the standardized CDC-NHNSg risk criteria2SSIs diagnosed in reference to the standardized CDC-NHNS risk criteria0No criteria for SSI diagnosis explained
5h1Not stated whether those in clinic were blinded to the telephone outcomes1Not stated whether those in clinic were blinded to the telephone outcomes1Not stated whether those in clinic were blinded to the telephone outcomes
6i230 days230 days230 days
7j0The loss to follow up was not commented on1Loss to follow up was 13%, but 26% of those who had been contacted by phone did not return to clinic2No loss to follow up
8k2Specificity, sensitivity2Specificity, sensitivity, positive predictive values, negative predictive values1Not recorded
9l2Compared against clinical diagnosis2Compared against clinical diagnosis2Compared against clinical diagnosis
10m2Patients were their own control2Patients were their own control2Patients were their own control
11n0No Table 1 referenced20No data on group equivalence mentioned
12o221No statistics mentioned for SSI detection via mobile phone
Total scorep181914

aHas a clearly stated aim.

bNot applicable/no description given.

cIncludes all eligible patients.

dCollected data according to a preestablished protocol.

eThere was an appropriate endpoint to the aim of the study.

fSSI: surgical site infection.

gCDC-NHNS: Centers for Disease Control and Prevention-National Healthcare Safety Network.

hThere was an unbiased assessment of the study endpoint.

iHad an appropriate follow-up period.

jHad a loss to follow up less than 5%.

kProspectively calculated the study size.

lUtilized an adequate control group.

mStudy group was managed during the same time period as the control.

nBaseline equivalence of the study group and control group.

oAdequate statistical analysis.

pOut of 24.

Table 4. Mobile health evidence and reporting assessment checklist.
CriteriaAiken et al [5]Nguhuni et al [3]Pathak et al [4]
Infrastructure (population level)NoNoNo
Technology platformYesYesYes
Interoperability or HISa contextYesYesYes
Intervention deliveryYesYesYes
Intervention contentYesYesYes
Usability/content testingNoNoNo
User feedbackNoNoNo
Access of individual participantsNoNoYes
Cost assessmentNoYesNo
Adoption inputs/ program entryYesYesYes
Limitations for delivery at scaleNoNoYes
Contextual adaptabilityNoNoNo
ReplicabilityYesYesYes
Data securityNoNoNo
Compliance with national guidelines or regulatory statutesNoNoNo
Fidelity of the interventionYesYesYes
Total (out of 16)789

aHIS: health information systems.


Primary Findings

More operative interventions are being undertaken in LMICs, however, higher rates of postoperative complications in LMICs are seen when compared with high income countries. Among these complications, SSIs have been found to be the most common [2]. The aim of this review was to establish the feasibility of using telemedicine to increase SSI detection and reduce the associated complications.

This review demonstrates that using telemedicine is a feasible intervention. All studies reported high telemedicine access and all SSIs diagnosed using telemedicine were found to be accurate. However, telemedicine alone underdiagnosed SSIs, as additional superficial infections were picked up on during in-person clinical review.

Additionally, in terms of cost effectiveness, telemedicine intervention was found to be 2.54 times less expensive than hospital outpatient appointments, using 2008 data supplied by the WHO recording one hospital outpatient appointment in Tanzania as costing a minimum of $1.27 [17].

Furthermore, based on an extrapolation of similar study data that showed a follow-up rate of 54% [18], the use of telemedicine could have detected an additional 8.28 SSIs otherwise lost to follow-up. This amounts to 36.59 USD per disability adjusted life years (DALY), where the DALY is an undiagnosed infection. This is considered a highly cost-effective intervention as per the WHO Choosing interventions that are cost-effective (CHOICE) guidelines [19], since the intervention is less than one third of Tanzania’s 2015 GDP per capita (290.66 USD) [20]. However, as only one paper discussed cost-effectiveness, firm conclusions on the cost of telemedicine intervention as a whole cannot be extrapolated from these data alone.

The included studies were able to reach up to 87% of patients for follow-up using telemedicine. This is much higher than the reported follow-up in a comparable Tanzanian study that did not use telemedicine, where only 46% of patients returned in person to clinics [18].

These results also reflect the success of LMIC telemedicine interventions in other medical fields. One study on follow-up of cancer patients in Nigeria found an additional 78.4% of patients completed all follow-up appointments if they were contacted by phone instead of being required to return to the hospital [8]. Telemedicine has also shown good efficacy in increasing patient compliance with returning for hospital follow-up, due to increased interaction with health care providers through text and call reminders [9,21].

This study strengthens the existing evidence for the incorporation of more telemedicine services in LMICs, as a practical way of delivering healthcare in remote settings. In Tanzania, two phone calls at day 7 and day 14 would have picked up over 90% of SSIs [3], evidence that this intervention can be a useful addition to clinicians’ practices. However, across the three studies, 25% of SSIs were missed by telemedicine alone. This shows that, currently, the intervention may have a low sensitivity that can limit its application.

Limitations

The most notable limitation of this review was that only three studies were eligible for inclusion in the final analysis. This may have been a result of only considering articles in the English language; however, this is not thought to bias overall results [22,23]. Furthermore, there was high heterogeneity between studies, due to studies being undertaken in different geographical areas, involving different surgical procedures, and in populations without standardized SSI diagnosis criteria between the three studies. As a result, meta-analysis was not considered applicable.

Additionally, within all three papers there is potential reporting bias due to a lag period of 2-7 days between phone diagnoses of SSI and clinical follow up. As SSI status is able to change within this window, this may have affected results. Furthermore, none of the studies confirmed whether diagnosing clinicians were blinded to the telephone results. There is further potential bias with regards to the subjectivity of CDC diagnosis criteria, such as whether a wound is considered erythematous or hot. Although this is explored by Nguhuni et al [3] and Aiken et al [5], Pathak et al [4] do not comment upon this.

A potential consequence of these biases is the low reported incidence of SSIs across the three studies (6.3% [4], 7.9% [5] and 12% [3]), of which 93% were reported as superficial. This is markedly lower than the SSI incidence reported in the GlobalSurg 2 study [24], which found LMICs to report an average SSI rate of 14-23.2%, with 81.1% being superficial. This discrepancy may be due to caesarean sections being the most common procedure represented within the study data, as these tend to be elective operations, with clean wounds and minimal contamination. Furthermore, patients undergoing caesarean section are not representative of the wider surgical population, as they are usually otherwise healthy young women. This limits the generalizability of the data analyzed.

Regarding the included data, while a total of 2719 patients were eligible for inclusion and up to 90% of patients provided telephone numbers [3] across the studies, only 573 patients were recorded as having successful telephone follow-ups with clinical confirmation and were therefore able to be included in the final analysis. Consequently, this may also limit the results. Moreover, telemedicine access is likely to be correlated to socioeconomic status and literacy, which was not commented upon in any of the included studies. It could therefore be argued that while telemedicine addresses the need for access to healthcare, it does so unequally, increasing social inequality.

None of the studies included in this review commented upon subsequent interventions or outcomes due to increased SSI detection, therefore the impact of the intervention is currently unclear. Future work should incorporate this and be undertaken using the WHO guidelines on monitoring and evaluation of digital health interventions [16] (Figure 2). Initially, pilot studies should be used to better measure the efficacy of telemedicine use, then they should be followed up by scaling-up of the intervention to measure the effectiveness of the intervention itself as well as changes in patient outcomes in both trial and less controlled environments.

Figure 2. World Health Organization Mobile health evidence and reporting assessment schematic depiction of the six stages of the intervention maturity life-cycle, from preprototype to national level deployment.
View this figure

Furthermore, the studies analyzed in this review only considered the use of telephone consultation; however, as mobile data access increases, ease of access to modalities such as image capture and live video streaming will also increase. This may help increase accuracy of diagnosis, as clinicians are able to simultaneously view the surgical site and question the patient. Therefore, ongoing study should not be limited to previously used telemedicine technology but instead focus on the most appropriate in terms of ease of use, accuracy of diagnosis, time and cost.

Conclusion

The use of telephone surveillance has been shown to be a feasible option for follow-up in comparison to in-person diagnosis, with evidence that it is also cost effective. The main advantage of its use is that it can help identify SSIs that would otherwise be unreported, thus increasing the potential prompt management of time sensitive infections. However, currently, the quantitative impact of this intervention has yet to be calculated, so more research is needed to address this. Future studies should also aim to improve the accuracy of diagnosis via telemedicine through strengthening questioning methods and exploring other modalities such as live video streaming. With application of robust telephone screening programs, there is evidence that this has the potential to be a great addition to the tools used to improve the high SSI morbidity and mortality seen in LMICs.

Acknowledgments

This study was funded by the National Institute for Health Research (NIHR) Biomedical Research Centre at University Hospitals Bristol National Health Service (NHS) Foundation Trust and the University of Bristol. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.

Conflicts of Interest

None declared.

Authors' Contributions

CS was responsible for the initial concept, study design, data collection, data interpretation and analysis, as well as drafting the article. SK was involved in the data collection, data interpretation and analysis, as well as the critical revision of the article. AQ was involved in the data analysis and interpretation, and the critical revision of the article. Finally, SP was responsible for the study design, data interpretation and analysis, critical revision of the article, and oversaw supervision of the overall project. All authors reviewed and approved the final version of the manuscript prior to submission.

  1. Owens CD, Stoessel K. Surgical site infections: epidemiology, microbiology and prevention. J Hosp Infect 2008 Nov;70 Suppl 2:3-10. [CrossRef] [Medline]
  2. Allegranzi B, Bagheri Nejad S, Combescure C, Graafmans W, Attar H, Donaldson L, et al. Burden of endemic health-care-associated infection in developing countries: systematic review and meta-analysis. Lancet 2011 Jan 15;377(9761):228-241. [CrossRef] [Medline]
  3. Nguhuni B, De Nardo P, Gentilotti E, Chaula Z, Damian C, Mencarini P, et al. Reliability and validity of using telephone calls for post-discharge surveillance of surgical site infection following caesarean section at a tertiary hospital in Tanzania. Antimicrob Resist Infect Control 2017;6:43 [FREE Full text] [CrossRef] [Medline]
  4. Pathak A, Sharma S, Sharma M, Mahadik VK, Lundborg CS. Feasibility of a Mobile Phone-Based Surveillance for Surgical Site Infections in Rural India. Telemed J E Health 2015 Mar 06;21(11):946-949 [FREE Full text] [CrossRef] [Medline]
  5. Aiken AM, Wanyoro AK, Mwangi J, Mulingwa P, Wanjohi J, Njoroge J, et al. Evaluation of surveillance for surgical site infections in Thika Hospital, Kenya. J Hosp Infect 2013 Feb;83(2):140-145 [FREE Full text] [CrossRef] [Medline]
  6. Boam T, Hueschelrath A, Tho L, da Costa TM, McMurrey A, Gollogly J. Managing Soft Tissue Sarcomas in a Developing Health System. World J Surg 2016 Jul;40(7):1542-1549. [CrossRef] [Medline]
  7. World Bank. World development report: Digital Dividends. Washington DC. USA: The World Bank; 2016.
  8. Odigie VI, Yusufu LMD, Dawotola DA, Ejagwulu F, Abur P, Mai A, et al. The mobile phone as a tool in improving cancer care in Nigeria. Psychooncology 2012 Mar;21(3):332-335. [CrossRef] [Medline]
  9. Foong DYJ, Butler DP, Vanna K, Sok Leng T, Gollogly J. A mobile phone initiative to increase return for speech therapy follow-up after cleft palate surgery in the developing world. J Plast Reconstr Aesthet Surg 2012 Sep;65(9):e260-e261. [CrossRef] [Medline]
  10. Gunter RL, Chouinard S, Fernandes-Taylor S, Wiseman JT, Clarkson S, Bennett K, et al. Current Use of Telemedicine for Post-Discharge Surgical Care: A Systematic Review. J Am Coll Surg 2016 May;222(5):915-927. [CrossRef] [Medline]
  11. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 2009 Aug 18;151(4):264-9, W64. [Medline]
  12. World Bank Data Team. Worldbank.org. New country classifications by income level | The Data Blog The World Bank: The World Bank; 2016:2016-2007.
  13. Institute of Medicine (US) Committee on Evaluating Clinical Applications of Telemedicine. In: Field MJ, editor. Telemedicine: A Guide to Assessing Telecommunications in Health Care. Washington, DC: National Academies Press; 1996.   URL: https://www.ncbi.nlm.nih.gov/books/NBK45448/ [CrossRef]
  14. Horan TC, Andrus M, Dudeck MA. CDC/NHSN surveillance definition of health care-associated infection and criteria for specific types of infections in the acute care setting. Am J Infect Control 2008 Jun;36(5):309-332. [CrossRef] [Medline]
  15. Slim K, Nini E, Forestier D, Kwiatkowski F, Panis Y, Chipponi J. Methodological index for non-randomized studies (MINORS): development and validation of a new instrument. ANZ J Surg 2003 Sep;73(9):712-716. [Medline]
  16. WHO. Monitoring and evaluating digital health interventions: a practical guide to conducting research and assessment. In: WHO. Geneva: World Health Organization; 2016.
  17. WHO. 2010. WHO | Health service delivery costs   URL: http://www.who.int/choice/cost-effectiveness/inputs/en/
  18. Fehr J, Hatz C, Soka I, Kibatala P, Urassa H, Smith T, et al. Risk factors for surgical site infection in a Tanzanian district hospital: a challenge for the traditional National Nosocomial Infections Surveillance system index. Infect Control Hosp Epidemiol 2006 Dec;27(12):1401-1404. [CrossRef] [Medline]
  19. Hutubessy R, Chisholm D, Edejer TT. Generalized cost-effectiveness analysis for national-level priority-setting in the health sector. Cost Eff Resour Alloc 2003 Dec 19;1(1):8 [FREE Full text] [CrossRef] [Medline]
  20. World BNAD. World Bank national accounts data. In: World Bank. Online: The World Bank; 2018.
  21. Lin H, Chen W, Luo L, Congdon N, Zhang X, Zhong X, et al. Effectiveness of a short message reminder in increasing compliance with pediatric cataract treatment: a randomized trial. Ophthalmology 2012 Dec;119(12):2463-2470. [CrossRef] [Medline]
  22. Jüni P, Holenstein F, Sterne J, Bartlett C, Egger M. Direction and impact of language bias in meta-analyses of controlled trials: empirical study. Int J Epidemiol 2002 Feb;31(1):115-123. [Medline]
  23. Moher D, Pham B, Klassen TP, Schulz KF, Berlin JA, Jadad AR, et al. What contributions do languages other than English make on the results of meta-analyses? J Clin Epidemiol 2000 Sep;53(9):964-972. [Medline]
  24. GlobalSurg Collaborative. Surgical site infection after gastrointestinal surgery in high-income, middle-income, and low-income countries: a prospective, international, multicentre cohort study. Lancet Infect Dis 2018 May;18(5):516-525 [FREE Full text] [CrossRef] [Medline]


CDC: centers for disease control and prevention
CHOICE: Choosing interventions that are cost-effective
DALY: Disability adjusted life years
GDP: gross domestic product
GNI: Gross national income
LMIC: Low-middle income country
mERA: Mobile health evidence and reporting assessment
NHS: National Health Service
NIHR: National Institute for Health Research
SSI: surgical site infection
USD: United States dollar
WHO: World Health Organization


Edited by G Eysenbach; submitted 04.01.19; peer-reviewed by F Kaliyadan, A Tsanas, E Caiani; comments to author 28.04.19; revised version received 07.06.19; accepted 17.06.19; published 19.08.19

Copyright

©Charlotte EJ Sandberg, Stephen R Knight, Ahmad Uzair Qureshi, Samir Pathak. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 19.08.2019.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.