Background: Patients with spinal cord injury (SCI) usually present with different motor impairments, including a deterioration of upper limb motor function (ULMF), that limit their performance of activities of daily living and reduce their quality of life. Virtual reality (VR) is being used in neurological rehabilitation for the assessment and treatment of the physical impairments of this condition.
Objective: A systematic review and meta-analysis was conducted to evaluate the effectiveness of VR on ULMF in patients with SCI compared with conventional physical therapy.
Methods: The search was performed from October to December 2019 in Embase, Web of Science, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Scopus, Medline, Physiotherapy Evidence Database (PEDro), PubMed, and Cochrane Central Register of Controlled Trials. The inclusion criteria of selected studies were as follows: (1) comprised adults with SCI, (2) included an intervention with VR, (3) compared VR intervention with conventional physical therapy, (4) reported outcomes related to ULMF, and (5) was a controlled clinical trial. The Cochrane Collaboration’s tool was used to evaluate the risk of bias. The RevMan 5.3 statistical software was used to obtain the meta-analysis according to the standardized mean difference (SMD) and 95% CIs.
Results: Six articles were included in this systematic review. Four of them contributed information to the meta-analysis. A total of 105 subjects were analyzed. All of the studies used semi-immersive or nonimmersive VR systems. The statistical analysis showed nonsignificant results for the Nine-Hole Peg Test (SMD –0.93, 95% CI –1.95 to 0.09), muscle balance test (SMD –0.27, 95% CI –0.82 to 0.27), Motricity Index (SMD 0.16, 95% CI −0.37 to 0.68), Jebsen-Taylor Hand Function Test (JTHFT) subtests (writing, SMD –0.10, 95% CI –4.01 to 3.82; simulated page turning, SMD –0.99, 95% CI –2.01 to 0.02; simulated feeding, SMD –0.64, 95% CI –1.61 to 0.32; stacking checkers, SMD 0.99, 95% CI –0.02 to 2.00; picking up large light objects, SMD –0.42, 95% CI –1.37 to 0.54; and picking up large heavy objects, SMD 0.52, 95% CI –0.44 to 1.49), range of motion of shoulder abduction/adduction (SMD –0.23, 95% CI –1.48 to 1.03), shoulder flexion/extension (SMD 0.56, 95% CI –1.24 to 2.36), elbow flexion (SMD –0.36, 95% CI –1.14 to 0.42), elbow extension (SMD –0.21, 95% CI –0.99 to 0.57), wrist extension (SMD 1.44, 95% CI –2.19 to 5.06), and elbow supination (SMD –0.18, 95% CI –1.80 to 1.44). Favorable results were found for the JTHFT subtest picking up small common objects (SMD –1.33, 95% CI –2.42 to –0.24).
Conclusions: The current evidence for VR interventions to improve ULMF in patients with SCI is limited. Future studies employing immersive systems to identify the key aspects that increase the clinical impact of VR interventions are needed, as well as research to prove the benefits of the use of VR in the rehabilitation of patients with SCI in the clinical setting.
The global estimate of the spinal cord injury (SCI) prevalence is 223 to 755 per million people and the worldwide incidence is 10.4 to 83 per million people per year . SCI produces a high impact on the health care system and society [ ]. Patients with SCI usually present with different motor impairments, including a deterioration of upper limb motor function (ULMF), causing an important limitation in the performance of activities of daily living and a loss of quality of life [ , ].
Neurological rehabilitation benefits from virtual reality (VR), which is being used for the assessment and treatment of physical and cognitive impairments, for pain management, and even to acquire surgical skills . This technology is becoming more portable, immersive, and vivid, making it more suitable for a wider range of clinical applications [ ]. VR systems allow the creation of virtual environments that can be used to practice, under controlled conditions, different activities that could be hazardous in a real-world setting [ ]. Different characteristics such as difficulty, intensity, exposure duration, and feedback can be adjusted to provide personalized experiences [ ]. Furthermore, VR and interactive video gaming are presented as a motivational therapy that could increase patient adherence to treatment [ , ]. VR-based interventions are usually provided by commercial devices such as Nintendo Wii [ ], PlayStation [ ], and Xbox Kinect [ ], among others. According to the level of immersion, VR systems can be divided into immersive, semi-immersive, or nonimmersive systems. Immersive systems provide a full integration into the virtual environment that is delivered through head-mounted displays and VR caves. Semi-immersive and nonimmersive systems consist of displaying the environment through a screen and these systems are usually used in video game consoles. Furthermore, VR systems can be combined with different devices such as gloves, electrical stimulation devices, and exoskeletons [ ].
Several studies on the use of VR interventions have been carried out in different neurological disorders, such as stroke [- ], cerebral palsy [ , ], Parkinson disease [ , ], and multiple sclerosis [ - ]. Nevertheless, the odds of a successful recovery are different for each disease, so the results obtained by VR interventions could be different as well. Specifically, patients with SCI usually suffer from significant participation restrictions [ ], so the physical treatment should be focused on keeping the residual functionality after SCI [ ].
SCI occurs with greater frequency at the cervical and thoracic levels than at lumbosacral levels. Patients with cervical and thoracic SCI can suffer loss of arm and hand function and consequently reduce significantly their autonomy and independence. However, small improvements in arm and hand function could improve the performance of the activities of daily living, independence, and quality of life, and thus recovering ULMF in patients with cervical and thoracic levels of SCI is a primary challenge . In this sense, the scientific evidence through systematic reviews and meta-analyses on the potential use of VR systems to recover ULMF in patients with SCI is limited. de Araújo et al [ ] stated that VR therapy could be used to improve motor function. A structured review performed by Yeo et al [ ] concluded that VR therapy provides benefits on balance and posture. Conversely, a recent meta-analysis published by our group [ ] suggested that VR interventions mat not be effective to improve the functional performance after SCI. Nevertheless, the previous reviews were not restricted specifically to the assessment of ULMF. We hypothesize that VR therapy could stimulate patients’ attention and motivation, making the intervention more effective than conventional physical therapy (CPT). Therefore, the main objective of this systematic review and meta-analysis was to evaluate the effectiveness of VR interventions in the recovery of ULMF in patients with SCI.
The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines  were followed to perform this systematic review. The search protocol was registered in the International Prospective Register of Systematic Reviews (PROSPERO) database (CRD 42018093855). The literature search was performed between October and December 2019 in the following electronic databases: Embase, Web of Science, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Scopus, Medline, Physiotherapy Evidence Database (PEDro), PubMed, and Cochrane Central Register of Controlled Trials (CENTRAL). The following descriptor terms combined with Boolean operators were employed: (“spinal cord injuries” OR “spinal cord injury” OR “quadriplegia” OR “paraplegia” OR “tetraplegia”) AND (“virtual reality exposure therapy” OR “virtual reality” OR “augmented reality” OR “virtual systems” OR “video games” OR “videogame” OR “exergaming” OR “exergames” OR “commercial games” OR “play-based therapy”). Medical Subject Headings (MeSH) descriptors were used in PubMed database: “virtual reality exposure therapy,” “virtual reality,” “spinal cord injuries,” and “video games.” The search was filtered to include full-text clinical trials papers. No date or language filters were applied.
The Population, Intervention, Comparison, Outcomes and Study (PICOS) design model was used to establish the article inclusion criteria: (1) population: adults with SCI; (2) intervention: VR interventions; (3) comparison: adults with SCI performing CPT; (4) outcome: outcomes specifically related to ULMF, such as muscle strength, range of motion (ROM), dexterity, grasp and pinch force, and hand function; and (5) study design: controlled clinical trials. Articles of studies which included participants with SCI and other pathologies but did not provide the outcome data for each specific population were excluded.
Study Selection Process and Data Extraction
The literature search was carried out by combining keywords in the scientific databases mentioned above and duplicated articles were excluded. Next, titles and abstracts were reviewed, and we excluded those articles that did not meet the established inclusion criteria. The remaining articles were analyzed strictly and were finally included in the systematic review. Two reviewers (ADM-R and MDR) took part independently in the study selection process, review, and systematic data extraction. A third reviewer (DLA) took part in achieving consensus in cases of dispute. The following data were extracted from the studies: (1) author and date of publication; (2) number and age of participants, levels of injury, and mean time post onset; (3) and characteristics of the interventions (intervention types in each group, outcome measures, measuring instrument) and results.
Tools for Assessing the Risk of Bias of the Studies
The Cochrane Collaboration’s tool  and Review Manager (RevMan) software (version 5.3; The Nordic Cochrane Centre, The Cochrane Collaboration, 2014), which includes a description and evaluation of each item by means of a bias table, were used to assess the risk of bias. After assessing the risk of bias of each study, the studies were categorized as “low risk,” “high risk,” or “unclear risk.” Two reviewers carried out the assessment independently. In cases of doubt, the final decision was determined through discussion including a third reviewer.
The meta-analysis compared CPT with VR interventions. The studies were divided into subgroups based on the measuring instrument that was used in the study. If more than one instrument was used in the same study, we included the study in more than one subgroup. The differences in the effect size (postintervention minus preintervention) between the groups were analyzed in terms of the standardized mean difference. The confidence level was set at 95% (significance at P<0.05). Results are shown along with 95% CIs.
The chi-square test and the I2 statistic (percentage of variation across studies that is due to heterogeneity) were used to test the homogeneity, using a fixed-effect model in the case of homogeneity and a random-effects model otherwise.
The analyses were performed using RevMan 5.3 software, and the results are presented in tables and forest plots.
A total of 279 potentially relevant articles were retrieved after the selection process, as shown in. A total of 6 studies were included in the systematic review. Four of them were included in the meta-analysis for statistical comparison.
Assessment of the Risk of Bias of the Studies Included in the Review
Regarding the risk of bias of the studies included in this review, the studies conducted by Kowalczewski et al , Dimbwadyo-Terrer et al [ ], and Prasad et al [ ] presented the lowest risk of bias, as shown in . Furthermore, concerning the risk of bias among the studies analyzed, the lowest biases were found in the selective reporting (0%) and the incomplete outcome data (0%). The highest value (85.5%) was found in the allocation concealment, as shown in .
A total of 103 subjects (control group, n=46; intervention group, n=57) took part in the different studies. A study by Dimbwadyo-Terrer et al  had the highest number of participants (n=31) and a different study by Dimbwadyo-Terrer et al [ ] had the lowest sample size (n=9). The mean age of the participants ranged from 23.7 years [ ] to 54.3 years [ ]. Concerning the neurological level of injury, 4 studies [ , , , ] included participants with American Spinal Injury Association Impairment Scale (AIS) grades A-B injuries, while 2 studies [ , ] included participants with AIS grades A-D injuries. The main characteristics of the participants are shown in .
|Study reference||Total||CGa||IGb||Age (years), mean (SD)||AISc grade||Level of injury||Mean time after disease onset (months)|
|||13||7||6||Overall: 35.9 (11.9)||A-B||C5-C7||Overall: 9.0|
|||10||5||5||CG: 49.0 (6.1)||A-B||C5-C8||CG: 5.8|
|IG: 36.2 (10.4)||IG: 4.2|
|||18||6||12||CG: 42.0 (13.6)||A-B||C5-C8||CG: 3.6|
|IG: 33.6 (14.1)||IG: 6.6|
|||31||15||16||CG: 40.2 (13.6)||A-B||C5-C8||CG: 5.6|
|IG: 34.5 (13.7)||IG: 4.3|
|||9||3||6||CG: 44.2 (22.9)||A-D||T1-T6||CG: 5.0|
|IG: 54.3 (9.9)||IG: 5.8|
|||22||10||12||CG: 33.9 (7.1)||A-D||C5-C8||CG: 10.2|
|IG: 23.7 (5.2)||IG: 15.2|
aCG: control group.
bIG: intervention group.
cAIS: American Spinal Injury Association Impairment Scale.
Concerning the intervention protocols, the VR therapy was applied to the intervention groups via different technological devices while the comparison group performed CPT. The longest total duration of intervention and the highest intensity were achieved by Kowalczewski et al  (5 times/week for 6 weeks). In addition, the longest session duration (60 minutes) was achieved by Kowalczewski et al [ ] and Prasad et al [ ]. Conversely, the shortest intervention time and lowest intensity were achieved by Dimbwadyo-Terrer et al [ ], who only performed 4 sessions (2 times/week for 2 weeks).
VR therapy was provided through different devices, such as the Rehabilitation Joystick for Computerized Exercise (ReJoyce) VR system (Saebo Inc) , Toyra system (National Paraplegics Hospital of Toledo and Rafael del Pino Foundation) [ , , ], Nintendo Wii [ ], and a mesh data glove [ ]. All of the devices used to provide VR therapy were categorized into semi-immersive and nonimmersive VR types. The ReJoyce VR system consists of a workstation where patients can play games shown on a screen through a segmented, jointed, spring-loaded arm. The Toyra system was used in 3 studies [ , , ]. It reproduces the patient movements in real time through an avatar displayed on the screen, and patients can interact with different objects in the virtual environment [ ]. Prasad et al [ ] used the Nintendo Wii video game console. Finally, the study by Dimbwadyo-Terrer et al [ ] used a data glove to interact with the virtual environment, allowing patients to manipulate virtual objects in real time.
Regarding the different deficits treated, all of the studies analyzed the effects of the VR intervention on ULMF. Moreover, the authors focused their interventions on improving upper limb ROM [, , ], upper limb strength [ ], upper limb dexterity [ ], grasp and pinch force [ ], and functional performance [ , , - ]. Most studies reported no significant effects on the different outcomes analyzed. Only the study of Kowalczewski et al [ ] showed benefits on all of the outcomes. Gil-Agudo et al [ ] showed significant results on stacked checked subtest of the Jebsen-Taylor Hand Function Test (JTHFT) [ ], and Dimbwadyo-Terrer et al [ ] got significant benefits for muscle strength measured by the muscle balance test [ ]. shows the main characteristics of the different interventions performed by the different studies.
|Study||Group interventions||Intensity||Session duration||Intervention duration||Outcomes||Measuring instrument||Results|
IGc: ReJoyce VRd system
|5 x/wke||60 minf||6 wksg||Upper limb motor function, ROMh, functional tasks, grasp, and pinch forces||ARATi, ReJoyce automated hand function test||All outcomes showed statistically significant differences and clinically important improvements for IG.|
IG: Toyra VR system
|3 x/wk||30 min||5 wks||Upper limb ROM, motor function and strength, and functional performance||NHPTj, JTHFTk, MIl, BIm, FIMn, SCIMo||No significant differences were found between groups after intervention, except for JTHFT stacking checkers subtest (P=0.008).|
IG: Toyra VR system
|4 x/wk||NDp||3 wks||Upper limb ROM and motor function, and functional performance||MI, MBq, FIM, SCIM||No significant differences were found between groups after intervention.|
IG: Toyra VR system
|3 x/wk||30 min||5 wks||Upper limb motor function and functional performance||MB, MI, FIM, SCIM, BI||No significant differences were found between groups after intervention. At follow-up, only MB was statistically improved (P=0.04).|
IG: VR system + CiberTouch data glove
|2 x/wk||30 min||2 wks||Upper limb motor function and functional performance||NHPT, JTHFT, MB, SCIM||No significant differences were found between groups after intervention.|
IG: Nintendo Wii
|3 x/wk||60 min||4 wks||Upper limb dexterity and motor function, and functional performance||CUEr, BBTs, SCIM, WHOQOL-BREFt||No significant differences were found between groups after intervention.|
aCG: control group.
bCPT: conventional physical therapy.
cIG: intervention group.
dVR: virtual reality.
hROM: range of motion.
iARAT: Action Research Arm Test.
jNHPT: Nine-Hole Peg Test.
kJTHFT: Jebsen-Taylor Hand Function Test.
lMI: Motricity Index.
mBI: Barthel Index.
nFIM: Functional Independence Measure.
oSCIM: Spinal Cord Independence Measure.
pND: not described.
qMB: muscle balance.
rCUE: Capabilities of Upper Extremity.
sBBT: Box and Block Test.
tWHOQOL-BREF: World Health Organization Quality of Life Scale, Abbreviated Version.
Instruments of Measurement Used in the Meta-Analysis
Different scales and tests were used in the studies to assess ULMF. The Nine-Hole Peg Test (NHPT) involves placing and removing pegs into 9 holes, and scores are based on the time taken to complete the activity. This scale is commonly used to measure fine manual dexterity . Muscle balance (MB) tests are used to rate muscle strength, assigning a grade from 0 to 5 according to the strength of the muscle to face the gravity or the force applied by the examiner [ ]. The Motricity Index (MI) measures the range and strength of active movements and each movement is rated on a point scale from 0 to 100 [ ]. The JTHFT assesses the time (in seconds) spent to perform different tasks related to hand functioning, which are commonly used in activities of daily living, and it comprises 7 subtests (writing, simulated page turning, picking up small common objects, simulated feeding, stacking checkers, picking up large light objects, and picking up large heavy objects) [ ]. Finally, ROM tests consist of measuring joint mobility using a goniometer [ ]. A total of 4 studies were included in the meta-analysis.
Two studies [, ] used the NHPT to analyze ULMF. According to the I2 statistic, 0% of variation across studies was due to heterogeneity. This homogeneity was confirmed by the chi-square test (P=0.41). A fixed-effect model was fitted. The study by Gil-Agudo et al [ ] obtained the best results. We observed that VR therapy turned out to be more effective than CPT. However, the overall result of this meta-analysis was not conclusive, as shown in .
Three studies [, , ] analyzed the effects of VR interventions using the results obtained from the MB test. In this group, I2=56%, although the chi-square test (P=0.10) showed homogeneity, and a fixed-effect model was fitted. Favorable results for VR interventions were obtained in the study by Dimbwadyo-Terrer et al [ ]. However, none of these results were statistically significant. The overall result of this meta-analysis was not conclusive, as shown in .
Three studies [, , ] used the MI to assess ULMF. As with the studies that used the NHPT to analyze ULMF, 0% of the variation across studies was due to heterogeneity (I2=0%), and the chi-square test confirmed that finding (P=0.89). A fixed-effect model was fitted. All the studies showed favorable results for VR interventions. However, none of these results were statistically significant. The overall result of this meta-analysis was not conclusive, as shown in .
The JHFT was used to measure the ULMF in two studies [, ]. The results suggested statistically significant results for VR interventions in the “picking up small common objects” subgroup. The overall result for the remaining subgroups was not conclusive ( ).
Finally, the ROM was measured in 2 of the studies [, ]. None of the subgroups in this meta-analysis led to conclusive results, as shown in .
The present research aimed to use meta-analysis to evaluate the effectiveness of VR versus CPT on ULMF in patients with SCI. Six controlled trials were included in the systematic review and 4 of them were included in the meta-analysis. A total of 105 participants were involved in the different studies. In view of our results, we can conclude that there is not enough evidence that VR interventions are more effective than CPT in helping patients to recover ULMF after SCI.
These results match with those obtained in our previous meta-analysis  on functional performance recovery in patients with SCI. Furthermore, from the 6 studies included in this review, 5 [ , , - ] analyzed the effects of VR therapy on functional performance and none of them showed significant results. According to the International Classification of Functioning, Disability and Health (ICF), we can hypothesize that ULMF impairments influence the loss of functional performance, since impairments at the body structure and functional level can influence activity limitations and participation restrictions [ ]. Conversely, our results do not match with those of Yeo et al [ ] and de Araújo et al [ ], who reported positive effects of VR interventions on motor function, but the reviews were not restricted specifically to assess ULMF. We suggest that the inconclusive results on ULMF revealed in the present review could have been affected by the type of VR devices used in the interventions. All of the studies performed the VR interventions through semi-immersive or nonimmersive systems, where a computer or video game console displayed the virtual environment through a screen [ ]. None of the studies used immersive VR devices, which could provoke more task-focused attention than semi-immersive and nonimmersive devices [ ]. Additionally, other heterogeneous factors could have influenced the results obtained, such as different tasks being performed in the VR sessions, different protocols being used for VR interventions and CPT, different session and program durations, and the participants’ characteristics. Therefore, it would be desirable to unify protocols in order to clarify which factors of VR interventions may be more appropriate to achieve the intended effects.
Concerning the characteristics of participants, the injury severity was measured by AIS grades. Most studies [, , , ] included participants with AIS grades A-B, while 2 studies [ , ] included AIS grades A-D. Regarding the levels of injury, most studies [ , , , , ] included patients with cervical levels of injury. Although several positive effects were found in patients with AIS A-B grades and cervical levels, we cannot conclude that the recovery of ULMF is related to the level of injury. Regarding the different effects obtained in the studies, of the 6 studies included in the present review, only the study by Kowalczewski et al [ ] showed significant improvements in ULMF, ROM, functional tasks, grasp, and pinch forces. These improvements might have been seen in the study because the intervention had the longest total duration and a higher intensity (60 minutes, 5 times/week for 6 weeks).
Although VR systems have the potential to provide precise measurement of motor outcomes, provide direct feedback and safe environments [, ], and increase patient motivation and treatment adherence [ ] in clinical settings, we did not find differences between VR interventions and CPT in improving ULMF in patients with SCI. According to Morone et al [ ], further research is needed in order to develop accurate user guidelines before VR systems are ready for market, to develop immersive VR systems based on personalized neurological characteristics optimizing motor learning processes [ ], to implement adequate training to health care professionals [ ], and to integrate this technology into neurological rehabilitation [ ].
Limitations and Recommendations for Future Research
Some limitations of the study should be mentioned. The results provided by the present review should be viewed with caution because of the limited number of controlled trials analyzed. Another limitation was the small sample size used in the studies and the different injury levels of the patients. Thus, we encourage authors to use large sample sizes and to include an appropriate number of subjects in stratified groups in order to know which factors of the participants’ characteristics are influencing the results. Nevertheless, these patients are usually treated in neurological institutions or centers and it is difficult to get large sample sizes. Thus, most studies include convenience samples, resulting in potential selection biases . Furthermore, the heterogeneous protocols used in terms of VR devices employed, program and session durations, and CPT protocols used could affect the results obtained in this review.
In this sense, we encourage researchers to perform randomized controlled trials with higher methodological quality using larger sample sizes, and to unify VR intervention protocols in order to identify the key aspects of VR interventions that have the greatest impact on ULMF recovery after SCI. In addition, because task-focused attention is stimulated more with immersive VR devices than with semi-immersive and nonimmersive devices  and no positive results on ULMF were obtained using semi-immersive and nonimmersive VR devices in the studies analyzed in this review, we encourage researchers to use immersive VR devices in their future clinical trials. Finally, we urge researchers to analyze the effectiveness of the application of different CPT techniques in patients with SCI in order to provide further evidence for this topic.
Although the use of VR devices has expanded in neurological rehabilitation, the current evidence for using VR interventions to improve ULMF in patients with SCI is limited. Specifically, our results showed that VR may not be more effective than CPT in ULMF recovery. This may be explained by the fact that all the studies used semi-immersive and nonimmersive devices, and these devices require less task-focused attention than immersive VR devices. No solid conclusions can be drawn concerning the relationship between injury levels and severity and the effects of VR interventions.
In view of our results, it is necessary to conduct clinical trials with a high methodological quality, using larger sample sizes, and to unify VR intervention protocols in order to identify the key aspects that increase the clinical impact of VR interventions in neurological rehabilitation. Further research is needed to provide evidence for the application of VR devices to facilitate ULMF recovery in patients with SCI.
Conceptualization and methodology: ADM-R, MDR, DL-A, and AA-R. Statistical analysis: AS. Writing—original draft preparation: ADM-R, DL-A, and JAM-M. Writing—review and editing: DL-A, JAM-M, and AS. All authors have read and agreed to the published version of the manuscript.
Conflicts of Interest
- Wyndaele M, Wyndaele J. Incidence, prevalence and epidemiology of spinal cord injury: what learns a worldwide literature survey? Spinal Cord 2006 Jan 3;44(9):523-529. [CrossRef]
- Yoon SY, Leigh J, Lee J, Kim WH. Comparing Activity and Participation between Acquired Brain Injury and Spinal-Cord Injury in Community-Dwelling People with Severe Disability Using WHODAS 2.0. IJERPH 2020 Apr 27;17(9):3031. [CrossRef]
- Dimbwadyo-Terrer I, Gil-Agudo A, Segura-Fragoso A, de los Reyes-Guzmán A, Trincado-Alonso F, Piazza S, et al. Effectiveness of the Virtual Reality System Toyra on Upper Limb Function in People with Tetraplegia: A Pilot Randomized Clinical Trial. Biomed Res Int 2016;2016:6397828 [FREE Full text] [CrossRef] [Medline]
- Pourmand A, Davis S, Lee D, Barber S, Sikka N. Emerging Utility of Virtual Reality as a Multidisciplinary Tool in Clinical Medicine. Games Health J 2017 Oct;6(5):263-270. [CrossRef] [Medline]
- Birckhead B, Khalil C, Liu X, Conovitz S, Rizzo A, Danovitch I, et al. Recommendations for Methodology of Virtual Reality Clinical Trials in Health Care by an International Working Group: Iterative Study. JMIR Ment Health 2019 Jan 31;6(1):e11973 [FREE Full text] [CrossRef] [Medline]
- de Lama C, González-Gaya C, Sánchez-Lite A. An Experimental Test Proposal to Study Human Behaviour in Fires Using Virtual Environments. Sensors (Basel) 2020 Jun 26;20(12):3607 [FREE Full text] [CrossRef] [Medline]
- Oña ED, Jardón A, Cuesta-Gómez A, Sánchez-Herrera-Baeza P, Cano-de-la-Cuerda R, Balaguer C. Validity of a Fully-Immersive VR-Based Version of the Box and Blocks Test for Upper Limb Function Assessment in Parkinson’s Disease. Sensors 2020 May 13;20(10):2773. [CrossRef]
- Gil-Agudo A, Dimbwadyo-Terrer I, Peñasco-Martín B, de los Reyes-Guzmán A, Bernal-Sahún A, Berbel-García A. Experiencia clínica de la aplicación del sistema de realidad TOyRA en la neuro-rehabilitación de pacientes con lesión medular. Rehabilitación 2012 Jan;46(1):41-48. [CrossRef]
- D'Addio G, Iuppariello L, Gallo F, Bifulco P, Cesarelli M, Lanzillo B. Comparison between clinical and instrumental assessing using Wii Fit system on balance control. In: IEEE. New York, USA: IEEE; 2014 Jun 11 Presented at: 2014 IEEE International Symposium on Medical Measurements and Applications (MeMeA); 2014; Lisboa, Portugal p. 1-5. [CrossRef]
- Franco JR, Jacobs K, Inzerillo C, Kluzik J. The effect of the Nintendo Wii Fit and exercise in improving balance and quality of life in community dwelling elders. THC 2012 May 01;20(2):95-115. [CrossRef]
- Khurana M, Walia S, Noohu MM. Study on the Effectiveness of Virtual Reality Game-Based Training on Balance and Functional Performance in Individuals with Paraplegia. Top Spinal Cord Inj Rehabil 2017 Jun;23(3):263-270 [FREE Full text] [CrossRef] [Medline]
- Park D, Lee D, Lee K, Lee G. Effects of Virtual Reality Training using Xbox Kinect on Motor Function in Stroke Survivors: A Preliminary Study. Journal of Stroke and Cerebrovascular Diseases 2017 Oct;26(10):2313-2319. [CrossRef]
- Domínguez-Téllez P, Moral-Muñoz JA, Salazar A, Casado-Fernández E, Lucena-Antón D. Game-Based Virtual Reality Interventions to Improve Upper Limb Motor Function and Quality of Life After Stroke: Systematic Review and Meta-analysis. Games Health J 2020 Feb 01;9(1):1-10. [CrossRef] [Medline]
- Dominguez-Tellez P, Moral-Munoz JA, Casado-Fernandez E, Salazar A, Lucena-Anton D. [Effects of virtual reality on balance and gait in stroke: a systematic review and meta-analysis]. Rev Neurol 2019 Sep 16;69(6):223-234 [FREE Full text] [CrossRef] [Medline]
- Ikbali Afsar S, Mirzayev I, Umit Yemisci O, Cosar Saracgil SN. Virtual Reality in Upper Extremity Rehabilitation of Stroke Patients: A Randomized Controlled Trial. J Stroke Cerebrovasc Dis 2018 Dec;27(12):3473-3478. [CrossRef] [Medline]
- Bonuzzi GMG, de Freitas TB, Palma GCDS, Soares MAA, Lange B, Pompeu JE, et al. Effects of the brain-damaged side after stroke on the learning of a balance task in a non-immersive virtual reality environment. Physiother Theory Pract 2020 Feb 24:1-8. [CrossRef] [Medline]
- Garcia-Munoz C, Casuso-Holgado M. [Effectiveness of Wii Fit Balance board in comparison with other interventions for post-stroke balance rehabilitation. Systematic review and meta-analysis]. Rev Neurol 2019 Oct 01;69(7):271-279 [FREE Full text] [CrossRef] [Medline]
- Booth ATC, Buizer AI, Meyns P, Oude Lansink ILB, Steenbrink F, van der Krogt MM. The efficacy of functional gait training in children and young adults with cerebral palsy: a systematic review and meta-analysis. Dev Med Child Neurol 2018 Mar 07;60(9):866-883. [CrossRef]
- Johansen T, Strøm V, Simic J, Rike P. Effectiveness of training with motion-controlled commercial video games for hand and arm function in people with cerebral palsy: A systematic review and meta-analysis. J Rehabil Med 2020 Jan;52(1):-10. [CrossRef]
- Feng H, Li C, Liu J, Wang L, Ma J, Li G, et al. Virtual Reality Rehabilitation Versus Conventional Physical Therapy for Improving Balance and Gait in Parkinson’s Disease Patients: A Randomized Controlled Trial. Med Sci Monit 2019 Jun 05;25:4186-4192. [CrossRef]
- Lei C, Sunzi K, Dai F, Liu X, Wang Y, Zhang B, et al. Effects of virtual reality rehabilitation training on gait and balance in patients with Parkinson's disease: A systematic review. PLoS ONE 2019 Nov 7;14(11):e0224819. [CrossRef]
- Moreno-Verdu M, Ferreira-Sanchez MR, Cano-de-la-Cuerda R, Jimenez-Antona C. [Efficacy of virtual reality on balance and gait in multiple sclerosis. Systematic review of randomized controlled trials]. Rev Neurol 2019 May 01;68(9):357-368 [FREE Full text] [CrossRef] [Medline]
- Norouzi E, Gerber M, Pühse U, Vaezmosavi M, Brand S. Combined virtual reality and physical training improved the bimanual coordination of women with multiple sclerosis. Neuropsychol Rehabil 2020 Jan 23:1-18. [CrossRef] [Medline]
- Maggio MG, Russo M, Cuzzola MF, Destro M, La Rosa G, Molonia F, et al. Virtual reality in multiple sclerosis rehabilitation: A review on cognitive and motor outcomes. Journal of Clinical Neuroscience 2019 Jul;65:106-111. [CrossRef]
- Sale P, Russo EF, Russo M, Masiero S, Piccione F, Calabrò RS, et al. Effects on mobility training and de-adaptations in subjects with Spinal Cord Injury due to a Wearable Robot: a preliminary report. BMC Neurol 2016 Jan 28;16(1). [CrossRef]
- de Araújo AVL, Ribeiro FPG, Massetti T, Potter-Baker KA, Cortes M, Plow EB, et al. Effectiveness of anodal transcranial direct current stimulation to improve muscle strength and motor functionality after incomplete spinal cord injury: a systematic review and meta-analysis. Spinal Cord 2020 Feb 17;58(6):635-646. [CrossRef]
- de Araújo AVL, Neiva JFDO, Monteiro CBDM, Magalhães FH. Efficacy of Virtual Reality Rehabilitation after Spinal Cord Injury: A Systematic Review. Biomed Res Int 2019;2019:7106951 [FREE Full text] [CrossRef] [Medline]
- Yeo E, Chau B, Chi B, Ruckle D, Ta P. Virtual Reality Neurorehabilitation for Mobility in Spinal Cord Injury: A Structured Review. Innov Clin Neurosci 2019 Jan 01;16(1-2):13-20 [FREE Full text] [Medline]
- De Miguel-Rubio A, Rubio MD, Salazar A, Camacho R, Lucena-Anton D. Effectiveness of Virtual Reality on Functional Performance after Spinal Cord Injury: A Systematic Review and Meta-Analysis of Randomized Controlled Trials. JCM 2020 Jul 01;9(7):2065. [CrossRef]
- Hutton B, Catalá-López F, Moher D. The PRISMA statement extension for systematic reviews incorporating network meta-analysis: PRISMA-NMA. Medicina Clínica (English Edition) 2016 Sep;147(6):262-266. [CrossRef]
- Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Cochrane Bias Methods Group, Cochrane Statistical Methods Group. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ 2011 Oct 18;343(oct18 2):d5928-d5928 [FREE Full text] [CrossRef] [Medline]
- Kowalczewski J, Chong SL, Galea M, Prochazka A. In-Home Tele-Rehabilitation Improves Tetraplegic Hand Function. Neurorehabil Neural Repair 2011 Mar 03;25(5):412-422. [CrossRef]
- Prasad S, Aikat R, Labani S, Khanna N. Efficacy of Virtual Reality in Upper Limb Rehabilitation in Patients with Spinal Cord Injury: A Pilot Randomized Controlled Trial. Asian Spine J 2018 Oct;12(5):927-934. [CrossRef]
- Dimbwadyo-Terrer I, Trincado-Alonso F, de Los Reyes-Guzmán A, Aznar MA, Alcubilla C, Pérez-Nombela S, et al. Upper limb rehabilitation after spinal cord injury: a treatment based on a data glove and an immersive virtual reality environment. Disabil Rehabil Assist Technol 2016 Aug 16;11(6):462-467. [CrossRef] [Medline]
- Dimbwadyo-Terrer I, Trincado-Alonso F, De los Reyes-Guzmán A, Bernal-Sahún A, López-Monteagudo P, Polonio-López B. Clinical, functional and kinematic correlations using the Virtual Reality System toyra® as upper limb rehabilitation tool in people with spinal cord injury. In: NEUROTECHNIX.: NEUROTECHNIX; 2013 Presented at: NEUROTECHNIX 2013 - International Congress on Neurotechnology, Electronics and Informatics; 18-20 September; Algarve, Portugal p. 81-88. [CrossRef]
- Sears ED, Chung KC. Validity and responsiveness of the Jebsen-Taylor Hand Function Test. J Hand Surg Am 2010 Jan;35(1):30-37 [FREE Full text] [CrossRef] [Medline]
- Perry J, Weiss W, Burnfield J, Gronley J. The supine hip extensor manual muscle test: a reliability and validity study. Arch Phys Med Rehabil 2004 Aug;85(8):1345-1350. [CrossRef] [Medline]
- Wang Y, Bohannon RW, Kapellusch J, Garg A, Gershon RC. Dexterity as measured with the 9-Hole Peg Test (9-HPT) across the age span. Journal of Hand Therapy 2015 Jan;28(1):53-60. [CrossRef]
- Demeurisse G, Demol O, Robaye E. Motor Evaluation in Vascular Hemiplegia. Eur Neurol 2008 Jan 29;19(6):382-389. [CrossRef]
- Gajdosik R, Bohannon R. Clinical measurement of range of motion. Review of goniometry emphasizing reliability and validity. Phys Ther 1987 Dec;67(12):1867-1872. [CrossRef] [Medline]
- Sullivan K, Cen S. Model of disablement and recovery: knowledge translation in rehabilitation research and practice. Phys Ther 2011 Dec;91(12):1892-1904. [CrossRef] [Medline]
- Gokeler A, Bisschop M, Myer GD, Benjaminse A, Dijkstra PU, van Keeken HG, et al. Immersive virtual reality improves movement patterns in patients after ACL reconstruction: implications for enhanced criteria-based return-to-sport rehabilitation. Knee Surg Sports Traumatol Arthrosc 2016 Jul 14;24(7):2280-2286. [CrossRef] [Medline]
- Gutiérrez Á, Sepúlveda-Muñoz D, Gil-Agudo Á, de los Reyes Guzmán A. Serious Game Platform with Haptic Feedback and EMG Monitoring for Upper Limb Rehabilitation and Smoothness Quantification on Spinal Cord Injury Patients. Applied Sciences 2020 Feb 02;10(3):963. [CrossRef]
- Morone G, Paolucci S, Mattia D, Pichiorri F, Tramontano M, Iosa M. The 3Ts of the new millennium neurorehabilitation gym: therapy, technology, translationality. Expert Rev Med Devices 2016 Sep 13;13(9):785-787. [CrossRef] [Medline]
- Sánchez-Herrera-Baeza P, Cano-de-la-Cuerda R, Oña-Simbaña ED, Palacios-Ceña D, Pérez-Corrales J, Cuenca-Zaldivar JN, et al. The Impact of a Novel Immersive Virtual Reality Technology Associated with Serious Games in Parkinson's Disease Patients on Upper Limb Rehabilitation: A Mixed Methods Intervention Study. Sensors (Basel) 2020 Apr 11;20(8):2168 [FREE Full text] [CrossRef] [Medline]
- Massetti T, da Silva TD, Crocetta TB, Guarnieri R, de Freitas BL, Bianchi Lopes P, et al. The Clinical Utility of Virtual Reality in Neurorehabilitation: A Systematic Review. J Cent Nerv Syst Dis 2018 Nov 27;10:1179573518813541 [FREE Full text] [CrossRef] [Medline]
- Morone G, Tramontano M, Iosa M, Shofany J, Iemma A, Musicco M, et al. The efficacy of balance training with video game-based therapy in subacute stroke patients: a randomized controlled trial. Biomed Res Int 2014;2014:580861 [FREE Full text] [CrossRef] [Medline]
- Miot H. Tamanho da amostra em estudos clínicos e experimentais. J. vasc. bras 2011 Dec;10(4):275-278. [CrossRef]
|AIS: American Spinal Injury Association Impairment Scale|
|CENTRAL: Cochrane Central Register of Controlled Trials|
|CINAHL: Cumulative Index to Nursing and Allied Health Literature|
|CPT: conventional physical therapy|
|ICF: International Classification of Functioning, Disability and Health|
|JTHFT: Jebsen-Taylor Hand Function Test|
|MeSH: Medical Subject Headings|
|MI: Motricity Index|
|NHPT: Nine-Hole Peg Test|
|PEDro: Physiotherapy Evidence Database|
|PICOS: Population, Intervention, Comparison, Outcomes and Study|
|PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses|
|PROSPERO: International Prospective Register of Systematic Reviews|
|ROM: range of motion|
|SCI: spinal cord injury|
|ULMF: upper limb motor function|
|VR: virtual reality|
Edited by L Buis; submitted 15.07.20; peer-reviewed by R Sobrino, D Scalzitti; comments to author 02.10.20; revised version received 16.10.20; accepted 06.11.20; published 03.12.20Copyright
©Amaranta De Miguel-Rubio, M Dolores Rubio, Alvaro Alba-Rueda, Alejandro Salazar, Jose A Moral-Munoz, David Lucena-Anton. Originally published in JMIR mHealth and uHealth (http://mhealth.jmir.org), 03.12.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.