This paper is in the following e-collection/theme issue:

mHealth for Data Collection and Research (917) mHealth for Rehabilitation (236)

Published on in Vol 7, No 8 (2019): August

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/12434, first published .
Intraindividual Variability Measurement of Fine Manual Motor Skills in Children Using an Electronic Pegboard: Cohort Study

Intraindividual Variability Measurement of Fine Manual Motor Skills in Children Using an Electronic Pegboard: Cohort Study

Intraindividual Variability Measurement of Fine Manual Motor Skills in Children Using an Electronic Pegboard: Cohort Study

Authors of this article:

Diego Rivera1 Author Orcid Image ;   Antonio García1 Author Orcid Image ;   Jose Eugenio Ortega2 Author Orcid Image ;   Bernardo Alarcos1 Author Orcid Image ;   Kevin van der Meulen3 Author Orcid Image ;   Juan R Velasco1 Author Orcid Image ;   Cristina del Barrio3 Author Orcid Image
Article Authors Cited by (4) Tweetations (3) Metrics

    Original Paper

    1Departamento de Automática, Escuela Politécnica Superior, Universidad de Alcalá, Alcalá de Henares, Spain

    2Departamento de Psicología Biológica y de la Salud, Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain

    3Departamento de Psicología Evolutiva y de la Educación, Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain

    Corresponding Author:

    Diego Rivera, PhD

    Departamento de Automática

    Escuela Politécnica Superior

    Universidad de Alcalá

    Campus Universitario

    Ctra Madrid-Barcelona, Km 33,600

    Alcalá de Henares, 28871

    Spain

    Phone: 34 918856644

    Email: diego.rivera@uah.es


    Background: Pegboard tests are a powerful technique used by health and education professionals to evaluate manual dexterity and fine motor speed, both in children and adults. Using traditional pegboards in tests, the total time that, for example, a 4-year-old child needs for inserting pegs in a pegboard, with the left or right hand, can be measured. However, these measurements only allow for studying the variability among individuals, whereas no data can be obtained on the intraindividual variability in inserting and removing these pegs with one and the other hand.

    Objective: The aim of this research was to study the intraindividual variabilities in fine manual motor skills of 2- to 3-year-old children during playing activities, using a custom designed electronic pegboard.

    Methods: We have carried out a pilot study with 39 children, aged between 25 and 41 months. The children were observed while performing a task involving removing 10 pegs from 10 holes on one side and inserting them in 10 holes on the other side of a custom-designed sensor-based electronic pegboard, which has been built to be able to measure the times between peg insertions and removals.

    Results: A sensor-based electronic pegboard was successfully developed, enabling the collection of single movement time data. In the piloting, a lower intraindividual variability was found in children with lower placement and removal times, confirming Adolph et al’s hypothesis.

    Conclusions: The developed pegboard allows for studying intraindividual variability using automated wirelessly transmitted data provided by its sensors. This novel technique has been useful in studying and validating the hypothesis that children with lower movement times present lower intraindividual variability. New research is necessary to confirm these findings. Research with larger sample sizes and age ranges that include additional testing of children’s motor development level is currently in preparation.

    JMIR Mhealth Uhealth 2019;7(8):e12434

    doi:10.2196/12434

    Keywords

    child development; psychology, developmental; play and playthings; motor skills; smartphone 


    Overview

    In the research on child development, especially in the field of manual dexterity and fine motor skills, professionals use scales and tests to help them in the evaluation of the child’s progress and in the detection of possible developmental delays [1,2]. These scales often involve the performance of specific activities using particular objects; among them are pegboards. A pegboard is a wooden or other material platform with holes, usually displayed along 2 parallel rows. A set of cylindrical pegs can be inserted into the holes. Depending on the scale, different measures are obtained with pegboards. For example, the time a child needs to place a particular number of pegs into the holes, withdrawing them from a container at the side of the pegboard is measured by means of a stopwatch (9-Hole Pegboard Dexterity Test). In another scale, the number of pegs that are placed in a given time lapse is counted (30 seconds in the Purdue Pegboard Test) [3].

    Background

    Pegboards have a long tradition in research on manual dexterity, so much that some of them have not changed substantially since 1948, as is the case of the Purdue pegboard [4]. Over time, new pegboards have appeared with their corresponding normative scores [5], such as the Functional Dexterity Test, which has been designed specifically to evaluate the functional level of persons with impairments of the dominant or nondominant hand, or the 9-Hole Peg Test, with existing norms for both children and adults [6]. The latter pegboard has been included in the test battery Toolbox Assessment of Neurological and Behavioral Function, recommended for its high reliability, easy application, and low cost by the National Institutes of Health [7]. These various pegboards have been tested with children [8,9] and adults [10], and can be used to evaluate manual dexterity of persons with Parkinson disease [11], Down syndrome [12], Asperger syndrome or autism [13,14], or primary school children with writing difficulties [15].

    When using these pegboards, measurement accuracy depends on the skills of the professional. In addition, it is not possible to measure the time of inserting each single peg using a manual stopwatch, and consequently only the total time per trial can be obtained, for example, the time of a trial that comprises inserting 10 pegs in a board with the right hand.

    An essential quality of motor development is its variability [16], both among various subjects (interindividual variability), as well as within the same person at different test moments (intraindividual variability). Although traditional pegboards provide information of interindividual variability [17,18], they cannot provide immediate data on intraindividual variability. Trials would need to be repeated several times to test the variability among performances of the same individual, which is difficult to do with children, especially very young children.

    A growing number of authors emphasize the importance of intraindividual variability in motor development [19-21] and relate it to a lack of motor control in the process of acquiring new skills [16]. This hypothesis has been confirmed in research that includes measuring the reaction times to stimuli presented to children with attention-deficit/hyperactivity disorder [22,23], as well as in various studies on drawing and writing, with both children with typical development and children with developmental coordination disorder [24].

    However, there are few tools available for the measurement of this intraindividual variability nowadays. On the other hand, using sensor-embedded devices in electronic health environments is becoming a popular research topic as the aggregation and analysis of sensor information is a very promising feature for developing new prevention and management techniques for diverse health issues [25,26], and also there is much literature on the design of sensor-based tools for this purpose [27]. Specifically, some efforts have already been made in the design of devices to help professionals in the study of children’s developmental issues such as autism spectrum disorder [28,29].

    Objectives

    Following this approach, we have designed a sensor-based electronic pegboard, which enables the measurement of the time taken for every single peg removal and placement during the activity. This board, as opposed to traditional pegboards, allows the accurate measurement of intraindividual manual skills by automatically determining the absence or presence of pegs each time a peg is moved. The board is based on the proposals of the Desarrollo de juguetes inteligentes para atención temprana a niños con trastornos del desarrollo en el entorno educativo y en el hogar digital (EDUCERE) project [30,31], which aimed to develop an ecosystem of connected toys and tools to aid professionals in the development assessment tasks. The main architecture and modules developed in the project are described in Rivera et al [32] and are the base of the specific tool proposed here.

    Using this electronic pegboard, we have designed and conducted a cohort study with 2- to 3-year-old children for the evaluation of intraindividual variability when using it for removing and placing pegs. The study and its results are described and discussed in this paper.

    The rest of the paper is organized as follows: the Methods section describes the study carried out, its initial hypothesis, the recruitment process, and a brief description of the designed tool. The results obtained in the cohort study are shown in the Results section, and finally, in the Discussion section, we discuss the results and the possible future steps to take in this research. Finally, we add some technological design details of the sensor-based pegboard in Multimedia Appendix 1.


    According to the hypothesis of Adolph et al [16], motor dexterity development will be accompanied by a decrease of intraindividual variability. Those children who are faster with the pegs will show less intraindividual variability, and this result will be reflected in medium- or high-level correlations between placement and removal times of each hand and the SDs.

    To prove this hypothesis, we have designed a study which could determine the variability of movement times during a playing activity comprising the removal and placement of pegs in a pegboard. A total of 39 children were interviewed, 21 boys and 18 girls. The children were aged between 25 and 41 months (mean=34.03, SD 3.96) and attended a day care center for 0- to 3-year-olds, located at the university campus on the northern side of Madrid.

    Once the school agreed to participate in the study, a letter was sent to the families of the 3 groups of children in the upper grade (2- to 3-year-olds), with a summary of the project and a reference to a more detailed document at their disposal in the school to obtain informed parental consent from each family (see [33] for a detailed description on ethical cautions). The project had been previously approved by the university Commission of Ethics in Science. The children were interviewed in the school setting, in a quiet room by one of the researchers, while another researcher videotaped the child-pegboard interaction and a third one supervised the registration of the activity information. Every child was invited to play with the board and move 5 of the 10 pegs, finding out how the lights would change. After this familiarization activity, the test started, and each child was invited to move the 10 pegs from their original position in row A (the row positioned facing the professional) to the empty holes in row B (the row positioned facing the child; first trial). Once finished, the child was asked to perform the same task with the other hand (second trial). A snapshot of the videotaped activity can be seen in Figure 1.

    ‎
    Figure 1. Snapshot of the prototype sensor-based pegboard being used by a child.
    View this figure

    Given that the traditional pegboards do not allow to measure the intraindividual variability during its use by a single child, we have designed and developed a prototype of a sensor-based electronic pegboard. The physical design of the pegboard proposed in this paper has been based on the current designs used for dexterity tests to maintain the reliability of the tests as much as possible. The design of the board is based on a series of requirements derived from (1) the experts’ needs related to the assessment tests (eg, the mobility-driven design of the device or its size), (2) the children’s interactions with this type of tools (ie, the necessity of a user-friendly simple interface and interaction without any special learning requirement for its use), and (3) the technological limitations and its costs. These requirements have been compiled from different sources such as the literature on pegboard tests, experts’ knowledge of the matter, and the documentation on the available sensor and communications technologies in these environments. Considering these requirements, the proposed electronic pegboard design has been developed as a modular system comprising the pegboard itself, a data collector module, and a user interface accessed through mobile or desktop devices (an example of this interface is shown in Figure 2).

    The modules are independent and communicate between each other using a wireless communications system. The full components overview and its communications can be seen in Figure 3. Further details on the modules’ design can be found in Multimedia Appendix 1.

    To determine the reliability of the pegboard, an additional study was carried out. In this study, the total trial times of the activity of 17 children with the pegs were recorded manually by an expert in manual dexterity using a stopwatch and was compared with the total times obtained electronically. The children were aged between 30 and 41 months and completed 2 trials, one with each hand. Hereafter, the measurements were analyzed, comparing the manually registered with those using the electronic pegboard, finding a high Pearson correlation between the manually and the electronically measured times of the first (r=0.998; P<.001) and the second trials (r=0.997; P<.001).

    ‎
    Figure 2. Example of results of a test as shown in the Web interface from a tablet.
    View this figure
    ‎
    Figure 3. Electronic pegboard system components overview.
    View this figure

    The electronic pegboard has enabled the study of intraindividual variability as the system allows for recording 10 placement times (for each peg) and 9 removal times (for pegs 2 to 10, excluding the first one) in a single trial, instead of 1 single time measurement for the total amount of pegs. In addition, it is possible to obtain the individual profiles of task performance for each child. In the following paragraphs, results concerning the intraindividual variability and individual profiles are reported.

    Specifically, we have recorded the mean and intraindividual values (IIV) for each child performing the activity. The values have been classified depending on the hand used for the movement and the type of movement (placement or removal of pegs) in 4 groups:

    • right hand placement (RP)
    • left hand placement (LP)
    • right hand removal (RR)
    • left hand removal (LR)

    The IIV value for each child is calculated as the SD of the times measured during the activity for each group. These values along with the mean time taken for each movement can contribute to determine if there is a relationship between the intraindividual variability, measured as the time taken to move the pegs, and the dexterity (the mean speed of placement or removal for each hand).

    A correlation analysis among age, the 4 mean measures of dexterity (mean RP, mean LP, mean RR, and mean LR), and the corresponding IIV values was performed. Results (see Table 1) show various negative correlations with age (eg, older children are faster at placing pegs with the right hand). Moreover, positive correlations between mean values and IIV for each hand and movement were found, from r=0.46 (P=.003) to r=0.72 (P<.001).

    Table 1. Pearson correlations between age and placement and removal measures.
    MeasureaAgeMeanb RPcIIVd RPMean LPeIIV LPMean RRfIIV RRMean LRgIIV LR
    Age—h————————
    Mean RP−0.33i————————
    IIV RP−0.170.66j———————
    Mean LP−0.310.44j−0.01——————
    IIV LP−0.38i0.35i0.200.46j—————
    Mean RR−0.180.57j0.190.240.13————
    IIV RR−0.190.29−0.01−0.05−0.150.72j———
    Mean LR−0.310.47j0.140.36i0.270.52j0.36i——
    IIV LR−0.40i0.35i0.150.130.210.250.40i0.72j—

    aAll tests are 2-tailed.

    bMean: mean value for each movement in an activity.

    cRP: right hand placement.

    dIIV: intraindividual variability (SD for the movements in an activity).

    eLP: left hand placement.

    fRR: right hand removal.

    gLR: left hand removal.

    hEmpty cells are meant to avoid repeated correlation values (the table is diagonally symmetric).

    iP<.05.

    jP<.01.

    The increased measurement possibilities with the electronic pegboard makes it possible to obtain individual profiles of the children showing the degree of variability in their performances [15]. As an example, Figure 4 shows placement times of the 10 pegs with both the right and the left hands of 2 children, both 30 months old. The mean time of Child A’s activity with the left hand is 2174.40 millisecond and the IIV value is 728.30 millisecond; with the right hand, mean=1418.78 millisecond and IIV=272.31 millisecond. Child B’s mean time for task performance with the left hand is 2089.78 millisecond and IIV=463.20 millisecond; with the right hand, mean=1725.00 millisecond and IIV=416.04 millisecond.

    For instance, by comparing these results for the 2 children, the differences in their profiles can be observed. Child A shows a lower mean and variability of the right hand compared with the left hand, which possibly reflects the further development of a right manual preference. However, Child B displays more comparable means and very similar variabilities of both hands, and therefore no clear manual preference.

    ‎
    Figure 4. Placement times in ms with left and right hands in two children (Child A and Child B). ms: milliseconds.
    View this figure

    The pilot study carried out with children has proven to be useful to study the intraindividual variability in children. On the basis of Adolph et al’s [16] hypothesis, a lower intraindividual variability was expected in individuals with lower placement and removal times as their motor control increases. Our results show this relation in 3-year-old children, thereby confirming the initial hypothesis.

    Nevertheless, some limitations can be observed in this preliminary study. A first limitation, as a consequence of its exploratory nature, is the low number of participating children. Although significant results were found, this low number of participants did now allow applying Bonferroni corrections, which is necessary when the number of correlations is high, as the results showed. Second, the age ranges of the participants were reduced, which might have caused lower correlations because of the increased homogeneity of the studied population. A third limitation lies in the absence of additional testing of the motor development level and manual dexterity of the children, as well as their manual preference, even though this may not be apparent yet. These issues are being addressed in subsequent studies.

    From a technological point of view, we have presented in this paper a novel sensor-based pegboard design, which shows interesting features for the motor development in children. The study carried out can be seen also as a validation test of the tool design, as the 2- and 3-year-old children have been able to perform all the requested activities without any added difficulty derived from its design.

    In future research, we will work on the integration of the pegboard within an ecosystem of similar sensor-based wireless devices that contribute to centralized data storage and analysis from different activities and perspectives, and therefore, improve the development assessment task. This would facilitate early interventions preventing children from more severe difficulties in manual activities, including handwriting. Moreover, this instrument seems promising for more precise diagnoses of eventual motor difficulties not only in children with atypical development, but in adults with Parkinson disease as well [11-15,34].

    Acknowledgments

    The authors would like to thank the Universidad de Alcalá that supported the results of this paper through the Sistemas de monitorización de actividad del desarrollo infantil y la vida cotidiana mediante juguetes y otros objetos del entorno project (UAH-GP2018-5). This work has been funded by the Spanish National Plan for Scientific and Technical Research and Innovation 2013-2016 (EDUCERE, TIN2013-47803-C2-R [MINECO/BIE/FEDER, UE]) and 2017-2020 (Detección precoz de trastornos de Desarrollo mediante el uso de juguetes y objetos cotidianos, TRASGO, RTI2018-101962-B-I00 [MCIU/AEI/FEDER, UE]) and through the Spanish Ministry of Economy and Competitiveness PhD students funding program (BES-2014-067912). The vector hand drawing used in Multimedia Appendix 1 was created by Ddraw (Freepik) and the users icons used in Figure 3 were created by Freepik and all of them are licensed by Creative Commons BY 3.0. The development of the pegboard program was carried out using Arduino language and NRF24 libraries. The collector and mobile app where developed using Python and the Django Framework. The authors wish to thank the children, staff, and families of the initial education school participating in the study.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Sensor-based pegboard design.

    PDF File (Adobe PDF File), 4MB
    1. Fewell RR, Folio MR. Peabody Developmental Motor Scales. Second Edition. Austin, TX: Pro-Ed; 2000.
    2. Henderson SE, Sugden DA, Barnett SA. Movement Assessment Battery for Children. Second Edition. London, UK: Pearson Education; 2007.
    3. Koyama T, Domen K, Yokoe M, Sakoda S, Kandori A. Psychometrics of dominant right hand during the 9-hole PEG test: differences between PEG placement and removal. PM R 2011 Jan;3(1):40-44. [CrossRef] [Medline]
    4. Tiffin J, Asher EJ. The Purdue pegboard; norms and studies of reliability and validity. J Appl Psychol 1948 Jun;32(3):234-247. [CrossRef] [Medline]
    5. Aaron DH, Jansen CW. Development of the functional dexterity test (FDT): construction, validity, reliability, and normative data. J Hand Ther 2003;16(1):12-21. [CrossRef] [Medline]
    6. Mathiowetz V, Weber K, Kashman N, Volland G. Adult norms for the nine hole peg test of finger dexterity. Occup Ther J Res 2016 Aug 24;5(1):24-38. [CrossRef]
    7. Reuben DB, Magasi S, McCreath HE, Bohannon RW, Wang YC, Bubela DJ, et al. Motor assessment using the NIH toolbox. Neurology 2013 Mar 12;80(11 Suppl 3):S65-S75 [FREE Full text] [CrossRef] [Medline]
    8. Poole JL, Burtner PA, Torres TA, McMullen CK, Markham A, Marcum ML, et al. Measuring dexterity in children using the Nine-Hole Peg Test. J Hand Ther 2005;18(3):348-351. [CrossRef] [Medline]
    9. Smith YA, Hong E, Presson C. Normative and validation studies of the Nine-Hole Peg Test with children. Percept Mot Skills 2000 Jun;90(3 Pt 1):823-843. [CrossRef] [Medline]
    10. Wang YC, Bohannon RW, Kapellusch J, Garg A, Gershon RC. Dexterity as measured with the 9-Hole Peg Test (9-HPT) across the age span. J Hand Ther 2015;28(1):53-9; quiz 60. [CrossRef] [Medline]
    11. Earhart GM, Cavanaugh JT, Ellis T, Ford MP, Foreman KB, Dibble L. The 9-hole PEG test of upper extremity function: average values, test-retest reliability, and factors contributing to performance in people with Parkinson disease. J Neurol Phys Ther 2011 Dec;35(4):157-163. [CrossRef] [Medline]
    12. Chen CC, Ringenbach SD, Albert AR. Assisted cycling exercise improves fine manual dexterity in persons with Down's syndrome. J Appl Res Intellect Disabil 2014 May;27(3):264-272. [CrossRef] [Medline]
    13. Smith IM. Motor functioning in Asperger syndrome. In: Klin A, Volkmar FR, Sparrow SS, editors. Asperger Syndrome. New York, USA: Guilford Publications; 2000:97-124.
    14. Barbeau EB, Meilleur AS, Zeffiro TA, Mottron L. Comparing motor skills in autism spectrum individuals with and without speech delay. Autism Res 2015 Dec;8(6):682-693 [FREE Full text] [CrossRef] [Medline]
    15. Ortega JE, del Barrio C, Nunez-Nagy S, Malagón J. Evaluation of Manual Dexterity in Early Education. In: Proceedings of the 17th European Conference on Developmental Psychology. 2015 Presented at: ECDP'15; September 8-12, 2015; Braga, Portugal p. 63-67.
    16. Adolph KE, Cole WG, Vereijken B. Intraindividual variability in the development of motor skills in childhood. In: Diehl M, Hooker K, Sliwinski MJ, editors. Handbook of Intraindividual Variability Across the Life Span. New York, USA: Routledge; 2015:59-83.
    17. Annett M. Left, Right, Hand and Brain: Right Shift Theory. London, UK: Psychology Press; 1985.
    18. Kakebeeke TH, Knaier E, Chaouch A, Caflisch J, Rousson V, Largo RH, et al. Neuromotor development in children. Part 4: new norms from 3 to 18 years. Dev Med Child Neurol 2018 Aug;60(8):810-819 [FREE Full text] [CrossRef] [Medline]
    19. van Geert P, van Dijk M. Focus on variability: new tools to study intra-individual variability in developmental data. Infant Behav Dev 2002 Jan;25(4):340-374. [CrossRef]
    20. Rueckriegel SM, Blankenburg F, Burghardt R, Ehrlich S, Henze G, Mergl R, et al. Influence of age and movement complexity on kinematic hand movement parameters in childhood and adolescence. Int J Dev Neurosci 2008 Nov;26(7):655-663. [CrossRef] [Medline]
    21. Palmis S, Danna JL, Velay J, Longcamp M. Motor control of handwriting in the developing brain: a review. Cogn Neuropsychol 2017;34(3-4):187-204. [CrossRef] [Medline]
    22. Rosch KS, Dirlikov B, Mostofsky SH. Increased intrasubject variability in boys with ADHD across tests of motor and cognitive control. J Abnorm Child Psychol 2013 Apr;41(3):485-495 [FREE Full text] [CrossRef] [Medline]
    23. Geurts HM, Grasman RP, Verté S, Oosterlaan J, Roeyers H, van Kammen SM, et al. Intra-individual variability in ADHD, autism spectrum disorders and Tourette's syndrome. Neuropsychologia 2008 Nov;46(13):3030-3041. [CrossRef] [Medline]
    24. Bo J, Bastian AJ, Kagerer FA, Contreras-Vidal JL, Clark JE. Temporal variability in continuous versus discontinuous drawing for children with developmental coordination disorder. Neurosci Lett 2008 Feb 6;431(3):215-220 [FREE Full text] [CrossRef] [Medline]
    25. Hassanalieragh M, Page A, Soyata T, Sharma G, Aktas M, Mateos G, et al. Health Monitoring and Management Using Internet-of-Things (IoT) Sensing with Cloud-Based Processing: Opportunities and Challenges. In: Proceedings of the International Conference on Services Computing. 2015 Presented at: SCC'15; June 27-July 2, 2015; New York, USA p. 285-292. [CrossRef]
    26. Domingo MC. An overview of the Internet of Things for people with disabilities. J Netw Comput Appl 2012 Mar;35(2):584-596. [CrossRef]
    27. Marschollek M, Gietzelt M, Schulze M, Kohlmann M, Song B, Wolf KH. Wearable sensors in healthcare and sensor-enhanced health information systems: all our tomorrows? Healthc Inform Res 2012 Jun;18(2):97-104 [FREE Full text] [CrossRef] [Medline]
    28. Taffoni F, Focaroli V, Formica D, Gugliemelli E, Keller F, Iverson JM. Sensor-Based Technology in the Study of Motor Skills in Infants at Risk for ASD. In: Proceedings of the 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics. 2012 Presented at: BioRob'12; June 24-27, 2012; Rome, Italy p. 1879-1883   URL: http://europepmc.org/abstract/MED/25055839 [CrossRef]
    29. Focaroli V, Taffoni F, Parsons SM, Keller F, Iverson JM. Performance of motor sequences in children at heightened vs low risk for ASD: a longitudinal study from 18 to 36 months of age. Front Psychol 2016;7:724 [FREE Full text] [CrossRef] [Medline]
    30. Martin-Ruiz ML, Valero MA, Lindén M, Nunez S, García AG. Foundations of a smart toy development for the early detection of motoric impairments at childhood. Int J Pediatr Res 2015 Dec 31;1(2):1-5. [CrossRef]
    31. García MA, Ruiz ML, Rivera D, Vadillo L, Valero MA. A smart toy to enhance the decision-making process at children's psychomotor delay screenings: a pilot study. J Med Internet Res 2017 May 19;19(5):e171 [FREE Full text] [CrossRef] [Medline]
    32. Rivera D, García A, Alarcos B, Velasco JR, Ortega JE, Martínez-Yelmo I. Smart toys designed for detecting developmental delays. Sensors (Basel) 2016 Nov 20;16(11):pii: E1953 [FREE Full text] [CrossRef] [Medline]
    33. Martín-Ruíz ML, Fernández-Aller C, Portillo E, Malagón J, del Barrio C. Developing a system for processing health data of children using digitalized toys: ethical and privacy concerns for the Internet of Things paradigm. Sci Eng Ethics 2018 Aug;24(4):1057-1076. [CrossRef] [Medline]
    34. LeBarton ES, Landa RJ. Infant motor skill predicts later expressive language and autism spectrum disorder diagnosis. Infant Behav Dev 2019 Feb;54:37-47. [CrossRef] [Medline]

    ‎
    EDUCERE: Desarrollo de juguetes inteligentes para atención temprana a niños con trastornos del desarrollo en el entorno educativo y en el hogar digital
    IIV: intraindividual values
    LP: left hand placement
    LR: left hand removal
    RP: right hand placement
    RR: right hand removal

    Edited by G Eysenbach; submitted 06.10.18; peer-reviewed by WC Su, B Worm, A Paglialonga; comments to author 04.02.19; revised version received 07.06.19; accepted 19.07.19; published 28.08.19

    Copyright

    ©Diego Rivera, Antonio García, Jose Eugenio Ortega, Bernardo Alarcos, Kevin van der Meulen, Juan R Velasco, Cristina del Barrio. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 28.08.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.