A Smartphone Application to Measure Response to Name in Everyday Environments
Objectives: The objective of the study was to develop a smartphone application to record children’s response to name in everyday environments. We examined fidelity, accuracy of parent ratings, and user experience.
Methods: Parents of children between the ages of 18-48 months participated in the study. Children could be typically developing, or have ASD or another developmental concern. Parents downloaded the app onto their smartphone and were asked to complete 3 sessions. The app included a built-in tutorial; otherwise no instructions were provided. The tutorial displayed illustrations and text guiding parents to stand 3-5 feet behind the child, call the child’s name once, and then press Yes or No to rate whether the child responded. Within each session, the app prompted up to 3 name call trials in case the child did not respond right away. After 3 sessions, we provided feedback to the parent about fidelity. Then parents were asked to record up to 30 additional sessions over the course of one week. Sessions were automatically uploaded to our database, with both a video file and time-stamped text file of parent ratings. After completing all sessions, parents completed online questionnaires about user experience and satisfaction.
Results: So far, 4 families have begun participation, and 17 more have expressed interest (study goal is 30 families). We currently have 16 pre-feedback trials and 135 post-feedback trials. Two raters viewed each video recording and text file to establish parent fidelity (the parent’s ability to administer the trial correctly) and accuracy (of child response ratings). Inter-rater agreement was 100% for fidelity and 98% for accuracy. Across participants’ first three sessions, parent fidelity averaged 78% (range 50%-100%). Two families needed feedback to say the child’s name only once, and not to shout the child’s name. Across post-feedback trials, parent fidelity averaged 89% (range=77%-97%). Parent accuracy for rating their child’s response was 97% (range=95%-100%). Parent survey responses indicated parents “strongly agreed” the app was easy to use, that it measured a meaningful behavior, and that they would recommend the app to a friend.
Conclusions: The app appears easy for parents to use correctly, though instructions do need to highlight calling the child’s name only once and not shouting the child’s name. Ongoing data collection will allow us to also develop formulas for calculating a child’s rate of responding, which can then be examined across children with ASD, other delays, and typical development.