Department of Mathematics
 Search | Help | Login | pdf version | printable version

Math @ Duke



Publications [#338014] of Guillermo Sapiro

Papers Published

  1. Hashemi, J; Dawson, G; Carpenter, KLH; Campbell, K; Qiu, Q; Espinosa, S; Marsan, S; Baker, JP; Egger, HL; Sapiro, G, Computer Vision Analysis for Quantification of Autism Risk Behaviors, Ieee Transactions on Affective Computing, vol. 12 no. 1 (January, 2021), pp. 215-226, Institute of Electrical and Electronics Engineers (IEEE) [doi]
    (last updated on 2021/05/13)

    Observational behavior analysis plays a key role for the discovery and evaluation of risk markers for many neurodevelopmental disorders. Research on autism spectrum disorder (ASD) suggests that behavioral risk markers can be observed at 12 months of age or earlier, with diagnosis possible at 18 months. To date, these studies and evaluations involving observational analysis tend to rely heavily on clinical practitioners and specialists who have undergone intensive training to be able to reliably administer carefully designed behavioral-eliciting tasks, code the resulting behaviors, and interpret such behaviors. These methods are therefore extremely expensive, time-intensive, and are not easily scalable for large population or longitudinal observational analysis. We developed a self-contained, closed-loop, mobile application with movie stimuli designed to engage the child's attention and elicit specific behavioral and social responses, which are recorded with a mobile device camera and then analyzed via computer vision algorithms. Here, in addition to presenting this paradigm, we validate the system to measure engagement, name-call responses, and emotional responses of toddlers with and without ASD who were presented with the application. Additionally, we show examples of how the proposed framework can further risk marker research with fine-grained quantification of behaviors. The results suggest these objective and automatic methods can be considered to aid behavioral analysis, and can be suited for objective automatic analysis for future studies.
ph: 919.660.2800
fax: 919.660.2821

Mathematics Department
Duke University, Box 90320
Durham, NC 27708-0320