Department of Mathematics
 Search | Help | Login | pdf version | printable version

Math @ Duke



Publications [#338434] of Vahid Tarokh

Papers Published

  1. Banerjee, T; Whipps, G; Gurram, P; Tarokh, V, Sequential Event Detection Using Multimodal Data in Nonstationary Environments, 2018 21st International Conference on Information Fusion, Fusion 2018 (September, 2018), pp. 1940-1947, IEEE [doi]
    (last updated on 2019/02/17)

    © 2018 ISIF The problem of sequential detection of anomalies in multimodal data is considered. The objective is to observe physical sensor data from CCTV cameras, and social media data from Twitter and Instagram to detect anomalous behaviors or events. Data from each modality is transformed to discrete time count data by using an artificial neural network to obtain counts of objects in CCTV images and by counting the number of tweets or Instagram posts in a geographical area. The anomaly detection problem is then formulated as a problem of quickest detection of changes in count statistics. The quickest detection problem is then solved using the framework of partially observable Markov decision processes (POMDP), and structural results on the optimal policy are obtained. The resulting optimal policy is then applied to real multimodal data collected from New York City around a 5K race to detect the race. The count data both before and after the change is found to be nonstationary in nature. The proposed mathematical approach to this problem provides a framework for event detection in such nonstationary environments and across multiple data modalities.
ph: 919.660.2800
fax: 919.660.2821

Mathematics Department
Duke University, Box 90320
Durham, NC 27708-0320