Department of Mathematics
 Search | Help | Login | pdf version | printable version

Math @ Duke



Publications [#322214] of Guillermo Sapiro

Papers Published

  1. Draelos, M; Qiu, Q; Bronstein, A; Sapiro, G, Intel realsense = Real low cost gaze, Proceedings International Conference on Image Processing, Icip, vol. 2015-December (December, 2015), pp. 2520-2524, IEEE, ISBN 9781479983391 [doi]
    (last updated on 2019/06/16)

    © 2015 IEEE. Intel's newly-announced low-cost RealSense 3D camera claims significantly better precision than other currently available low-cost platforms and is expected to become ubiquitous in laptops and mobile devices starting this year. In this paper, we demonstrate for the first time that the RealSense camera can be easily converted into a real low-cost gaze tracker. Gaze has become increasingly relevant as an input for human-computer interaction due to its association with attention. It is also critical in clinical mental health diagnosis. We present a novel 3D gaze and fixation tracker based on the eye surface geometry captured with the RealSense 3D camera. First, eye surface 3D point clouds are segmented to extract the pupil center and iris using registered infrared images. With non-ellipsoid eye surface and single fixation point assumptions, pupil centers and iris normal vectors are used to first estimate gaze (for each eye), and then a single fixation point for both eyes simultaneously using a RANSAC-based approach. With a simple learned bias field correction model, the fixation tracker demonstrates mean error of approximately 1 cm at 20-30 cm, which is sufficiently adequate for gaze and fixation tracking in human-computer interaction and mental health diagnosis applications.
ph: 919.660.2800
fax: 919.660.2821

Mathematics Department
Duke University, Box 90320
Durham, NC 27708-0320