Operator Attention Based Video Surveillance

We introduce a surveillance video tractability adjustment system that employs a dynamic operator attention model. The tractability of the surveillance video is adjusted ac-cording to the instantaneous attention level of the operator (Fig.1). Our system has two novel major parts: (i) dynamic measurement of the operator attention levels and (ii) an on-line video tractability adjustment system that employs mea-sured attention levels. We estimate the attention levels of the operators by measuring the blink rates and the saccade information of the eyes. Using well known theories from hu-man psychology, we estimate the amount of video tractabil-ity that the operator can easily handle. We tested the pro-posed system on volunteer operators using both synthetic and real surveillance data. The results are very promis-ing and we plan to extend the system with multiple opera-tors and multiple video streams. Supplementary material is available at the project website. 1