A Computational Model for Top Down visual attention

Abhijit Sharang
Computer Science and Engineering IIT Kanpur

Abhijit Sharang A Computational Model for Top Down visual attention

Computer Science and Engineering IIT Kanpur

Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur .Introduction Attention involves selectively processing certain aspects of the environment while ignoring others.

Introduction Attention involves selectively processing certain aspects of the environment while ignoring others. Crucial for real time processing of the stimuli Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur .

Crucial for real time processing of the stimuli Two aspects of visual attention: Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur .Introduction Attention involves selectively processing certain aspects of the environment while ignoring others.

Introduction Attention involves selectively processing certain aspects of the environment while ignoring others. Crucial for real time processing of the stimuli Two aspects of visual attention: .Top down Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur .Bottom up .

Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur .Top down The aim is to model the top down aspect.Bottom up .Introduction Attention involves selectively processing certain aspects of the environment while ignoring others. Crucial for real time processing of the stimuli Two aspects of visual attention: .

Peters and Itti[3] developed a spatial attention model by associating the global scene features to gaze fixation in navigation and exploration tasks Cagli et al.Related work The sequential nature of attention has been exploited to develop HMM based models for specific tasks like sandwich making[2].[4] proposed a Bayesian framework for sensory-motor coordination in drawing tasks Global scene features were also used by Torralba et al.[5] to develop a discriminative model for top down saliency Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur .

Object Based Model Objects are the most salient entities in the scene for task driven attention Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur .

Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur .Object Based Model Objects are the most salient entities in the scene for task driven attention The sequential nature is exploited here in form of a Dynamic Bayesian Network to maximise the probability P(O|V) where.

Object Based Model Objects are the most salient entities in the scene for task driven attention The sequential nature is exploited here in form of a Dynamic Bayesian Network to maximise the probability P(O|V) where. O = the series of attended objects. Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur .

θ).where m represents the structure of the net and θ includes the state transition matrix and the observation matrix Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur . O = the series of attended objects. V =(m.Object Based Model Objects are the most salient entities in the scene for task driven attention The sequential nature is exploited here in form of a Dynamic Bayesian Network to maximise the probability P(O|V) where.

V =(m.where X = sequence of attended spatial locations Y = sequence of attended objects F = vector of the features associated with the objects Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur . F1: T ). O = the series of attended objects.where m represents the structure of the net and θ includes the state transition matrix and the observation matrix The model consists of the joint probability distribution 1:j P (X1:T .Object Based Model Objects are the most salient entities in the scene for task driven attention The sequential nature is exploited here in form of a Dynamic Bayesian Network to maximise the probability P(O|V) where.θ). Y1:T .

Object Based Model Objects are the most salient entities in the scene for task driven attention The sequential nature is exploited here in form of a Dynamic Bayesian Network to maximise the probability P(O|V) where.θ). F1: T ).where X = sequence of attended spatial locations Y = sequence of attended objects F = vector of the features associated with the objects Exploit some property independences to reduce the formulation Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur .where m represents the structure of the net and θ includes the state transition matrix and the observation matrix The model consists of the joint probability distribution 1:j P (X1:T . V =(m. Y1:T . O = the series of attended objects.

an equivalent model based on HMM or Kalman filter is intended to be developed for comparison purpose.[1] Developing relevant features for the model. Apart from DBN. Comparison also intended to be done with the classifier based models Abhijit Sharang A Computational Model for Top Down visual attention Computer Science and Engineering IIT Kanpur .Experimentation Dataset consists of eye tracking data of participants engaged in playing video games.

et al.” International Journal of Humanoid Robotics 6. Oliva. Sihite.12 (2007): 520-527.8 (2009): 810-818.03 (2009): 337-359 Peters.References 1 Borji. and Laurent Itti. IEEE Conference on.” Twenty-Sixth AAAI Conference on Artificial Intelligence.. ”Recognizing behavior in hand-eye coordination patterns. Dicky N. 2007. Coen-Cagli. IEEE. YI. ”Beyond bottom-up: Incorporating task-dependent influences into a computational model of spatial attention. Computer Science and Engineering IIT Kanpur 2 3 4 5 Abhijit Sharang A Computational Model for Top Down visual attention . 2007.” Vision research 49. ”The role of context in object recognition.” Trends in cognitive sciences 11. 2012 WEILIE. and Antonio Torralba. Ruben. Aude. Ali. CVPR’07.” Computer Vision and Pattern Recognition. Robert J. and Laurent Itti. and Dana Ballard. ”Visuomotor characterization of eye movements in a drawing task. ”An Object-Based Bayesian Framework for Top-Down Visual Attention.

Sign up to vote on this title
UsefulNot useful