Tracking and Behaviour Modelling

finding new ways to represent, learn and apply visual models of behaviour

Our research on the visual analysis of behaviour has focussed largely, but not exclusively, on human behaviour. We are interested in all aspects of this problem, including fundamental research on categorisation, tracking, segmentation and stochastic modelling, through to applied work addressing social and commercial priorities. Some of our recent work, in collaboration with the School's KRR group, is exploring the integration of vision within a broader cognitive framework, including audition, inductive reasoning, and intentionality.

[Image of cogvis game playing]

Protocol learning

Learning games from observation
[Image of Smarties]

Learning about activities from video

A new EPSRC funded project to investigate unsupervised learning of activities from video.
[Detecting Carried Objects]

Detecting Carried Objects

Detecting carried objects in short video sequences
[Image of WaterMark Extraction]

Watermark Extraction

Paper-based Watermark Extraction with Image Processing
[Image of intentional map]

Intentionality

Using psychological ideas of intentionality and goal-directedness within behaviour modelling
[Image of temporal continuity]

Temporal Continuity

Enforcing global spatio-temporal consistency to enhance reliability of moving object tracking and classification
[Image of cogvis game playing]

Traffic Interactions

Modelling traffic interaction using learnt qualitative spatio-temporal relations and variable length Markov models
[Image of cogvis game playing]

Car Tracking

A generic object tracker, demonstrated tracking vehicles
[Image of Music via Motion]

Music via Motion

Creating an augmented and interactive audio-visual space
[Image of synthetic head]

Synthetic Interaction

Synthesising an interactive agent by learning from the interactive behaviour of people
[Image of soccer player tracking]

Soccer Tracking

Tracking the movements of individual players in team games

The projects shown below have been undertaken in Leeds, some time ago now, but are still of interest. Please follow the links below to find out more...

[*]

Electronic stockman's eye

Tracking cows and looking for abnormalities in their movements
[Image of old stuff]

VLMMs of behaviour

Learning variable length markov models of human behaviour
[*]

IMV

Detecting unusual events by modelling simple interactions between people and vehicles
[*]

OMR

Optical music recognition (with dept. of music)
[*]

Behaviour modelling

Modelling of `object behaviours' using detailed, learnt statistical models
[*]

Hand tracking

Robust, model-based methods for tracking deformable objects
[*]

Pedestrian tracking

Contour tracking using Active Shape Models.
Source code for the Baumberg tracker.