Integration and coordination in a cognitive vision system

In this paper, we present a case study that exemplifiesgeneral ideas of system integration and coordination.The application field of assistant technology provides anideal test bed for complex computer vision systems includingreal-time components, human-computer interaction, dynamic3-d environments, and information retrieval aspects.In our scenario the user is wearing an augmented reality devicethat supports her/him in everyday tasks by presentinginformation that is triggered by perceptual and contextualcues. The system integrates a wide variety of visual functionslike localization, object tracking and recognition, actionrecognition, interactive object learning, etc. We showhow different kinds of system behavior are realized usingthe Active Memory Infrastructure that provides the technicalbasis for distributed computation and a data- and eventdrivenintegration approach.