Automated tracking methods, data stream processing and interactive virtual environments

3 Ph.D/Postdoctoral Positions

Research objectives: Interactive virtual environments encompass real-time tracking, behavioural analysis as well as online data processing, all of which allow us to react to the behavior of organisms. Real-time rendering methods are needed for updating the environment. While this has been achieved for some species (flies, fish, mice) in small environments, we will extend this approach to other species such as locusts and birds within large environments. With respect to tracking, in some cases the development of data-driven, low-level predictive models for the appearance and motion of organisms can be trained from different types of sensor data (multi-view video and depth, ultrasonic localisation tags etc.). Moreover, it must work on a wide range of scales and allow for a fast determination of location and posture. This will be particularly challenging when tracking a large number of individuals. Furthermore, reactive environments require real-time processing, and the data stream volume will fluctuate strongly with the number and movement of the tracked individuals. In order to detect and identify (possibly exceptionally) important events in the presence of these spikes and lulls of data, we need to manage the quality of service, for example by a controlled reduction of the accuracy of the detected events in exchange for reduced computational overhead. Since reaction time will be critical, with vast amounts of pixels to be produced for large projections, we will have to synthesise renditions with minimal effort that different animals will perceive as realistic. This requires organism-specific rendering, which is also important for a deeper understanding of the sensory systems and visual processing of different species.

The Department of Computer and Information Science is looking for one PhD/Postdoc candidate with a solid background in computer vision, in particular tracking, structure-from-motion, sensor data fusion and real-time methods. You will develop robust multi-target tracking and pose estimation for groups of animals in virtual reality environments. (Advisor: Bastian Goldlücke)

The Department of Computer and Information Science is looking for one PhD/Postdoc candidate with a solid background in data management, in particular high-performance data stream processing on cluster architectures, for example with Apache Flink or Apache Spark. In cooperation with researchers from Biology and CS (Computer Graphics, Virtual Reality, Computer Vision), you will develop the infrastructure to process and analyse the animal tracking data in real-time. (Advisor: Michael Grossniklaus)

In order to produce Virtual Reality environments for animals ranging from insects to birds, the Department of Computer and Information Science looks for one PhD/PostDoc candidate with a profound knowledge in Computer Graphics and Virtual Reality. In cooperation with other computer scientists and the Department of Biology we need to perform perceptual experiments, develop and provide necessary display technology and find visible (and other) cues in order to influence animals in various ways. (Advisors: Oliver Deussen and Stephan Streuber)