That's me !!!
Below you find a list of my current research interests. For more information, parallel interests or possible collaboration please do not hesitate to contact me!

  • "A Learning Rule for Universal Approximators with a Single Non-Linearity": Here we develop and investigate learning algorithms for soft-WTA gates. The use and the computational power of WTA-gates are of importance in the area of neural computation and neuromorphic engineering, e.g. for attention in visual systems, but learning algorithms for these gates are largely unknown.

  • "Development of software for real-time spike-based computation on Linux": The micro-robot Khepera has been widely used for experiments for navigation, learning and sensory information processing. Neuromorphic engineering was used to study biological plausible computations with spike trains through devices (e.g. silicon retina) mounted onto the Khepera and Koala. Limitations of possible computations through technical feasibility have been observed. Little effort has been made so far using real-world devices in combination with spike-based computation on a software level of real-time simulations. The goal of this project is to bypass this limitation through providing a Linux based platform for real-time spike-based computations with real-world devices.

  • "Speeding up reinforcement learning for use on real robots": Many attempts have been made to speed-up reinforcement learning. Some of these use the structuring of the state-action space through hierarchies of smaller RL-problems (Dayan&Hinton, Parr&Russel, Kalmar et al). On the other hand there are approaches in robot programming that do not learn at all but provide good ideas of a modularisation of the problem (e.g. Brooks' subsumption architecture). The promising combination of giving a biologically motivated structure to a RL-task in a real-world problem is the goal of this project. Again, a Khepera with a mounted video camera is used as the experimental platform.

  • "Spike-based RL": Recent results from neurobiology suggest that a combination of prediction and reward maybe used in biological system to select actions and to control behaviour (Schulz et al, Read Montague et al.). I am curious about a combination of RL-tasks and spike-based computation. An evolving project could be based on the two projects above and would extend the possibilities of learning and spike-based computation on real-world devices.