Robotics-1: Event-based vision, navigation, and SLAM

Yulia Sandamirskaya

In this session, we will discuss the role of neuromorphic computing in robot navigation. The discussion will start with several (very) short presentations (statements) from prominent researchers, who already have successfully applied neuromorphic computing in their work – either in the form of event-based vision algorithms running on a conventional computer or SNNs running on Loihi. We will then have a panel discussion, aiming to narrow down answers to the following questions:

• Which subtasks in robot (vehicle, drone) navigation are particularly attractive for neuromorphic solutions and which are not? What would be the criteria for success of a solution? Which bottleneck could neuromorphic realization solve: scalability? latency? throughput?

• What are the challenges to make Neuromorphic approaches enter the main stream in robot navigation: Algorithms? Interfaces? Performance? Ecosystem?

Other questions can be posted in our slack channel #robotics.

Since the keynote presentations will be ultra-shot 5-7 minute statements, please, have a look at the related previous talks of the speakers, listed below.

• Davide Scaramuzza (Univ. Zurich)

  • Event-based vision for high-speed control of drones

  • Related INRC Forum talk: A PID Controller on Loihi for Drone Flight Control

  • Everything you need to know about event-based vision for drones: http://rpg.ifi.uzh.ch/research.html

• Tobias Fischer (QUT)

  • Ensemble strategies for event-based visual place recognition

• Konstantinos Michmizos (Rutgers Univ.)

  • Robotic Navigation: Scaling Brain-Inspired Computing by pursuing its biological plausibility

  • INRC Forum talk: From Brain-Cell Principles to Brain-Optimized Loihi Primitives Benchmarked in Brain-Morphic Robots

• Guido de Croon (TU Delft)

  • Neuromorphic sensing and computing for tiny drones: Opportunities and challenges.

  • INRC Forum talk: Embedding the Loihi Kapoho Bay on Micro Air Vehicles: An Investigation into Neuromorphic Optical Flow Landing

• Torben Schoepe (Univ. Groningen)

  • Finding the Gap: Insect-Inspired Motion-Vision

• Max Ruffo (Terabee)

  • Lean sensing for mobile robots

  • Concept video: https://www.youtube.com/watch?v=wRfdbIh499A&feature=youtu.be

• Kirk Schepper (Sony Zurich)

A collection of robotics-related talks from last year’s INRC Forum can be browsed here: https://intel-ncl.atlassian.net/wiki/spaces/INRC/pages/1080328193/Tutorials+and+Related+Presentations?atlOrigin=eyJpIjoiZjNkNTg4ODFiOGVkNDJiOTkzODkzNzg3ZjQ1ZDU5ODUiLCJwIjoiYyJ9

Not yet available