Motion (physics)

Quantum mechanics

Video tracking

Structure from motion

Motion field

Event (particle physics)

Computer science

Motion interpolation

Physics

Block-matching algorithm

Politics

Image (mathematics)

Political science

Object (grammar)

Motion blur

Artificial intelligence

Representation (politics)

Optical flow

Artificial neural network

Computer vision

In this work, we propose a novel framework for unsupervised learning for event cameras that learns motion information from only the event stream. In particular, we propose an input representation of the events in the form of a discretized volume that maintains the temporal distribution of the events, which we pass through a neural network to predict the motion of the events. This motion is used to attempt to remove any motion blur in the event image. We then propose a loss function applied to the motion compensated event image that measures the motion blur in this image. We train two networks with this framework, one to predict optical flow, and one to predict egomotion and depths, and evaluate these networks on the Multi Vehicle Stereo Event Camera dataset, along with qualitative results from a variety of different scenes.

Unsupervised Event-Based Learning of Optical Flow, Depth, and Egomotion