Artículo
An Event-Driven Multi-Kernel Convolution Processor Module for Event-Driven Vision Sensors
Autor/es | Camuñas Mesa, Luis Alejandro
Zamarreño Ramos, Carlos Linares Barranco, Alejandro Acosta Jiménez, Antonio José Serrano Gotarredona, María Teresa Linares Barranco, Bernabé |
Departamento | Universidad de Sevilla. Departamento de Arquitectura y Tecnología de Computadores |
Fecha de publicación | 2012 |
Fecha de depósito | 2020-02-13 |
Publicado en |
|
Resumen | Event-Driven vision sensing is a new way of sensing
visual reality in a frame-free manner. This is, the vision sensor
(camera) is not capturing a sequence of still frames, as in conventional
video and computer vision ... Event-Driven vision sensing is a new way of sensing visual reality in a frame-free manner. This is, the vision sensor (camera) is not capturing a sequence of still frames, as in conventional video and computer vision systems. In Event-Driven sensors each pixel autonomously and asynchronously decides when to send its address out. This way, the sensor output is a continuous stream of address events representing reality dynamically continuously and without constraining to frames. In this paper we present an Event-Driven Convolution Module for computing 2D convolutions on such event streams. The Convolution Module has been designed to assemble many of them for building modular and hierarchical Convolutional Neural Networks for robust shape and pose invariant object recognition. The Convolution Module has multi-kernel capability. This is, it will select the convolution kernel depending on the origin of the event. A proof-of-concept test prototype has been fabricated in a 0.35 m CMOS process and extensive experimental results are provided. The Convolution Processor has also been combined with an Event-Driven Dynamic Vision Sensor (DVS) for high-speed recognition examples. The chip can discriminate propellers rotating at 2 k revolutions per second, detect symbols on a 52 card deck when browsing all cards in 410 ms, or detect and follow the center of a phosphor oscilloscope trace rotating at 5 KHz. |
Identificador del proyecto | 216777 (NABAB)
TEC2009-10639-C04-01 |
Cita | Camuñas Mesa, L.A., Zamarreño Ramos, C., Linares Barranco, A., Acosta Jiménez, A.J., Serrano Gotarredona, M.T. y Linares Barranco, B. (2012). An Event-Driven Multi-Kernel Convolution Processor Module for Event-Driven Vision Sensors. IEEE Journal of Solid-State Circuits, 47 (2), 504-517. |
Ficheros | Tamaño | Formato | Ver | Descripción |
---|---|---|---|---|
An Event-Driven Multi-Kernel.pdf | 2.372Mb | [PDF] | Ver/ | |