Comparison between Human and Silicon Retina 2
Hauptseminar Neuroengineering,Marcello Mulas
Abstract:This paper provides a personal perspective on human vision and event-based vision sensors, algorithms, and applications over the period of last decade. The comparison between the standards of biology and technology has been the major focus throughout. Some recent advancements in the field are also briefly described.When Mahowald and Mead built the first silicon retina with asynchronous digital output around 1992 1 , conventional CMOS active pixel sensors (APS) were still research chips. It required the investment by industry of about a billion dollars to bring CMOS APS to high volume production. So it is no surprise that while the imager community has been consumed by the megapixel race to make nice photos, cameras that mimic more closely how the eye works have taken a long time to come to a useful form. These “silicon retinas” are much more complex at the pixel level than APS cameras and they pay the price in terms of fill factor and pixel size; machine vision cameras with capability of synchronous global electronic shutter are about 5um. Silicon retina pixels are roughly 10 times the area of a machine vision camera pixel. So why are silicon retinas still interesting? What was the nessesity to mimic the biological eye? Mostly because of the high cost at the system level of processing the highly redundant data from conventional cameras, and the fixed latencies imposed by the frame intervals. High performance activitydriven event-based sensors could greatly benefit applications in real time robotics, where just as in nature, latency and power are very important 2 3 . Still is this the closest that technology brought the field towards biology? What important ascpect are missing to make a bionic eye? These are the few aspects that are througly discussed throughout this paper. 1 Mahowald, M.A.: An Analog VLSI System for Stereoscopic Vision. Kluwer, Boston (1994) 2 Lichtsteiner, P., Posch, C., Delbruck, T.: A 128×128 120 dB 15 μs latency asynchronous temporal contrast vision sensor. IEEE Journal of Solid-State Circuits 43(2), 566–576 (2008) 3 . Liu, S.C., van Schaik, A., Minch, B.A., Delbruck, T.: Event-based 64-channel binaural silicon cochlea with Q enhancement mechanisms. In: IEEE ISCAS 2009, pp. 2426–2429 (2010) Comparison between Human and Silicon Retina 5
Computer Science,Engineering