A Real-time Multi-aperture Omnidirectional Visual Sensor Based on Interconnected Network of Smart Cameras

Hossein Afshari, Abdulkadir Akin, Ömer Cogal, Yusuf Leblebici, Vladan Popovic, Alexandre Schmid, Kerem Seyid
Institute of Electrical and Electronics Engineers, 2015
Article

Résumé

Centralized and multi-level implementations of the Panoptic omnidirectional multiaperture visual system were previously presented by the authors, relying on transmission of all camera outputs to a single central processing node for omnidirectional image and video reconstruction. In this paper, a novel distributed and parallel implementation of the omnidirectional vision reconstruction algorithm of the Panoptic system is presented. The parallel approach aims to overcome the scalability problems and memory bandwidth limitations of the centralised approach. The real-time hardware implementation is presented for camera modules with image processing, memory and interconnectivity features. A methodology is introduced for the arrangement of camera modules with interconnectivity feature into a target interconnection network topology. A unique custom-made multiple- FPGA hardware platform is introduced for the implementation of an interconnected network of 49 camera prototype Panoptic system. A hardware architecture based on presented hardware platform enabling the real-time implementation of the blending algorithms is presented, along with the imaging results and resource utilization. The real-time implementation results of the implemented omnivision application on the aforementioned prototype are demonstrated.

Official source

https://infoscience.epfl.ch/record/202134?ln=fr

À propos de ce résultat

Cette page est générée automatiquement et peut contenir des informations qui ne sont pas correctes, complètes, à jour ou pertinentes par rapport à votre recherche. Il en va de même pour toutes les autres pages de ce site. Veillez à vérifier les informations auprès des sources officielles de l'EPFL.

Concepts associés (15)

Concepts associés

Chargement

Publications associées (4)

Publications associées

Chargement

, , , , , ,

Panoptic is a custom spherical light field camera used as a polydioptric system where imagers are distributed over a hemispherical surface, each having its own vision of the surroundings and a distinct focal plane. The spherical light field camera records light information from any direction around its center. This paper revises previously developed Nearest Neighbor and Linear blending techniques. Novel Gaussian blending and Restricted Gaussian blending techniques for vision reconstruction of a virtual observer located inside the spherical geometry are presented. These new blending techniques improve the output quality of the reconstructed image with respect to the ordinary stitching techniques and simpler image blending algorithms. A comparison of the developed blending algorithms is also given in this paper. A hardware architecture based on Field Programmable Gate Arrays (FPGA) enabling the real-time implementation of the blending algorithms is presented, along with the imaging results and resource utilization comparison. A recorded omnidirectional video is attached as a supplementary material.

2013

Chargement

Real-time FPGA implementation of linear blending vision reconstruction algorithm using a spherical light field camera

Hossein Afshari, Abdulkadir Akin, Yusuf Leblebici, Vladan Popovic, Alexandre Schmid

A custom spherical light-field camera used as a polydioptric system where imagers are distributed over a spherical geometry, each having its own vision of the surrounding and distinct focal plane. The spherical light-field camera is also an omnidirectional camera which records light information from any direction around its center. A novel linear blending technique is presented for vision reconstruction of a virtual observer located inside the spherical geometry of this camera. This blending technique improves the output quality of the reconstructed vision with respect to the ordinary stitching technique. A novel pixel gridding scheme is presented for rectangular displaying of the reconstructed vision induced from the spherical light field camera. This gridding technique preserve the correct size of objects when mapped on the spherical geometry of the Panoptic system. A hardware architecture based on FPGAs with the real-time implementation of the linear blending algorithm and the new pixel gridding scheme of the spherical light-field camera are presented along with imaging results.

2012

Chargement

, , ,

Panoptic is a custom spherical light field camera used as a polydioptric system where imagers are distributed over a spherical geometry, each having its own vision of the surrounding and a distinct focal plane. The spherical light field camera records light information from any direction around its center. A novel Gaussian blending technique is presented for vision reconstruction of a virtual observer located inside the spherical geometry of this camera. This blending technique improves the output quality of the reconstructed image with respect to ordinary stitching techniques and simpler image blending algorithms. A hardware architecture based on Field Programmable Gate Arrays (FPGA) with the real-time implementation of the Gaussian blending algorithm using the spherical light field camera is presented, along with the imaging results.

Ieee2013

Chargement