ESR 14 – Emanuele Palma

ESR 14 – Emanuele Palma

Research Project 6 “Compression methods for geometry-enhanced light field images under safety-critical conditions” (TAU)

Project Information:

Investigation and proposal of new dedicated compression methods for geometry-enhanced light field images in safety-critical conditions. At first, with the analysis of the multimodal sensor data, for interpreting the scene with respect to mission-critical and safety-critical elements (e.g., the pose of objects to be grasped, manipulated, or inspected).

Secondly with the relevant 3D scene geometry defined by the elements of interest compression in a lossless mode. The compression of light field image conditional on the 3D geometry is then designed to achieve very high efficiency.

This project focuses on the development of Novel dedicated compression techniques for geometry-enhanced light field images, where the defined region-of-interest and detected objects of interest are encoded in a lossless way, allowing the full available precision for decisions with respect to critical elements, when evaluating the decoded data.

Current Status of the Project:

M1.11 Scenery analysis and lossless geometry compression
Completed 100%

Regarding this Milestone

M1.12 Efficient light field compression with geometry priors
Completed 100%

Regarding this Milestone

Secondments:

During my research period 2 Secondments are planned:

Seondment #1 - November 1st 2019 - January 31st 2020 @ Roma Tre University
Completed 100%
Secondment #2 - Virtual Secondment
Completed 100%

Final Summary of the Project

In this project, together with my supervisor, we studied a new immersive media: light fields. These images can be represented by a so-called plenoptic function, which allows the viewer (through processing) to render the scene from multiple points of view (angular views). These angular views, which show the same image from slightly various angles or camera placements, can carry a lot of extra information, especially in safety critical environments. 

Using well designed geometry-aware approaches, the microlens structure of a light field capturing decive can be exploited to do very precise image compression, keeping the compressed image with the same quality as the acquired image, enabling the creation of high-performance coding methods that can store losslessly any light field image.

We divided the project in two macro-sections, following the milestones: Efficient Compression Methods and Quality Analysis and Assessment.

In the first section we studied new methods for lossless coding of light fields using sparse linear predictive models and context adaptive arithmetic coding. We also presented a new algorithm for near-lossless coding of light field sensor images.

In the second section we presented a quality analysis and assessment experiment, that shed light on how end users perceive the compression artifacts when it comes to novel imaging structures, such as light fields. A standardized experiment was carried out and binary preference scores were collected to achieve a coherent and informative outcome, that could help us identify the problems in the fruition of such content.

Watch my Science Slam on ImmerSAFE Youtube Channel!

Follow me on my Socials!

—————————————————————————————————————————————————————-

Emanuele has a Master’s degree in Telecommunications Engineering (2017) from Dipartimento di Ingegneria, Università degli Studi di Roma TRE . He completed his bachelor in Electronic Engineering from Dipartimento di Ingegneria, Università degli Studi di Roma TRE in 2014.

Contact information:

Palma Emanuele (MSc.)
Doctoral Student
Tampere University,
Faculty of Information Technology and Communication Sciences

Street address: 
Korkeakoulunkatu 7, TF414, FI-33720 Tampere, Finland
E-mail:     emanuele.palma@tuni.fi

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 764951.