VEDI: Vision Exploitation for Data Interpretation


G. M. Farinella1,2, G. Signorello2, S. Battiato1, A. Furnari1, F. Ragusa1,3,
R. Leonardi1, E. Ragusa3, E. Scuderi3, A. Lopes3, L. Santo3, M. Samarotto3

1IPLab, Department of Mathematics and Computer Science - University of Catania, IT
2CUTGANA - University of Catania, IT
3Xenia Gestione Documentale s.r.l. - Xenia Progetti s.r.l., Acicastello, Catania, IT




We present VEDI (Vision Exploitation for Data Interpretation), an integrated system to jointly assist the visitors of cultural sites and provide meaningful statistics about the cultural site to managers. To address both goals, VEDI includes a wearable assistant (implemented through a wearable device such as HoloLens) which leverages Computer Vision algorithms to understand where the user is and what they are paying attention to. At the visitor's end, such information is leveraged to augment the visit by displaying additional information on the observed points of interest, helping the visitors to navigate the site and suggesting what to see next. Concurrently, a back-end extracts high-level behavioral information from the captured video content, which is used to provide the site manager with meaningful statistics and performance indexes on the cultural site. Experiments show that VEDI achieves good results on both the indoor and outdoor cultural sites considered for the experimentation.



Architecture



VEDI architecture is composed of 4 main parts: 1) Mobile devices, 2) GPU, 3) Charging and update station, 4) Central system.





Video Demo


Room-based Localization



Points of Interest Recognition



Fruition through AR



Memories Generation



Management System and Data Analysis



VIDEO Description (English Subtitles) - Produced by Ministero dello Sviluppo Economico (MISE)



VEDI Project - Video Description (In Italian Only)



VEDI App: L'arte in un palmo di mano



Dataset




Paper

G.M. Farinella, G. Signorello, S. Battiato, A. Furnari, F. Ragusa, R. Leonardi, E. Ragusa, E. Scuderi, A. Lopes, L. Santo, M. Samarotto. VEDI: Vision Exploitation for Data Interpretation. In 20th International Conference on Image Analysis and Processing, 2019. Download the paper here.



Acknowledgement

This research is supported by PON MISE – Horizon 2020, Project VEDI - Vision Exploitation for Data Interpretation, Prog. n. F/050457/02/X32 - CUP: B68I17000800008 - COR: 128032, and Piano della Ricerca 2016-2018 linea di Intervento 2 of DMI of the University of Catania.