The project (call H2020-ICT-22b. Develop novel multi-modal, adaptive interfaces, including Brain Computer Interfaces, assisting people with disabilities) aims at exploiting the recently matured biologically-inspired technique of event-driven compressive sensing (EDC) of audio-visual information, to implement touch-less device control/interaction based on gesture and vision-assisted speech recognition.
The final goal of the project is to demonstrate that the proposed technology, focused on mobile smart devices (e.g. tablet computers), is particularly suited to support the diverse user group of the visual-impaired and the elderly, and to facilitate their interaction with modern ICT devices, and hence improve their potential to better participate in a modern, interconnected society.
The project consortium is composed of: UPMC (Universite Pierre et Marie Curie, Paris, France -- project coordinator), IIT (Fondazione Istituto Italiano di Tecnologia, Genoa, Italy) CSIC (Agencia Estatal Consejo Superior de Investigaciones Cientificas, Seville, Spain), StreetLab (SME subsidiary of Institut de la Vision, Paris, France), Innovati Networks (software engineering SME, Madrid, Spain), FBK (Fondazione Bruno Kessler, Trento, Italy), and Cronocam S.a.S (start-up company, Paris, France).
FBK is in charge of User Centered Design activities. i3 team will conduct research with older adults with the goal of understanding senior citizens’ specificities and needs (social, psychological and social) in relation to the design of multimodal services based on gestures and speech recognition.