|FRAJBERG DARIAN||Cycle: XXXII |
Section: Computer Science and Engineering
Tutor: ALIPPI CESARE Major Research topic
:Artificial Intelligence (AI) and Augmented Reality (AR) for crowdsourced environmental applications
Advisor: FRATERNALI PIEROAbstract:
The research work aims at exploiting the recent progress in the Artificial Intelligence (AI) and Computer Vision (CV) fields, resulting from the commoditization of Deep Learning methods, and the forthcoming wave of low-cost mass-market Augmented Reality (AR) devices to develop novel methods, architectures, components, and applications for environmental and ecological purposes.Mobile AR applications blend digital information and real objects offering a new way to promote the collection of geo-referenced information by engaging citizens in an entertaining immersive experience while gathering useful environment data, such as images of plant species or of mountain snow coverage. The distinctive characteristic of mobile AR applications is the overlay of information directly on top of what the user sees, based on the user’s context estimated from the device sensors. The application analyses the sensor readings (GPS position, phone orientation and motion, and possibly also the camera frame content), to understand what the user is watching and enriches the view with contextual information and commands to perform context-dependent tasks (e.g., taking a photo of a relevant object or landscape).The idea is to use crowdsourcing tasks embedded within mobile outdoor AR applications to engage users to collaborate in the collection and validation of geo-referenced data, which can be exploited for many purposes such as mapping and building environmental monitoring systems based on predictive models and event detectors. Indeed, the combination of AI, CV, AR and crowdsourcing can lead to the generation of attractive and entertaining systems with which users would be more likely to participate.The research work spans four main disciplines: artificial intelligence, augmented reality, computer vision, crowdsourcing and environment science.