Browsing by Author "Pereira, João André Rosa"
Now showing 1 - 1 of 1
Results Per Page
Sort Options
- Smart augmented reality application for enhanced museum experiencePublication . Pereira, João André Rosa; Rodrigues, J. M .F.Museums’ collections can be almost endless, with countless objects, making it challenging to choose which ones to visit and appreciate. When a user enters a museum he usually encounters a guide or a predefined route to aid him, which more often than not is not suitable for his necessities and preferences. This dissertation focus on developing a mobile augmented reality framework and intelligent multiplatform application, that can be used as a museum guide and navigation helper. The work was divided into 3 main modules: (a) an intelligent routing system, (b) an adaptive user interface, and (c) an image recognition and augmented reality framework. Also presented is the integration of the above modules in an application. The first module, (a) intelligent routing system module, poses a solution for a "typical" museum problem. Museums routes do not take into account the physical, moral or psychological limitations of a user and/or their preferences. It resembles the traveling salesman problem where a route is calculated, only visiting once each point of interest, diminishing as much as possible the "walking" time, and extending the time spent admiring the museum’s objects. An Ant Colony Optimization algorithm was used to handle the calculations and compute an optimal walk, rendering the user’s preferences and limitations. This problem was formulated as a multi-criteria optimization problem. Also focusing on adapting the application for the user, (b) an adaptive user interface was developed, which adapts the application’s user interface on-thefly, according to the user’s preferences and conditions. This module is built upon a modular card system which is divided into structure and contents. It relies on a modular system in the sense that a complex interface can be divided into simpler and more manageable sub-modules, which can be used in other parts of the application or even in a completely different one. On an ideal application, each user would have a distinct interface/structure and contents. Nonetheless, different users could share the same interface structure only modifying the contents. The adaptive user interface is capable of (as the name implies) adapting itself to the user, either by changing both its structure and contents or only the contents displayed to the user. Regarding the augmented reality module (c), a mobile image recognition and tracking framework (MIRAR) was developed. The purpose of this framework is to recognize and track the innumerous objects of the museum in a mobile device. This framework is a marker-based augmented reality framework and even though the recognition happens on the client (mobile device) a server is required to keep the packaged markers accessible for the clients. These markers are preprocessed in the server and grouped by section. As the user navigates through the museum, an indoor beacon location system calculates his current position that is transmitted to the server which, in turn, sends the correct markers for that section to the mobile device. Finally, the integration of the above modules is presented in an alpha version of a mobile application, as well as tests and results for each module.