Smart Museum Tour prototype application provides the museum visitors with immersive and technologically enhanced user experience by adding visual and audio stimuli. Enhanced user experience is provided relying on the advanced technologies of indoor localization and navigation, automatic object (exhibit) recognition, text recognition and augmented reality interface. To interact and control the application, smart interfaces are used, e.g. speech and gesture recognition technologies
The general use case of this prototype is to allow the user indoor navigation, thus allowing to easily find exhibits of interest. Upon arrival, the application performs automatic exhibit detection to provide the user with information of the specific exhibit through the AR interface. In order not to overload the user interface, or not to lose the user’s interest by providing undesirable information, all the content (text or video) appearance can be adapted accordingly to user emotional state. For this purpose, we developed an emotion detection system which uses features extracted from PPG/GSR signals to classify user’s affective state correctly.