AR AND CHAMBER MUSIC: MUSICAL KALEIDOSCOPE

Abstract. DIGI-ORCH is a research project with objectives, on one hand, to design and develop "smart" brochures for concerts and educational programs of the State Conservatory of Thessaloniki (Greece), and, on the other, to develop an innovative system for the visualization of information on smart mobile devices (smartphones and tablets). The application of Augmented Reality (AR) provides free access to the information and content of the above concerts and educational programs, combining the information of a robust data server and an easy-to-use user interface of the smart device in real-time.

The pilot implementation of the system in real conditions took place at the beginning of December 2022, in an event held at the facilities of the State Conservatory of Thessaloniki. The event was an evening of Chamber Music entitled Musical Kaleidoscope, with the internationally acclaimed artists Simos Papanas (violin), Dimos Goundaroulis (violoncello), and Vassilis Varvaresos (piano). They performed the Piano Trio no. 3 in G minor, Robert Schumann's opus 110, and the Piano Trio no. 2 in E flat major, Op. 100 D. 929 by Franz Schubert. The concert was attended by over 150 attendees.

The paper will present the chaîne-operatoire of the development of the system, from the acquisition of raw data (text, video, image, and sound) to the methodology used to produce the "smart" event brochure and the AR application for the above concert. Essentially, this large amount of information that cannot be assessed by a regular printed concert brochure is included in the smart system and displayed on the mobile device when the user locates the appropriate AR patterns on the surface of the analog concert poster and/or on the pages of the brochure.

This information comprised of ie. additional text and images about the composers and their musical projects, about the musicians of the concert (e.g. biographies), their interviews and rehearsals (video) before the concert, information about the State Conservatory of Thessaloniki (text, video, image, and sound), 3D models of musical instruments, 360° of the concert space, etc. diverse multimedia material.