Abstract
Skuarewave is a holographic musical instrument built in Godot, running on Meta Quest 3 with hand tracking and a gesture-based interface. A musician composes and performs music by waving and pinching inside holographic skuares (squares) in mixed reality. There are three instrument sequencers and a drum sequencer, each supporting variable-length sequences up to 64 steps. Key, mode, and octave can be changed in real-time with gestures as the composition plays live. There are real-time audio effects and a 3D waveform visualiser. The demo features a live performance incorporating live looping on Bb flute with holograms, with the performer's view projected for the audience and audio transmitted wirelessly.
Keywords
Godot, hand tracking, holographic interface, live performance, Meta Quest 3, MIDI, mixed reality, step sequencer, XR
DOI Link
Publication Date
2026-06-08
Event
2026 ACM International Conference on Interactive Media Experiences, IMX 2026
Publication Title
IMX 2026 - Proceedings of the 2026 ACM International Conference on Interactive Media Experiences
Publisher
Association for Computing Machinery (ACM)
ISBN
9798400724480
First Page
668
Last Page
669
Deposit Date
2026-07-17
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Additional Links
Recommended Citation
Duggan, Bryan, "Skuarewave: Play Music with Holograms" (2026). Research Outputs: 2025-Present. 17.
https://arrow.tudublin.ie/scschcomro/17