Harmonic Essence

Harmonic Essence is an audio-visual performance that creates a responsive dialogue between acoustic instruments, computer-generated sounds, and digital projections. Live cello and guzheng performances combined with electronic loops and samples drive an undulating tapestry of geometric visuals that respond directly to the music, creating a unified sensory experience. The work was presented at the Asian Art Museum's RAD gallery, where the space was transformed into an immersive environment with projections spanning multiple walls.

The performance was so well-received that the museum commissioned a recorded version to be displayed as a permanent, immersive installation piece.

Concept

This work explores the relationship between sound and visual form through real-time translation. By creating a system where acoustic instruments directly influence digital geometries, I wanted to reveal hidden patterns in musical expression. The abstract visual language mimics biological movement patterns, creating organic forms that feel alive despite their geometric nature.

The performance highlights the interplay between traditional instruments and contemporary technology. Rather than treating technology as a tool for documentation, it becomes an equal participant in the creative process - a digital instrument being played alongside the cello and guzheng.

Technical Details

I developed custom software in Unity that functions as a visual instrument, analyzing incoming audio and translating different frequency ranges into visual parameters. The performance incorporated both live acoustic instruments and computer-generated loops and samples, all feeding into the audio analysis system.

The software analyzes various frequency windows from the incoming audio signal and maps them to different visual parameters of the abstract geometric forms. This creates responsive visuals where the shapes, movements, and colors directly correlate with the musical elements.

The system creates a mathematical bridge between sound and visual elements, where every note and timbre finds expression in the digital realm. The software provides a performance interface that allows real-time adjustment of visual parameters during the live event.

The museum's immersive projection system provided an ideal canvas, allowing the visuals to surround and envelop the audience.

Credits

• Concept and Visuals: Osman Koç

• Cello Performance: Dan Gorelick

• Guzheng Performance: Qianqian Jin

• Venue: Asian Art Museum RAD Gallery