Resonate is a real-time audio-visual installation that uses the viewers body movement to create live music and video. Using computer vision, a users presence and physical movement is interpreted into midi-based musical notes and layered audio samples. The artwork strives to create a instantaneous and continuous feedback loop between the user and the system.
The video image displayed is a melting time-lapse, shadow reflection of the viewers movement and marking in time. Samples of the users interaction are captured by system and randomly played back during periods of in-activity as a way to lure new viewers to the piece.
Resonate continues to be revised as the technology changes.