The Operator: Notated Human

The Operator series of artworks simulates and visualises the interaction between humans and artificial intelligence creating music together. The AI in this work freely observes the human world within the CCTV network and transforms location data into music. The artwork’s design language is predominantly created with pixels. This design choice is based on the idea that the human world, as perceived by AI, appears via pixels and resolutions. Live CCTV footage from around the world is displayed on LED panels throughout the pavilion. The person-detection module identifies the number and location of people in the CCTV footage in real time, converting this data into sound. This sound is then transformed into music by recognising the spectator’s motion through the camera where the work is installed. When interactions between the artwork and the audience occur, the artwork greets the audience with a ‘hello’ in nine languages, and graphic effects emerge through alterations in resolution and saturation. The pavilion’s design is crafted with a pixelated appearance. The structure is modular, designed with columns allowing for future expansion or contraction by adjusting the number of columns. This flexibility enables various arrangement options for every installation location, enhancing the adaptability and visual impact of the artwork. Red Dot Award: Design Concept | Ready For Market | Exhibition and Installations