1. 视频
  2. 图片
AI PIANIST 人工智能钢琴家

原创 临时 2022-06-23

案例介绍

Role
Direction & Design

Type
Immersive Experience

Date
2019 / 2021

Commissioned By

Daejeon Museum of Art

Premiered at the “Ways of Seeing” exhibition in Daejeon Museum of Art in 2019, NOS Visuals collaborated with VirtuosoNet, the AI pianist developed in Korea Advanced Institute of Science and Technology [KAIST-CT].

A selected repertoire from contemporary composers [Philip Glass, Olivier Messiaen, Sergei Prokofiev, Dmitri Shostakovich] is interpreted and played by the AI Pianist VirtuosoNet on an automatic grand piano, and each visual environment surrounding the performance is responsive to sound, and generated in real-time.

NOS Visuals is originally a collaborative platform named after the custom NOS visual engine, developed by Nohlab and Osman Koç. Based on Processing infrastructure, NOS analyzes the sound in the performance in real-time and uses this data as a parameter in the calculations for the visuals, which melts the sound and visuals into a single entity.

For this unique collaboration, Dr. Jeong Dasaem trained an AI pianist, VirtuosoNet, using data from 16 composers and 226 performers, by a “Hierarchical Attention Network [HAN]”. Integrating several parameters of score and performance, VirtuosoNet not only interprets the score, but also plays with emotion as it adjusts the beat and rhythm, and the tone and touch in order to capture the musical expression of the original performers.

The performance since has been a part of Beyoglu Culture Road exhibition in the opening of AKM, the biggest and most symbolic art exhibition center is Istanbul, and was supported by Turkish Ministry of Culture.

CREDITS

Location
Daejeon Museum of Art, S. Korea
AKM, İstanbul

Art Direction & Visual Design
Nohlab

Creative Coding & Visual Design
Osman Koç

AI Training & Research
Dr. Jeong Dasaem

Pianist
VirtuosoNet

Real-time Visualization Engine
NOS Visual Engine

案例参与

* 文章为作者独立观点,不代表数艺网立场转载须知

本文内容由数艺网收录采集自微信公众号Nohlab ,并经数艺网进行了排版优化。转载此文章请在文章开头和结尾标注“作者”、“来源:数艺网” 并附上本页链接: 如您不希望被数艺网所收录,感觉到侵犯到了您的权益,请及时告知数艺网,我们表示诚挚的歉意,并及时处理或删除。

沉浸式体验 大田美术馆 钢琴 AI 钢琴家

19345 举报
登录| 注册 后参与评论