- 视频
- 图片
- AI PIANIST 人工智能钢琴家
-
原创 临时 2022-06-23
Role
Direction & Design
Type
Immersive Experience
Date
2019 / 2021
Commissioned By
Daejeon Museum of Art
Premiered at the “Ways of Seeing” exhibition in Daejeon Museum of Art in 2019, NOS Visuals collaborated with VirtuosoNet, the AI pianist developed in Korea Advanced Institute of Science and Technology [KAIST-CT].
A selected repertoire from contemporary composers [Philip Glass, Olivier Messiaen, Sergei Prokofiev, Dmitri Shostakovich] is interpreted and played by the AI Pianist VirtuosoNet on an automatic grand piano, and each visual environment surrounding the performance is responsive to sound, and generated in real-time.
NOS Visuals is originally a collaborative platform named after the custom NOS visual engine, developed by Nohlab and Osman Koç. Based on Processing infrastructure, NOS analyzes the sound in the performance in real-time and uses this data as a parameter in the calculations for the visuals, which melts the sound and visuals into a single entity.
For this unique collaboration, Dr. Jeong Dasaem trained an AI pianist, VirtuosoNet, using data from 16 composers and 226 performers, by a “Hierarchical Attention Network [HAN]”. Integrating several parameters of score and performance, VirtuosoNet not only interprets the score, but also plays with emotion as it adjusts the beat and rhythm, and the tone and touch in order to capture the musical expression of the original performers.
The performance since has been a part of Beyoglu Culture Road exhibition in the opening of AKM, the biggest and most symbolic art exhibition center is Istanbul, and was supported by Turkish Ministry of Culture.
CREDITS
Location
Daejeon Museum of Art, S. Korea
AKM, İstanbul
Art Direction & Visual Design
Nohlab
Creative Coding & Visual Design
Osman Koç
AI Training & Research
Dr. Jeong Dasaem
Pianist
VirtuosoNet
Real-time Visualization Engine
NOS Visual Engine
-
* 文章为作者独立观点,不代表数艺网立场转载须知
- 本文内容由数艺网收录采集自微信公众号Nohlab ,并经数艺网进行了排版优化。转载此文章请在文章开头和结尾标注“作者”、“来源:数艺网” 并附上本页链接: 如您不希望被数艺网所收录,感觉到侵犯到了您的权益,请及时告知数艺网,我们表示诚挚的歉意,并及时处理或删除。