LIVE POSE MUSIC
DEC 2018
COLLABORAtion with yiyao nie and danxiaomeng huang
Live Pose Music is a screen-based musical instrument played with users’ body, head, hips & feet.
It is programmed in Javascript with PoseNet, which is a machine learning model that allows for Real-time Human Pose Estimation.
Due to the use of socket.io and peer.js, it allows multiple users to play at the same time, even when they are remote from each other. Users can see how each other is doing from the bottom right corner of the screens.