Skeletron is a system that predicts joints and human skeleton position in 3d from real-time video taken by any (cheap) RGB camera, such as a webcam. The system sends the data about the position of the human body to Unity, a 3D game development engine, to allow engineers, artists, and creative technologists to use it to develop digital experiences. This demo was developed thanks to the NYU ITP Xstory grant.
- Machine Learning Model – http://gvv.mpi-inf.mpg.de/projects/VNect/
- TensorFlow port – https://github.com/timctho/VNect-tensorflow
- Model prediction – Google TensorFlow
- Data representation in 3D – https://unity3d.com/
Skeletron was built by:
Or Fleisher – http://orfleisher.com
Dror Ayalon – http://www.drorayalon.com