top of page
TEACHABLE MACHINE + UNITY3D
Anchor 1
_environment
​
_role
_tools
​
_description
_code
NYU ITP Machine Learning for Web
Software Developer
Unity3D, C#, Javascript, Teachable Machine by Google
This project combines both machine learning and gameplay to create a unique control interface for gameplay. I used different gestures of my hand to train an image classification model and then integrated that with Unity WebGL.
demo (uses webcam, white/light gray background necessary)
_process
gather data

class: UP

class: DOWN

class: LEFT

class: RIGHT
train model

Teachable Machine.
export model
import assets

modify scripts
#

adjusted player control script to receive external directional inputs
Unity3D
read webcam feed

make prediction using model
send result to Unity
move character

Javascript/WebGL
_demo_Video
bottom of page