About this project
Signature interactive WebGL experiment and creative engineering showcase. A custom particle engine built with React Three Fiber and hand-written GLSL shaders morphs between complex formations in real-time — responding to live microphone audio frequency, speech recognition commands, camera-based face tracking via MediaPipe, pointer drag, and device gyroscope. An integrated local AI assistant with Web Speech synthesis narrates the experience. Runs entirely in-browser, no backend required.
Tech Stack
React Three FiberThree.jsGLSL ShadersMediaPipeWeb Audio APIWeb Speech API