Category: Interactive × OSC
-
OSC – from mobile phone to Unreal
Voice/speech recognition by my OSC controller-BugOSC, and visualized in unreal engine/UE4, all realtime. OSC controller: BugOSC, an OSC controller I developed based of Wechat mini program (微信小程序). You should install Wechat App firstly and then search “BugOSC” in it. “BugOSC” is NOT a native App, but more like a Webapp. It has to be…
-
Audio Visual interaction based on AI paintings
Just tried adding some audio-visual effect onto an portrait painting generated by AI. The full video:https://youtu.be/w4WUDmZYKOQ The original painting generated by AI, a model using StyleGAN2. The visual effect created mostly from shader.And I used the handy and cool software “Fragment:Flow” based on MaxMSP/Jitter. BGM: “Green Lake Remix 006”, by dogone – my old friend…
-
Simulating Robot Arm with MaxMSP and RobotStudio
This project was about robotic arm with multi screens, (by ManaVR ✖ INT++) made in 2017.In the early stage, I used MaxMSP Jitter with ABB’s RobotStudio to simulate the robotic arm and the large screen. This article only focuses on how to use MaxMSP to do the simulation of the project prototype, making full use…
-
Motion capture with Tenserflow.js/PoseNet + MaxMSP + Blender
The key steps of the video above: Use the PoseNet of TensorFlow based on web-based machine learning for motion capture; Link the PoseNet page to MaxMSP with the Node for Max module provided by MaxMSP; Human motion data captured by PoseNet is sent back to MaxMSP through SocketIO; MaxMSP sends the received data to Blender…
-
Speech recognition and then visualize the 3D text in Blender Eevee in realtime
Voice/speech recognition by my OSC controller-BugOSC, then send the text to Blender and rendered by Eevee, all realtime. Youtube: https://youtu.be/KVT-y5a963Y B站(Chinese): https://www.bilibili.com/video/BV1A54y1d7Sh/ OSC controller: BugOSC, an OSC controller I developed based of Wechat mini program (微信小程序). You should install Wechat App firstly and then search “BugOSC” in it. “BugOSC” is NOT a native App, it…
-
Tutorial to voice control HTML GIF animation with mobile phone using MaxMSP and Nodejs
A demo and tutorial to voice control HTML GIF animation with mobile phone using OSC + MaxMSP + Nodejs + SocketIO. Source code: https://gum.co/whmyz https://www.patreon.com/posts/35323161 The data flow: OSC controller —- MaxMSP —- Node for Max —- Animation (HTML Web GIF) OSC controller: BugOSC, an OSC controller I developed based of Wechat mini program (微信小程序).…
-
Interactive between mobile phone and Blender animation through OSC
Just another demo about interactive between mobile phone and Blender animation through OSC. Blender Eevee animation: BLUE FOX Creation https://youtu.be/TYkPvFLDBNI NodeOSC addon of Blender: maybites https://github.com/maybites/blender.NodeOSC OSC controller: BugOSC, an OSC controller I developed based of Wechat mini program (微信小程序). You should install wechat firstly and then search “BugOSC” in it. Detail how-to video: “How…
-
How to make interactive audiovisual effect in 5 minutes using Blender and MaxMSP
Blender is now a new force in 3D art. Although new but not young, about twenties. In [Experimental Programming], I generally use Blender as a Python runtime environment out of the box, like:Using Blender to run Python and visualizing the Fourier Series. And this time, it is a simple and crude VJ / music visualization /…
-
How to use phone dial tone as an interaction controller, and decode DTMF signals
The first article in 2020, accidentally picked an Old School topic. There was a section in 名探偵コナン 戦慄の楽譜フルスコア(Detective Conan:Full Score of Fear), released ten years ago. Konan was standing in the middle of the water. First, a world wave shot down the phone receiver on the shore, then closed his eyes and shouted loudly. 110…
-
Drawing anything with Fourier Series using Blender and Python
Recently, in the Fourier Series chapter of “Coding Druid”, I practiced the visualization of Fourier Series and demonstrated the periodic square wave curve, which can be decomposed into a series of sine wave curves: Above is Python (Blender) version. There are JavaScript (React) version, and Unity version. “Coding Druid” series is my horizontal programming practice notes, each part around a topic like mathematical, physics, electronic, graphics, sound,…