avantcontra

Author: Contra

  • Generatived video with AI (StyleGAN2) and Unreal Engine Niagara

    —

    by

    Contra
    in

    Generated video from StyleGAN2, then mapped the video texture to Niagara Mesh Particle in Unreal Engine (4.27) YouTube: https://youtu.be/FzO48cp72Y8 Bilibili: https://www.bilibili.com/video/BV1k3411q7jw   ref: StyleGAN2-ADA: https://github.com/NVlabs/stylegan2-ada-pytorch FluidNinja LIVE: https://www.youtube.com/channel/UC8Wmn_ubaSYx9RCXDCEeYVQ

  • Generative art video with AI (StyleGAN2)

    —

    by

    Contra
    in

    Video generated from StyleGAN2, then add shader FX (Fragment:Flow based on MaxMSP Jitter).   YouTube: https://youtu.be/AcHX0vZA_yc Bilibili: https://www.bilibili.com/video/BV1mq4y1U72K   ref: https://github.com/NVlabs/stylegan2-ada-pytorch https://github.com/pbaylies/stylegan2  

  • Generative video with StyleGAN and Unreal engine, another

    —

    by

    Contra
    in

    Original video generated from StyleGAN2, then add FX in unreal engine. YouTube: https://www.youtube.com/watch?v=Yd_4cMO6pQ4

  • OSC – from mobile phone to Unreal

    —

    by

    Contra
    in

    Voice/speech recognition by my OSC controller-BugOSC, and visualized in unreal engine/UE4, all realtime.   OSC controller: BugOSC, an OSC controller I developed based of Wechat mini program (微信小程序). You should install Wechat App firstly and then search “BugOSC” in it. “BugOSC” is NOT a native App, but more like a Webapp. It has to be…

  • How to add Shadertoy effect to Spark AR

    —

    by

    Contra
    in

    This article introduces how to add the effects on Shadertoy into Spark AR Studio. It has been several years since Spark AR Studio was launched, and its functions are relatively mature. Its UI as shown above, with a familiar three-dimensional scene editor, and a node-visual-programming patch editor. This kind of AR special effects software is…

  • A green scanner effect with depth texture

    —

    by

    Contra
    in

    I made a green scanner effect. Steps: Prepare a handsome photo. Calculate the depth value of the scene in the photo through machine learning, and get a depth texture. Write shader code to implement green scan line effect. Calculate photo scene depth Why do we need to calculate the scene depth of the photo? Because…

  • Audio visual + AI generated face

    —

    by

    Contra
    in

    Audio visual + AI generated face. Visual by Contra(me), Audio by dogone. The original face animation generated using Baidu PaddleGan. Then added some shader effect triggered by the bgm in realtime.

  • a Web+AR+AI Christmas Tree example

    —

    by

    Contra
    in

    Last year today, I made a Christmas tree using Bender and Python: This time I tested a workflow: Export the model (Mesh) generated by the Sverchok plug-in or Python script from Blender, and then import it into the web page for rendering. By the way, the web version of machine learning face recognition is added,…

  • An effect of reflection in water – [Patch a Dirty 011]

    —

    by

    Contra
    in

    An effect of reflection in water, made with MaxMSP Jitter. [jit.gl.videoplane] for reflection; A simple shader [jit.gl.pix] to add noise to the reflection to simulate the water ripples on the water surface. Source patch:https://www.patreon.com/posts/43367515 Acturaly it is from an old project(2018) of mine, which is an interactive wall. Vision, sound effects (except water sound), interactive…

  • Audio Visual interaction based on AI paintings

    —

    by

    Contra
    in ,

    Just tried adding some audio-visual effect onto an portrait painting generated by AI. The full video:https://youtu.be/w4WUDmZYKOQ The original painting generated by AI, a model using StyleGAN2. The visual effect created mostly from shader.And I used the handy and cool software “Fragment:Flow” based on MaxMSP/Jitter. BGM: “Green Lake Remix 006”, by dogone – my old friend…