COVER Tech details in-house OBS plugin that rebuilds 3D space for VTuber streams

COVER Tech details in-house OBS plugin that rebuilds 3D space for VTuber streams

Summary

COVER Tech has published a behind-the-scenes post on an in-house OBS plugin that rebuilds 3D space for VTuber streams. The system links the Studio app via Spout to enable relighting, ambient occlusion and rich post effects in OBS. It is currently internal-only with future talent distribution in mind.

COVER Corporation has updated its technical blog COVER Tech with a post from graphics engineering manager O about an in-house OBS and Spout plugin project. The team wanted richer recording materials from its in-house Studio app, which renders motion capture, lighting and VFX in real time, without waiting on the Studio app release schedule. Their solution outputs video via Spout from a shared rendering base, then handles processing and file export in OBS. The setup rebuilds 3D space inside OBS to enable relighting with directional and point lights, ambient occlusion, occlusion-aware decals, board rendering by ray tracing, synchronized export of normal, world position, depth, camera and color buffers, plus diffusion and simplified depth-of-field filters. The article includes sample images and diagrams. The plugins are currently for internal use only. The team says it hopes to separate confidential parts into another app or DLL so the tools can eventually be shared with talents, and to explore hybrid rendering combining Unity and Unreal Engine. The full post, in Japanese, is available via COVERedge: https://coveredge.cover-corp.com/list/5433
Read the original