I love Cyberpunk 2077 and I love the idea of pushing the boundaries of tech. Soo I guess I will explain how this works for anyone interested 😅
This system runs entirely in real time with minimal latency. The inside of the car as I said in the vid is unreal engine. Think of it as like one of those car rig streamers you see with a TV in front of a car console. I take a virtual interior set of the Vtech Quadra and put virtual screens outside the windows that feed to the game itself in cyberpunk in ultrawide and skewed to fit the virtual screen in relevance to the camera with room for the camera to move a bit without loosing the 3d aspect. I see the game via the headset on my head and you see it this way through a live unreal engine virtual production set.
The onboard Ai voice is called Wingman Ai it’s made for gamers it can give me actual road directions in cyberpunk among a ton of other stuff and see what I see in the game too!
For wingman’s visual used a sound wave visualizer in OBS added glow filter and one that makes it only visible when audible and then used either spout or NDI to feed it with transparency back into unreal where it appears in virtual space and reflects off my glass window.
Speaking of reflections you can see them off the game into the car into the dash and then back into the window. Also got this virtual grid scan effect going in unreal yes this all runs in real time!
All instances I ran this on were entirely non profit mostly just friends watching. I never even attached a card to Tik Tok and all forms of “gifts” got sent back to other supporters and creators. I just do this stuff for fun 🙂