Using Generative AI as a full game engine / rendering engine

I follow a lot of the current state of things and have seen the NVidia demo running GTAV thru some generative rendering to render the scenes.

I’m nearing 50, a seasoned pro looking to focus on a big project if ‘big enough’ to matter to me.

I’m fully beginning to think we (NVidia devs easier perhaps, but soon ‘anyone’) can develop
a ‘concept artist that can render what i describe’, but at 60fps.

Then, I can simply describe (or have it understand this via LLM)

  1. when I hit up
  2. ‘render the same scene in this same world as if in a game and I just hit up for 0.016667 of a second’

I’ve described this a few times over the past couple of years as ‘pie in the sky’ and mostly get laughed at.

Can you confirm (NVidia or others) that this is not only well within the realm of possibility, but you are looking into it?

I’m happily employed and not looking to change jobs… but what group? I’m VERY interested in this approach / wanna help.

Basically, I’m a seasoned game dev… and I see this as:
game devs go away… no more coding games, no more modelling in Maya… just a game designer chatting with his generative AI.

very much like in H.E.R. (his friend was kinda doing that with what looked like Unreal with an AI helper)

I’m saying there is never even a game scene or game engine… just playing the AI’s dream.

Lemme know… I wanna make it!

1 Like

You may find our developer discord channel a good place to chat about ideas like this.
Our nvidia developer discord can be fouind here : NVIDIA Developer

Ditto… I second his interest but I believe there’s a whole education site dedicated to this that will probably answer this question and other things.