DLSS 5 looks like a real-time generative AI filter for video games

Nvidia announced DLSS 5 during its GTC conference on Monday, and based on early reactions, it’s going to be a divisive update, with some reactions calling it a “slop” that unacceptably changes the artistic intent. Nvidia CEO Jensen Huang is calling it “the GPT moment for graphics – blending handmade rendering with generic AI to deliver a dramatic leap in visual realism while preserving the control artists need for creative expression.”

In games that support DLSS5, the tools can instantly provide a noticeable increase in lighting and shadows, but unlike previous versions of upscaling, which used machine learning to close the gap between high and low graphics settings, this version applies generative AI to rework lighting and materials with newly added details. Examples shown by Nvidia today Resident Evil Requiem, Starfield, Hogwarts LegacyAnd ea sports fc Each looks more lifelike, yes, but the DLSS 5 versions feature changes that seem similar to the “AI slope” updates we’ve seen applied to photography, video, and other creative endeavors.

According to Nvidia, “AI models are trained from start to finish by analyzing a single frame to understand complex visual semantics such as characters, hair, clothing and translucent skin, as well as environmental lighting conditions such as front-lit, back-lit or overcast. DLSS5 then uses its deep understanding to generate visually accurate images that capture subsurface scattering on skin, delicate sheen of clothing and light-material interactions on hair while maintaining structure.” Handles complex elements such as the semantics of the original scene.

The most noticeable impact is that DLSS 5 appears to make significant changes to how character models appear. in the matter of RequiemGenerative AI overlaid on original assets makes protagonist Grace Ashcroft look completely different, as if she had used an Instagram filter that made her lips look fuller and applied intense eyeshadow.

its application Starfield Delivers equally uncanny results, like sharpness boosted to the max, and bright highlights that illuminate their features and hair despite standing on stage in an environment where there isn’t that kind of lighting. Nvidia quoted Todd Howard, studio head of Bethesda Game Studios, as saying, “When Nvidia showed us DLSS5 and we turned it on StarfieldIt was amazing how it brought it to life. We have played it. We can’t wait for you all to do the same.”

DLSS 5 can run up to 4K resolution in real time, and while this will certainly satisfy some gamers and developers who have been waiting to see photorealism in more titles, the effect won’t work for everyone. Game developer Mike Bithell wrote, “When you absolutely, positively, want no art direction in your gaming experience. It’s disappointing to see that no one takes this nonsense seriously. It’s so messed up.”

However, Nvidia says it gives control to game developers to decide how DLSS 5 affects the look of the game, so it’s possible that by the time it ships, the in-game effects will be different than what we see here.

Nvidia:

DLSS5 respects artistic intent in two ways:

Inputting the game’s color and motion vectors for each frame into the model, anchoring the output to the source 3D material.
By providing developers with detailed controls such as intensity and color grading. Artists can use these controls to adjust blending, contrast, saturation, and gamma, and determine where and how enhancements are applied to maintain the game’s unique aesthetic. Developers can also hide specific objects or areas to be excluded from enhancements.

DLSS 5 is coming this fall, and so far, it’s only been confirmed to be compatible with select games, which, in addition to the ones mentioned earlier, include big titles like The Elder Scrolls VI: Oblivion remake and shadow of assassin’s creed.



<a href

Leave a Comment