I think to your second point, since this AI Instagram filter is based on a 2D picture with no understanding of the light source or materials, even the background with this tech will ruin things.
One of the things I said in another post is that the DLSS demo with Grace was that I wasn't just thrown by the face, I honestly was also thrown by the brightly lit background that really undermined what that scene was trying to convey.
To me the original scene was somber, she's visiting a murder scene, the background amplifies that somber, feeling of dread with everything darker, shadows everywhere threatening to consume the light. The DLSS 5 scene, everything is brighter, shinier and now that same scene isn't helping to convey the getting atmosphere, it's like the darkness is being overcome.
That's a very good point, and now that I've seen more coverage (including this video) and got a better understanding of how the tech works (based on 2D frames plus motion vectors) I'm inclined to agree.
I wonder if it would be possible to feed this system information about object materials and 3D lighting and spatial atmosphere so it's not just "painting over" every frame? Or if that would even help it? Because the way it works now, I'm honestly concerned every major new game will soon start to look homogenous.
Yeah, turning up the lighting (essentially) on certain aspects of the background seems like an actual accessibility use case. There are probably far more direct ways of doing it that don't interfere with artistic intent as much. I wonder if we will ever get away from raster lighting in a way that isnt buttfucking computationally expensive.
Maybe? But considering that it's a 2D image with no underlying information about the models it would probably put light on things that shouldn't be lit up, actually detracting from what it should look like.
Yeah see Gamer's Nexus's video for examples on how much extra random light got added to scenes. The rooftops of Assassin's Creed Shadows look like a solar farm in the hot desert sun.
Maybe? It's a road trip simulator with European scenery, things light up irl regardless, you are the driver, watch the road.
People are so salty about this, I wonder how this tech will go xD
The alternative here is a mod that requires you to pay a subscription monthly w/ IP DRM, I would like to see SCS' answer.
16 Comments
nutbutter@discuss.tchncs.de · 12 pts · 136d
Tldw?
inclementimmigrant@lemmy.world · 57 pts · 136d
DLSS 5 is a 2D Instagram filter that normalizes/yassifises faces using a AI model trained on what Nvidia thinks is what people should look like.
capuccino@lemmy.world · 6 pts · 136d
Are there examples of how games like Minecraft (if possible) would look like?
Kolanaki@pawb.social · 29 pts · 136d
SaraTonin@lemmy.world · 8 pts · 136d
JDVance-ifier
TALL421@lemmy.world · 4 pts · 136d
"This will be minecraft in 2016"
MolochHorridus@piefed.social · 9 pts · 136d
It’s slop.
Deconceptualist@leminal.space · 7 pts · 136d
I haven't seen this video yet (will when I get home) but based on another by Gameranx, DLSS 5 looks like it will simultaneously:
If they can program it to just skip over character models, it might actually be good tech. Of course I have near zero faith in that happening.
inclementimmigrant@lemmy.world · 15 pts · 136d
I think to your second point, since this AI Instagram filter is based on a 2D picture with no understanding of the light source or materials, even the background with this tech will ruin things.
One of the things I said in another post is that the DLSS demo with Grace was that I wasn't just thrown by the face, I honestly was also thrown by the brightly lit background that really undermined what that scene was trying to convey.
To me the original scene was somber, she's visiting a murder scene, the background amplifies that somber, feeling of dread with everything darker, shadows everywhere threatening to consume the light. The DLSS 5 scene, everything is brighter, shinier and now that same scene isn't helping to convey the getting atmosphere, it's like the darkness is being overcome.
Deconceptualist@leminal.space · 1 pts · 134d
That's a very good point, and now that I've seen more coverage (including this video) and got a better understanding of how the tech works (based on 2D frames plus motion vectors) I'm inclined to agree.
I wonder if it would be possible to feed this system information about object materials and 3D lighting and spatial atmosphere so it's not just "painting over" every frame? Or if that would even help it? Because the way it works now, I'm honestly concerned every major new game will soon start to look homogenous.
Elting@piefed.social · 4 pts · 136d
Yeah, turning up the lighting (essentially) on certain aspects of the background seems like an actual accessibility use case. There are probably far more direct ways of doing it that don't interfere with artistic intent as much. I wonder if we will ever get away from raster lighting in a way that isnt buttfucking computationally expensive.
TalkingFlower@lemmy.world · -5 pts · 136d
It would look great with Euro Truck Simulator or Lushfoil Photography Sim, their styles pair well.
inclementimmigrant@lemmy.world · 14 pts · 136d
Maybe? But considering that it's a 2D image with no underlying information about the models it would probably put light on things that shouldn't be lit up, actually detracting from what it should look like.
BeardedGingerWonder@feddit.uk · 10 pts · 136d
I'm also assuming consistency is going to be an issue. Will characters look the same at the start of a sequence as the end? Or from load to load?
HarkMahlberg@kbin.earth · 7 pts · 136d
Yeah see Gamer's Nexus's video for examples on how much extra random light got added to scenes. The rooftops of Assassin's Creed Shadows look like a solar farm in the hot desert sun.
TalkingFlower@lemmy.world · -4 pts · 136d
Maybe? It's a road trip simulator with European scenery, things light up irl regardless, you are the driver, watch the road.
People are so salty about this, I wonder how this tech will go xD The alternative here is a mod that requires you to pay a subscription monthly w/ IP DRM, I would like to see SCS' answer.