Submitted 19 hours ago by dmir@gehirneimer.de to steamdeck@sopuli.xyz
https://www.techspot.com/news/114133-amd-fsr-4-coming-handhelds-laptops-end-2026.html
While the support itself doesn't necessarily mean OS-level toggle like the Steam Deck has right (which I believe is still at FSR 1), it still could be a nice touch for the titles that choose to implement FSR 4.
Maybe the community adds the OS-level support unofficially, somewhat similarly to Lossless Scaling right now (although perhaps for free).
FSR4 would benefit from specialized hardware cores used to accelerate Ai based workload. Looking at AMDs site: www.amd.com/en/products/…/super-resolution.html
(Sorry for screenshot, couldn’t copy-paste easily.) REdstone is FSR 4 here. The RX 7000 graphics cards here can only use Upscaling. So I would expect any older generation of (and weaker) hardware like Steam Deck should also only be able to use Upscaling, not the full set of features. And because these graphics cards and older hardware do not have the hardware cores to accelerate Ai based workload, they should require more power and latency. Just my assumption here.
The table shows 3 types of upscaling: Spatioal, Temporal and ML-Based. Spatial is without Ai, and the game does not require any support, it’s like a Photoshop effect after the image is created (simply speaking). Temporal is more complex, taking multiple images from the game with builtin support from the game to produce better results. This doesn’t necessarily require Ai, but AMD decided to combine Temporal with their FSR 2 and FSR 3 with Ai based logic. Now I do not understand why ML-Based Upscaling is not available to FSR 2 and FSR 3. Maybe this requires special hardware that is only available on the new RX 9000 cards… Ah yes, I was right: en.wikipedia.org/wiki/Radeon_RX_9000_series#FSR_4
FidelityFX Super Resolution 4 (FSR 4) is AMD’s first machine-learning upscaling solution that is able to leverage the second-generation AI accelerator cores in the RDNA 4 architecture.[14] AMD stated that due to requiring hardware acceleration, FSR 4 was limited to the Radeon RX 9000 series.
That means, the FSR 4 version that could be available on Steam Deck is not the same upscaler used on these cards. So we get a FSR 3 styled upscaler (Temporal) only and I wonder how much better it is, if any, and how much more power it draws. I think its important to make this distinction.
These are all solid assumptions and I thank you for providing the data to try and manage expectations here.
However, I do think you're making the case for the current state of things as opposed to what AMD is apparently trying to achieve by supporting older hardware with FSR 4.
That said, it's probably going to be somewhere in the middle, with RDNA 4 (which Steam Deck APU is not) getting the full potential that FSR 4 can provide, and RDNA 2 (which Steam Deck APU is) seeing at least some of it. I wonder if the latter is going to be of any benefit compared to what Steam Deck users have now, especially in terms of the power draw, like you mentioned.
“Supporting” and “working well” are different things though.
Without the low precision/specialized instructions of newer hardware, there’s just a fundamental limit to what can be done without the overhead of FSR being too much. Though there are certainly some implementations that could work on older hardware, I’m sure.
You can already use FSR4 on Steam Deck btw, no need to wait if you want to try it out!
Proton-CachyOS also can upgrade FSR3 games to FSR4 on RX 6000 and 7000 series of GPUs, and it works outside of the Steam Deck platform.
thingsiplay@lemmy.ml 17 hours ago
No, this is not possible. FSR 1 is an algorithm that works on the output image, like a Photoshop filter. That means HUD elements can’t be distinguished from the actual game world in example. Since FSR 2 (and upwards) its different. It needs to be integrated into the game, understanding what it does and compare multiple images. It is Ai based and requires training from the game itself. That’s why you don’t get system level integration for DLSS too. So that is out of question.
exist@sopuli.xyz 5 hours ago
Afaik dlss and fsr are pretrained models and they don’t train them for each specific game. Modders totally do enable them for games that don’t support them natively, but it can be quite involved because it needs the motion vectors and maybe depth from the game.
thingsiplay@lemmy.ml 4 hours ago
Maybe I misunderstood it and its not about adjustment training to specific games, and its about adjusting settings or something like that. I searched for a resource to point to that, but cannot find. It’s really hard to search about this topic online, because its always the same basic explanations what Ai upsaclers are (probably written by an Ai model itself…).
I know of modders being able to replace an existing model that already has motion vectors and depth. It would just reuse those information, because the API is agnostic to the models. If modders add vectors and depth by their own, that does not change the fact that DLSS or FSR 2+ can only work with those data.
brucethemoose@lemmy.world 6 hours ago
I think it needs depth buffer access and a UI mask, but not necessarily deep integration beyond that? At least for the FSR3 shader code I’ve looked at personally.
This is not out of the question for generic integration.
I’m less sure if FSR4 though, as I think that was a pretty big leap over 3.
thingsiplay@lemmy.ml 6 hours ago
I don’t know the exact process too, so we are both speculating. But its fact that Temporal upscaling (that is FSR2 and upwards for FSR related ones) need integration from the game. And these are Ai models that needs some kind of training data from the game as well. I don’t know what that exactly means, but my guess is that the integrated Ai model to upscale is trained with the data in the game and then delivered as a package. That makes it impossible to integrate a general purpose Temporal upscaler with Ai into a system, that could be utlized on any game (or program if you will). So I don’t know how this cannot be anything else “out of question”. I mean this is by concept not possible, as far as I understand (and why nobody did it too).
But an Ai system could be used as a Spatial upscaler, like a filter that is not integrated into the game. FSR 1 itself is not using any Ai, but DLSS 5 has such capabilities (think of the new lighting model, it could be tweaked to upscale the image instead).
Kolanaki@pawb.social 16 hours ago
I can use FSR4 in games that don’t have it, on hardware that doesn’t support it with Optiscaler. How the fuck did it train on shit it wasn’t actually made for if that’s how it worked?
thingsiplay@lemmy.ml 16 hours ago
What exactly do you mean? Any link? As explained. FSR 2, 3 and 4 needs training data from the game. It is possible to swap DLSS out with FSR variants, because DLSS has the training data already. But you cannot have FSR 2, 3 and 4 on all games like FSR 1. And FSR 4 also has to modes as it seems, one classical Temporal like 2 and 3 that runs on relatively older hardware too, and the new ML-based variant that requires the new cores on RX 9000 hardware.
If you use Optiscaler, then I think what happens is that you swap the DLSS implementation with FSR 4 Temporal variant out. I searched the web a bit and found this: github.com/optiscaler/OptiScaler
So what part I was wrong about exactly?