What about any of those things?
Im still rocking my Corsair 750W PSU that I have owned for what must be close to a decade by now. Power usage of components doesn't really rise from generation-to-generation, and good quality hardware doesn't pop. Having a quick look on Amazon, PSU prices have also barely moved, from memory. PSUs really aren't an issue.
CPU prices have also barely moved, and the bang-for-buck that you can get these days is insane. My girlfriend is using an i3 10100F which is a 4c/8t CPU, that I got for £80 from Amazon, and is supposedly on-par with a 7th gen i7, and performs dangerously close to my 9600K. CPUs also really aren't an issue.
SSD prices, if anything, have gone way down. I remember when I got my first 120GB SSD, and it was close to about £50. These days, you can get 500GB for that money, or 1TB for an extra £25, depending on where you look. It is only with the high-performance Samsung or WD SSDs, where the prices start to look eye watering, but even an entry-level SSD will do the job.
I think one thing that a lot of people struggle with, when looking at a gaming PC, is feeling like you need the biggest and baddest parts, but really, that isn't the case. Get yourself a Ryzen 5 or an i5, 16GB RAM, a good quality 600W PSU, a 1TB SSOD, or 500GB and a HDD, and then pump the rest of your budget into a GPU, and you will be golden. The only thing that you will need to think about upgrading would be the GPU, or the storage,
Hell, I still know people who are still happily rocking 2nd gen i5s.
But again, I wouldn't fault anyone for still thinking that the up-front cost is too much to justify.