I think you get a performance hit because your CPU is so old, them new Ryzen CPUs can run games, capture video and stream the output, all the while the machine running in a VM without a sweat.
My CPU is a generation older than yours, under W10 with every semiannual feature update it was getting more sluggish, with Pop is like a new machine.
I'm a compulsive builder/fixer/tinkerer. In the fall I sold my custom built pc (8th gen intel quad core i3 built in 2018) because I was going to build a brand spanking new Ryzen system. I got this Lenovo 4th gen pc for $90 Canadian without a hard drive as a temp computer until the Ryzen got built.
Then I started asking myself if I really needed a new Ryzen - I don't. This Lenovo does everything I need. 90% of my use is browser based stuff.
A 4th gen quad core i5 with 8GB RAM is fine. I put in a small 120GB SSD for the operating system with a 1TB mechanical hard drive for storage/backup etc and then added a cheap 1GB GTX 710 graphics card ($40 CAD) because the onboard graphics couldn't do 2560X1080 on my ultra-wide monitor.
My current setup is fine. I tried bumping up RAM from 8GB to 16GB and it had ZERO effect and I know this because I had the system monitors running and used benchmark progs to see how it would perform. So 8GB is definitely more than enough for a non gaming pc running Linux.
I pulled the extra 8GB of RAM and sold them on kijiji.
Since the only things I do on my pc are browser based or videos on VLC or Spotify music I really don't need anything more powerful. The SSD is critical to reasonable performance. Plus I've always LOVED Lenovo(IBM) Gigabyte and ASUS since I got involved in pc's years ago.