I went out and got the AMD 7800xt to do ultrafast AV1 encoding of large h264 and hevc files.
I am able to select VCN acceleration options in Windows but not Linux Handbrake.
I have tried the flatpak and both the Pop_OS and ppa deb packages of Handbrake. I have the latest mesa driver and am running the most current version of PopOS 22.04. I’ve had no issues gaming at all, just with picking the hardware encoder in Handbrake. Any ideas or rabbit holes I can go down?
You need to use amdgpu-pro, according to the page here. I tried installing the pro drivers on Linux Mint a few weeks ago and still couldn’t get hardware acceleration in Handbrake to work, but it might be worth a shot.