Did further testing on this, and the last version of DeoVR which seems to work with newer drivers seems to be the one released in 30th of March 2021 (manifest 7185922987022268259), which was before the UI update, so whatever change was made to the way previews/thumbnails are played is clearly playing a part into the incompatibility between AMD drivers and DeoVR.
Additionally, this is almost certainly the same issue found by these users https://forum.deovr.com/d/953-deovr-causes-graphics-driver-crash-soon-after-startup they just didn't realize that it was the thumbnail preview causing the crash.
Finally, for users that need this to work, the only workaround I have found so far is to either install driver version 22.5.1 or download DeoVR build with manifest 7185922987022268259 which can be done by pressing WIN+R keys then writing steam://open/console and pressing ok, finally on the steam console all that is left to do is write download_depot 837380 837381 7185922987022268259 and press enter, this will download the last working version and then say on the console where it downloaded to, then ofc it is just a question of opening the DeoVR.exe in that location.