I thought I got agreement with Philip that this should be fixed in DXVK instead of worked around in radv. If there is really no plan for DXVK to fix it I may have to reconsider ...
For context: even if it happens to some degree on all GPUs the issue at hand here is that it is much worse for APUs, because DXVK pulls considerably more into the address space for these.
I'll try to fix this in DXVK. It's going to be a bit of work though, because right now i'm not tracking whether an allocation needs to be mapped or not.
eac86fab1536e070c9af703de3c4140069c20a61 should fix this for now. It's a rather simple solution that might slightly increase overall memory consumption on such systems, but should be good enough in practice.
Thanks. It seems, like Grey Goo (32 bit) is now runs fine on RADV 18.3-git and AMD Raven.
RADV_MEM_HEAP_COUNTx1 2018-09
It seems like DXVK by default maps every buffer which can be mapped. On an APU all buffers are going to be able to be mapped, resulting in running out of address space in 32-bit applications.
RADV patch to get an APU like memory configuration: