"Allow background processing of Vulkan shaders" in combination with nouveau drivers cause massive memory usage leading to OOM

steamclosed

ValveSoftware/steam-for-linux#9065 · opened 2023-01-03 by ver4a · updated 2023-02-12 · 1 comments · github

Vver4a 2023-01-03 github

Your system information

Steam client version (build number or date): Dec 15 2022, at 21:27:25
Distribution (e.g. Ubuntu): Fedora 37
Opted into Steam client beta?: No
Have you checked for system updates?: Yes

Please describe your issue in as much detail as possible:

Whenever I have nouveau drivers loaded and run steam, the "fossilize_replay" process fills memory at roughly 5GB/s (with swap it varies) until it fills memory+swap (which total 60GB on my system) and triggers systemd-oomd, "fossilize_replay" gets killed, created again by steam and the process repeats. This issue doesn't occur with the proprietary nvidia driver.
Disabling "background processing of vulkan shaders" mitigates the issue.

Technical details:
Kernel: Linux 6.0.15 (but I have the same symptoms on 6.2-rc1 mainline)
DE: KDE Plasma 5.26.4
WM: KWin (X11)
GPU: 2080 Super
nouveau driver: 1.0.17
nvidia driver: 525.60.11
Steam was installed from rpmfusion repository

Steps for reproducing this issue:

Have nouveau drivers active (Fedora and other distros default to this)
Install a game that uses proton and background processing of vulkan shaders
Run steam

Kkisak-valve maintainer 2023-01-03 github

Hello @TheSiman, your issue is with the memory usage of lavapipe in combination with fossilize_replay and has nothing to do with nouveau beyond the fact that nouveau is not a Vulkan implementation. This is the same issue as https://github.com/ValveSoftware/Fossilize/issues/205 (and https://github.com/ValveSoftware/Fossilize/issues/200). Closing in favor of the older issue report.

Nothing extracted yet.