protonscr

New Media Source Megaissue - Proton Experimental

protonclosed
ValveSoftware/Proton#8186 · opened 2024-10-23 by ivyl · updated 2025-05-05 · 39 comments · github
Iivyl 2024-10-23 github

Living true to its name Proton Experimental will serve as a vehicle to roll out and test a new implementation of media source. While it improves video playback in many games and enables us to fix even more things in the future, the change is substantial and may cause regressions.

We've done extensive internal testing and made the changes available via the bleeding-edge beta branch already. Now it's time to push this experiment even further - into the default Proton Experimental.

In case of regressions in video playback please report them here.
There's a beta branch named old-media-source (select Proton Experimental in you Steam Library -> cog icon -> Properties -> Betas -> and select the branch from the beta participation drop-down).

If you face any issues please make sure that they are not present with old-media-source before reporting them here.

Games with fixed or improved video playback:

  • Gal*Gun 2
  • SOULCALIBUR VI
  • Call of Cthulhu
  • All-Star Fruit Racing
  • Greedfall
  • Onimusha: Warlords
  • Bloodstained: Ritual of the Night
  • Indigo Park: Chapter 1
  • Agony Unrated
  • TELEFORUM

Known issues:

  • Resident Evil 7 videos fail to play.
  • Resident Evil Village videos fail to play.
  • Quantum Break videos have green flashes and intermittent crashes.
  • Shin Megami Tensei III has intermittent video playback failure.

For any affected games please use stable Proton 9.0-3 (the default) or the old-media-source beta branch while we work on fixes.

Wwaspennator 2024-10-23 github

This new media source seems to break Raiden V Directors cut. This game used to have problems with seizure inducing flickering during fmvs, but it seems like using 8.0-5, it stays on a white screen, but i can still hear and skip the fmv and eventually get to the main menu if I press a enough.

On 9.0 and onwards, the game just gets outright stuck after the fmv plays whether you let it play through or manually skip it.

Now with this new media update, the game won't even start unless I use the proton log command, even then the fmv still flickers and eventually gets softlocked before the title screen.

steam-570050.log

DDekosAnjo 2024-10-23 github

Cool! I hope it fixes a lot of the playback failures Proton has had since the beginning. I'll start testing my games right now!

Wwaspennator 2024-10-24 github

Moero Chronicles crashes on startup with this, if I try it with the old media source it gets stuck visually on some weird blocky lines. If I drop to 9.0-3 it works but only plays audio.

If i launch it with Experimental and proton log, it doesn't crash but gets stuck with a small bit of static garbage on the bottom left of the screen.

steam-638160.zip

Rranplayer 2024-10-24 github

Darksiders Warmastered Edition cutscenes finally working (some audio crackling)

AAJuujarvi 2024-10-25 github

This new media source seems to break Raiden V Directors cut. This game used to have problems with seizure inducing flickering during fmvs, but it seems like using 8.0-5, it stays on a white screen, but i can still hear and skip the fmv and eventually get to the main menu if I press a enough.

On 9.0 and onwards, the game just gets outright stuck after the fmv plays whether you let it play through or manually skip it.

Now with this new media update, the game won't even start unless I use the proton log command, even then the fmv still flickers and eventually gets softlocked before the title screen.

steam-570050.log

@waspennator I am unable to reproduce this one on an OLED Deck or a Desktop. I get the flickering fmvs and then can able to get to the main menu with 8.0-5, 9.0-3, experimental-9.0-20241022, and experimental-9.0-20241022-old-media-source. Were you doing something on the Deck at the same time that may introduce some performance degradation? For example, if you were downloading something at the same time to internal storage or an SD card, it can cause some video playback issues. Or did you have some third party plugin installed? The fact that with experimental-9.0-20241022 the game isn't booting unless you are logging indicates some sort of race condition.

One thing you can try is seeing if the game boots properly after rebooting your deck from a shut down state. I would be interested in if it works then, and if the failure then returns after booting the game multiple times from there.

Wwaspennator 2024-10-25 github

Replying to https://github.com/ValveSoftware/Proton/issues/8186#issuecomment-2438169889

Tried it again today to double check and weirdly enough it fixed itself on its own, dunno why it happened yesterday though. I wasn't downloading anything nor was i using plug-ins while testing to influence anything. Moero Chronicles still seems to crash though without proton log.

Unrelared, but i tested out the new media source on a few other games and I can confirm it makes the boss fmvs for River City Girls play (audio is pretty crackly though) and Radiant silvergun no longer crashes when trying to play fmvs (they need to be reencoded though.) AQUARIUMs fmv on the title screen still fails to play even with this pr though.

SSmithAF 2024-10-28 github

I was curious to see if this might have an improvement on Battlefleet Gothic's audio during cut scenes, that being heavy distortion, but unfortunately no change between experimental and 9.0-3. Not the most useful of comments but thought I'd mention in case it's something that can be fixed as part of this work
steam-363680.log

Hhikarutilmitt 2024-11-01 github

This fixed the video playback in Hyperdimension Neptunia U. Only hitch is that if you try to skip a video the game locks up.

SStr4ngeB0y 2024-11-02 github

The pre-rendered cutscenes in NieR Replicant used to work flawlessy with GE-Proton but nowadays you either have to:

input this as a startup command:
PROTON_AUDIO_CONVERT=0 PROTON_AUDIO_CONVERT_BIN=0 PROTON_VIDEO_CONVERT=0 PROTON_DEMUX=0 %command%
or
use GE-Proton 9-13 or older

AAJuujarvi 2024-11-04 github

The pre-rendered cutscenes in NieR Replicant used to work flawlessy with GE-Proton but nowadays you either have to:

input this as a startup command: PROTON_AUDIO_CONVERT=0 PROTON_AUDIO_CONVERT_BIN=0 PROTON_VIDEO_CONVERT=0 PROTON_DEMUX=0 %command% or use GE-Proton 9-13 or older

What cutscenes are you talking about exactly so I know what to look for? I've looked at the Dev splash screens and the cutscene that plays before gameplay when you start a new game and that is working well for me with proton-9.0-3c, experimental-9.0-20241022, experimental-bleeding-edge-9.0-132337-20241104.

SStr4ngeB0y 2024-11-04 github

The pre-rendered cutscenes in NieR Replicant used to work flawlessy with GE-Proton but nowadays you either have to:
input this as a startup command: PROTON_AUDIO_CONVERT=0 PROTON_AUDIO_CONVERT_BIN=0 PROTON_VIDEO_CONVERT=0 PROTON_DEMUX=0 %command% or use GE-Proton 9-13 or older

What cutscenes are you talking about exactly so I know what to look for? I've looked at the Dev splash screens and the cutscene that plays before gameplay when you start a new game and that is working well for me with proton-9.0-3c, experimental-9.0-20241022, experimental-bleeding-edge-9.0-132337-20241104.

There aren't many pre-rendered cutscenes in the game but the earliest you can get one is when you idle in the main menu long enough.
It's important that you wait while it says "Press Any Button"! If you already pressed a button and then wait, the cutscene won't appear.

AAJuujarvi 2024-11-04 github

There aren't many pre-rendered cutscenes in the game but the earliest you can get one is when you idle in the main menu long enough.
It's important that you wait while it says "Press Any Button"! If you already pressed a button and then wait, the cutscene won't appear.

Using that video that plays on the main menu, I am still having playback with proton-9.0-3c, experimental-9.0-20241022, experimental-bleeding-edge-9.0-132337-20241104. Please check to make sure there is a transcoded_video.foz file found in ~/.steam/steam/steamapps/shadercache/1113560.

Please check to see if you are having the same playback issues with the Proton versions I listed above. For experimental-bleeding-edge-9.0-132337-20241104, you can get this (or a newer version depending on when you try) by going to Proton Experimental, clicking the Gear button, clicking Properties, scrolling down to Betas, and selecting the dropdown next to Beta Participation. There, select Bleeding Edge.

SStr4ngeB0y 2024-11-04 github

Replying to https://github.com/ValveSoftware/Proton/issues/8186#issuecomment-2455428560

I made a new discovery.
Turning on shader pre-caching made the pre-rendered cutscenes playable (I had shader pre-caching disabled before but turned it on when you mentioned the shadercache folder). When I tried out Proton Experimental (with and without bleeding-edge), I noticed that the video speed was wrong, leading to a desync between video and audio. Stable Proton 9.0-3 seems to work without any issue.

AAJuujarvi 2024-11-04 github

Replying to [#8186 (comment)](https://github.com/ValveSoftware/Proton/issues/8186#issuecomment-2455428560)

I made a new discovery. Turning on shader pre-caching made the pre-rendered cutscenes playable (I had shader pre-caching disabled before but turned it on when you mentioned the shadercache folder). When I tried out Proton Experimental (with and without bleeding-edge), I noticed that the video speed was wrong, leading to a desync between video and audio. Stable Proton 9.0-3 seems to work without any issue.

I am glad it was a shader pre-caching thing for the issue previously reported. Glad we figured that out. :)

In regards to the desync, you are correct. It's pretty significant desync that I am seeing, upwards of several seconds. I checked this with our Proton Experimental build that is shipped vs the same one with the old media source (found as a beta branch in Proton Experimental) and this confirmed for me it is due to the New Media Source work. We are now tracking this, thank you. :)

AAJuujarvi 2024-11-08 github

This fixed the video playback in Hyperdimension Neptunia U. Only hitch is that if you try to skip a video the game locks up.

@hikarutilmitt I'm trying to figure out what videos are improved and struggling. Can you clarify what videos please? From what we can tell for the intro splash screens, the behavior matches Proton 9.0-3 and experimental-9.0-20241022-old-media-source, where they play properly with an occasional stutter and they will freeze if you skip them. Are there videos further into the game specifically that might be broken with normal playback (not counting the skipping breaking it) with Proton 9.0-3/experimental-9.0-20241022-old-media-source that is now improved?

Hhikarutilmitt 2024-11-08 github

This fixed the video playback in Hyperdimension Neptunia U. Only hitch is that if you try to skip a video the game locks up.

@hikarutilmitt I'm trying to figure out what videos are improved and struggling. Can you clarify what videos please? From what we can tell for the intro splash screens, the behavior matches Proton 9.0-3 and experimental-9.0-20241022-old-media-source, where they play properly with an occasional stutter and they will freeze if you skip them. Are there videos further into the game specifically that might be broken with normal playback (not counting the skipping breaking it) with Proton 9.0-3/experimental-9.0-20241022-old-media-source that is now improved?

I guess you can disregard my message, then. I usually live on Experimental as my default and had been trying new releases on the game to see if they ever got past the videos. I hadn't tried 9.0-3 but had tried 9.0-1 before when it came out and the videos were pretty much impossible to get past, then. The only previous version where the game worked normally was 5.0-10, but the videos wouldn't play, but you could skip past them by hitting the button as though they were playing.

The only other videos I'm aware of that would play would be the video that plays post-intro scenario (after doing the 2 initial scenarios but before you can actually save) and the ending credits video.

I'd be curious to know at some point exactly why the game freezes when skipping the videos, though, haha. Nothing of note seems to show up in the Proton logs when you do it, just... the game crashing.

AAwesamLinux 2024-11-08 github

Issue:
Massacre At The Mirage (2794610) #8226 - The game hangs/freezes when video should be played, unless using the old-media-source

Improved:
Remothered: Tormented Fathers (633360) #2581 - The videos are now displayed with proper gamma/brightness with the new media source.

Ttgurr 2024-11-09 · hidden on GitHub github

AJuujarvi: Please check to make sure there is a transcoded_video.foz file found in ~/.steam/steam/steamapps/shadercache/1113560
Str4ngeB0y: Turning on shader pre-caching made the pre-rendered cutscenes playable (I had shader pre-caching disabled before but turned it on when you mentioned the shadercache folder)

@AJuujarvi I don't want to hijack this thread but having stumbled upon this issue myself I'd like to ask and/or know if it may already be in the pipeline to decouple downloading the pre-rendered/re-encoded videos from the actual shader pre-caching option as to me they're both completely different things and personally I for example want the re-encoded videos if required for a certain game but do not want to activate shader pre-caching globally so having those two things decoupled (or able to be set just for a specific game) would be great. Additionally since the informational text the steam client offers for the shader pre-caching option also doesn't (currently) even mention that the shader pre-caching option might have something to do with (missing) videos.

Nnightsky30 2024-11-09 github

Would this be an appropriate thread to report game regressions where crashes occur due to missing GStreamer decoders? Rogue Heroes: Ruins of Tasos (787810) previously worked. It has been crashing shortly after reaching the initial loading screen when starting the game. I believe an Advanced Streaming Format (ASF) (video/x-ms-asf) video previously played. Logs are attached in the linked game issue.

AAJuujarvi 2024-11-12 github

Would this be an appropriate thread to report game regressions where crashes occur due to missing GStreamer decoders? Rogue Heroes: Ruins of Tasos (787810) previously worked. It has been crashing shortly after reaching the initial loading screen when starting the game. I believe an Advanced Streaming Format (ASF) (video/x-ms-asf) video previously played. Logs are attached in the linked game issue.

@nightsky30 If you are referencing the issue back from April, it would be unrelated to this Megaissue thread as this is specifically for our New Media Source implementation we recently put out. I will follow up with you on that issue for further investigation on that ticket. :)

Wwaspennator 2024-11-12 github

Moero Chronicles has not been fixed with proton Experimental, the game with the new media source seems to get stuck unless I manually swap from the active movie tab to the moero Chronicles tab for the logo fmv and intro fmv, if I tab between them I can see a single frame of the fmv, if I tab back it goes black again and the audio restarts. If I use the old media source it does the same behavior mentioned in my older posts where the screen is a garbled mess of static lines and blasts me with static noise.

Game should be removed from the proton Experimental changelog until it's actually fixed.

steam-638160.log

VVolRencs 2024-12-25 github

The problem with video playback is also noticed in Lockdown Protocol and The Light Remake.
изображение

VVolRencs 2024-12-29 github

It's the same one in Nuclear Nightmare

PPickMeNow 2024-12-30 github

Problem also in MGS5 Phantom Pain and MGSGZ

VVolRencs 2024-12-30 github

Same thing at Zort.

Aalasky17 2025-01-02 github

@VolRencs @PickMeNow The test pattern that you've screenshotted is a replacement for videos which are not yet available to play in Proton - if you see that replacement video, it means the system is working and after enough folks have played the game the transcoded video will be available to replace the test pattern and automatically downloaded into a file called shadercache/[appid]/transcoded_video.foz. (As a note, these will only play if you have shader pre-caching enabled).

This thread is specifically for regressions between old_media_source and new_media_source - are you seeing the test pattern only with new_media_source (Proton - Experimental), or with all proton versions right now?

As a side note - there isn't anything we can do if you see the test pattern except wait for the full video to eventually be available.

Wwaspennator 2025-01-04 github

River City Girls 1 still seems to suffer from audio crackling and static during fmvs with the new media source with proton Experimental currently

PPickMeNow 2025-01-04 github

@alasky17 The problem that I am experiencing is that I don´t even see the test pattern, like in the previous versions of proton, so I believe it's a problem with the new media source ( Tested with Proton Experimental ) , with older versions of Proton ( Proton 8 ), I have the test pattern showing up.

Example 1:
When I finish the prologue in MGS5, after displaying Chapter 1 title, I only get a black screen and the game does not progress any further, no test pattern whatsoever.

Example 2:
In ending video of MGS: GZ the video does play but at double of the speed with the audio being screeched and robotic and cracking. This also happens across MGS5 in specific cutscenes, one that I can recall is after saving Miller and he recollects what happen in the helicopter.

I verified and have shader-caching enabled, I think it would be nice to add a note for Shader Pre-caching detailed information, that these new transcoded videos can only be seen with this option activated.

Let me know if there is more information I can share or help in any way.

VVankog 2025-01-25 github
  1. @alasky17, thank you for clarifying the test pattern. Can you point us to any kind of documentation about this? Because this is driving people nuts on the internet. The general consensus is, that these videos are encoded in an unsupported codec. Thus, they try out various wonky methods with installing all sorts of codec and dlls. It seems, mostly it is recommended to use GE, as this would work... sometimes.
  2. Regression: Guayota on Steam Deck:
    This used to work flawlessly according to the steam deck verification and several online videos.
    1. However, for me on the latest game version and proton 9, the intro and following video scenes show the test pattern with audio. So I guess this is fine, though a bit weird as they have evidently worked before.
    2. Though, with proton Hotfix and Experimental we only see a black screen, no audio anymore. And if you skip the scene the game freezes. Proton 8 the same.
SSoraBytes 2025-01-27 github

@VolRencs @PickMeNow The test pattern that you've screenshotted is a replacement for videos which are not yet available to play in Proton - if you see that replacement video, it means the system is working and after enough folks have played the game the transcoded video will be available to replace the test pattern and automatically downloaded into a file called shadercache/[appid]/transcoded_video.foz. (As a note, these will only play if you have shader pre-caching enabled).

A few months ago I disabled shader pre-caching so I guess thats why all of my games are no longer playing videos, despite having done so previously. I would have never known shader pre-caching was a requirement had I not seen this comment. The shader pre-caching comment in the client settings should be updated with a better description that indicates it includes video playback. I had no idea thats why all of my videos broke despite previously working.

Eex0planetary 2025-02-08 github

Lethal Company has these little videos showing off the moon you're above on the main monitor (underneath the text that has the name of the moon and whatnot). Seems like they're just not rendering whatsoever on the new media source implementation. Going to old-media-source or 9.0 fixes them.

KKawaiiDinosaur 2025-02-10 github

Devil May Cry HD Collection has audio issues in FMVs in both 9.0 and Experimental, but on Experimental the audio out of sync, playing more than a second later.

AAJuujarvi 2025-02-10 github

@ex0planetary I was able to replicate this issue, it's an issue with transcoded video playback with the New Media Source work. In the meantime, you should be able to run steam steam://unlockh264/ on your device and you should be able to run videos well even with Proton Experimental that includes the New Media Source work.

AAJuujarvi 2025-02-10 github

@KawaiiDinosaur I took a look into this and it appears that instead of the audio being out of sync, it is the video out of sync. Timing when the warning gets destroyed at the very beginning shows it happening nearly immediately with Proton Experimental but taking about 1 second with Proton 9.0-4d. We will take a look into this one, although a fix may take awhile.

HHasshu 2025-02-16 github

@Str4ngeB0y @AJuujarvi @tgurr @PickMeNow @SoraBytes Regarding the transcoding shenanigans, see ValveSoftware/steam-for-linux#9132.

MMCSeekeri 2025-03-06 github

Pacific Drive
The Logo video at startup doesn't play properly, but it doesn't affect normal gameplay.

Nnocs13 2025-05-03 github

I also have issue relate to Proton experimental and hostfix. I not sure that it related but i cannot open new issue so i drop here screenshot. I suspect that proton use wine predefined as WIndows XP, which is incompatible to directx11.

this issue appeared after 30 Apr. Before I was able play without issue.

Image

Iivyl 2025-05-05 github

I've pointed some people towards the issue reported above.

It has nothing to do with media playback though and since new media source is no longer part of any proton release in favor of using winedmo I'm closing this mega issue.

Aalasky17 2025-05-05 github

I also have issue relate to Proton experimental and hostfix. I not sure that it related but i cannot open new issue so i drop here screenshot. I suspect that proton use wine predefined as WIndows XP, which is incompatible to directx11.

this issue appeared after 30 Apr. Before I was able play without issue.

Image

I would suggest trying to delete your prefix (default location in ~/.steam/steam/steamapps/compatdata/[prefixnumber] or do a fresh install of battle.net. Since this is a non-steam game, the prefix folder will probably have a long string - the default is the appid, but this game doesn't have one. Otherwise - hopefully you can figure out how to file a new issue :)