In Remote Play Together - How does Steam decide when to Pause the stream?

Sometimes Steam will pause the Remote Play Together stream when a game is running
Sometimes it will stream the game launcher, but not the game
Sometimes it will not stream the launcher which is needed to set up controllers

How does Steam decide when to pause a stream and are there any workarounds to un-pause it?