The game continues, we don't pause. There's a 5 second grace period to absorb refreshes, after which the server auto-passes priority on the disconnected player's behalf. They can reconnect anytime and the authoritative durable object places them back into current state.
This also only mostly matters in the "full priority" mode where players are actively passing priority all the time. In the more casual modes it doesn't come up too much.