Do enemies keep moving during those twenty seconds when the host is away, or does the match pause? Keeping the connection alive helps, but returning to find the team overwhelmed would make a phone interruption pretty costly
I'm still thinking through solutions to this entire problem of phone hosting, it might be that we do the hosting for phone only groups to avoid the problems associated with it.
A short countdown visible to everyone when the host returns could help with the current pause. It would give the person switching back time to find the controls before the fight starts moving again