Join in session is a necessary thing. Spectating takes up a spot better served for players.
I think the better option would for incoming players to be able to see the score and time left and choose to join or back out without penalty. If you get into a match and decide you want no part of it, you can back out without taking a loss. If you want in, you just hit join match, choose your loadout, and start playing.