A challenge to a panel is an objection made to all the trial jurors returned and may be taken by either party.