A challenge to the panel is an objection made to all the trial jurors returned, and may be taken by either party.

R.L. 1910, § 5841.