The Department of Corrections shall provide a death chamber and all necessary appliances for inflicting such penalty by electrocution and pay the costs thereof out of any funds in its hands. The expense of transporting any such criminal to the State Penitentiary shall be borne by the county in which the offense was committed.