Whenever a convict shall be discharged from the penitentiary, the State Department of Corrections shall furnish such convict with a suit of common clothes, if deemed necessary, and transportation from the penitentiary to his home or as near thereto as can be done by public conveyances. The cost of such transportation and clothes shall be paid to the State Treasurer, on the draft of the department, countersigned by the Comptroller General.