Each electrical utility shall have an office in one of the counties of this State in which its property or some part thereof is located and shall keep in such office all books, accounts, papers and records as shall be required by the Commission to be kept within the State. No books, accounts, papers or records required by the Commission to be kept within the State shall be removed at any time from the State except upon such conditions as may be prescribed by the Commission.