Single executives heading principal departments and the chief executive officers of principal departments headed by boards or commissions shall keep their offices at the seat of government except as otherwise provided by law, superintend them in person and perform duties prescribed by law.