If any person permanently appointed to a position (other than stenographic or clerical) on the permanent staff of a district office either fails to establish or fails to continue his residence within the prescribed area, it shall be cause for discharge from his position by the appointing authority.