The Governor has power to remove from office any member of the board for neglect of any duty required by this chapter, for incompetency, or for unprofessional conduct.