The commissioner may suspend, revoke or refuse to issue any license under this chapter whenever it is made to appear to him that the holder of such permit is not a fit or proper person to be permitted to continue to hold or receive such license.