The commissioner is empowered to suspend or cancel any license issued pursuant to the provisions of sections 32.071 to 32.076 after a hearing upon written notice containing the grounds therefor, which notice shall be served personally upon the licensee or the licensee's agent at least five days prior to such hearing.