The board may grant, or refuse to grant a permit and may reject any application, after hearing.