No telephone utility shall abandon all or any portion of its service to the public, except for ordinary discontinuance of service for nonpayment of a lawful charge or for violation of rules and regulations approved by the Commission, unless written application is first made to the Commission for the issuance of a certificate authorizing such abandonment, nor until the Commission in its discretion issues such certificate.