Add cleanup in the certificate renewal logic to remove old pki material.

The current solution will use the mechanism of signAndStoreCertificate which stores the old pki material in a backup directory, but from the main directory the necessary material are removed.