When you enter the server URL you need to make sure it exactly matches the certificate you installed on the machine running the ATE. I would double click on the certificate again and confirm the hostname and then try again.
The other possibility is that you didn't install the certificate to the Trusted Root Certificate Authorities store.
--Bill