4 ms·

It might be that you need to update Safari to get the latest root certificate authorities. I'm on 5.0.5 on 10.6.8 and don't have the problem.