Ya it really does sound like something to do with the firewall. Look into that if you can, whether it's iptables or a hardware firewall, you should be able to just mimick the settings for the non-ssl port over to the ssl port so that it accepts connections the same.