Have you been following the latest instructions to create your self-signed certificates?
Make sure that they contain the IP address in the subjectAltName part of the certificates as described at http://docs.graylog.org/en/2.3/pages/configuration/https.html#creating-a-self-signed-private-key-certificate