Since today around 17:21 the graylog server logs are flooded with messages like:
2019-07-10T19:41:37.975+01:00 WARN [ProxiedResource] Unable to call http://gray.log.ip.address:9000/api/system on node <node-id> java.net.SocketTimeoutException: timeout.
I can call the api from the command line with and get a response:
$ curl -i 'http://gray.log.ip.address:9000/api/system/metrics/' -u user:pass
but this hangs:
$ curl -i 'http://gray.log.ip.address:9000/api/system/' -u user:pass
The web interface is working visibly slower and I cannot access the node API browser.
A little earlier I noticed I had indexer failures, but that was solved by setting “index.blocks.read_only_allow_delete”: null, not sure if this could possibly be related
Does anyone have any insight regarding this issue?
thanks in advance