We have installed a Graylog server and send in log data from multiple systems. We get an average of 3000 messages per second. For some reason Graylog is not efficiently reading messages from the journal. Any help would be highly appreciated!!! What could be the problem here?
48,881,103 unprocessed messages are currently in the journal, in 314 segments.
1,524 messages have been appended in the last second, 1,060 messages have been read in the last second.
The journal contains 48,857,121 unprocessed messages in 314 segments. 2,943 messages appended, 0 messages read in the last second.
That’s our graylog-settings.json file:
root@xyz:/home/ubuntu# vim /etc/graylog/graylog-settings.json
{
“timezone”: “Europe/Vienna”,
“smtp_server”: “mailhub.xyz.at”,
“smtp_port”: 2500,
“smtp_user”: “”,
“smtp_password”: “”,
“smtp_from_email”: “graylog@xyz.at”,
“smtp_web_url”: “http://graylog-beta”,
“smtp_no_tls”: true,
“smtp_no_ssl”: true,
“master_node”: “127.0.0.1”,
“local_connect”: false,
“current_address”: “172.20.45.29”,
“last_address”: “172.20.45.29”,
“enforce_ssl”: false,
“journal_size”: 100,
“node_id”: false,
“internal_logging”: false,
“web_listen_uri”: false,
“web_endpoint_uri”: false,
“rest_listen_uri”: false,
“rest_transport_uri”: false,
“external_rest_uri”: false,
“custom_attributes”: {
“graylog-server”: {
“memory”: “10240m”
},
“elasticsearch”: {
“memory”: “10240m”
}
}
}
