Our Graylog instance get not say high rate messages around 1000-2000 msg/s and journal growing till i get an alert in web interface that some uncommitted messages was deleted from journal and journal utilization is too high? Can you advise which parameters should be tweaked for handle this load? Al…

Graylog Journal will raise if Elasticsearch is not able to handle the load or if the processing in Graylog took to much time so no real time processing is possible. You should check your Logfiles of Graylog to find the reason for that.

2017-07-24T02:56:03.305-05:00 WARN [KafkaJournal] Journal utilization (96.0%) has gone over 95%. 2017-07-24T02:57:03.305-05:00 WARN [KafkaJournal] Journal utilization (96.0%) has gone over 95%. 2017-07-24T02:58:03.305-05:00 WARN [KafkaJournal] Journal utilization (97.0%) has gone over 95%. 2017-0…

[image] mpolitaev: I didn’t find in Graylog documentation where this values explained. Graylog2/graylog2-server/blob/2.2.3/misc/graylog.conf ############################ # GRAYLOG CONFIGURATION FILE ############################ # # This is the Graylog configuration file. The f…

Thank you. Now is clear. The another problem raised. When i have logged in into web interface all work is fine and so fast enough. But when i try to login from private session web browser or another user try to login web interface page loading too long time, 1 or 2 minutes. Do you have an idea why…

We are facing the same issue in our company. When the Journal is growing and growing, our current solution for that is brute force. We add more cores and more RAM to the GL nodes, and then we change the following parameters to match the available CPU cores in the server. This workaround has worke…

If Graylog server CPU is low, but messages are not processed quickly, it is possible that the Elasticsearch cluster is not quick enough. You can try to speed things up by: setting output_batch_size to a larger value (for example 5000) adding RAM to the Elasticsearch servers, and setting Elasticse…

Graylog journal continuously growing up

Graylog Central (peer support)

mpolitaev (Mihail Politaev) July 25, 2017, 4:17pm 7

Strange because i don’t see by CPU load average log that CPU is under load, even more 50%.

New install web interface hangs

Topic		Replies	Views
Journal keeps growing Graylog Central (peer support)	7	2066	March 7, 2018
Answer to Graylog Journal is fully utilized and there are millions of unprocessed messages Graylog Central (peer support)	4	2170	December 28, 2018
Journal Utilization is too high Graylog Central (peer support)	16	19065	November 6, 2017
Journal utilization 99% has gone over 95% Graylog Central (peer support)	14	5447	May 28, 2020
Graylog high journaling and low output rate Graylog Central (peer support) documentation , sidecar , nxlog , basic-configuration	10	2518	November 30, 2021

Graylog journal continuously growing up

Related topics