I am looking at creating an instance with about 10,000 messages per second. What setup do people run an instance of this size on, would 32gb ram and 8 cores work? I know the above is quite vague, but from experience what does everyone suggest? Cheers, George

you should give Elasticsearch enough ressources - those amount of messages should work with a single Graylog Node, but should have multiple Elasticsearch Hosts in a cluster.

We are going into a full production service and have never worked with clustering so don’t want to be experimenting. On the other hand I understand clustering should be used in production as it’s more reliable and efficient. For now I think we will have to just run with a single node and try to bu…

Just a thought: If you have your single server Graylog, setup next to it a elasticsearch cluster like https://www.digitalocean.com/community/tutorials/how-to-set-up-a-production-elasticsearch-cluster-on-ubuntu-14-04 Then ajust the /etc/elasticsearch/elasticsearch.yml of the graylog server so it re…

I’m seriously considering clustering now. Could I have 1 server (64gb ram 8 cores) with GL and ES on then 2 server with just ES on the create the cluster or should GL be separated from the ES cluster? When messages are being processed in the Graylog node section of the web interface, is that showi…

I would give GL one Server and ES two servers - that they did not share ressources.

What specs would you recommend for those three servers? I was thinking GL: 32gb RAM (16 for GL) 8 cores ES x 2: 64gb RAM (32 for ES) 8 cores Cheers, G

Graylog Sizing 10,000 msgs per second

Graylog Central (peer support)

Topic		Replies	Views
Regarding tuning Graylog Cluster Graylog Central (peer support) access-specific-log- , architecture , components	4	1119	March 1, 2023
Graylog cluster in kubernetes Graylog Central (peer support)	27	3761	May 4, 2024
Server resource specifications for 150K/sec log with Graylog Graylog Central (peer support)	3	1118	June 9, 2017
Performance Scaling Graylog Central (peer support)	5	1647	November 25, 2021
Clustered environment (ressources) for Graylog 3.x Graylog Central (peer support)	16	819	February 21, 2019

Graylog Sizing 10,000 msgs per second

Related topics