after i moved my setup from a single elasticsearch server to a cluster (in the cluster i have 3 Master nodes and 3 Data nodes) the output in the right corner decreased from 7500 msg/s to arround 4500 msg/s, and my input was the same as vefore around 7500msg/s.
what i did so far, i have checked the time and data, everywhere is the same, because it’s synced via NTP.
i have also configured the following on elasticsearch:
# Recover only after the given number of nodes have joined the cluster. Can be seen as "minimum number of nodes to attempt recovery at all". gateway.recover_after_nodes: 4 # Time to wait for additional nodes after recover_after_nodes is met. gateway.recover_after_time: 5m # Inform ElasticSearch how many nodes form a full cluster. If this number is met, start up immediately. gateway.expected_nodes: 6
then i did 300mb instead of 150:
in graylog i changed the process buffer to 20 from 10
also in graylog i rotated all the indexes manually and deleted the old ones.
with all of these nothing changed in better.
have you ever seen this problem before, or any ideas that can help me?