We are using two input plugins such as KAFKA and AWS given below,
- If we create input with global option selected, then kafka thread will be created in one of the randomly selected graylog node
- If we choose any node while created the input, then kafka thread will be created in selected node
Currently we have 2 node graylog cluster and we found that whenever any graylog node with kafka thread running goes down then other node will not start kafak thread.
Also if we want to restart graylog node with kaka thread running, then we may loose the messages b/w restart time interval.
Please let us know how we can support kafka input heigh availability, so that we do not loose any log messages on graylog node failure or on graylog node restart.
Thanks in advance,