In the Kafka input, what is the Zookeeper configuration for? Is this needed to:
- Tell the plugin where the kafka servers are
- Tell the plugin the state of the kafka servers as recorded by the kafka servers
- Store the last offset retrieved after retrieving messages from kafka
The reason I’m asking is because I’m looking at trying out Jocko, which is a Go-based Kafka replacement that does not use Zookeeper. I may have to modify the Kafka input to store offsets in something else (like Mongo?) but I don’t want to pursue that until I know exactly what Graylog needs Zookeeper for.