Kafka input, Processor threads

Hello,

I have

  • Graylog 4.0.6 cluster with 3 nodes
  • Kafka 2.6.2 cluster with 3 nodes

I have one topic in Kafka, and 3 partitions.

Which value i must put in the Graylog’s input config for “Processor threads” ?

If i set it to “1”, in the “server.log” i can clearly see Graylog talking about partition :

INFO  [ConsumerCoordinator] [Consumer clientId=gl2-f210676e-5fa0176fd32e375cb803f016-0, groupId=graylog] Notifying assignor about the new Assignment(partitions=[graylog-2])
INFO  [ConsumerCoordinator] [Consumer clientId=gl2-f210676e-5fa0176fd32e375cb803f016-0, groupId=graylog] Adding newly assigned partitions: graylog-2

If i set it to “3”, nothing about the partition, all the lines are empty :

INFO  [ConsumerCoordinator] [Consumer clientId=gl2-f210676e-5fa0176fd32e375cb803f016-1, groupId=graylog] Notifying assignor about the new Assignment(partitions=[])
INFO  [ConsumerCoordinator] [Consumer clientId=gl2-f210676e-5fa0176fd32e375cb803f016-1, groupId=graylog] Adding newly assigned partitions:

Thank you.

Hello,

To help you further we may need more details about the issue your having.
Can you use the default setting on that Kafka input? Do you get the same results?
Which type of Kafka INPUT are you using?

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.