I am sending messages through logstash to kafka. i am seeing messages are received by kafka(in topics). i have configured graylog and created graylog configuration by specifying mongodb, elastic search server details. i am able to configure input and added zookeeper for input in graylog UI. when i am trying to see consume messages.
i am getting below info in graylogs log ,it is stuck here in this point and not moving. i had restarted many times but same issue. any help and suggestion appreciated thank you.
PS : everything setup in only one unix box
20-06-26 07:26:05,610 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_server-01-1593156365538-a4c43525], end rebalancing consumer graylog2_server-01-1593156365538-a4c43525 try #0
2020-06-26 07:26:05,610 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_server-01-1593156365538-a4c43525], Creating topic event watcher for topics ^test-incidents$
2020-06-26 07:26:05,611 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_server-01-1593156365538-a4c43525], Topics to consume = List(test-incidents)
2020-06-26 07:26:05,621 INFO : kafka.consumer.ConsumerFetcherManager$LeaderFinderThread - [graylog2_server-01-1593156365538-a4c43525-leader-finder-thread], Starting
2020-06-26 07:26:05,628 INFO : org.graylog2.inputs.InputStateListener - Input [Raw/Plaintext Kafka/5ef365ad61cd183ae63dd2e9] is now RUNNING
2020-06-26 07:26:05,629 INFO : kafka.utils.VerifiableProperties - Verifying properties
2020-06-26 07:26:05,629 INFO : kafka.utils.VerifiableProperties - Property client.id is overridden to gl2-70689d85-a36d-489d-a466-40b8a0eda56f-5ef365ad61cd183ae63dd2e9
2020-06-26 07:26:05,630 INFO : kafka.utils.VerifiableProperties - Property metadata.broker.list is overridden to server-01:9092
2020-06-26 07:26:05,630 INFO : kafka.utils.VerifiableProperties - Property request.timeout.ms is overridden to 30000
2020-06-26 07:26:05,633 INFO : kafka.client.ClientUtils$ - Fetching metadata from broker BrokerEndPoint(1,server-01,9092) with correlation id 0 for 1 topic(s) Set(test-incidents)
2020-06-26 07:26:05,634 INFO : kafka.producer.SyncProducer - Connected to server-01:9092 for producing
2020-06-26 07:26:05,641 INFO : kafka.producer.SyncProducer - Disconnecting from server-01:9092
2020-06-26 07:26:05,645 INFO : kafka.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1593156365546] Added fetcher for partitions ArrayBuffer([[test-incidents,2], initOffset 143 to broker BrokerEndPoint(1,server-01,9092)] , [[test-incidents,1], initOffset 144 to broker BrokerEndPoint(1,server-01,9092)] , [[test-incidents,0], initOffset 143 to broker BrokerEndPoint(1,server-01,9092)] )