Graylog Not Starting Caused by: java.lang.NumberFormatException: For input string: "XDB3"

skinfrakki · April 29, 2021, 3:30pm

My CentOS 8 testing image rebooted last night. This morning, Graylog wasn’t started and refused to start with the following error:

Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.bootstrap.Main.main(Main.java:50)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: 31) Error injecting constructor, java.lang.NumberFormatException: For input string: “XDB3”
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.journal.KafkaJournal.(KafkaJournal.java:191)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.journal.KafkaJournal.class(KafkaJournal.java:101)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.shared.journal.KafkaJournal
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.journal.KafkaJournalModule.configure(KafkaJournalModule.java:25) (via modules: org.graylog2.bindings.>
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.shared.journal.Journal
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: for the 2nd parameter of org.graylog2.shared.buffers.JournallingMessageHandler.(JournallingMessageHandler.java:67)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.shared.buffers.JournallingMessageHandler
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.buffers.InputBufferImpl.(InputBufferImpl.java:55)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.buffers.InputBufferImpl.class(InputBufferImpl.java:45)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.shared.buffers.InputBufferImpl
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.plugin.buffers.InputBuffer
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: for the 2nd parameter of org.graylog2.shared.inputs.InputLauncher.(InputLauncher.java:47)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.shared.inputs.InputLauncher
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: for the 3rd parameter of org.graylog2.shared.initializers.InputSetupService.(InputSetupService.java:50)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.initializers.InputSetupService.class(InputSetupService.java:40)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.shared.initializers.InputSetupService
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: Caused by: java.lang.NumberFormatException (same stack trace as error #18)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: 32) Error injecting constructor, java.lang.NumberFormatException: For input string: “XDB3”
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.journal.KafkaJournal.(KafkaJournal.java:191)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.journal.KafkaJournal.class(KafkaJournal.java:101)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.shared.journal.KafkaJournal
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.journal.KafkaJournalModule.configure(KafkaJournalModule.java:25) (via modules: org.graylog2.bindings.>
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.shared.journal.Journal
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: for the 4th parameter of org.graylog2.outputs.BlockingBatchedESOutput.(BlockingBatchedESOutput.java:76)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.outputs.BlockingBatchedESOutput
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.bindings.MessageOutputBindings.configure(MessageOutputBindings.java:51)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.plugin.outputs.MessageOutput annotated with @org.graylog2.outputs.DefaultMessageOutput()
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: for the 1st parameter of org.graylog2.outputs.OutputRegistry.(OutputRegistry.java:71)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.outputs.OutputRegistry.class(OutputRegistry.java:51)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.outputs.OutputRegistry
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: for the 4th parameter of org.graylog2.streams.OutputServiceImpl.(OutputServiceImpl.java:55)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.streams.OutputServiceImpl
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.streams.OutputService
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: for the 4th parameter of org.graylog2.streams.StreamServiceImpl.(StreamServiceImpl.java:97)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.streams.StreamServiceImpl
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.streams.StreamService
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: for the 3rd parameter of org.graylog2.indexer.indexset.MongoIndexSetService.(MongoIndexSetService.java:58)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.indexer.indexset.MongoIndexSetService
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.indexer.indexset.IndexSetService
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: for the 1st parameter of org.graylog2.indexer.MongoIndexSetRegistry.(MongoIndexSetRegistry.java:89)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.indexer.MongoIndexSetRegistry.class(MongoIndexSetRegistry.java:89)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.indexer.MongoIndexSetRegistry
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.indexer.IndexSetRegistry
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: for the 4th parameter of org.graylog2.indexer.ranges.MongoIndexRangeService.(MongoIndexRangeService.java:75)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.indexer.ranges.MongoIndexRangeService
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.bindings.PersistenceServicesBindings.configure(PersistenceServicesBindings.java:61)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.indexer.ranges.IndexRangeService
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: for the 2nd parameter of org.graylog2.indexer.searches.Searches.(Searches.java:196)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.indexer.searches.Searches.class(Searches.java:116)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: while locating org.graylog2.indexer.searches.Searches
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: Caused by: java.lang.NumberFormatException: For input string: “XDB3”
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at java.lang.Long.parseLong(Long.java:589)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at java.lang.Long.parseLong(Long.java:631)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.journal.KafkaJournal.(KafkaJournal.java:304)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.journal.KafkaJournal.(KafkaJournal.java:191)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.journal.KafkaJournal$$FastClassByGuice$$8f50433e.newInstance()
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.DefaultConstructionProxyFactory$FastClassProxy.newInstance(DefaultConstructionProxyFacto>
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:114)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:91)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:306)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:148)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:39)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:62)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:148)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:39)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:42)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:65)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:113)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:91)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:306)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:62)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:148)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:39)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:42)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:65)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:113)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:91)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:306)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:148)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:39)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:42)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:65)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:113)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:91)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:306)
lines 882-936/1024
29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:91)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:306)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:148)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:39)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.InternalInjectorCreator.loadEagerSingletons(InternalInjectorCreator.java:211)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:182)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:109)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.Guice.createInjector(Guice.java:87)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.bindings.GuiceInjectorHolder.createInjector(GuiceInjectorHolder.java:34)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.bootstrap.CmdLineTool.setupInjector(CmdLineTool.java:379)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.bootstrap.CmdLineTool.run(CmdLineTool.java:194)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.bootstrap.Main.main(Main.java:50)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: 32 errors
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:543)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:186)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:109)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at com.google.inject.Guice.createInjector(Guice.java:87)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.shared.bindings.GuiceInjectorHolder.createInjector(GuiceInjectorHolder.java:34)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.bootstrap.CmdLineTool.setupInjector(CmdLineTool.java:379)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.bootstrap.CmdLineTool.run(CmdLineTool.java:194)
Apr 29 08:27:31 mylinbox.thehoff.local graylog-server[28323]: at org.graylog2.bootstrap.Main.main(Main.java:50)
Apr 29 08:27:31 mylinbox.thehoff.local mongod[1669]: {“t”:{"$date":“2021-04-29T08:27:31.934-07:00”},“s”:“I”, “c”:“NETWORK”, “id”:22944, “ctx”:“conn175”,“msg”:“Connection ended”,“attr”:>
Apr 29 08:27:31 mylinbox.thehoff.local mongod[1669]: {“t”:{"$date":“2021-04-29T08:27:31.934-07:00”},“s”:“I”, “c”:“NETWORK”, “id”:22944, “ctx”:“conn174”,“msg”:“Connection ended”,“attr”:>
Apr 29 08:27:31 mylinbox.thehoff.local systemd[1]: graylog-server.service: Main process exited, code=exited, status=1/FAILURE
Apr 29 08:27:31 mylinbox.thehoff.local systemd[1]: graylog-server.service: Failed with result ‘exit-code’.
– Subject: Unit failed
– Defined-By: systemd
– Support: Red Hat Customer Experience & Engagement - Red Hat Customer Portal

– The unit graylog-server.service has entered the ‘failed’ state with result ‘exit-code’.
Apr 29 08:27:38 mylinbox.thehoff.local mongod[1669]: {“t”:{"$date":“2021-04-29T08:27:38.180-07:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“WTCheckpointThread”,“msg”:"WiredTiger mes>
Apr 29 08:27:42 mylinbox.thehoff.local systemd[1]: graylog-server.service: Service RestartSec=10s expired, scheduling restart.
Apr 29 08:27:42 mylinbox.thehoff.local systemd[1]: graylog-server.service: Scheduled restart job, restart counter is at 76.
– Subject: Automatic restarting of a unit has been scheduled
– Defined-By: systemd
– Support: Red Hat Customer Experience & Engagement - Red Hat Customer Portal

Any ideas?

gsmith · April 29, 2021, 11:01pm

@skinfrakki
Hello,
This is very hard to read , could you reformat you post please.

https://community.graylog.org/t/community-guidelines/6649#format-markdown

Thank you

tmacgbay · April 30, 2021, 11:08am

In short, when you are posting code or logs, use the </> tool in your forum toolbar to make code look nice:

What is the status of your Mongo database? I have Ubuntu but it should be similar… - here is my output(using formatting):

$ service mongod status
● mongod.service - MongoDB Database Server
     Loaded: loaded (/lib/systemd/system/mongod.service; enabled; vendor preset: enabled)
     Active: active (running) since Tue 2021-04-20 03:05:18 EDT; 1 weeks 3 days ago
       Docs: https://docs.mongodb.org/manual
   Main PID: 675 (mongod)
     Memory: 4.3G
     CGroup: /system.slice/mongod.service
             └─645 /usr/bin/mongod --config /etc/mongod.conf

Apr 20 03:05:18 GL-SRV72 systemd[1]: Started MongoDB Database Server.

system · May 14, 2021, 11:09am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Graylogservice does not start because of java? Graylog Central (peer support)	12	2046	September 15, 2022
Graylog3 not starting Graylog Central (peer support)	4	777	March 3, 2021
Graylog 3.3.X doesn't start. Graylog 3.2.X does Graylog Central (peer support)	20	1954	August 31, 2020
Unable to start graylog Graylog Central (peer support)	17	2634	August 31, 2017
Graylog-server web ui suddenly does not work Graylog Central (peer support)	2	755	October 22, 2020

Graylog Not Starting Caused by: java.lang.NumberFormatException: For input string: "XDB3"

Related topics