Currently I have two Graylog Deployments.
One that receives a lot of messages from various sources (let’s call it BIG) and another one mainly for receiving logs from first graylog site (let’s call it SMALL).
I am trying to output a stream from BIG to SMALL and it seem to be working through GelfOutput and GelfInput TCP.
However I’ve been receiving a lot of errors like the following:
2017-09-11T07:01:54.428Z ERROR [OutputBufferProcessor] Error in output [class org.graylog2.outputs.GelfOutput]. java.lang.ClassCastException: java.lang.Long cannot be cast to java.lang.String at org.graylog2.outputs.GelfOutput.toGELFMessage(GelfOutput.java:245) ~[graylog.jar:?] at org.graylog2.outputs.GelfOutput.write(GelfOutput.java:184) ~[graylog.jar:?] at org.graylog2.buffers.processors.OutputBufferProcessor$1.run(OutputBufferProcessor.java:194) [graylog.jar:?] at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) [graylog.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_121] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_121] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_121] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_121] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_121]
AND a lot of
ERROR [OutputBufferProcessor] Error in output [class org.graylog2.outputs.GelfOutput]. java.lang.ClassCastException: null
I’ve tried using UDP output and INPUT however results are still the same:
Currently I’m running with TCP and still keep on receiving errors.
Has anyone encountered this before?
Also, when TCP output is running, sometimes indexing will suddenly stop working, with the outputbuffer empty and processbuffer full. I would have to restart BIG graylog-servers in order to get it back to normal.