Like the title says, my message journal does fillup during peak usage which is normal. When there is minimal usage, I see almost no messages being processed by the configured pipelines and the journal message count keeps increasing against the low and slow stream of messages.
I don’t see any errors or anything unusual both in graylog and elasticsearch logs. The process,input and output buffers are all at 0% usage but the disk journal continues to increase with 116,636,921 plus unprocessed messages.
My message journal settings are below, is this sane?
message_journal_max_age = 48h message_journal_max_size = 40gb message_journal_flush_age = 1m #message_journal_flush_interval = 1000000 message_journal_segment_age = 1m message_journal_segment_size = 100mb