Deduplicate logs in stream

Hi,

I have set up filters and created a stream to only display logs those we are interested in.
See there is pipeline and we can create stage and rule to parse logs and determine what to show up in the stream, question:

For the messages, can we perform some sort of deduplication so that for the exact same message we get in the logs if this repeated in a specific time frame (let say 30mins) we can drop the message from the stream so it only has one instance of that message in the stream?

nope that is not possible with a vanilla Graylog.

You would need to write a plugin for that or search if someone already has done that.

I do such things with NXLog befor the messages arrive in Graylog.
https://nxlog.co/documentation/nxlog-user-guide/pm_norepeat.html

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.