I am looking for a DaemonSet log agent that will collect logs from the custom log file let’s say /etc/var/log/application/.* and push logs directly to a backend(Graylog servers). Can we use Sidecar DaemonSet that will run on each Kubernetes worker node and collect logs directly from custom path /etc/var/log/application/.*?
Currently, I am using FluentBit as a DaemonSet that collects the logs directly from the PODs, not from the custom path. And my requirement is to collect the logs only from the custom path.
Did anyone configure any DaemonSet to collect the logs from the custom path? If yes, please help me with the documentation or any reference link.