Log monitoring using Fluentd

HI Team,

I had setup the Fluentd as per https://docs.fluentd.org/how-to-guides/graylog2, but I am not able to start my fluted(td-agent) service and thus no logs data coming on Graylog.
For Graylog configuration click here

[root@<fluentd-server> ~]# ulimit -n
65536

[root@<fluentd-server> ~]# cat /etc/security/limits.conf
# For Graylog
root soft nofile 65536
root hard nofile 65536
* soft nofile 65536
* hard nofile 65536
# End of file

[root@<fluentd-server> ~]# systemctl status td-agent.service
● td-agent.service - td-agent: Fluentd based data collector for Treasure Data
   Loaded: loaded (/etc/systemd/system/td-agent.service; enabled; vendor preset: disabled)
   Active: failed (Result: start-limit) since Tue 2019-06-25 08:51:54 GMT; 3s ago
     Docs: https://docs.treasuredata.com/articles/td-agent
  Process: 54514 ExecStart=/opt/td-agent/embedded/bin/fluentd --log /var/log/td-agent/td-agent.log --daemon /var/run/td-agent/td-agent.pid $TD_AGENT_OPTIONS (code=exited, status=1/FAILURE)

Jun 25 08:51:54 lit-rhel7-test3 systemd[1]: td-agent.service: control process exited, code=exited status=1
Jun 25 08:51:54 lit-rhel7-test3 systemd[1]: Failed to start td-agent: Fluentd based data collector for Treasure Data.
Jun 25 08:51:54 lit-rhel7-test3 systemd[1]: Unit td-agent.service entered failed state.
Jun 25 08:51:54 lit-rhel7-test3 systemd[1]: td-agent.service failed.
Jun 25 08:51:54 lit-rhel7-test3 systemd[1]: td-agent.service holdoff time over, scheduling restart.
Jun 25 08:51:54 lit-rhel7-test3 systemd[1]: Stopped td-agent: Fluentd based data collector for Treasure Data.
Jun 25 08:51:54 lit-rhel7-test3 systemd[1]: start request repeated too quickly for td-agent.service
Jun 25 08:51:54 lit-rhel7-test3 systemd[1]: Failed to start td-agent: Fluentd based data collector for Treasure Data.
Jun 25 08:51:54 lit-rhel7-test3 systemd[1]: Unit td-agent.service entered failed state.
Jun 25 08:51:54 lit-rhel7-test3 systemd[1]: td-agent.service failed.

[root@<fluentd-server> ~]# systemctl restart td-agent.service
Job for td-agent.service failed because the control process exited with error code. See "systemctl status td-agent.service" and "journalctl -xe" for details.

[root@<fluentd-server> ~]# journalctl -xe
Jun 25 08:52:31 lit-rhel7-test3 fluentd[54609]: from /opt/td-agent/embedded/lib/ruby/site_ruby/2.4.0/rubygems/specification.rb
Jun 25 08:52:31 lit-rhel7-test3 fluentd[54609]: from /opt/td-agent/embedded/lib/ruby/site_ruby/2.4.0/rubygems/dependency.rb:27
Jun 25 08:52:31 lit-rhel7-test3 fluentd[54609]: from /opt/td-agent/embedded/lib/ruby/site_ruby/2.4.0/rubygems.rb:269:in `find_
Jun 25 08:52:31 lit-rhel7-test3 fluentd[54609]: from /opt/td-agent/embedded/lib/ruby/site_ruby/2.4.0/rubygems.rb:299:in `activ
Jun 25 08:52:31 lit-rhel7-test3 fluentd[54609]: from /opt/td-agent/embedded/bin/fluentd:23:in `<main>'
Jun 25 08:52:31 lit-rhel7-test3 systemd[1]: td-agent.service: control process exited, code=exited status=1
Jun 25 08:52:31 lit-rhel7-test3 systemd[1]: Failed to start td-agent: Fluentd based data collector for Treasure Data.
-- Subject: Unit td-agent.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit td-agent.service has failed.
--
-- The result is failed.
Jun 25 08:52:31 lit-rhel7-test3 systemd[1]: Unit td-agent.service entered failed state.
Jun 25 08:52:31 lit-rhel7-test3 systemd[1]: td-agent.service failed.
Jun 25 08:52:31 lit-rhel7-test3 systemd[1]: td-agent.service holdoff time over, scheduling restart.
Jun 25 08:52:31 lit-rhel7-test3 systemd[1]: Stopped td-agent: Fluentd based data collector for Treasure Data.
-- Subject: Unit td-agent.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit td-agent.service has finished shutting down.
Jun 25 08:52:31 lit-rhel7-test3 systemd[1]: start request repeated too quickly for td-agent.service
Jun 25 08:52:31 lit-rhel7-test3 systemd[1]: Failed to start td-agent: Fluentd based data collector for Treasure Data.
-- Subject: Unit td-agent.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit td-agent.service has failed.
--
-- The result is failed.
Jun 25 08:52:31 lit-rhel7-test3 systemd[1]: Unit td-agent.service entered failed state.
Jun 25 08:52:31 lit-rhel7-test3 systemd[1]: td-agent.service failed.

Kindly let me know what I am missing or configured wrong.

Input configuration screenshot is attached.

that looks for me more like a fluentd configuration problem … you might want to ask the fluentd community for help.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.