Error executing action `run` on resource 'ruby_block[add node to server list]'

I’m experiencing issues with graylog server, “graylog-ctl reconfigure” command is unable to bring etcd and mongodb online.

Its a single node, so i have already tried deleting contents of etcd directory.

I’m getting following error after running “graylog-ctl reconfigure”

 Error executing action `run` on resource 'ruby_block[add node to server list]'
    ================================================================================

    Errno::ECONNREFUSED
    -------------------
    Connection refused - connect(2) for "127.0.0.1" port 4001

    Cookbook Trace:
    ---------------
    /opt/graylog/embedded/cookbooks/graylog/libraries/registry.rb:17:in `set_master'
    /opt/graylog/embedded/cookbooks/graylog/recipes/graylog-server.rb:86:in `block (2 levels) in from_file'

    Resource Declaration:
    ---------------------
    # In /opt/graylog/embedded/cookbooks/graylog/recipes/graylog-server.rb

     84: ruby_block "add node to server list" do
     85:   block do
     86:     $registry.set_master
     87:     $registry.add_gl_server(node['ipaddress'])
     88:     $registry.add_es_node(node['ipaddress'])
     89:   end
     90:   retries 15
     91: end

    Compiled Resource:
    ------------------
    # Declared in /opt/graylog/embedded/cookbooks/graylog/recipes/graylog-server.rb:84:in `from_file'

    ruby_block("add node to server list") do
      action [:run]
      retries 15
      retry_delay 2
      default_guard_interpreter :default
      block_name "add node to server list"
      declared_type :ruby_block
      cookbook_name :graylog
      recipe_name "graylog-server"
      block #<Proc:0x00000002647858@/opt/graylog/embedded/cookbooks/graylog/recipes/graylog-server.rb:85>
    end


Running handlers:
[2017-10-12T12:10:44+00:00] ERROR: Running exception handlers
Running handlers complete
[2017-10-12T12:10:44+00:00] ERROR: Exception handlers complete
Chef Client failed. 7 resources updated in 01 minutes 25 seconds
[2017-10-12T12:10:44+00:00] FATAL: Stacktrace dumped to /opt/graylog/embedded/cookbooks/cache/chef-stacktrace.out
[2017-10-12T12:10:44+00:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
[2017-10-12T12:10:44+00:00] ERROR: ruby_block[add node to server list] (graylog::graylog-server line 84) had an error: Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 4001
[2017-10-12T12:10:45+00:00] FATAL: Chef::Exceptions::ChildConvergeError: Chef run process exited unsuccessfully (exit code 1)
   ===================================================================

Also when i run graylog-ctl status, getting following output

root@GRAYLOG:/var/opt/graylog/data# graylog-ctl status
run: elasticsearch: (pid 21113) 1s; run: log: (pid 944) 5929s
down: etcd: 0s, normally up, want up; run: log: (pid 942) 5929s
run: graylog-server: (pid 965) 5928s; run: log: (pid 943) 5929s
down: mongodb: 0s, normally up, want up; run: log: (pid 946) 5929s
run: nginx: (pid 971) 5927s; run: log: (pid 945) 5929s

webpage displays graylog is restarting message.

Any help will be much appreciated.

Thanks,
Kashif

Did you upgrade your Graylog OVA?

Did you follow the following Steps?

http://docs.graylog.org/en/2.3/pages/configuration/graylog_ctl.html#upgrade-graylog

We have deployed it using OVA template.

One more thing, my colleague has actually changed heap settings. Everything was working in the start.

Please refer to this related GitHub issue:

my bad, issue is resolved now. The problem was vm was running out of space. Added additional space and we are back on track.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.