Error executing action `run` on resource 'ruby_block[add node to server list]'

Graylog Central (peer support)
1

I’m experiencing issues with graylog server, “graylog-ctl reconfigure” command is unable to bring etcd and mongodb online.

Its a single node, so i have already tried deleting contents of etcd directory.

I’m getting following error after running “graylog-ctl reconfigure”

 Error executing action `run` on resource 'ruby_block[add node to server list]'
    ================================================================================

    Errno::ECONNREFUSED
    -------------------
    Connection refused - connect(2) for "127.0.0.1" port 4001

    Cookbook Trace:
    ---------------
    /opt/graylog/embedded/cookbooks/graylog/libraries/registry.rb:17:in `set_master'
    /opt/graylog/embedded/cookbooks/graylog/recipes/graylog-server.rb:86:in `block (2 levels) in from_file'

    Resource Declaration:
    ---------------------
    # In /opt/graylog/embedded/cookbooks/graylog/recipes/graylog-server.rb

     84: ruby_block "add node to server list" do
     85:   block do
     86:     $registry.set_master
     87:     $registry.add_gl_server(node['ipaddress'])
     88:     $registry.add_es_node(node['ipaddress'])
     89:   end
     90:   retries 15
     91: end

    Compiled Resource:
    ------------------
    # Declared in /opt/graylog/embedded/cookbooks/graylog/recipes/graylog-server.rb:84:in `from_file'

    ruby_block("add node to server list") do
      action [:run]
      retries 15
      retry_delay 2
      default_guard_interpreter :default
      block_name "add node to server list"
      declared_type :ruby_block
      cookbook_name :graylog
      recipe_name "graylog-server"
      block #<Proc:0x00000002647858@/opt/graylog/embedded/cookbooks/graylog/recipes/graylog-server.rb:85>
    end


Running handlers:
[2017-10-12T12:10:44+00:00] ERROR: Running exception handlers
Running handlers complete
[2017-10-12T12:10:44+00:00] ERROR: Exception handlers complete
Chef Client failed. 7 resources updated in 01 minutes 25 seconds
[2017-10-12T12:10:44+00:00] FATAL: Stacktrace dumped to /opt/graylog/embedded/cookbooks/cache/chef-stacktrace.out
[2017-10-12T12:10:44+00:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
[2017-10-12T12:10:44+00:00] ERROR: ruby_block[add node to server list] (graylog::graylog-server line 84) had an error: Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 4001
[2017-10-12T12:10:45+00:00] FATAL: Chef::Exceptions::ChildConvergeError: Chef run process exited unsuccessfully (exit code 1)
   ===================================================================

Also when i run graylog-ctl status, getting following output

root@GRAYLOG:/var/opt/graylog/data# graylog-ctl status
run: elasticsearch: (pid 21113) 1s; run: log: (pid 944) 5929s
down: etcd: 0s, normally up, want up; run: log: (pid 942) 5929s
run: graylog-server: (pid 965) 5928s; run: log: (pid 943) 5929s
down: mongodb: 0s, normally up, want up; run: log: (pid 946) 5929s
run: nginx: (pid 971) 5927s; run: log: (pid 945) 5929s

webpage displays graylog is restarting message.

Any help will be much appreciated.

Thanks,
Kashif

2

Did you upgrade your Graylog OVA?

Did you follow the following Steps?

http://docs.graylog.org/en/2.3/pages/configuration/graylog_ctl.html#upgrade-graylog

3

We have deployed it using OVA template.

One more thing, my colleague has actually changed heap settings. Everything was working in the start.

6

Please refer to this related GitHub issue:

7

my bad, issue is resolved now. The problem was vm was running out of space. Added additional space and we are back on track.

8

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.