# Multi Node Graylog Setup problem

**URL:** <https://community.graylog.org/t/multi-node-graylog-setup-problem/9278>\
**Category:** Graylog Central (peer support)\
**Created:** [March 6, 2019, 10:34am UTC](https://community.graylog.org/t/multi-node-graylog-setup-problem/9278 "2019-03-06T10:34:08Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mbuyukkarakas](https://sea2.discourse-cdn.com/flex016/user_avatar/community.graylog.org/mbuyukkarakas/32/410_2.png) [@Mbuyukkarakas](https://community.graylog.org/u/Mbuyukkarakas)\
**Post date:** [March 6, 2019, 10:34am UTC](https://community.graylog.org/t/multi-node-graylog-setup-problem/9278/1 "2019-03-06T10:34:08Z")

</div>

Dear all, I’m trying to build a 3 node GL cluster but have some strange logs and cant bring it up.

My cluster is using GL 2.5 / EL 5.5 / Mongo 4.0.6. No firewall, no SELinux

IPs :  
node01.local 172.23.88.9  
node02.local 172.23.88.10  
node03.local 172.23.88.11

## Mongo DB / Primary Config

rs0:PRIMARY\> rs.config()  
{  
“\_id” : “rs0”,  
“version” : 3,  
“protocolVersion” : NumberLong(1),  
“writeConcernMajorityJournalDefault” : true,  
“members” : [  
{  
“\_id” : 0,  
“host” : “node01.local:27017”,  
“arbiterOnly” : false,  
“buildIndexes” : true,  
“hidden” : false,  
“priority” : 1,  
“tags” : {

```
		},
		"slaveDelay" : NumberLong(0),
		"votes" : 1
	},
	{
		"_id" : 1,
		"host" : "node02.local:27017",
		"arbiterOnly" : false,
		"buildIndexes" : true,
		"hidden" : false,
		"priority" : 1,
		"tags" : {

		},
		"slaveDelay" : NumberLong(0),
		"votes" : 1
	},
	{
		"_id" : 2,
		"host" : "node03.local:27017",
		"arbiterOnly" : false,
		"buildIndexes" : true,
		"hidden" : false,
		"priority" : 1,
		"tags" : {

		},
		"slaveDelay" : NumberLong(0),
		"votes" : 1
	}
],
"settings" : {
	"chainingAllowed" : true,
	"heartbeatIntervalMillis" : 2000,
	"heartbeatTimeoutSecs" : 10,
	"electionTimeoutMillis" : 10000,
	"catchUpTimeoutMillis" : -1,
	"catchUpTakeoverDelayMillis" : 30000,
	"getLastErrorModes" : {

	},
	"getLastErrorDefaults" : {
		"w" : 1,
		"wtimeout" : 0
	},
	"replicaSetId" : ObjectId("5c7f9b9d2cd4ee245aee4df5")
}

```

}

## MongoDB Secondary server view :

rs0:SECONDARY\> rs.slaveOk()  
rs0:SECONDARY\> db.printSlaveReplicationInfo()  
source: node02.local:27017  
syncedTo: Wed Mar 06 2019 13:28:31 GMT+0300  
-1 secs (0 hrs) behind the primary  
source: node03.local:27017  
syncedTo: Wed Mar 06 2019 13:28:30 GMT+0300  
0 secs (0 hrs) behind the primary  
rs0:SECONDARY\> show dbs  
admin 0.000GB  
config 0.000GB  
graylog 0.001GB  
local 0.000GB

## graylog.conf file

…  
rest\_listen\_uri = [http://node01.local:9000/api/](http://node01.local:9000/api/)  
rest\_transport\_uri = [http://node01.local:9000/api/](http://node01.local:9000/api/)  
web\_listen\_uri = [http://node01.local:9000/](http://node01.local:9000/)  
elasticsearch\_hosts = [http://node01.local:9200](http://node01.local:9200),[http://node02.local:9200](http://node02.local:9200),[http://node03.local:9200](http://node03.local:9200)  
#mongodb://graylog:123456@node01.local:27017,node02.local:27017,node03.local:27017/graylog?replicaSet=rs0  
mongodb://node01.local:27017,node02.local:27017,node03.local:27017/graylog?replicaSet=rs0  
…

## graylog node 01 graylog.log file

019-03-06T13:11:19.455+03:00 INFO [Version] HV000001: Hibernate Validator 5.1.3.Final  
2019-03-06T13:11:23.842+03:00 INFO [InputBufferImpl] Message journal is enabled.  
2019-03-06T13:11:23.879+03:00 INFO [NodeId] Node ID: 8f49d4e6-5d90-4c10-906f-7324ad14c678  
2019-03-06T13:11:24.245+03:00 INFO [LogManager] Loading logs.  
2019-03-06T13:11:24.375+03:00 INFO [LogManager] Logs loading complete.  
2019-03-06T13:11:24.376+03:00 INFO [KafkaJournal] Initialized Kafka based journal at /data/graylog/journal  
2019-03-06T13:11:24.408+03:00 INFO [InputBufferImpl] Initialized InputBufferImpl with ring size \<65536\> and wait strategy , running 2 parallel message handlers.  
2019-03-06T13:11:24.449+03:00 INFO [cluster] Cluster created with settings {hosts=[localhost:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout=‘30000 ms’, maxWaitQueueSize=5000}  
2019-03-06T13:11:24.541+03:00 INFO [cluster] No server chosen by ReadPreferenceServerSelector{readPreference=primary} from cluster description ClusterDescription{type=UNKNOWN, connectionMode=SINGLE, serverDescriptions=[ServerDescription{address=localhost:27017, type=UNKNOWN, state=CONNECTING}]}. Waiting for 30000 ms before timing out  
2019-03-06T13:11:24.838+03:00 INFO [connection] Opened connection [connectionId{localValue:1, serverValue:20}] to localhost:27017  
2019-03-06T13:11:24.854+03:00 INFO [cluster] Monitor thread successfully connected to server with description ServerDescription{address=localhost:27017, type=REPLICA\_SET\_PRIMARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 0, 6]}, minWireVersion=0, maxWireVersion=7, maxDocumentSize=16777216, roundTripTimeNanos=3674710, setName=‘rs0’, canonicalAddress=node01.local:27017, hosts=[node02.local:27017, node03.local:27017, node01.local:27017], passives=, arbiters=, primary=‘node01.local:27017’, tagSet=TagSet{}, electionId=7fffffff0000000000000001, setVersion=3, lastWriteDate=Wed Mar 06 13:11:23 EET 2019, lastUpdateTimeNanos=11093256202569}  
2019-03-06T13:11:24.870+03:00 INFO [connection] Opened connection [connectionId{localValue:2, serverValue:21}] to localhost:27017  
…  
…

## node02 graylog.log file

2019-03-06T13:13:59.534+03:00 INFO [LogManager] Logs loading complete.  
2019-03-06T13:13:59.534+03:00 INFO [KafkaJournal] Initialized Kafka based journal at /data/graylog/journal  
2019-03-06T13:13:59.573+03:00 INFO [InputBufferImpl] Initialized InputBufferImpl with ring size \<65536\> and wait strategy , running 2 parallel message handlers.  
2019-03-06T13:13:59.608+03:00 INFO [cluster] Cluster created with settings {hosts=[localhost:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout=‘30000 ms’, maxWaitQueueSize=5000}  
2019-03-06T13:13:59.701+03:00 INFO [cluster] No server chosen by ReadPreferenceServerSelector{readPreference=primary} from cluster description ClusterDescription{type=UNKNOWN, connectionMode=SINGLE, serverDescriptions=[ServerDescription{address=localhost:27017, type=UNKNOWN, state=CONNECTING}]}. Waiting for 30000 ms before timing out  
2019-03-06T13:13:59.743+03:00 INFO [connection] Opened connection [connectionId{localValue:1, serverValue:25}] to localhost:27017  
2019-03-06T13:13:59.758+03:00 INFO [cluster] Monitor thread successfully connected to server with description ServerDescription{address=localhost:27017, type=REPLICA\_SET\_SECONDARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 0, 6]}, minWireVersion=0, maxWireVersion=7, maxDocumentSize=16777216, roundTripTimeNanos=3617725, setName=‘rs0’, canonicalAddress=node02.local:27017, hosts=[node02.local:27017, node03.local:27017, node01.local:27017], passives=, arbiters=, primary=‘node01.local:27017’, tagSet=TagSet{}, electionId=null, setVersion=3, lastWriteDate=Wed Mar 06 13:13:58 EET 2019, lastUpdateTimeNanos=6793303396622}  
2019-03-06T13:13:59.797+03:00 INFO [connection] Opened connection [connectionId{localValue:2, serverValue:26}] to localhost:27017  
2019-03-06T13:14:00.178+03:00 INFO [cluster] No server chosen by WritableServerSelector from cluster description ClusterDescription{type=REPLICA\_SET, connectionMode=SINGLE, serverDescriptions=[ServerDescription{address=localhost:27017, type=REPLICA\_SET\_SECONDARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 0, 6]}, minWireVersion=0, maxWireVersion=7, maxDocumentSize=16777216, roundTripTimeNanos=3617725, setName=‘rs0’, canonicalAddress=node02.local:27017, hosts=[node02.local:27017, node03.local:27017, node01.local:27017], passives=, arbiters=, primary=‘node01.local:27017’, tagSet=TagSet{}, electionId=null, setVersion=3, lastWriteDate=Wed Mar 06 13:13:58 EET 2019, lastUpdateTimeNanos=6793303396622}]}. Waiting for 30000 ms before timing out  
2019-03-06T13:14:30.192+03:00 INFO [cluster] No server chosen by WritableServerSelector from cluster description ClusterDescription{type=REPLICA\_SET, connectionMode=SINGLE, serverDescriptions=[ServerDescription{address=localhost:27017, type=REPLICA\_SET\_SECONDARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 0, 6]}, minWireVersion=0, maxWireVersion=7, maxDocumentSize=16777216, roundTripTimeNanos=1199113, setName=‘rs0’, canonicalAddress=node02.local:27017, hosts=[node02.local:27017, node03.local:27017, node01.local:27017], passives=, arbiters=, primary=‘node01.local:27017’, tagSet=TagSet{}, electionId=null, setVersion=3, lastWriteDate=Wed Mar 06 13:14:28 EET 2019, lastUpdateTimeNanos=6823420143388}]}. Waiting for 30000 ms before timing out

My questions are ;

- Why cant make it up ?
- Why I’m always seeing in the log files that the mongo is connecting locally instead of cluster on all of my servers ?

Any help ?  
Thank you.

Mehmet

---

<div class="post-metadata">

**Author:** ![Mbuyukkarakas](https://sea2.discourse-cdn.com/flex016/user_avatar/community.graylog.org/mbuyukkarakas/32/410_2.png) [@Mbuyukkarakas](https://community.graylog.org/u/Mbuyukkarakas)\
**Post date:** [March 6, 2019, 12:01pm UTC](https://community.graylog.org/t/multi-node-graylog-setup-problem/9278/2 "2019-03-06T12:01:27Z")

</div>

Dear all, I’m trully sorry to take your time. I have found the problem.

My graylog.conf file has this line ;

mongodb://node01.local:27017,node02.local:27017,node03.local:27017/graylog?replicaSet=rs0

Actually it should be like this ;

mongodb\_uri = mongodb://node01.local:27017,node02.local:27017,node03.local:27017/graylog?replicaSet=rs0

I forgot to add “mongodb\_uri =” part. Copy / Paste issues from text editor 🙂

Best regards.  
Mehmet

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex016/uploads/graylog/original/3X/c/7/c7c09c6b5099570133d6502b83f50ba4430de5b6.png) [@system](https://community.graylog.org/u/system)\
**Post date:** [March 20, 2019, 12:05pm UTC](https://community.graylog.org/t/multi-node-graylog-setup-problem/9278/3 "2019-03-20T12:05:32Z")

</div>

Closed on March 20, 2019, 12:05pm UTC

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.
