Problem while loading Graylog webpage after a restart

Graylog Central (peer support)
1

Hi Team,

Recently i noticed my graylog suddenly stopped showing received messages and also sources. So I tried to restart graylog (graylog-ctl restart) and after that when im loading webpage stuck up with below content.Please help me to fix it.Thanks in advance

Graylog is restarting…

There is no Graylog web application running at the moment, please reload this page in a minute. It can take up to 1-2 minutes until all services are running properly. In case this is a permanent error, check the following:

  • Check if all services are running - sudo graylog-ctl status shows an overview of all running services
  • Check for errors in log files - Relevant services write log files here: /var/log/graylog/*/current
  • Ask for help - If there is no way to fix the issue ask for help: https://github.com/Graylog2/graylog2-images/issues
2

and did you checked the log files?

3

I noticed some problem with logmanager in “server” current log.

root@graylog:~# graylog-ctl status
run: elasticsearch: (pid 10353) 349s; run: log: (pid 960) 48033s
run: etcd: (pid 10386) 349s; run: log: (pid 963) 48033s
run: graylog-server: (pid 11280) 22s; run: log: (pid 959) 48033s
run: mongodb: (pid 10429) 348s; run: log: (pid 962) 48033s
run: nginx: (pid 10433) 347s; run: log: (pid 961) 48033s

For your reference last 10 lines each log:

root@graylog:/var/log/graylog# tailf server/current

2019-03-20_08:11:59.72926 ERROR [KafkaJournal] Unable to start logmanager.
2019-03-20_08:11:59.72980 kafka.common.KafkaException: Failed to acquire lock on file .lock in /var/opt/graylog/data/journal. A Kafka instance in another process or thread is using this directory.
2019-03-20_08:11:59.73038 at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:98) ~[graylog.jar:?]
2019-03-20_08:11:59.73088 at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:95) ~[graylog.jar:?]
2019-03-20_08:11:59.73136 at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) ~[graylog.jar:?]
2019-03-20_08:11:59.73191 at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) ~[graylog.jar:?]
2019-03-20_08:11:59.73243 at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) ~[graylog.jar:?]
2019-03-20_08:11:59.73300 at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:35) ~[graylog.jar:?]
2019-03-20_08:11:59.73349 at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) ~[graylog.jar:?]
2019-03-20_08:11:59.73420 at scala.collection.AbstractTraversable.map(Traversable.scala:104) ~[graylog.jar:?]
2019-03-20_08:11:59.73471 at kafka.log.LogManager.lockLogDirs(LogManager.scala:95) ~[graylog.jar:?]
2019-03-20_08:11:59.73553 at kafka.log.LogManager.(LogManager.scala:57) ~[graylog.jar:?]
2019-03-20_08:11:59.73673 at org.graylog2.shared.journal.KafkaJournal.(KafkaJournal.java:275) [graylog.jar:?]
2019-03-20_08:11:59.73697 at org.graylog2.shared.journal.KafkaJournal$$FastClassByGuice$$8f50433e.newInstance() [graylog.jar:?]
2019-03-20_08:11:59.73737 at com.google.inject.internal.DefaultConstructionProxyFactory$FastClassProxy.newInstance(DefaultConstructionProxyFactory.java:89) [graylog.jar:?]
2019-03-20_08:11:59.73813 at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:111) [graylog.jar:?]
2019-03-20_08:11:59.73863 at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) [graylog.jar:?]
2019-03-20_08:11:59.73955 at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) [graylog.jar:?]
2019-03-20_08:11:59.74005 at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) [graylog.jar:?]
2019-03-20_08:11:59.74052 at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) [graylog.jar:?]
2019-03-20_08:11:59.74130 at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) [graylog.jar:?]
2019-03-20_08:11:59.74145 at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) [graylog.jar:?]
2019-03-20_08:11:59.74199 at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) [graylog.jar:?]
2019-03-20_08:11:59.74262 at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:56) [graylog.jar:?]
2019-03-20_08:11:59.74325 at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) [graylog.jar:?]
2019-03-20_08:11:59.74404 at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) [graylog.jar:?]
2019-03-20_08:11:59.74453 at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) [graylog.jar:?]
2019-03-20_08:11:59.74529 at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) [graylog.jar:?]
2019-03-20_08:11:59.74573 at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) [graylog.jar:?]
2019-03-20_08:11:59.74646 at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) [graylog.jar:?]
2019-03-20_08:11:59.74696 at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) [graylog.jar:?]
2019-03-20_08:11:59.74795 at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110) [graylog.jar:?]
2019-03-20_08:11:59.74834 at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) [graylog.jar:?]
2019-03-20_08:11:59.74910 at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) [graylog.jar:?]
2019-03-20_08:11:59.74962 at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:56) [graylog.jar:?]
2019-03-20_08:11:59.75015 at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) [graylog.jar:?]
2019-03-20_08:11:59.75057 at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) [graylog.jar:?]
2019-03-20_08:11:59.75122 at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) [graylog.jar:?]
2019-03-20_08:11:59.75180 at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) [graylog.jar:?]
2019-03-20_08:11:59.75268 at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) [graylog.jar:?]
2019-03-20_08:11:59.75321 at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) [graylog.jar:?]
2019-03-20_08:11:59.75383 at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) [graylog.jar:?]
2019-03-20_08:11:59.75426 at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110) [graylog.jar:?]
2019-03-20_08:11:59.75526 at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) [graylog.jar:?]
2019-03-20_08:11:59.75578 at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) [graylog.jar:?]
2019-03-20_08:11:59.75646 at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) [graylog.jar:?]
2019-03-20_08:11:59.75697 at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) [graylog.jar:?]
2019-03-20_08:11:59.75767 at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) [graylog.jar:?]
2019-03-20_08:11:59.75825 at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) [graylog.jar:?]
2019-03-20_08:11:59.75900 at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) [graylog.jar:?]
2019-03-20_08:11:59.75943 at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) [graylog.jar:?]
2019-03-20_08:11:59.76008 at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) [graylog.jar:?]
2019-03-20_08:11:59.76056 at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110) [graylog.jar:?]
2019-03-20_08:11:59.76127 at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) [graylog.jar:?]
2019-03-20_08:11:59.76175 at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) [graylog.jar:?]
2019-03-20_08:11:59.76242 at com.google.inject.internal.InjectorImpl$1.get(InjectorImpl.java:759) [graylog.jar:?]
2019-03-20_08:11:59.76297 at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) [graylog.jar:?]
2019-03-20_08:11:59.76404 at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) [graylog.jar:?]
2019-03-20_08:11:59.76456 at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110) [graylog.jar:?]
2019-03-20_08:11:59.76524 at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) [graylog.jar:?]
2019-03-20_08:11:59.76573 at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) [graylog.jar:?]
2019-03-20_08:11:59.76644 at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:56) [graylog.jar:?]
2019-03-20_08:11:59.76694 at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) [graylog.jar:?]
2019-03-20_08:11:59.76771 at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) [graylog.jar:?]
2019-03-20_08:11:59.76821 at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110) [graylog.jar:?]
2019-03-20_08:11:59.76889 at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) [graylog.jar:?]
2019-03-20_08:11:59.76934 at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) [graylog.jar:?]
2019-03-20_08:11:59.77008 at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:56) [graylog.jar:?]
2019-03-20_08:11:59.77055 at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) [graylog.jar:?]
2019-03-20_08:11:59.77125 at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) [graylog.jar:?]
2019-03-20_08:11:59.77177 at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110) [graylog.jar:?]
2019-03-20_08:11:59.77248 at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) [graylog.jar:?]
2019-03-20_08:11:59.77299 at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) [graylog.jar:?]
2019-03-20_08:11:59.77608 at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38) [graylog.jar:?]
2019-03-20_08:11:59.77800 at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62) [graylog.jar:?]
2019-03-20_08:11:59.78077 at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:110) [graylog.jar:?]
2019-03-20_08:11:59.78123 at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) [graylog.jar:?]
2019-03-20_08:11:59.78199 at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) [graylog.jar:?]
2019-03-20_08:11:59.78244 at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) [graylog.jar:?]
2019-03-20_08:11:59.78297 at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) [graylog.jar:?]
2019-03-20_08:11:59.78349 at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) [graylog.jar:?]
2019-03-20_08:11:59.78410 at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) [graylog.jar:?]
2019-03-20_08:11:59.78467 at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) [graylog.jar:?]
2019-03-20_08:11:59.78534 at com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:205) [graylog.jar:?]
2019-03-20_08:11:59.78581 at com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:199) [graylog.jar:?]
2019-03-20_08:11:59.78614 at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1085) [graylog.jar:?]
2019-03-20_08:11:59.78683 at com.google.inject.internal.InternalInjectorCreator.loadEagerSingletons(InternalInjectorCreator.java:199) [graylog.jar:?]
2019-03-20_08:11:59.78760 at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:180) [graylog.jar:?]
2019-03-20_08:11:59.78827 at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:110) [graylog.jar:?]
2019-03-20_08:11:59.78889 at com.google.inject.Guice.createInjector(Guice.java:99) [graylog.jar:?]
2019-03-20_08:11:59.78929 at org.graylog2.shared.bindings.GuiceInjectorHolder.createInjector(GuiceInjectorHolder.java:34) [graylog.jar:?]
2019-03-20_08:11:59.79005 at org.graylog2.bootstrap.CmdLineTool.setupInjector(CmdLineTool.java:379) [graylog.jar:?]
2019-03-20_08:11:59.79062 at org.graylog2.bootstrap.CmdLineTool.run(CmdLineTool.java:193) [graylog.jar:?]
2019-03-20_08:11:59.79138 at org.graylog2.bootstrap.Main.main(Main.java:44) [graylog.jar:?]

root@graylog:/var/log/graylog# tailf elasticsearch/current
2019-03-20_08:02:36.46643 [INFO ][o.e.d.DiscoveryModule ] [-NVB18K] using discovery type [zen]
2019-03-20_08:02:38.14577 [INFO ][o.e.n.Node ] initialized
2019-03-20_08:02:38.14711 [INFO ][o.e.n.Node ] [-NVB18K] starting …
2019-03-20_08:02:38.44745 [INFO ][o.e.t.TransportService ] [-NVB18K] publish_address {10.100.125.148:9300}, bound_addresses {10.100.125.148:9300}
2019-03-20_08:02:38.48407 [INFO ][o.e.b.BootstrapChecks ] [-NVB18K] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
2019-03-20_08:02:48.62128 [INFO ][o.e.c.s.ClusterService ] [-NVB18K] new_master {-NVB18K}{-NVB18KyQHuXJW6RTKbH4A}{-TD8PJY-RNadvIL8Om-wsQ}{10.100.125.148}{10.100.125.148:9300}, reason: zen-disco-elected-as-master ([0] nodes joined)
2019-03-20_08:02:48.70438 [INFO ][o.e.h.n.Netty4HttpServerTransport] [-NVB18K] publish_address {10.100.125.148:9200}, bound_addresses {10.100.125.148:9200}
2019-03-20_08:02:48.70519 [INFO ][o.e.n.Node ] [-NVB18K] started
2019-03-20_08:02:49.19313 [INFO ][o.e.g.GatewayService ] [-NVB18K] recovered [1] indices into cluster_state
2019-03-20_08:02:49.71387 [INFO ][o.e.c.r.a.AllocationService] [-NVB18K] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[graylog_0][2]] …]).

root@graylog:/var/log/graylog# tailf etcd/current
2019-03-20_08:02:25.07395 2019-03-20 08:02:25.073564 I | raft: 8e9e05c52164694d is starting a new election at term 55
2019-03-20_08:02:25.07478 2019-03-20 08:02:25.073690 I | raft: 8e9e05c52164694d became candidate at term 56
2019-03-20_08:02:25.07627 2019-03-20 08:02:25.073717 I | raft: 8e9e05c52164694d received MsgVoteResp from 8e9e05c52164694d at term 56
2019-03-20_08:02:25.07714 2019-03-20 08:02:25.073734 I | raft: 8e9e05c52164694d became leader at term 56
2019-03-20_08:02:25.08014 2019-03-20 08:02:25.073745 I | raft: raft.node: 8e9e05c52164694d elected leader 8e9e05c52164694d at term 56
2019-03-20_08:02:25.08074 2019-03-20 08:02:25.076045 I | etcdserver: published {Name:default ClientURLs:[http://10.100.125.148:4001]} to cluster cdf818194e3a8c32
2019-03-20_08:02:25.08394 2019-03-20 08:02:25.078125 I | embed: ready to serve client requests
2019-03-20_08:02:25.08450 2019-03-20 08:02:25.078543 N | embed: serving insecure client requests on [::]:2379, this is strongly discouraged!
2019-03-20_08:02:25.08558 2019-03-20 08:02:25.079176 I | embed: ready to serve client requests
2019-03-20_08:02:25.08612 2019-03-20 08:02:25.079468 N | embed: serving insecure client requests on [::]:4001, this is strongly discouraged!

root@graylog:/var/log/graylog# tailf mongodb/current
2019-03-20_08:10:20.82915 2019-03-20T08:10:20.829+0000 I - [conn76] end connection 127.0.0.1:51093 (2 connections now open)
2019-03-20_08:10:20.82961 2019-03-20T08:10:20.829+0000 I - [conn75] end connection 127.0.0.1:51092 (2 connections now open)
2019-03-20_08:10:20.84022 2019-03-20T08:10:20.840+0000 I NETWORK [thread1] connection accepted from 127.0.0.1:51096 #78 (1 connection now open)
2019-03-20_08:10:20.84060 2019-03-20T08:10:20.840+0000 I - [conn78] end connection 127.0.0.1:51096 (1 connection now open)
2019-03-20_08:10:29.09739 2019-03-20T08:10:29.097+0000 I NETWORK [thread1] connection accepted from 127.0.0.1:51097 #79 (1 connection now open)
2019-03-20_08:10:29.11625 2019-03-20T08:10:29.116+0000 I NETWORK [conn79] received client metadata from 127.0.0.1:51097 conn79: { driver: { name: “mongo-java-driver”, version: “unknown” }, os: { type: “Linux”, name: “Linux”, architecture: “amd64”, version: “3.13.0-137-generic” }, platform: “Java/Oracle Corporation/1.8.0_151-b12” }
2019-03-20_08:10:29.14775 2019-03-20T08:10:29.147+0000 I NETWORK [thread1] connection accepted from 127.0.0.1:51098 #80 (2 connections now open)
2019-03-20_08:10:29.14839 2019-03-20T08:10:29.148+0000 I NETWORK [conn80] received client metadata from 127.0.0.1:51098 conn80: { driver: { name: “mongo-java-driver”, version: “unknown” }, os: { type: “Linux”, name: “Linux”, architecture: “amd64”, version: “3.13.0-137-generic” }, platform: “Java/Oracle Corporation/1.8.0_151-b12” }
2019-03-20_08:10:33.17672 2019-03-20T08:10:33.176+0000 I NETWORK [thread1] connection accepted from 127.0.0.1:51100 #81 (3 connections now open)
2019-03-20_08:10:33.17763 2019-03-20T08:10:33.177+0000 I NETWORK [conn81] received client metadata from 127.0.0.1:51100 conn81: { driver: { name: “mongo-java-driver”, version: “unknown” }, os: { type: “Linux”, name: “Linux”, architecture: “amd64”, version: “3.13.0-137-generic” }, platform: “Java/Oracle Corporation/1.8.0_151-b12” }

root@graylog:/var/log/graylog# tailf nginx/current
2019-03-20_07:58:33.47111 nginx: 14.142.185.242 - - [20/Mar/2019:07:58:33 +0000] “GET / HTTP/1.1” 502 1091 “-” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36” “-” <msec=1553068713.470|connection=456|connection_requests=1|millis=0.001>
2019-03-20_07:58:33.71238 nginx: 14.142.185.242 - - [20/Mar/2019:07:58:33 +0000] “GET /favicon.ico HTTP/1.1” 502 1091 “https://log.t2scdn.com/” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36” “-” <msec=1553068713.711|connection=456|connection_requests=2|millis=0.000>
2019-03-20_07:59:27.34824 nginx: 14.142.185.242 - - [20/Mar/2019:07:59:27 +0000] “GET / HTTP/1.1” 502 1091 “-” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36” “-” <msec=1553068767.348|connection=456|connection_requests=3|millis=0.001>
2019-03-20_07:59:27.56988 nginx: 14.142.185.242 - - [20/Mar/2019:07:59:27 +0000] “GET /favicon.ico HTTP/1.1” 502 1091 “https://log.t2scdn.com/” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36” “-” <msec=1553068767.569|connection=456|connection_requests=4|millis=0.000>
2019-03-20_07:59:36.45862 nginx: 14.142.185.242 - - [20/Mar/2019:07:59:36 +0000] “GET / HTTP/1.1” 502 1091 “-” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36” “-” <msec=1553068776.458|connection=456|connection_requests=5|millis=0.000>
2019-03-20_07:59:36.67401 nginx: 14.142.185.242 - - [20/Mar/2019:07:59:36 +0000] “GET /favicon.ico HTTP/1.1” 502 1091 “https://log.t2scdn.com/” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36” “-” <msec=1553068776.673|connection=456|connection_requests=6|millis=0.000>
2019-03-20_07:59:37.65667 nginx: 14.142.185.242 - - [20/Mar/2019:07:59:37 +0000] “GET / HTTP/1.1” 502 1091 “-” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36” “-” <msec=1553068777.656|connection=456|connection_requests=7|millis=0.000>
2019-03-20_07:59:37.90528 nginx: 14.142.185.242 - - [20/Mar/2019:07:59:37 +0000] “GET /favicon.ico HTTP/1.1” 502 1091 “https://log.t2scdn.com/” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36” “-” <msec=1553068777.905|connection=456|connection_requests=8|millis=0.000>
2019-03-20_08:02:33.88361 nginx: 182.73.76.118 - - [20/Mar/2019:08:02:33 +0000] “GET / HTTP/1.1” 502 1091 “-” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36” “-” <msec=1553068953.882|connection=2|connection_requests=1|millis=0.000>
2019-03-20_08:02:34.08718 nginx: 182.73.76.118 - - [20/Mar/2019:08:02:34 +0000] “GET /favicon.ico HTTP/1.1” 502 1091 “https://log.t2scdn.com/” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36” “-” <msec=1553068954.086|connection=2|connection_requests=2|millis=0.000>

4

first, please format your possting. Place log in code blocks will make them readable …

It looks from a first look like your Graylog journal is corrupt and you need to stop Graylog, delete the journal and start Graylog again.

That happens mostly when the disk is was full or similar.

5

Sure. Thank you and now its working fine

But its not showing any received messages/Sources in graylog web console. Suddenly from past 3 days its not showing any data and Im able to see number of messages receiving per second.Please find screenshots below for your reference

32%20PM
Screen Shot 2019-03-20 at 2.13.32 PM.png1440×540 60.9 KB

28%20PM
Screen Shot 2019-03-20 at 2.11.28 PM.png1431×473 44.3 KB

6

so your problem is something different from what you wrote in your first posting …

what are the messages you see when you click the read dot?
did you tried to go to System > indices > INDEXNAME and hit “maintenance > recalculate index range”?

7

Hi Jan

Yes

There were 4 notifications (read dot).

24%20PM
Screen Shot 2019-03-20 at 5.13.24 PM.png1428×521 82.6 KB

-> I did System > indices > INDEXNAME and hit “maintenance > recalculate index range” . Now Im able to see logs. Thanks alot for your help :slight_smile: Can you help me to avoid it in future

8

you can click on the x on the right of the message to remove them.

9

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.