Graylog will not load

Graylog Central (peer support)
1

My Graylog (ver 2.4) is attached to LUNs on my netapp. While I was on vacation Graylog lost communication with the drive I have logs written to (not sure why I am not storage) after fixing the storage issue the site will not load. I think something happened to my Mongodb.

root@ubuntu:~# mongod
2019-09-05T07:06:19.647-0700 I CONTROL [initandlisten] MongoDB starting : pid=3453 port=27017 dbpath=/data/db 64-bit host=ubuntu
2019-09-05T07:06:19.647-0700 I CONTROL [initandlisten] db version v3.6.3
2019-09-05T07:06:19.648-0700 I CONTROL [initandlisten] git version: 9586e557d54ef70f9ca4b43c26892cd55257e1a5
2019-09-05T07:06:19.648-0700 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.2g 1 Mar 2016
2019-09-05T07:06:19.648-0700 I CONTROL [initandlisten] allocator: tcmalloc
2019-09-05T07:06:19.648-0700 I CONTROL [initandlisten] modules: none
2019-09-05T07:06:19.648-0700 I CONTROL [initandlisten] build environment:
2019-09-05T07:06:19.648-0700 I CONTROL [initandlisten] distmod: ubuntu1604
2019-09-05T07:06:19.648-0700 I CONTROL [initandlisten] distarch: x86_64
2019-09-05T07:06:19.648-0700 I CONTROL [initandlisten] target_arch: x86_64
2019-09-05T07:06:19.648-0700 I CONTROL [initandlisten] options: {}
2019-09-05T07:06:19.648-0700 I STORAGE [initandlisten] exception in initAndListen: NonExistentPath: Data directory /data/db not found., terminating
2019-09-05T07:06:19.648-0700 I CONTROL [initandlisten] now exiting
2019-09-05T07:06:19.648-0700 I CONTROL [initandlisten] shutting down with code:100

Mongod.log
2019-09-04T15:46:04.085-0700 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb/mongod.lock is not empty.
2019-09-04T15:54:34.153-0700 E STORAGE [initandlisten] WiredTiger error (0) [1567637674:153267][1356:0x7fc3ce0e29c0], file:collection-67–3864921791193957682.wt, WT_CURSOR.prev: read checksum error for 4096B block at offset 696320: block header checksum of 3556023370 doesn’t match expected checksum of 3809927217

2

it looks like your mongoDB is wrecked.

Restore from Backup and you are in the game again.

3

Might want to check your storage is definitely mounted properly and Mongo can access the data?

4

That is what I was afraid of, thanks

5

After googling I found if I run mongod --dbpath /var/lib/mongodb/ graylog starts to work. I am running the cmd over ssh. When I close out my ssh Window graylog stops. So (I am assuming) running mongod --dbpath /var/lib/mongodb/ starts the DB??? How do I fix this so I dont have to ssh in to the box and keep running it??

6

sorry dude - but that is linux basic knowledge I’ll not teach here:

One of the following certificates will give you the knowledge about your problem.

  • LINUX + CompTIA.
  • RHCE- RED HAT CERTIFIED ENGINEER.
  • GCUX: GIAC CERTIFIED UNIX SECURITY ADMINISTRATOR.
  • ORACLE LINUX OCA & OCP.
  • LPI ( LINUX PROFESSIONAL INSTITUTE) CERTIFICATIONS .
7

Wow, not looking to get a cert dude, just looking to get graylog up and running again. Anyone else care to help me out?

8

Run MongoDB as a service.

9

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.