Hello all, I’ve been running Graylog in production for a while now, but recently have been experiencing some at times very severe service degradation and it seems to be stemming from the Graylog API making calls to the /system endpoint. Specs: Graylog Server 3.3.2 on CentOS 7.8.2003 @ 3.10.0-112…

how much RAM did you have configured for JAVA Heap? If you do not know it is very likely that you have only the default settings and you should raise the heap.

Hi Jan, the heap size is set to 28 gig and has been from the outset.

Seems like this is an issue for others as well? Would love to help try to debug this before going full production on GL3. If not, I’ll probably revert to GL2. Please let me know what else I can do as far as debugging this. I feel like this is a bug somewhere.

he @finite setting 28GB Heap for Graylog on a 32GB system is way to much - I recomment not more than 12GB of HEAP. Unless you make heavy use of CSV or DSV Lookup tables.

Hi @jan I’ve decreased the heap to 12GB, but the issue persists.

Hi @fadenb indeed it looks like you and I might be in a very similar situation. Which to me means there has to be a bug somewhere. I only have one node running GL, but it has plenty of CPU just sitting idle that the process can use.

Still seeing the same behavior in 3.3.3. Is there anything else I can try? Upping the verbosity of the logging?

Graylog System API Timeouts

Graylog Central (peer support)

fadenb (FadenB) July 29, 2020, 8:38am 7

Just stumbled on this following https://github.com/Graylog2/graylog2-server/issues/8610 .
Is this the same issue I am describing in API timeout when querying list of metrics ?

Topic		Replies	Views
API timeout /system Graylog Central (peer support)	7	2569	February 5, 2022
Graylog api/system timeout failures Graylog Central (peer support)	3	2670	July 12, 2019
API timeout when querying list of metrics Graylog Central (peer support)	4	1232	July 20, 2020
Problem with REST API timing out Graylog Central (peer support)	8	2694	June 8, 2017
System information is currently unavailable Graylog Central (peer support)	5	2344	February 28, 2018

Graylog System API Timeouts

Related topics