Indices & Index configuration

Graylog Central (peer support)
1

Hi all,
Thanks in advance for the help,

I have a basic question but i didn’t get it after reading the documentation online.
I’ve just realized that I’m using only 17% of my memory’s server where graylog is running.
For the moment, graylog is working with the initial configuration :
Max docs per index: 20000000 / Max number of indices:16

My first idea to use at least 80% of that memory is to put “max_number_of_indices” at 80.
But maybe I can also change de “max_docs_per_index” parameter, … or something else ?
I really don’t know ! If someone needed the same kind of changement from the initial configuration file, let me know
Thank you again
Guillaume

2

How many indices You have now?

3

I’m already using the 16 indices (the max number in my configuration file) so I can’t have more than 320 000 000 messages and use more than 17% of memory

4

Why don’t you use the Index Size as an option?

2018-08-07%2011_57_15-Graylog%20-%20Index%20Set%20-%20Default%20index%20set
2018-08-07 11_57_15-Graylog - Index Set - Default index set.png711×89 6.34 KB

We have it this way. It is more comfortable for us.

Edit: As an example for a big index file: 18.9GB / 20,632,306 messages

6

Oh ! Could be another good option sure …
And what is the best choice ? A high “max_index_size” value ? A high “max_number_of_indices” value ? A mix ?
Thanks again

Edit : for example, with 30 indices max as your own configuration, I need an index size at 40GB each, i don’t know

7

You might want to have a look at this blog post from 2016.


I found it last year. There are interesting aspects for sizing the Graylog system.

1 Like
8

Oh thanks again !! It has been really usefull, I think I will use a higher max number of indices with a “max index size” value instead of “max docs per index”
Thks ! All the best

9

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.