Number of documents in the index can't exceed

Before you post: Your responses to these questions will help the community help you. Please complete this template if you’re asking a support question.
Don’t forget to select tags to help index your topic!

1. Describe your incident:
I am getting this issue on my server and its hanging my server.
ElasticsearchException[Elasticsearch exception [type=illegal_argument_exception, reason=Number of documents in the index can’t exceed [2 147 483 519]]]

2. Describe your environment:

  • OS Information:
    RHEL 7
  • Package Version:
    graylog-server-5.0.5-1.x86_64
  • Service logs, configurations, and environment variables:
    ElasticsearchException[Elasticsearch exception [type=illegal_argument_exception, reason=Number of documents in the index can’t exceed [2 147 483 519]]]

3. What steps have you already taken to try and solve the problem?
This has been going on for a while , just rebooting the server. But the next day the server still hangs.

4. How can the community help?
We are using an opensource graylog
32CPU and 64 G memory

Is this something to do with the license or just configuration on the server?

Helpful Posting Tips: Tips for Posting Questions that Get Answers [Hold down CTRL and link on link to open tips documents in a separate tab]

While that is a hard limit, you can address it by splitting your logs across multiple indices. Graylog has added several rotation/retention strategies to better help with this. The new Index Time Size Optimizing Configuration is recommended.

Have a look through Index model to get an idea of how the index model works. Graylog can accommodate enormous amounts of log data but does require some tuning.

1 Like

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.