Pipeline rule editor error when updating rules

I just want to dump some information here in case it helps. We took snapshots of all VMs and did some testing.

  1. We dropped the database, rebooted the graylog-server and graylog-datanode and after the preflight the issue still occured.
  2. We replaced the graylog-server only and the issue still occured.
  3. Emptying the folders config and data under /var/lib/graylog-datanode/opensearch and restarting the graylog-datanode service did not help either.
  4. We tried to add a new datanode to replace the existing one but we were unsuccessful to do so. We get the same error messages as seen in the logs from this post here:
    Failled to add new Datanode - #14 by Etny
  5. Accessing the webinterface without reverse proxy produced the same error.

We are eyeing to just build it from scratch but it seems really tedious to migrate all the rules and stuff.