Before you post: Your responses to these questions will help the community help you. Please complete this template if you’re asking a support question.
Don’t forget to select tags to help index your topic!
1. Describe your incident:
Unable to add second data node to cluster. Was available during in-place migration, however shows unavailable after final graylog server restart. Logs show an error regarding basic auth, almost like the jwt is not being used
2. Describe your environment:
-
OS Information:
Graylog/mongodb - Ubuntu 24.04.1
Working data node - Ubuntu 24.04.1
Failing data note - RHEL 8.1 -
Package Version:
6.2.3+b5538f9 -
Service logs, configurations, and environment variables:
[2025-06-04T17:03:23,861][INFO ][o.o.m.c.MLCommonsClusterManagerEventListener] [opensearch.ncg.local] Starting ML sync up job…
[2025-06-04T17:03:27,774][WARN ][o.o.s.h.HTTPBasicAuthenticator] [opensearch.ncg.local] No ‘Basic Authorization’ header, send 401 and ‘WWW-Authenticate Basic’
[2025-06-04T17:03:33,874][INFO ][o.o.m.c.MLSyncUpCron ] [opensearch.ncg.local] ML configuration already initialized, no action needed
[2025-06-04T17:03:37,774][WARN ][o.o.s.h.HTTPBasicAuthenticator] [opensearch.ncg.local] No ‘Basic Authorization’ header, send 401 and ‘WWW-Authenticate Basic’
[2025-06-04T17:03:47,774][WARN ][o.o.s.h.HTTPBasicAuthenticator] [opensearch.ncg.local] No ‘Basic Authorization’ header, send 401 and ‘WWW-Authenticate Basic’
[2025-06-04T17:03:57,774][WARN ][o.o.s.h.HTTPBasicAuthenticator] [opensearch.ncg.local] No ‘Basic Authorization’ header, send 401 and ‘WWW-Authenticate Basic’
[2025-06-04T17:04:07,774][WARN ][o.o.s.h.HTTPBasicAuthenticator] [opensearch.ncg.local] No ‘Basic Authorization’ header, send 401 and ‘WWW-Authenticate Basic’
[2025-06-04T17:04:13,828][INFO ][o.o.i.i.ManagedIndexCoordinator] [opensearch.ncg.local] Performing move cluster state metadata.
[2025-06-04T17:04:13,829][INFO ][o.o.i.i.MetadataService ] [opensearch.ncg.local] ISM config index not exist, so we cancel the metadata migration job.
[2025-06-04T17:04:17,774][WARN ][o.o.s.h.HTTPBasicAuthenticator] [opensearch.ncg.local] No ‘Basic Authorization’ header, send 401 and ‘WWW-Authenticate Basic’
3. What steps have you already taken to try and solve the problem?
Verified setup with working data node, system reboots, service resets
4. How can the community help?
Does anyone have a suggestion as to why its looking for basic auth? I followed the migration guide
Helpful Posting Tips: Tips for Posting Questions that Get Answers [Hold down CTRL and link on link to open tips documents in a separate tab]