[dstaroff]

Problem

metrics-grafana in monitoring-system does not expose the VictoriaMetrics Prometheus-compatible datasource, leaving Soperator dashboards without metric data.

The datasource ConfigMap exists and is discovered by the Grafana sidecar. However, the sidecar’s provisioning reload request returns 403 Forbidden because:

• Grafana Basic Auth is disabled.
• The sidecar uses the existing Grafana administrator credentials.
• Grafana 13 no longer grants the configured Admin role to anonymous users.
• A startup timing race causes Grafana to miss the datasource during its initial provisioning pass, making the rejected reload necessary.

Solution

Enable Basic Auth for provisioning requests while keeping the interactive login form disabled.

Testing

Enabled basic auth on a dev cluster, and restarted Grafana pod.

Release Notes

Fix: Missing data source in Grafana.

[theyoprst]

My friend just telegraphed:

2. The Grafana chart bundled with vm-k8s-stack 0.80 (12.3.x) has sidecar.datasources.initDatasources. Turning it on writes the datasources to disk before Grafana starts, which removes the race. Basic auth is still needed for datasources added later, so this would go alongside the PR's change, not replace it.

Up to you, though