[tempo-distributed] Failed to extract org id from both grpc and HTTP

[Blocka]

Hi, I'd like to ask about an issue I'm facing. I've set multitenancyEnabled: true in Tempo, and I've configured the following parameters in Mimir:

global:
  extraEnv:
    - name: JAEGER_AGENT_HOST
      value: tempo-distributor.tracing
    - name: JAEGER_SAMPLER_PARAM
      value: "1"

However, No matter if I remove the headers or set them to X-Scope-OrgID: anonymous in Tempo datasource, I'm unable to receive traces from Mimir when viewing them from Tempo. I found the following issue in the logs.

tempo-distributor:

ts=2024-03-14T04:44:52.633295325Z caller=middleware.go:68 msg="failed to extract org id from both grpc and HTTP" err="no org id" client=unknown
ts=2024-03-14T04:44:52Z level=error msg="Processor failed" component=tempo error="no org id"

if I disable multitenancyEnabled, i can see the traces from mimir.