Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[extensions/headerssetter] fatal error: concurrent map writes - collector crashes when multiple exporters uses headers_setter #31289

Closed
tdarwin opened this issue Feb 15, 2024 · 6 comments
Closed

[extensions/headerssetter] fatal error: concurrent map writes - collector crashes when multiple exporters uses headers_setter #31289

tdarwin opened this issue Feb 15, 2024 · 6 comments
Labels
bug Something isn't working extension/headerssetter

Comments

@tdarwin
Copy link

tdarwin commented Feb 15, 2024

Component(s)

No response

What happened?

Description

Daemonset collector instances have been crashing and restarting when having multiple exporters using the same instance of the headers_setter extension. Collectors eventually crash with the following error:
fatal error: concurrent map writes

Steps to Reproduce

  1. Setup a collector to receive OTLP metrics
  2. Use the headers_setter extension to transmit a header via exporter Honeycomb blog for example
  3. Apply a header via the HS extension to multiple exporters (the more exporters, the faster you get crashes)
  4. Send OTLP metrics through the collector for several minutes
  5. Watch for the collector to crash

Expected Result

Collector does not crash

Actual Result

Collector crashes

Collector version

0.94.0

Environment information

Environment

Kubernetes deployment via helm chart version 0.81.1.
Running in AWS/EKS, on Graviton3 processors

OpenTelemetry Collector configuration

mode: daemonset
service:
  enabled: true

resources:
  limits:
    cpu: 200m
    memory: 512Mi
  requests:
    cpu: 100m
    memory: 256Mi

presets:
  kubernetesAttributes:
    enabled: true
  logsCollection:
    enabled: false
  kubeletMetrics:
    enabled: true

# Adding a comment here to trigger the helm deployment
config:
  extensions:
    headers_setter:
      headers:
        - action: upsert
          key: x-honeycomb-dataset
          from_context: x-honeycomb-dataset
  receivers:
    jaeger: null
    zipkin: null
    otlp:
      protocols:
        grpc:
          endpoint: ${env:MY_POD_IP}:4317
          include_metadata: true
        http:
          endpoint: ${env:MY_POD_IP}:4318
          include_metadata: true
    kubeletstats:
      collection_interval: 30s
      metrics:
        k8s.node.uptime:
          enabled: true
        k8s.pod.uptime:
          enabled: true
        container.uptime:
          enabled: true
        k8s.container.cpu_limit_utilization:
          enabled: true
        k8s.container.cpu_request_utilization:
          enabled: true
        k8s.container.memory_limit_utilization:
          enabled: true
        k8s.container.memory_request_utilization:
          enabled: true
        k8s.pod.cpu_limit_utilization:
          enabled: true
        k8s.pod.cpu_request_utilization:
          enabled: true
        k8s.pod.memory_limit_utilization:
          enabled: true
        k8s.pod.memory_request_utilization:
          enabled: true
    prometheus:
      config:
        scrape_configs:
        - job_name: opentelemetry-collector
          scrape_interval: 30s
          static_configs:
          - targets:
            - ${env:MY_POD_IP}:8888
  processors:
    batch:
      metadata_keys: 
        - x-honeycomb-dataset
      metadata_cardinality_limit: 30
    k8sattributes:
      extract:
        annotations:
        - from: pod
          key_regex: (.*)
          tag_name: $$1
        - from: node
          key_regex: (.*)
          tag_name: $$1
        labels:
        - from: pod
          key_regex: (.*)
          tag_name: $$1
        - from: node
          key_regex: (.*)
          tag_name: $$1
      passthrough: false
      pod_association:
      - sources:
        - from: resource_attribute
          name: k8s.pod.ip
      - sources:
        - from: resource_attribute
          name: k8s.pod.uid
      - sources:
        - from: connection
    attributes:
      include:
        match_type: strict
        services:
          - frontend-proxy
      actions:
        - key: net.component
          value: proxy
          action: insert
    transform:
      error_mode: ignore
      trace_statements:
        - context: span
          statements:
            - set(attributes["k8s.cluster.name"], "cs-k8s-sandbox")
            - set(attributes["http.response.status_code"], attributes["http.status_code"]) where attributes["http.status_code"] != nil and attributes["http.response.status_code"] == nil
        - context: spanevent
          statements:
            - set(attributes["k8s.cluster.name"], "cs-k8s-sandbox")
  exporters:
    otlp/unrefined:
      endpoint: "api.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
    otlp/refined:
      # sends to prrrod sampled environment on the ca team slack
      endpoint: "refinery.carefinery:4317"
      tls:
        insecure: true
      headers:
        "x-honeycomb-team": "REDACTED"
    otlp/dogfood-unrefined:
      endpoint: "api-dogfood.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
    otlp/eu-unrefined:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
    otlp/eu-refined:
      # sends to eu-prrrod sampled environment on the EU1 ca team slack
      endpoint: "hnytest.refinery.eu1.honeydemo.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
    otlp/dataset_hs_traffic:
      endpoint: "api.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
      auth:
        authenticator: headers_setter
    otlp/dataset_hs_traffic2:
      endpoint: "api.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
      auth:
        authenticator: headers_setter
    otlp/dataset_hs_traffic-dogfood:
      endpoint: "api-dogfood.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
      auth:
        authenticator: headers_setter
    otlp/eu-dataset_hs_traffic:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
      auth:
        authenticator: headers_setter
    otlp/eu-dataset_hs_traffic2:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
      auth:
        authenticator: headers_setter
    otlp/k8sMetrics:
      endpoint: "api.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-kubeletstats"
    otlp/dogfood-k8sMetrics:
      endpoint: "api-dogfood.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-kubeletstats"
    otlp/k8sMetrics2:
      endpoint: "api.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-kubeletstats"
    otlp/eu-k8sMetrics:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-kubeletstats"
    otlp/eu-k8sMetrics2:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-kubeletstats"
    otlp/otelColMetrics:
      endpoint: "api.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-collector-metrics"
    otlp/dogfood-otelColMetrics:
      endpoint: "api-dogfood.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-collector-metrics"
    otlp/otelColMetrics2:
      endpoint: "api.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-collector-metrics"
    otlp/eu-otelColMetrics:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-collector-metrics"
    otlp/eu-otelColMetrics2:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-collector-metrics"
    otlp/k8slogs:
      endpoint: "api.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-filelog"
    otlp/dogfood-k8slogs:
      endpoint: "api-dogfood.honeycomb.io:443"
      headers:
        "x-honeycomb-team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-filelog"
    otlp/k8slogs2:
      endpoint: "api.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-filelog"
    otlp/eu-k8slogs:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-filelog"
    otlp/eu-k8slogs2:
      endpoint: "api.eu1.honeycomb.io:443"
      headers:
        "X-Honeycomb-Team": "REDACTED"
        "X-Honeycomb-Dataset": "otel-filelog"
  service:
    telemetry:
      logs:
        level: DEBUG
        initial_fields:
          service: otel-daemonset
    extensions:
      - headers_setter
      - health_check
      - memory_ballast
    pipelines:
      traces:
        receivers: [ otlp ]
        processors: [ k8sattributes, transform, attributes, batch]
        exporters: [ otlp/unrefined, otlp/eu-unrefined, otlp/refined, otlp/eu-refined, otlp/dogfood-unrefined ]
      metrics:
        receivers: [ otlp ]
        processors: [ k8sattributes, batch ]
        exporters: [ otlp/dataset_hs_traffic, otlp/dataset_hs_traffic2, otlp/eu-dataset_hs_traffic, otlp/eu-dataset_hs_traffic2, otlp/dataset_hs_traffic-dogfood ]
      logs:
        receivers: [ otlp ]
        processors: [ k8sattributes, batch ]
        exporters: [ otlp/dataset_hs_traffic, otlp/dataset_hs_traffic2, otlp/eu-dataset_hs_traffic, otlp/eu-dataset_hs_traffic2, otlp/dataset_hs_traffic-dogfood ]
      metrics/k8s:
        receivers: [ kubeletstats ]
        processors: [ k8sattributes, transform, batch ]
        exporters: [ otlp/k8sMetrics, otlp/k8sMetrics2, otlp/eu-k8sMetrics, otlp/eu-k8sMetrics2, otlp/dogfood-k8sMetrics ]
      metrics/otelcol:
        receivers: [ prometheus ]
        processors: [ k8sattributes, transform, batch ]
        exporters: [ otlp/otelColMetrics, otlp/otelColMetrics2, otlp/eu-otelColMetrics, otlp/eu-otelColMetrics2, otlp/dogfood-otelColMetrics ]
      # logs/k8s:
      #   receivers: [ filelog ]
      #   processors: [ k8sattributes, batch ]
      #   exporters: [ otlp/k8slogs, otlp/k8slogs2, otlp/eu-k8slogs, otlp/eu-k8slogs2, otlp/dogfood-k8slogs ]

ports:
  otlp:
    enabled: true
    containerPort: 4317
    servicePort: 4317
    hostPort: 4317
    protocol: TCP
    appProtocol: grpc
  otlp-http:
    enabled: true
    containerPort: 4318
    servicePort: 4318
    hostPort: 4318
    protocol: TCP
  jaeger-compact:
    enabled: false
  jaeger-thrift:
    enabled: false
  jaeger-grpc:
    enabled: false
  zipkin:
    enabled: false
  metrics:
    # The metrics port is disabled by default. However you need to enable the port
    # in order to use the ServiceMonitor (serviceMonitor.enabled) or PodMonitor (podMonitor.enabled).
    enabled: true
    containerPort: 8888
    servicePort: 8888
    protocol: TCP

clusterRole:
  create: true
  rules:
    - apiGroups: 
        - ""
      resources:
        - nodes/proxy
      verbs:
        - get
    - apiGroups:
        - ""
      resources:
        - nodes
      verbs:
        - get
        - watch
        - list

Log output

Will add stack trace as comments, as it's 7200 lines long and causes this submission to fail.

Additional context

Have tried duplicating the extension and using the second extension for a second exporter, but still got a crash/restart of the pod.
@tdarwin tdarwin added bug Something isn't working needs triage New item requiring triage labels Feb 15, 2024
@tdarwin
Copy link
Author

tdarwin commented Feb 15, 2024

Log output part 1

fatal error: concurrent map writes

goroutine 616 [running]:
go.opentelemetry.io/collector/client.Metadata.Get({0x0?}, {0x4002a01488, 0x13})
	go.opentelemetry.io/[email protected]/client/client.go:158 +0x13c
github.com/open-telemetry/opentelemetry-collector-contrib/extension/headerssetterextension/internal/source.(*ContextSource).Get(0x4002dbea20, {0x85cbe38?, 0x40054a02a0?})
	github.com/open-telemetry/opentelemetry-collector-contrib/extension/[email protected]/internal/source/context.go:21 +0xd0
github.com/open-telemetry/opentelemetry-collector-contrib/extension/headerssetterextension.(*headersPerRPC).GetRequestMetadata(0x40033439c8, {0x85cbe38, 0x40054a02a0}, {0x30?, 0x30?, 0x6f0e5c0?})
	github.com/open-telemetry/opentelemetry-collector-contrib/extension/[email protected]/extension.go:90 +0xc4
google.golang.org/grpc/internal/transport.(*http2Client).getTrAuthData(0x40038d1440, {0x85cbe38, 0x40054a02a0}, {0x4005233f80, 0x52})
	google.golang.org/[email protected]/internal/transport/http2_client.go:630 +0x114
google.golang.org/grpc/internal/transport.(*http2Client).createHeaderFields(0x40038d1440, {0x85cbe38, 0x40054a0270}, 0x40031c6ec8)
	google.golang.org/[email protected]/internal/transport/http2_client.go:512 +0xd0
google.golang.org/grpc/internal/transport.(*http2Client).NewStream(0x40038d1440, {0x85cbe38, 0x40054a01e0}, 0x40053f84e0)
	google.golang.org/[email protected]/internal/transport/http2_client.go:721 +0x144
google.golang.org/grpc.(*csAttempt).newStream(0x40053c8b60)
	google.golang.org/[email protected]/stream.go:504 +0x94
google.golang.org/grpc.newClientStreamWithParams.func2(0x40053c8b60)
	google.golang.org/[email protected]/stream.go:354 +0x34
google.golang.org/grpc.(*clientStream).withRetry(0x4005279b00, 0x4007814af0, 0x40031c7268)
	google.golang.org/[email protected]/stream.go:778 +0x188
google.golang.org/grpc.newClientStreamWithParams({0x85cbe38, 0x40053d1fb0}, 0xde3e560, 0x40035fe380, {0x783f923, 0x39}, {0x0, 0x0, 0x0, 0x0, ...}, ...)
	google.golang.org/[email protected]/stream.go:363 +0x9d4
google.golang.org/grpc.newClientStream.func3({0x85cbe38?, 0x40053d1fb0?}, 0x40053d1fb0?)
	google.golang.org/[email protected]/stream.go:220 +0x6c
google.golang.org/grpc.newClientStream({0x85cbe38, 0x40053d1fb0}, 0xde3e560, 0x40035fe380, {0x783f923, 0x39}, {0x4002dff320, 0x2, 0x1?})
	google.golang.org/[email protected]/stream.go:255 +0x628
google.golang.org/grpc.invoke({0x85cbe38?, 0x40053d1fb0?}, {0x783f923?, 0x4003602630?}, {0x7242c80, 0x4006739f80}, {0x7242dc0, 0x40068213c8}, 0x40068213c8?, {0x4002dff320?, ...})
	google.golang.org/[email protected]/call.go:66 +0x68
google.golang.org/grpc.(*ClientConn).Invoke(0x40035fe380?, {0x85cbe38?, 0x40053d1fb0?}, {0x783f923?, 0x39?}, {0x7242c80?, 0x4006739f80?}, {0x7242dc0?, 0x40068213c8?}, {0x4003602ba0?, ...})
	google.golang.org/[email protected]/call.go:37 +0x1a4
go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/logs/v1.(*logsServiceClient).Export(0x4002f77710, {0x85cbe38, 0x40053d1fb0}, 0xde95160?, {0x4003602ba0, 0x1, 0x1})
	go.opentelemetry.io/collector/[email protected]/internal/data/protogen/collector/logs/v1/logs_service.pb.go:272 +0x8c
go.opentelemetry.io/collector/pdata/plog/plogotlp.(*grpcClient).Export(0x10?, {0x85cbe38?, 0x40053d1fb0?}, {0x4006739f80?, 0x40050d2148?}, {0x4003602ba0?, 0x40031c76c8?, 0xb4f38?})
	go.opentelemetry.io/collector/[email protected]/plog/plogotlp/grpc.go:42 +0x48
go.opentelemetry.io/collector/exporter/otlpexporter.(*baseExporter).pushLogs(0x4002d75b00, {0x85cbee0?, 0x4001b60e00?}, {0x4006739f80?, 0x40050d2148?})
	go.opentelemetry.io/collector/exporter/[email protected]/otlp.go:127 +0x8c
go.opentelemetry.io/collector/exporter/exporterhelper.(*logsRequest).Export(0x85cbe38?, {0x85cbee0?, 0x4001b60e00?})
	go.opentelemetry.io/collector/[email protected]/exporterhelper/logs.go:59 +0x40
go.opentelemetry.io/collector/exporter/exporterhelper.(*timeoutSender).send(0x40053f2c00?, {0x85cbe38?, 0x40053d1f80?}, {0x8582b98, 0x4006821380})
	go.opentelemetry.io/collector/[email protected]/exporterhelper/timeout_sender.go:49 +0xa0
go.opentelemetry.io/collector/exporter/exporterhelper.(*retrySender).send(0x4002dd25a0, {0x85cbe38, 0x40053d1f80}, {0x8582b98, 0x4006821380})
	go.opentelemetry.io/collector/[email protected]/exporterhelper/retry_sender.go:89 +0x334
go.opentelemetry.io/collector/exporter/exporterhelper.(*logsExporterWithObservability).send(0x4002de3920, {0x85cc310?, 0x4007814a00?}, {0x8582b98?, 0x4006821380?})
	go.opentelemetry.io/collector/[email protected]/exporterhelper/logs.go:171 +0x74
go.opentelemetry.io/collector/exporter/exporterhelper.newQueueSender.func1({0x85cc310?, 0x4007814a00?}, {0x8582b98?, 0x4006821380?})
	go.opentelemetry.io/collector/[email protected]/exporterhelper/queue_sender.go:95 +0x78
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:57 +0xa4
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 1 [select, 1 minutes]:
go.opentelemetry.io/collector/otelcol.(*Collector).Run(0x40028a19a0, {0x85ca9c0, 0xde95160})
	go.opentelemetry.io/collector/[email protected]/collector.go:245 +0x1e8
go.opentelemetry.io/collector/otelcol.NewCommand.func1(0x400006af00, {0x7693196?, 0x7?, 0x768b84b?})
	go.opentelemetry.io/collector/[email protected]/command.go:27 +0x8c
github.com/spf13/cobra.(*Command).execute(0x400006af00, {0x40001ba090, 0x1, 0x1})
	github.com/spf13/[email protected]/command.go:983 +0x840
github.com/spf13/cobra.(*Command).ExecuteC(0x400006af00)
	github.com/spf13/[email protected]/command.go:1115 +0x344
github.com/spf13/cobra.(*Command).Execute(0x7a194e0?)
	github.com/spf13/[email protected]/command.go:1039 +0x1c
main.runInteractive({0x7a194e0, {{0x76bed6c, 0xf}, {0x775685a, 0x1f}, {0x768f95a, 0x6}}, 0x0, {0x0, 0x0}, ...})
	github.com/open-telemetry/opentelemetry-collector-releases/contrib/main.go:27 +0x90
main.run(...)
	github.com/open-telemetry/opentelemetry-collector-releases/contrib/main_others.go:10
main.main()
	github.com/open-telemetry/opentelemetry-collector-releases/contrib/main.go:20 +0xe0

goroutine 19 [chan receive]:
k8s.io/klog.(*loggingT).flushDaemon(0x0?)
	k8s.io/[email protected]/klog.go:1010 +0x5c
created by k8s.io/klog.init.0 in goroutine 1
	k8s.io/[email protected]/klog.go:411 +0x110

goroutine 6 [select]:
go.opencensus.io/stats/view.(*worker).start(0x4000128c00)
	[email protected]/stats/view/worker.go:292 +0x88
created by go.opencensus.io/stats/view.init.0 in goroutine 1
	[email protected]/stats/view/worker.go:34 +0x98

goroutine 7 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x40018b8910, 0x0)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40018b8900)
	sync/cond.go:70 +0xcc
github.com/cihub/seelog.(*asyncLoopLogger).processItem(0x400010c510)
	github.com/cihub/[email protected]/behavior_asynclooplogger.go:50 +0x90
github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0x400010c510)
	github.com/cihub/[email protected]/behavior_asynclooplogger.go:63 +0x38
created by github.com/cihub/seelog.NewAsyncLoopLogger in goroutine 1
	github.com/cihub/[email protected]/behavior_asynclooplogger.go:40 +0xc8

goroutine 8 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x40018b8a90, 0x0)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40018b8a80)
	sync/cond.go:70 +0xcc
github.com/cihub/seelog.(*asyncLoopLogger).processItem(0x400010c630)
	github.com/cihub/[email protected]/behavior_asynclooplogger.go:50 +0x90
github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0x400010c630)
	github.com/cihub/[email protected]/behavior_asynclooplogger.go:63 +0x38
created by github.com/cihub/seelog.NewAsyncLoopLogger in goroutine 1
	github.com/cihub/[email protected]/behavior_asynclooplogger.go:40 +0xc8

goroutine 9 [select]:
github.com/DataDog/datadog-agent/pkg/trace/metrics/timing.(*Set).Autoreport.func1()
	github.com/DataDog/datadog-agent/pkg/[email protected]/metrics/timing/timing.go:59 +0xd0
created by github.com/DataDog/datadog-agent/pkg/trace/metrics/timing.(*Set).Autoreport in goroutine 1
	github.com/DataDog/datadog-agent/pkg/[email protected]/metrics/timing/timing.go:54 +0xa0

goroutine 64 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0xffff5e042220, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4002256a80?, 0x35350?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0x4002256a80)
	internal/poll/fd_unix.go:611 +0x250
net.(*netFD).accept(0x4002256a80)
	net/fd_unix.go:172 +0x28
net.(*TCPListener).accept(0x400222d600)
	net/tcpsock_posix.go:152 +0x28
net.(*TCPListener).Accept(0x400222d600)
	net/tcpsock.go:315 +0x2c
net/http.(*Server).Serve(0x4001d5a5a0, {0x85ab140, 0x400222d600})
	net/http/server.go:3056 +0x2b8
net/http.(*Server).ListenAndServe(0x4001d5a5a0)
	net/http/server.go:2985 +0x84
go.opentelemetry.io/collector/service/internal/proctelemetry.InitPrometheusServer.func1()
	go.opentelemetry.io/collector/[email protected]/internal/proctelemetry/config.go:150 +0x28
created by go.opentelemetry.io/collector/service/internal/proctelemetry.InitPrometheusServer in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/proctelemetry/config.go:149 +0x1ac

goroutine 81 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e042128, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4002e89180?, 0x0?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0x4002e89180)
	internal/poll/fd_unix.go:611 +0x250
net.(*netFD).accept(0x4002e89180)
	net/fd_unix.go:172 +0x28
net.(*TCPListener).accept(0x400316ba20)
	net/tcpsock_posix.go:152 +0x28
net.(*TCPListener).Accept(0x400316ba20)
	net/tcpsock.go:315 +0x2c
net/http.(*Server).Serve(0x4001d5ab40, {0x85ab140, 0x400316ba20})
	net/http/server.go:3056 +0x2b8
github.com/open-telemetry/opentelemetry-collector-contrib/extension/healthcheckextension.(*healthCheckExtension).Start.func1()
	github.com/open-telemetry/opentelemetry-collector-contrib/extension/[email protected]/healthcheckextension.go:56 +0x6c
created by github.com/open-telemetry/opentelemetry-collector-contrib/extension/healthcheckextension.(*healthCheckExtension).Start in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/extension/[email protected]/healthcheckextension.go:52 +0x698

goroutine 82 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40031e3550, {0x85cbe70, 0x40031aee60})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 83 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40031e3580, {0x85cbe70, 0x40031aeeb0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 84 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40031e35b0, {0x85cbe70, 0x40031aef00})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 847 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d1f90, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a380)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 623
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 86 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 87 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 88 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 89 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 90 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 91 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 92 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 93 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 94 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 95 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e750)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 900 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fda9b0, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b9d0)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 324
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 96 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40031e3e80, {0x85cbe70, 0x40031af130})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 97 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40031e3eb0, {0x85cbe70, 0x40031af180})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 98 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40031e3ee0, {0x85cbe70, 0x40031af1d0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 916 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x40029c8300, 0x4001c4eb00)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x400370001c?, 0x40036707b0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 526
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 100 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 101 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 102 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 103 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 104 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 105 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 106 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 107 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 108 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 109 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e840)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 927 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x4001c8c040)
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 925
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:160 +0x19c

goroutine 254 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40033a2f00, 0x85cbe38?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 261
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 167 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003247e90, {0x85cbe70, 0x400327a410})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 111 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032466c0, {0x85cbe70, 0x40031af590})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 112 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032466f0, {0x85cbe70, 0x40031af5e0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 113 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003246720, {0x85cbe70, 0x40031af630})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 907 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c378, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40036a5800?, 0x400267a800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40036a5800, {0x400267a800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40036a5800, {0x400267a800?, 0x4002fe1828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77040, {0x400267a800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x40067f3b78, {0x400267a800?, 0x40067f3b78?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40036b7ea8, {0x8550b20, 0x40067f3b78})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40036b7c00, {0x854dee0?, 0x4002f77040}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40036b7c00, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40036b7c00, {0x4003142000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4002c87260, {0x4003693540, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4002c87260}, {0x4003693540, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003693540, 0x9, 0x12c06ac236?}, {0x854a860?, 0x4002c87260?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003693500)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40022c8900, 0x4002a758c0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 576
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 115 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 116 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 117 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 118 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 119 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 120 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 121 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 122 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 123 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 124 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f9e0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 861 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d5680, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40038bafc0)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 489
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 168 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003247ec0, {0x85cbe70, 0x400327a460})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 909 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c568, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40036a5700?, 0x4002679000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40036a5700, {0x4002679000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40036a5700, {0x4002679000?, 0x40037ac828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77050, {0x4002679000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x40067f3b90, {0x4002679000?, 0x40067f3b90?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x4002084628, {0x8550b20, 0x40067f3b90})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x4002084380, {0x854dee0?, 0x4002f77050}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x4002084380, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x4002084380, {0x400275e000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4002c873e0, {0x4003693620, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4002c873e0}, {0x4003693620, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003693620, 0x9, 0x12c07236dc?}, {0x854a860?, 0x4002c873e0?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40036935e0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40022c8b40, 0x4002f77e58?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 653
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 951 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002260648, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002260638)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002260630, {0x40037fa001, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40037fa001?, 0x4007c99ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40052dfa40)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40052dfa40)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40052dfa40, {0x65704e0, 0x4001bbe798})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40033af290, {0x4003071000, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001f96550, 0x4004470000?, {0x8587d88, 0x400444acc0})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x400333d220)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4002c56b00)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 256
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 243 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041d48, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003316100?, 0x400331a000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003316100, {0x400331a000, 0x8000, 0x8000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003316100, {0x400331a000?, 0x1?, 0x801010601?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f76f88, {0x400331a000?, 0xffff5dd97360?, 0x8594130?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4003312600, {0x4003202740, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003312600}, {0x4003202740, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003202740, 0x9, 0x13395f9906?}, {0x854a860?, 0x4003312600?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003202700)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4003232240, 0x0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 85
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 128 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003246f60, {0x85cbe70, 0x40031afa90})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 129 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003246f90, {0x85cbe70, 0x40031afae0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 130 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003246fc0, {0x85cbe70, 0x40031afb30})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 886 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4000112460, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a5b0)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 271
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 79 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 80 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 145 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 146 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 147 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 148 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 149 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 150 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 151 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 152 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e570)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 816 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d4870, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40038ba9a0)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 475
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 319 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4001c829c8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001c829b8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4001c829a0, 0x40033b3520)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40033ab540)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003398a68?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40032a41a0?, {0x8554bc0, 0x400351c090}, 0x1, 0x40033767e0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40032dfa40?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40033ab540, 0x40033767e0)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8c9a0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 378
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:188 +0x298

goroutine 304 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003273728?, {0x8554bc0, 0x4003331470}, 0x1, 0x40033251a0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x4003273778?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40033ad320)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 254
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 131 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003247430, {0x85cbe70, 0x40031afc70})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 132 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003247460, {0x85cbe70, 0x40031afcc0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 133 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003247490, {0x85cbe70, 0x40031afd10})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 946 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4004e94c00, 0x4000164b00)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x400365ca38?, 0x40036457b0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 734
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 135 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 136 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 137 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 138 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 139 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 140 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 141 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 142 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 143 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 144 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9fad0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 956 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x400662e780, 0x400358a400)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002de001c?, 0x4003641fb0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 295
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 795 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de36000, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521580?, 0x40036da000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521580, {0x40036da000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521580, {0x40036da000?, 0x400384e828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77aa8, {0x40036da000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4002dbd608, {0x40036da000?, 0x4002dbd608?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40035ff7a8, {0x8550b20, 0x4002dbd608})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40035ff500, {0x854dee0?, 0x4002f77aa8}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40035ff500, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40035ff500, {0x4003816000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x40036fede0, {0x40036922e0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x40036fede0}, {0x40036922e0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40036922e0, 0x9, 0xe633e6323?}, {0x854a860?, 0x40036fede0?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40036922a0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40036958c0, 0x0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 352
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 166 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003247e60, {0x85cbe70, 0x400327a3c0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 156 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400228b670, {0x85cbe70, 0x40022da9b0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 157 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400228b6a0, {0x85cbe70, 0x40022daa00})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 158 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400228b6d0, {0x85cbe70, 0x40022daa50})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 949 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x40052fa7c8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40052fa7b8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x40052fa7b0, {0x40037ca001, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40037ca001?, 0x4007c27ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40052df7c0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40052df7c0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40052df7c0, {0x65704e0, 0x4001bbe7f8})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40033af140, {0x4002f7d000, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001f96460, 0x40052c2b00?, {0x8587d88, 0x400444aec0})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x400333d1e0)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4002c569c0)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 714
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 160 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 177 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 178 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 179 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 180 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 181 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 182 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 183 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 184 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 185 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e390)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 186 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400228bf10, {0x85cbe70, 0x40022dadc0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 187 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400228bf40, {0x85cbe70, 0x40022dae10})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 188 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400228bf70, {0x85cbe70, 0x40022dae60})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 898 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fda7d0, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b960)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 99
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 190 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 191 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 192 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 193 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 194 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 195 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 196 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 197 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 198 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 199 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3fb0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 200 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032ce690, {0x85cbe70, 0x40022db090})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 201 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032ce6c0, {0x85cbe70, 0x40022db0e0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 202 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032ce6f0, {0x85cbe70, 0x40022db130})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 859 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d5590, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40038baf50)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 609
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 204 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 205 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 206 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 207 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 208 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 209 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 210 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 211 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 212 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 213 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e0c0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 996 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041a60, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40027eaf00?, 0x4006e00000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40027eaf00, {0x4006e00000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40027eaf00, {0x4006e00000?, 0x4006739830?, 0x401000301?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4000115290, {0x4006e00000?, 0x4003afebb8?, 0x18124?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4006c7c540, {0x40065f5380, 0x9, 0x400362e780?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4006c7c540}, {0x40065f5380, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40065f5380, 0x9, 0x40067f2180?}, {0x854a860?, 0x4006c7c540?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40065f5340)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x400326a340, {0x85cbe38, 0x4006d30bd0}, 0xde95160?)
	google.golang.org/[email protected]/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x400326a340}, {0x85f1f18?, 0x4000115290?})
	google.golang.org/[email protected]/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/[email protected]/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 984
	google.golang.org/[email protected]/server.go:958 +0x1d0

goroutine 855 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d4c30, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40038baa80)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 203
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 215 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 216 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 217 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 218 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 219 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 220 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 221 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 222 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 223 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 224 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e1b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 225 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032cf310, {0x85cbe70, 0x40022db720})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 226 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032cf340, {0x85cbe70, 0x40022db770})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 227 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40032cf370, {0x85cbe70, 0x40022db7c0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 971 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041968, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40025c3b00?, 0x4006b38000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40025c3b00, {0x4006b38000, 0x1000, 0x1000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40025c3b00, {0x4006b38000?, 0x40049dda58?, 0xf95dc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002960770, {0x4006b38000?, 0x40049ddaa8?, 0x4006b2cfc8?})
	net/net.go:179 +0x34
net/http.(*connReader).Read(0x4006b2cfc0, {0x4006b38000, 0x1000, 0x1000})
	net/http/server.go:791 +0x224
bufio.(*Reader).fill(0x4006b0aba0)
	bufio/bufio.go:113 +0xf8
bufio.(*Reader).Peek(0x4006b0aba0, 0x4)
	bufio/bufio.go:151 +0x60
net/http.(*conn).serve(0x40067f5c20, {0x85cbe38, 0x40037050b0})
	net/http/server.go:2044 +0x64c
created by net/http.(*Server).Serve in goroutine 667
	net/http/server.go:3086 +0x4cc

goroutine 229 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 230 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 231 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 232 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 233 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 234 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 235 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 236 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 237 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 238 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e2a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 422 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003514000)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 409
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 239 [select]:
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).deleteLoop(0x40032fe9c0, 0x83394?, 0x40032d8840?)
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:334 +0xa4
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.New in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:93 +0x26c

goroutine 299 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033bbf28?, {0x8554bc0, 0x40033312f0}, 0x1, 0x4003324f60)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40033bbf78?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40033ad440)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 265
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 257 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033b21d0, {0x85cbe70, 0x40033a2ff0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 258 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033b2200, {0x85cbe70, 0x40033a3040})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 259 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033b2230, {0x85cbe70, 0x40033a3090})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 260 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4001c82708, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001c826f8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4001c826e0, 0x40033b2a30)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40033aadc0)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40033985e8?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40032ffa00?, {0x8554bc0, 0x40033aedb0}, 0x1, 0x40032bfbc0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40032df260?, 0x3b9aca00, 0x0, 0x80?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40033aadc0, 0x40032bfbc0)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4001c822c0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 240
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:188 +0x298

goroutine 261 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8c708, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8c6f8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8c6e0, 0x4003322250)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x4003201680)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40031ddef0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40032ffba0?, {0x8554bc0, 0x40033304b0}, 0x1, 0x40032bfbc0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40031f1b30?, 0x3b9aca00, 0x0, 0x20?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x4003201680, 0x40032bfbc0)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4001c82370, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 240
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:198 +0x514

goroutine 262 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8c868, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8c858)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8c840, 0x4003322630)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40032017c0)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003342048?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40032ffd40?, {0x8554bc0, 0x4003330960}, 0x1, 0x40032bfbc0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40031f1d00?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40032017c0, 0x40032bfbc0)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4001c82420, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 240
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:209 +0x79c

goroutine 263 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4001c825a8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001c82598)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4001c82580, 0x40033b2390)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40033aab40)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003398468?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033ce000?, {0x8554bc0, 0x40033ae750}, 0x1, 0x40032bfbc0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40032def40?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40033aab40, 0x40032bfbc0)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4001c824d0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 240
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:221 +0xa04

goroutine 265 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40033a2fa0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 263
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 244 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x400327a820, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40032172d0)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 85
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 266 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 263
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 267 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x400208e1c0}, {0xffff5de359d0, 0x4001c82580}, {0x8641c30?, 0x7587920}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4000019260, {0x0?, 0x0?}, 0x40032bfbc0, 0x40033bb548?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4000019260, 0x40032bfbc0)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4001c82580?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4002233a80?, {0x8554be0, 0x40033a30e0}, 0x1, 0x40032bfbc0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4000019260, 0x40032bfbc0)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 263
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 862 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4000019260, 0x40032bfbc0, 0x4002b0d620, 0x4003694480?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 267
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 878 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4001f98048, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001f98038)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4001f98030, {0x400268c001, 0x3dff, 0x3dff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x400268c001?, 0x40078ffca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40031a6a00)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40031a6a00)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40031a6a00, {0x65704e0, 0x400305a540})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40026e4f60, {0x4002690000, 0x4000, 0x5000})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x400183c0a0, 0x400308d4d0?, {0x8587d88, 0x40045c3d40})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x40025d60a0)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001c7c9c0)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 544
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 936 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x40060ef248, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40060ef238)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x40060ef230, {0x4002b68601, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002b68601?, 0x4007c1dca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40060d7180)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40060d7180)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40060d7180, {0x65704e0, 0x400318b6e0})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40060db260, {0x40032a2400, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x400203f950, 0x4000155600?, {0x8587d88, 0x4001fe3680})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x400621c820)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x40032efa80)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 411
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 903 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de35b28, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40038da000?, 0x400264c800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40038da000, {0x400264c800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40038da000, {0x400264c800?, 0x4003686828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6170, {0x400264c800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4006810570, {0x400264c800?, 0x4006810570?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x400205e628, {0x8550b20, 0x4006810570})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x400205e380, {0x854dee0?, 0x40022c6170}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x400205e380, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x400205e380, {0x4002806000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400276a900, {0x4003693460, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400276a900}, {0x4003693460, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003693460, 0x9, 0x12bcb3341d?}, {0x854a860?, 0x400276a900?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003693420)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a758c0, 0x4003686fb0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 530
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 272 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 273 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 274 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 275 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 276 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 277 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 278 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 279 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 280 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 281 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f080)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 305 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033dff28?, {0x8554bc0, 0x40033af230}, 0x1, 0x40033c0a20)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40033dff78?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40033ad290)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 283
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 283 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40033a2eb0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 260
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 284 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 260
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 285 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x40001383c0}, {0xffff5de359d0, 0x4001c826e0}, {0x8641c30?, 0x7586360}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4000019420, {0x0?, 0x0?}, 0x40032bfbc0, 0x4003384548?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4000019420, 0x40032bfbc0)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4001c826e0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4002233cc0?, {0x8554be0, 0x40033a32c0}, 0x1, 0x40032bfbc0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4000019420, 0x40032bfbc0)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 260
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 869 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4000019420, 0x40032bfbc0, 0x40032beb40, 0x4002f77e48?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 285
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 255 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 261
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 256 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4002c56b00}, {0xffff5de359d0, 0x4002e8c6e0}, {0x8641c30?, 0x7588b40}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40032027e0, {0x0?, 0x0?}, 0x40032bfbc0, 0x40033ba548?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40032027e0, 0x40032bfbc0)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8c6e0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003153a00?, {0x8554be0, 0x400327ab40}, 0x1, 0x40032bfbc0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40032027e0, 0x40032bfbc0)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 261
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 838 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40032027e0, 0x40032bfbc0, 0x400018e840, 0x4003504fb0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 256
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 1005 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x400719e5c0)
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 983
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:160 +0x19c

goroutine 924 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002dcad80, 0x400377e400)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x400365dfc8?, 0x400375f7b0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 558
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 858 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041e40, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521d80?, 0x40037ec800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521d80, {0x40037ec800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521d80, {0x40037ec800?, 0x400385a828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6920, {0x40037ec800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4006810438, {0x40037ec800?, 0x4006810438?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40036b70a8, {0x8550b20, 0x4006810438})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40036b6e00, {0x854dee0?, 0x40022c6920}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40036b6e00, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40036b6e00, {0x4002020000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4001b29e00, {0x4003736580, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4001b29e00}, {0x4003736580, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003736580, 0x9, 0x12bc672537?}, {0x854a860?, 0x4001b29e00?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003736540)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40038d1440, 0x40038d1200?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 609
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 306 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40033ad290)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 283
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 839 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002260600, 0x400382cd00)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002260a80?, 0x0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 256
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 322 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003272728?, {0x8554bc0, 0x40033314a0}, 0x1, 0x4003325200)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x4003272778?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40033ad3b0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 293
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 293 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40033a2f50, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 262
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 294 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 262
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 295 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x40033edf40}, {0xffff5de359d0, 0x4002e8c840}, {0x8641c30?, 0x758ba60}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40032029a0, {0x0?, 0x0?}, 0x40032bfbc0, 0x40033bad48?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40032029a0, 0x40032bfbc0)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8c840?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003153a80?, {0x8554be0, 0x400327abe0}, 0x1, 0x40032bfbc0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40032029a0, 0x40032bfbc0)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 262
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 955 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40032029a0, 0x40032bfbc0, 0x400357fda0, 0x400360cfb0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 295
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 995 [select, 1 minutes]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x400326a340)
	google.golang.org/[email protected]/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 984
	google.golang.org/[email protected]/internal/transport/http2_server.go:328 +0x1338

goroutine 830 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de362e8, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521280?, 0x40036db800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521280, {0x40036db800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521280, {0x40036db800?, 0x4003863828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77aa0, {0x40036db800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400662cc30, {0x40036db800?, 0x400662cc30?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40035ff428, {0x8550b20, 0x400662cc30})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40035ff180, {0x854dee0?, 0x4002f77aa0}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40035ff180, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40035ff180, {0x4001f9c000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4003867620, {0x4003692040, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003867620}, {0x4003692040, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692040, 0x9, 0x13397609f4?}, {0x854a860?, 0x4003867620?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692000)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4003694000, 0x0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 78
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 300 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40033ad440)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 265
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 301 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003322ee0, {0x85cbe70, 0x400327af00})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 302 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003322f10, {0x85cbe70, 0x400327af50})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 303 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003322f40, {0x85cbe70, 0x400327afa0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 321 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40033ad320)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 254
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 323 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40033ad3b0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 293
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 913 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002d51cc8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002d51cb8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002d51cb0, {0x40020da001, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40020da001?, 0x4007c25ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001d49040)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001d49040)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001d49040, {0x65704e0, 0x400318a198})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40025e0600, {0x40037be800, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x40020af310, 0x4002104180?, {0x8587d88, 0x4007793a40})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001f900c0)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001abc340)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 684
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 325 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 326 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 327 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 328 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 329 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 330 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 331 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 332 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 333 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 334 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f170)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 335 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033237b0, {0x85cbe70, 0x400327b310})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 336 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033237e0, {0x85cbe70, 0x400327b360})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 337 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003323810, {0x85cbe70, 0x400327b3b0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 877 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x400284ec48, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x400284ec38)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x400284ec30, {0x4002606001, 0x3dff, 0x3dff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002606001?, 0x4007bfdca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40031a63c0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40031a63c0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40031a63c0, {0x65704e0, 0x400305a558})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40026e4ab0, {0x400261b000, 0x4000, 0x5000})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x400018d4f0, 0x400308d560?, {0x8587d88, 0x40045c3d80})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001c01dc0)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001c6e840)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 397
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 339 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 340 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 341 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 342 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 343 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 344 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 345 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 346 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 347 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 348 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f260)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 349 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003366040, {0x85cbe70, 0x400327b720})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 350 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003366070, {0x85cbe70, 0x400327b770})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 351 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033660a0, {0x85cbe70, 0x400327b7c0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 967 [select, 1 minutes]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x40031da000)
	google.golang.org/[email protected]/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 965
	google.golang.org/[email protected]/internal/transport/http2_server.go:328 +0x1338

goroutine 353 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 354 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 355 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 356 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 357 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 358 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 359 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 360 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 361 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 362 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9f350)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 363 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40033668e0, {0x85cbe70, 0x400327bb30})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 364 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003366910, {0x85cbe70, 0x400327bb80})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 365 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003366940, {0x85cbe70, 0x400327bbd0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 810 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d44b0, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40038baa10)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/[email protected]/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 825
	google.golang.org/[email protected]/internal/transport/http2_server.go:322 +0x12f8

goroutine 367 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 368 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 369 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 370 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 371 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 372 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 373 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 374 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 375 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 376 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ef90)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 377 [select]:
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).deleteLoop(0x4003375ba0, 0x83394?, 0x4003249080?)
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:334 +0xa4
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.New in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:93 +0x26c

goroutine 415 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40033e2680?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003384728?, {0x8554bc0, 0x400351cdb0}, 0x1, 0x4003540060)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40033847a8?, 0x3b9aca00, 0x0, 0x38?, 0x4003384778?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003514090)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 388
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 379 [select]:
go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping.func1()
	go.opentelemetry.io/collector/[email protected]/scraperhelper/scrapercontroller.go:174 +0x108
created by go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping in goroutine 1
	go.opentelemetry.io/collector/[email protected]/scraperhelper/scrapercontroller.go:158 +0x5c

goroutine 320 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4001c82b28, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001c82b18)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4001c82b00, 0x40033b3900)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40033ab680)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003398bb8?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033e31e0?, {0x8554bc0, 0x400351c540}, 0x1, 0x40033767e0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40032dfd00?, 0x3b9aca00, 0x0, 0x40?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40033ab680, 0x40033767e0)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8ca50, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 378
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:198 +0x514

goroutine 385 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4001c82c88, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001c82c78)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4001c82c60, 0x40033b3ce0)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40033ab7c0)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003398d08?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033e3380?, {0x8554bc0, 0x400351c9f0}, 0x1, 0x40033767e0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40032dfed0?, 0x3b9aca00, 0x0, 0x80?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40033ab7c0, 0x40033767e0)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8cb00, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 378
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:209 +0x79c

goroutine 386 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4001c82868, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001c82858)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4001c82840, 0x40033b3140)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x40033ab400)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003398918?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033e3520?, {0x8554bc0, 0x40033afbc0}, 0x1, 0x40033767e0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40032df780?, 0x3b9aca00, 0x0, 0x40?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x40033ab400, 0x40033767e0)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8cbb0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 378
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:221 +0xa04

goroutine 388 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40034993b0, 0x83394?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 386
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 389 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 386
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 390 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001abc2c0}, {0xffff5de359d0, 0x4001c82840}, {0x8641c30?, 0x7587920}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40000195e0, {0x0?, 0x0?}, 0x40033767e0, 0x40033ba548?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40000195e0, 0x40033767e0)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4001c82840?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400351a000?, {0x8554be0, 0x40033a39f0}, 0x1, 0x40033767e0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40000195e0, 0x40033767e0)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 386
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 871 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40000195e0, 0x40033767e0, 0x40033c0b40, 0x40032717b0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 390
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 1092 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8bda8, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40030f4580?, 0x40042c8000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40030f4580, {0x40042c8000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40030f4580, {0x40042c8000?, 0x40028b2be8?, 0x801000601?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40001b7700, {0x40042c8000?, 0x40028b2d38?, 0x18?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4003697020, {0x4003202200, 0x9, 0x80060?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003697020}, {0x4003202200, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003202200, 0x9, 0x40029793c8?}, {0x854a860?, 0x4003697020?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40032021c0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x40001829c0, {0x85cbe38, 0x4002de30b0}, 0xde95160?)
	google.golang.org/[email protected]/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x40001829c0}, {0x85f1f18?, 0x40001b7700?})
	google.golang.org/[email protected]/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/[email protected]/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 1089
	google.golang.org/[email protected]/server.go:958 +0x1d0

goroutine 815 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8bf98, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40036a4180?, 0x4001aec800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40036a4180, {0x4001aec800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40036a4180, {0x4001aec800?, 0x4003860828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c67a0, {0x4001aec800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4004451d10, {0x4001aec800?, 0x4004451d10?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40036b6628, {0x8550b20, 0x4004451d10})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40036b6380, {0x854dee0?, 0x40022c67a0}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40036b6380, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40036b6380, {0x4003af0000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x40038d8720, {0x40037362e0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x40038d8720}, {0x40037362e0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40037362e0, 0x9, 0xfe763fc4a?}, {0x854a860?, 0x40038d8720?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40037362a0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40038d0b40, 0x0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 475
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 417 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40033e1f28?, {0x8554bc0, 0x400351cde0}, 0x1, 0x40035400c0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40033e1f78?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40033ade60)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 395
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 395 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40034992c0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 319
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 396 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 319
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 397 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001c6e840}, {0xffff5de359d0, 0x4001c829a0}, {0x8641c30?, 0x7586360}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40000197a0, {0x0?, 0x0?}, 0x40033767e0, 0x400348ed48?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40000197a0, 0x40033767e0)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4001c829a0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400351a180?, {0x8554be0, 0x40033a3a90}, 0x1, 0x40033767e0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40000197a0, 0x40033767e0)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 319
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 917 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40000197a0, 0x40033767e0, 0x4003541500, 0x4002f77e58?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 397
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 966 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4002c2f900, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x4001cd4e00)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/[email protected]/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 965
	google.golang.org/[email protected]/internal/transport/http2_server.go:322 +0x12f8

goroutine 1001 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c470, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4002e89c00?, 0x4006ef0000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4002e89c00, {0x4006ef0000, 0x1000, 0x1000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4002e89c00, {0x4006ef0000?, 0x4003587a58?, 0xf95dc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002960cb0, {0x4006ef0000?, 0x4003587aa8?, 0x4006eee068?})
	net/net.go:179 +0x34
net/http.(*connReader).Read(0x4006eee060, {0x4006ef0000, 0x1000, 0x1000})
	net/http/server.go:791 +0x224
bufio.(*Reader).fill(0x4006d7f740)
	bufio/bufio.go:113 +0xf8
bufio.(*Reader).Peek(0x4006d7f740, 0x4)
	bufio/bufio.go:151 +0x60
net/http.(*conn).serve(0x4006b6e7e0, {0x85cbe38, 0x4002268f00})
	net/http/server.go:2044 +0x64c
created by net/http.(*Server).Serve in goroutine 64
	net/http/server.go:3086 +0x4cc

goroutine 419 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003489728?, {0x8554bc0, 0x400351ce10}, 0x1, 0x4003540120)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x4003489778?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40033adef0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 402
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 402 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x4003499310, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 320
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 403 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 320
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 404 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4002c56b80}, {0xffff5de359d0, 0x4001c82b00}, {0x8641c30?, 0x7588b40}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4000019960, {0x0?, 0x0?}, 0x40033767e0, 0x400336bd48?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4000019960, 0x40033767e0)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4001c82b00?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400351a2c0?, {0x8554be0, 0x40033a3b30}, 0x1, 0x40033767e0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4000019960, 0x40033767e0)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 320
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 836 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4000019960, 0x40033767e0, 0x400018e1e0, 0x0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 404
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 834 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c090, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40036a4080?, 0x40036dd000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40036a4080, {0x40036dd000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40036a4080, {0x40036dd000?, 0x4003aeb828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6898, {0x40036dd000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4002dbd4d0, {0x40036dd000?, 0x4002dbd4d0?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40036b6d28, {0x8550b20, 0x4002dbd4d0})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40036b6a80, {0x854dee0?, 0x40022c6898}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40036b6a80, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40036b6a80, {0x4001c5c000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4003ad1620, {0x4003692580, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003ad1620}, {0x4003692580, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692580, 0x9, 0xe61896a8b?}, {0x854a860?, 0x4003ad1620?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692540)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40036946c0, 0x0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 338
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 854 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c188, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521f80?, 0x40036de800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521f80, {0x40036de800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521f80, {0x40036de800?, 0x400385f828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6890, {0x40036de800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400305a0a8, {0x40036de800?, 0x400305a0a8?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40036b69a8, {0x8550b20, 0x400305a0a8})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40036b6700, {0x854dee0?, 0x40022c6890}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40036b6700, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40036b6700, {0x4001fbe000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x40038d9da0, {0x40037363c0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x40038d9da0}, {0x40037363c0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40037363c0, 0x9, 0xe59f6ef2a?}, {0x854a860?, 0x40038d9da0?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003736380)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40038d1200, 0x40038d0900?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 203
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 421 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400348af28?, {0x8554bc0, 0x400351ce40}, 0x1, 0x4003540180)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x400348af78?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003514000)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 409
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 409 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x4003499360, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 385
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 410 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 385
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 411 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x40032efa80}, {0xffff5de359d0, 0x4001c82c60}, {0x8641c30?, 0x758ba60}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4000019b20, {0x0?, 0x0?}, 0x40033767e0, 0x40033bad48?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4000019b20, 0x40033767e0)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4001c82c60?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400351a340?, {0x8554be0, 0x40033a3bd0}, 0x1, 0x40033767e0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4000019b20, 0x40033767e0)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 385
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 932 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4000019b20, 0x40033767e0, 0x4005742fc0, 0x4001c83c30?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 411
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 885 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de365d0, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520d00?, 0x4002676000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520d00, {0x4002676000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520d00, {0x4002676000?, 0x4003854828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e60, {0x4002676000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400305abb8, {0x4002676000?, 0x400305abb8?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cd0a8, {0x8550b20, 0x400305abb8})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cce00, {0x854dee0?, 0x4002f77e60}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cce00, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cce00, {0x4002b58000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400276af60, {0x4003692c80, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400276af60}, {0x4003692c80, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692c80, 0x9, 0xe657e694c?}, {0x854a860?, 0x400276af60?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692c40)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74240, 0x40038d1680?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 271
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 832 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041f38, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521e80?, 0x40037e8000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521e80, {0x40037e8000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521e80, {0x40037e8000?, 0x40038a7828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77af0, {0x40037e8000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4006821140, {0x40037e8000?, 0x4006821140?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40035ffea8, {0x8550b20, 0x4006821140})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40035ffc00, {0x854dee0?, 0x4002f77af0}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40035ffc00, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40035ffc00, {0x40024ea000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4003ad1080, {0x4003692120, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003ad1080}, {0x4003692120, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692120, 0x9, 0x13398fe69a?}, {0x854a860?, 0x4003ad1080?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40036920e0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4003694480, 0x0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 114
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 416 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003514090)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 388
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 418 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40033ade60)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 395
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 420 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40033adef0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 402
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 888 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4000112550, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b7a0)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 189
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 948 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x40052fa780, 0x400382de00)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4001c8c040?, 0x0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 714
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 380 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003367700, {0x85cbe70, 0x4003499400})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 381 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003367730, {0x85cbe70, 0x4003499450})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 382 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003367760, {0x85cbe70, 0x40034994a0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 894 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fda230, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b880)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 159
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 384 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 433 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 434 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 435 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 436 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 437 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 438 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 439 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 440 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 441 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ec00)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 442 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003367f90, {0x85cbe70, 0x4003499810})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 443 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003367fc0, {0x85cbe70, 0x4003499860})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 444 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003367ff0, {0x85cbe70, 0x40034998b0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 944 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c758, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4001cab100?, 0x400646a000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4001cab100, {0x400646a000, 0xa000, 0xa000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4001cab100, {0x400646a000?, 0x40035c9828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f76d20, {0x400646a000?, 0x40035c9878?, 0x25acbc?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4001bbe978, {0x400646a000?, 0x4001bbe978?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x4001fb1b28, {0x8550b20, 0x4001bbe978})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x4001fb1880, {0x854dee0?, 0x4002f76d20}, 0xa000?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x4001fb1880, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x4001fb1880, {0x4002cb4000, 0x1000, 0x2f4c8c?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400622d5c0, {0x40060e0c80, 0x9, 0xddb2030?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400622d5c0}, {0x40060e0c80, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
net/http.http2readFrameHeader({0x40060e0c80, 0x9, 0x40067b34a0?}, {0x854a860?, 0x400622d5c0?})
	net/http/h2_bundle.go:1635 +0x58
net/http.(*http2Framer).ReadFrame(0x40060e0c40)
	net/http/h2_bundle.go:1899 +0x78
net/http.(*http2clientConnReadLoop).run(0x40035c9f88)
	net/http/h2_bundle.go:9339 +0xf8
net/http.(*http2ClientConn).readLoop(0x40060ef380)
	net/http/h2_bundle.go:9234 +0x5c
created by net/http.(*http2Transport).newClientConn in goroutine 943
	net/http/h2_bundle.go:7906 +0xabc

goroutine 446 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 447 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 448 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

@tdarwin
Copy link
Author

tdarwin commented Feb 15, 2024

Log output part 2


goroutine 465 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 466 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 467 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 468 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 469 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 470 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 471 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e660)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 472 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c6700, {0x85cbe70, 0x4003499ae0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 473 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c6730, {0x85cbe70, 0x4003499b30})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 474 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c6760, {0x85cbe70, 0x4003499b80})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 846 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041398, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40035fdf00?, 0x400264b000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40035fdf00, {0x400264b000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40035fdf00, {0x400264b000?, 0x4003aed828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6160, {0x400264b000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4006810450, {0x400264b000?, 0x4006810450?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x400205e2a8, {0x8550b20, 0x4006810450})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x400205e000, {0x854dee0?, 0x40022c6160}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x400205e000, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x400205e000, {0x400285a000, 0x8000, 0x1f7dc?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400276aa20, {0x4003692820, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400276aa20}, {0x4003692820, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692820, 0x9, 0x12bc714c5c?}, {0x854a860?, 0x400276aa20?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40036927e0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40001638c0, 0x0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 623
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 476 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 477 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 478 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 479 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 480 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 481 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 482 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 483 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 484 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 485 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9e930)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 486 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c6f90, {0x85cbe70, 0x4003499ef0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 487 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c6fc0, {0x85cbe70, 0x4003499f40})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 488 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c6ff0, {0x85cbe70, 0x4003499f90})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 864 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4001d57848, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4001d57838)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4001d57830, {0x4003091201, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4003091201?, 0x4007c33ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x400011e640)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x400011e640)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x400011e640, {0x65704e0, 0x400306d5d8})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x4001ab1620, {0x40037bf800, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x40020af040, 0x40021b6180?, {0x8587d88, 0x400786f900})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x400012a8c0)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x400208e1c0)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 267
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 490 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 491 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 492 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 493 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 494 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 495 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 496 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 497 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 498 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 499 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9ea20)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 500 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c7820, {0x85cbe70, 0x40034ee320})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 501 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c7850, {0x85cbe70, 0x40034ee370})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 502 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40034c7880, {0x85cbe70, 0x40034ee3c0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 904 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fdaa50, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383ba40)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 530
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 912 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002c46948, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002c46938)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002c46930, {0x4003090c01, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4003090c01?, 0x400364fca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001d48f00)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001d48f00)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001d48f00, {0x65704e0, 0x400306d578})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40025e0570, {0x40037be400, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x40020af2c0, 0x40021b6000?, {0x8587d88, 0x400786f100})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001f900a0)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001abc2c0)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 390
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 914 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x400284e1c8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x400284e1b8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x400284e1b0, {0x4002b68001, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002b68001?, 0x40033d7ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001d49400)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001d49400)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001d49400, {0x65704e0, 0x400318b620})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40025e0930, {0x40037bec00, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x40020af360, 0x4002104600?, {0x8587d88, 0x4001fe3600})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001f90280)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001abc680)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 694
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 504 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 505 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 506 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 507 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 508 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 509 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 510 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 511 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 512 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 513 [chan receive, 1 minutes]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002e9eb10)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 896 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fda690, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b8f0)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 134
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 514 [select]:
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).deleteLoop(0x4003588b60, 0x83394?, 0x40034f02c0?)
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:334 +0xa4
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.New in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:93 +0x26c

goroutine 950 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4004e94c48, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4004e94c38)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4004e94c30, {0x4002b68c01, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002b68c01?, 0x4007c09ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40052df900)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40052df900)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40052df900, {0x65704e0, 0x400318b770})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40033af1d0, {0x4003070c00, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001f96500, 0x4000155700?, {0x8587d88, 0x4001fe3700})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x400333d200)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4002c56a80)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 734
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 973 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d45a0, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x4001ca3650)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/[email protected]/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 828
	google.golang.org/[email protected]/internal/transport/http2_server.go:322 +0x12f8

goroutine 968 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041490, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40025c2580?, 0x4006a80000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40025c2580, {0x4006a80000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40025c2580, {0x4006a80000?, 0x4006811a40?, 0x801000601?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002960698, {0x4006a80000?, 0x4006811e30?, 0x18?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4006831da0, {0x40060e19a0, 0x9, 0x80060?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4006831da0}, {0x40060e19a0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40060e19a0, 0x9, 0x4002cf6768?}, {0x854a860?, 0x4006831da0?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40060e1960)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x40031da000, {0x85cbe38, 0x40068a33e0}, 0xde95160?)
	google.golang.org/[email protected]/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x40031da000}, {0x85f1f18?, 0x4002960698?})
	google.golang.org/[email protected]/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/[email protected]/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 965
	google.golang.org/[email protected]/server.go:958 +0x1d0

goroutine 811 [select, 1 minutes]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x40036aaea0)
	google.golang.org/[email protected]/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 825
	google.golang.org/[email protected]/internal/transport/http2_server.go:328 +0x1338

goroutine 876 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x40029c8348, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40029c8338)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x40029c8330, {0x40037fa601, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40037fa601?, 0x4007c89ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40031a6280)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40031a6280)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40031a6280, {0x65704e0, 0x4001bbe7b0})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40026e4a20, {0x4003ad3c00, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x400018d4a0, 0x40021b6300?, {0x8587d88, 0x400444ad40})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001c01da0)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001c6e7c0)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 526
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 562 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035abf28?, {0x8554bc0, 0x40035c56e0}, 0x1, 0x4003600300)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40035abf78?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40035b4120)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 524
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 516 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400359c650, {0x85cbe70, 0x40034efbd0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 517 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400359c680, {0x85cbe70, 0x40034efc20})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 518 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400359c6b0, {0x85cbe70, 0x40034efc70})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 519 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8d0a8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8d098)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8d080, 0x400359cea0)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400359b860)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40033433e0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003589d40?, {0x8554bc0, 0x40035c4300}, 0x1, 0x40034fc780)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40035a25c0?, 0x3b9aca00, 0x0, 0x80?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400359b860, 0x40034fc780)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8cc60, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 515
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:188 +0x298

goroutine 520 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8d208, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8d1f8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8d1e0, 0x400359d280)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400359b9a0)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003343530?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035b6000?, {0x8554bc0, 0x40035c47b0}, 0x1, 0x40034fc780)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40035a2880?, 0x3b9aca00, 0x0, 0xe0?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400359b9a0, 0x40034fc780)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8cd10, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 515
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:198 +0x514

goroutine 521 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8d368, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8d358)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8d340, 0x400359d660)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400359bae0)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003343680?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035b61a0?, {0x8554bc0, 0x40035c4c60}, 0x1, 0x40034fc780)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40035a2a50?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400359bae0, 0x40034fc780)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8cdc0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 515
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:209 +0x79c

goroutine 522 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8cf48, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8cf38)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8cf20, 0x400359c810)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400359b5e0)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003343260?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035b6340?, {0x8554bc0, 0x4003597ce0}, 0x1, 0x40034fc780)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40035a22b0?, 0x3b9aca00, 0x0, 0x80?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400359b5e0, 0x40034fc780)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8ce70, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 515
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:221 +0xa04

goroutine 524 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40034efb80, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 522
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 525 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 522
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 526 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001c6e7c0}, {0xffff5de359d0, 0x4002e8cf20}, {0x8641c30?, 0x7587920}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003202ee0, {0x0?, 0x0?}, 0x40034fc780, 0x40035ab548?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003202ee0, 0x40034fc780)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8cf20?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337cc80?, {0x8554be0, 0x40034efcc0}, 0x1, 0x40034fc780)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003202ee0, 0x40034fc780)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 522
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 915 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003202ee0, 0x40034fc780, 0x4003540600, 0x4003694480?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 526
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 975 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de35c20, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40035fdc00?, 0x4003c80000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40035fdc00, {0x4003c80000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40035fdc00, {0x4003c80000?, 0x400384cb80?, 0x17ad4?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77f10, {0x4003c80000?, 0x40068113f8?, 0x4001cc1da0?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x40038d8360, {0x4003736200, 0x9, 0x80060?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x40038d8360}, {0x4003736200, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003736200, 0x9, 0x4002cf6210?}, {0x854a860?, 0x40038d8360?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40037361c0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x40036ab040, {0x85cbe38, 0x4006b66630}, 0xde95160?)
	google.golang.org/[email protected]/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x40036ab040}, {0x85f1f18?, 0x4002f77f10?})
	google.golang.org/[email protected]/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/[email protected]/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 828
	google.golang.org/[email protected]/server.go:958 +0x1d0

goroutine 974 [select, 1 minutes]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x40036ab040)
	google.golang.org/[email protected]/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 828
	google.golang.org/[email protected]/internal/transport/http2_server.go:328 +0x1338

goroutine 908 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fdad70, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383bb90)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 576
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 531 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 532 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 533 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 534 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 535 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 536 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 537 [runnable]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 538 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 539 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 540 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de36b0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 570 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035d5f28?, {0x8554bc0, 0x40035c5950}, 0x1, 0x4003600600)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40035d5f78?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40035a1ef0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 542
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 542 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40034efa90, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 519
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 543 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 519
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 544 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001c7c9c0}, {0xffff5de359d0, 0x4002e8d080}, {0x8641c30?, 0x7586360}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40032030a0, {0x0?, 0x0?}, 0x40034fc780, 0x40034f8548?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40032030a0, 0x40034fc780)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8d080?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337cec0?, {0x8554be0, 0x40034efea0}, 0x1, 0x40034fc780)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40032030a0, 0x40034fc780)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 519
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 919 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40032030a0, 0x40034fc780, 0x400370a780, 0x40036707b0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 544
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 895 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de367c0, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520a00?, 0x4002648000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520a00, {0x4002648000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520a00, {0x4002648000?, 0x4003859828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e50, {0x4002648000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400662cf00, {0x4002648000?, 0x400662cf00?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cc9a8, {0x8550b20, 0x400662cf00})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cc700, {0x854dee0?, 0x4002f77e50}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cc700, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cc700, {0x4002fa8000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4002c86180, {0x4003693000, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4002c86180}, {0x4003693000, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003693000, 0x9, 0x133d888208?}, {0x854a860?, 0x4002c86180?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692fc0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74b40, 0x0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 134
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 897 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041778, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40036a5000?, 0x4002649800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40036a5000, {0x4002649800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40036a5000, {0x4002649800?, 0x40035cb828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e48, {0x4002649800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400662cee8, {0x4002649800?, 0x400662cee8?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cc628, {0x8550b20, 0x400662cee8})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cc380, {0x854dee0?, 0x4002f77e48}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cc380, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cc380, {0x4002fb0000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4002c86300, {0x40036930e0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4002c86300}, {0x40036930e0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40036930e0, 0x9, 0x133d6ef597?}, {0x854a860?, 0x4002c86300?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40036930a0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74d80, 0x0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 99
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 572 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035d7728?, {0x8554bc0, 0x40035c5980}, 0x1, 0x4003600660)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40035d7778?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40035b4000)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 549
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 549 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40034efae0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 520
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 550 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 520
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 551 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4000138f40}, {0xffff5de359d0, 0x4002e8d1e0}, {0x8641c30?, 0x7588b40}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003203260, {0x0?, 0x0?}, 0x40034fc780, 0x40035aa548?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003203260, 0x40034fc780)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8d1e0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337d000?, {0x8554be0, 0x40034eff40}, 0x1, 0x40034fc780)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003203260, 0x40034fc780)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 520
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 865 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003203260, 0x40034fc780, 0x40000bd200, 0x4002f77e50?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 551
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 814 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40038d4780, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40038ba930)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 214
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 812 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de369b0, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40035fdb80?, 0x4002300000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40035fdb80, {0x4002300000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40035fdb80, {0x4002300000?, 0x40067f2bd0?, 0x801000601?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e80, {0x4002300000?, 0x40067f31b8?, 0x18?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4003ad0ea0, {0x4003736040, 0x9, 0x80060?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003ad0ea0}, {0x4003736040, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003736040, 0x9, 0x4002ca92c0?}, {0x854a860?, 0x4003ad0ea0?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003736000)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x40036aaea0, {0x85cbe38, 0x40038c7350}, 0xde95160?)
	google.golang.org/[email protected]/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x40036aaea0}, {0x85f1f18?, 0x4002f77e80?})
	google.golang.org/[email protected]/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/[email protected]/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 825
	google.golang.org/[email protected]/server.go:958 +0x1d0

goroutine 574 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40035d0f28?, {0x8554bc0, 0x40035c59b0}, 0x1, 0x40036006c0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x40035d0f78?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40035b4090)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 556
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 556 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40034efb30, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 521
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 557 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 521
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 558 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x400260f9c0}, {0xffff5de359d0, 0x4002e8d340}, {0x8641c30?, 0x758ba60}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003203420, {0x0?, 0x0?}, 0x40034fc780, 0x40035aad48?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003203420, 0x40034fc780)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8d340?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337d080?, {0x8554be0, 0x40035ec000}, 0x1, 0x40034fc780)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003203420, 0x40034fc780)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 521
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 923 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003203420, 0x40034fc780, 0x400379d560, 0x400366c7b0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 558
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 796 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d0a00, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40036c7420)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 352
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 794 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d0910, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40036c73b0)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 228
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 563 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40035b4120)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 524
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 884 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4000112370, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a540)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 445
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 809 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d1310, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b730)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 366
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 899 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de364d8, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520e00?, 0x4002677800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520e00, {0x4002677800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520e00, {0x4002677800?, 0x4003865828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e58, {0x4002677800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400305abd0, {0x4002677800?, 0x400305abd0?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037ccd28, {0x8550b20, 0x400305abd0})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cca80, {0x854dee0?, 0x4002f77e58}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cca80, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cca80, {0x4002fba000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4002c86480, {0x40036931c0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4002c86480}, {0x40036931c0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40036931c0, 0x9, 0xe65c13cef?}, {0x854a860?, 0x4002c86480?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003693180)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74fc0, 0x4002a74000?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 324
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 578 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041588, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003316680?, 0x400189e000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003316680, {0x400189e000, 0xc000, 0xc000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003316680, {0x400189e000?, 0x40032f3828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c64b0, {0x400189e000?, 0x40032f3798?, 0x26908?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400305a528, {0x400189e000?, 0x400305a528?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40032dd7a8, {0x8550b20, 0x400305a528})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40032dd500, {0x854dee0?, 0x40022c64b0}, 0xc000?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40032dd500, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40032dd500, {0x400356d000, 0x1000, 0x40038fc0a3?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400355da40, {0x4000019ee0, 0x9, 0xa8?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400355da40}, {0x4000019ee0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4000019ee0, 0x9, 0x6a0d500?}, {0x854a860?, 0x400355da40?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4000019ea0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
golang.org/x/net/http2.(*clientConnReadLoop).run(0x40032f3f88)
	golang.org/x/[email protected]/http2/transport.go:2275 +0xf8
golang.org/x/net/http2.(*ClientConn).readLoop(0x4002260a80)
	golang.org/x/[email protected]/http2/transport.go:2170 +0x5c
created by golang.org/x/net/http2.(*Transport).newClientConn in goroutine 577
	golang.org/x/[email protected]/http2/transport.go:821 +0xabc

goroutine 567 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400359def0, {0x85cbe70, 0x40035ec410})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 568 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400359df20, {0x85cbe70, 0x40035ec460})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 569 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x400359df50, {0x85cbe70, 0x40035ec4b0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 571 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40035a1ef0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 542
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 573 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40035b4000)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 549
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 575 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40035b4090)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 556
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 863 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4001d57800, 0x4001c86b00)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002260a80?, 0x0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 267
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 911 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x40029c99c8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40029c99b8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x40029c99b0, {0x40038ea001, 0x3dff, 0x3dff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40038ea001?, 0x4007c19ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001d48c80)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001d48c80)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001d48c80, {0x65704e0, 0x4002dbccd8})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40025e0480, {0x4002bb1000, 0x4000, 0x5000})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x40020af220, 0x4002ed81b0?, {0x8587d88, 0x40044dcf80})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001f90080)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001abc240)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 702
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 593 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 594 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 595 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 596 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 597 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 598 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 599 [runnable]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 600 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 601 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 870 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002c46480, 0x40001c1b00)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002260a80?, 0x0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 285
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 602 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3890)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 952 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x40022601c8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x40022601b8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x40022601b0, {0x40020da601, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40020da601?, 0x4007c21ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40052dfb80)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40052dfb80)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40052dfb80, {0x65704e0, 0x400318b590})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40033af3e0, {0x4003071400, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001f96640, 0x4002cc7a00?, {0x8587d88, 0x4001fe3500})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x400333d2a0)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4002c56b80)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 404
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 928 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002dcadc8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002dcadb8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002dcadb0, {0x40037fac01, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40037fac01?, 0x4003585ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40045ea3c0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40045ea3c0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40045ea3c0, {0x65704e0, 0x4001bbe7c8})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x4002d42090, {0x40037bf000, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001f03810, 0x40052c2900?, {0x8587d88, 0x400444adc0})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4002ab2180)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x400260f9c0)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 558
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 872 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002c46900, 0x4001c4e900)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002260a80?, 0x0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 390
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 803 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d0f00, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a620)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 503
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 802 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041b58, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521180?, 0x40031e5800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521180, {0x40031e5800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521180, {0x40031e5800?, 0x40038a6828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6720, {0x40031e5800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4004451dd0, {0x40031e5800?, 0x4004451dd0?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x4003557b28, {0x8550b20, 0x4004451dd0})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x4003557880, {0x854dee0?, 0x40022c6720}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x4003557880, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x4003557880, {0x400383e000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4003827d40, {0x40036923c0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003827d40}, {0x40036923c0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40036923c0, 0x9, 0xfe7973837?}, {0x854a860?, 0x4003827d40?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692380)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4003695b00, 0x0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 503
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 918 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x400284ec00, 0x40025f2300)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x400370001c?, 0x40036707b0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 397
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 837 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002260180, 0x400382ca00)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002260a80?, 0x0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 404
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 931 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002260948, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002260938)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002260930, {0x4003091801, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4003091801?, 0x4007c13ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40054a5400)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40054a5400)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40054a5400, {0x65704e0, 0x4001bbe780})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x400351d530, {0x40032a2000, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x400183c550, 0x40031abf80?, {0x8587d88, 0x400444ac80})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x40032346c0)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4002a3f100)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 728
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 875 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002c46048, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002c46038)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002c46030, {0x40025d0001, 0x3dff, 0x3dff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40025d0001?, 0x4007c83ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4002591b80)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4002591b80)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4002591b80, {0x65704e0, 0x4002dbccf0})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40026e4510, {0x4002616000, 0x4000, 0x5000})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x400018d400, 0x4002ed8240?, {0x8587d88, 0x40044dcfc0})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4001c01ae0)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4001c6e0c0)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 722
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 920 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4001f98000, 0x40025f2900)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x400365c998?, 0x4003671fb0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 544
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 866 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4000069500, 0x4001c87f00)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002260a80?, 0x0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 551
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 606 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003602830, {0x85cbe70, 0x40035ec960})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 607 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003602860, {0x85cbe70, 0x40035ec9b0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 608 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003602890, {0x85cbe70, 0x40035eca00})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 860 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de35e10, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521780?, 0x40031e8800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521780, {0x40031e8800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521780, {0x40031e8800?, 0x4003864828?, 0x155?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77ab0, {0x40031e8800?, 0x21?, 0xffff5de09850?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4004451de8, {0x40031e8800?, 0x4004451de8?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40035ffb28, {0x8550b20, 0x4004451de8})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40035ff880, {0x854dee0?, 0x4002f77ab0}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40035ff880, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40035ff880, {0x400215a000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4001c047e0, {0x4003736740, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4001c047e0}, {0x4003736740, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003736740, 0x9, 0xfe79cb175?}, {0x854a860?, 0x4001c047e0?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003736700)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40038d1680, 0x4003694000?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 489
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 610 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 611 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 612 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 613 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 614 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 615 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 617 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 618 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 619 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3980)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 620 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003603120, {0x85cbe70, 0x40035ecdc0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 621 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003603150, {0x85cbe70, 0x40035ece10})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 622 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003603180, {0x85cbe70, 0x40035ece60})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 848 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4002c464c8, 0x2)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002c464b8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4002c464b0, {0x4002818001, 0x3dff, 0x3dff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002818001?, 0x4007c97ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001fd37c0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001fd37c0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001fd37c0, {0x65704e0, 0x400318b4e8})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x400212dfb0, {0x4002bac000, 0x4000, 0x5000})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4000112190, 0x4002ed8120?, {0x8587d88, 0x4001fe34c0})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4003ac1ac0)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x40001383c0)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 285
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 624 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 641 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 642 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 643 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 644 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 645 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 646 [running]:
	goroutine running on other thread; stack unavailable
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 647 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 648 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 649 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 650 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40036039b0, {0x85cbe70, 0x40035ed1d0})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 651 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x40036039e0, {0x85cbe70, 0x40035ed220})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 652 [select, 1 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0x4003603a10, {0x85cbe70, 0x40035ed270})
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0xc8
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1
	google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x134

goroutine 925 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de35d18, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40038da400?, 0x4002801000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x40038da400, {0x4002801000, 0x1000, 0x1000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x40038da400, {0x4002801000?, 0x4004df9a58?, 0xf95dc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4000114670, {0x4002801000?, 0x4004df9aa8?, 0x400282c308?})
	net/net.go:179 +0x34
net/http.(*connReader).Read(0x400282c300, {0x4002801000, 0x1000, 0x1000})
	net/http/server.go:791 +0x224
bufio.(*Reader).fill(0x400276acc0)
	bufio/bufio.go:113 +0xf8
bufio.(*Reader).Peek(0x400276acc0, 0x4)
	bufio/bufio.go:151 +0x60
net/http.(*conn).serve(0x400307e6c0, {0x85cbe38, 0x40037050b0})
	net/http/server.go:2044 +0x64c
created by net/http.(*Server).Serve in goroutine 667
	net/http/server.go:3086 +0x4cc

goroutine 654 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 655 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 656 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 657 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 658 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 659 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 660 [runnable]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 661 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 662 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 663 [chan receive]:
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de37a0)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:51 +0x40
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

goroutine 664 [select]:
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).deleteLoop(0x4003650820, 0x83394?, 0x40034f1340?)
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:334 +0xa4
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.New in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:93 +0x26c

goroutine 717 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400366cf28?, {0x8554bc0, 0x400377cc30}, 0x1, 0x400379c120)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x400366cf78?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40037025a0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 682
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 666 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041870, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40035fca00?, 0x0?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0x40035fca00)
	internal/poll/fd_unix.go:611 +0x250
net.(*netFD).accept(0x40035fca00)
	net/fd_unix.go:172 +0x28
net.(*TCPListener).accept(0x4003647940)
	net/tcpsock_posix.go:152 +0x28
net.(*TCPListener).Accept(0x4003647940)
	net/tcpsock.go:315 +0x2c
google.golang.org/grpc.(*Server).Serve(0x400358ca00, {0x85ab140?, 0x4003647940})
	google.golang.org/[email protected]/server.go:885 +0x458
go.opentelemetry.io/collector/receiver/otlpreceiver.(*otlpReceiver).startGRPCServer.func1()
	go.opentelemetry.io/collector/receiver/[email protected]/otlp.go:112 +0x64
created by go.opentelemetry.io/collector/receiver/otlpreceiver.(*otlpReceiver).startGRPCServer in goroutine 1
	go.opentelemetry.io/collector/receiver/[email protected]/otlp.go:109 +0x4dc

goroutine 667 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0xffff5dd8c280, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x40035fca80?, 0x0?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0x40035fca80)
	internal/poll/fd_unix.go:611 +0x250
net.(*netFD).accept(0x40035fca80)
	net/fd_unix.go:172 +0x28
net.(*TCPListener).accept(0x4003647a40)
	net/tcpsock_posix.go:152 +0x28
net.(*TCPListener).Accept(0x4003647a40)
	net/tcpsock.go:315 +0x2c
net/http.(*Server).Serve(0x4001d5ac30, {0x85ab140, 0x4003647a40})
	net/http/server.go:3056 +0x2b8
go.opentelemetry.io/collector/receiver/otlpreceiver.(*otlpReceiver).startHTTPServer.func4()
	go.opentelemetry.io/collector/receiver/[email protected]/otlp.go:162 +0x64
created by go.opentelemetry.io/collector/receiver/otlpreceiver.(*otlpReceiver).startHTTPServer in goroutine 1
	go.opentelemetry.io/collector/receiver/[email protected]/otlp.go:159 +0x58c

goroutine 668 [select]:
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).deleteLoop(0x4003651380, 0x0?, 0x0?)
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:334 +0xa4
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.New in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:93 +0x26c

goroutine 737 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40035418c0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400366c728?, {0x8554bc0, 0x400377cc60}, 0x1, 0x400379c180)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x400366c778?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003702c60)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 692
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 670 [chan receive, 1 minutes]:
github.com/prometheus/prometheus/discovery.(*Manager).Run(0x4002e8da20)
	github.com/prometheus/[email protected]/discovery/manager.go:183 +0x78
github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver.(*pReceiver).initPrometheusComponents.func1()
	github.com/open-telemetry/opentelemetry-collector-contrib/receiver/[email protected]/metrics_receiver.go:241 +0x54
created by github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver.(*pReceiver).initPrometheusComponents in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/receiver/[email protected]/metrics_receiver.go:239 +0xc0

goroutine 671 [select, 1 minutes]:
github.com/prometheus/prometheus/scrape.(*Manager).Run(0x400362f7a0, 0x4003601f80)
	github.com/prometheus/[email protected]/scrape/manager.go:167 +0xc4
github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver.(*pReceiver).initPrometheusComponents.func2()
	github.com/open-telemetry/opentelemetry-collector-contrib/receiver/[email protected]/metrics_receiver.go:283 +0x6c
created by github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver.(*pReceiver).initPrometheusComponents in goroutine 1
	github.com/open-telemetry/opentelemetry-collector-contrib/receiver/[email protected]/metrics_receiver.go:279 +0x4c8

goroutine 739 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x400370ade0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003671f28?, {0x8554bc0, 0x400377cc90}, 0x1, 0x400379c1e0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003671f18?, 0x3b9aca00, 0x0, 0x38?, 0x4003671f78?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x40037023f0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 700
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 674 [chan receive, 1 minutes]:
github.com/prometheus/prometheus/discovery.(*Manager).updater(0x4002e8da20, {0x85cbe70, 0x40037082d0}, 0x4003675030, 0x400370a180)
	github.com/prometheus/[email protected]/discovery/manager.go:323 +0x328
created by github.com/prometheus/prometheus/discovery.(*Manager).startProvider in goroutine 1
	github.com/prometheus/[email protected]/discovery/manager.go:294 +0x358

goroutine 676 [syscall, 1 minutes]:
os/signal.signal_recv()
	runtime/sigqueue.go:152 +0x30
os/signal.loop()
	os/signal/signal_unix.go:23 +0x1c
created by os/signal.Notify.func1.1 in goroutine 1
	os/signal/signal.go:151 +0x28

goroutine 677 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8dc58, 0x2)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8dc48)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8dc30, 0x4003655c00)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f720)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003666b28?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003714820?, {0x8554bc0, 0x4003705620}, 0x1, 0x4003601d40)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003676e90?, 0x3b9aca00, 0x0, 0x80?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f720, 0x4003601d40)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d4a0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 665
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:188 +0x298

goroutine 678 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8dd08, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8dcf8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8dce0, 0x4003655f70)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f7c0)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003666c60?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x40037149c0?, {0x8554bc0, 0x4003705a10}, 0x1, 0x4003601d40)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003677110?, 0x3b9aca00, 0x0, 0xc0?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f7c0, 0x4003601d40)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d550, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 665
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:198 +0x514

goroutine 679 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8ddb8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8dda8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8dd90, 0x400376c2e0)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f860)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003666d98?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003714b60?, {0x8554bc0, 0x4003705e00}, 0x1, 0x4003601d40)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003677290?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f860, 0x4003601d40)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d600, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 665
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:209 +0x79c

goroutine 680 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8daf8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8dae8)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8dad0, 0x4003655280)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f540)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40036667c8?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003714d00?, {0x8554bc0, 0x4003704c00}, 0x1, 0x4003601d40)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003676960?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f540, 0x4003601d40)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d6b0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 665
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:221 +0xa04

goroutine 682 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x400365ca50, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 680
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 683 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 680
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 684 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001abc340}, {0xffff5de359d0, 0x4002e8dad0}, {0x8641c30?, 0x7587920}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003203ea0, {0x0?, 0x0?}, 0x4003601d40, 0x400366c548?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003203ea0, 0x4003601d40)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8dad0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337db80?, {0x8554be0, 0x4003708370}, 0x1, 0x4003601d40)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003203ea0, 0x4003601d40)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 680
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 901 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003203ea0, 0x4003601d40, 0x40033775c0, 0x0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 684
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 902 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002d51c80, 0x400382dd00)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x0?, 0x400366c708?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 684
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 687 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8de68, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8de58)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8de40, 0x400376c5d0)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f900)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003666f00?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003715860?, {0x8554bc0, 0x400377c150}, 0x1, 0x4003601ec0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003677400?, 0x3b9aca00, 0x0, 0x0?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f900, 0x4003601ec0)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d760, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 669
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:188 +0x298

goroutine 688 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8df18, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8df08)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8def0, 0x400376c940)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f9a0)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003667038?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003715a00?, {0x8554bc0, 0x400377c540}, 0x1, 0x4003601ec0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003677670?, 0x3b9aca00, 0x0, 0xe0?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f9a0, 0x4003601ec0)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d810, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 669
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:198 +0x514

goroutine 689 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4003794028, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4003794018)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4003794000, 0x400376ccb0)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367fa40)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003667170?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003715ba0?, {0x8554bc0, 0x400377c930}, 0x1, 0x4003601ec0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x40036777f0?, 0x3b9aca00, 0x0, 0x80?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367fa40, 0x4003601ec0)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d8c0, 0x400366f7b0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 669
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:209 +0x79c

goroutine 690 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0x4002e8dba8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4002e8db98)
	sync/cond.go:70 +0xcc
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0x4002e8db80, 0x40036557d0)
	k8s.io/[email protected]/tools/cache/delta_fifo.go:575 +0x1dc
k8s.io/client-go/tools/cache.(*controller).processLoop(0x400367f680)
	k8s.io/[email protected]/tools/cache/controller.go:188 +0x3c
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40036669a8?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003715d40?, {0x8554bc0, 0x40037051d0}, 0x1, 0x4003601ec0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x4003676c20?, 0x3b9aca00, 0x0, 0xc0?, 0xffff5de359d0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0x400367f680, 0x4003601ec0)
	k8s.io/[email protected]/tools/cache/controller.go:159 +0x2d0
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0x4002e8d970, 0x400366efb0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:504 +0x264
created by github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sattributesprocessor/internal/kube.(*WatchClient).Start in goroutine 669
	github.com/open-telemetry/opentelemetry-collector-contrib/processor/[email protected]/internal/kube/client.go:221 +0xa04

goroutine 692 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x40037080a0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 690
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 693 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 690
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 694 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001abc680}, {0xffff5de359d0, 0x4002e8db80}, {0x8641c30?, 0x7587920}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40037360e0, {0x0?, 0x0?}, 0x4003601ec0, 0x400366ed48?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40037360e0, 0x4003601ec0)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8db80?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337dd40?, {0x8554be0, 0x40037084b0}, 0x1, 0x4003601ec0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40037360e0, 0x4003601ec0)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 690
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 905 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40037360e0, 0x4003601ec0, 0x40034fdf80, 0x0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 694
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 906 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x400284e180, 0x40021d2600)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x0?, 0x400366ef08?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 694
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 697 [select]:
github.com/prometheus/prometheus/discovery.(*Manager).sender(0x4002e8da20)
	github.com/prometheus/[email protected]/discovery/manager.go:346 +0xa4
created by github.com/prometheus/prometheus/discovery.(*Manager).Run in goroutine 670
	github.com/prometheus/[email protected]/discovery/manager.go:182 +0x5c

goroutine 698 [select, 1 minutes]:
github.com/prometheus/prometheus/scrape.(*Manager).reloader(0x400362f7a0)
	github.com/prometheus/[email protected]/scrape/manager.go:197 +0x104
created by github.com/prometheus/prometheus/scrape.(*Manager).Run in goroutine 671
	github.com/prometheus/[email protected]/scrape/manager.go:165 +0x60

goroutine 700 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x400365c960, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 677
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 701 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 677
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 702 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001abc240}, {0xffff5de359d0, 0x4002e8dc30}, {0x8641c30?, 0x7586360}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003736460, {0x0?, 0x0?}, 0x4003601d40, 0x4003642548?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003736460, 0x4003601d40)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8dc30?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400337df40?, {0x8554be0, 0x40037085f0}, 0x1, 0x4003601d40)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003736460, 0x4003601d40)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 677
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 873 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003736460, 0x4003601d40, 0x40033c1b00, 0x4002f77ab0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 702
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 874 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x40029c9980, 0x4001c4ef00)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x0?, 0x4003642708?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 702
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 741 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40035418c0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003642728?, {0x8554bc0, 0x400377ccc0}, 0x1, 0x400379c240)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x4003642778?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003702480)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 706
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 706 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x400365c9b0, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 678
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 707 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 678
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 708 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4000138ec0}, {0xffff5de359d0, 0x4002e8dce0}, {0x8641c30?, 0x7588b40}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003736620, {0x0?, 0x0?}, 0x4003601d40, 0x4003645548?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003736620, 0x4003601d40)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8dce0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400376a080?, {0x8554be0, 0x4003708640}, 0x1, 0x4003601d40)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003736620, 0x4003601d40)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 678
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 867 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003736620, 0x4003601d40, 0x40000bd620, 0x40022c6898?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 708
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 868 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4000069800, 0x4000164600)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x0?, 0x4003645708?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 708
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 743 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40035418c0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003645728?, {0x8554bc0, 0x400377ccf0}, 0x1, 0x400379c2a0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x4003645778?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003702510)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 712
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 712 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x400365ca00, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 679
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 713 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 679
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 714 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4002c569c0}, {0xffff5de359d0, 0x4002e8dd90}, {0x8641c30?, 0x758ba60}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40037367e0, {0x0?, 0x0?}, 0x4003601d40, 0x400366bd48?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40037367e0, 0x4003601d40)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8dd90?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400376a100?, {0x8554be0, 0x4003708690}, 0x1, 0x4003601d40)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40037367e0, 0x4003601d40)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 679
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 947 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40037367e0, 0x4003601d40, 0x40033258c0, 0x4003608fb0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 714
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 963 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x400682d5c0)
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 379
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:160 +0x19c

goroutine 718 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40037025a0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 682
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 745 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400375f728?, {0x8554bc0, 0x400377cd20}, 0x1, 0x400379c300)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x400375f778?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003702ab0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 720
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 720 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x400365df90, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 687
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 721 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 687
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 722 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4001c6e0c0}, {0xffff5de359d0, 0x4002e8de40}, {0x8641c30?, 0x7586360}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x40037369a0, {0x0?, 0x0?}, 0x4003601ec0, 0x4003670548?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x40037369a0, 0x4003601ec0)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8de40?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400376a180?, {0x8554be0, 0x4003708780}, 0x1, 0x4003601ec0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x40037369a0, 0x4003601ec0)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 687
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 921 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x40037369a0, 0x4003601ec0, 0x400370baa0, 0x4003671fb0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 722
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 922 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002c46000, 0x40025f2f00)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x40037080d8?, 0x400366c7b0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 722
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 747 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40035418c0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4003670728?, {0x8554bc0, 0x400377cd50}, 0x1, 0x400379c360)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x4003670778?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003702b40)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 726
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 726 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x4003708000, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 688
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 727 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 688
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 728 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4002a3f100}, {0xffff5de359d0, 0x4002e8def0}, {0x8641c30?, 0x7588b40}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003736b60, {0x0?, 0x0?}, 0x4003601ec0, 0x400366fd48?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003736b60, 0x4003601ec0)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4002e8def0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400376a2c0?, {0x8554be0, 0x40037087d0}, 0x1, 0x4003601ec0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003736b60, 0x4003601ec0)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 688
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 840 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003736b60, 0x4003601ec0, 0x400018f020, 0x40020c8fb0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 728
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 841 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x4002260900, 0x400382d000)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x0?, 0x400366ff08?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 728
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 749 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	k8s.io/[email protected]/tools/cache/shared_informer.go:969 +0x48
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x40035418c0?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400366ff28?, {0x8554bc0, 0x400377cd80}, 0x1, 0x400379c3c0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x38?, 0x400366ff78?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:204 +0x80
k8s.io/apimachinery/pkg/util/wait.Until(...)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0x4003702bd0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:968 +0x68
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 732
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 732 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0x4003708050, 0x0?)
	k8s.io/[email protected]/tools/cache/shared_informer.go:803 +0x3c
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 689
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 733 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
	k8s.io/[email protected]/tools/cache/controller.go:132 +0x2c
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 689
	k8s.io/[email protected]/tools/cache/controller.go:131 +0x94

goroutine 734 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0xde4b640?}, {0x8593668, 0x4002c56a80}, {0xffff5de359d0, 0x4003794000}, {0x8641c30?, 0x758ba60}, 0x0, ...)
	k8s.io/[email protected]/tools/cache/reflector.go:714 +0x11c
k8s.io/client-go/tools/cache.(*Reflector).watch(0x4003736d20, {0x0?, 0x0?}, 0x4003601ec0, 0x400366f548?)
	k8s.io/[email protected]/tools/cache/reflector.go:433 +0x3e0
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0x4003736d20, 0x4003601ec0)
	k8s.io/[email protected]/tools/cache/reflector.go:358 +0x2dc
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	k8s.io/[email protected]/tools/cache/reflector.go:291 +0x28
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x4003794000?)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:226 +0x40
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x400376a340?, {0x8554be0, 0x4003708820}, 0x1, 0x4003601ec0)
	k8s.io/[email protected]/pkg/util/wait/backoff.go:227 +0x90
k8s.io/client-go/tools/cache.(*Reflector).Run(0x4003736d20, 0x4003601ec0)
	k8s.io/[email protected]/tools/cache/reflector.go:290 +0x184
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
	k8s.io/[email protected]/pkg/util/wait/wait.go:55 +0x2c
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 689
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 945 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0x4003736d20, 0x4003601ec0, 0x400303f020, 0x400375f7b0?)
	k8s.io/[email protected]/tools/cache/reflector.go:370 +0xbc
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 734
	k8s.io/[email protected]/tools/cache/reflector.go:357 +0x2c4

goroutine 964 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x4006860840)
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 379
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:160 +0x19c

goroutine 738 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003702c60)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 692
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 740 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x40037023f0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 700
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 742 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003702480)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 706
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 744 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003702510)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 712
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 746 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003702ab0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 720
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 748 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003702b40)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 726
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 793 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de360f8, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521480?, 0x40031e7000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521480, {0x40031e7000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521480, {0x40031e7000?, 0x40038b3828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6718, {0x40031e7000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4002dbce10, {0x40031e7000?, 0x4002dbce10?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40035577a8, {0x8550b20, 0x4002dbce10})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x4003557500, {0x854dee0?, 0x40022c6718}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x4003557500, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x4003557500, {0x400380e000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x40036fec60, {0x4003692200, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x40036fec60}, {0x4003692200, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692200, 0x9, 0xe5ddfff87?}, {0x854a860?, 0x40036fec60?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40036921c0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4003695680, 0x0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 228
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 750 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0x4003702bd0)
	k8s.io/[email protected]/tools/cache/shared_informer.go:939 +0xe0
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
	k8s.io/[email protected]/pkg/util/wait/wait.go:72 +0x58
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 732
	k8s.io/[email protected]/pkg/util/wait/wait.go:70 +0x7c

goroutine 910 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001fdaeb0, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383bc00)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 653
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 857 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x40037d8d40)
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 856
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:160 +0x19c

goroutine 835 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d0d70, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a230)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 338
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 933 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0x40060ef200, 0x4002dd8a00)
	golang.org/x/[email protected]/http2/transport.go:1464 +0x900
golang.org/x/net/http2.(*clientStream).doRequest(0x4002a3f100?, 0x40032597b0?)
	golang.org/x/[email protected]/http2/transport.go:1326 +0x20
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 411
	golang.org/x/[email protected]/http2/transport.go:1232 +0x2d4

goroutine 808 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de35f08, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521680?, 0x40037eb000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521680, {0x40037eb000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521680, {0x40037eb000?, 0x40038a4828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6750, {0x40037eb000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4002dbd848, {0x40037eb000?, 0x4002dbd848?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40036b62a8, {0x8550b20, 0x4002dbd848})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40036b6000, {0x854dee0?, 0x40022c6750}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40036b6000, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40036b6000, {0x4003ad6000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4003ad0de0, {0x40036924a0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003ad0de0}, {0x40036924a0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40036924a0, 0x9, 0xe65aad999?}, {0x854a860?, 0x4003ad0de0?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692460)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4003695d40, 0x4003695680?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 366
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 893 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041c50, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520b00?, 0x40023cc800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520b00, {0x40023cc800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520b00, {0x40023cc800?, 0x400385b828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e68, {0x40023cc800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4002dbd4e8, {0x40023cc800?, 0x4002dbd4e8?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cd428, {0x8550b20, 0x4002dbd4e8})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cd180, {0x854dee0?, 0x4002f77e68}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cd180, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cd180, {0x4002d36000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4002c86000, {0x4003692f20, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4002c86000}, {0x4003692f20, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692f20, 0x9, 0xe5de85ab9?}, {0x854a860?, 0x4002c86000?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692ee0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74900, 0x4002a74480?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 159
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 887 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de366c8, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520c00?, 0x40023cb000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520c00, {0x40023cb000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520c00, {0x40023cb000?, 0x4003aec828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e70, {0x40023cb000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4002dbd500, {0x40023cb000?, 0x4002dbd500?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cd7a8, {0x8550b20, 0x4002dbd500})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cd500, {0x854dee0?, 0x4002f77e70}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cd500, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cd500, {0x4002c30000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400276b0e0, {0x4003692d60, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400276b0e0}, {0x4003692d60, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692d60, 0x9, 0xe5dec296e?}, {0x854a860?, 0x400276b0e0?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692d20)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74480, 0x40036946c0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 189
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 883 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e042030, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520900?, 0x40023c8000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520900, {0x40023c8000, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520900, {0x40023c8000?, 0x4003aff828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e78, {0x40023c8000?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x4004451e48, {0x40023c8000?, 0x4004451e48?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cdb28, {0x8550b20, 0x4004451e48})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cd880, {0x854dee0?, 0x4002f77e78}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cd880, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cd880, {0x4002ab4000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400276ade0, {0x4003692ba0, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400276ade0}, {0x4003692ba0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692ba0, 0x9, 0xfeb65af35?}, {0x854a860?, 0x400276ade0?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692b60)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a74000, 0x40022c6160?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 445
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 813 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de361f0, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003521380?, 0x40037e9800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003521380, {0x40037e9800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003521380, {0x40037e9800?, 0x4003861828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x40022c6748, {0x40037e9800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x400305aa98, {0x40037e9800?, 0x400305aa98?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x4003557ea8, {0x8550b20, 0x400305aa98})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x4003557c00, {0x854dee0?, 0x40022c6748}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x4003557c00, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x4003557c00, {0x4003870000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x4003867500, {0x4003737540, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4003867500}, {0x4003737540, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003737540, 0x9, 0xe6032caec?}, {0x854a860?, 0x4003867500?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003737500)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x40038d0900, 0x4002f77f10?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 214
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 889 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de363e0, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4003520f00?, 0x40023c9800?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4003520f00, {0x40023c9800, 0x1800, 0x1800})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4003520f00, {0x40023c9800?, 0x40038a5828?, 0x25acbc?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4002f77e88, {0x40023c9800?, 0x21?, 0x17f3?})
	net/net.go:179 +0x34
crypto/tls.(*atLeastReader).Read(0x40054759e0, {0x40023c9800?, 0x40054759e0?, 0x0?})
	crypto/tls/conn.go:805 +0x40
bytes.(*Buffer).ReadFrom(0x40037cdea8, {0x8550b20, 0x40054759e0})
	bytes/buffer.go:211 +0x90
crypto/tls.(*Conn).readFromUntil(0x40037cdc00, {0x854dee0?, 0x4002f77e88}, 0x1800?)
	crypto/tls/conn.go:827 +0xd0
crypto/tls.(*Conn).readRecordOrCCS(0x40037cdc00, 0x0)
	crypto/tls/conn.go:625 +0x1e4
crypto/tls.(*Conn).readRecord(...)
	crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0x40037cdc00, {0x4002c48000, 0x8000, 0x8594130?})
	crypto/tls/conn.go:1369 +0x168
bufio.(*Reader).Read(0x400276b260, {0x4003692e40, 0x9, 0xa8494?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x400276b260}, {0x4003692e40, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4003692e40, 0x9, 0xfeb688a3c?}, {0x854a860?, 0x400276b260?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4003692e00)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Client).reader(0x4002a746c0, 0x40032737b0?)
	google.golang.org/[email protected]/internal/transport/http2_client.go:1587 +0x1b8
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 383
	google.golang.org/[email protected]/internal/transport/http2_client.go:400 +0x16fc

goroutine 994 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4001bd1b80, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x4001cd5d50)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/[email protected]/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 984
	google.golang.org/[email protected]/internal/transport/http2_server.go:322 +0x12f8

goroutine 831 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d0050, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a000)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 78
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 833 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40036d0230, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383a070)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 114
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 890 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x400208ae10, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x400383b810)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.newHTTP2Client.func6()
	google.golang.org/[email protected]/internal/transport/http2_client.go:454 +0x70
created by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 383
	google.golang.org/[email protected]/internal/transport/http2_client.go:452 +0x1b50

goroutine 891 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4000069848, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4000069838)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4000069830, {0x4002461801, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002461801?, 0x4003617ca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001b70dc0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001b70dc0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001b70dc0, {0x65704e0, 0x400318b5c0})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40024b7c80, {0x4003ad3400, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001fda140, 0x4002cc7b00?, {0x8587d88, 0x4001fe3580})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x40000b10e0)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4000138ec0)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 708
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 892 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x4000069548, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x4000069538)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x4000069530, {0x4002461201, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x4002461201?, 0x4007c0fca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x4001d017c0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x4001d017c0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x4001d017c0, {0x65704e0, 0x400318b5a8})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x40024b7d40, {0x4003ad3800, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001fda190, 0x4002cc7a80?, {0x8587d88, 0x4001fe3540})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x40000b1100)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x4000138f40)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 551
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 957 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0x400662e7c8, 0x1)
	runtime/sema.go:527 +0x154
sync.(*Cond).Wait(0x400662e7b8)
	sync/cond.go:70 +0xcc
golang.org/x/net/http2.(*pipe).Read(0x400662e7b0, {0x40037fb201, 0x5ff, 0x5ff})
	golang.org/x/[email protected]/http2/pipe.go:76 +0x108
golang.org/x/net/http2.transportResponseBody.Read({0x768a208?}, {0x40037fb201?, 0x4007c2bca8?, 0x181f0?})
	golang.org/x/[email protected]/http2/transport.go:2558 +0x50
encoding/json.(*Decoder).refill(0x40065fd7c0)
	encoding/json/stream.go:165 +0x164
encoding/json.(*Decoder).readValue(0x40065fd7c0)
	encoding/json/stream.go:140 +0x88
encoding/json.(*Decoder).Decode(0x40065fd7c0, {0x65704e0, 0x4001bbe7e0})
	encoding/json/stream.go:63 +0x5c
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0x4006624900, {0x4003071800, 0x400, 0x400})
	k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0x4001f97450, 0x40052c2a00?, {0x8587d88, 0x400444ae40})
	k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0x88
k8s.io/client-go/rest/watch.(*Decoder).Decode(0x4006105820)
	k8s.io/[email protected]/rest/watch/decoder.go:49 +0x5c
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0x40033edf40)
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0xb0
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 295
	k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x120

goroutine 979 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4002cf3f90, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x4001ca36c0)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/[email protected]/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 978
	google.golang.org/[email protected]/internal/transport/http2_server.go:322 +0x12f8

goroutine 959 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4002cf3590, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x4001ca32d0)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/[email protected]/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 958
	google.golang.org/[email protected]/internal/transport/http2_server.go:322 +0x12f8

goroutine 960 [select, 1 minutes]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x4001c9b520)
	google.golang.org/[email protected]/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 958
	google.golang.org/[email protected]/internal/transport/http2_server.go:328 +0x1338

goroutine 977 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8c660, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x400267cd80?, 0x4006b80000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x400267cd80, {0x4006b80000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x400267cd80, {0x4006b80000?, 0x4003533b78?, 0x401000801?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4000114ea8, {0x4006b80000?, 0x4003533bb8?, 0x18124?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4006a6e2a0, {0x40065f50e0, 0x9, 0x40035f3680?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4006a6e2a0}, {0x40065f50e0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40065f50e0, 0x9, 0x40050d39d0?}, {0x854a860?, 0x4006a6e2a0?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40065f50a0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x4001c9b520, {0x85cbe38, 0x4006a70750}, 0xde95160?)
	google.golang.org/[email protected]/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x4001c9b520}, {0x85f1f18?, 0x4000114ea8?})
	google.golang.org/[email protected]/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/[email protected]/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 958
	google.golang.org/[email protected]/server.go:958 +0x1d0

goroutine 980 [select, 1 minutes]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x4001c9bba0)
	google.golang.org/[email protected]/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 978
	google.golang.org/[email protected]/internal/transport/http2_server.go:328 +0x1338

goroutine 981 [IO wait]:
internal/poll.runtime_pollWait(0xffff5e041680, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x400267db00?, 0x4006c80000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x400267db00, {0x4006c80000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x400267db00, {0x4006c80000?, 0x40037a7b80?, 0x17ad4?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4000114fd0, {0x4006c80000?, 0x40068205a0?, 0x40071f42a0?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x4006a6eb40, {0x40065f51c0, 0x9, 0x80060?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x4006a6eb40}, {0x40065f51c0, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x40065f51c0, 0x9, 0x4002ca96b0?}, {0x854a860?, 0x4006a6eb40?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x40065f5180)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x4001c9bba0, {0x85cbe38, 0x4006a71aa0}, 0xde95160?)
	google.golang.org/[email protected]/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x4001c9bba0}, {0x85f1f18?, 0x4000114fd0?})
	google.golang.org/[email protected]/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/[email protected]/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 978
	google.golang.org/[email protected]/server.go:958 +0x1d0

goroutine 983 [select]:
github.com/prometheus/prometheus/scrape.(*scrapeLoop).run(0x40066030e0, 0x0?)
	github.com/prometheus/[email protected]/scrape/scrape.go:1308 +0x2ec
created by github.com/prometheus/prometheus/scrape.(*scrapePool).sync in goroutine 982
	github.com/prometheus/[email protected]/scrape/scrape.go:648 +0x930

goroutine 1068 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x4001c2e140)
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 1067
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:160 +0x19c

goroutine 990 [IO wait]:
internal/poll.runtime_pollWait(0xffff5de368b8, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x4002256900?, 0x4006f21000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x4002256900, {0x4006f21000, 0x1000, 0x1000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x4002256900, {0x4006f21000?, 0x1?, 0x1?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4000115728, {0x4006f21000?, 0x4002fdac28?, 0x18124?})
	net/net.go:179 +0x34
net/http.(*persistConn).Read(0x4006dcd200, {0x4006f21000?, 0x17fd0?, 0x4006c79b60?})
	net/http/transport.go:1954 +0x50
bufio.(*Reader).fill(0x4006df6f00)
	bufio/bufio.go:113 +0xf8
bufio.(*Reader).Peek(0x4006df6f00, 0x1)
	bufio/bufio.go:151 +0x60
net/http.(*persistConn).readLoop(0x4006dcd200)
	net/http/transport.go:2118 +0x14c
created by net/http.(*Transport).dialConn in goroutine 988
	net/http/transport.go:1776 +0x1144

goroutine 991 [select]:
net/http.(*persistConn).writeLoop(0x4006dcd200)
	net/http/transport.go:2421 +0x9c
created by net/http.(*Transport).dialConn in goroutine 988
	net/http/transport.go:1777 +0x118c

goroutine 1053 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x40033ec400)
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 1084
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:160 +0x19c

goroutine 1091 [select]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x40001829c0)
	google.golang.org/[email protected]/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 1089
	google.golang.org/[email protected]/internal/transport/http2_server.go:328 +0x1338

goroutine 1046 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x4001c88d40)
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 1045
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:160 +0x19c

goroutine 1081 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x40027eeb40, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40020a09a0)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/[email protected]/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 1080
	google.golang.org/[email protected]/internal/transport/http2_server.go:322 +0x12f8

goroutine 1090 [select]:
google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x4003110370, 0x1)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:418 +0x14c
google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x40001751f0)
	google.golang.org/[email protected]/internal/transport/controlbuf.go:552 +0x7c
google.golang.org/grpc/internal/transport.NewServerTransport.func2()
	google.golang.org/[email protected]/internal/transport/http2_server.go:325 +0xd8
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 1089
	google.golang.org/[email protected]/internal/transport/http2_server.go:322 +0x12f8

goroutine 1082 [select]:
google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x4001c9a680)
	google.golang.org/[email protected]/internal/transport/http2_server.go:1138 +0x184
created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 1080
	google.golang.org/[email protected]/internal/transport/http2_server.go:328 +0x1338

goroutine 1083 [IO wait]:
internal/poll.runtime_pollWait(0xffff5dd8bea0, 0x72)
	runtime/netpoll.go:343 +0xa0
internal/poll.(*pollDesc).wait(0x400719b880?, 0x4004080000?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x28
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x400719b880, {0x4004080000, 0x80000, 0x80000})
	internal/poll/fd_unix.go:164 +0x200
net.(*netFD).Read(0x400719b880, {0x4004080000?, 0x4002cc9fb0?, 0x801000601?})
	net/fd_posix.go:55 +0x28
net.(*conn).Read(0x4001f42690, {0x4004080000?, 0x40025a6228?, 0x18?})
	net/net.go:179 +0x34
bufio.(*Reader).Read(0x40037b2180, {0x4000018f20, 0x9, 0x80060?})
	bufio/bufio.go:244 +0x1b4
io.ReadAtLeast({0x854a860, 0x40037b2180}, {0x4000018f20, 0x9, 0x9}, 0x9)
	io/io.go:335 +0xa0
io.ReadFull(...)
	io/io.go:354
golang.org/x/net/http2.readFrameHeader({0x4000018f20, 0x9, 0x4002d2b878?}, {0x854a860?, 0x40037b2180?})
	golang.org/x/[email protected]/http2/frame.go:237 +0x58
golang.org/x/net/http2.(*Framer).ReadFrame(0x4000018ee0)
	golang.org/x/[email protected]/http2/frame.go:498 +0x78
google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x4001c9a680, {0x85cbe38, 0x4002cc9b90}, 0xde95160?)
	google.golang.org/[email protected]/internal/transport/http2_server.go:617 +0x11c
google.golang.org/grpc.(*Server).serveStreams(0x400358ca00, {0x85ca9c0?, 0xde95160?}, {0x85fe840?, 0x4001c9a680}, {0x85f1f18?, 0x4001f42690?})
	google.golang.org/[email protected]/server.go:1023 +0x324
google.golang.org/grpc.(*Server).handleRawConn.func1()
	google.golang.org/[email protected]/server.go:959 +0x5c
created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 1080
	google.golang.org/[email protected]/server.go:958 +0x1d0

goroutine 1106 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x4006c115c0)
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 1105
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:160 +0x19c

goroutine 1115 [select]:
go.opentelemetry.io/collector/processor/batchprocessor.(*shard).start(0x4007820b40)
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:193 +0x114
created by go.opentelemetry.io/collector/processor/batchprocessor.(*batchProcessor).newShard in goroutine 1114
	go.opentelemetry.io/collector/processor/[email protected]/batch_processor.go:160 +0x19c

goroutine 646 [running]:
go.opentelemetry.io/collector/client.Metadata.Get({0x0?}, {0x4002a01488, 0x13})
	go.opentelemetry.io/[email protected]/client/client.go:158 +0x13c
github.com/open-telemetry/opentelemetry-collector-contrib/extension/headerssetterextension/internal/source.(*ContextSource).Get(0x4002dbea20, {0x85cbe38?, 0x400545bc80?})
	github.com/open-telemetry/opentelemetry-collector-contrib/extension/[email protected]/internal/source/context.go:21 +0xd0
github.com/open-telemetry/opentelemetry-collector-contrib/extension/headerssetterextension.(*headersPerRPC).GetRequestMetadata(0x4003343b30, {0x85cbe38, 0x400545bc80}, {0x30?, 0x30?, 0x6f0e5c0?})
	github.com/open-telemetry/opentelemetry-collector-contrib/extension/[email protected]/extension.go:90 +0xc4
google.golang.org/grpc/internal/transport.(*http2Client).getTrAuthData(0x40001638c0, {0x85cbe38, 0x400545bc80}, {0x40032ca960, 0x4a})
	google.golang.org/[email protected]/internal/transport/http2_client.go:630 +0x114
google.golang.org/grpc/internal/transport.(*http2Client).createHeaderFields(0x40001638c0, {0x85cbe38, 0x400545bc50}, 0x40037b6ec8)
	google.golang.org/[email protected]/internal/transport/http2_client.go:512 +0xd0
google.golang.org/grpc/internal/transport.(*http2Client).NewStream(0x40001638c0, {0x85cbe38, 0x400545bbc0}, 0x40052eb740)
	google.golang.org/[email protected]/internal/transport/http2_client.go:721 +0x144
google.golang.org/grpc.(*csAttempt).newStream(0x40054624e0)
	google.golang.org/[email protected]/stream.go:504 +0x94
google.golang.org/grpc.newClientStreamWithParams.func2(0x40054624e0)
	google.golang.org/[email protected]/stream.go:354 +0x34
google.golang.org/grpc.(*clientStream).withRetry(0x40052dd7a0, 0x40077a3b80, 0x40037b7268)
	google.golang.org/[email protected]/stream.go:778 +0x188
google.golang.org/grpc.newClientStreamWithParams({0x85cbe38, 0x400545b9b0}, 0xde3e560, 0x40035fe700, {0x783f923, 0x39}, {0x0, 0x0, 0x0, 0x0, ...}, ...)
	google.golang.org/[email protected]/stream.go:363 +0x9d4
google.golang.org/grpc.newClientStream.func3({0x85cbe38?, 0x400545b9b0?}, 0x400545b9b0?)
	google.golang.org/[email protected]/stream.go:220 +0x6c
google.golang.org/grpc.newClientStream({0x85cbe38, 0x400545b9b0}, 0xde3e560, 0x40035fe700, {0x783f923, 0x39}, {0x4002f35de0, 0x2, 0x1?})
	google.golang.org/[email protected]/stream.go:255 +0x628
google.golang.org/grpc.invoke({0x85cbe38?, 0x400545b9b0?}, {0x783f923?, 0x4003602f20?}, {0x7242c80, 0x4006739f80}, {0x7242dc0, 0x400662cf30}, 0x400662cf30?, {0x4002f35de0?, ...})
	google.golang.org/[email protected]/call.go:66 +0x68
google.golang.org/grpc.(*ClientConn).Invoke(0x40035fe700?, {0x85cbe38?, 0x400545b9b0?}, {0x783f923?, 0x39?}, {0x7242c80?, 0x4006739f80?}, {0x7242dc0?, 0x400662cf30?}, {0x4003603430?, ...})
	google.golang.org/[email protected]/call.go:37 +0x1a4
go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/logs/v1.(*logsServiceClient).Export(0x4002f77790, {0x85cbe38, 0x400545b9b0}, 0xde95160?, {0x4003603430, 0x1, 0x1})
	go.opentelemetry.io/collector/[email protected]/internal/data/protogen/collector/logs/v1/logs_service.pb.go:272 +0x8c
go.opentelemetry.io/collector/pdata/plog/plogotlp.(*grpcClient).Export(0x10?, {0x85cbe38?, 0x400545b9b0?}, {0x4006739f80?, 0x40050d2148?}, {0x4003603430?, 0x40037b76c8?, 0xb4f38?})
	go.opentelemetry.io/collector/[email protected]/plog/plogotlp/grpc.go:42 +0x48
go.opentelemetry.io/collector/exporter/otlpexporter.(*baseExporter).pushLogs(0x4002d75d40, {0x85cbee0?, 0x4001b2b7a0?}, {0x4006739f80?, 0x40050d2148?})
	go.opentelemetry.io/collector/exporter/[email protected]/otlp.go:127 +0x8c
go.opentelemetry.io/collector/exporter/exporterhelper.(*logsRequest).Export(0x85cbe38?, {0x85cbee0?, 0x4001b2b7a0?})
	go.opentelemetry.io/collector/[email protected]/exporterhelper/logs.go:59 +0x40
go.opentelemetry.io/collector/exporter/exporterhelper.(*timeoutSender).send(0x4005464980?, {0x85cbe38?, 0x400545b980?}, {0x8582b98, 0x40068212c0})
	go.opentelemetry.io/collector/[email protected]/exporterhelper/timeout_sender.go:49 +0xa0
go.opentelemetry.io/collector/exporter/exporterhelper.(*retrySender).send(0x4002dd26e0, {0x85cbe38, 0x400545b980}, {0x8582b98, 0x40068212c0})
	go.opentelemetry.io/collector/[email protected]/exporterhelper/retry_sender.go:89 +0x334
go.opentelemetry.io/collector/exporter/exporterhelper.(*logsExporterWithObservability).send(0x4002de3a10, {0x85cc310?, 0x4007814900?}, {0x8582b98?, 0x40068212c0?})
	go.opentelemetry.io/collector/[email protected]/exporterhelper/logs.go:171 +0x74
go.opentelemetry.io/collector/exporter/exporterhelper.newQueueSender.func1({0x85cc310?, 0x4007814900?}, {0x8582b98?, 0x40068212c0?})
	go.opentelemetry.io/collector/[email protected]/exporterhelper/queue_sender.go:95 +0x78
go.opentelemetry.io/collector/exporter/internal/queue.(*boundedMemoryQueue[...]).Consume(0x85d7140, 0x4002de3a70)
	go.opentelemetry.io/collector/[email protected]/internal/queue/bounded_memory_queue.go:57 +0xa4
go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start.func1()
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:43 +0x80
created by go.opentelemetry.io/collector/exporter/internal/queue.(*Consumers[...]).Start in goroutine 1
	go.opentelemetry.io/collector/[email protected]/internal/queue/consumers.go:39 +0x8c

@TylerHelmuth TylerHelmuth added extension/headerssetter and removed needs triage New item requiring triage labels Feb 15, 2024
@github-actions GitHub Actions
Copy link
Contributor

Pinging code owners for extension/headerssetter: @jpkrohling. See Adding Labels via Comments if you do not have permissions to add labels yourself.

@TylerHelmuth TylerHelmuth mentioned this issue Feb 16, 2024
Closed
@TylerHelmuth
Copy link
Member

TylerHelmuth commented Feb 16, 2024 •
edited
Loading

I think I know why this is happening.

A request comes in to receiver A. The data (and the request context) flows down the pipeline to exporter X and exporter Y. Both extensions independently access the context in their own threads here. Since 2 threads are access a map it panics.

@jpkrohling
Copy link
Member

Thank you for the investigation, @TylerHelmuth!

This was referenced Feb 20, 2024
Closed
Open
@TylerHelmuth
Copy link
Member

Closed via open-telemetry/opentelemetry-collector#9595

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working extension/headerssetter
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jpkrohling @tdarwin @TylerHelmuth