Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[exporter/datadog] Integration test timing out #34836

Open
crobert-1 opened this issue Aug 23, 2024 · 7 comments
Open

[exporter/datadog] Integration test timing out #34836

crobert-1 opened this issue Aug 23, 2024 · 7 comments
Assignees
Labels

Comments

@crobert-1
Copy link
Member

Component(s)

exporter/datadog

Describe the issue you're reporting

Failing CI/CD link

Failure output:

=== Failed
=== FAIL: .  (0.00s)
2024-08-23T08:29:27.454Z	info	datadogconnector/connector_native.go:102	Stopping concentrator	{"kind": "connector", "name": "datadog/connector", "exporter_in_pipeline": "traces", "receiver_in_pipeline": "metrics"}
panic: test timed out after 10m0s
running tests:
	TestIntegrationInternalMetrics (8m52s)

goroutine 960 [running]:
testing.(*M).startAlarm.func1()
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/testing/testing.go:2366 +0x265
created by time.goFunc
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/time/sleep.go:177 +0x45

goroutine 1 [chan receive, 8 minutes]:
testing.(*T).Run(0xc000817d40, {0x145fc0d8c, 0x1e}, 0x1461352b8)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/testing/testing.go:1750 +0x851
testing.runTests.func1(0xc000817d40)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/testing/testing.go:2161 +0x86
testing.tRunner(0xc000817d40, 0xc000a5fb10)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/testing/testing.go:1689 +0x21f
testing.runTests(0xc00090e2b8, {0x144fd70a0, 0x5, 0x5}, {0xc000a5fbb8?, 0xc000a5fc00?, 0x14a3692e0?})
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/testing/testing.go:2159 +0x8bf
testing.(*M).Run(0xc0007a74a0)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/testing/testing.go:2027 +0xf18
main.main()
	_testmain.go:55 +0x2be

goroutine 20 [select]:
go.opencensus.io/stats/view.(*worker).start(0xc0007e0000)
	C:/Users/runneradmin/go/pkg/mod/[email protected]/stats/view/worker.go:292 +0x1a5
created by go.opencensus.io/stats/view.init.0 in goroutine 1
	C:/Users/runneradmin/go/pkg/mod/[email protected]/stats/view/worker.go:34 +0xfd

goroutine 7 [sync.Cond.Wait, 10 minutes]:
sync.runtime_notifyListWait(0xc000801090, 0x0)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/runtime/sema.go:569 +0x15d
sync.(*Cond).Wait(0xc000801080)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/sync/cond.go:70 +0x75
github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc00048fc20)
	C:/Users/runneradmin/go/pkg/mod/github.com/cihub/[email protected][575](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/10522339745/job/29154786351#step:6:576)75/behavior_asynclooplogger.go:50 +0x159
github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc00048fc20)
	C:/Users/runneradmin/go/pkg/mod/github.com/cihub/[email protected]/behavior_asynclooplogger.go:63 +0x37
created by github.com/cihub/seelog.NewAsyncLoopLogger in goroutine 1
	C:/Users/runneradmin/go/pkg/mod/github.com/cihub/[email protected]/behavior_asynclooplogger.go:40 +0x11d

goroutine 8 [sync.Cond.Wait, 10 minutes]:
sync.runtime_notifyListWait(0xc000801210, 0x0)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/runtime/sema.go:569 +0x15d
sync.(*Cond).Wait(0xc000801200)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/sync/cond.go:70 +0x75
github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc00048fd40)
	C:/Users/runneradmin/go/pkg/mod/github.com/cihub/[email protected]/behavior_asynclooplogger.go:50 +0x159
github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc00048fd40)
	C:/Users/runneradmin/go/pkg/mod/github.com/cihub/[email protected]/behavior_asynclooplogger.go:63 +0x37
created by github.com/cihub/seelog.NewAsyncLoopLogger in goroutine 1
	C:/Users/runneradmin/go/pkg/mod/github.com/cihub/[email protected]/behavior_asynclooplogger.go:40 +0x11d

goroutine 364 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x6)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 271
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 398 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 378
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 396 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 378
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 524 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x3)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 498
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 71 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x2)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 68
ERROR rerun aborted because previous run had a suspected panic and some test may not have run
make[2]: *** [../../../Makefile.Common:126: test] Error 3
make[1]: *** [Makefile:178: exporter/datadogexporter/integrationtest] Error 2
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 72 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x3)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 68
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 73 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x4)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 68
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 74 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x5)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 68
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 75 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x6)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 68
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 884 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newMetricsExporter.func2()
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/metrics_exporter.go:126 +0xde
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newMetricsExporter in goroutine 848
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/metrics_exporter.go:126 +0xb4e

goroutine 262 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 254
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 395 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 378
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 98 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/sampler.NewRareSampler.func1()
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/sampler/rare_sampler.go:68 +0x94
created by github.com/DataDog/datadog-agent/pkg/trace/sampler.NewRareSampler in goroutine 68
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/sampler/rare_sampler.go:67 +0x55d

goroutine 525 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x4)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 498
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 380 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newTracesExporter.func1()
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/traces_exporter.go:86 +0xde
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newTracesExporter in goroutine 271
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/traces_exporter.go:86 +0x996

goroutine 236 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x6)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 59
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 108 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newTracesExporter.func1()
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/traces_exporter.go:86 +0xde
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newTracesExporter in goroutine 68
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/traces_exporter.go:86 +0x996

goroutine 233 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x3)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 59
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 232 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x2)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 59
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 234 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x4)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 59
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 121 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newMetricsExporter.func2()
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/metrics_exporter.go:126 +0xde
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newMetricsExporter in goroutine 68
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/metrics_exporter.go:126 +0xb4e

goroutine 223 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newMetricsExporter.func2()
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/metrics_exporter.go:126 +0xde
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newMetricsExporter in goroutine 59
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/metrics_exporter.go:126 +0xb4e

goroutine 235 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x5)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 59
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 883 [select, 8 minutes]:
github.com/patrickmn/go-cache.(*janitor).Run(0xc000a18350, 0xc000b28440)
	C:/Users/runneradmin/go/pkg/mod/github.com/patrickmn/[email protected]+incompatible/cache.go:1079 +0xfc
created by github.com/patrickmn/go-cache.runJanitor in goroutine 848
	C:/Users/runneradmin/go/pkg/mod/github.com/patrickmn/[email protected]+incompatible/cache.go:1099 +0x18c

goroutine 523 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x2)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 498
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 370 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/sampler.NewRareSampler.func1()
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/sampler/rare_sampler.go:68 +0x94
created by github.com/DataDog/datadog-agent/pkg/trace/sampler.NewRareSampler in goroutine 271
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/sampler/rare_sampler.go:67 +0x55d

goroutine 526 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x5)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 498
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 142 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 106
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 143 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 106
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 144 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 106
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 145 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 106
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 360 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x2)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 271
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 363 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x5)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 271
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 362 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x4)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 271
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 259 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 254
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 361 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x3)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 271
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 260 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 254
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 261 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 254
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 397 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 378
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 459 [chan receive]:
github.com/DataDog/datadog-agent/pkg/status/health.(*catalog).run(0x14a368620)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/status/[email protected]/health.go:91 +0x71
created by github.com/DataDog/datadog-agent/pkg/status/health.(*catalog).register in goroutine 498
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/status/[email protected]/health.go:63 +0x18c

goroutine 179 [syscall, 9 minutes]:
os/signal.signal_recv()
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/runtime/sigqueue.go:152 +0x29
os/signal.loop()
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/os/signal/signal_unix.go:23 +0x1d
created by os/signal.Notify.func1.1 in goroutine 68
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/os/signal/signal.go:151 +0x47

goroutine 408 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newMetricsExporter.func2()
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/metrics_exporter.go:126 +0xde
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newMetricsExporter in goroutine 271
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/metrics_exporter.go:126 +0xb4e

goroutine 846 [select]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest.TestIntegrationInternalMetrics(0xc000c73380)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest/integration_test.go:[589](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/10522339745/job/29154786351#step:6:590) +0x7bb
testing.tRunner(0xc000c73380, 0x1461352b8)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/testing/testing.go:1689 +0x21f
created by testing.(*T).Run in goroutine 1
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/testing/testing.go:1742 +0x826

goroutine 856 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x5)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 848
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 854 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x3)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 848
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 246 [chan receive, 9 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/sampler.NewRareSampler.func1()
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected][601](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/10522339745/job/29154786351#step:6:602)58-ad956a31a730/sampler/rare_sampler.go:68 +0x94
created by github.com/DataDog/datadog-agent/pkg/trace/sampler.NewRareSampler in goroutine 59
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/sampler/rare_sampler.go:67 +0x55d

goroutine 899 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newTracesExporter.func1()
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/traces_exporter.go:86 +0xde
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newTracesExporter in goroutine 848
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/traces_exporter.go:86 +0x996

goroutine 255 [chan send, 9 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newTracesExporter.func1()
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/traces_exporter.go:86 +0xde
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newTracesExporter in goroutine 59
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/traces_exporter.go:86 +0x996

goroutine 857 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x6)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 848
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 527 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x6)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 498
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 920 [chan receive, 8 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 898
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 853 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x2)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 848
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 569 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newMetricsExporter.func2()
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/metrics_exporter.go:126 +0xde
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter.newMetricsExporter in goroutine 498
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/metrics_exporter.go:126 +0xb4e

goroutine 890 [chan receive, 8 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/sampler.NewRareSampler.func1()
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/sampler/rare_sampler.go:68 +0x94
created by github.com/DataDog/datadog-agent/pkg/trace/sampler.NewRareSampler in goroutine 848
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/sampler/rare_sampler.go:67 +0x55d

goroutine 921 [chan receive, 8 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 898
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 922 [chan receive, 8 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 898
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 923 [chan receive, 8 minutes]:
github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).work(...)
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:230
created by github.com/DataDog/datadog-agent/pkg/trace/agent.(*Agent).Run in goroutine 898
	C:/Users/runneradmin/go/pkg/mod/github.com/!data!dog/datadog-agent/pkg/[email protected]/agent/agent.go:204 +0x715

goroutine 698 [select, 8 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc000ce42a0, {0x147d793e0, 0xc0002cb1d0})
	C:/Users/runneradmin/go/pkg/mod/google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0x1eb
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 480
	C:/Users/runneradmin/go/pkg/mod/google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x207

goroutine 855 [chan send, 8 minutes]:
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source.func1(0x4)
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:55 +0xe5
created by github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider.(*chainProvider).Source in goroutine 848
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/internal/hostmetadata/provider/provider.go:53 +0x44c

goroutine 699 [select, 8 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc000ce42f0, {0x147d793e0, 0xc0002cb5e0})
	C:/Users/runneradmin/go/pkg/mod/google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0x1eb
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 480
	C:/Users/runneradmin/go/pkg/mod/google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x207

goroutine 700 [select, 8 minutes]:
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc000ce4360, {0x147d793e0, 0xc0002cb680})
	C:/Users/runneradmin/go/pkg/mod/google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:76 +0x1eb
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 480
	C:/Users/runneradmin/go/pkg/mod/google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x207

goroutine 701 [select, 8 minutes]:
google.golang.org/grpc/internal/resolver/dns.(*dnsResolver).watcher(0xc000c46500)
	C:/Users/runneradmin/go/pkg/mod/google.golang.org/[email protected]/internal/resolver/dns/dns_resolver.go:220 +0x3ee
created by google.golang.org/grpc/internal/resolver/dns.(*dnsBuilder).Build in goroutine 699
	C:/Users/runneradmin/go/pkg/mod/google.golang.org/[email protected]/internal/resolver/dns/dns_resolver.go:149 +0x66b

goroutine 847 [IO wait, 8 minutes]:
internal/poll.runtime_pollWait(0x48330ce0, 0x72)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/runtime/netpoll.go:345 +0x85
internal/poll.(*pollDesc).wait(0xc000d80440, 0x72, 0x0)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/internal/poll/fd_poll_runtime.go:84 +0xb1
internal/poll.execIO(0xc000d802a0, 0xc000b439f8)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/internal/poll/fd_windows.go:175 +0x271
internal/poll.(*FD).acceptOne(0xc000d80288, 0x3e4, {0xc000d6c3c0, 0x2, 0x2}, 0xc000d802a0)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/internal/poll/fd_windows.go:944 +0xf8
internal/poll.(*FD).Accept(0xc000d80288, 0xc0010ddc70)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/internal/poll/fd_windows.go:978 +0x3cb
net.(*netFD).accept(0xc000d80288)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/net/fd_windows.go:178 +0x85
net.(*TCPListener).accept(0xc0010eb4c0)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/net/tcpsock_posix.go:159 +0x3e
net.(*TCPListener).Accept(0xc0010eb4c0)
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/net/tcpsock.go:327 +0x65
net/http.(*Server).Serve(0xc00031c2d0, {0x147d613d0, 0xc0010eb4c0})
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/net/http/server.go:3260 +0x672
net/http/httptest.(*Server).goServe.func1()
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/net/http/httptest/server.go:310 +0xbc
created by net/http/httptest.(*Server).goServe in goroutine 846
	C:/hostedtoolcache/windows/go/1.22.6/x64/src/net/http/httptest/server.go:308 +0xa6
FAIL	github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest	[603](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/10522339745/job/29154786351#step:6:604).840s

=== FAIL: . TestIntegrationInternalMetrics (unknown)
2024-08-23T08:30:14.981Z	info	[email protected]/service.go:119	Setting up own telemetry...
2024-08-23T08:30:14.981Z	info	[email protected]/telemetry.go:98	Serving metrics	{"address": "localhost:8888", "metrics level": "Basic"}
2024-08-23T08:30:14.981Z	info	[email protected]/reporter.go:210	Stopped reporter	{"kind": "exporter", "data_type": "logs", "name": "datadog"}
2024-08-23T08:30:14.981Z	info	extensions/extensions.go:64	Stopping extensions...
2024-08-23T08:30:14.981Z	info	[email protected]/service.go:281	Shutdown complete.
2024-08-23T08:30:15.028Z	info	provider/provider.go:71	Resolved source	{"kind": "exporter", "data_type": "metrics", "name": "datadog", "provider": "azure", "source": {"Kind":"host","Identifier":"2bec1aaa-c73c-434f-af2b-6c9c86f3458c"}}
2024-08-23T08:30:15.028Z	info	datadogexporter/factory.go:399	Trace metrics are now disabled in the Datadog Exporter by default. To continue receiving Trace Metrics, configure the Datadog Connector or disable the feature gate.	{"kind": "exporter", "data_type": "traces", "name": "datadog", "documentation": "https://docs.datadoghq.com/opentelemetry/guide/migration/", "feature gate ID": "exporter.datadogexporter.DisableAPMStats"}
2024-08-23T08:30:15.028Z	info	datadogexporter/zaplogger.go:38	Starting Agent with processor trace buffer of size 0	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-08-23T08:30:15.028Z	info	datadogexporter/zaplogger.go:38	Receiver configured with 2 decoders and a timeout of 0ms	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-08-23T08:30:15.028Z	info	datadogexporter/zaplogger.go:38	Trace writer initialized (climit=5 qsize=1 compression=gzip)	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-08-23T08:30:15.028Z	info	[email protected][622](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/10522339745/job/29154786351#step:6:623)672bc/service.go:204	Starting otelcol...	{"Version": "tests", "NumCPU": 4}
2024-08-23T08:30:15.028Z	info	extensions/extensions.go:37	Starting extensions...
2024-08-23T08:30:15.028Z	info	clientutil/api.go:40	Validating API key.	{"kind": "exporter", "data_type": "metrics", "name": "datadog"}
2024-08-23T08:30:15.028Z	info	datadogexporter/zaplogger.go:38	Processing Pipeline configured with 4 workers	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-08-23T08:30:15.028Z	info	clientutil/api.go:40	Validating API key.	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-08-23T08:30:15.028Z	info	[email protected]/otlp.go:103	Starting GRPC server	{"kind": "receiver", "name": "otlp", "data_type": "traces", "endpoint": "localhost:4317"}
2024-08-23T08:30:15.028Z	info	[email protected]/otlp.go:153	Starting HTTP server	{"kind": "receiver", "name": "otlp", "data_type": "traces", "endpoint": "localhost:4318"}
2024-08-23T08:30:15.092Z	info	clientutil/api.go:44	API key validation successful.	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-08-23T08:30:15.092Z	info	clientutil/api.go:44	API key validation successful.	{"kind": "exporter", "data_type": "metrics", "name": "datadog"}
2024-08-23T08:30:15.092Z	info	prometheusreceiver/metrics_receiver.go:390	Starting discovery manager	{"kind": "receiver", "name": "prometheus", "data_type": "metrics"}
2024-08-23T08:30:15.098Z	info	prometheusreceiver/metrics_receiver.go:368	Scrape job added	{"kind": "receiver", "name": "prometheus", "data_type": "metrics", "jobName": "otelcol"}
2024-08-23T08:30:15.098Z	info	[email protected]/service.go:230	Everything is ready. Begin running and processing data.
2024-08-23T08:30:15.098Z	info	localhostgate/featuregate.go:63	The default endpoints for all servers in components have changed to use localhost instead of 0.0.0.0. Disable the feature gate to temporarily revert to the previous default.	{"feature gate ID": "component.UseLocalHostAsDefaultHost"}
2024-08-23T08:30:15.098Z	error	[email protected][646](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/10522339745/job/29154786351#step:6:647)22672bc/collector.go:322	Asynchronous error received, terminating process	{"error": "listen tcp 127.0.0.1:8888: bind: Only one usage of each socket address (protocol/network address/port) is normally permitted."}
go.opentelemetry.io/collector/otelcol.(*Collector).Run
	C:/Users/runneradmin/go/pkg/mod/go.opentelemetry.io/collector/[email protected]/collector.go:322
github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest.TestIntegrationInternalMetrics.func1
	D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest/integration_test.go:543
2024-08-23T08:30:15.098Z	info	[email protected]/service.go:267	Starting shutdown...
2024-08-23T08:30:15.098Z	info	prometheusreceiver/metrics_receiver.go:459	Starting scrape manager	{"kind": "receiver", "name": "prometheus", "data_type": "metrics"}
2024-08-23T08:30:15.100Z	info	[email protected]/reporter.go:210	Stopped reporter	{"kind": "exporter", "data_type": "metrics", "name": "datadog"}
2024-08-23T08:30:15.100Z	info	extensions/extensions.go:64	Stopping extensions...
2024-08-23T08:30:15.100Z	info	[email protected]/service.go:281	Shutdown complete.
2024-08-23T08:30:15.100Z	info	datadogexporter/zaplogger.go:33	Exiting...	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-08-23T08:30:15.101Z	info	datadogexporter/zaplogger.go:33	Exiting concentrator, computing remaining stats	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-08-23T08:30:16.135Z	warn	zapgrpc/zapgrpc.go:193	[core] [Channel #27 SubChannel #28]grpc: addrConn.createTransport failed to connect to {Addr: "[::1]:4317", ServerName: "localhost:4317", }. Err: connection error: desc = "transport: Error while dialing: dial tcp [::1]:4317: connectex: No connection could be made because the target machine actively refused it."	{"grpc_log": true}
2024-08-23T08:30:16.135Z	warn	zapgrpc/zapgrpc.go:193	[core] [Channel #27 SubChannel #28]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:4317", ServerName: "localhost:4317", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:4317: connectex: No connection could be made because the target machine actively refused it."	{"grpc_log": true}
2024-08-23T08:30:17.137Z	warn	zapgrpc/zapgrpc.go:193	[core] [Channel #27 SubChannel #28]grpc: addrConn.createTransport failed to connect to {Addr: "[::1]:4317", ServerName: "localhost:4317", }. Err: connection error: desc = "transport: Error while dialing: dial tcp [::1]:4317: connectex: No connection could be made because the target machine actively refused it."	{"grpc_log": true}
2024-08-23T08:30:17.137Z	warn	zapgrpc/zapgrpc.go:193	[core] [Channel #27 SubChannel #28]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:4317", ServerName: "localhost:4317", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:4317: connectex: No connection could be made because the target machine actively refused it."	{"grpc_log": true}
2024-08-23T08:30:18.493Z	warn	zapgrpc/zapgrpc.go:193	[core] [Channel #27 SubChannel #28]grpc: addrConn.createTransport failed to connect to {Addr: "[::1]:4317", ServerName: "localhost:4317", }. Err: connection error: desc = "transport: Error while dialing: dial tcp [::1]:4317: connectex: No connection could be made because the target machine actively refused it."	{"grpc_log": true}
2024-08-23T08:30:18.493Z	warn	zapgrpc/zapgrpc.go:193	[core] [Channel #27 SubChannel #28]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:4317", ServerName: "localhost:4317", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:4317: connectex: No connection could be made because the target machine actively refused it."	{"grpc_log": true}
2024-08-23T08:30:21.262Z	warn	zapgrpc/zapgrpc.go:193	[core] [Channel #27 SubChannel #28]grpc: addrConn.createTransport failed to connect to {Addr: "[::1]:4317", ServerName: "localhost:4317", }. Err: connection error: desc = "transport: Error while dialing: dial tcp [::1]:4317: connectex: No connection could be made because the target machine actively refused it."	{"grpc_log": true}
2024-08-23T08:30:21.263Z	warn	zapgrpc/zapgrpc.go:193	[core] [Channel #27 SubChannel #28]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:4317", ServerName: "localhost:4317", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:4317: connectex: No connection could be made because the target machine actively refused it."	{"grpc_log": true}
2024-08-23T08:30:25.971Z	warn	zapgrpc/zapgrpc.go:193	[core] [Channel #27 SubChannel #28]grpc: addrConn.createTransport failed to connect to {Addr: "[::1]:4317", ServerName: "localhost:4317", }. Err: connection error: desc = "transport: Error while dialing: dial tcp [::1]:4317: connectex: No connection could be made because the target machine actively refused it."	{"grpc_log": true}
2024-08-23T08:30:25.971Z	warn	zapgrpc/zapgrpc.go:193	[core] [Channel #27 SubChannel #28]grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:4317", ServerName: "localhost:4317", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:4317: connectex: No connection could be made because the target machine actively refused it."	{"grpc_log": true}
2024/08/23 08:30:26 traces export: context deadline exceeded: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp [::1]:4317: connectex: No connection could be made because the target machine actively refused it."

DONE 5 tests, 2 failures in 1178.785s
make[1]: Leaving directory 'D:/a/opentelemetry-collector-contrib/opentelemetry-collector-contrib'
make: *** [Makefile:127: gotest] Error 2
@crobert-1 crobert-1 added the needs triage New item requiring triage label Aug 23, 2024
Copy link
Contributor

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@github-actions github-actions bot added the exporter/datadog Datadog components label Aug 23, 2024
@songy23 songy23 added flaky test a test is flaky os:windows labels Aug 23, 2024
@songy23 songy23 self-assigned this Aug 23, 2024
@songy23
Copy link
Member

songy23 commented Aug 23, 2024

Looks like this is only on Windows

mx-psi pushed a commit that referenced this issue Aug 27, 2024
**Description:**
Skip flaky test while investigating

**Link to tracking Issue:** 

#34836
@odubajDT
Copy link
Contributor

odubajDT commented Sep 3, 2024

It seems like there is a data race in the test as well

=== FAIL: . TestIntegrationInternalMetrics (7.01s)
2024-09-03T10:02:43.553Z	info	[email protected]/reporter.go:210	Stopped reporter	{"kind": "exporter", "data_type": "metrics", "name": "datadog"}
2024-09-03T10:02:43.556Z	info	extensions/extensions.go:65	Stopping extensions...
2024-09-03T10:02:43.556Z	info	[email protected]/service.go:340	Shutdown complete.
2024-09-03T10:02:43.574Z	info	[email protected]/service.go:178	Setting up own telemetry...
2024-09-03T10:02:43.574Z	info	[email protected]/telemetry.go:98	Serving metrics	{"address": "localhost:8888", "metrics level": "Basic"}
2024-09-03T10:02:43.586Z	info	provider/provider.go:71	Resolved source	{"kind": "exporter", "data_type": "metrics", "name": "datadog", "provider": "azure", "source": {"Kind":"host","Identifier":"d74013b4-9500-468b-b9b5-e7392326d427"}}
2024-09-03T10:02:43.587Z	info	clientutil/api.go:40	Validating API key.	{"kind": "exporter", "data_type": "metrics", "name": "datadog"}
2024-09-03T10:02:43.588Z	info	datadogexporter/factory.go:399	Trace metrics are now disabled in the Datadog Exporter by default. To continue receiving Trace Metrics, configure the Datadog Connector or disable the feature gate.	{"kind": "exporter", "data_type": "traces", "name": "datadog", "documentation": "https://docs.datadoghq.com/opentelemetry/guide/migration/", "feature gate ID": "exporter.datadogexporter.DisableAPMStats"}
2024-09-03T10:02:43.588Z	info	datadogexporter/zaplogger.go:38	Starting Agent with processor trace buffer of size 0	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-09-03T10:02:43.588Z	info	datadogexporter/zaplogger.go:38	Receiver configured with 2 decoders and a timeout of 0ms	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-09-03T10:02:43.588Z	info	clientutil/api.go:44	API key validation successful.	{"kind": "exporter", "data_type": "metrics", "name": "datadog"}
2024-09-03T10:02:43.589Z	info	datadogexporter/zaplogger.go:38	Trace writer initialized (climit=5 qsize=1 compression=gzip)	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-09-03T10:02:43.589Z	info	datadogexporter/zaplogger.go:38	Processing Pipeline configured with 4 workers	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-09-03T10:02:43.589Z	info	clientutil/api.go:40	Validating API key.	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
2024-09-03T10:02:43.590Z	info	clientutil/api.go:44	API key validation successful.	{"kind": "exporter", "data_type": "traces", "name": "datadog"}
==================
WARNING: DATA RACE
Write at 0x00000a662a90 by goroutine 864:
  google.golang.org/grpc/grpclog.SetLoggerV2()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/grpclog/loggerv2.go:75 +0x234
  go.opentelemetry.io/collector/otelcol/internal/grpclog.SetLogger()
      /home/runner/go/pkg/mod/go.opentelemetry.io/collector/[email protected]/internal/grpclog/logger.go:32 +0x1d8
  go.opentelemetry.io/collector/otelcol.(*Collector).setupConfigurationComponents()
      /home/runner/go/pkg/mod/go.opentelemetry.io/collector/[email protected]/collector.go:225 +0xcae
  go.opentelemetry.io/collector/otelcol.(*Collector).Run()
      /home/runner/go/pkg/mod/go.opentelemetry.io/collector/[email protected]/collector.go:282 +0x6a
  github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest.TestIntegrationInternalMetrics.func1()
      /home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest/integration_test.go:548 +0x44

Previous read at 0x00000a662a90 by goroutine 719:
  google.golang.org/grpc/internal/grpclog.InfoDepth()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/internal/grpclog/grpclog.go:37 +0x8a
  google.golang.org/grpc/grpclog.(*componentData).InfoDepth()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/grpclog/component.go:36 +0x16d
  google.golang.org/grpc/internal/channelz.AddTraceEvent()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/internal/channelz/trace.go:191 +0x338
  google.golang.org/grpc/internal/channelz.Infof()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/internal/channelz/logging.go:39 +0x12d
  google.golang.org/grpc.(*connectivityStateManager).updateState()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:539 +0x2ef
  google.golang.org/grpc.(*ccBalancerWrapper).UpdateState()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/balancer_wrapper.go:222 +0x30f
  google.golang.org/grpc/internal/balancer/gracefulswitch.(*balancerWrapper).UpdateState()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/internal/balancer/gracefulswitch/gracefulswitch.go:353 +0x2e1
  google.golang.org/grpc/balancer/pickfirst.(*pickfirstBalancer).updateSubConnState()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/balancer/pickfirst/pickfirst.go:243 +0x3e5
  google.golang.org/grpc/balancer/pickfirst.(*pickfirstBalancer).UpdateClientConnState.func3()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/balancer/pickfirst/pickfirst.go:176 +0x73
  google.golang.org/grpc/internal/balancer/gracefulswitch.(*Balancer).updateSubConnState()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/internal/balancer/gracefulswitch/gracefulswitch.go:261 +0x315
  google.golang.org/grpc/internal/balancer/gracefulswitch.(*balancerWrapper).NewSubConn.func1()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/internal/balancer/gracefulswitch/gracefulswitch.go:376 +0xae
  google.golang.org/grpc.(*acBalancerWrapper).updateState.func1()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/balancer_wrapper.go:263 +0xdd
  google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:82 +0x265
  google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer.gowrap1()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x4f

Goroutine 864 (running) created at:
  github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest.TestIntegrationInternalMetrics()
      /home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest/integration_test.go:547 +0x47e
  testing.tRunner()
      /opt/hostedtoolcache/go/1.22.6/x64/src/testing/testing.go:1689 +0x21e
  testing.(*T).Run.gowrap1()
make[2]: *** [../../../Makefile.Common:133: test-with-cover] Error 1
make[1]: *** [Makefile:187: exporter/datadogexporter/integrationtest] Error 2
make: *** [Makefile:131: gotest-with-cover] Error 2
      /opt/hostedtoolcache/go/1.22.6/x64/src/testing/testing.go:1742 +0x44

Goroutine 719 (running) created at:
  google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/internal/grpcsync/callback_serializer.go:52 +0x206
  google.golang.org/grpc.newCCBalancerWrapper()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/balancer_wrapper.go:83 +0x65
  google.golang.org/grpc.(*ClientConn).initIdleStateLocked()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:347 +0x88
  google.golang.org/grpc.NewClient()
      /home/runner/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:197 +0x1705
  go.opentelemetry.io/otel/exporters/otlp/otlplog/otlploggrpc.newClient()
      /home/runner/go/pkg/mod/go.opentelemetry.io/otel/exporters/otlp/otlplog/[email protected]/client.go:62 +0x3d3
  go.opentelemetry.io/otel/exporters/otlp/otlplog/otlploggrpc.New()
      /home/runner/go/pkg/mod/go.opentelemetry.io/otel/exporters/otlp/otlplog/[email protected]/exporter.go:41 +0xc4
  github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest.sendLogs()
      /home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest/integration_test.go:526 +0x6d
  github.com/open-telemetry/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest.TestIntegrationLogs()
      /home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/datadogexporter/integrationtest/integration_test.go:480 +0x524
  testing.tRunner()
      /opt/hostedtoolcache/go/1.22.6/x64/src/testing/testing.go:1689 +0x21e
  testing.(*T).Run.gowrap1()
      /opt/hostedtoolcache/go/1.22.6/x64/src/testing/testing.go:1742 +0x44

Full log here https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/10680562893/job/29602789741?pr=34729

PR here #34729

@crobert-1
Copy link
Member Author

+1 freq: https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/10793164085/job/29934651463?pr=34729

This frequency is the WARNING: DATA RACE failure that @odubajDT shared as well, it's being hit on Ubuntu. Perhaps we should always skip this test for now, until it can be fixed?

@songy23
Copy link
Member

songy23 commented Sep 10, 2024

The data race seems also an issue from upstream. Will skip race detector for now

@crobert-1
Copy link
Member Author

The data race seems also an issue from upstream. Will skip race detector for now

Can we file an issue upstream that we can reference here, to help us track it and remind us to enable it again once the upstream issue is fixed?

mx-psi pushed a commit that referenced this issue Sep 11, 2024
**Description:** 
Skip `TestIntegrationInternalMetrics` in race detector 

**Link to tracking Issue:** 

#34836
@mx-psi mx-psi added priority:p2 Medium and removed needs triage New item requiring triage labels Sep 11, 2024
f7o pushed a commit to f7o/opentelemetry-collector-contrib that referenced this issue Sep 12, 2024
**Description:**
Skip flaky test while investigating

**Link to tracking Issue:** 

open-telemetry#34836
jriguera pushed a commit to springernature/opentelemetry-collector-contrib that referenced this issue Oct 4, 2024
**Description:** 
Skip `TestIntegrationInternalMetrics` in race detector 

**Link to tracking Issue:** 

open-telemetry#34836
Copy link
Contributor

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@github-actions github-actions bot added the Stale label Nov 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants