slow macOS - "##[error]The job running on agent Azure Pipelines 9 ran longer than the maximum time of 60 minutes."

[jeffschwMSFT]

Build

https://dnceng.visualstudio.com/internal/_build/results?buildId=2360768&view=results

Error

##[error]The job running on agent Azure Pipelines 9 ran longer than the maximum time of 60 minutes. For more information, see https://go.microsoft.com/fwlink/?linkid=2077134

Build leg reported

vsos

Pull Request

No response

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "",
    "BuildRetry": false,
    "ErrorPattern": "The job running on agent Azure Pipelines .+ ran longer than the maximum time of .+ minutes.",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng/internal/_build/results?buildId=2360768
Error message validated: [The job running on agent Azure Pipelines .+ ran longer than the maximum time of .+ minutes.]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/7/2024 1:03:13 AM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
2602248	dotnet-dotnet	tvOSSimulator_NativeAOT_Shortstack_x64
2602199	dotnet-arcade-validation	Validate_Signing_MacOS Real_Signing	Log
2602104	dotnet-runtime	Libraries SuperPMI collection libraries_tests_no_tiered_compilation Checked coreclr osx arm64 Release
895768	dotnet/runtime	coreclr Pri0 Runtime Tests Run osx x64 checked	Log	dotnet/runtime#110690
895742	dotnet/runtime	osx-x64 Release CoreCLR_Release	Log
895756	dotnet/runtime	osx-x64 Release CoreCLR_Release	Log
895754	dotnet/runtime	osx-x64 Release CoreCLR_Release	Log
2601833	dotnet-arcade-validation	MacOS Build_Release	Log
895246	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45131
895290	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#44614
895284	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45156
895277	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45458
895242	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#44879
895234	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45465
2601391	dotnet-performance	osx 14 x64 maui_scenarios_ios coreclr iPhoneMini12 8.0	Log
894962	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45419
2601210	dotnet-emsdk	macOS_x64	Log
894780	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45293
894771	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45151
894807	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45452
894620	dotnet/arcade	Windows_NT Build_Release	Log
894512	dotnet/runtime	osx-x64 Release NativeAOT	Log	dotnet/runtime#110404
894494	dotnet/runtime	osx-x64 Release NativeAOT	Log	dotnet/runtime#110685
894484	dotnet/runtime	osx-x64 Release AllSubsets_Mono_Interpreter_RuntimeTests monointerpreter	Log	dotnet/runtime#110682
894453	dotnet/runtime	Libraries Test Run checked coreclr osx x64 Release	Log
2600922	dotnet-runtime	Performance osx x64 release iOSNativeAOT JIT ios_scenarios perfiphone12mini NoJS False True True net10.0	Log
894410	dotnet/runtime	Libraries Test Run checked coreclr osx x64 Debug	Log	dotnet/runtime#110655
893558	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45327
894363	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45427
2600735	dotnet-performance	windows 22H2 arm64 roslyn Ampere 8.0	Log
2600698	dotnet-runtime	Performance osx x64 release iOSMono JIT ios_scenarios perfiphone12mini NoJS True True True net10.0	Log
894100	dotnet/arcade	Windows_NT Build_Release	Log	dotnet/arcade#15334
2600557	dotnet-runtime	Performance osx x64 release iOSNativeAOT JIT ios_scenarios perfiphone12mini NoJS False True True net10.0	Log
2600551	dotnet-arcade-validation	Validate_Signing_MacOS Real_Signing	Log
893783	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45427
2600407	dotnet-runtime	Performance osx x64 release iOSMono JIT ios_scenarios perfiphone12mini NoJS True False True net10.0	Log
893584	dotnet/runtime	osx-x64 Release AllSubsets_Mono_Interpreter_RuntimeTests monointerpreter	Log	dotnet/runtime#109143
892151	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45392
893504	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45405
893447	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45427
893355	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#44969
893430	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45293
893387	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45327
2600164	dotnet-runtime	Performance osx x64 release iOSNativeAOT JIT ios_scenarios perfiphone12mini NoJS False False True net10.0	Log
893295	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45409
893274	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45388
893271	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45394
2600027	dotnet-runtime	Performance osx x64 release iOSMono JIT ios_scenarios perfiphone12mini NoJS True False True net10.0	Log
893004	dotnet/runtime	osx-arm64 release CrossAOT_Mono crossaot	Log	dotnet/runtime#110477
2599910	dotnet-dotnet	OSX_ShortStack_Mono_CrossAOT_x64
892698	dotnet/runtime	osx-x64 release Installer_Build_And_Test	Log	dotnet/runtime#110622
2599749	dotnet-runtime	Performance osx x64 release iOSMono JIT ios_scenarios perfiphone12mini NoJS True False True net10.0	Log
892407	dotnet/arcade	Windows_NT Build_Release	Log	dotnet/arcade#15323
2599634	dotnet-runtime	Performance osx x64 release iOSMono JIT ios_scenarios perfiphone12mini NoJS True False True net10.0	Log
2599627	dotnet-performance	windows 22H2 arm64 roslyn Ampere main	Log
2599515	dotnet-runtime	Performance osx x64 release iOSMono JIT ios_scenarios perfiphone12mini NoJS True True True net10.0	Log
892146	dotnet/aspnetcore	Test: Blazor E2E tests on Linux	Log	dotnet/aspnetcore#59389
2599242	dotnet-performance	ubuntu 2204 arm64 fsharpmicro Ampere main	Log
2599230	dotnet-arcade-validation	MacOS Build_Release	Log
891873	dotnet/aspnetcore	Test: macOS	Log	dotnet/aspnetcore#59424
2598790	dotnet-runtime	Performance osx x64 release iOSMono JIT ios_scenarios perfiphone12mini NoJS True False True net10.0	Log
890955	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45381
890296	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45351
890761	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45274
891021	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45265
891014	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45293
891002	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45353
890993	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45042
2598687	dotnet-runtime	Performance osx x64 release iOSMono JIT ios_scenarios perfiphone12mini NoJS False True True net10.0	Log
890849	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45327
890888	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45293
890824	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45374
890810	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45380
2598607	dotnet-runtime	Performance osx x64 release iOSMono JIT ios_scenarios perfiphone12mini NoJS True False True net10.0	Log
890838	dotnet/sdk	AoT: macOS (x64)	Log	dotnet/sdk#44862
890835	dotnet/sdk	TestBuild: macOS (arm64)	Log	dotnet/sdk#45371
890821	dotnet/sdk	TestBuild: macOS (x64)	Log	dotnet/sdk#45375
890817	dotnet/sdk	AoT: macOS (x64)	Log	dotnet/sdk#45376
890814	dotnet/sdk	TestBuild: macOS (x64)	Log	dotnet/sdk#45377
890811	dotnet/sdk	TestBuild: macOS (x64)	Log	dotnet/sdk#45378
890807	dotnet/sdk	TestBuild: macOS (x64)	Log	dotnet/sdk#45381
890643	dotnet/sdk	AoT: macOS (x64)	Log	dotnet/sdk#45160
890724	dotnet/sdk	TestBuild: macOS (x64)	Log	dotnet/sdk#45388
890700	dotnet/sdk	AoT: macOS (x64)	Log	dotnet/sdk#45265
2598521	dotnet-performance	windows 22H2 arm64 roslyn Ampere main	Log
890674	dotnet/sdk	TestBuild: macOS (x64)	Log	dotnet/sdk#45042
890670	dotnet/sdk	AoT: macOS (x64)	Log	dotnet/sdk#45356
890662	dotnet/runtime	osx-arm64 Release NativeAOT	Log	dotnet/runtime#110465
890658	dotnet/runtime	osx-arm64 Release NativeAOT	Log	dotnet/runtime#110105
890652	dotnet/sdk	TestBuild: macOS (x64)	Log	dotnet/sdk#44611
890256	dotnet/runtime	osx-arm64 Release NativeAOT	Log	dotnet/runtime#110481
890264	dotnet/sdk	AoT: macOS (x64)	Log	dotnet/sdk#45366
2598447	dotnet-runtime	Performance osx x64 release iOSMono JIT ios_scenarios perfiphone12mini NoJS True False True net10.0	Log
890309	dotnet/sdk	AoT: macOS (x64)	Log	dotnet/sdk#45383
890588	dotnet/runtime	osx-arm64 Release NativeAOT	Log	dotnet/runtime#110540
890581	dotnet/runtime	osx-arm64 Release NativeAOT	Log	dotnet/runtime#110542
890579	dotnet/sdk	TestBuild: macOS (x64)	Log	dotnet/sdk#45376
890575	dotnet/sdk	TestBuild: macOS (x64)	Log	dotnet/sdk#45384
890562	dotnet/runtime	osx-arm64 Release NativeAOT	Log	dotnet/runtime#110551
890559	dotnet/runtime	osx-arm64 Release NativeAOT	Log	dotnet/runtime#110545
Displaying 100 of 345 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
4	145	345

[lewing]

🤔

[nagilson]

@dotnet/dnceng @dougbu This has impacted a lot of PRs recently, may you PTAL into expanding this Mac resource?