Template engine tests hitting known parallelism issue in GetVisualStudioInstances

[marcpopMSFT]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=869444
Build error leg or test failing: Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewInstantiateTests.CanInstantiateTemplate_WithConditions_BasedOnFileName
Pull request: #44859

Error Message

{
  "ErrorMessage": "57005",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=869444
Error message validated: [57005]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 11/14/2024 7:41:30 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
985240	dotnet/sdk	Build	Log	#47338
985279	dotnet/sdk	🟣 Build	Log	#45633
2666494	dotnet-sdk	Run Tests in Helix and non Helix in parallel	Log	#48608
984279	dotnet/sdk	Run Tests	Log	#47652
984193	dotnet/sdk	Build	Log	#47500
984061	dotnet/sdk	Run Tests in Helix	Log	#47645
983579	dotnet/sdk	Run FullFramework Tests	Log	#46218
983190	dotnet/sdk	Build	Log	#47659
982215	dotnet/sdk	Build	Log	#47338
981444	dotnet/sdk	Run Tests	Log	#47580
980701	dotnet/sdk	Clone dotnet/dotnet	Log	#47480
979987	dotnet/sdk	Run TestBuild Tests	Log	#47574
979641	dotnet/sdk	Build	Log	#47509
979739	dotnet/sdk	Build	Log	#47076
2662667	dotnet-sdk	OneLocBuild	Log
978977	dotnet/sdk	Build	Log	#47544
978956	dotnet/sdk	🟣 Run TestBuild Tests	Log	#46425
978893	dotnet/sdk	Build	Log	#47544
978707	dotnet/sdk	🟣 Run FullFramework Tests	Log	#47507
978519	dotnet/sdk	Build	Log	#47167
978359	dotnet/sdk	Build	Log	#47512
977637	dotnet/sdk	🟣 Run FullFramework Tests	Log	#47510
977283	dotnet/sdk	Build	Log	#47480
977117	dotnet/sdk	Build	Log	#47499
976656	dotnet/sdk	Build	Log	#47480
975295	dotnet/sdk	Build	Log	#47167
973178	dotnet/sdk	Build	Log	#47377
972967	dotnet/sdk	Build	Log	#47388
972750	dotnet/sdk	🟣 Build	Log	#47377
972577	dotnet/sdk	Build	Log	#47321
972569	dotnet/sdk	Build	Log	#47371
972575	dotnet/sdk	Build	Log
971923	dotnet/sdk	Build	Log	#47359
970981	dotnet/sdk	Run Tests in Helix	Log	#47322
970164	dotnet/sdk	Build	Log	#47226
969671	dotnet/sdk	Build	Log	#47290
969163	dotnet/sdk	Build	Log	#47167
969044	dotnet/sdk	Build	Log	#47266
2654113	dotnet-sdk	OneLocBuild	Log
966256	dotnet/sdk	Synchronize dotnet/dotnet (Unix)	Log	#47208
966009	dotnet/sdk	🟣 Build	Log	#42416
965436	dotnet/sdk	Build	Log	#47185
965415	dotnet/sdk	🟣 Build	Log	#47171
965048	dotnet/sdk	Build	Log	#47167
965287	dotnet/sdk	🟣 Build	Log	#47177
2652367	dotnet-sdk	🟣 Build	Log
964429	dotnet/sdk	Build	Log	#47152
2651349	dotnet-sdk	Build (cblMariner20Fpm)	Log
963858	dotnet/sdk	Build	Log	#47141
963883	dotnet/sdk	Build	Log	#47112
963706	dotnet/sdk	Build	Log	#47131
963414	dotnet/sdk	🟣 Build	Log	#47127
963246	dotnet/sdk	Build	Log	#47119
963141	dotnet/sdk	Build	Log	#47100
962350	dotnet/sdk	🟣 Run TestBuild Tests	Log	#47098
2649347	dotnet-sdk	🟣 Build	Log
960955	dotnet/sdk	🟣 Run TestBuild Tests	Log	#46994
960649	dotnet/sdk	🟣 Run TestBuild Tests	Log	#47004
959248	dotnet/sdk	🟣 Run TestBuild Tests	Log	#47026
2647667	dotnet-sdk	🟣 Build	Log
959005	dotnet/sdk	Synchronize dotnet/dotnet (Unix)	Log	#46994
957567	dotnet/sdk	Build	Log	#46967
958621	dotnet/sdk	🟣 Run FullFramework Tests	Log	#46997
2647087	dotnet-sdk	🟣 Build	Log
958298	dotnet/sdk	Build	Log	#46994
2646622	dotnet-sdk	OneLocBuild	Log
957401	dotnet/sdk	Synchronize dotnet/dotnet (Unix)	Log	#46967
956954	dotnet/sdk	Build	Log	#45872
956638	dotnet/sdk	Checkout dotnet/sdk@refs/pull/46951/merge to s	Log	#46951
956349	dotnet/sdk	Build	Log	#46949
955718	dotnet/sdk	🟣 Run TestBuild Tests	Log	#46926
955592	dotnet/sdk	Build	Log	#46425
2645223	dotnet-sdk	🟣 Build	Log
955047	dotnet/sdk	🟣 Build	Log	#46908
954882	dotnet/sdk	Run FullFramework Tests	Log	#46901

Build	Definition	Test	Pull Request
981526	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	#47616
960728	dotnet/sdk	Microsoft.DotNet.Cli.Test.Tests.GivenDotnetTestBuildsAndDiscoversTests.Microsoft.DotNet.Cli.Test.Tests.GivenDotnetTestBuildsAndDiscoversTests.DiscoverProjectWithMSTestMetaPackageAndMultipleTFMsWithTests_ShouldReturnExitCodeSuccess	#46997
959908	dotnet/sdk	dotnet.Tests.dll.19.WorkItemExecution	#46991
958908	dotnet/sdk	dotnet.Tests.dll.16.WorkItemExecution	#47014
958543	dotnet/sdk	dotnet.Tests.dll.9.WorkItemExecution	#46965

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
5	25	75

[BrennanConroy]

Template engine tests hitting known parallelism issue in GetVisualStudioInstances

Is there an issue describing the problem? Are there people working on fixing it? We're hitting this in the aspnetcore repo a lot and as far as I'm aware we don't do anything with UWP which is how the sdk resolved the problem.

[baronfel]

@jaredpar sent a PR here with a short-term workaround that we're working to merge: #44930

The 'true' fix is coming in a future VS release, there was some unintended concurrent access to a critical section that wasn't locked.