Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dotnet-watch tests failing #40006

Open
dsplaisted opened this issue Apr 4, 2024 · 12 comments
Open

dotnet-watch tests failing #40006

dsplaisted opened this issue Apr 4, 2024 · 12 comments
Assignees
Labels
Milestone

Comments

@dsplaisted
Copy link
Member

dsplaisted commented Apr 4, 2024

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=629827
Build error leg or test failing: dotnet-watch.Tests.dll.1.WorkItemExecution
Pull request: #39888

Error Message

##[error].packages/microsoft.dotnet.helix.sdk/8.0.0-beta.24177.1/tools/Microsoft.DotNet.Helix.Sdk.MultiQueue.targets(89,5): error : (NETCORE_ENGINEERING_TELEMETRY=Test) Work item dotnet-watch.Tests.dll.1 in job 82728a56-9430-4356-ab82-1c21670792a7 has failed

{
  "ErrorMessage": "",
  "ErrorPattern": "Work item dotnet-watch\\.Tests\\.dll\\.1 in job [a-z0-9\\-]+ has failed",
  "BuildRetry": true,
  "ExcludeConsoleLog": true
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=629827
Error message validated: [Work item dotnet-watch\.Tests\.dll\.1 in job [a-z0-9\-]+ has failed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/4/2024 9:51:10 AM UTC

Report

Build Definition Step Name Console log Pull Request
2666585 dotnet-sdk Run TestBuild Tests Log #48610
2666514 dotnet-sdk Run FullFramework Tests Log #48610
984079 dotnet/sdk Run TestBuild Tests Log #47684
983579 dotnet/sdk Run TestBuild Tests Log #46218
983580 dotnet/sdk Run TestBuild Tests Log #47661
982672 dotnet/sdk Run TestBuild Tests Log #47608
982540 dotnet/sdk Run FullFramework Tests Log #47531
2664035 dotnet-sdk Run FullFramework Tests Log #48496
981459 dotnet/sdk Run FullFramework Tests Log #47631
2663663 dotnet-sdk Run TestBuild Tests Log #48483
2663664 dotnet-sdk Run TestBuild Tests Log #48482
980722 dotnet/sdk Run TestBuild Tests Log #47586
980698 dotnet/sdk 🟣 Run TestBuild Tests Log #47606
2663151 dotnet-sdk Run FullFramework Tests Log #48453
980197 dotnet/sdk Run TestBuild Tests Log #47531
980050 dotnet/sdk Run TestBuild Tests Log #47587
980141 dotnet/sdk Run TestBuild Tests Log #47552
979988 dotnet/sdk Run TestBuild Tests Log #47575
979909 dotnet/sdk 🟣 Run TestBuild Tests Log #47572
2662650 dotnet-sdk Run FullFramework Tests Log #48424
2662645 dotnet-sdk Run Tests in Helix Log #48427
979343 dotnet/sdk Run TestBuild Tests Log #47537
979340 dotnet/sdk Run TestBuild Tests Log #47528
979334 dotnet/sdk Run TestBuild Tests Log #47518
979037 dotnet/sdk Run TestBuild Tests Log #47552
978733 dotnet/sdk Run TestBuild Tests Log #47528
977843 dotnet/sdk 🟣 Run TestBuild Tests Log #47519
978471 dotnet/sdk Run FullFramework Tests Log #47538
978584 dotnet/sdk Run TestBuild Tests Log #47532
978359 dotnet/sdk Run TestBuild Tests Log #47512
978381 dotnet/sdk Run TestBuild Tests Log #47528
977841 dotnet/sdk Run TestBuild Tests Log #47514
2661696 dotnet-sdk Run FullFramework Tests Log #48367
977642 dotnet/sdk Run FullFramework Tests Log #47508
977456 dotnet/sdk Run TestBuild Tests Log #47466
976823 dotnet/sdk Run TestBuild Tests Log #47490
976824 dotnet/sdk Run TestBuild Tests Log #47465
976415 dotnet/sdk Run TestBuild Tests Log #47465
976234 dotnet/sdk Run Tests in Helix Log
975976 dotnet/sdk Run TestBuild Tests Log #47465
975942 dotnet/sdk 🟣 Run TestBuild Tests Log #47463
975813 dotnet/sdk Run TestBuild Tests Log #47456
2660290 dotnet-sdk Run FullFramework Tests Log #47785
2660291 dotnet-sdk Run TestBuild Tests Log #48211
2660147 dotnet-sdk Run FullFramework Tests Log #47785
2660148 dotnet-sdk Run TestBuild Tests Log #47786
2660012 dotnet-sdk Run FullFramework Tests Log #47785
975039 dotnet/sdk Run TestBuild Tests Log #47431
2659849 dotnet-sdk Run TestBuild Tests Log #47785
2659709 dotnet-sdk Run TestBuild Tests Log #47785
974015 dotnet/sdk Run TestBuild Tests Log #47021
973649 dotnet/sdk Run Tests in Helix Log #47034
973104 dotnet/sdk Run TestBuild Tests Log #47391
972964 dotnet/sdk Run TestBuild Tests Log #47385
972767 dotnet/sdk Run TestBuild Tests Log #47383
2658101 dotnet-sdk Run FullFramework Tests Log #47785
972436 dotnet/sdk Run TestBuild Tests Log #47321
972266 dotnet/sdk Run TestBuild Tests Log #47364
972248 dotnet/sdk Run TestBuild Tests Log #47328
971996 dotnet/sdk 🟣 Run TestBuild Tests Log #47226
2657333 dotnet-sdk Run FullFramework Tests Log #47785
2657334 dotnet-sdk Run TestBuild Tests Log #47786
971502 dotnet/sdk Run TestBuild Tests Log #47235
971497 dotnet/sdk Run TestBuild Tests Log #46844
971031 dotnet/sdk Run TestBuild Tests Log #47326
970984 dotnet/sdk Run TestBuild Tests Log #47325
970804 dotnet/sdk 🟣 Run TestBuild Tests Log #47226
970588 dotnet/sdk 🟣 Run TestBuild Tests Log #47308
970729 dotnet/sdk Run TestBuild Tests Log #47305
970387 dotnet/sdk Run FullFramework Tests Log #47304
970349 dotnet/sdk Run FullFramework Tests Log #47299
970391 dotnet/sdk Run TestBuild Tests Log #47305
970298 dotnet/sdk 🟣 Run FullFramework Tests Log #47226
970165 dotnet/sdk 🟣 Run FullFramework Tests Log #47226
969669 dotnet/sdk 🟣 Run TestBuild Tests Log #47289
969246 dotnet/sdk Run FullFramework Tests Log #47271
969000 dotnet/sdk 🟣 Run TestBuild Tests Log #47263
969045 dotnet/sdk 🟣 Run TestBuild Tests Log #47266
968265 dotnet/sdk Run TestBuild Tests Log #47245
968264 dotnet/sdk Run TestBuild Tests Log #47244
968222 dotnet/sdk Run TestBuild Tests Log #47237
967762 dotnet/sdk 🟣 Run TestBuild Tests Log #47226
967812 dotnet/sdk Run FullFramework Tests Log #46989
967670 dotnet/sdk 🟣 Run TestBuild Tests Log #47225
967261 dotnet/sdk 🟣 Run TestBuild Tests Log #47220
966586 dotnet/sdk 🟣 Run FullFramework Tests Log #47212
965524 dotnet/sdk Run TestBuild Tests Log #47021
965388 dotnet/sdk Run TestBuild Tests Log #47184
965182 dotnet/sdk 🟣 Run TestBuild Tests Log #47175
965175 dotnet/sdk Run TestBuild Tests Log #47174
965066 dotnet/sdk 🟣 Run TestBuild Tests Log #47169
964829 dotnet/sdk 🟣 Run TestBuild Tests Log #47159
964710 dotnet/sdk 🟣 Run FullFramework Tests Log #47146
964688 dotnet/sdk 🟣 Run TestBuild Tests Log #47157
964593 dotnet/sdk Run TestBuild Tests Log #47119
964145 dotnet/sdk Run TestBuild Tests Log #47112
964071 dotnet/sdk 🟣 Run TestBuild Tests Log #47144
964037 dotnet/sdk Run TestBuild Tests Log #47143
963883 dotnet/sdk Run TestBuild Tests Log #47112
963332 dotnet/sdk 🟣 Run TestBuild Tests Log #47126
Displaying 100 of 224 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
3 38 200
@marcpopMSFT
Copy link
Member

@tmat
Copy link
Member

tmat commented Jun 26, 2024

No luck yet. This might help: https://github.com/dotnet/sdk/blob/d45e40d665e647804de03d2b4eec2aae9c488cb5/test/dotnet-watch.Tests/xunit.runner.json

It will print out test info every 20 seconds a test is running.

@marcpopMSFT
Copy link
Member

@tmat another failure this morning shows a bunch of build processes for watch apps still running... https://helixre107v0xd1eu3ibi6ka.blob.core.windows.net/dotnet-sdk-refs-pull-41958-merge-84357342ee154a5088/dotnet-watch.Tests.dll.2/1/console.3dddc463.log?helixlogtype=result

@tmat
Copy link
Member

tmat commented Jul 3, 2024

Looks like that's in 8.0 branch. Porting test diagnostics from 9: #41963

@Forgind
Copy link
Member

Forgind commented Aug 26, 2024

This has been making one of my PRs fail today, so I looked into it a bit. Based on when this issue was created and which tests are failing, I suspect this PR:
#39618

I asked jasonmalinowski whether the MSBuildWorkspace is supposed to support F# because I'd found a code snippet that suggested that it shouldn't, and he said it doesn't and never did. Did that PR make us use MSBuildWorkspace in a different way than we had before?

@Forgind
Copy link
Member

Forgind commented Aug 26, 2024

The changes to HotReloadDotNetWatcher look most suspicious to me. It looks like a substantial change to how we call MSBuild.

@Forgind
Copy link
Member

Forgind commented Jan 18, 2025

Ping @tmat
This is still a serious pain point, currently preventing MSBuild from merging their code flow to 9.0.2xx. I already clicked rerun twice. I pointed to a PR that I think is likely to blame.

@tmat
Copy link
Member

tmat commented Jan 19, 2025

Fixes targeting 9.0.3xx: #45999, #46141

@nagilson
Copy link
Member

@tmat Thank you for making some PRs to try to remedy this -- we are still seeing this in 9.0.2xx, 9.0.1xx, and main, 10 preview 2. Do your changes need to be ported?

@tmat
Copy link
Member

tmat commented Feb 20, 2025

They don't flow automatically to main?

Re 9.0.2xx, 9.0.1xx - these are product changes. Do they meet the servicing bar?

@nagilson
Copy link
Member

nagilson commented Feb 20, 2025

They should flow to main, but either something went wrong and it didn't for those PRs, or the fix did not work, since it is still showing up in .net 10 preview 2: #46983

I dont think they would meet the bar that, so good point. 9.0.3xx though, they probably do.

@tmat
Copy link
Member

tmat commented Feb 21, 2025

Might be something else causing failure in 10 P2. Do you have a link to the failed run? The PR is merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

5 participants