Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failure on Helix tests - Tests timing out #40074

Open
MiYanni opened this issue Apr 9, 2024 · 7 comments
Open

Failure on Helix tests - Tests timing out #40074

MiYanni opened this issue Apr 9, 2024 · 7 comments
Labels
Area-Infrastructure Area-Watch Known Build Error untriaged Request triage from a team member

Comments

@MiYanni
Copy link
Member

MiYanni commented Apr 9, 2024 •
edited by build-analysis bot
Loading

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799
Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution
Pull request: #40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799
Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build Definition Test Pull Request
880512 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45167
881072 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution #45192
880855 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45179
880741 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #45171
880736 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44974
880749 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45174
878114 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45053
880496 dotnet/sdk dotnet.Tests.dll.25.WorkItemExecution #45125
880380 dotnet/sdk Microsoft.NET.Publish.Tests.GivenThatWeWantToRunILLink1.ILLink_links_simple_app_without_analysis_warnings_and_it_runs #44540
880425 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45156
880303 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #45144
880107 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #45131
880244 dotnet/sdk EndToEnd.Tests.dll.2.WorkItemExecution #45159
878656 dotnet/sdk EndToEnd.Tests.dll.2.WorkItemExecution #45115
877297 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45056
879808 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44899
879918 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45151
879751 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #45147
879638 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43085
879617 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #45137
879450 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44417
879431 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44974
879190 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45128
878962 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution #45108
879274 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #45131
879317 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45125
878867 dotnet/sdk Microsoft.NET.Build.Tests.dll.24.WorkItemExecution #44856
879244 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45095
879225 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45125
879114 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44969
878861 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44974
876391 dotnet/sdk Microsoft.NET.Publish.Tests.GivenThatWeWantToRunILLink1.ILLink_links_simple_app_without_analysis_warnings_and_it_runs #44540
873544 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44956
878388 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45108
878144 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44417
878108 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #45091
877787 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution #45046
877997 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45095
877961 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution #45007
877942 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #45073
877955 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #44899
877897 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #45084
877802 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45081
877758 dotnet/sdk Microsoft.NET.Build.Tests.dll.14.WorkItemExecution #44899
877716 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution #44786
877637 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution #45071
877627 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44786
877636 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #45070
877305 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45046
877502 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution #45052
877446 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #44786
877424 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44786
877383 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44786
877303 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45058
877309 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44786
877240 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.19.WorkItemExecution #44786
875878 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44974
876270 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45007
874245 dotnet/sdk dotnet.Tests.dll.27.WorkItemExecution #44899
877117 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45052
876945 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44786
876977 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44958
876780 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45046
876774 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44786
876387 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44963
2586915 dotnet-sdk dotnet-watch.Tests.dll.3.WorkItemExecution #45249
876242 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44786
876138 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44786
875084 dotnet/sdk Microsoft.NET.Clean.Tests.dll.WorkItemExecution #44958
876040 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #44417
875914 dotnet/sdk dotnet.Tests.dll.27.WorkItemExecution #44786
875908 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #45021
875785 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44786
875754 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution #45009
875651 dotnet/sdk dotnet.Tests.dll.16.WorkItemExecution #44417
875513 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44828
875499 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44805
875495 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution #44417
874185 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #44805
875354 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #44786
875288 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution #44786
875211 dotnet/sdk dotnet.Tests.dll.14.WorkItemExecution #44967
875019 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44417
875023 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution #44828
874749 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution #44974
874772 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44986
874824 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44988
874653 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44980
874402 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44962
874562 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.19.WorkItemExecution #44974
874542 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution #44786
874471 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44953
874254 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44967
874428 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution #44786
874416 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44801
874413 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44972
874255 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44966
874364 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution #44786
874350 dotnet/sdk Microsoft.NET.Build.Tests.dll.14.WorkItemExecution #44866
874270 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution #44786
Displaying 100 of 381 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
16 84 381
@dotnet-issue-labeler dotnet-issue-labeler bot added Area-Infrastructure untriaged Request triage from a team member labels Apr 9, 2024
@ericstj ericstj mentioned this issue May 20, 2024
Merged
@nagilson
Copy link
Member

@tmat May you please look at this dotnet watch failure?

@tmat
Copy link
Member

tmat commented May 20, 2024 •
edited
Loading

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

@nagilson
Copy link
Member

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

@nagilson
Copy link
Member

We also just hit it in main, so there might be another existing problem: #41045

@ViktorHofer ViktorHofer mentioned this issue Jun 20, 2024
Merged
@ellahathaway ellahathaway mentioned this issue Jul 2, 2024
Closed
@baronfel
Copy link
Member

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

@tmat
Copy link
Member

tmat commented Aug 15, 2024

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

@baronfel
Copy link
Member

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.

@akoeplinger akoeplinger changed the title Darwin Build_Release failure on Helix tests - Tests timing out Failure on Helix tests - Tests timing out Nov 15, 2024
@akoeplinger akoeplinger mentioned this issue Nov 15, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Area-Infrastructure Area-Watch Known Build Error untriaged Request triage from a team member
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@tmat @baronfel @MiYanni @nagilson