Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce RetryAttribute for test methods #4586

Merged
merged 9 commits into from
Jan 15, 2025

Fix build

6d66b83
Select commit
Loading
Failed to load commit list.
Merged

Introduce RetryAttribute for test methods #4586

Fix build
6d66b83
Select commit
Loading
Failed to load commit list.
Azure Pipelines / microsoft.testfx succeeded Jan 15, 2025 in 34m 11s

Build #20250115.39 had test failures

0 errors / 0 warnings

Details

Tests

  • Failed: 4 (0.01%)
  • Passed: 53,020 (99.99%)
  • Other: 0 (0.00%)
  • Total: 53,024
Code coverage

  • 115737 of 190023 blocks covered (60.91%)
  • 78694 of 128807 lines covered (61.09%)

Annotations

Check failure on line 1 in MSTest.Acceptance.IntegrationTests.TimeoutTests.ClassInitialize_WhenTimeoutExpires_ClassInitializeIsCanceled_AttributeTakesPrecedence ("net462")

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.testfx

MSTest.Acceptance.IntegrationTests.TimeoutTests.ClassInitialize_WhenTimeoutExpires_ClassInitializeIsCanceled_AttributeTakesPrecedence ("net462") 

StringAssert.Contains failed. String 'MSTest v3.8.0-ci (UTC 1/15/2025) [x64 - .NET Framework 4.8.9287.0]
[+0/x0/?0] CodeWithOneSecTimeout.exe (net462|x64) - Test1 (3s)
failed Test1 (0ms)
  Class cleanup method 'TestClass.ClassCleanupMethod' timed out after 1000ms
    at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestClassInfo.ExecuteClassCleanup(TestContext testContext)
    at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.UnitTestRunner.RunAssemblyCleanupIfNeeded(ITestContext testContext, ClassCleanupManager classCleanupManager, TypeCache typeCache, UnitTestResult[] results)
Test run summary: Failed! - D:\a\_work\1\s\artifacts\tmp\Release\testsuite\kZzNv\CodeWithOneSecTimeout\bin\Release\net462\CodeWithOneSecTimeout.exe (net462|x64)
  total: 1
  failed: 1
  succeeded: 0
  skipped: 0
  duration: 4s 124ms' does not contain string 'Class initialize method 'TestClass.ClassInit' timed out after 1000ms'. Expression 'AssertOutputContains' failed for member 'RunAndAssertWithRunSettingsAsync' at line 411 of file '/_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TimeoutTests.cs'. Output of the test host is:
Command: D:\a\_work\1\s\artifacts\tmp\Release\testsuite\kZzNv\CodeWithOneSecTimeout\bin\Release\net462\CodeWithOneSecTimeout.exe --settings D:\a\_work\1\s\artifacts\tmp\Release\testsuite\kZzNv\CodeWithOneSecTimeout\bin\Release\net462\4a152fbc8ffb44caadaa54496f005880.runsettings
====================
ExitCode: 2
====================
StandardOutput:
MSTest v3.8.0-ci (UTC 1/15/2025) [x64 - .NET Framework 4.8.9287.0]
[+0/x0/?0] CodeWithOneSecTimeout.exe (net462|x64) - Test1 (3s)
failed Test1 (0ms)
  Class cleanup method 'TestClass.ClassCleanupMethod' timed out after 1000ms
    at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestClassInfo.ExecuteClassCleanup(TestContext testContext)
    at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.UnitTestRunner.RunAssemblyCleanupIfNeeded(ITestContext testContext, ClassCleanupManager classCleanupManager, TypeCache typeCache, UnitTestResult[] results)
Test run summary: Failed! - D:\a\_work\1\s\artifacts\tmp\Release\testsuite\kZzNv\CodeWithOneSecTimeout\bin\Release\net462\CodeWithOneSecTimeout.exe (net462|x64)
  total: 1
  failed: 1
  succeeded: 0
  skipped: 0
  duration: 4s 124ms
====================
StandardError:
.
Raw output 
   at MSTest.Acceptance.IntegrationTests.TimeoutTests.RunAndAssertWithRunSettingsAsync(String tfm, Int32 timeoutValue, Boolean assertAttributePrecedence, String entryKind) in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TimeoutTests.cs:line 411
   at MSTest.Acceptance.IntegrationTests.TimeoutTests.ClassInitialize_WhenTimeoutExpires_ClassInitializeIsCanceled_AttributeTakesPrecedence(String tfm) in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TimeoutTests.cs:line 102

Check failure on line 1 in MSTest.Acceptance.IntegrationTests.TimeoutTests.TestInitialize_WhenTimeoutExpires_TestInitializeIsCanceled_AttributeTakesPrecedence ("net462")

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.testfx

MSTest.Acceptance.IntegrationTests.TimeoutTests.TestInitialize_WhenTimeoutExpires_TestInitializeIsCanceled_AttributeTakesPrecedence ("net462") 

StringAssert.Contains failed. String 'MSTest v3.8.0-ci (UTC 1/15/2025) [x64 - .NET Framework 4.8.9287.0]
[+0/x0/?0] CodeWithOneSecTimeout.exe (net462|x64) - Test1 (2s)
failed Test1 (2s 038ms)
  Class cleanup method 'TestClass.ClassCleanupMethod' timed out after 1000ms
    at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestClassInfo.ExecuteClassCleanup(TestContext testContext)
    at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.UnitTestRunner.RunAssemblyCleanupIfNeeded(ITestContext testContext, ClassCleanupManager classCleanupManager, TypeCache typeCache, UnitTestResult[] results)
Test run summary: Failed! - D:\a\_work\1\s\artifacts\tmp\Release\testsuite\kZzNv\CodeWithOneSecTimeout\bin\Release\net462\CodeWithOneSecTimeout.exe (net462|x64)
  total: 1
  failed: 1
  succeeded: 0
  skipped: 0
  duration: 5s 656ms' does not contain string 'Test initialize method 'TestClass.TestInit' timed out after 1000ms'. Expression 'AssertOutputContains' failed for member 'RunAndAssertWithRunSettingsAsync' at line 411 of file '/_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TimeoutTests.cs'. Output of the test host is:
Command: D:\a\_work\1\s\artifacts\tmp\Release\testsuite\kZzNv\CodeWithOneSecTimeout\bin\Release\net462\CodeWithOneSecTimeout.exe --settings D:\a\_work\1\s\artifacts\tmp\Release\testsuite\kZzNv\CodeWithOneSecTimeout\bin\Release\net462\91a66b7f75e14f01a2f4adc0d2d0fa08.runsettings
====================
ExitCode: 2
====================
StandardOutput:
MSTest v3.8.0-ci (UTC 1/15/2025) [x64 - .NET Framework 4.8.9287.0]
[+0/x0/?0] CodeWithOneSecTimeout.exe (net462|x64) - Test1 (2s)
failed Test1 (2s 038ms)
  Class cleanup method 'TestClass.ClassCleanupMethod' timed out after 1000ms
    at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestClassInfo.ExecuteClassCleanup(TestContext testContext)
    at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.UnitTestRunner.RunAssemblyCleanupIfNeeded(ITestContext testContext, ClassCleanupManager classCleanupManager, TypeCache typeCache, UnitTestResult[] results)
Test run summary: Failed! - D:\a\_work\1\s\artifacts\tmp\Release\testsuite\kZzNv\CodeWithOneSecTimeout\bin\Release\net462\CodeWithOneSecTimeout.exe (net462|x64)
  total: 1
  failed: 1
  succeeded: 0
  skipped: 0
  duration: 5s 656ms
====================
StandardError:
.
Raw output 
   at MSTest.Acceptance.IntegrationTests.TimeoutTests.RunAndAssertWithRunSettingsAsync(String tfm, Int32 timeoutValue, Boolean assertAttributePrecedence, String entryKind) in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TimeoutTests.cs:line 411
   at MSTest.Acceptance.IntegrationTests.TimeoutTests.TestInitialize_WhenTimeoutExpires_TestInitializeIsCanceled_AttributeTakesPrecedence(String tfm) in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TimeoutTests.cs:line 171

Check failure on line 1 in MSTest.Acceptance.IntegrationTests.TimeoutTests.AssemblyInitialize_WhenTimeoutExpires_AssemblyInitializeIsCanceled_AttributeTakesPrecedence ("net462")

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.testfx

MSTest.Acceptance.IntegrationTests.TimeoutTests.AssemblyInitialize_WhenTimeoutExpires_AssemblyInitializeIsCanceled_AttributeTakesPrecedence ("net462") 

StringAssert.Contains failed. String 'MSTest v3.8.0-ci (UTC 1/15/2025) [x64 - .NET Framework 4.8.9287.0]
[+0/x0/?0] CodeWithOneSecTimeout.exe (net462|x64) - Test1 (3s)
failed Test1 (0ms)
  Assembly cleanup method 'TestClass.AssemblyCleanupMethod' timed out after 1000ms
    at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestAssemblyInfo.ExecuteAssemblyCleanup(TestContext testContext)
    at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.UnitTestRunner.RunAssemblyCleanupIfNeeded(ITestContext testContext, ClassCleanupManager classCleanupManager, TypeCache typeCache, UnitTestResult[] results)
Test run summary: Failed! - D:\a\_work\1\s\artifacts\tmp\Release\testsuite\4Jb4F\CodeWithOneSecTimeout\bin\Release\net462\CodeWithOneSecTimeout.exe (net462|x64)
  total: 1
  failed: 1
  succeeded: 0
  skipped: 0
  duration: 4s 187ms' does not contain string 'Assembly initialize method 'TestClass.AssemblyInit' timed out after 1000ms'. Expression 'AssertOutputContains' failed for member 'RunAndAssertWithRunSettingsAsync' at line 411 of file '/_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TimeoutTests.cs'. Output of the test host is:
Command: D:\a\_work\1\s\artifacts\tmp\Release\testsuite\4Jb4F\CodeWithOneSecTimeout\bin\Release\net462\CodeWithOneSecTimeout.exe --settings D:\a\_work\1\s\artifacts\tmp\Release\testsuite\4Jb4F\CodeWithOneSecTimeout\bin\Release\net462\0cb35f43e22f4047aea47fbd1bd2633d.runsettings
====================
ExitCode: 2
====================
StandardOutput:
MSTest v3.8.0-ci (UTC 1/15/2025) [x64 - .NET Framework 4.8.9287.0]
[+0/x0/?0] CodeWithOneSecTimeout.exe (net462|x64) - Test1 (3s)
failed Test1 (0ms)
  Assembly cleanup method 'TestClass.AssemblyCleanupMethod' timed out after 1000ms
    at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestAssemblyInfo.ExecuteAssemblyCleanup(TestContext testContext)
    at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.UnitTestRunner.RunAssemblyCleanupIfNeeded(ITestContext testContext, ClassCleanupManager classCleanupManager, TypeCache typeCache, UnitTestResult[] results)
Test run summary: Failed! - D:\a\_work\1\s\artifacts\tmp\Release\testsuite\4Jb4F\CodeWithOneSecTimeout\bin\Release\net462\CodeWithOneSecTimeout.exe (net462|x64)
  total: 1
  failed: 1
  succeeded: 0
  skipped: 0
  duration: 4s 187ms
====================
StandardError:
.
Raw output 
   at MSTest.Acceptance.IntegrationTests.TimeoutTests.RunAndAssertWithRunSettingsAsync(String tfm, Int32 timeoutValue, Boolean assertAttributePrecedence, String entryKind) in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TimeoutTests.cs:line 411
   at MSTest.Acceptance.IntegrationTests.TimeoutTests.AssemblyInitialize_WhenTimeoutExpires_AssemblyInitializeIsCanceled_AttributeTakesPrecedence(String tfm) in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TimeoutTests.cs:line 97

Check failure on line 1 in MSTest.Acceptance.IntegrationTests.TimeoutTests.TestInitialize_WhenTimeoutExpires_TestInitializeIsCanceled_AttributeTakesPrecedence ("net462")

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.testfx

MSTest.Acceptance.IntegrationTests.TimeoutTests.TestInitialize_WhenTimeoutExpires_TestInitializeIsCanceled_AttributeTakesPrecedence ("net462") 

StringAssert.Contains failed. String 'MSTest v3.8.0-ci (UTC 1/15/2025) [x64 - .NET Framework 4.8.9287.0]
[+0/x0/?0] CodeWithOneSecTimeout.exe (net462|x64) - Test1 (2s)
failed Test1 (1s 995ms)
  Test cleanup method 'TestClass.TestCleanupMethod' timed out after 1000ms
Test run summary: Failed! - D:\a\_work\1\s\artifacts\tmp\Release\testsuite\4Jb4F\CodeWithOneSecTimeout\bin\Release\net462\CodeWithOneSecTimeout.exe (net462|x64)
  total: 1
  failed: 1
  succeeded: 0
  skipped: 0
  duration: 4s 547ms' does not contain string 'Test initialize method 'TestClass.TestInit' timed out after 1000ms'. Expression 'AssertOutputContains' failed for member 'RunAndAssertWithRunSettingsAsync' at line 411 of file '/_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TimeoutTests.cs'. Output of the test host is:
Command: D:\a\_work\1\s\artifacts\tmp\Release\testsuite\4Jb4F\CodeWithOneSecTimeout\bin\Release\net462\CodeWithOneSecTimeout.exe --settings D:\a\_work\1\s\artifacts\tmp\Release\testsuite\4Jb4F\CodeWithOneSecTimeout\bin\Release\net462\3c1139a4ec8741b190dd395553ba4e08.runsettings
====================
ExitCode: 2
====================
StandardOutput:
MSTest v3.8.0-ci (UTC 1/15/2025) [x64 - .NET Framework 4.8.9287.0]
[+0/x0/?0] CodeWithOneSecTimeout.exe (net462|x64) - Test1 (2s)
failed Test1 (1s 995ms)
  Test cleanup method 'TestClass.TestCleanupMethod' timed out after 1000ms
Test run summary: Failed! - D:\a\_work\1\s\artifacts\tmp\Release\testsuite\4Jb4F\CodeWithOneSecTimeout\bin\Release\net462\CodeWithOneSecTimeout.exe (net462|x64)
  total: 1
  failed: 1
  succeeded: 0
  skipped: 0
  duration: 4s 547ms
====================
StandardError:
.
Raw output 
   at MSTest.Acceptance.IntegrationTests.TimeoutTests.RunAndAssertWithRunSettingsAsync(String tfm, Int32 timeoutValue, Boolean assertAttributePrecedence, String entryKind) in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TimeoutTests.cs:line 411
   at MSTest.Acceptance.IntegrationTests.TimeoutTests.TestInitialize_WhenTimeoutExpires_TestInitializeIsCanceled_AttributeTakesPrecedence(String tfm) in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TimeoutTests.cs:line 171
View more details on Azure Pipelines