Skip to content

AutoMLExperiment_return_current_best_trial_when_ct_is_canceled_with_trial_completed_Async fails in CI #7418

Open

Description

@ericstj

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=976255
Build error leg or test failing: Microsoft.ML.AutoML.Test.AutoMLExperimentTests.AutoMLExperiment_return_current_best_trial_when_ct_is_canceled_with_trial_completed_Async
Pull request: #7414

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "AutoMLExperiment_return_current_best_trial_when_ct_is_canceled_with_trial_completed_Async",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Error:

Starting test: Microsoft.ML.AutoML.Test.AutoMLExperimentTests.AutoMLExperiment_Taxi_Fare_CV_5_Test
    Microsoft.ML.AutoML.Test.AutoMLExperimentTests.AutoMLExperiment_return_current_best_trial_when_ct_is_canceled_with_trial_completed_Async [FAIL]
�[31;1m�[m�[37m      Expected value to be less than or equal to 2500L, but found 3236L (difference of 736).
�[m�[30;1m      Stack Trace:
�[m�[37m           at FluentAssertions.Execution.XUnit2TestFramework.Throw(String message)
�[m�[37m           at FluentAssertions.Execution.TestFrameworkProvider.Throw(String message)
�[m�[37m           at FluentAssertions.Execution.DefaultAssertionStrategy.HandleFailure(String message)
�[m�[37m           at FluentAssertions.Execution.AssertionScope.FailWith(Func`1 failReasonFunc)
�[m�[37m           at FluentAssertions.Execution.AssertionScope.FailWith(Func`1 failReasonFunc)
�[m�[37m           at FluentAssertions.Execution.AssertionScope.FailWith(String message, Object[] args)
�[m�[37m           at FluentAssertions.Numeric.NumericAssertions`2.BeLessThanOrEqualTo(T expected, String because, Object[] becauseArgs)
�[m�[37m           at FluentAssertions.Numeric.NumericAssertions`2.BeLessOrEqualTo(T expected, String because, Object[] becauseArgs)
�[m�[37m        /__w/1/s/test/Microsoft.ML.AutoML.Tests/AutoMLExperimentTests.cs(146,0): at Microsoft.ML.AutoML.Test.AutoMLExperimentTests.AutoMLExperiment_return_current_best_trial_when_ct_is_canceled_with_trial_completed_Async()
�[m�[37m        --- End of stack trace from previous location ---

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=976255
Error message validated: [AutoMLExperiment_return_current_best_trial_when_ct_is_canceled_with_trial_completed_Async]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 3/12/2025 1:13:43 AM UTC

Report

Build Repository Test Pull Request
1660208 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoFitTests.AutoFitRecommendationTest
1659370 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoFitTests.AutoFitRecommendationTest
1659168 dotnet/machinelearning Microsoft.ML.AutoML.Tests.WorkItemExecution #7869
1656395 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoFitTests.AutoFitMultiClassification_Image_TrainTest #7867
1655959 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoFitTests.AutoFitRecommendationTest
1655753 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test #7866
1655758 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoMLExperimentTests.AutoMLExperiment_return_current_best_trial_when_ct_is_canceled_with_trial_completed_Async #7864
1651045 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoFitTests.AutoFitMultiClassification_Image_TrainTest #7863
1647380 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoFitTests.AutoFitMultiClassification_Image_TrainTest #7857
1645345 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoMLExperimentTests.AutoMLExperiment_return_current_best_trial_when_ct_is_canceled_with_trial_completed_Async #7845
1643775 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoFitTests.AutoFitMultiClassification_Image_TrainTest #7833
1642171 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoFitTests.AutoFitRecommendationTest #7704
1640309 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoFitTests.AutoFitRecommendationTest #7817
1635408 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoMLExperimentTests.AutoMLExperiment_return_current_best_trial_when_ct_is_canceled_with_trial_completed_Async #7747
1633155 dotnet/machinelearning Microsoft.ML.AutoML.Tests.WorkItemExecution #7767
1632367 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoFitTests.AutoFitMultiClassification_Image_TrainTest #7762
1631941 dotnet/machinelearning Microsoft.ML.AutoML.Test.AutoFitTests.AutoFitRecommendationTest #7696

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
1 8 17

Activity

  1. added this to the ML.NET 5.0 milestone on Mar 17, 2025
  2. added
    area-AutoMLAutomated machine learning, Model Builder, and ML.NET CLI
    on Sep 8, 2026
  3. rosebyte commented on Oct 23, 2026

    @rosebyte
    Member

    Triage: the test is still failing, let's fix it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Known Build ErrorUse this to report build issues in the .NET Helix tabarea-AutoMLAutomated machine learning, Model Builder, and ML.NET CLIblocking-clean-ciBlocking PR or rolling buildsyellowmaintenance only

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions