Skip to content

MsQuic fails with QUIC_STATUS_OUT_OF_MEMORY on AzureLinux #123216

Closed

Description

@rzikm

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=1254154
Build error leg or test failing: System.Net.Http.Functional.Tests.Http3ResponseStreamZeroByteReadTest.ZeroByteRead_BlocksUntilDataIsAvailable
Pull request: #123091

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "System.Net.Quic.QuicException : An internal error has occurred. RegistrationOpen failed: QUIC_STATUS_OUT_OF_MEMORY",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}
   at System.Net.Quic.ThrowHelper.ThrowMsQuicException(Int32 status, String message) in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/ThrowHelper.cs:line 144
   at System.Net.Quic.MsQuicApi..ctor(QUIC_API_TABLE* apiTable) in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/MsQuicApi.cs:line 50
   at System.Net.Quic.MsQuicApi.AllocateMsQuicApi() in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/MsQuicApi.cs:line 235
   at System.Lazy`1.ViaFactory(LazyThreadSafetyMode mode) in /_/src/libraries/System.Private.CoreLib/src/System/Lazy.cs:line 321
--- End of stack trace from previous location ---
   at System.Lazy`1.CreateValue() in /_/src/libraries/System.Private.CoreLib/src/System/Lazy.cs:line 429
   at System.Net.Quic.MsQuicApi.get_Api() in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/MsQuicApi.cs:line 57
   at System.Net.Quic.QuicListener..ctor(QuicListenerOptions options) in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicListener.cs:line 127
   at System.Net.Quic.QuicListener.ListenAsync(QuicListenerOptions options, CancellationToken cancellationToken) in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicListener.cs:line 63
   at System.Net.Test.Common.Http3LoopbackServer..ctor(Http3Options options) in /_/src/libraries/Common/tests/System/Net/Http/Http3LoopbackServer.cs:line 57
   at System.Net.Test.Common.Http3LoopbackServerFactory.CreateServer(GenericLoopbackOptions options) in /_/src/libraries/Common/tests/System/Net/Http/Http3LoopbackServer.cs:line 109
   at System.Net.Test.Common.Http3LoopbackServerFactory.CreateServerAsync(Func`3 funcAsync, Int32 millisecondsTimeout, GenericLoopbackOptions options) in /_/src/libraries/Common/tests/System/Net/Http/Http3LoopbackServer.cs:line 114
   at System.Net.Http.Functional.Tests.ResponseStreamZeroByteReadTestBase.ZeroByteRead_BlocksUntilDataIsAvailable(Boolean async) in /_/src/libraries/System.Net.Http/tests/FunctionalTests/ResponseStreamZeroByteReadTests.cs:line 204
--- End of stack trace from previous location ---

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1254154
Error message validated: [System.Net.Quic.QuicException : An internal error has occurred. RegistrationOpen failed: QUIC_STATUS_OUT_OF_MEMORY]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 1/15/2026 2:21:33 PM UTC

Report

Build Definition Test Pull Request
1390914 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #124494
1390901 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1390899 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1390303 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126152
1389329 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #124494
1389020 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1389028 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1388404 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126341
1387415 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue
1386909 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #124027
1386871 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1386870 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1386491 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #125945
1386026 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1386029 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1385314 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue
1385293 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1385292 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1385257 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #127067
1384681 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #127067
1384434 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue
1383806 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1383799 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1383753 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #127067
1383697 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatforms_IsSupportedIsTrue #125945
1381829 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WaitForReadsClosedAsync_ServerReadAborted_Throws
1382249 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue
1381941 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #125945
1381894 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126999
1381812 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1381809 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1367390 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #125945
1380409 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue
1379975 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1379976 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1379471 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126136
1379462 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue
1379072 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126913
1379061 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126912
1378666 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126897
1378443 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126136
1378431 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue
1378054 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1378049 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1376536 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1376545 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1375693 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1375691 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1375039 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1375030 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1374442 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws #126152
1373799 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1373803 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1373008 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126136
1372996 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws
2947490 dotnet-runtime System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws #59957
1372185 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WaitForReadsClosedAsync_ServerReadAborted_Throws #126152
1371932 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1371937 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
2946627 dotnet-runtime System.Net.Quic.Tests.QuicStreamTests.ReadOutstanding_ReadAborted_Throws #59957
1370333 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WaitForReadsClosedAsync_ServerReadAborted_Throws #126152
1369935 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1369923 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1369035 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WaitForReadsClosedAsync_ConnectionClosed_Throws #126616
1368496 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1368479 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1365906 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.ReadOutstanding_ReadAborted_Throws #126152
1365330 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1365329 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1364721 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws #126152
1364443 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126200
1363768 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1363759 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1363155 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws #126341
1361814 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1361815 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1359937 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1359950 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1359248 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.ReadAbortedWithoutReading_WriteThrows #126341
1357823 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1357812 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1357668 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126200
1357401 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #125945
1356911 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1356909 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1356362 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1356351 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1354934 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws #126152
1354920 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126200
1354677 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1354673 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1353753 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.GetStreamIdWithoutStartWorks #126152
1353546 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
1353561 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_UnsuccessfulRequest_LogsStartFailedStop
1353195 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws
1353014 dotnet/runtime System.Net.Quic.Tests.MsQuicPlatformDetectionTests.SupportedLinuxPlatformsWithMsQuic_IsSupportedIsTrue #126136
1352988 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WaitForReadsClosedAsync_ServerReadAborted_Throws
1352957 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws #126134
1352899 dotnet/runtime System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws #126119
1351900 dotnet/runtime System.Net.Http.Functional.Tests.TelemetryTest_Http30.EventSource_SuccessfulRequest_LogsStartStop
Displaying 100 of 101 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 26 101

Activity

  1. added
    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
    Known Build ErrorUse this to report build issues in the .NET Helix tab
    on Jan 15, 2026
  2. dotnet-policy-service commented on Jan 15, 2026

    @dotnet-policy-service
    Contributor

    Tagging subscribers to this area: @karelz, @dotnet/ncl
    See info in area-owners.md if you want to be subscribed.

  3. added this to the 11.0.0 milestone on Jan 15, 2026
  4. ManickaP commented on Jan 15, 2026

    @ManickaP
    Member

    This is once again problem with AzL3. Downgrade of SymCrypt-OpenSSL from 1.9.4 to 1.9.3 will help. We need to update the helix docker images to pin that package to 1.9.3 for the time being.

    I have internally contacted responsible people from AzL3, so it's in the process.

  5. ManickaP commented on Jan 20, 2026

    @ManickaP
    Member

    This has stopped occurring since dotnet/dotnet-buildtools-prereqs-docker#1576.
    We need to remove the downgrade in the docker images once it gets fixed in SymCrypt, so keeping this open.

    KQL query:

    AzureDevOpsTests
    | where Message contains "RegistrationOpen failed: QUIC_STATUS_OUT_OF_MEMORY"
    | order by RunCompleted desc
    | take 100
    
  6. self-assigned this
    on Jan 20, 2026
  7. added
    tracking-external-issueThe issue is caused by external problem (e.g. OS) - nothing we can do to fix it directly
    and removed
    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
    Known Build ErrorUse this to report build issues in the .NET Helix tab
    on Jan 20, 2026
  8. 15 remaining items

  9. vcsjones commented on Mar 23, 2026

    @vcsjones
    Member

    Does this mean we can unpin the SCOSSL in the docker image now since the tests are disabled? SCOSSL has fixes in the latest version that are blocking #118807.

  10. ManickaP commented on Mar 23, 2026

    @ManickaP
    Member

    I disabled this only when ran directly on AzL3 VM, not in docker, so that we don't completely lose the coverage.

  11. vcsjones commented on Mar 26, 2026

    @vcsjones
    Member

    @ManickaP Do we have any progress or understanding of a resolution? Holding back SymCrypt-OpenSSL is preventing some work in System.Security from getting merged because SCOSSL 1.9.4+ have fixes we need for a clean CI run.

  12. ManickaP commented on Mar 27, 2026

    @ManickaP
    Member

    It's not held back on AzureLinux3 VM, just in the docker images. If we disable our tests in docker as well, we're gonna lose majority of our test coverage, but if you think it's an acceptable trade-off, I can do it.
    And just for an FYI, ETA for the SymCrypt (1.9.5) fix is next week AFAIK.

  13. xnox commented on Apr 9, 2026

    @xnox

    @ManickaP I see that https://github.com/microsoft/azurelinux/blob/3.0/SPECS/SymCrypt-OpenSSL/SymCrypt-OpenSSL.spec is now at 1.9.5 as merged two weeks ago microsoft/azurelinux#16139

    Is it time to attempt to upgrade to 1.9.5 and see if it sticks?

  14. locked and limited conversation to collaborators on May 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Known Build ErrorUse this to report build issues in the .NET Helix tabarea-System.Net.Quicblocking-clean-ci-optionalBlocking optional rolling runsdisabled-testThe test is disabled in source code against the issuetracking-external-issueThe issue is caused by external problem (e.g. OS) - nothing we can do to fix it directly

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions