Repository navigation
SIGSEGV in System.Net.Quic.Functional.Tests #121575
Description
Seeing this on both ARM32 and x64 Alpine in my PR.
Discovering: System.Net.Quic.Functional.Tests (method display = ClassAndMethod, method display options = None)
Discovered: System.Net.Quic.Functional.Tests (found 142 of 153 test cases)
Starting: System.Net.Quic.Functional.Tests (parallel test collections = on [2 threads], stop on fail = off)
MsQuic supported and using 'libmsquic.so 2.4.5.0 (Unknown)' (OpenSSL).
System.Net.Quic.Tests.MsQuicPlatformDetectionTests.UnsupportedPlatforms_ThrowsPlatformNotSupportedException [SKIP]
Condition(s) not met: "IsQuicUnsupported"
[createdump] Gathering state for process 35 dotnet
[createdump] Crashing thread 0036 signal 11 (000b)
[createdump] Writing crash report to file /datadisks/disk1/dumps/coredump.35.dmp.crashreport.json
[createdump] Crash report successfully written
[createdump] Writing minidump with heap to file /datadisks/disk1/dumps/coredump.35.dmp
[createdump] Written 156844032 bytes (38292 pages) to core file
[createdump] Target process is alive
[createdump] Dump successfully written in 332ms
waitpid() returned successfully (wstatus 00000000) WEXITSTATUS 0 WTERMSIG 0
./RunTests.sh: line 178: 35 Segmentation fault (core dumped) "$RUNTIME_PATH/dotnet" exec --runtimeconfig System.Net.Quic.Functional.Tests.runtimeconfig.json --depsfile System.Net.Quic.Functional.Tests.deps.json xunit.console.dll System.Net.Quic.Functional.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing $RSP_FILE
/root/helix/work/workitem/e
----- end Thu Nov 13 08:00:33 UTC 2025 ----- exit code 139 ----------------------------------------------------------
exit code 139 means SIGSEGV Illegal memory access. Deref invalid pointer, overrunning buffer, stack overflow etc. Core dumped.
Build Information
Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=1201719
Build error leg or test failing: System.Net.Quic.Functional.Tests.WorkItemExecution
Pull request: #121570
Error Message
Fill the error message using step by step known issues guidance.
{
"ErrorMessage": ["System.Net.Quic.Functional.Tests", "exit code 139"],
"ErrorPattern": "",
"BuildRetry": false,
"ExcludeConsoleLog": false
}Known issue validation
Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1201719
Error message validated: [System.Net.Quic.Functional.Tests exit code 139]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 11/13/2025 10:44:21 AM UTC
Report
Summary
| 24-Hour Hit Count | 7-Day Hit Count | 1-Month Count |
|---|---|---|
| 2 | 23 | 93 |
Activity
ManickaP commentedon Nov 18, 2025
Great, works on my machine (tm). Even with the exact same docker image we use in Helix. This will take a bit. If it's super blocking, I can disable QUIC tests on Alpine 3.21.
ManickaP commentedon Dec 4, 2025
#121647 (comment)
From
runfo get-helix-payload -j aba1f875-f698-420d-b4aa-03e134688e5a -w System.Net.Http.Functional.Tests -o c:\helix_payload- crashing at:ManickaP commentedon Dec 4, 2025
Based on Kusto data this started happening on 5.11. and corresponds to #121331. All the crashes are using those specific images with those SHAs. Also, this doesn't seem to be specific to base VM as it happened in the past on Ubuntu queues as well. Also, I'm still unable to reproduce it in any way. So I'm gonna continue with checking the dumps we already have and in parallel, I might try updating the image if it helps.
am11 commentedon Dec 4, 2025
Copilot seem to have removed
RUN apk add --repository=http://dl-cdn.alpinelinux.org/alpine/edge/community/ libmsquicline yesterday: dotnet/dotnet-buildtools-prereqs-docker@d0042b1#diff-fcdfb3a477b488c95732f2dbe1c17a756a9c4da02a0cbdacce9d0b1f73a933fbI think we need we need to add that line in all four helix images so it picks up the latest v2.4.16 (https://pkgs.alpinelinux.org/package/edge/community/x86_64/libmsquic):
src/alpine/3.21/helix/Dockerfile,src/alpine/3.22/helix/Dockerfile, ``src/alpine/3.23/helix/Dockerfileandsrc/alpine/edge/helix/Dockerfile`. Then few hours after the images are built, images will be published.ManickaP commentedon Dec 4, 2025
I do concur that the change is suspicious but how does is relate to crashes happening for the past month?
ManickaP commentedon Dec 4, 2025
The images in main were updated in #122168, so I'll keep observing for one more day. But if the crashes settle down, I will consider this as resolved.
am11 commentedon Dec 4, 2025
It was for your previous comment:
I might try updating the image if it helps..Package was updated to 2.4.16 yesterday
2025-12-02upstream for all architectures https://pkgs.alpinelinux.org/packages?name=libmsquic&branch=edge&repo=&arch=&origin=&flagged=&maintainer=. And coincidentally copilot did the wrong thing (removed "latest" flag) yesterday which is strange.ManickaP commentedon Dec 4, 2025
Hehe, I didn't realize I was beat to it and from our data it seems that it helped, fingers crossed.
Alpine 3.23 has 2.4.16 msquic. And I'm not 100% convinced we should pull the latest msquic for all alpine images, we should be testing with what the customers get. And update msquic in older Alpine versions if necessary.
ManickaP commentedon Dec 5, 2025
No longer happens with the updated images. This was happening only on the alpine 3.21 images with the SHA specified. Seems resolved, closing.