Skip to content

[wasi] Cannot find host wasmtime #100394

Closed

Description

@pavelsavara

Log

    Wasi.Build.Tests.ILStripTests.WasmStripILAfterAOT_TestDefaultAndOverride(stripILAfterAOT: "", expectILStripping: True, singleFileBundle: False) [FAIL]
       Expected 0 exit code but got 255: /root/helix/work/workitem/e/dotnet-latest/dotnet run --no-silent --no-build -c Release
      Standard Output:
      [Release_3ubcj3n5_xxb] WasmAppHost --runtime-config /root/helix/work/workitem/e/wbt artifacts/Release_3ubcj3n5_xxb/bin/Release/net9.0/wasi-wasm/AppBundle/Release_3ubcj3n5_xxb.runtimeconfig.json --no-silent
      [Release_3ubcj3n5_xxb] Error: Cannot find host wasmtime: Tried to look for wasmtime in PATH: /root/helix/work/workitem/e/dotnet-latest, /root/helix/work/correlation/dotnet-latest, /root/helix/work/correlation/xharness-cli, /root/helix/work/correlation/dotnet-cli, /root/helix/work/correlation/wasi-sdk, /root/helix/work/correlation/wasmtime, /home/helixbot/.jsvu/bin, /usr/local/sbin, /usr/local/bin, /usr/sbin, /usr/bin, /sbin, /bin .

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=621924

Error Message

{
  "ErrorMessage": "Cannot find host wasmtime",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=621924
Error message validated: [Cannot find host wasmtime]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 3/28/2024 9:09:15 AM UTC

Report

Build Definition Test Pull Request
645396 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100141
645013 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100272
644758 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #101095
640285 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100157
640282 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100938
639606 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100661
639437 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100520
638169 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100407
637618 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100407
637478 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100858
637169 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100847
637144 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100846
635807 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100801
635488 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100386
634844 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100610
634832 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #91042
634711 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100767
633684 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish
631271 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100618
630000 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100407
629576 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100610
629024 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #98492
628517 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #98492
627438 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #96169
626872 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100517
624831 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100402
623845 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100283
623635 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100141
622955 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #96169
621924 dotnet/runtime Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish #100251

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 0 30

Activity

  1. added
    Known Build ErrorUse this to report build issues in the .NET Helix tab
    os-wasiRelated to WASI variant of arch-wasm
    on Mar 28, 2024
  2. ghost added
    needs-area-labelAn area label is needed to ensure this gets routed to the appropriate area owners
    on Mar 28, 2024
  3. dotnet-policy-service commented on Mar 28, 2024

    @dotnet-policy-service
    Contributor

    Tagging subscribers to 'arch-wasm': @lewing
    See info in area-owners.md if you want to be subscribed.

  4. added and removed
    untriagedNew issue has not been triaged by the area owner
    needs-area-labelAn area label is needed to ensure this gets routed to the appropriate area owners
    on Mar 28, 2024
  5. added this to the 9.0.0 milestone on Mar 28, 2024
  6. pavelsavara commented on Mar 28, 2024

    @pavelsavara
    MemberAuthor
  7. akoeplinger commented on Mar 29, 2024

    @akoeplinger
    Member

    It looks like wasmtime is missing from the correlation payload which suggests to me something goes wrong here:

    ** Staging system directories before use as helix payloads **
    Helix tries to write a `.payload` file to the payload directory, but if that is
    not writable then it needs to be staged first. For example:
    <HelixDependenciesToStage Condition="'$(NeedsWasmtime)' == 'true'" SourcePath="$(WasmtimeDir)" Include="$(WasmtimeDirForHelixPayload)" />

  8. maraf commented on Apr 4, 2024

    @maraf
    Member
    Red hering - windows investigation - on windows everything works

    From Build.binlog
    WasmtimeDir = D:\a\_work\1\s\artifacts\obj\wasmtime\
    Downloading from "https://github.com/bytecodealliance/wasmtime/releases/download/v5.0.0/wasmtime-v5.0.0-x86_64-windows.zip" to "D:\a\_work\1\s\artifacts\obj\wasmtime-v5.0.0-x86_64-windows.zip" (3995602 bytes).
    image
    image
    image
    image
    image
    image
    image

    From SendToHelix.binlog
    WasmtimeDir = D:\a\_work\1\s\artifacts\obj\wasmtime\
    WasmtimeDirForHelixPayload = D:\a\_work\1\s\artifacts\obj\helix-staging\\wasmtime

    One of the corellation payload was empty (empty zip) https://helixde107v0xdeko0k025g8.blob.core.windows.net/helix-job-887530b8-8cc0-4dab-a4c8-242ff41fa82b18102e030f94a06bf/c7d44711-29d4-4ff7-944f-947d4f8dea8a.zip

    It all seems correct from the binlog :/

    From Build.binlog
    image
    image
    We don't provision wasmtime on linux. It's preinstalled in the image. Could it be that copy fails because of some symlink or something?

    I have tried to ignore WASMTIME_PATH (system provided wasmtime) in #100664 and it worked. The corellation payload that is normally empty, contains wasmtime now.

  9. maraf commented on Apr 5, 2024

    @maraf
    Member

    I'm not seeing it anymore

    EDIT: It happens sometimes and on linux lines only

  10. added
    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
    on Apr 8, 2024
  11. 7 remaining items

  12. lewing commented on Apr 24, 2024

    @lewing
    Member

    Is this still matching the correct failures?

  13. maraf commented on Apr 25, 2024

    @maraf
    Member

    @pavelsavara You saw this on lib tests, right? But all of the matches are from WBT 🤔

  14. maraf commented on Apr 25, 2024

    @maraf
  15. pavelsavara commented on Apr 25, 2024

    @pavelsavara
    MemberAuthor

    @pavelsavara You saw this on lib tests, right? But all of the matches are from WBT 🤔

    I just saw ls -lsa twice because BuildHelixItems -> PrepareHelixCorrelationPayload_Wasi is called twice. In Build and in Test which are separate MSBuild runs. I don't know why.

    Also, we won't see it after #101392

    I'm not sure about that, why you think so ?
    It will get downloaded every time

    • as before on windows
    • now as well on linux
  16. maraf commented on Apr 25, 2024

    @maraf
    Member

    I'm not sure about that, why you think so ?

    My bad, sorry

  17. pavelsavara commented on Apr 25, 2024

    @pavelsavara
    MemberAuthor

    well maybe it will fix because you saw it on linux, which was using pre-installed. Now it will be fresh every time.

  18. maraf commented on Apr 25, 2024

    @maraf
    Member

    well maybe it will fix because you saw it on linux, which was using pre-installed. Now it will be fresh every time.

    That was my previous thinking, but later it looks like the files are there always, and then are deleted from staging folder

  19. maraf commented on Apr 25, 2024

    @maraf
    Member

    Theory

    • sendtohelixhelp.proj runs in parallel for two scenarios (workloads, noworkloads) EDIT: not scenario, but same loop
      • First runs StageDependenciesForHelix, because @(__HelixDependenciesToStageThatDontExist->Count()) > 0
          1. It creates folders for payloads
          1. It copies (a lot of) files
          1. Copying files is finished
          1. Executes SendToHelixJob, but zips are already uploaded, reusing them
      • Second doesn't run StageDependenciesForHelix, because @(__HelixDependenciesToStageThatDontExist->Count()) == 0
          1. Folders for payloads already exist
          1. Pass them to SendToHelixJob, which zips folders and upload them

    According to this theory, WASI SDK payloads shouldn't be always complete

  20. pavelsavara commented on Apr 25, 2024

    @pavelsavara
    MemberAuthor

    workloads, noworkloads are not scenarios

  21. reopened this on Apr 26, 2024
  22. lewing commented on Apr 26, 2024

    @lewing
    Member

    reopening for a few days to let the fix make it into pr builds

  23. locked and limited conversation to collaborators on May 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Known Build ErrorUse this to report build issues in the .NET Helix tabarch-wasmWebAssembly architecturearea-Build-monoblocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'os-wasiRelated to WASI variant of arch-wasm

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions