[build] Add windows-11-arm and ubuntu-24.04-arm to CI run-tests.yaml

[nietras]

cc @timcassell

[timcassell]

SingleBenchmarkCanBeExecutedForMultipleRuntimes is failing because it's testing Platform.X64. I think simply removing the platform from the job should work.

BenchmarkCanAllocateMoreThan2Gb test is failing because it's testing Platform.X64 and Platform.X86. It needs to be updated for Arm.

NoHangs test is also failing, though I can't tell why from the logs.

[nietras]

@timcassell tried to address issues in the two tests. As I have no insight into the specifics of these I am somewhat guessing here, so it is probably more a more efficient use of time if you guys just fix these directly yourselves, so feel free to make changes here or elsewhere necessary for these CI changes. Or let me know what to do specifically. :)

[timcassell]

I don't have a Windows Arm machine to test with, so I can only go off of the logs.

[timcassell]

BenchmarkCanAllocateMoreThan2Gb is failing at line 47 because ClrRuntime is not included on Arm. net481 supports Arm, so it should be tested, though I'm not sure if it should be testing Arm64 or Arm. [Edit] Looks like it only officially supports Arm64.

[timcassell]

If you have an Arm machine to test with, can you try to figure out why NoHangs is failing?

[filzrev]

It seems egor-tensin/setup-clang action explicitly install x64 version Clang & LLVM

Is this settings ares used inside integration tests?
or already skipped on ARM64 platform, or testing x64 binary on ARM64?

[nietras]

I don't have a Windows Arm machine to test with, so I can only go off of the logs.
If you have an Arm machine to test with, can you try to figure out why NoHangs is failing?

I don't have any ARM pc. Hence, why I am in no better shape to fix these issues, worse even since have no idea why these tests look like they do. 😅 So if anybody has an idea how to fix please do, or make a pr to this pr with necessary changes.

[timcassell]

I pushed some test fixes, but I'm not sure how to fix remaining.

Disassembler fails on test-windows-core (windows-11-arm)

Failed CanDisassembleAllMethodCalls [1 ms]
  Error Message:
   System.InvalidOperationException : No data found for BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests.CanDisassembleAllMethodCalls

New Mono tests are all failing

error NU1101: Unable to find package Microsoft.NETCore.App.Runtime.Mono.win-arm64. No packages exist with this id in source(s): api.nuget.org, dotnet10, dotnet6, dotnet7, dotnet8, dotnet9 

@adamsitnik Maybe you have ideas, or could ping someone who might?

[adamsitnik]

I pushed some test fixes, but I'm not sure how to fix remaining.

Disassembler fails on test-windows-core (windows-11-arm)

Failed CanDisassembleAllMethodCalls [1 ms]
  Error Message:
   System.InvalidOperationException : No data found for BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests.CanDisassembleAllMethodCalls

New Mono tests are all failing

error NU1101: Unable to find package Microsoft.NETCore.App.Runtime.Mono.win-arm64. No packages exist with this id in source(s): api.nuget.org, dotnet10, dotnet6, dotnet7, dotnet8, dotnet9 

@adamsitnik Maybe you have ideas, or could ping someone who might?

I am sorry, I've missed this GH notification (I am signed up to everything in BDN and sometimes I struggle to find direct mentions).

It's very likely that Mono does not support it by design. Let's exclude the problematic tests for given configs.

[timcassell]

The report job is running forever and can't be canceled (unrelated).

Thanks @nietras.

[nietras]

Wonderful, @timcassell thanks for finishing it.