Benchmarks for dotnet/runtime#124858 (for @EgorBo)

[EgorBot]

Processing benchmark request from PR dotnet/runtime#124858.

Targets: macos15_helix_arm64, ubuntu24_azure_turin, windows_azure_emeraldrapids
Commits: main;PR_124858

• macos15_helix_arm64: live logs
• ubuntu24_azure_turin: live logs
• windows_azure_emeraldrapids: live logs

Results will be posted here once they are ready.

[EgorBot]

windows_azure_emeraldrapids — Failed

@EgorBo

At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.
Status: 200 (OK)
ErrorCode: DeploymentFailed

Service request succeeded. Response content and headers are not included to avoid logging sensitive data.

Job | Full logs

[EgorBot]

Results for macos15_helix_arm64

@EgorBo

BenchmarkDotNet v0.15.8, macOS Sequoia 15.4.1 (24E263) [Darwin 24.4.0]
Apple M2, 1 CPU, 8 logical and 8 physical cores
.NET SDK 11.0.100-preview.3.26124.102
  [Host]     : .NET 10.0.3 (10.0.3, 10.0.326.7603), Arm64 RyuJIT armv8.0-a

EnvironmentVariables=DOTNET_ReadyToRun=0  

Method	Toolchain	Mean	Error	Ratio
SmallBigEndian	PR #124858	1.0228 ns	0.0016 ns	1.00
SmallBigEndian	main	0.8623 ns	0.0009 ns	0.84
SmallLittleEndian	PR #124858	1.0236 ns	0.0024 ns	1.00
SmallLittleEndian	main	0.8140 ns	0.0192 ns	0.80
MediumPositiveBigEndian	PR #124858	3.1437 ns	0.0463 ns	1.00
MediumPositiveBigEndian	main	2.8853 ns	0.0030 ns	0.92
MediumPositiveLittleEndian	PR #124858	3.2295 ns	0.0021 ns	1.00
MediumPositiveLittleEndian	main	4.0160 ns	0.0329 ns	1.24
LargePositiveBigEndian	PR #124858	9.4305 ns	0.0044 ns	1.00
LargePositiveBigEndian	main	6.4844 ns	0.0109 ns	0.69
LargePositiveLittleEndian	PR #124858	9.6988 ns	0.0071 ns	1.00
LargePositiveLittleEndian	main	6.4035 ns	0.0036 ns	0.66
MediumNegativeBigEndian	PR #124858	3.8195 ns	0.0057 ns	1.00
MediumNegativeBigEndian	main	3.5240 ns	0.0031 ns	0.92
MediumNegativeLittleEndian	PR #124858	4.0984 ns	0.0871 ns	1.00
MediumNegativeLittleEndian	main	3.2118 ns	0.0027 ns	0.78
LargeNegativeBigEndian	PR #124858	11.6041 ns	0.0058 ns	1.00
LargeNegativeBigEndian	main	6.9393 ns	0.0034 ns	0.60
LargeNegativeLittleEndian	PR #124858	10.6719 ns	0.0054 ns	1.00
LargeNegativeLittleEndian	main	6.7054 ns	0.0049 ns	0.63
NegativeSignExtendBigEndian	PR #124858	7.5312 ns	0.0060 ns	1.00
NegativeSignExtendBigEndian	main	7.5800 ns	0.0069 ns	1.01
NegativeSignExtendLittleEndian	PR #124858	7.3837 ns	0.0089 ns	1.00
NegativeSignExtendLittleEndian	main	7.3303 ns	0.0385 ns	0.99

Full logs

[EgorBot]

Results for ubuntu24_azure_turin

@EgorBo

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 9V45 2.60GHz, 1 CPU, 8 logical and 4 physical cores
.NET SDK 11.0.100-preview.3.26124.102
  [Host]     : .NET 10.0.3 (10.0.3, 10.0.326.7603), X64 RyuJIT x86-64-v4

EnvironmentVariables=DOTNET_ReadyToRun=0  

Method	Toolchain	Mean	Error	Ratio
SmallBigEndian	PR #124858	1.0196 ns	0.0178 ns	1.00
SmallBigEndian	main	1.1526 ns	0.0042 ns	1.13
SmallLittleEndian	PR #124858	0.9758 ns	0.0055 ns	1.00
SmallLittleEndian	main	1.0962 ns	0.0039 ns	1.12
MediumPositiveBigEndian	PR #124858	2.6296 ns	0.0183 ns	1.00
MediumPositiveBigEndian	main	2.8231 ns	0.0077 ns	1.07
MediumPositiveLittleEndian	PR #124858	2.8119 ns	0.0299 ns	1.00
MediumPositiveLittleEndian	main	2.3677 ns	0.0161 ns	0.84
LargePositiveBigEndian	PR #124858	8.6373 ns	0.1949 ns	1.00
LargePositiveBigEndian	main	6.6157 ns	0.0080 ns	0.77
LargePositiveLittleEndian	PR #124858	7.9803 ns	0.0296 ns	1.00
LargePositiveLittleEndian	main	5.4854 ns	0.0239 ns	0.69
MediumNegativeBigEndian	PR #124858	4.6940 ns	0.0173 ns	1.00
MediumNegativeBigEndian	main	3.9347 ns	0.0202 ns	0.84
MediumNegativeLittleEndian	PR #124858	4.5540 ns	0.0196 ns	1.00
MediumNegativeLittleEndian	main	3.5540 ns	0.0234 ns	0.78
LargeNegativeBigEndian	PR #124858	13.6830 ns	0.0460 ns	1.00
LargeNegativeBigEndian	main	9.0106 ns	0.0123 ns	0.66
LargeNegativeLittleEndian	PR #124858	12.9175 ns	0.0357 ns	1.00
LargeNegativeLittleEndian	main	9.0079 ns	0.0105 ns	0.70
NegativeSignExtendBigEndian	PR #124858	8.9813 ns	0.0058 ns	1.00
NegativeSignExtendBigEndian	main	7.9783 ns	0.0352 ns	0.89
NegativeSignExtendLittleEndian	PR #124858	8.7463 ns	0.0626 ns	1.00
NegativeSignExtendLittleEndian	main	6.6389 ns	0.0623 ns	0.76

Full logs

[EgorBo]

@EgorBot -amd -arm -windows-intel

using System.Numerics;
using BenchmarkDotNet.Attributes;
using BenchmarkDotNet.Running;

BenchmarkSwitcher.FromAssembly(typeof(Bench).Assembly).Run(args);

public class Bench
{
    private BigInteger _small;
    private BigInteger _mediumPositive;
    private BigInteger _largePositive;
    private BigInteger _mediumNegative;
    private BigInteger _largeNegative;
    private BigInteger _negativeSignExtend;
    private byte[] _dest = default!;

    [GlobalSetup]
    public void Setup()
    {
        _small = new BigInteger(42);
        _mediumPositive = BigInteger.Parse("123456789012345678901234567890");
        _largePositive = BigInteger.Pow(2, 512) + 1;
        _mediumNegative = BigInteger.Parse("-123456789012345678901234567890");
        _largeNegative = -(BigInteger.Pow(2, 512) + 1);
        _negativeSignExtend = -(BigInteger.Pow(2, 255));
        _dest = new byte[256];
    }

    [Benchmark]
    public bool SmallBigEndian()
    {
        return ((IBinaryInteger<BigInteger>)_small).TryWriteBigEndian(_dest, out _);
    }

    [Benchmark]
    public bool SmallLittleEndian()
    {
        return ((IBinaryInteger<BigInteger>)_small).TryWriteLittleEndian(_dest, out _);
    }

    [Benchmark]
    public bool MediumPositiveBigEndian()
    {
        return ((IBinaryInteger<BigInteger>)_mediumPositive).TryWriteBigEndian(_dest, out _);
    }

    [Benchmark]
    public bool MediumPositiveLittleEndian()
    {
        return ((IBinaryInteger<BigInteger>)_mediumPositive).TryWriteLittleEndian(_dest, out _);
    }

    [Benchmark]
    public bool LargePositiveBigEndian()
    {
        return ((IBinaryInteger<BigInteger>)_largePositive).TryWriteBigEndian(_dest, out _);
    }

    [Benchmark]
    public bool LargePositiveLittleEndian()
    {
        return ((IBinaryInteger<BigInteger>)_largePositive).TryWriteLittleEndian(_dest, out _);
    }

    [Benchmark]
    public bool MediumNegativeBigEndian()
    {
        return ((IBinaryInteger<BigInteger>)_mediumNegative).TryWriteBigEndian(_dest, out _);
    }

    [Benchmark]
    public bool MediumNegativeLittleEndian()
    {
        return ((IBinaryInteger<BigInteger>)_mediumNegative).TryWriteLittleEndian(_dest, out _);
    }

    [Benchmark]
    public bool LargeNegativeBigEndian()
    {
        return ((IBinaryInteger<BigInteger>)_largeNegative).TryWriteBigEndian(_dest, out _);
    }

    [Benchmark]
    public bool LargeNegativeLittleEndian()
    {
        return ((IBinaryInteger<BigInteger>)_largeNegative).TryWriteLittleEndian(_dest, out _);
    }

    [Benchmark]
    public bool NegativeSignExtendBigEndian()
    {
        return ((IBinaryInteger<BigInteger>)_negativeSignExtend).TryWriteBigEndian(_dest, out _);
    }

    [Benchmark]
    public bool NegativeSignExtendLittleEndian()
    {
        return ((IBinaryInteger<BigInteger>)_negativeSignExtend).TryWriteLittleEndian(_dest, out _);
    }
}

[EgorBot]

Benchmark job submitted. The results will be posted here once they are ready.

• ubuntu24_azure_turin: live logs
• macos15_helix_arm64: live logs
• windows_azure_emeraldrapids: live logs

[EgorBot]

Results for macos15_helix_arm64

@EgorBo

BenchmarkDotNet v0.15.8, macOS Sequoia 15.4.1 (24E263) [Darwin 24.4.0]
Apple M4, 1 CPU, 10 logical and 10 physical cores
.NET SDK 11.0.100-preview.3.26124.102
  [Host]     : .NET 10.0.3 (10.0.3, 10.0.326.7603), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Mean	Error	Ratio
SmallBigEndian	PR #124858	0.4415 ns	0.0004 ns	1.00
SmallBigEndian	main	0.2379 ns	0.0005 ns	0.54
SmallLittleEndian	PR #124858	0.4511 ns	0.0008 ns	1.00
SmallLittleEndian	main	0.2337 ns	0.0006 ns	0.52
MediumPositiveBigEndian	PR #124858	1.6307 ns	0.0083 ns	1.00
MediumPositiveBigEndian	main	1.2950 ns	0.0011 ns	0.79
MediumPositiveLittleEndian	PR #124858	1.2108 ns	0.0008 ns	1.00
MediumPositiveLittleEndian	main	1.7058 ns	0.0061 ns	1.41
LargePositiveBigEndian	PR #124858	5.2293 ns	0.0351 ns	1.00
LargePositiveBigEndian	main	5.2603 ns	0.0305 ns	1.01
LargePositiveLittleEndian	PR #124858	5.1354 ns	0.0828 ns	1.00
LargePositiveLittleEndian	main	5.0734 ns	0.0714 ns	0.99
MediumNegativeBigEndian	PR #124858	2.2404 ns	0.0012 ns	1.00
MediumNegativeBigEndian	main	1.8806 ns	0.0012 ns	0.84
MediumNegativeLittleEndian	PR #124858	1.9551 ns	0.0018 ns	1.00
MediumNegativeLittleEndian	main	1.7286 ns	0.0026 ns	0.88
LargeNegativeBigEndian	PR #124858	6.1756 ns	0.1005 ns	1.00
LargeNegativeBigEndian	main	5.3696 ns	0.0247 ns	0.87
LargeNegativeLittleEndian	PR #124858	5.4848 ns	0.0503 ns	1.00
LargeNegativeLittleEndian	main	5.3096 ns	0.0230 ns	0.97
NegativeSignExtendBigEndian	PR #124858	6.5302 ns	0.0197 ns	1.00
NegativeSignExtendBigEndian	main	5.5791 ns	0.0113 ns	0.85
NegativeSignExtendLittleEndian	PR #124858	6.2979 ns	0.0237 ns	1.00
NegativeSignExtendLittleEndian	main	5.4692 ns	0.0122 ns	0.87

Full logs

[EgorBot]

Results for ubuntu24_azure_turin

@EgorBo

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 9V45 2.60GHz, 1 CPU, 8 logical and 4 physical cores
.NET SDK 11.0.100-preview.3.26124.102
  [Host]     : .NET 10.0.3 (10.0.3, 10.0.326.7603), X64 RyuJIT x86-64-v4

Method	Toolchain	Mean	Error	Ratio
SmallBigEndian	PR #124858	1.119 ns	0.0325 ns	1.00
SmallBigEndian	main	1.126 ns	0.0220 ns	1.01
SmallLittleEndian	PR #124858	1.151 ns	0.0241 ns	1.00
SmallLittleEndian	main	1.148 ns	0.0176 ns	1.00
MediumPositiveBigEndian	PR #124858	2.648 ns	0.0572 ns	1.00
MediumPositiveBigEndian	main	2.355 ns	0.0458 ns	0.89
MediumPositiveLittleEndian	PR #124858	2.059 ns	0.0540 ns	1.00
MediumPositiveLittleEndian	main	2.220 ns	0.0576 ns	1.08
LargePositiveBigEndian	PR #124858	8.541 ns	0.1539 ns	1.00
LargePositiveBigEndian	main	6.788 ns	0.0543 ns	0.79
LargePositiveLittleEndian	PR #124858	6.283 ns	0.1481 ns	1.00
LargePositiveLittleEndian	main	5.672 ns	0.0643 ns	0.90
MediumNegativeBigEndian	PR #124858	13.722 ns	0.1285 ns	1.00
MediumNegativeBigEndian	main	4.135 ns	0.0322 ns	0.30
MediumNegativeLittleEndian	PR #124858	3.602 ns	0.0419 ns	1.00
MediumNegativeLittleEndian	main	3.839 ns	0.0865 ns	1.07
LargeNegativeBigEndian	PR #124858	10.529 ns	0.0780 ns	1.00
LargeNegativeBigEndian	main	9.653 ns	0.1340 ns	0.92
LargeNegativeLittleEndian	PR #124858	15.429 ns	0.3117 ns	1.00
LargeNegativeLittleEndian	main	9.708 ns	0.1276 ns	0.63
NegativeSignExtendBigEndian	PR #124858	8.180 ns	0.1130 ns	1.00
NegativeSignExtendBigEndian	main	8.432 ns	0.0861 ns	1.03
NegativeSignExtendLittleEndian	PR #124858	7.730 ns	0.1026 ns	1.00
NegativeSignExtendLittleEndian	main	7.223 ns	0.0589 ns	0.93

Full logs

[EgorBot]

Results for windows_azure_emeraldrapids

@EgorBo

BenchmarkDotNet v0.15.8, Windows 11 (10.0.26100.32370/24H2/2024Update/HudsonValley) (Hyper-V)
INTEL XEON PLATINUM 8573C 2.30GHz, 1 CPU, 8 logical and 4 physical cores
.NET SDK 11.0.100-preview.3.26124.102
  [Host]     : .NET 10.0.3 (10.0.3, 10.0.326.7603), X64 RyuJIT x86-64-v4

Method	Toolchain	Mean	Error	Ratio
SmallBigEndian	PR #124858	1.520 ns	0.0048 ns	1.00
SmallBigEndian	main	1.556 ns	0.0022 ns	1.02
SmallLittleEndian	PR #124858	1.413 ns	0.0032 ns	1.00
SmallLittleEndian	main	1.516 ns	0.0055 ns	1.07
MediumPositiveBigEndian	PR #124858	3.110 ns	0.0247 ns	1.00
MediumPositiveBigEndian	main	3.080 ns	0.0039 ns	0.99
MediumPositiveLittleEndian	PR #124858	3.033 ns	0.0207 ns	1.00
MediumPositiveLittleEndian	main	2.968 ns	0.0315 ns	0.98
LargePositiveBigEndian	PR #124858	8.380 ns	0.0320 ns	1.00
LargePositiveBigEndian	main	8.122 ns	0.0029 ns	0.97
LargePositiveLittleEndian	PR #124858	6.737 ns	0.0313 ns	1.00
LargePositiveLittleEndian	main	6.956 ns	0.0068 ns	1.03
MediumNegativeBigEndian	PR #124858	4.796 ns	0.0261 ns	1.00
MediumNegativeBigEndian	main	3.663 ns	0.0046 ns	0.76
MediumNegativeLittleEndian	PR #124858	4.127 ns	0.0196 ns	1.00
MediumNegativeLittleEndian	main	3.483 ns	0.0058 ns	0.84
LargeNegativeBigEndian	PR #124858	12.284 ns	0.0781 ns	1.00
LargeNegativeBigEndian	main	11.300 ns	0.0169 ns	0.92
LargeNegativeLittleEndian	PR #124858	8.537 ns	0.0803 ns	1.00
LargeNegativeLittleEndian	main	7.682 ns	0.0045 ns	0.90
NegativeSignExtendBigEndian	PR #124858	10.175 ns	0.0662 ns	1.00
NegativeSignExtendBigEndian	main	8.732 ns	0.0536 ns	0.86
NegativeSignExtendLittleEndian	PR #124858	9.700 ns	0.0910 ns	1.00
NegativeSignExtendLittleEndian	main	11.295 ns	0.0443 ns	1.16

Full logs