Skip to content

[Perf] Linux/x64: 24 Improvements on 1/27/2023 3:53:39 PM #12309

@performanceautofiler

Description

@performanceautofiler

Run Information

Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ec06321141611cc131c18761808abce15d097db3
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 81.14 ns 68.09 ns 0.84 0.14 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Byte&gt;*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 68.08543906612266 < 75.42704829997972.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 1/12/2023 3:42:01 AM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 30.463810803354857 (T) = (0 -68.54867432993251) / Math.Sqrt((31.607028106694663 / (299)) + (2.3005061427274103 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.19508316107733756 = (85.16243047130334 - 68.54867432993251) / 85.16243047130334 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 97.25 ns 80.15 ns 0.82 0.13 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 80.14744042069866 < 85.37590531283514.
IsChangePoint: Marked as a change because one of 12/12/2022 1:43:17 AM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 15.10196865735339 (T) = (0 -81.26498947728989) / Math.Sqrt((16.35492991976052 / (299)) + (5.25013488902686 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.11177597163318864 = (91.49154591855935 - 81.26498947728989) / 91.49154591855935 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Int64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 84.58 ns 68.21 ns 0.81 0.08 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int64&gt;*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<Int64>.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 68.21498324545092 < 74.49218243404418.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 1/12/2023 3:42:01 AM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 23.629629305800872 (T) = (0 -66.98456075069937) / Math.Sqrt((30.46840089065395 / (299)) + (6.161789592027861 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.21117046396100392 = (84.91639535590103 - 66.98456075069937) / 84.91639535590103 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 92.04 ns 80.84 ns 0.88 0.11 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 80.84397621470404 < 86.07927349873403.
IsChangePoint: Marked as a change because one of 12/8/2022 9:08:34 PM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 23.5688545423843 (T) = (0 -81.80294549556469) / Math.Sqrt((13.515414237000684 / (299)) + (1.4352930516523599 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.10471790842767748 = (91.37114018655258 - 81.80294549556469) / 91.37114018655258 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff Diff

Improvements in System.Numerics.Tests.Perf_Quaternion

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
AddBenchmark - Duration of single invocation 216.15 ns 169.44 ns 0.78 0.08 False
SubtractBenchmark - Duration of single invocation 210.67 ns 171.40 ns 0.81 0.11 False
MultiplyByQuaternionBenchmark - Duration of single invocation 253.85 ns 227.70 ns 0.90 0.06 False
DivideBenchmark - Duration of single invocation 205.68 ns 167.92 ns 0.82 0.10 False

graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Quaternion.AddBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 169.4412089102544 < 195.7381302016684.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 1/12/2023 3:42:01 AM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 44.04876247294383 (T) = (0 -169.88840325165924) / Math.Sqrt((457.37209733742225 / (299)) + (3.979339749174926 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.2599725995656774 = (229.57042286806086 - 169.88840325165924) / 229.57042286806086 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 171.39586040956834 < 198.28522909060058.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 1/12/2023 3:42:01 AM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 43.46208452513088 (T) = (0 -170.21825274942609) / Math.Sqrt((445.36854898400327 / (299)) + (3.6938962687925088 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.253758488686632 = (228.10075581274734 - 170.21825274942609) / 228.10075581274734 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 227.70095258917488 < 241.81747386879178.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 1/12/2023 3:42:01 AM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 37.29102812963702 (T) = (0 -221.48359102005165) / Math.Sqrt((169.05343565310022 / (299)) + (13.608669362494716 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.17612995972077017 = (268.8331656592166 - 221.48359102005165) / 268.8331656592166 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 167.92458396628817 < 195.19136788339372.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 1/12/2023 3:42:01 AM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 35.93743552679844 (T) = (0 -170.52217037498488) / Math.Sqrt((451.63889214682445 / (299)) + (13.560422441939833 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.25509980777392877 = (228.91948767712597 - 170.52217037498488) / 228.91948767712597 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff Diff

Improvements in System.Numerics.Tests.Perf_Vector2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 78.38 ns 70.65 ns 0.90 0.11 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector2*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Vector2.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 70.64691464277035 < 74.57690003793137.
IsChangePoint: Marked as a change because one of 12/9/2022 7:57:12 PM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 26.32383559581847 (T) = (0 -69.19119512829691) / Math.Sqrt((10.90592925622536 / (299)) + (1.6951957427444997 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.1345101650684222 = (79.94454970550508 - 69.19119512829691) / 79.94454970550508 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff Diff

Improvements in System.Numerics.Tests.Perf_Plane

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 190.48 ns 169.97 ns 0.89 0.06 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Plane*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Plane.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 169.9678197867776 < 181.2571830873123.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 40.76823705928075 (T) = (0 -171.916230279938) / Math.Sqrt((46.75732752220852 / (299)) + (2.1141531328522327 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.11811775966851346 = (194.94238847050283 - 171.916230279938) / 194.94238847050283 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Int16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 80.27 ns 70.17 ns 0.87 0.10 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int16&gt;*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<Int16>.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 70.17234749114117 < 75.87097365143832.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 1/12/2023 3:42:01 AM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 39.381330370787424 (T) = (0 -69.3986949134532) / Math.Sqrt((51.54297202540026 / (299)) + (0.6814773723590628 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.21201278971172346 = (88.0708392310891 - 69.3986949134532) / 88.0708392310891 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 90.22 ns 81.07 ns 0.90 0.13 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 81.07407715132473 < 86.23890426403277.
IsChangePoint: Marked as a change because one of 12/9/2022 8:25:19 AM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 9.061530494664877 (T) = (0 -83.07449219220962) / Math.Sqrt((20.56949455658792 / (299)) + (9.923200438662688 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0935738076251062 = (91.65058654643376 - 83.07449219220962) / 91.65058654643376 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<UInt32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 78.14 ns 67.49 ns 0.86 0.14 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 67.49457902023525 < 74.17342666359721.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 1/12/2023 3:42:01 AM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 27.00853352028762 (T) = (0 -67.95189045078979) / Math.Sqrt((33.016794290767315 / (299)) + (3.563244516613072 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.19773248261908935 = (84.69979025528306 - 67.95189045078979) / 84.69979025528306 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Int

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 89.59 ns 80.01 ns 0.89 0.13 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Int*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 80.01384656714241 < 85.0623104316183.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 25.739518588478496 (T) = (0 -80.24977457075042) / Math.Sqrt((17.133624870069205 / (299)) + (1.6871489131589141 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.12182975809876502 = (91.38293549666405 - 80.24977457075042) / 91.38293549666405 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff Diff

Improvements in System.Numerics.Tests.Perf_Vector4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 60.06 ns 51.87 ns 0.86 0.07 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector4*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Vector4.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 51.870466638802206 < 57.117916593298204.
IsChangePoint: Marked as a change because one of 12/5/2022 8:20:45 AM, 1/12/2023 3:42:01 AM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 43.9799113709258 (T) = (0 -51.22278683128123) / Math.Sqrt((9.27657337894222 / (299)) + (0.7410293146373528 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.20302340436135227 = (64.27138150805352 - 51.22278683128123) / 64.27138150805352 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline acc409ef8a94c8148c86edc6a94eb8edf2e5e2e5
Compare ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsBenchmark - Duration of single invocation 78.14 ns 67.12 ns 0.86 0.16 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<Int32>.EqualsBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 67.1224270266829 < 75.46524504172909.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 1/12/2023 3:42:01 AM, 1/27/2023 11:36:27 AM, 1/30/2023 9:42:46 PM falls between 1/22/2023 2:59:30 AM and 1/30/2023 9:42:46 PM.
IsImprovementStdDev: Marked as improvement because 25.75302049533593 (T) = (0 -67.69774269816412) / Math.Sqrt((30.402783467550133 / (299)) + (4.296089132342644 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.20004834314884293 = (84.62729230994054 - 67.69774269816412) / 84.62729230994054 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions