[Perf] Linux/arm64: 4 Improvements on 5/2/2023 7:50:39 PM

### Run Information

Name | Value
-- | --
Architecture | arm64
OS | ubuntu 20.04
Queue | AmpereUbuntu
Baseline | [3e8f17a65a068fca3d19fa5cd43a7e1cd414a5ae](https://github.com/dotnet/runtime/commit/3e8f17a65a068fca3d19fa5cd43a7e1cd414a5ae)
Compare | [c5303ae33513e1a2eddceb2986639efd7505115e](https://github.com/dotnet/runtime/commit/c5303ae33513e1a2eddceb2986639efd7505115e)
Diff | [Diff](https://github.com/dotnet/runtime/compare/3e8f17a65a068fca3d19fa5cd43a7e1cd414a5ae...c5303ae33513e1a2eddceb2986639efd7505115e)
Configs | CompilationMode:tiered, RunKind:micro


### Improvements in System.Collections.Concurrent.Count&lt;String&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Collections.Concurrent.Count(String).Queue(Size%3a%20512).html>) | 12.78 ns | 10.49 ns | 0.82 | 0.05 | False | | |

[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/05_04_2023/refs/heads/main_arm64_ubuntu%2020.04_Improvement/System.Collections.Concurrent.Count%28String%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-03cc1f1b-2b40-42fb-8841-34fc25215213eef76e4330d432197/ee433355-3578-4cc3-b739-547388f92507.zip?sv=2021-08-06&se=2023-06-01T05%3A05%3A20Z&sr=c&sp=rl&sig=n8Umrg9y5DUM%2BlQ2i8iUwiH81w7nL0n9d%2B4RrwbZ8ZE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-f1271a19-1507-4427-a748-02de4fec9cdfe1899eb86b54481b8/4d6d39b3-ba53-432f-9b06-93670cca4263.zip?sv=2021-08-06&se=2023-06-02T02%3A38%3A21Z&sr=c&sp=rl&sig=oZcDJYR1MvgcapUA7np034XXXAH%2BU5R4GNqMWVFGKdo%3D>)

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Concurrent.Count&lt;String&gt;*'
```

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-03cc1f1b-2b40-42fb-8841-34fc25215213eef76e4330d432197/ee433355-3578-4cc3-b739-547388f92507.zip?sv=2021-08-06&se=2023-06-01T05%3A05%3A20Z&sr=c&sp=rl&sig=n8Umrg9y5DUM%2BlQ2i8iUwiH81w7nL0n9d%2B4RrwbZ8ZE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-f1271a19-1507-4427-a748-02de4fec9cdfe1899eb86b54481b8/4d6d39b3-ba53-432f-9b06-93670cca4263.zip?sv=2021-08-06&se=2023-06-02T02%3A38%3A21Z&sr=c&sp=rl&sig=oZcDJYR1MvgcapUA7np034XXXAH%2BU5R4GNqMWVFGKdo%3D>)
### Histogram

#### System.Collections.Concurrent.Count&lt;String&gt;.Queue(Size: 512)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 10.486237089170574 < 11.768451919483237.
IsChangePoint: Marked as a change because one of 1/11/2023 5:39:19 AM, 3/14/2023 8:42:09 PM, 4/25/2023 6:46:56 PM, 5/2/2023 12:51:17 PM, 5/3/2023 11:00:11 PM falls between 4/25/2023 6:51:20 AM and 5/3/2023 11:00:11 PM.
IsImprovementStdDev: Marked as improvement because 25.92687640983691 (T) = (0 -10.63891576530929) / Math.Sqrt((1.8237376922939712 / (299)) + (0.02593616378446734 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.22834686731259488 = (13.787173685484266 - 10.63891576530929) / 13.787173685484266 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | arm64
OS | ubuntu 20.04
Queue | AmpereUbuntu
Baseline | [3e8f17a65a068fca3d19fa5cd43a7e1cd414a5ae](https://github.com/dotnet/runtime/commit/3e8f17a65a068fca3d19fa5cd43a7e1cd414a5ae)
Compare | [c5303ae33513e1a2eddceb2986639efd7505115e](https://github.com/dotnet/runtime/commit/c5303ae33513e1a2eddceb2986639efd7505115e)
Diff | [Diff](https://github.com/dotnet/runtime/compare/3e8f17a65a068fca3d19fa5cd43a7e1cd414a5ae...c5303ae33513e1a2eddceb2986639efd7505115e)
Configs | CompilationMode:tiered, RunKind:micro


### Improvements in System.Collections.AddGivenSize&lt;Int32&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Collections.AddGivenSize(Int32).Dictionary(Size%3a%20512).html>) | 7.82 μs | 6.43 μs | 0.82 | 0.02 | False | | |
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Collections.AddGivenSize(Int32).HashSet(Size%3a%20512).html>) | 7.29 μs | 6.11 μs | 0.84 | 0.00 | True | | |

[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/05_04_2023/refs/heads/main_arm64_ubuntu%2020.04_Improvement/System.Collections.AddGivenSize%28Int32%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-03cc1f1b-2b40-42fb-8841-34fc25215213eef76e4330d432197/ee433355-3578-4cc3-b739-547388f92507.zip?sv=2021-08-06&se=2023-06-01T05%3A05%3A20Z&sr=c&sp=rl&sig=n8Umrg9y5DUM%2BlQ2i8iUwiH81w7nL0n9d%2B4RrwbZ8ZE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-f1271a19-1507-4427-a748-02de4fec9cdfe1899eb86b54481b8/4d6d39b3-ba53-432f-9b06-93670cca4263.zip?sv=2021-08-06&se=2023-06-02T02%3A38%3A21Z&sr=c&sp=rl&sig=oZcDJYR1MvgcapUA7np034XXXAH%2BU5R4GNqMWVFGKdo%3D>)

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize&lt;Int32&gt;*'
```

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-03cc1f1b-2b40-42fb-8841-34fc25215213eef76e4330d432197/ee433355-3578-4cc3-b739-547388f92507.zip?sv=2021-08-06&se=2023-06-01T05%3A05%3A20Z&sr=c&sp=rl&sig=n8Umrg9y5DUM%2BlQ2i8iUwiH81w7nL0n9d%2B4RrwbZ8ZE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-f1271a19-1507-4427-a748-02de4fec9cdfe1899eb86b54481b8/4d6d39b3-ba53-432f-9b06-93670cca4263.zip?sv=2021-08-06&se=2023-06-02T02%3A38%3A21Z&sr=c&sp=rl&sig=oZcDJYR1MvgcapUA7np034XXXAH%2BU5R4GNqMWVFGKdo%3D>)
### Histogram

#### System.Collections.AddGivenSize&lt;Int32&gt;.Dictionary(Size: 512)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 6.430090243920348 < 7.409548409622751.
IsChangePoint: Marked as a change because one of 2/9/2023 1:41:04 PM, 5/2/2023 12:51:17 PM, 5/3/2023 11:00:11 PM falls between 4/25/2023 6:51:20 AM and 5/3/2023 11:00:11 PM.
IsImprovementStdDev: Marked as improvement because 94.71398304320574 (T) = (0 -6421.917473565428) / Math.Sqrt((26584.84389687347 / (299)) + (325.9476097281581 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.17170594396986216 = (7753.185510402556 - 6421.917473565428) / 7753.185510402556 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
### JIT Disasms

#### System.Collections.AddGivenSize&lt;Int32&gt;.HashSet(Size: 512)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 6.111858627450979 < 6.939940778921208.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/3/2023 11:00:11 PM falls between 4/25/2023 6:51:20 AM and 5/3/2023 11:00:11 PM.
IsImprovementStdDev: Marked as improvement because 129.65153445974886 (T) = (0 -6129.4093860545345) / Math.Sqrt((10073.926241296318 / (299)) + (1871.2556410059688 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.17859818672985345 = (7462.132767460382 - 6129.4093860545345) / 7462.132767460382 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | arm64
OS | ubuntu 20.04
Queue | AmpereUbuntu
Baseline | [3e8f17a65a068fca3d19fa5cd43a7e1cd414a5ae](https://github.com/dotnet/runtime/commit/3e8f17a65a068fca3d19fa5cd43a7e1cd414a5ae)
Compare | [c5303ae33513e1a2eddceb2986639efd7505115e](https://github.com/dotnet/runtime/commit/c5303ae33513e1a2eddceb2986639efd7505115e)
Diff | [Diff](https://github.com/dotnet/runtime/compare/3e8f17a65a068fca3d19fa5cd43a7e1cd414a5ae...c5303ae33513e1a2eddceb2986639efd7505115e)
Configs | CompilationMode:tiered, RunKind:micro


### Improvements in System.Collections.TryAddGiventSize&lt;Int32&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Collections.TryAddGiventSize(Int32).Dictionary(Count%3a%20512).html>) | 7.72 μs | 6.40 μs | 0.83 | 0.05 | False | | |

[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/05_04_2023/refs/heads/main_arm64_ubuntu%2020.04_Improvement/System.Collections.TryAddGiventSize%28Int32%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-03cc1f1b-2b40-42fb-8841-34fc25215213eef76e4330d432197/ee433355-3578-4cc3-b739-547388f92507.zip?sv=2021-08-06&se=2023-06-01T05%3A05%3A20Z&sr=c&sp=rl&sig=n8Umrg9y5DUM%2BlQ2i8iUwiH81w7nL0n9d%2B4RrwbZ8ZE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-f1271a19-1507-4427-a748-02de4fec9cdfe1899eb86b54481b8/4d6d39b3-ba53-432f-9b06-93670cca4263.zip?sv=2021-08-06&se=2023-06-02T02%3A38%3A21Z&sr=c&sp=rl&sig=oZcDJYR1MvgcapUA7np034XXXAH%2BU5R4GNqMWVFGKdo%3D>)

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddGiventSize&lt;Int32&gt;*'
```

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-03cc1f1b-2b40-42fb-8841-34fc25215213eef76e4330d432197/ee433355-3578-4cc3-b739-547388f92507.zip?sv=2021-08-06&se=2023-06-01T05%3A05%3A20Z&sr=c&sp=rl&sig=n8Umrg9y5DUM%2BlQ2i8iUwiH81w7nL0n9d%2B4RrwbZ8ZE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-f1271a19-1507-4427-a748-02de4fec9cdfe1899eb86b54481b8/4d6d39b3-ba53-432f-9b06-93670cca4263.zip?sv=2021-08-06&se=2023-06-02T02%3A38%3A21Z&sr=c&sp=rl&sig=oZcDJYR1MvgcapUA7np034XXXAH%2BU5R4GNqMWVFGKdo%3D>)
### Histogram

#### System.Collections.TryAddGiventSize&lt;Int32&gt;.Dictionary(Count: 512)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 6.403038692306566 < 7.369284203908065.
IsChangePoint: Marked as a change because one of 5/2/2023 12:51:17 PM, 5/3/2023 11:00:11 PM falls between 4/25/2023 6:51:20 AM and 5/3/2023 11:00:11 PM.
IsImprovementStdDev: Marked as improvement because 9.871457743912423 (T) = (0 -6507.616328999836) / Math.Sqrt((28262.64261747224 / (299)) + (42464.671976352736 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.15331352933299733 = (7685.981239163141 - 6507.616328999836) / 7685.981239163141 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>

Name	Value
Architecture	arm64
OS	ubuntu 20.04
Queue	AmpereUbuntu
Baseline	3e8f17a65a068fca3d19fa5cd43a7e1cd414a5ae
Compare	c5303ae33513e1a2eddceb2986639efd7505115e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Dictionary - Duration of single invocation	7.82 μs	6.43 μs	0.82	0.02	False
HashSet - Duration of single invocation	7.29 μs	6.11 μs	0.84	0.00	True

[Perf] Linux/arm64: 4 Improvements on 5/2/2023 7:50:39 PM #17404

Description

Run Information

Improvements in System.Collections.Concurrent.Count<String>

Repro

Payloads

Payloads

Histogram

System.Collections.Concurrent.Count<String>.Queue(Size: 512)

Description of detection logic

JIT Disasms

Docs

Run Information

Improvements in System.Collections.AddGivenSize<Int32>

Repro

Payloads

Payloads

Histogram

System.Collections.AddGivenSize<Int32>.Dictionary(Size: 512)

Description of detection logic

JIT Disasms

System.Collections.AddGivenSize<Int32>.HashSet(Size: 512)

Description of detection logic

JIT Disasms

Docs

Run Information

Improvements in System.Collections.TryAddGiventSize<Int32>

Repro

Payloads

Payloads

Histogram

System.Collections.TryAddGiventSize<Int32>.Dictionary(Count: 512)

Description of detection logic

JIT Disasms

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions