[Perf] Windows 10.0.18362/x86 : Improvement on 8/12/2022 4:42:45 PM

[performanceautofiler]

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	c55d76d43c6c451548590c479ed06d1566838f8b
Compare	f44da5225f894eced11b23d820f5e28b079fa76b
Diff	Diff

Improvements in System.Collections.ContainsTrueComparer<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ImmutableHashSet - Duration of single invocation	26.01 μs	23.99 μs	0.92	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsTrueComparer<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsTrueComparer<Int32>.ImmutableHashSet(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 23.992462179487173 < 24.704287469484953.
IsChangePoint: Marked as a change because one of 6/17/2022 12:17:51 PM, 6/22/2022 10:31:12 AM, 7/7/2022 7:02:29 PM, 7/18/2022 2:17:16 AM, 8/12/2022 1:21:32 PM, 8/15/2022 12:02:22 PM falls between 8/5/2022 10:47:59 PM and 8/15/2022 12:02:22 PM.
IsImprovementStdDev: Marked as improvement because 24.27547777097257 (T) = (0 -24186.085272292425) / Math.Sqrt((401995.6906151135 / (299)) + (57472.592310032 / (20))) is greater than 1.9674756580274855 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (20) - 2, .975) and 0.06119763682239155 = (25762.701736741103 - 24186.085272292425) / 25762.701736741103 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	c55d76d43c6c451548590c479ed06d1566838f8b
Compare	f44da5225f894eced11b23d820f5e28b079fa76b
Diff	Diff

Improvements in System.Collections.IterateForEach<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Dictionary - Duration of single invocation	3.22 μs	2.79 μs	0.87	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach<String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.IterateForEach<String>.Dictionary(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.790031375016131 < 3.062778699111387.
IsChangePoint: Marked as a change because one of 6/14/2022 2:27:40 PM, 6/22/2022 6:53:40 PM, 7/7/2022 7:02:29 PM, 7/12/2022 3:04:36 AM, 7/24/2022 8:36:55 PM, 7/28/2022 3:42:13 AM, 8/12/2022 1:21:32 PM, 8/15/2022 12:02:22 PM falls between 8/5/2022 10:47:59 PM and 8/15/2022 12:02:22 PM.
IsImprovementStdDev: Marked as improvement because 21.14822388068283 (T) = (0 -2821.4889562140506) / Math.Sqrt((37513.174069743414 / (299)) + (3437.8529076086525 / (20))) is greater than 1.9674756580274855 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (20) - 2, .975) and 0.11445706823121879 = (3186.168456653384 - 2821.4889562140506) / 3186.168456653384 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository