Skip to content

disable telemetry for MethodHandle lookups #8160

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jan 7, 2025
Merged

disable telemetry for MethodHandle lookups #8160

merged 1 commit into from
Jan 7, 2025

Conversation

@jpbempel
Copy link
Member

@jpbempel jpbempel commented Jan 6, 2025

What Does This Do

disable telemetry for MethodHandle lookups
can happen frequently (every startup on jdk8)

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@jpbempel
disable telemetry for MethodHandle lookups
e5bd885 
can happen frequently (every startup on jdk8)
@jpbempel jpbempel added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: debugger Dynamic Instrumentation labels Jan 6, 2025
@jpbempel jpbempel requested a review from a team as a code owner January 6, 2025 10:30
@jpbempel jpbempel requested review from cimi and removed request for a team January 6, 2025 10:30
@pr-commenter
Copy link

pr-commenter bot commented Jan 6, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1736159885 1736160263
end_time 2025-01-06T10:39:22 2025-01-06T10:45:40
git_branch master jpbempel/reduce-telemetry-noise
git_commit_sha 4e79504 e5bd885
start_time 2025-01-06T10:38:06 2025-01-06T10:44:24
See matching parameters
Baseline Candidate
ci_job_id 755155624 755155624
ci_pipeline_id 52212896 52212896
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1736159314 1736159314

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-42.022µs; +30.546µs] or [-15.040%; +10.932%]		 unstable
[-56.996µs; +44.833µs] or [-17.777%; +13.984%]		 unstable
[-68.398µs; +56.427µs] or [-20.385%; +16.817%]		 unstable
[-141.067µs; +130.027µs] or [-22.776%; +20.994%]		 same
scenario:basic same same same unstable
[-52.031µs; +41.646µs] or [-9.626%; +7.705%]		 unstable
[-172.448op/s; +172.448op/s] or [-6.898%; +6.898%]
scenario:loop unsure
[-69.745µs; -13.211µs] or [-0.680%; -0.129%]		 same same same same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (320.609 µs) : 266, 375
.   : milestone, 321,
basic (311.241 µs) : 299, 323
.   : milestone, 311,
loop (10.431 ms) : 10380, 10481
.   : milestone, 10431,
section candidate
noprobe (314.527 µs) : 273, 356
.   : milestone, 315,
basic (311.766 µs) : 302, 321
.   : milestone, 312,
loop (10.391 ms) : 10357, 10426
.   : milestone, 10391,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 320.609 µs [265.862 µs, 375.355 µs]
basic 311.241 µs [299.411 µs, 323.071 µs]
loop 10.431 ms [10.38 ms, 10.481 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 314.527 µs [273.134 µs, 355.921 µs]
basic 311.766 µs [302.494 µs, 321.038 µs]
loop 10.391 ms [10.357 ms, 10.426 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jan 6, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/reduce-telemetry-noise
git_commit_date 1736158231 1736159314
git_commit_sha 4e79504 e5bd885
release_version 1.45.0-SNAPSHOT~4e795042e9 1.45.0-SNAPSHOT~e5bd885390
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1736161591 1736161591
ci_job_id 755155618 755155618
ci_pipeline_id 52212896 52212896
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.45.0-SNAPSHOT~e5bd885390, baseline=1.45.0-SNAPSHOT~4e795042e9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1056271
Total [baseline] (10.508 s) : 0, 10508343
Agent [candidate] (1.055 s) : 0, 1055321
Total [candidate] (10.423 s) : 0, 10422806
section appsec
Agent [baseline] (1.189 s) : 0, 1189063
Total [baseline] (10.728 s) : 0, 10727573
Agent [candidate] (1.191 s) : 0, 1191165
Total [candidate] (10.704 s) : 0, 10704033
section iast
Agent [baseline] (1.179 s) : 0, 1179024
Total [baseline] (10.96 s) : 0, 10960224
Agent [candidate] (1.183 s) : 0, 1182934
Total [candidate] (10.939 s) : 0, 10938504
section profiling
Agent [baseline] (1.276 s) : 0, 1275662
Total [baseline] (10.839 s) : 0, 10839070
Agent [candidate] (1.286 s) : 0, 1286055
Total [candidate] (10.829 s) : 0, 10829026
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.189 s 132.792 ms (12.6%)
Agent iast 1.179 s 122.753 ms (11.6%)
Agent profiling 1.276 s 219.391 ms (20.8%)
Total tracing 10.508 s -
Total appsec 10.728 s 219.23 ms (2.1%)
Total iast 10.96 s 451.881 ms (4.3%)
Total profiling 10.839 s 330.726 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.191 s 135.844 ms (12.9%)
Agent iast 1.183 s 127.613 ms (12.1%)
Agent profiling 1.286 s 230.733 ms (21.9%)
Total tracing 10.423 s -
Total appsec 10.704 s 281.227 ms (2.7%)
Total iast 10.939 s 515.698 ms (4.9%)
Total profiling 10.829 s 406.22 ms (3.9%) 
gantt
    title petclinic - break down per module: candidate=1.45.0-SNAPSHOT~e5bd885390, baseline=1.45.0-SNAPSHOT~4e795042e9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (713.515 ms) : 0, 713515
BytebuddyAgent [candidate] (714.649 ms) : 0, 714649
GlobalTracer [baseline] (255.905 ms) : 0, 255905
GlobalTracer [candidate] (256.141 ms) : 0, 256141
AppSec [baseline] (55.369 ms) : 0, 55369
AppSec [candidate] (55.093 ms) : 0, 55093
Remote Config [baseline] (735.176 µs) : 0, 735
Remote Config [candidate] (719.225 µs) : 0, 719
Telemetry [baseline] (15.703 ms) : 0, 15703
Telemetry [candidate] (13.629 ms) : 0, 13629
section appsec
BytebuddyAgent [baseline] (730.775 ms) : 0, 730775
BytebuddyAgent [candidate] (733.156 ms) : 0, 733156
GlobalTracer [baseline] (253.711 ms) : 0, 253711
GlobalTracer [candidate] (254.108 ms) : 0, 254108
AppSec [baseline] (171.275 ms) : 0, 171275
AppSec [candidate] (170.136 ms) : 0, 170136
IAST [baseline] (19.449 ms) : 0, 19449
IAST [candidate] (20.09 ms) : 0, 20090
Remote Config [baseline] (668.186 µs) : 0, 668
Remote Config [candidate] (669.586 µs) : 0, 670
Telemetry [baseline] (7.966 ms) : 0, 7966
Telemetry [candidate] (7.951 ms) : 0, 7951
section iast
BytebuddyAgent [baseline] (828.8 ms) : 0, 828800
BytebuddyAgent [candidate] (831.807 ms) : 0, 831807
GlobalTracer [baseline] (246.631 ms) : 0, 246631
GlobalTracer [candidate] (247.443 ms) : 0, 247443
AppSec [baseline] (58.316 ms) : 0, 58316
AppSec [candidate] (57.848 ms) : 0, 57848
IAST [baseline] (21.173 ms) : 0, 21173
IAST [candidate] (21.593 ms) : 0, 21593
Remote Config [baseline] (662.11 µs) : 0, 662
Remote Config [candidate] (651.575 µs) : 0, 652
Telemetry [baseline] (8.501 ms) : 0, 8501
Telemetry [candidate] (8.502 ms) : 0, 8502
section profiling
BytebuddyAgent [baseline] (702.67 ms) : 0, 702670
BytebuddyAgent [candidate] (709.727 ms) : 0, 709727
GlobalTracer [baseline] (372.326 ms) : 0, 372326
GlobalTracer [candidate] (375.831 ms) : 0, 375831
AppSec [baseline] (54.771 ms) : 0, 54771
AppSec [candidate] (53.903 ms) : 0, 53903
Remote Config [baseline] (653.374 µs) : 0, 653
Remote Config [candidate] (655.241 µs) : 0, 655
Telemetry [baseline] (7.809 ms) : 0, 7809
Telemetry [candidate] (7.8 ms) : 0, 7800
ProfilingAgent [baseline] (95.599 ms) : 0, 95599
ProfilingAgent [candidate] (95.915 ms) : 0, 95915
Profiling [baseline] (95.623 ms) : 0, 95623
Profiling [candidate] (95.939 ms) : 0, 95939
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.45.0-SNAPSHOT~e5bd885390, baseline=1.45.0-SNAPSHOT~4e795042e9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1054352
Total [baseline] (8.609 s) : 0, 8608502
Agent [candidate] (1.056 s) : 0, 1055827
Total [candidate] (8.641 s) : 0, 8640510
section iast
Agent [baseline] (1.195 s) : 0, 1194671
Total [baseline] (9.226 s) : 0, 9225951
Agent [candidate] (1.183 s) : 0, 1182541
Total [candidate] (9.251 s) : 0, 9251330
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.182 s) : 0, 1182411
Total [baseline] (9.185 s) : 0, 9185106
Agent [candidate] (1.18 s) : 0, 1179942
Total [candidate] (9.179 s) : 0, 9179212
section iast_TELEMETRY_OFF
Agent [baseline] (1.175 s) : 0, 1174831
Total [baseline] (9.223 s) : 0, 9222887
Agent [candidate] (1.179 s) : 0, 1178784
Total [candidate] (9.179 s) : 0, 9179436
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent iast 1.195 s 140.319 ms (13.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.182 s 128.059 ms (12.1%)
Agent iast_TELEMETRY_OFF 1.175 s 120.479 ms (11.4%)
Total tracing 8.609 s -
Total iast 9.226 s 617.449 ms (7.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.185 s 576.604 ms (6.7%)
Total iast_TELEMETRY_OFF 9.223 s 614.385 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.183 s 126.713 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 124.114 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.179 s 122.956 ms (11.6%)
Total tracing 8.641 s -
Total iast 9.251 s 610.821 ms (7.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.179 s 538.703 ms (6.2%)
Total iast_TELEMETRY_OFF 9.179 s 538.927 ms (6.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.45.0-SNAPSHOT~e5bd885390, baseline=1.45.0-SNAPSHOT~4e795042e9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (713.597 ms) : 0, 713597
BytebuddyAgent [candidate] (714.048 ms) : 0, 714048
GlobalTracer [baseline] (255.506 ms) : 0, 255506
GlobalTracer [candidate] (256.484 ms) : 0, 256484
AppSec [baseline] (55.978 ms) : 0, 55978
AppSec [candidate] (55.273 ms) : 0, 55273
Remote Config [baseline] (725.125 µs) : 0, 725
Remote Config [candidate] (727.023 µs) : 0, 727
Telemetry [baseline] (13.527 ms) : 0, 13527
Telemetry [candidate] (14.209 ms) : 0, 14209
section iast
BytebuddyAgent [baseline] (841.46 ms) : 0, 841460
BytebuddyAgent [candidate] (831.457 ms) : 0, 831457
GlobalTracer [baseline] (248.877 ms) : 0, 248877
GlobalTracer [candidate] (247.155 ms) : 0, 247155
AppSec [baseline] (58.292 ms) : 0, 58292
AppSec [candidate] (58.176 ms) : 0, 58176
IAST [baseline] (21.574 ms) : 0, 21574
IAST [candidate] (21.454 ms) : 0, 21454
Remote Config [baseline] (667.415 µs) : 0, 667
Remote Config [candidate] (662.014 µs) : 0, 662
Telemetry [baseline] (8.61 ms) : 0, 8610
Telemetry [candidate] (8.567 ms) : 0, 8567
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (831.433 ms) : 0, 831433
BytebuddyAgent [candidate] (829.413 ms) : 0, 829413
GlobalTracer [baseline] (246.904 ms) : 0, 246904
GlobalTracer [candidate] (246.869 ms) : 0, 246869
AppSec [baseline] (58.342 ms) : 0, 58342
AppSec [candidate] (58.095 ms) : 0, 58095
IAST [baseline] (21.526 ms) : 0, 21526
IAST [candidate] (21.364 ms) : 0, 21364
Remote Config [baseline] (663.978 µs) : 0, 664
Remote Config [candidate] (672.445 µs) : 0, 672
Telemetry [baseline] (8.494 ms) : 0, 8494
Telemetry [candidate] (8.532 ms) : 0, 8532
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (826.24 ms) : 0, 826240
BytebuddyAgent [candidate] (828.465 ms) : 0, 828465
GlobalTracer [baseline] (246.409 ms) : 0, 246409
GlobalTracer [candidate] (246.913 ms) : 0, 246913
AppSec [baseline] (57.563 ms) : 0, 57563
AppSec [candidate] (58.42 ms) : 0, 58420
IAST [baseline] (20.597 ms) : 0, 20597
IAST [candidate] (20.76 ms) : 0, 20760
Remote Config [baseline] (646.767 µs) : 0, 647
Remote Config [candidate] (649.73 µs) : 0, 650
Telemetry [baseline] (8.364 ms) : 0, 8364
Telemetry [candidate] (8.459 ms) : 0, 8459
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-06T10:39:12 2025-01-06T10:46:12
git_branch master jpbempel/reduce-telemetry-noise
git_commit_date 1736158231 1736159314
git_commit_sha 4e79504 e5bd885
release_version 1.45.0-SNAPSHOT~4e795042e9 1.45.0-SNAPSHOT~e5bd885390
start_time 2025-01-06T10:38:58 2025-01-06T10:45:58
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1736160727 1736160727
ci_job_id 755155619 755155619
ci_pipeline_id 52212896 52212896
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~e5bd885390, baseline=1.45.0-SNAPSHOT~4e795042e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (385.654 µs) : 366, 405
.   : milestone, 386,
iast (506.131 µs) : 484, 528
.   : milestone, 506,
iast_FULL (658.687 µs) : 637, 680
.   : milestone, 659,
iast_GLOBAL (531.966 µs) : 510, 554
.   : milestone, 532,
iast_HARDCODED_SECRET_DISABLED (501.444 µs) : 480, 523
.   : milestone, 501,
iast_INACTIVE (457.734 µs) : 436, 480
.   : milestone, 458,
iast_TELEMETRY_OFF (492.882 µs) : 470, 515
.   : milestone, 493,
tracing (453.478 µs) : 432, 475
.   : milestone, 453,
section candidate
no_agent (383.108 µs) : 363, 403
.   : milestone, 383,
iast (503.41 µs) : 481, 525
.   : milestone, 503,
iast_FULL (658.841 µs) : 637, 681
.   : milestone, 659,
iast_GLOBAL (525.767 µs) : 504, 548
.   : milestone, 526,
iast_HARDCODED_SECRET_DISABLED (490.967 µs) : 469, 512
.   : milestone, 491,
iast_INACTIVE (456.225 µs) : 435, 478
.   : milestone, 456,
iast_TELEMETRY_OFF (488.724 µs) : 467, 510
.   : milestone, 489,
tracing (449.432 µs) : 429, 470
.   : milestone, 449,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 385.654 µs [365.889 µs, 405.419 µs] -
iast 506.131 µs [484.106 µs, 528.156 µs] 120.477 µs (31.2%)
iast_FULL 658.687 µs [637.158 µs, 680.215 µs] 273.033 µs (70.8%)
iast_GLOBAL 531.966 µs [509.718 µs, 554.213 µs] 146.312 µs (37.9%)
iast_HARDCODED_SECRET_DISABLED 501.444 µs [479.716 µs, 523.171 µs] 115.79 µs (30.0%)
iast_INACTIVE 457.734 µs [435.893 µs, 479.575 µs] 72.08 µs (18.7%)
iast_TELEMETRY_OFF 492.882 µs [470.415 µs, 515.349 µs] 107.228 µs (27.8%)
tracing 453.478 µs [432.247 µs, 474.709 µs] 67.824 µs (17.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 383.108 µs [363.328 µs, 402.887 µs] -
iast 503.41 µs [481.424 µs, 525.397 µs] 120.303 µs (31.4%)
iast_FULL 658.841 µs [637.126 µs, 680.556 µs] 275.733 µs (72.0%)
iast_GLOBAL 525.767 µs [503.87 µs, 547.665 µs] 142.66 µs (37.2%)
iast_HARDCODED_SECRET_DISABLED 490.967 µs [469.462 µs, 512.472 µs] 107.859 µs (28.2%)
iast_INACTIVE 456.225 µs [434.814 µs, 477.637 µs] 73.118 µs (19.1%)
iast_TELEMETRY_OFF 488.724 µs [467.105 µs, 510.342 µs] 105.616 µs (27.6%)
tracing 449.432 µs [428.671 µs, 470.193 µs] 66.325 µs (17.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~e5bd885390, baseline=1.45.0-SNAPSHOT~4e795042e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.351 ms) : 1332, 1370
.   : milestone, 1351,
appsec (1.749 ms) : 1725, 1772
.   : milestone, 1749,
appsec_no_iast (1.732 ms) : 1709, 1755
.   : milestone, 1732,
iast (1.514 ms) : 1492, 1536
.   : milestone, 1514,
profiling (1.542 ms) : 1517, 1567
.   : milestone, 1542,
tracing (1.466 ms) : 1441, 1492
.   : milestone, 1466,
section candidate
no_agent (1.352 ms) : 1333, 1372
.   : milestone, 1352,
appsec (1.74 ms) : 1717, 1764
.   : milestone, 1740,
appsec_no_iast (1.758 ms) : 1735, 1781
.   : milestone, 1758,
iast (1.535 ms) : 1512, 1558
.   : milestone, 1535,
profiling (1.562 ms) : 1537, 1586
.   : milestone, 1562,
tracing (1.493 ms) : 1467, 1518
.   : milestone, 1493,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.351 ms [1.332 ms, 1.37 ms] -
appsec 1.749 ms [1.725 ms, 1.772 ms] 397.059 µs (29.4%)
appsec_no_iast 1.732 ms [1.709 ms, 1.755 ms] 380.831 µs (28.2%)
iast 1.514 ms [1.492 ms, 1.536 ms] 162.433 µs (12.0%)
profiling 1.542 ms [1.517 ms, 1.567 ms] 190.057 µs (14.1%)
tracing 1.466 ms [1.441 ms, 1.492 ms] 114.833 µs (8.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.352 ms [1.333 ms, 1.372 ms] -
appsec 1.74 ms [1.717 ms, 1.764 ms] 388.011 µs (28.7%)
appsec_no_iast 1.758 ms [1.735 ms, 1.781 ms] 405.727 µs (30.0%)
iast 1.535 ms [1.512 ms, 1.558 ms] 182.325 µs (13.5%)
profiling 1.562 ms [1.537 ms, 1.586 ms] 209.117 µs (15.5%)
tracing 1.493 ms [1.467 ms, 1.518 ms] 140.358 µs (10.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/reduce-telemetry-noise
git_commit_date 1736158231 1736159314
git_commit_sha 4e79504 e5bd885
release_version 1.45.0-SNAPSHOT~4e795042e9 1.45.0-SNAPSHOT~e5bd885390
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1736161300 1736161300
ci_job_id 755155620 755155620
ci_pipeline_id 52212896 52212896
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~e5bd885390, baseline=1.45.0-SNAPSHOT~4e795042e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.462 ms) : 1450, 1473
.   : milestone, 1462,
appsec (2.343 ms) : 2301, 2386
.   : milestone, 2343,
iast (2.096 ms) : 2042, 2150
.   : milestone, 2096,
iast_GLOBAL (2.137 ms) : 2083, 2191
.   : milestone, 2137,
profiling (1.972 ms) : 1928, 2016
.   : milestone, 1972,
tracing (1.936 ms) : 1895, 1978
.   : milestone, 1936,
section candidate
no_agent (1.461 ms) : 1450, 1472
.   : milestone, 1461,
appsec (2.346 ms) : 2303, 2388
.   : milestone, 2346,
iast (2.088 ms) : 2034, 2142
.   : milestone, 2088,
iast_GLOBAL (2.13 ms) : 2076, 2185
.   : milestone, 2130,
profiling (1.975 ms) : 1931, 2019
.   : milestone, 1975,
tracing (1.927 ms) : 1886, 1969
.   : milestone, 1927,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.45 ms, 1.473 ms] -
appsec 2.343 ms [2.301 ms, 2.386 ms] 881.475 µs (60.3%)
iast 2.096 ms [2.042 ms, 2.15 ms] 634.348 µs (43.4%)
iast_GLOBAL 2.137 ms [2.083 ms, 2.191 ms] 675.384 µs (46.2%)
profiling 1.972 ms [1.928 ms, 2.016 ms] 510.092 µs (34.9%)
tracing 1.936 ms [1.895 ms, 1.978 ms] 474.764 µs (32.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.461 ms [1.45 ms, 1.472 ms] -
appsec 2.346 ms [2.303 ms, 2.388 ms] 884.652 µs (60.6%)
iast 2.088 ms [2.034 ms, 2.142 ms] 626.816 µs (42.9%)
iast_GLOBAL 2.13 ms [2.076 ms, 2.185 ms] 669.517 µs (45.8%)
profiling 1.975 ms [1.931 ms, 2.019 ms] 514.151 µs (35.2%)
tracing 1.927 ms [1.886 ms, 1.969 ms] 466.539 µs (31.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~e5bd885390, baseline=1.45.0-SNAPSHOT~4e795042e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.946 s) : 14946000, 14946000
.   : milestone, 14946000,
appsec (15.068 s) : 15068000, 15068000
.   : milestone, 15068000,
iast (18.751 s) : 18751000, 18751000
.   : milestone, 18751000,
iast_GLOBAL (17.981 s) : 17981000, 17981000
.   : milestone, 17981000,
profiling (15.635 s) : 15635000, 15635000
.   : milestone, 15635000,
tracing (14.949 s) : 14949000, 14949000
.   : milestone, 14949000,
section candidate
no_agent (15.243 s) : 15243000, 15243000
.   : milestone, 15243000,
appsec (15.24 s) : 15240000, 15240000
.   : milestone, 15240000,
iast (18.704 s) : 18704000, 18704000
.   : milestone, 18704000,
iast_GLOBAL (18.107 s) : 18107000, 18107000
.   : milestone, 18107000,
profiling (15.527 s) : 15527000, 15527000
.   : milestone, 15527000,
tracing (15.055 s) : 15055000, 15055000
.   : milestone, 15055000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.946 s [14.946 s, 14.946 s] -
appsec 15.068 s [15.068 s, 15.068 s] 122.0 ms (0.8%)
iast 18.751 s [18.751 s, 18.751 s] 3.805 s (25.5%)
iast_GLOBAL 17.981 s [17.981 s, 17.981 s] 3.035 s (20.3%)
profiling 15.635 s [15.635 s, 15.635 s] 689.0 ms (4.6%)
tracing 14.949 s [14.949 s, 14.949 s] 3.0 ms (0.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.243 s [15.243 s, 15.243 s] -
appsec 15.24 s [15.24 s, 15.24 s] -3.0 ms (-0.0%)
iast 18.704 s [18.704 s, 18.704 s] 3.461 s (22.7%)
iast_GLOBAL 18.107 s [18.107 s, 18.107 s] 2.864 s (18.8%)
profiling 15.527 s [15.527 s, 15.527 s] 284.0 ms (1.9%)
tracing 15.055 s [15.055 s, 15.055 s] -188.0 ms (-1.2%)

@jpbempel jpbempel added tag: no release notes Changes to exclude from release notes and removed tag: no release notes Changes to exclude from release notes labels Jan 6, 2025
@jpbempel jpbempel merged commit 54d4a6f into master Jan 7, 2025
158 checks passed
@jpbempel jpbempel deleted the jpbempel/reduce-telemetry-noise branch January 7, 2025 19:16
@github-actions github-actions bot added this to the 1.45.0 milestone Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@evanchooly evanchooly evanchooly approved these changes

@cimi cimi Awaiting requested review from cimi cimi is a code owner automatically assigned from DataDog/debugger-java

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.45.0

Development

Successfully merging this pull request may close these issues.

3 participants

@jpbempel @evanchooly