Add smoke test for websphere-jmx by amarziali · Pull Request #11077 · DataDog/dd-trace-java

amarziali · 2026-04-10T08:57:05Z

What Does This Do

Adds a smoke test for the websphere-jmx instrumentation.

It bootstraps a websphere classic via a docker container (so it's a particular smoke test) and configure its jvm to use the java agent enabling the websphere jmxfetch extension.
Then it bootstrap as well a tiny udp receiver to fetch the metrics that will be sent.

If the instrumentation applies correctly, the websphere vendored metrics will appear, otherwise not.

Note: there are some debugger tests that also spawn a udp server for the same statsd purposes. In the future, we might think about refactoring it into a common test harness.

Motivation

Additional Notes

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

pr-commenter · 2026-04-10T09:39:59Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	andrea.marziali/ibmsmoke
git_commit_date	1775810809	1775814617
git_commit_sha	`067d0d2`	`7002719`
release_version	1.62.0-SNAPSHOT~067d0d2c4b	1.62.0-SNAPSHOT~7002719936

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1775816434	1775816434
ci_job_id	1584685546	1584685546
ci_pipeline_id	107053574	107053574
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-sj0cymkf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-sj0cymkf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~7002719936, baseline=1.62.0-SNAPSHOT~067d0d2c4b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1067777
Total [baseline] (8.876 s) : 0, 8876241
Agent [candidate] (1.059 s) : 0, 1058753
Total [candidate] (8.874 s) : 0, 8873555
section iast
Agent [baseline] (1.234 s) : 0, 1233968
Total [baseline] (9.621 s) : 0, 9620742
Agent [candidate] (1.224 s) : 0, 1224098
Total [candidate] (9.571 s) : 0, 9570851

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.068 s	-
Agent	iast	1.234 s	166.192 ms (15.6%)
Total	tracing	8.876 s	-
Total	iast	9.621 s	744.501 ms (8.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.059 s	-
Agent	iast	1.224 s	165.345 ms (15.6%)
Total	tracing	8.874 s	-
Total	iast	9.571 s	697.296 ms (7.9%)

gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~7002719936, baseline=1.62.0-SNAPSHOT~067d0d2c4b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.264 ms) : 0, 1264
crashtracking [candidate] (1.219 ms) : 0, 1219
BytebuddyAgent [baseline] (638.918 ms) : 0, 638918
BytebuddyAgent [candidate] (633.021 ms) : 0, 633021
AgentMeter [baseline] (29.954 ms) : 0, 29954
AgentMeter [candidate] (29.405 ms) : 0, 29405
GlobalTracer [baseline] (251.737 ms) : 0, 251737
GlobalTracer [candidate] (248.715 ms) : 0, 248715
AppSec [baseline] (32.589 ms) : 0, 32589
AppSec [candidate] (32.021 ms) : 0, 32021
Debugger [baseline] (60.272 ms) : 0, 60272
Debugger [candidate] (59.092 ms) : 0, 59092
Remote Config [baseline] (622.303 µs) : 0, 622
Remote Config [candidate] (597.828 µs) : 0, 598
Telemetry [baseline] (8.252 ms) : 0, 8252
Telemetry [candidate] (8.009 ms) : 0, 8009
Flare Poller [baseline] (7.799 ms) : 0, 7799
Flare Poller [candidate] (10.545 ms) : 0, 10545
section iast
crashtracking [baseline] (1.237 ms) : 0, 1237
crashtracking [candidate] (1.236 ms) : 0, 1236
BytebuddyAgent [baseline] (808.411 ms) : 0, 808411
BytebuddyAgent [candidate] (800.943 ms) : 0, 800943
AgentMeter [baseline] (11.476 ms) : 0, 11476
AgentMeter [candidate] (11.389 ms) : 0, 11389
GlobalTracer [baseline] (240.565 ms) : 0, 240565
GlobalTracer [candidate] (240.045 ms) : 0, 240045
IAST [baseline] (26.027 ms) : 0, 26027
IAST [candidate] (25.767 ms) : 0, 25767
AppSec [baseline] (28.256 ms) : 0, 28256
AppSec [candidate] (31.751 ms) : 0, 31751
Debugger [baseline] (65.149 ms) : 0, 65149
Debugger [candidate] (59.182 ms) : 0, 59182
Remote Config [baseline] (1.785 ms) : 0, 1785
Remote Config [candidate] (520.804 µs) : 0, 521
Telemetry [baseline] (11.043 ms) : 0, 11043
Telemetry [candidate] (13.264 ms) : 0, 13264
Flare Poller [baseline] (3.467 ms) : 0, 3467
Flare Poller [candidate] (3.545 ms) : 0, 3545

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~7002719936, baseline=1.62.0-SNAPSHOT~067d0d2c4b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1057387
Total [baseline] (11.09 s) : 0, 11090174
Agent [candidate] (1.066 s) : 0, 1066061
Total [candidate] (11.139 s) : 0, 11139313
section appsec
Agent [baseline] (1.248 s) : 0, 1248017
Total [baseline] (11.196 s) : 0, 11196037
Agent [candidate] (1.248 s) : 0, 1247543
Total [candidate] (11.129 s) : 0, 11129017
section iast
Agent [baseline] (1.234 s) : 0, 1233974
Total [baseline] (11.38 s) : 0, 11379973
Agent [candidate] (1.232 s) : 0, 1231621
Total [candidate] (11.197 s) : 0, 11197236
section profiling
Agent [baseline] (1.185 s) : 0, 1184976
Total [baseline] (11.169 s) : 0, 11169431
Agent [candidate] (1.192 s) : 0, 1191533
Total [candidate] (11.064 s) : 0, 11063853

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	appsec	1.248 s	190.63 ms (18.0%)
Agent	iast	1.234 s	176.586 ms (16.7%)
Agent	profiling	1.185 s	127.589 ms (12.1%)
Total	tracing	11.09 s	-
Total	appsec	11.196 s	105.863 ms (1.0%)
Total	iast	11.38 s	289.799 ms (2.6%)
Total	profiling	11.169 s	79.257 ms (0.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	appsec	1.248 s	181.482 ms (17.0%)
Agent	iast	1.232 s	165.56 ms (15.5%)
Agent	profiling	1.192 s	125.472 ms (11.8%)
Total	tracing	11.139 s	-
Total	appsec	11.129 s	-10.296 ms (-0.1%)
Total	iast	11.197 s	57.923 ms (0.5%)
Total	profiling	11.064 s	-75.46 ms (-0.7%)

gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~7002719936, baseline=1.62.0-SNAPSHOT~067d0d2c4b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.242 ms) : 0, 1242
crashtracking [candidate] (1.216 ms) : 0, 1216
BytebuddyAgent [baseline] (632.881 ms) : 0, 632881
BytebuddyAgent [candidate] (636.869 ms) : 0, 636869
AgentMeter [baseline] (29.451 ms) : 0, 29451
AgentMeter [candidate] (29.879 ms) : 0, 29879
GlobalTracer [baseline] (248.923 ms) : 0, 248923
GlobalTracer [candidate] (251.715 ms) : 0, 251715
AppSec [baseline] (32.07 ms) : 0, 32070
AppSec [candidate] (32.607 ms) : 0, 32607
Debugger [baseline] (60.217 ms) : 0, 60217
Debugger [candidate] (60.98 ms) : 0, 60980
Remote Config [baseline] (601.709 µs) : 0, 602
Remote Config [candidate] (601.039 µs) : 0, 601
Telemetry [baseline] (8.12 ms) : 0, 8120
Telemetry [candidate] (8.198 ms) : 0, 8198
Flare Poller [baseline] (7.643 ms) : 0, 7643
Flare Poller [candidate] (7.674 ms) : 0, 7674
section appsec
crashtracking [baseline] (1.233 ms) : 0, 1233
crashtracking [candidate] (1.22 ms) : 0, 1220
BytebuddyAgent [baseline] (661.477 ms) : 0, 661477
BytebuddyAgent [candidate] (660.729 ms) : 0, 660729
AgentMeter [baseline] (12.062 ms) : 0, 12062
AgentMeter [candidate] (12.086 ms) : 0, 12086
GlobalTracer [baseline] (248.838 ms) : 0, 248838
GlobalTracer [candidate] (249.116 ms) : 0, 249116
AppSec [baseline] (184.783 ms) : 0, 184783
AppSec [candidate] (184.494 ms) : 0, 184494
Debugger [baseline] (65.885 ms) : 0, 65885
Debugger [candidate] (65.9 ms) : 0, 65900
Remote Config [baseline] (596.892 µs) : 0, 597
Remote Config [candidate] (623.529 µs) : 0, 624
Telemetry [baseline] (8.599 ms) : 0, 8599
Telemetry [candidate] (8.565 ms) : 0, 8565
Flare Poller [baseline] (3.561 ms) : 0, 3561
Flare Poller [candidate] (3.563 ms) : 0, 3563
IAST [baseline] (24.571 ms) : 0, 24571
IAST [candidate] (24.756 ms) : 0, 24756
section iast
crashtracking [baseline] (1.241 ms) : 0, 1241
crashtracking [candidate] (1.232 ms) : 0, 1232
BytebuddyAgent [baseline] (809.913 ms) : 0, 809913
BytebuddyAgent [candidate] (806.225 ms) : 0, 806225
AgentMeter [baseline] (11.512 ms) : 0, 11512
AgentMeter [candidate] (11.527 ms) : 0, 11527
GlobalTracer [baseline] (240.626 ms) : 0, 240626
GlobalTracer [candidate] (240.072 ms) : 0, 240072
AppSec [baseline] (31.789 ms) : 0, 31789
AppSec [candidate] (32.03 ms) : 0, 32030
Debugger [baseline] (59.581 ms) : 0, 59581
Debugger [candidate] (61.142 ms) : 0, 61142
Remote Config [baseline] (528.52 µs) : 0, 529
Remote Config [candidate] (536.02 µs) : 0, 536
Telemetry [baseline] (13.109 ms) : 0, 13109
Telemetry [candidate] (13.018 ms) : 0, 13018
Flare Poller [baseline] (3.531 ms) : 0, 3531
Flare Poller [candidate] (3.476 ms) : 0, 3476
IAST [baseline] (25.702 ms) : 0, 25702
IAST [candidate] (25.975 ms) : 0, 25975
section profiling
ProfilingAgent [baseline] (94.381 ms) : 0, 94381
ProfilingAgent [candidate] (94.027 ms) : 0, 94027
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (690.895 ms) : 0, 690895
BytebuddyAgent [candidate] (695.609 ms) : 0, 695609
AgentMeter [baseline] (9.133 ms) : 0, 9133
AgentMeter [candidate] (9.15 ms) : 0, 9150
GlobalTracer [baseline] (207.5 ms) : 0, 207500
GlobalTracer [candidate] (208.86 ms) : 0, 208860
AppSec [baseline] (32.517 ms) : 0, 32517
AppSec [candidate] (32.93 ms) : 0, 32930
Debugger [baseline] (65.936 ms) : 0, 65936
Debugger [candidate] (65.994 ms) : 0, 65994
Remote Config [baseline] (577.819 µs) : 0, 578
Remote Config [candidate] (566.129 µs) : 0, 566
Telemetry [baseline] (7.875 ms) : 0, 7875
Telemetry [candidate] (7.872 ms) : 0, 7872
Flare Poller [baseline] (3.595 ms) : 0, 3595
Flare Poller [candidate] (3.6 ms) : 0, 3600
Profiling [baseline] (94.934 ms) : 0, 94934
Profiling [candidate] (94.594 ms) : 0, 94594

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	andrea.marziali/ibmsmoke
git_commit_date	1775810809	1775814617
git_commit_sha	`067d0d2`	`7002719`
release_version	1.62.0-SNAPSHOT~067d0d2c4b	1.62.0-SNAPSHOT~7002719936

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1775816904	1775816904
ci_job_id	1584685547	1584685547
ci_pipeline_id	107053574	107053574
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-vvi1dpkb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-vvi1dpkb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:profiling:high_load	worse [+0.616ms; +1.394ms] or [+3.474%; +7.862%]	unsure [+265.013µs; +1593.681µs] or [+0.917%; +5.512%]	unstable [-37.101op/s; +12.101op/s] or [-14.377%; +4.689%]	18.738ms	29.844ms	245.562op/s	17.733ms	28.915ms	258.062op/s
scenario:load:petclinic:iast:high_load	better [-1.584ms; -0.655ms] or [-8.542%; -3.534%]	unsure [-1.658ms; -0.395ms] or [-5.568%; -1.327%]	unstable [-11.865op/s; +37.678op/s] or [-4.783%; +15.187%]	17.425ms	28.755ms	261.000op/s	18.545ms	29.782ms	248.094op/s
scenario:load:petclinic:tracing:high_load	better [-1.569ms; -0.780ms] or [-8.464%; -4.207%]	better [-2.251ms; -0.871ms] or [-7.438%; -2.877%]	unstable [-10.611op/s; +38.923op/s] or [-4.288%; +15.729%]	17.366ms	28.697ms	261.625op/s	18.540ms	30.258ms	247.469op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~7002719936, baseline=1.62.0-SNAPSHOT~067d0d2c4b
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.254 ms) : 18069, 18438
.   : milestone, 18254,
appsec (19.081 ms) : 18888, 19274
.   : milestone, 19081,
code_origins (17.988 ms) : 17810, 18165
.   : milestone, 17988,
iast (18.813 ms) : 18622, 19003
.   : milestone, 18813,
profiling (18.076 ms) : 17898, 18253
.   : milestone, 18076,
tracing (18.859 ms) : 18666, 19051
.   : milestone, 18859,
section candidate
no_agent (19.194 ms) : 18994, 19393
.   : milestone, 19194,
appsec (19.103 ms) : 18906, 19300
.   : milestone, 19103,
code_origins (17.891 ms) : 17712, 18070
.   : milestone, 17891,
iast (17.879 ms) : 17703, 18056
.   : milestone, 17879,
profiling (19.006 ms) : 18821, 19191
.   : milestone, 19006,
tracing (17.833 ms) : 17655, 18011
.   : milestone, 17833,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.254 ms [18.069 ms, 18.438 ms]	-
appsec	19.081 ms [18.888 ms, 19.274 ms]	827.705 µs (4.5%)
code_origins	17.988 ms [17.81 ms, 18.165 ms]	-265.931 µs (-1.5%)
iast	18.813 ms [18.622 ms, 19.003 ms]	559.25 µs (3.1%)
profiling	18.076 ms [17.898 ms, 18.253 ms]	-177.931 µs (-1.0%)
tracing	18.859 ms [18.666 ms, 19.051 ms]	604.993 µs (3.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.194 ms [18.994 ms, 19.393 ms]	-
appsec	19.103 ms [18.906 ms, 19.3 ms]	-90.297 µs (-0.5%)
code_origins	17.891 ms [17.712 ms, 18.07 ms]	-1.303 ms (-6.8%)
iast	17.879 ms [17.703 ms, 18.056 ms]	-1.314 ms (-6.8%)
profiling	19.006 ms [18.821 ms, 19.191 ms]	-187.943 µs (-1.0%)
tracing	17.833 ms [17.655 ms, 18.011 ms]	-1.361 ms (-7.1%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~7002719936, baseline=1.62.0-SNAPSHOT~067d0d2c4b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.259 ms) : 1246, 1272
.   : milestone, 1259,
iast (3.381 ms) : 3331, 3431
.   : milestone, 3381,
iast_FULL (6.235 ms) : 6171, 6299
.   : milestone, 6235,
iast_GLOBAL (3.718 ms) : 3655, 3782
.   : milestone, 3718,
profiling (2.224 ms) : 2204, 2244
.   : milestone, 2224,
tracing (1.844 ms) : 1829, 1858
.   : milestone, 1844,
section candidate
no_agent (1.234 ms) : 1222, 1246
.   : milestone, 1234,
iast (3.3 ms) : 3254, 3346
.   : milestone, 3300,
iast_FULL (6.437 ms) : 6369, 6505
.   : milestone, 6437,
iast_GLOBAL (3.616 ms) : 3562, 3670
.   : milestone, 3616,
profiling (2.199 ms) : 2178, 2220
.   : milestone, 2199,
tracing (1.95 ms) : 1933, 1967
.   : milestone, 1950,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.259 ms [1.246 ms, 1.272 ms]	-
iast	3.381 ms [3.331 ms, 3.431 ms]	2.122 ms (168.5%)
iast_FULL	6.235 ms [6.171 ms, 6.299 ms]	4.976 ms (395.2%)
iast_GLOBAL	3.718 ms [3.655 ms, 3.782 ms]	2.459 ms (195.3%)
profiling	2.224 ms [2.204 ms, 2.244 ms]	964.937 µs (76.6%)
tracing	1.844 ms [1.829 ms, 1.858 ms]	584.657 µs (46.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.234 ms [1.222 ms, 1.246 ms]	-
iast	3.3 ms [3.254 ms, 3.346 ms]	2.066 ms (167.4%)
iast_FULL	6.437 ms [6.369 ms, 6.505 ms]	5.203 ms (421.5%)
iast_GLOBAL	3.616 ms [3.562 ms, 3.67 ms]	2.382 ms (193.0%)
profiling	2.199 ms [2.178 ms, 2.22 ms]	964.973 µs (78.2%)
tracing	1.95 ms [1.933 ms, 1.967 ms]	715.842 µs (58.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	andrea.marziali/ibmsmoke
git_commit_date	1775810809	1775814617
git_commit_sha	`067d0d2`	`7002719`
release_version	1.62.0-SNAPSHOT~067d0d2c4b	1.62.0-SNAPSHOT~7002719936

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1775816604	1775816604
ci_job_id	1584685548	1584685548
ci_pipeline_id	107053574	107053574
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-07100v8o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-07100v8o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~7002719936, baseline=1.62.0-SNAPSHOT~067d0d2c4b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.096 s) : 15096000, 15096000
.   : milestone, 15096000,
appsec (14.838 s) : 14838000, 14838000
.   : milestone, 14838000,
iast (17.907 s) : 17907000, 17907000
.   : milestone, 17907000,
iast_GLOBAL (18.049 s) : 18049000, 18049000
.   : milestone, 18049000,
profiling (15.005 s) : 15005000, 15005000
.   : milestone, 15005000,
tracing (14.836 s) : 14836000, 14836000
.   : milestone, 14836000,
section candidate
no_agent (14.945 s) : 14945000, 14945000
.   : milestone, 14945000,
appsec (15.097 s) : 15097000, 15097000
.   : milestone, 15097000,
iast (18.17 s) : 18170000, 18170000
.   : milestone, 18170000,
iast_GLOBAL (18.111 s) : 18111000, 18111000
.   : milestone, 18111000,
profiling (14.766 s) : 14766000, 14766000
.   : milestone, 14766000,
tracing (15.175 s) : 15175000, 15175000
.   : milestone, 15175000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.096 s [15.096 s, 15.096 s]	-
appsec	14.838 s [14.838 s, 14.838 s]	-258.0 ms (-1.7%)
iast	17.907 s [17.907 s, 17.907 s]	2.811 s (18.6%)
iast_GLOBAL	18.049 s [18.049 s, 18.049 s]	2.953 s (19.6%)
profiling	15.005 s [15.005 s, 15.005 s]	-91.0 ms (-0.6%)
tracing	14.836 s [14.836 s, 14.836 s]	-260.0 ms (-1.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.945 s [14.945 s, 14.945 s]	-
appsec	15.097 s [15.097 s, 15.097 s]	152.0 ms (1.0%)
iast	18.17 s [18.17 s, 18.17 s]	3.225 s (21.6%)
iast_GLOBAL	18.111 s [18.111 s, 18.111 s]	3.166 s (21.2%)
profiling	14.766 s [14.766 s, 14.766 s]	-179.0 ms (-1.2%)
tracing	15.175 s [15.175 s, 15.175 s]	230.0 ms (1.5%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~7002719936, baseline=1.62.0-SNAPSHOT~067d0d2c4b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.486 ms) : 1474, 1497
.   : milestone, 1486,
appsec (3.824 ms) : 3602, 4046
.   : milestone, 3824,
iast (2.267 ms) : 2198, 2336
.   : milestone, 2267,
iast_GLOBAL (2.308 ms) : 2239, 2378
.   : milestone, 2308,
profiling (2.523 ms) : 2358, 2688
.   : milestone, 2523,
tracing (2.097 ms) : 2043, 2152
.   : milestone, 2097,
section candidate
no_agent (1.486 ms) : 1474, 1497
.   : milestone, 1486,
appsec (3.802 ms) : 3581, 4024
.   : milestone, 3802,
iast (2.265 ms) : 2195, 2334
.   : milestone, 2265,
iast_GLOBAL (2.309 ms) : 2240, 2378
.   : milestone, 2309,
profiling (2.088 ms) : 2034, 2143
.   : milestone, 2088,
tracing (2.071 ms) : 2018, 2124
.   : milestone, 2071,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.486 ms [1.474 ms, 1.497 ms]	-
appsec	3.824 ms [3.602 ms, 4.046 ms]	2.339 ms (157.4%)
iast	2.267 ms [2.198 ms, 2.336 ms]	781.174 µs (52.6%)
iast_GLOBAL	2.308 ms [2.239 ms, 2.378 ms]	822.689 µs (55.4%)
profiling	2.523 ms [2.358 ms, 2.688 ms]	1.037 ms (69.8%)
tracing	2.097 ms [2.043 ms, 2.152 ms]	611.817 µs (41.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.486 ms [1.474 ms, 1.497 ms]	-
appsec	3.802 ms [3.581 ms, 4.024 ms]	2.317 ms (156.0%)
iast	2.265 ms [2.195 ms, 2.334 ms]	779.037 µs (52.4%)
iast_GLOBAL	2.309 ms [2.24 ms, 2.378 ms]	823.326 µs (55.4%)
profiling	2.088 ms [2.034 ms, 2.143 ms]	602.961 µs (40.6%)
tracing	2.071 ms [2.018 ms, 2.124 ms]	585.627 µs (39.4%)

mcculls

Thanks for the increased coverage!

dd-octo-sts · 2026-04-10T12:32:16Z

/merge

gh-worker-devflow-routing-ef8351 · 2026-04-10T12:32:21Z

View all feedbacks in Devflow UI.

2026-04-10 12:32:20 UTC ℹ️ Start processing command /merge

2026-04-10 12:32:24 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).

2026-04-10 13:45:07 UTC ℹ️ MergeQueue: This merge request was merged

Add smoke test for websphere-jmx

d61f715

amarziali added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes labels Apr 10, 2026

amarziali requested a review from a team as a code owner April 10, 2026 08:57

amarziali requested a review from mcculls April 10, 2026 08:57

avoid udp listener hangs on cleanup

7002719

amarziali enabled auto-merge April 10, 2026 11:53

mcculls approved these changes Apr 10, 2026

View reviewed changes

amarziali added this pull request to the merge queue Apr 10, 2026

github-merge-queue bot removed this pull request from the merge queue due to failed status checks Apr 10, 2026

gh-worker-dd-mergequeue-cf854d bot merged commit 7426235 into master Apr 10, 2026
567 checks passed

gh-worker-dd-mergequeue-cf854d bot deleted the andrea.marziali/ibmsmoke branch April 10, 2026 13:45

github-actions bot added this to the 1.62.0 milestone Apr 10, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add smoke test for websphere-jmx#11077

Add smoke test for websphere-jmx#11077
gh-worker-dd-mergequeue-cf854d[bot] merged 2 commits intomasterfrom
andrea.marziali/ibmsmoke

amarziali commented Apr 10, 2026

Uh oh!

pr-commenter bot commented Apr 10, 2026 •

edited

Loading

Uh oh!

mcculls left a comment

Uh oh!

dd-octo-sts bot commented Apr 10, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Apr 10, 2026 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

amarziali commented Apr 10, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Apr 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

mcculls left a comment

Choose a reason for hiding this comment

Uh oh!

dd-octo-sts bot commented Apr 10, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Apr 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

pr-commenter bot commented Apr 10, 2026 •

edited

Loading

gh-worker-devflow-routing-ef8351 bot commented Apr 10, 2026 •

edited

Loading