Skip to content

Add JApiCmd plugin to ease up spotting api differences for muzzle #10233

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
amarziali merged 2 commits into from
Dec 18, 2025
Merged

Add JApiCmd plugin to ease up spotting api differences for muzzle #10233

amarziali merged 2 commits into from
Dec 18, 2025

Conversation

@amarziali
Copy link
Contributor

@amarziali amarziali commented Dec 17, 2025 •
edited
Loading

What Does This Do

Adds the JApiCmp Gradle plugin to help identify API breaking changes when defining muzzle version ranges for instrumentations.

It also updates the documentation to illustrate use cases, especially to ease up muzzle directive definitions.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Dec 17, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/automuzzle
git_commit_date 1765988867 1766050538
git_commit_sha a9499fa 3b5371c
release_version 1.57.0-SNAPSHOT~a9499fa82c 1.57.0-SNAPSHOT~3b5371c1e4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1766052493 1766052493
ci_job_id 1305314039 1305314039
ci_pipeline_id 87497215 87497215
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-rxkk9jgr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-rxkk9jgr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~3b5371c1e4, baseline=1.57.0-SNAPSHOT~a9499fa82c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.092 s) : 0, 1092223
Total [baseline] (10.925 s) : 0, 10925014
Agent [candidate] (1.08 s) : 0, 1079941
Total [candidate] (10.836 s) : 0, 10835859
section appsec
Agent [baseline] (1.278 s) : 0, 1277793
Total [baseline] (10.972 s) : 0, 10972181
Agent [candidate] (1.259 s) : 0, 1258963
Total [candidate] (11.012 s) : 0, 11012307
section iast
Agent [baseline] (1.227 s) : 0, 1227478
Total [baseline] (11.238 s) : 0, 11237889
Agent [candidate] (1.217 s) : 0, 1216979
Total [candidate] (11.164 s) : 0, 11163534
section profiling
Agent [baseline] (1.202 s) : 0, 1201722
Total [baseline] (11.0 s) : 0, 10999582
Agent [candidate] (1.2 s) : 0, 1199846
Total [candidate] (10.928 s) : 0, 10927755
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.092 s -
Agent appsec 1.278 s 185.57 ms (17.0%)
Agent iast 1.227 s 135.255 ms (12.4%)
Agent profiling 1.202 s 109.499 ms (10.0%)
Total tracing 10.925 s -
Total appsec 10.972 s 47.167 ms (0.4%)
Total iast 11.238 s 312.875 ms (2.9%)
Total profiling 11.0 s 74.568 ms (0.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent appsec 1.259 s 179.023 ms (16.6%)
Agent iast 1.217 s 137.038 ms (12.7%)
Agent profiling 1.2 s 119.905 ms (11.1%)
Total tracing 10.836 s -
Total appsec 11.012 s 176.448 ms (1.6%)
Total iast 11.164 s 327.675 ms (3.0%)
Total profiling 10.928 s 91.896 ms (0.8%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~3b5371c1e4, baseline=1.57.0-SNAPSHOT~a9499fa82c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.174 ms) : 0, 1174
BytebuddyAgent [baseline] (655.775 ms) : 0, 655775
BytebuddyAgent [candidate] (647.504 ms) : 0, 647504
GlobalTracer [baseline] (284.914 ms) : 0, 284914
GlobalTracer [candidate] (282.594 ms) : 0, 282594
AppSec [baseline] (32.788 ms) : 0, 32788
AppSec [candidate] (32.123 ms) : 0, 32123
Debugger [baseline] (68.382 ms) : 0, 68382
Debugger [candidate] (67.972 ms) : 0, 67972
Remote Config [baseline] (621.309 µs) : 0, 621
Remote Config [candidate] (609.986 µs) : 0, 610
Telemetry [baseline] (9.028 ms) : 0, 9028
Telemetry [candidate] (8.997 ms) : 0, 8997
Flare Poller [baseline] (3.8 ms) : 0, 3800
Flare Poller [candidate] (3.688 ms) : 0, 3688
section appsec
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (697.463 ms) : 0, 697463
BytebuddyAgent [candidate] (685.591 ms) : 0, 685591
GlobalTracer [baseline] (261.485 ms) : 0, 261485
GlobalTracer [candidate] (257.713 ms) : 0, 257713
IAST [baseline] (25.093 ms) : 0, 25093
IAST [candidate] (24.587 ms) : 0, 24587
AppSec [baseline] (175.372 ms) : 0, 175372
AppSec [candidate] (173.406 ms) : 0, 173406
Debugger [baseline] (67.976 ms) : 0, 67976
Debugger [candidate] (67.555 ms) : 0, 67555
Remote Config [baseline] (688.535 µs) : 0, 689
Remote Config [candidate] (715.883 µs) : 0, 716
Telemetry [baseline] (8.943 ms) : 0, 8943
Telemetry [candidate] (8.906 ms) : 0, 8906
Flare Poller [baseline] (3.828 ms) : 0, 3828
Flare Poller [candidate] (3.891 ms) : 0, 3891
section iast
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.172 ms) : 0, 1172
BytebuddyAgent [baseline] (793.734 ms) : 0, 793734
BytebuddyAgent [candidate] (786.249 ms) : 0, 786249
GlobalTracer [baseline] (256.247 ms) : 0, 256247
GlobalTracer [candidate] (254.686 ms) : 0, 254686
IAST [baseline] (27.311 ms) : 0, 27311
IAST [candidate] (26.927 ms) : 0, 26927
AppSec [baseline] (34.931 ms) : 0, 34931
AppSec [candidate] (32.633 ms) : 0, 32633
Debugger [baseline] (66.066 ms) : 0, 66066
Debugger [candidate] (67.617 ms) : 0, 67617
Remote Config [baseline] (600.695 µs) : 0, 601
Remote Config [candidate] (591.554 µs) : 0, 592
Telemetry [baseline] (8.435 ms) : 0, 8435
Telemetry [candidate] (8.397 ms) : 0, 8397
Flare Poller [baseline] (3.51 ms) : 0, 3510
Flare Poller [candidate] (3.456 ms) : 0, 3456
section profiling
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.206 ms) : 0, 1206
BytebuddyAgent [baseline] (698.853 ms) : 0, 698853
BytebuddyAgent [candidate] (698.95 ms) : 0, 698950
GlobalTracer [baseline] (220.651 ms) : 0, 220651
GlobalTracer [candidate] (219.851 ms) : 0, 219851
AppSec [baseline] (32.159 ms) : 0, 32159
AppSec [candidate] (31.996 ms) : 0, 31996
Debugger [baseline] (67.919 ms) : 0, 67919
Debugger [candidate] (68.114 ms) : 0, 68114
Remote Config [baseline] (660.593 µs) : 0, 661
Remote Config [candidate] (634.063 µs) : 0, 634
Telemetry [baseline] (8.772 ms) : 0, 8772
Telemetry [candidate] (8.782 ms) : 0, 8782
Flare Poller [baseline] (3.722 ms) : 0, 3722
Flare Poller [candidate] (3.679 ms) : 0, 3679
ProfilingAgent [baseline] (98.213 ms) : 0, 98213
ProfilingAgent [candidate] (97.152 ms) : 0, 97152
Profiling [baseline] (98.804 ms) : 0, 98804
Profiling [candidate] (97.754 ms) : 0, 97754
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~3b5371c1e4, baseline=1.57.0-SNAPSHOT~a9499fa82c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.089 s) : 0, 1088685
Total [baseline] (8.796 s) : 0, 8796353
Agent [candidate] (1.079 s) : 0, 1079232
Total [candidate] (8.76 s) : 0, 8760480
section iast
Agent [baseline] (1.227 s) : 0, 1226679
Total [baseline] (9.385 s) : 0, 9385297
Agent [candidate] (1.216 s) : 0, 1215536
Total [candidate] (9.407 s) : 0, 9407208
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.089 s -
Agent iast 1.227 s 137.994 ms (12.7%)
Total tracing 8.796 s -
Total iast 9.385 s 588.944 ms (6.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent iast 1.216 s 136.304 ms (12.6%)
Total tracing 8.76 s -
Total iast 9.407 s 646.728 ms (7.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~3b5371c1e4, baseline=1.57.0-SNAPSHOT~a9499fa82c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.174 ms) : 0, 1174
BytebuddyAgent [baseline] (653.749 ms) : 0, 653749
BytebuddyAgent [candidate] (647.367 ms) : 0, 647367
GlobalTracer [baseline] (284.358 ms) : 0, 284358
GlobalTracer [candidate] (282.058 ms) : 0, 282058
AppSec [baseline] (32.601 ms) : 0, 32601
AppSec [candidate] (32.293 ms) : 0, 32293
Debugger [baseline] (66.863 ms) : 0, 66863
Debugger [candidate] (67.364 ms) : 0, 67364
Remote Config [baseline] (638.695 µs) : 0, 639
Remote Config [candidate] (643.309 µs) : 0, 643
Telemetry [baseline] (9.067 ms) : 0, 9067
Telemetry [candidate] (9.093 ms) : 0, 9093
Flare Poller [baseline] (4.523 ms) : 0, 4523
Flare Poller [candidate] (3.76 ms) : 0, 3760
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (793.409 ms) : 0, 793409
BytebuddyAgent [candidate] (785.304 ms) : 0, 785304
GlobalTracer [baseline] (256.761 ms) : 0, 256761
GlobalTracer [candidate] (254.693 ms) : 0, 254693
IAST [baseline] (27.911 ms) : 0, 27911
IAST [candidate] (26.806 ms) : 0, 26806
AppSec [baseline] (34.618 ms) : 0, 34618
AppSec [candidate] (31.764 ms) : 0, 31764
Debugger [baseline] (64.661 ms) : 0, 64661
Debugger [candidate] (68.094 ms) : 0, 68094
Remote Config [baseline] (605.342 µs) : 0, 605
Remote Config [candidate] (575.25 µs) : 0, 575
Telemetry [baseline] (8.542 ms) : 0, 8542
Telemetry [candidate] (8.423 ms) : 0, 8423
Flare Poller [baseline] (3.595 ms) : 0, 3595
Flare Poller [candidate] (3.481 ms) : 0, 3481
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/automuzzle
git_commit_date 1765988867 1766050538
git_commit_sha a9499fa 3b5371c
release_version 1.57.0-SNAPSHOT~a9499fa82c 1.57.0-SNAPSHOT~3b5371c1e4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1766052895 1766052895
ci_job_id 1305314041 1305314041
ci_pipeline_id 87497215 87497215
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-6avfefb3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-6avfefb3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 15 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-218.757µs; -108.363µs] or [-7.532%; -3.731%]		 unstable
[-1231.016µs; +33.129µs] or [-14.668%; +0.395%]		 unstable
[-68.389op/s; +217.264op/s] or [-5.497%; +17.463%]		 2.741ms 7.794ms 1318.594op/s 2.904ms 8.393ms 1244.156op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.735ms; +3.272ms] or [+10.613%; +20.016%]		 unstable
[+2.274ms; +5.398ms] or [+8.169%; +19.389%]		 unstable
[-60.914op/s; -1.398op/s] or [-22.285%; -0.512%]		 18.851ms 31.677ms 242.188op/s 16.347ms 27.841ms 273.344op/s
scenario:load:petclinic:code_origins:high_load better
[-1.470ms; -0.625ms] or [-8.034%; -3.418%]		 better
[-2.142ms; -0.827ms] or [-7.203%; -2.781%]		 unstable
[-13.749op/s; +41.999op/s] or [-5.499%; +16.799%]		 17.249ms 28.251ms 264.125op/s 18.297ms 29.736ms 250.000op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~3b5371c1e4, baseline=1.57.0-SNAPSHOT~a9499fa82c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.192 ms) : 1180, 1203
.   : milestone, 1192,
iast (3.277 ms) : 3233, 3320
.   : milestone, 3277,
iast_FULL (5.757 ms) : 5700, 5815
.   : milestone, 5757,
iast_GLOBAL (3.688 ms) : 3627, 3748
.   : milestone, 3688,
profiling (1.949 ms) : 1932, 1966
.   : milestone, 1949,
tracing (1.759 ms) : 1744, 1775
.   : milestone, 1759,
section candidate
no_agent (1.186 ms) : 1174, 1197
.   : milestone, 1186,
iast (3.163 ms) : 3122, 3204
.   : milestone, 3163,
iast_FULL (5.596 ms) : 5542, 5651
.   : milestone, 5596,
iast_GLOBAL (3.477 ms) : 3430, 3524
.   : milestone, 3477,
profiling (1.907 ms) : 1889, 1924
.   : milestone, 1907,
tracing (1.787 ms) : 1772, 1802
.   : milestone, 1787,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.192 ms [1.18 ms, 1.203 ms] -
iast 3.277 ms [3.233 ms, 3.32 ms] 2.085 ms (174.9%)
iast_FULL 5.757 ms [5.7 ms, 5.815 ms] 4.565 ms (383.1%)
iast_GLOBAL 3.688 ms [3.627 ms, 3.748 ms] 2.496 ms (209.4%)
profiling 1.949 ms [1.932 ms, 1.966 ms] 757.524 µs (63.6%)
tracing 1.759 ms [1.744 ms, 1.775 ms] 567.698 µs (47.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.186 ms [1.174 ms, 1.197 ms] -
iast 3.163 ms [3.122 ms, 3.204 ms] 1.977 ms (166.8%)
iast_FULL 5.596 ms [5.542 ms, 5.651 ms] 4.411 ms (372.0%)
iast_GLOBAL 3.477 ms [3.43 ms, 3.524 ms] 2.291 ms (193.2%)
profiling 1.907 ms [1.889 ms, 1.924 ms] 720.806 µs (60.8%)
tracing 1.787 ms [1.772 ms, 1.802 ms] 601.097 µs (50.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~3b5371c1e4, baseline=1.57.0-SNAPSHOT~a9499fa82c
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.068 ms) : 16894, 17241
.   : milestone, 17068,
appsec (18.373 ms) : 18189, 18557
.   : milestone, 18373,
code_origins (18.667 ms) : 18476, 18857
.   : milestone, 18667,
iast (18.087 ms) : 17905, 18270
.   : milestone, 18087,
profiling (18.609 ms) : 18425, 18792
.   : milestone, 18609,
tracing (17.522 ms) : 17348, 17697
.   : milestone, 17522,
section candidate
no_agent (19.274 ms) : 19075, 19473
.   : milestone, 19274,
appsec (18.387 ms) : 18204, 18569
.   : milestone, 18387,
code_origins (17.662 ms) : 17490, 17833
.   : milestone, 17662,
iast (17.679 ms) : 17501, 17856
.   : milestone, 17679,
profiling (18.388 ms) : 18204, 18571
.   : milestone, 18388,
tracing (17.613 ms) : 17440, 17787
.   : milestone, 17613,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.068 ms [16.894 ms, 17.241 ms] -
appsec 18.373 ms [18.189 ms, 18.557 ms] 1.305 ms (7.6%)
code_origins 18.667 ms [18.476 ms, 18.857 ms] 1.599 ms (9.4%)
iast 18.087 ms [17.905 ms, 18.27 ms] 1.02 ms (6.0%)
profiling 18.609 ms [18.425 ms, 18.792 ms] 1.541 ms (9.0%)
tracing 17.522 ms [17.348 ms, 17.697 ms] 454.374 µs (2.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.274 ms [19.075 ms, 19.473 ms] -
appsec 18.387 ms [18.204 ms, 18.569 ms] -887.608 µs (-4.6%)
code_origins 17.662 ms [17.49 ms, 17.833 ms] -1.613 ms (-8.4%)
iast 17.679 ms [17.501 ms, 17.856 ms] -1.595 ms (-8.3%)
profiling 18.388 ms [18.204 ms, 18.571 ms] -886.622 µs (-4.6%)
tracing 17.613 ms [17.44 ms, 17.787 ms] -1.661 ms (-8.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/automuzzle
git_commit_date 1765988867 1766050538
git_commit_sha a9499fa 3b5371c
release_version 1.57.0-SNAPSHOT~a9499fa82c 1.57.0-SNAPSHOT~3b5371c1e4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1766052670 1766052670
ci_job_id 1305314043 1305314043
ci_pipeline_id 87497215 87497215
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5ej6pnn7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5ej6pnn7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~3b5371c1e4, baseline=1.57.0-SNAPSHOT~a9499fa82c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1494
.   : milestone, 1483,
appsec (2.528 ms) : 2472, 2583
.   : milestone, 2528,
iast (2.214 ms) : 2149, 2278
.   : milestone, 2214,
iast_GLOBAL (2.268 ms) : 2203, 2333
.   : milestone, 2268,
profiling (2.092 ms) : 2038, 2146
.   : milestone, 2092,
tracing (2.053 ms) : 2001, 2104
.   : milestone, 2053,
section candidate
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.753 ms) : 3531, 3975
.   : milestone, 3753,
iast (2.217 ms) : 2152, 2282
.   : milestone, 2217,
iast_GLOBAL (2.263 ms) : 2198, 2328
.   : milestone, 2263,
profiling (2.107 ms) : 2052, 2162
.   : milestone, 2107,
tracing (2.052 ms) : 2001, 2103
.   : milestone, 2052,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.494 ms] -
appsec 2.528 ms [2.472 ms, 2.583 ms] 1.045 ms (70.5%)
iast 2.214 ms [2.149 ms, 2.278 ms] 731.072 µs (49.3%)
iast_GLOBAL 2.268 ms [2.203 ms, 2.333 ms] 785.527 µs (53.0%)
profiling 2.092 ms [2.038 ms, 2.146 ms] 609.281 µs (41.1%)
tracing 2.053 ms [2.001 ms, 2.104 ms] 569.877 µs (38.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.753 ms [3.531 ms, 3.975 ms] 2.276 ms (154.1%)
iast 2.217 ms [2.152 ms, 2.282 ms] 740.229 µs (50.1%)
iast_GLOBAL 2.263 ms [2.198 ms, 2.328 ms] 786.356 µs (53.2%)
profiling 2.107 ms [2.052 ms, 2.162 ms] 630.193 µs (42.7%)
tracing 2.052 ms [2.001 ms, 2.103 ms] 575.61 µs (39.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~3b5371c1e4, baseline=1.57.0-SNAPSHOT~a9499fa82c
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.037 s) : 15037000, 15037000
.   : milestone, 15037000,
appsec (14.982 s) : 14982000, 14982000
.   : milestone, 14982000,
iast (18.342 s) : 18342000, 18342000
.   : milestone, 18342000,
iast_GLOBAL (17.932 s) : 17932000, 17932000
.   : milestone, 17932000,
profiling (14.921 s) : 14921000, 14921000
.   : milestone, 14921000,
tracing (14.552 s) : 14552000, 14552000
.   : milestone, 14552000,
section candidate
no_agent (14.955 s) : 14955000, 14955000
.   : milestone, 14955000,
appsec (14.587 s) : 14587000, 14587000
.   : milestone, 14587000,
iast (18.01 s) : 18010000, 18010000
.   : milestone, 18010000,
iast_GLOBAL (17.968 s) : 17968000, 17968000
.   : milestone, 17968000,
profiling (14.782 s) : 14782000, 14782000
.   : milestone, 14782000,
tracing (14.856 s) : 14856000, 14856000
.   : milestone, 14856000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.037 s [15.037 s, 15.037 s] -
appsec 14.982 s [14.982 s, 14.982 s] -55.0 ms (-0.4%)
iast 18.342 s [18.342 s, 18.342 s] 3.305 s (22.0%)
iast_GLOBAL 17.932 s [17.932 s, 17.932 s] 2.895 s (19.3%)
profiling 14.921 s [14.921 s, 14.921 s] -116.0 ms (-0.8%)
tracing 14.552 s [14.552 s, 14.552 s] -485.0 ms (-3.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.955 s [14.955 s, 14.955 s] -
appsec 14.587 s [14.587 s, 14.587 s] -368.0 ms (-2.5%)
iast 18.01 s [18.01 s, 18.01 s] 3.055 s (20.4%)
iast_GLOBAL 17.968 s [17.968 s, 17.968 s] 3.013 s (20.1%)
profiling 14.782 s [14.782 s, 14.782 s] -173.0 ms (-1.2%)
tracing 14.856 s [14.856 s, 14.856 s] -99.0 ms (-0.7%)

@amarziali amarziali force-pushed the andrea.marziali/automuzzle branch from 39c8bba to 98cfd05 Compare December 18, 2025 07:39
@amarziali amarziali added type: enhancement Enhancements and improvements type: documentation comp: tooling Build & Tooling labels Dec 18, 2025
@amarziali amarziali changed the title Add jcmp plugin to ease up spotting api differences for muzzle Add JApiCmd plugin to ease up spotting api differences for muzzle Dec 18, 2025
@amarziali amarziali marked this pull request as ready for review December 18, 2025 07:42
@amarziali amarziali requested a review from a team as a code owner December 18, 2025 07:42
@amarziali amarziali requested a review from smola December 18, 2025 07:42
@amarziali amarziali merged commit b9fde86 into master Dec 18, 2025
738 of 744 checks passed
@amarziali amarziali deleted the andrea.marziali/automuzzle branch December 18, 2025 15:16
@github-actions github-actions bot added this to the 1.58.0 milestone Dec 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bric3 bric3 bric3 approved these changes

@smola smola Awaiting requested review from smola smola is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: tooling Build & Tooling type: documentation type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.58.0

Development

Successfully merging this pull request may close these issues.

3 participants

@amarziali @bric3