-
Notifications
You must be signed in to change notification settings - Fork 322
Remove instrumentation afterEvaluate
#9752
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
d930307 to
ff71451
Compare
This comment has been minimized.
This comment has been minimized.
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 11 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.58.0-SNAPSHOT~243cc8f840, baseline=1.58.0-SNAPSHOT~6ccbc0607e
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.086 s) : 0, 1085898
Total [baseline] (8.802 s) : 0, 8801663
Agent [candidate] (1.083 s) : 0, 1083123
Total [candidate] (8.768 s) : 0, 8768393
section iast
Agent [baseline] (1.222 s) : 0, 1222133
Total [baseline] (9.37 s) : 0, 9370267
Agent [candidate] (1.223 s) : 0, 1223247
Total [candidate] (9.388 s) : 0, 9387699
gantt
title insecure-bank - break down per module: candidate=1.58.0-SNAPSHOT~243cc8f840, baseline=1.58.0-SNAPSHOT~6ccbc0607e
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (653.057 ms) : 0, 653057
BytebuddyAgent [candidate] (650.182 ms) : 0, 650182
GlobalTracer [baseline] (282.706 ms) : 0, 282706
GlobalTracer [candidate] (283.262 ms) : 0, 283262
AppSec [baseline] (32.369 ms) : 0, 32369
AppSec [candidate] (32.439 ms) : 0, 32439
Debugger [baseline] (67.51 ms) : 0, 67510
Debugger [candidate] (66.377 ms) : 0, 66377
Remote Config [baseline] (611.203 µs) : 0, 611
Remote Config [candidate] (630.699 µs) : 0, 631
Telemetry [baseline] (9.038 ms) : 0, 9038
Telemetry [candidate] (9.778 ms) : 0, 9778
Flare Poller [baseline] (3.716 ms) : 0, 3716
Flare Poller [candidate] (3.73 ms) : 0, 3730
section iast
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (789.566 ms) : 0, 789566
BytebuddyAgent [candidate] (790.31 ms) : 0, 790310
GlobalTracer [baseline] (256.281 ms) : 0, 256281
GlobalTracer [candidate] (256.512 ms) : 0, 256512
AppSec [baseline] (33.498 ms) : 0, 33498
AppSec [candidate] (32.912 ms) : 0, 32912
Debugger [baseline] (66.435 ms) : 0, 66435
Debugger [candidate] (67.126 ms) : 0, 67126
Remote Config [baseline] (635.752 µs) : 0, 636
Remote Config [candidate] (596.746 µs) : 0, 597
Telemetry [baseline] (8.531 ms) : 0, 8531
Telemetry [candidate] (8.477 ms) : 0, 8477
Flare Poller [baseline] (3.565 ms) : 0, 3565
Flare Poller [candidate] (3.558 ms) : 0, 3558
IAST [baseline] (26.985 ms) : 0, 26985
IAST [candidate] (27.075 ms) : 0, 27075
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.58.0-SNAPSHOT~243cc8f840, baseline=1.58.0-SNAPSHOT~6ccbc0607e
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.088 s) : 0, 1088034
Total [baseline] (10.869 s) : 0, 10869293
Agent [candidate] (1.082 s) : 0, 1082192
Total [candidate] (10.803 s) : 0, 10803129
section appsec
Agent [baseline] (1.267 s) : 0, 1266759
Total [baseline] (11.007 s) : 0, 11007006
Agent [candidate] (1.268 s) : 0, 1268015
Total [candidate] (11.013 s) : 0, 11013066
section iast
Agent [baseline] (1.222 s) : 0, 1222281
Total [baseline] (11.165 s) : 0, 11164928
Agent [candidate] (1.238 s) : 0, 1238273
Total [candidate] (11.243 s) : 0, 11242752
section profiling
Agent [baseline] (1.207 s) : 0, 1206577
Total [baseline] (10.97 s) : 0, 10969648
Agent [candidate] (1.208 s) : 0, 1207817
Total [candidate] (10.979 s) : 0, 10978687
gantt
title petclinic - break down per module: candidate=1.58.0-SNAPSHOT~243cc8f840, baseline=1.58.0-SNAPSHOT~6ccbc0607e
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.175 ms) : 0, 1175
BytebuddyAgent [baseline] (654.048 ms) : 0, 654048
BytebuddyAgent [candidate] (648.746 ms) : 0, 648746
GlobalTracer [baseline] (282.819 ms) : 0, 282819
GlobalTracer [candidate] (283.013 ms) : 0, 283013
AppSec [baseline] (32.363 ms) : 0, 32363
AppSec [candidate] (32.202 ms) : 0, 32202
Debugger [baseline] (68.652 ms) : 0, 68652
Debugger [candidate] (68.102 ms) : 0, 68102
Remote Config [baseline] (603.21 µs) : 0, 603
Remote Config [candidate] (622.745 µs) : 0, 623
Telemetry [baseline] (8.983 ms) : 0, 8983
Telemetry [candidate] (9.159 ms) : 0, 9159
Flare Poller [baseline] (3.711 ms) : 0, 3711
Flare Poller [candidate] (3.726 ms) : 0, 3726
section appsec
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (690.095 ms) : 0, 690095
BytebuddyAgent [candidate] (690.992 ms) : 0, 690992
GlobalTracer [baseline] (259.807 ms) : 0, 259807
GlobalTracer [candidate] (260.562 ms) : 0, 260562
AppSec [baseline] (174.917 ms) : 0, 174917
AppSec [candidate] (174.954 ms) : 0, 174954
Debugger [baseline] (66.99 ms) : 0, 66990
Debugger [candidate] (66.65 ms) : 0, 66650
Remote Config [baseline] (734.426 µs) : 0, 734
Remote Config [candidate] (691.811 µs) : 0, 692
Telemetry [baseline] (8.897 ms) : 0, 8897
Telemetry [candidate] (8.976 ms) : 0, 8976
Flare Poller [baseline] (3.821 ms) : 0, 3821
Flare Poller [candidate] (3.775 ms) : 0, 3775
IAST [baseline] (24.571 ms) : 0, 24571
IAST [candidate] (24.498 ms) : 0, 24498
section iast
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (789.265 ms) : 0, 789265
BytebuddyAgent [candidate] (801.325 ms) : 0, 801325
GlobalTracer [baseline] (256.404 ms) : 0, 256404
GlobalTracer [candidate] (258.474 ms) : 0, 258474
AppSec [baseline] (31.839 ms) : 0, 31839
AppSec [candidate] (33.229 ms) : 0, 33229
Debugger [baseline] (68.387 ms) : 0, 68387
Debugger [candidate] (68.186 ms) : 0, 68186
Remote Config [baseline] (593.334 µs) : 0, 593
Remote Config [candidate] (628.212 µs) : 0, 628
Telemetry [baseline] (8.504 ms) : 0, 8504
Telemetry [candidate] (8.659 ms) : 0, 8659
Flare Poller [baseline] (3.533 ms) : 0, 3533
Flare Poller [candidate] (3.556 ms) : 0, 3556
IAST [baseline] (27.135 ms) : 0, 27135
IAST [candidate] (27.323 ms) : 0, 27323
section profiling
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.223 ms) : 0, 1223
BytebuddyAgent [baseline] (703.154 ms) : 0, 703154
BytebuddyAgent [candidate] (703.668 ms) : 0, 703668
GlobalTracer [baseline] (221.417 ms) : 0, 221417
GlobalTracer [candidate] (221.377 ms) : 0, 221377
AppSec [baseline] (32.193 ms) : 0, 32193
AppSec [candidate] (32.19 ms) : 0, 32190
Debugger [baseline] (68.063 ms) : 0, 68063
Debugger [candidate] (68.81 ms) : 0, 68810
Remote Config [baseline] (636.941 µs) : 0, 637
Remote Config [candidate] (644.429 µs) : 0, 644
Telemetry [baseline] (8.931 ms) : 0, 8931
Telemetry [candidate] (8.856 ms) : 0, 8856
Flare Poller [baseline] (3.775 ms) : 0, 3775
Flare Poller [candidate] (3.798 ms) : 0, 3798
ProfilingAgent [baseline] (97.275 ms) : 0, 97275
ProfilingAgent [candidate] (97.455 ms) : 0, 97455
Profiling [baseline] (97.874 ms) : 0, 97874
Profiling [candidate] (98.034 ms) : 0, 98034
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 2 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.58.0-SNAPSHOT~243cc8f840, baseline=1.58.0-SNAPSHOT~6ccbc0607e
dateFormat X
axisFormat %s
section baseline
no_agent (18.188 ms) : 17997, 18378
. : milestone, 18188,
appsec (18.559 ms) : 18371, 18746
. : milestone, 18559,
code_origins (17.644 ms) : 17469, 17818
. : milestone, 17644,
iast (17.689 ms) : 17511, 17866
. : milestone, 17689,
profiling (18.714 ms) : 18528, 18900
. : milestone, 18714,
tracing (17.871 ms) : 17692, 18050
. : milestone, 17871,
section candidate
no_agent (18.246 ms) : 18060, 18432
. : milestone, 18246,
appsec (19.578 ms) : 19374, 19783
. : milestone, 19578,
code_origins (17.858 ms) : 17682, 18035
. : milestone, 17858,
iast (17.617 ms) : 17440, 17794
. : milestone, 17617,
profiling (18.605 ms) : 18423, 18787
. : milestone, 18605,
tracing (17.476 ms) : 17303, 17650
. : milestone, 17476,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.58.0-SNAPSHOT~243cc8f840, baseline=1.58.0-SNAPSHOT~6ccbc0607e
dateFormat X
axisFormat %s
section baseline
no_agent (1.189 ms) : 1178, 1201
. : milestone, 1189,
iast (3.186 ms) : 3140, 3231
. : milestone, 3186,
iast_FULL (5.742 ms) : 5685, 5799
. : milestone, 5742,
iast_GLOBAL (3.629 ms) : 3569, 3688
. : milestone, 3629,
profiling (2.049 ms) : 2031, 2067
. : milestone, 2049,
tracing (1.82 ms) : 1805, 1836
. : milestone, 1820,
section candidate
no_agent (1.199 ms) : 1187, 1211
. : milestone, 1199,
iast (3.127 ms) : 3089, 3166
. : milestone, 3127,
iast_FULL (5.76 ms) : 5702, 5817
. : milestone, 5760,
iast_GLOBAL (3.739 ms) : 3679, 3798
. : milestone, 3739,
profiling (2.189 ms) : 2170, 2209
. : milestone, 2189,
tracing (1.784 ms) : 1768, 1800
. : milestone, 1784,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.58.0-SNAPSHOT~243cc8f840, baseline=1.58.0-SNAPSHOT~6ccbc0607e
dateFormat X
axisFormat %s
section baseline
no_agent (14.989 s) : 14989000, 14989000
. : milestone, 14989000,
appsec (14.914 s) : 14914000, 14914000
. : milestone, 14914000,
iast (17.981 s) : 17981000, 17981000
. : milestone, 17981000,
iast_GLOBAL (17.736 s) : 17736000, 17736000
. : milestone, 17736000,
profiling (15.103 s) : 15103000, 15103000
. : milestone, 15103000,
tracing (14.71 s) : 14710000, 14710000
. : milestone, 14710000,
section candidate
no_agent (15.011 s) : 15011000, 15011000
. : milestone, 15011000,
appsec (14.671 s) : 14671000, 14671000
. : milestone, 14671000,
iast (18.428 s) : 18428000, 18428000
. : milestone, 18428000,
iast_GLOBAL (17.918 s) : 17918000, 17918000
. : milestone, 17918000,
profiling (14.847 s) : 14847000, 14847000
. : milestone, 14847000,
tracing (14.768 s) : 14768000, 14768000
. : milestone, 14768000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.58.0-SNAPSHOT~243cc8f840, baseline=1.58.0-SNAPSHOT~6ccbc0607e
dateFormat X
axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
. : milestone, 1473,
appsec (3.726 ms) : 3508, 3943
. : milestone, 3726,
iast (2.224 ms) : 2159, 2289
. : milestone, 2224,
iast_GLOBAL (2.266 ms) : 2201, 2331
. : milestone, 2266,
profiling (2.081 ms) : 2028, 2134
. : milestone, 2081,
tracing (2.052 ms) : 2001, 2103
. : milestone, 2052,
section candidate
no_agent (1.474 ms) : 1462, 1485
. : milestone, 1474,
appsec (3.744 ms) : 3524, 3964
. : milestone, 3744,
iast (2.217 ms) : 2152, 2282
. : milestone, 2217,
iast_GLOBAL (2.272 ms) : 2207, 2337
. : milestone, 2272,
profiling (2.085 ms) : 2031, 2139
. : milestone, 2085,
tracing (2.038 ms) : 1987, 2090
. : milestone, 2038,
|
5388f6d to
4835e7b
Compare
4835e7b to
bd9e60c
Compare
bd9e60c to
a83b867
Compare
f458fa4 to
aec23b1
Compare
6357293 to
745c9e4
Compare
745c9e4 to
248eb0b
Compare
0aaa955 to
5586082
Compare
# Conflicts: # dd-java-agent/instrumentation/build.gradle # Conflicts: # dd-java-agent/instrumentation/build.gradle # Conflicts: # dd-java-agent/instrumentation/build.gradle
5586082 to
243cc8f
Compare
sarahchen6
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Cool!
What Does This Do
Removes instrumentation module's
afterEvaluate.This looks like it is reducing sync time to ~1min on my M1

Motivation
Using
afterEvaluateis a bad practice and has tighter restriction in Gradle 9+.https://docs.gradle.org/9.1.0/userguide/task_configuration_avoidance.html#8_some_apis_may_be_disallowed_if_you_try_to_access_them_from_the_new_apis_configuration_blocks
It introduces subtle ordering issues which can be very challenging to debug.
From my notes:
Additional Notes
Blocked by
testJvmConstraintsGradle extension to replace extra properties #9892:dd-java-agent:testing#10218Blocks
Contributor Checklist
type:and (comp:orinst:) labels in addition to any useful labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]