Skip to content

Trace injection in python to mirror the JS implementation#175

Merged
CLowbrow merged 2 commits intomainfrom
trace-injection-py
Feb 25, 2026
Merged

Trace injection in python to mirror the JS implementation#175
CLowbrow merged 2 commits intomainfrom
trace-injection-py

Conversation

@CLowbrow
Copy link
Contributor

@CLowbrow CLowbrow commented Feb 20, 2026

This is a direct port of:

#168

@github-actions
Copy link

github-actions bot commented Feb 20, 2026

Braintrust eval report

Autoevals (trace-injection-py-1771625361)

Score Average Improvements Regressions
NumericDiff 73.7% (+0pp) 3 🟢 3 🔴
Time_to_first_token 1.43tok (+0.08tok) 21 🟢 98 🔴
Llm_calls 1.55 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 279.25tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Completion_tokens 18.45tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 297.7tok (+0tok) - -
Estimated_cost 0$ (+0$) - -
Duration 3.22s (+0.36s) 51 🟢 168 🔴
Llm_duration 2.89s (+0.18s) 16 🟢 103 🔴

@github-actions
Copy link

Braintrust eval report

Autoevals (trace-injection-py-1771622788)

Score Average Improvements Regressions
NumericDiff 73.7% (0pp) 1 🟢 2 🔴
Time_to_first_token 1.35tok (-0.01tok) 85 🟢 34 🔴
Llm_calls 1.55 (+0) - -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 279.25tok (+0tok) - -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Completion_tokens 18.45tok (+0tok) - -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 297.7tok (+0tok) - -
Estimated_cost 0$ (+0$) - -
Duration 2.85s (-0.58s) 166 🟢 53 🔴
Llm_duration 2.71s (-0.1s) 98 🟢 21 🔴

@CLowbrow CLowbrow changed the title [WIP] Trace injection in python to mirror the JS implementation Trace injection in python to mirror the JS implementation Feb 20, 2026
@CLowbrow CLowbrow marked this pull request as ready for review February 20, 2026 22:40
@CLowbrow CLowbrow merged commit 0d428fb into main Feb 25, 2026
7 checks passed
@github-actions
Copy link

github-actions bot commented Feb 25, 2026

Braintrust eval report

Autoevals (main-1772056171)

Score Average Improvements Regressions
NumericDiff 74.2% (+37pp) 95 🟢 22 🔴
Time_to_first_token 1.38tok (-5.89tok) 119 🟢 -
Llm_calls 1.55 (+0.45) 100 🟢 -
Tool_calls 0 (+0) - -
Errors 0 (+0) - -
Llm_errors 0 (+0) - -
Tool_errors 0 (+0) - -
Prompt_tokens 279.25tok (-38.45tok) 119 🟢 -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Completion_tokens 18.45tok (-233.46tok) 119 🟢 -
Completion_reasoning_tokens 0tok (+0tok) - -
Total_tokens 297.7tok (-271.92tok) 119 🟢 -
Estimated_cost 0$ (0$) 119 🟢 -
Duration 3.64s (-0.91s) 119 🟢 100 🔴
Llm_duration 2.71s (-6.03s) 119 🟢 -

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants