All pull requests

Pull requests

• feat(optimization): add the run record and resume state

  area-coreenhancement
  #527·nhungbi opened Nov 10, 2026Contributor·1 of 9 tasks·

  ·
  3

• feat(optimization): add BayesBenchModel, the design, and effects to the score model

  area-evaluatorsenhancement
  #526·nhungbi opened Nov 10, 2026Contributor·8 of 9 tasks·

  ·
  13

• feat(skills): generalize session-converter to work with non-coding-agent sessions

  area-tracingenhancement
  #525·liramon2 opened Nov 9, 2026Contributor·8 tasks done·

  ·
  11

• ci: update opentelemetry-instrumentation-langchain requirement from <0.63.0,>=0.40.0 to >=0.40.0,<0.64.0

  area-communitychoredependenciespython
  #524·dependabot[bot] opened Nov 9, 2026Bot·

  ·

• ci: bump amannn/action-semantic-pull-request from 6.1.1 to 6.1.2

  area-communitychoredependenciesgithub_actions
  #523·dependabot[bot] opened Nov 9, 2026Bot·

  ·

• fix(mappers): preserve embedded CloudWatch span events

  area-tracingbug
  #522·ikenyal opened Nov 6, 2026·8 of 9 tasks·

  ·

• chore(ci): updated ci check for calibration branch

  area-communitychore
  #516·poshinchen opened Nov 5, 2026Contributor·3 of 9 tasks·

  ·

• feat: apply calibration profiles to historical reports

  area-evaluatorsenhancement
  #514·leonhuang29 opened Nov 5, 2026·

  ·
  1

• feat: add versioned calibration profiles

  area-coreenhancement
  #513·leonhuang29 opened Nov 5, 2026·

  ·
  5

• feat: add calibration bootstrap diagnostics

  area-detectorsenhancement
  #512·leonhuang29 opened Nov 5, 2026·

  ·
  9

• feat: collect repeated calibration evaluations

  area-evaluatorsenhancement
  #511·leonhuang29 opened Nov 5, 2026·

  ·
  16

• feat: fit calibration models from evaluation reports

  area-evaluatorsenhancement
  #510·leonhuang29 opened Nov 5, 2026·

  ·
  12

• feat: add pluggable calibration algorithm contracts

  area-evaluatorsenhancement
  #509·leonhuang29 opened Nov 5, 2026·

  ·
  9

• fix(evaluators): pass trajectory_description to the TrajectoryEvaluator judge prompt

  area-evaluatorsbug
  #508·jangwonikk opened Nov 5, 2026·9 tasks done·

  ·
  1

• feat(skills): add validation and review steps to session-converter

  area-generatorsenhancement
  #505·liramon2 opened Nov 4, 2026Contributor·8 tasks done·

  ·
  19

• feat(evaluators): add TypedRubricEvaluator for decision-model rubrics

  area-evaluatorsenhancement
  #493·mehtarac opened Oct 29, 2026Member·9 tasks·

  ·
  19

• fix: prevent evaluator judges from invoking tools

  area-evaluatorsbug
  #490·mikemikimike opened Oct 28, 2026·

  ·
  1

  1

• fix(types): discriminate user/assistant messages on role

  area-devxarea-tracingbug
  #488·ruserxd opened Oct 28, 2026·9 of 14 tasks·

  ·
  1

• fix(redteam): handle StructuredOutputException in strategy judges and attackers

  area-redteambug
  #479·kevinlupera opened Oct 26, 2026Contributor·9 tasks done·

  ·
  1

  1

• fix(mappers): detect OpenInference spans by span.kind attribute

  area-tracingbug
  #478·nsknojj opened Oct 25, 2026·

  ·
  1

• fix(providers)!: support Langfuse v4 in LangfuseProvider

  area-tracingbug
  #469·fbalicchia opened Oct 21, 2026·9 tasks done·

  ·
  1

• fix(mappers): parse string-encoded timeUnixNano in CloudWatchSessionMapper

  area-tracingbug
  #461·kevinlupera opened Oct 20, 2026Contributor·9 tasks done·

  ·
  1

  1

• feat: add versioned calibration profiles

  area-evaluatorsdesignenhancement
  #437·leonhuang29 opened Oct 16, 2026·

  ·
  2

  1

• feat: add experimental evaluator calibration

  area-evaluatorsdesignenhancement
  #429·leonhuang29 opened Oct 13, 2026·11 of 13 tasks·

  ·
  1

  40

• feat(providers): add HoneyHiveProvider

  area-tracingenhancement
  #419·sanjeed5 opened Oct 9, 2026·9 tasks done·

  ·
  1