feat(HYBIM-730): rename Log Streams → Agent Streams, Metrics → Evaluators

[adityamehra]

Summary

Implements the SDK-side domain entity renames from HYBIM-730:

• AgentStream replaces LogStream as the canonical agent-stream class
• Evaluator (and LlmEvaluator, CodeEvaluator, LocalEvaluator, SplunkAOEvaluator) replaces Metric and its subclasses
• Full backward compatibility — old names emit DeprecationWarning and remain functional

The underlying API endpoints (/log_streams, /scorers) are unchanged; the server-side rename is tracked separately.

New API at a glance

# Agent Streams
from splunk_ao import AgentStream
stream = AgentStream(name="prod-traces", project_name="my-project").create()
stream = AgentStream.get(name="prod-traces", project_name="my-project")
streams = AgentStream.list(project_name="my-project")

# Evaluators
from splunk_ao import Evaluator, LlmEvaluator, LocalEvaluator
ev = Evaluator.get(name="factuality-checker")
llm_ev = LlmEvaluator(name="quality", prompt="Rate 1-10: {input}", model="gpt-4o-mini").create()

# Project methods
project = Project.get(name="My AI Project")
stream = project.create_agent_stream(name="Production Traces")
streams = project.list_agent_streams()
for s in project.agent_streams:
    print(s.name)

Backward compatibility

Old names remain functional via PEP 562 __getattr__ in __init__.py:

# Still works — emits DeprecationWarning
from splunk_ao import LogStream, Metric, LlmMetric, CodeMetric, LocalMetric
project.create_log_stream("foo")   # warns → create_agent_stream
project.list_log_streams()          # warns → list_agent_streams
project.logstreams                  # warns → agent_streams

Files changed

File	Change
src/splunk_ao/agent_stream.py	New — AgentStream subclass of LogStream
src/splunk_ao/agent_streams.py	New — AgentStreams service + get_agent_stream, list_agent_streams, create_agent_stream, enable_evaluators
src/splunk_ao/evaluator.py	New — Evaluator, LlmEvaluator, CodeEvaluator, LocalEvaluator, SplunkAOEvaluator
src/splunk_ao/evaluators.py	New — Evaluators service + create_custom_llm_evaluator, get_evaluators, delete_evaluator
src/splunk_ao/__future__/agent_stream.py	New — deprecation shim
src/splunk_ao/__future__/evaluator.py	New — deprecation shim
src/splunk_ao/__init__.py	Modified — export new names; PEP 562 __getattr__ for old names
src/splunk_ao/project.py	Modified — add create_agent_stream, list_agent_streams, agent_streams; deprecate old counterparts
docs/HYBIM-730-domain-entity-rename.md	New — full migration guide

Test plan

• Import smoke-test: all new modules import without errors
• Deprecation warnings: splunk_ao.LogStream and splunk_ao.Metric emit DeprecationWarning
• MRO check: AgentStream → LogStream → StateManagementMixin; Evaluator → Metric → StateManagementMixin
• Integration tests: create/get/list AgentStream against a live environment
• Verify Project.create_agent_stream round-trips correctly

Related

• HYBIM-730 — this ticket
• HYBIM-832 — env-var rename (already merged)
• PR refactor: rename Galileo OTel symbols to Splunk AO (GalileoSpan, galileo-tracer, galileo-otel) #90 — OTel layer Galileo → Splunk AO rename

Made with Cursor