Skip to content

Add AGENTS.md and basic skills#2156

Merged
b-deam merged 4 commits into
elastic:masterfrom
b-deam:add-agent-skills
Jul 8, 2026
Merged

Add AGENTS.md and basic skills#2156
b-deam merged 4 commits into
elastic:masterfrom
b-deam:add-agent-skills

Conversation

@b-deam

@b-deam b-deam commented Jul 3, 2026

Copy link
Copy Markdown
Member

Adds Rally agent skills (AGENTS.md + running-benchmarks and accessing-benchmark-results skills) so LLMs/agents can reliably launch races and query benchmark results without having to guess CLI flags or the metrics-store schema.

@b-deam b-deam self-assigned this Jul 3, 2026
Copilot AI review requested due to automatic review settings July 3, 2026 04:05
@b-deam b-deam requested a review from a team as a code owner July 3, 2026 04:05
@b-deam b-deam added enhancement Improves the status quo :Usability Makes Rally easier to use labels Jul 3, 2026
@b-deam b-deam requested review from pquentin and stevereads-elastic and removed request for a team July 3, 2026 04:05
@b-deam b-deam changed the title Add 'running-benchmarks' and 'accessing-benchmark-results' skills Add AGENTS.md and basic skills Jul 3, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds agent-facing documentation (“skills”) to standardize how automated tools run Rally races and retrieve results from an Elasticsearch-backed metrics store, reducing guesswork around CLI flags and schema.

Changes:

  • Added running-benchmarks skill describing pipelines, safe race execution, and interpreting the summary report.
  • Added accessing-benchmark-results skill describing how to list/compare races and query metrics-store data streams/indices.
  • Introduced AGENTS.md with Rally vocabulary, guardrails, and pointers to the new skills and docs.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 3 comments.

File Description
skills/running-benchmarks/SKILL.md New skill for launching races and interpreting the summary report.
skills/accessing-benchmark-results/SKILL.md New skill for retrieving/querying results from an Elasticsearch metrics store.
AGENTS.md New entrypoint doc for agents with Rally terminology, rules, and links to skills/docs.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread skills/accessing-benchmark-results/SKILL.md
Comment thread skills/accessing-benchmark-results/SKILL.md
Comment thread skills/accessing-benchmark-results/SKILL.md Outdated

@pquentin pquentin left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! LGTM.

Comment thread skills/accessing-benchmark-results/SKILL.md Outdated
Comment thread skills/accessing-benchmark-results/SKILL.md Outdated
Comment thread AGENTS.md
@b-deam b-deam requested a review from pquentin July 7, 2026 06:50

@pquentin pquentin left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! LGTM.

Comment thread skills/developing-rally/SKILL.md
@b-deam b-deam merged commit 5866181 into elastic:master Jul 8, 2026
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement Improves the status quo :Usability Makes Rally easier to use

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants