Remove deprecated multi-agent workflow samples and update evaluation …

[Howie Leung (howieleung)]

…scripts with new role assignment parameters. Update YAML configuration for additional directories and commit reference.

Description

Please add an informative description that covers that changes made by the pull request and link all relevant issues.

If an SDK is being regenerated based on a new API spec, a link to the pull request containing these API spec changes should be included above.

All SDK Contribution checklist:

• The pull request does not introduce [breaking changes]
• CHANGELOG is updated for new features, bug fixes or other significant changes.
• I have read the contribution guidelines.

General Guidelines and Best Practices

• Title of the pull request is clear and informative.
• There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

• Pull request includes test coverage for the included changes.

[azure-pipelines]

Azure Pipelines:
Successfully started running 1 pipeline(s).
9 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

[Ryan Hurey (rhurey)]

class RealtimeConversationItem(_Model): # pylint: disable=docstring-keyword-should-match-keyword-only

The Realtime classes can come from the OpenAI SDK, right?

---

Refers to: sdk/ai/azure-ai-projects/azure/ai/projects/models/_models.py:14274 in ab6b8d0. [](commit_id = ab6b8d0, deletion_comment = False)

[Howie Leung (howieleung)]

RealtimeConversationItem

Yes
From
node_modules@azure-tools\openai-typespec\src\realtime\models.tsp

[github-actions]

[Pilot] PR Pipeline Failure Analysis

What failed

Build: azure-sdk/public #6768621 — failed

Two distinct failure categories were found:

1. Test collection failures (all platforms)

Tests test_foundry_features_header_on_beta_operations and test_foundry_features_header_on_beta_operations_async failed on all 6 platforms (macos311, ubuntu2404_310, ubuntu2404_310_coverage, Ubuntu2404_313, Ubuntu2404_314, windows2022_312) for both whl and sdist artifacts.

Root cause: A new .beta sub-client agent_endpoint_conversations was introduced by this PR, but the EXPECTED_FOUNDRY_FEATURES mapping in tests/foundry_features_header/base_test.py was not updated to include an entry for it.

Relevant pipeline output

AssertionError: New .beta sub-client 'agent_endpoint_conversations' discovered but not found in
EXPECTED_FOUNDRY_FEATURES. Please add an entry for '.beta.agent_endpoint_conversations' to the
EXPECTED_FOUNDRY_FEATURES mapping in base_test.py.
assert 'agent_endpoint_conversations' in {'agents': 'WorkflowAgents=V1Preview,...', ...}

File: tests/foundry_features_header/test_foundry_features_header_on_beta_operations.py:104
File: tests/foundry_features_header/test_foundry_features_header_on_beta_operations_async.py:109

Fix: In sdk/ai/azure-ai-projects/tests/foundry_features_header/base_test.py, add an entry for 'agent_endpoint_conversations' to EXPECTED_FOUNDRY_FEATURES with the appropriate Foundry feature flag value.

---

2. CSpell spelling check failure

The CSpell check flagged 85 issues across 6 files. The unknown words are technical acronyms and terms introduced by the new API surface in this PR.

Relevant pipeline output

##[error]sdk/ai/azure-ai-projects/api.md - Unknown word (Pcma), (pcma), (PCMA), (Pcmu), (pcmu), (PCMU)
##[error]sdk/ai/azure-ai-projects/api.md - Unknown word (MCPHTTP)
##[error]sdk/ai/azure-ai-projects/api.md - Unknown word (DTMF), (dtmf)
##[error]sdk/ai/azure-ai-projects/azure/ai/projects/aio/operations/_operations.py - Unknown word (BYOS), (retriable)
##[error]sdk/ai/azure-ai-projects/azure/ai/projects/models/_enums.py - Unknown word (PCMU), (PCMA), (DTMF)
##[error]sdk/ai/azure-ai-projects/azure/ai/projects/models/_models.py - Unknown word (Pcma), (Pcmu), (MCPHTTP), (BYOS)
##[error]sdk/ai/azure-ai-projects/azure/ai/projects/operations/_operations.py - Unknown word (BYOS), (retriable)
##[error]Spelling errors detected. See: https://aka.ms/azsdk/engsys/spellcheck

Fix: Add the unknown words (BYOS, DTMF, MCPHTTP, PCMA, PCMU, Pcma, Pcmu, dtmf, pcma, pcmu, retriable) to the CSpell allowlist. See https://aka.ms/azsdk/engsys/spellcheck for guidance.

Recommended next steps

• In sdk/ai/azure-ai-projects/tests/foundry_features_header/base_test.py, add 'agent_endpoint_conversations': '<feature_flag_value>' to EXPECTED_FOUNDRY_FEATURES (use the appropriate feature flag matching the new sub-client).
• Add the flagged words to the CSpell allowlist per https://aka.ms/azsdk/engsys/spellcheck.
• See https://aka.ms/ci-fix

Automated fix: Fix found, view and apply fix

Generated by Pipeline Analysis Next Steps · 50.3 AIC · ⌖ 9.45 AIC · ⊞ 6K · ◷