TRCLI-162: Multisuite parser to process multiple suites in a single test plan

[acuanico-tr-galt]

Issue being resolved: #348

Solution description

If the test automation spans multiple TestRail suites, the multisuite parser (--special-parser multisuite) allows you to create a single test plan with one run per suite from a single JUnit XML report. The CLI automatically detects which suite each test case belongs to, groups them accordingly, and creates or updates a test plan with the appropriate structure.

• All test cases must have case IDs (C123 format in test names or test_id properties)
• Must use --case-matcher name or --case-matcher property (not auto)
• All cases must belong to the same project (cross-project cases are skipped with warnings)

Changes

• multisuite_uploader.py to properly fetch cases, project validation with cross project filtering.

Potential impacts

None. Changes are all backwards compatible.

Steps to test

Happy path to test implemented scenario

PR Tasks

• PR reference added to issue
• README updated
• Unit tests added/updated

[lscottnaim]

Hello! This will fix my issue if it gets released. Very exciting! One question, let's say I have multiple suites and over 300 test cases in total. If one of my IDs is incorrect for whatever reason, will this break uploading the results to the valid cases?

[acuanico-tr-galt]

Hi @lscottnaim No, a single invalid case ID will not break the entire upload. The invalid case id will only be skipped and the valid ones will still be uploaded. Moreover, The parser only exits with error if ALL cases are invalid or ALL valid cases belongs to a different project. Thank you for your constant support!

[lscottnaim]

@acuanico-tr-galt I've just had an opportunity to try this, and it seems my fears were correct. If I upload all my cases with some inaccuracies it just fails to upload:

nxt@nxt ~ $ trcli -n -c /home/nxt/git/config.yaml parse_junit --special-parser multisuite --title "Automation - 5.4.0" --case-matcher "name" --plan-id 5463 --result-fields version:5.4.0.8602.0 --allow-ms -f "/home/nxt/git/reports/*.xml"
TestRail CLI v1.14.0
Copyright 2025 Gurock Software GmbH - www.gurock.com
Parser Results Execution Parameters
> Report file: /home/nxt/git/reports/*.xml
> Config file: /home/nxt/git/config.yaml
> TestRail instance: https://example.testrail.io (user: XXX)
> Project: Name
> Run title: Automation Example Title
> Update run: No
> Add to milestone: No
> Auto-assign failures: No
> Auto-create entities: False
Parsing JUnit report.
Processed 6 test cases in section pytest.
Processed 35 test cases in section pytest.
...
Processed 5 test cases in section pytest.
Multisuite mode: Preparing cross-suite test plan...
Checking project. Done.
ERROR: All test cases must have case IDs when using multisuite parser. Found 1 case(s) without IDs.

EDIT: Looks like I had a case like `test_caseName_C1234_example. That breaks the upload.