Skip to content

Compare protocol-test list headers semantically; add runner skip list - #3920

Open
pulimsr wants to merge 1 commit into
mainfrom
protocol-tests-skip-known-failures
Open

Compare protocol-test list headers semantically; add runner skip list#3920
pulimsr wants to merge 1 commit into
mainfrom
protocol-tests-skip-known-failures

Conversation

@pulimsr

@pulimsr pulimsr commented Sep 4, 2026

Copy link
Copy Markdown
Collaborator

Two test-only improvements to the generated protocol tests:

  1. Semantic comparison for list-valued HTTP headers (AwsProtocolTestHelpers.h): list header values are now compared with optional whitespace around commas normalized per RFC 7230, so a, b, c and a,b,c are treated as equivalent. Element order, content, and quoting remain significant, so meaningful differences are still caught. Follows the same approach used for XML, query, and form-urlencoded bodies in Protocol tests updates #3900.
  2. Known-failures skip list in the test runner (run_protocol_tests.py): adds an explicit, annotated list of cases the runner skips, so unrelated known-open items (and any test that aborts its binary) don't mask results for the rest of the suite. Entries are annotated so the list can be revisited and trimmed over time.

Check all that applies:

  • Did a review by yourself.
  • Added proper tests to cover this PR. (If tests are not applicable, explain.)
  • Checked if this PR is a breaking (APIs have been changed) change.
  • Checked if this PR will not introduce cross-platform inconsistent behavior.
  • Checked if this PR would require a ReadMe/Wiki update.

Check which platforms you have built SDK on to verify the correctness of this PR.

  • Linux
  • Windows
  • Android
  • MacOS
  • IOS
  • Other Platforms

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant