Skip to content

test(azure-client, tinylicious-client): Ensure test results are correctly published for CI - #27863

Merged
Joshua Smithrud (Josmithr) merged 7 commits into
microsoft:mainfrom
Josmithr:ci/fix-test-results-publishing
Aug 7, 2026
Merged

test(azure-client, tinylicious-client): Ensure test results are correctly published for CI#27863
Joshua Smithrud (Josmithr) merged 7 commits into
microsoft:mainfrom
Josmithr:ci/fix-test-results-publishing

Conversation

@Josmithr

@Josmithr Joshua Smithrud (Josmithr) commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Test results for the ci:test:realsvc:tinylicious test script were not being correctly generated and published in CI for azure-client and tinylicious-client.

There were 2 issues preventing these results from correctly showing up in the test viewer in the Azure DevOps pipeline views:

  1. The packages were not correctly configured for our use of mocha-multi-reporters, and as a result their test summary reports were being dropped. They have now been updated to extend mocha-test-setup/mocharc-common.
  2. The npm run test:copyresults step of the build pipeline was not configured to run when the test step(s) failed, which caused the failed test reports to not be in the expected place when the subsequent publish step ran. The conditions for this step have been updated to run so long as the test runs were started.

AB#74374

@github-actions github-actions Bot added area: tools area: build Build related issues area: repo Repo related work area: website base: main PRs targeted against main branch labels Aug 5, 2026
@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Hi! Thank you for opening this PR. Want me to review it?

Based on the diff (35 lines, 6 files), I've queued these reviewers:

  • Correctness — logic errors, race conditions, lifecycle issues
  • Security — vulnerabilities, secret exposure, injection
  • API Compatibility — breaking changes, release tags, type design
  • Performance — algorithmic regressions, memory leaks
  • Testing — coverage gaps, hollow tests

How this works

  • Adjust the reviewer set by ticking/unticking boxes above. Reviewer toggles alone don't trigger anything.

  • Tick Start review below to dispatch the review fleet.

  • After review finishes, tick Start review again to request another run — it auto-resets after each dispatch.

  • This comment updates as new commits land; your reviewer selections are preserved.

  • Start review

@github-actions github-actions Bot added the dependencies Pull requests that update a dependency file label Aug 5, 2026
@Josmithr Joshua Smithrud (Josmithr) changed the title fix(ci): Always aggregate and publish test results when tests have run build(azure-client, tinylicious-client): Ensure test results are correctly published Aug 5, 2026
@Josmithr

Copy link
Copy Markdown
Contributor Author

[Microsoft only] Here is a sample run with an intentionally failing test that demonstrates tests correctly appearing in the test browser: https://dev.azure.com/fluidframework/public/_build/results?buildId=414628&view=ms.vss-test-web.build-test-results-tab

@github-actions github-actions Bot removed the area: build Build related issues label Aug 6, 2026
@Josmithr
Joshua Smithrud (Josmithr) force-pushed the ci/fix-test-results-publishing branch from 68afc0e to 0e63e8c Compare August 6, 2026 17:14
@Josmithr Joshua Smithrud (Josmithr) changed the title build(azure-client, tinylicious-client): Ensure test results are correctly published test(azure-client, tinylicious-client): Ensure test results are correctly published for CI Aug 6, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

@Josmithr
Joshua Smithrud (Josmithr) enabled auto-merge (squash) August 6, 2026 18:18
@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Bundle size comparison

Base commit: ea3048207acad7a859e3d2a7efc295d95d239940
Head commit: 49b6bb8925149e53c9f43fcfe558fd9a62e4dbe3

Pending — Build - client packages is running. Results will appear here when the build completes.

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Bundle size comparison

Base commit: ea3048207acad7a859e3d2a7efc295d95d239940
Head commit: 49b6bb8925149e53c9f43fcfe558fd9a62e4dbe3

Notable changes

No bundles changed by ≥ 500 bytes parsed.

Per-bundle deltas

@fluid-example/bundle-size-tests

  • fluidFrameworkAllAlpha.js: parsed 780974 → 781016 (+42), gzip 214234 → 214271 (+37)
  • azureClient.js: parsed 620351 → 620407 (+56), gzip 165482 → 165525 (+43)
  • odspClient.js: parsed 592639 → 592695 (+56), gzip 158607 → 158651 (+44)
  • aqueduct.js: parsed 526970 → 527005 (+35), gzip 141035 → 141062 (+27)
  • fluidFramework.js: parsed 399466 → 399487 (+21), gzip 113434 → 113450 (+16)
  • sharedTree.js: parsed 388870 → 388884 (+14), gzip 110881 → 110889 (+8)
  • containerRuntime.js: parsed 305091 → 305105 (+14), gzip 83553 → 83558 (+5)
  • sharedString.js: parsed 176457 → 176464 (+7), gzip 49807 → 49814 (+7)
  • experimentalSharedTree.js: parsed 160677 → 160677 (0), gzip 46276 → 46276 (0)
  • matrix.js: parsed 160302 → 160309 (+7), gzip 45800 → 45807 (+7)
  • loader.js: parsed 145459 → 145473 (+14), gzip 39221 → 39235 (+14)
  • odspDriver.js: parsed 103906 → 103927 (+21), gzip 32404 → 32411 (+7)
  • directory.js: parsed 67110 → 67117 (+7), gzip 18859 → 18866 (+7)
  • 578.js: parsed 58686 → 58686 (0), gzip 17657 → 17657 (0)
  • map.js: parsed 47205 → 47212 (+7), gzip 14455 → 14462 (+7)
  • odspPrefetchSnapshot.js: parsed 45635 → 45649 (+14), gzip 15242 → 15249 (+7)
  • 252.js: parsed 44371 → 44371 (0), gzip 13732 → 13732 (0)
  • summarizerDelayLoadedModule.js: parsed 30717 → 30717 (0), gzip 7716 → 7716 (0)
  • socketModule.js: parsed 26469 → 26476 (+7), gzip 7896 → 7903 (+7)
  • createNewModule.js: parsed 12454 → 12454 (0), gzip 4797 → 4797 (0)
  • summaryModule.js: parsed 3789 → 3789 (0), gzip 1857 → 1857 (0)
  • connectionState.js: parsed 909 → 909 (0), gzip 500 → 500 (0)
  • sharedTreeAttributes.js: parsed 847 → 854 (+7), gzip 499 → 507 (+8)
  • debugAssert.js: parsed 429 → 429 (0), gzip 299 → 299 (0)
  • FluidFramework-HashFallback.js: parsed 419 → 419 (0), gzip 313 → 313 (0)

@Josmithr
Joshua Smithrud (Josmithr) merged commit afa15c8 into microsoft:main Aug 7, 2026
35 checks passed
@Josmithr
Joshua Smithrud (Josmithr) deleted the ci/fix-test-results-publishing branch August 7, 2026 18:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area: build Build related issues area: repo Repo related work area: tools area: website base: main PRs targeted against main branch dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants