Skip to content

feat: add Testiny reporter for UI tests(WPB-26230)#4944

Merged
emmaoke-w merged 6 commits into
developfrom
feat/WPB-26230-wire-testiny-test-reporter
Jun 15, 2026
Merged

feat: add Testiny reporter for UI tests(WPB-26230)#4944
emmaoke-w merged 6 commits into
developfrom
feat/WPB-26230-wire-testiny-test-reporter

Conversation

@emmaoke-w

@emmaoke-w emmaoke-w commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

https://wearezeta.atlassian.net/browse/WPB-26230


PR Submission Checklist for internal contributors

  • The PR Title

    • conforms to the style of semantic commits messages¹ supported in Wire's Github Workflow²
    • contains a reference JIRA issue number like SQPIT-764
    • answers the question: If merged, this PR will: ... ³
  • The PR Description

    • is free of optional paragraphs and you have filled the relevant parts to the best of your ability

What's new in this PR?

  • Adds a TestinySyncRule to BaseUiTest so each UI test can report its final JUnit result after execution.

  • Reads @testcaseid and @category annotations from each test method and sends the mapped result status to Testiny.

  • Passes Testiny config from CI into Android instrumentation using encoded runtime arguments for project name, run name, API key, and source run URL.

  • Fetches the Testiny API key from runtime secrets and masks both the raw and encoded values in GitHub Actions logs.

  • Reuses an existing open Testiny run by name, or creates one when missing, so normal runs and deflake retries update the same run.

  • Keeps Testiny sync failures non-blocking: reporting errors are logged, but they do not change the actual UI test result.

Issues

Briefly describe the issue you have solved or implemented with this pull request. If the PR contains multiple issues, use a bullet list.

Causes (Optional)

Briefly describe the causes behind the issues. This could be helpful to understand the adopted solutions behind some nasty bugs or complex issues.

Solutions

Briefly describe the solutions you have implemented for the issues explained above.

Dependencies (Optional)

If there are some other pull requests related to this one (e.g. new releases of frameworks), specify them here.

Needs releases with:

  • GitHub link to other pull request

Testing

Test Coverage (Optional)

  • I have added automated test to this contribution

How to Test

Briefly describe how this change was tested and if applicable the exact steps taken to verify that it works as expected.

Notes (Optional)

Specify here any other facts that you think are important for this issue.

Attachments (Optional)

Attachments like images, videos, etc. (drag and drop in the text box)

image

PR Post Submission Checklist for internal contributors (Optional)

  • Wire's Github Workflow has automatically linked the PR to a JIRA issue

PR Post Merge Checklist for internal contributors

  • If any soft of configuration variable was introduced by this PR, it has been added to the relevant documents and the CI jobs have been updated.

References
  1. https://sparkbox.com/foundry/semantic_commit_messages
  2. https://github.com/wireapp/.github#usage
  3. E.g. feat(conversation-list): Sort conversations by most emojis in the title #SQPIT-764.

@pull-request-size

Copy link
Copy Markdown

Ups 🫰🟨

This PR is too big. Please try to break it up into smaller PRs.

@emmaoke-w emmaoke-w marked this pull request as ready for review June 10, 2026 07:38
@emmaoke-w emmaoke-w requested a review from a team as a code owner June 10, 2026 07:38
Comment thread scripts/qa_android_ui_tests/execution_setup.sh Outdated
@emmaoke-w emmaoke-w removed the request for review from CinnamonNinja June 10, 2026 09:34
@codecov

codecov Bot commented Jun 11, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 48.92%. Comparing base (dbd47c3) to head (e62bcda).

Additional details and impacted files
@@           Coverage Diff            @@
##           develop    #4944   +/-   ##
========================================
  Coverage    48.92%   48.92%           
========================================
  Files          643      643           
  Lines        23068    23068           
  Branches      3525     3525           
========================================
  Hits         11287    11287           
  Misses       10732    10732           
  Partials      1049     1049           

Continue to review full report in Codecov by Harness.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update dbd47c3...e62bcda. Read the comment docs.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@sonarqubecloud

Copy link
Copy Markdown

@emmaoke-w emmaoke-w enabled auto-merge June 15, 2026 13:34
@emmaoke-w emmaoke-w added this pull request to the merge queue Jun 15, 2026
Merged via the queue into develop with commit cab9265 Jun 15, 2026
20 checks passed
@emmaoke-w emmaoke-w deleted the feat/WPB-26230-wire-testiny-test-reporter branch June 15, 2026 14:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants