Skip to content

Fantom's README says its tests do not run outside of Meta's CI, but Test All runs them in GitHub Actions on pull requests #60028

Closed

Description

@YevheniiKotyrlo

Description

The FAQ entry "Are tests executed on Github CI?" in private/react-native-fantom/__docs__/README.md (L662-L666) says:

Fantom tests are currently tied to Meta's infrastructure and do not run outside of Meta's CI. We are working on migrating Fantom to Github CI. If you submit a PR, the tests will run as part of the PR import process.

.github/workflows/test-all.yml runs on pull_request (L3-L9). It builds the tester in build_fantom_runner whenever check_code_changes finds a code change (L240-L262), and runs the suite in run_fantom_tests through fantom-tests.yml, with up to two retries (L264-L280). The Test All run of #60023 ran both jobs: https://github.com/react/react-native/actions/runs/43864916872.

Expected: the FAQ entry says Fantom tests run in GitHub Actions, in Test All, on pull requests that change code. The rest of the README stays as it is.

Actual: the entry says they do not run outside of Meta's CI.

Steps to reproduce

  1. Download repro.sh from the reproducer below and run bash repro.sh (bash, curl and jq; GITHUB_TOKEN is optional and only lifts the API's 60 requests an hour).
  2. It reads the FAQ entry and .github/workflows/test-all.yml at the head of main, then goes through the latest completed pull_request runs of Test All until one ran build_fantom_runner and run_fantom_tests / test, and prints those jobs' conclusions.
  3. It exits 1 while the FAQ says Fantom tests "do not run outside of Meta's CI" and Test All runs them on pull requests, and 0 once the FAQ no longer says so.

By hand: open the FAQ entry linked above, then the Fantom jobs of any recent pull request's Test All run.

React Native Version

0.88.1 (the same FAQ entry: L608-L612) and main at e37dbfd

Affected Platforms

Other (please specify)

Output of npx @react-native-community/cli info

react/react-native main e37dbfd9561; bash 5.3.15(2)-release; curl 8.23.0; jq-1.8.1; MINGW64_NT-10.0-26300 3.6.10-5a1665c8.x86_64

Stacktrace or Logs

react/react-native main e37dbfd9561; bash 5.3.15(2)-release; curl 8.23.0; jq-1.8.1; MINGW64_NT-10.0-26300 3.6.10-5a1665c8.x86_64

== 1. private/react-native-fantom/__docs__/README.md at e37dbfd9561, the FAQ entry
662: #### Are tests executed on Github CI?
663: 
664: Fantom tests are currently tied to Meta's infrastructure and do not run outside
665: of Meta's CI. We are working on migrating Fantom to Github CI. If you submit a
666: PR, the tests will run as part of the PR import process.
667: 
FAQ says "do not run outside of Meta's CI": yes

== 2. .github/workflows/test-all.yml at e37dbfd9561
3: on:
4:   workflow_dispatch:
5:   pull_request:
6:   push:
7:     branches:
8:       - main
9:       - '*-stable'
240:  build_fantom_runner:
264:  run_fantom_tests:
266:    uses: ./.github/workflows/fantom-tests.yml
269:  run_fantom_tests_retry_1:
272:    uses: ./.github/workflows/fantom-tests.yml
275:  run_fantom_tests_retry_2:
278:    uses: ./.github/workflows/fantom-tests.yml
Test All runs on pull_request: yes; holds run_fantom_tests: yes

== 3. The latest completed pull_request runs of Test All, until one ran the Fantom jobs
run 43867327939: build_fantom_runner absent, run_fantom_tests / test absent; next
run 43866449912: build_fantom_runner absent, run_fantom_tests / test absent; next
https://github.com/react/react-native/actions/runs/43864916872 (event pull_request, head add4e7308e1, 2026-11-16T12:15:27Z)
build_fantom_runner: success
run_fantom_tests / test: success
run_fantom_tests / report: success
run_fantom_tests_retry_1: skipped
run_fantom_tests_retry_2: skipped

DEFECT: private/react-native-fantom/__docs__/README.md says Fantom tests "do not run outside of Meta's CI", while Test All runs on pull_request and its pull_request run https://github.com/react/react-native/actions/runs/43864916872 ran build_fantom_runner (success) and run_fantom_tests / test (success).

MANDATORY Reproducer

https://gist.github.com/YevheniiKotyrlo/b0406911be5a68c4d2b3ef0f272c5e64 — bash repro.sh exits 1 while the FAQ says Fantom tests do not run outside of Meta's CI, and 0 once it does not.

Screenshots and Videos

No response

Activity

  1. react-native-bot commented on Nov 16, 2026

    @react-native-bot
    Collaborator

    Warning

    Could not parse version: We could not find or parse the version number of React Native in your issue report. Please use the template, and report your version including major, minor, and patch numbers - e.g. 0.76.2.

  2. react-native-bot commented on Nov 16, 2026

    @react-native-bot
    Collaborator

    Warning

    Could not parse version: We could not find or parse the version number of React Native in your issue report. Please use the template, and report your version including major, minor, and patch numbers - e.g. 0.76.2.

  3. YevheniiKotyrlo commented on Nov 16, 2026

    @YevheniiKotyrlo
    ContributorAuthor

    The React Native Version field now names 0.88.1, which carries the same FAQ entry, beside main at e37dbfd.

  4. added a commit that references this issue on Nov 16, 2026
    487979a
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions