Unit test got freeze then re-run

[maithanhtung]

Why are you starting this discussion?

Question

What GitHub Actions topic or product is this about?

Misc

Discussion Details

Please check this short log. It is iOS/FastLane/GithubAction
The Test Suite 'Project.xctest' already started before ( at 12:23:29 ). Test run normally a while before these happen.

[12:23:50]: ▸ Test Suite 'ABCTest' started at 2025-07-28 12:23:49.944.
[12:23:50]: ▸     ✔ testLoad (0.007 seconds)
[12:24:35]: ▸ Test Suite 'Selected tests' started at 2025-07-28 12:24:35.338.
[12:24:36]: ▸ Test Suite 'Project.xctest' started at 2025-07-28 12:24:35.346.
[12:24:36]: ▸ Test Suite 'ABCTest' started at 2025-07-28 12:24:35.346.

Don't know where is Selected tests comes from, not in project itself.
The Project test seem got resume from something, then the ABC test continues. But it does not execute 1 test. Which make the action fail at the end

▸ Test Suite 'Project.xctest' passed at 2025-07-28 09:49:43.715.
[09:49:43]: ▸ Executed 68 tests, with 0 failures (0 unexpected) in 0.241 (0.355) seconds
[09:49:43]: ▸ Executed 68 tests, with 0 failures (0 unexpected) in 0.241 (0.356) seconds
[09:50:08]: ▸ 2025-07-28 09:50:08.386 xcodebuild[6516:24737] [MT] IDETestOperationsObserverDebug: 163.104 elapsed -- Testing started completed.
[09:50:08]: ▸ 2025-07-28 09:50:08.386 xcodebuild[6516:24737] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start
[09:50:08]: ▸ 2025-07-28 09:50:08.386 xcodebuild[6516:24737] [MT] IDETestOperationsObserverDebug: 163.105 sec, +163.105 sec -- end
[09:50:12]: ▸ Failing tests:
[09:50:12]: ▸ 	ABCTest.testThatNotGetExcecute()
[09:50:12]: ▸ ** TEST FAILED **

And this happen randomly, not in any specific test or test file. It just seem that the host out of memory and got re-start or something?
Locally run fastlane works pass normally.
Also I have not made any recent changes to GitHub action or fast lane at all. It just start to fail couple days ago.

Also if I change project structure, sometimes it pass.
Also tried to ignore "Selected tests" in fast lane file, still fail and it still run the "Selected tests" - make sense since there is no "Selected tests" in my project.
Please help. Got stuck with this couple of days already.

[maithanhtung]

Thanks for replying.

Currently I am using:

• runs-on: macos-15
• clean: true
• parallelizable: NO
• Even tried to use runs-on: macos-15-large

Nothing works so far.
The test suited did not getting run multiple times before ( in all pass tests ). But then this happens without any change from projects.

[maithanhtung]

Work flow file

name: running-unitTests
permissions:
  contents: read
on:
  push:
    branches: 
      - main
  pull_request:
    branches: 
      - main
      - develop
      - 'release/**'

jobs:    
  running-unitTests:
    runs-on: macos-15
    steps:
      - uses: actions/checkout@v4

      - uses: ./.github/actions/setup-env-composite
        with: 
          git-crypt-key: ${{ secrets.GIT_CRYPT_KEY }}

      - name: Test Build App
        env:
          FASTLANE_XCODEBUILD_SETTINGS_TIMEOUT: 60
          FASTLANE_XCODEBUILD_SETTINGS_RETRIES: 5
        run: bundle exec fastlane test --env unitTests

Fast file

default_platform(:ios)

platform :ios do

    desc "Runs all the tests"
    lane :test do |params|
    run_tests(
        project: ENV['XCODE_PROJ'],
        scheme: ENV['SCHEME'],
        device: 'iPhone 16 Pro Max',
        slack_only_on_failure: true,
        include_simulator_logs: false
    )
    end

[maithanhtung]

Oh turn out the simulator crash in Github macOS simulator. Crash right on start. Don't know why yet but at least that seem the reason why the Test suite got re-run and missing out randomly 1 test case.

[Harudev0914]

Fully Reset the Simulator Before Tests Start
To prevent frequent simulator crashes, completely shut down and erase all simulators before running your tests:
xcrun simctl shutdown all xcrun simctl erase all

Add Automatic Retry to Fastlane Tests
Simulators can be unstable and cause test failures. Add the retry_count option to run_tests to automatically retry failed tests up to two times:

run_tests( ..., retry_count: 2 )

Check Your GitHub Actions Environment
Make sure the simulator device you’re using is supported in the GitHub Actions environment:
xcrun simctl list devices

Additional Tips
Clear Xcode’s derived data cache before running tests
Use Fastlane’s only_testing option to specify exactly which tests to run

[github-actions[bot]]

🕒 Discussion Activity Reminder 🕒

This Discussion has been labeled as dormant by an automated system for having no activity in the last 60 days. Please consider one the following actions:

1️⃣ Close as Out of Date: If the topic is no longer relevant, close the Discussion as out of date at the bottom of the page.

2️⃣ Provide More Information: Share additional details or context — or let the community know if you've found a solution on your own.

3️⃣ Mark a Reply as Answer: If your question has been answered by a reply, mark the most helpful reply as the solution.

Note: This dormant notification will only apply to Discussions with the Question label. To learn more, see our recent announcement.

Thank you for helping bring this Discussion to a resolution! 💬