Skip to content

Run the tests inside XGAP from TestPackage as well - #48

Merged
fingolfin merged 1 commit into
masterfrom
mh/testall-gui
Sep 20, 2026
Merged

fingolfin merged 1 commit into
masterfrom
mh/testall-gui

Conversation

@fingolfin

Copy link
Copy Markdown
Member

Stacked on #44; only the last commit belongs to this PR.

tst/testall.g, and thus TestPackage("xgap"), never touched the XGAP executable, so it could not tell whether that was built or works, which is what #4 asks for. It now also runs the tests in tst-gui/ through the executable: under xvfb-run if that is installed, else on the X server in DISPLAY.

Without the executable or an X server these tests are skipped with a message, not failed, because the GAP code of XGAP is also used without the executable (Gap.app). The price is that a broken build still passes TestPackage silently on a machine without the executable; making that a failure is a one-line change.

Checked locally (macOS, Xvfb via DISPLAY): all fine gives exit 0 with both test runs executed; a deliberately broken GUI test gives exit 1; no executable and no X server each skip with a message and exit 0. The xvfb-run branch could not be tested locally; CI exercises it, as #44 installs xvfb.

In CI the GUI tests now run twice, once from testall.g and once in the separate step that collects coverage.

Fixes #4

Assisted-by: Claude Code (Fable 5.1)

@codecov

codecov Bot commented Sep 20, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 49.79%. Comparing base (91fb23b) to head (da17e3c).

Additional details and impacted files
@@           Coverage Diff           @@
##           master      #48   +/-   ##
=======================================
  Coverage   49.78%   49.79%           
=======================================
  Files          28       28           
  Lines       10302    10302           
  Branches      558      558           
=======================================
+ Hits         5129     5130    +1     
  Misses       5083     5083           
+ Partials       90       89    -1     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@fingolfin
fingolfin added this pull request to stack #49 September 20, 2026 16:41
Base automatically changed from mh/coverage to master September 20, 2026 16:42
tst/testall.g, and thus TestPackage("xgap"), never touched the XGAP
executable, so it could not tell whether that was built or works. Let
it also run the tests in tst-gui through the executable, under
xvfb-run if that is installed and else on the X server in DISPLAY.

Without the executable or an X server these tests are skipped with a
message rather than failed: the GAP code of XGAP is also used without
the executable, by Gap.app.

Fixes #4

Assisted-by: Claude Code (Fable 5.1)
@fingolfin
fingolfin merged commit 97cf4fa into master Sep 20, 2026
6 checks passed
@fingolfin
fingolfin deleted the mh/testall-gui branch September 20, 2026 18:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

minimal automated test for XGAP

1 participant