not
fff88ca23d
## What & why Use the standard `$GITHUB_STEP_SUMMARY` (Gitea 1.27 + act_runner 2.0.0) to surface on the run page what was previously buried in logs or download-only artifacts. All five quick wins from #136, **reporting-only** — no job's pass/fail gating changes. Closes #136 ### Items 1. **Mutation scores** — added the `markdown` reporter to each `stryker-config.json`; the `mutation` job concatenates each service's `mutation-report.md` into the summary (`if: always()`). Also reveals where `make mutation` stopped on a ratchet break. 2. **Per-frontend tests** — the 4 apps' `test` targets emit vitest JSON to `test-output/{projectName}.json` (Nx token interpolation); `infra/vitest-summary.py` renders a per-frontend table. 3. **Per-service unit tests** — `make unit` now writes TRX; `infra/trx-summary.py` renders a per-service table (service name derived from the `services/<name>/` path, so `domain` shows, not `big.tests`). 4. **e2e per-spec results** — Playwright writes `playwright-report.json`; `run-e2e-check.sh` copies it out of the container (capturing the exit code first); `infra/playwright-summary.py` renders a per-spec table. Turns a red e2e into a one-glance "which spec". 5. **verify-stack check table** — each live-stack check has an `id`; a final `if: always()` step tabulates each check's ✅/❌/⏭️. Docs: `gitea-actions-gotchas.md` §8 (version requirement + `$GITHUB_STEP_SUMMARY` guard + step-level `always()` note). ### Notes - Every summary write is guarded with `[ -n "${GITHUB_STEP_SUMMARY:-}" ]`, so it no-ops on an unsupported runner / locally. - New helper scripts are stdlib-only Python, matching the existing `infra/*.py` check scripts (no new dependency — a few lines of parsing rather than a test-logger package). - `TestResults/` and `test-output/` gitignored. - This is also the first PR-run exercising the #135 verify-stack fix end to end. ## Verified locally `make unit` (TRX) ✓ · 4 apps' vitest JSON ✓ · ACL Stryker markdown report ✓ · all four parsers + the two summary shell blocks ✓ · `ci.yaml` + `run-e2e-check.sh` syntax ✓. The rendered summaries themselves only appear on the run page — this PR's CI run is the end-to-end check. ## Definition of Done - [x] Each item writes to `$GITHUB_STEP_SUMMARY` (guarded), renders on the run page. - [x] No change to any job's pass/fail gating. - [x] Conventional Commits referencing #136 (one per item + docs). - [ ] CI green; summaries visible on the run. - [x] Runbook note (gotchas §8). 🤖 Generated with [Claude Code](https://claude.com/claude-code)Reviewed-on: #137
66 lines
2.5 KiB
Python
66 lines
2.5 KiB
Python
#!/usr/bin/env python3
|
|
"""Render a per-test-project table from .trx files for a Gitea job summary (#136).
|
|
|
|
Reads every *.trx in the given directory (default: TestResults), pulls each project's
|
|
counters + assembly name, and prints a GitHub/Gitea-flavoured markdown table to stdout.
|
|
The CI step redirects that into $GITHUB_STEP_SUMMARY. Stdlib only.
|
|
"""
|
|
import glob
|
|
import os
|
|
import sys
|
|
import xml.etree.ElementTree as ET
|
|
|
|
NS = {"t": "http://microsoft.com/schemas/VisualStudio/TeamTest/2010"}
|
|
|
|
|
|
def project_name(root):
|
|
# The test assembly path, e.g. …/services/domain/Big.Tests/bin/…/big.tests.dll. Prefer the
|
|
# owning service folder (services/<name>) so "domain" shows rather than the opaque "big.tests";
|
|
# fall back to the assembly basename for projects outside services/ (e.g. tests/acceptance).
|
|
ut = root.find(".//t:TestDefinitions/t:UnitTest", NS)
|
|
storage = ut.get("storage") if ut is not None else None
|
|
if not storage:
|
|
return None
|
|
parts = storage.replace("\\", "/").split("/")
|
|
if "services" in parts:
|
|
return parts[parts.index("services") + 1]
|
|
base = os.path.basename(parts[-1])
|
|
return base[:-4] if base.lower().endswith(".dll") else base
|
|
|
|
|
|
def parse(path):
|
|
root = ET.parse(path).getroot()
|
|
c = root.find(".//t:ResultSummary/t:Counters", NS)
|
|
if c is None:
|
|
return None
|
|
total = int(c.get("total", 0))
|
|
if total == 0: # e.g. the Integration project, filtered out of the unit run
|
|
return None
|
|
executed = int(c.get("executed", 0))
|
|
passed = int(c.get("passed", 0))
|
|
failed = int(c.get("failed", 0)) + int(c.get("error", 0))
|
|
skipped = total - executed
|
|
return {
|
|
"name": project_name(root) or os.path.basename(path),
|
|
"passed": passed, "failed": failed, "skipped": skipped, "total": total,
|
|
}
|
|
|
|
|
|
def main(results_dir):
|
|
rows = [r for r in (parse(p) for p in sorted(glob.glob(os.path.join(results_dir, "*.trx")))) if r]
|
|
if not rows:
|
|
print("_No test results found._")
|
|
return 0
|
|
rows.sort(key=lambda r: r["name"])
|
|
print("## ✅ Unit tests\n")
|
|
print("| Project | Result | Passed | Failed | Skipped | Total |")
|
|
print("| ------- | :----: | -----: | -----: | ------: | ----: |")
|
|
for r in rows:
|
|
status = "❌" if r["failed"] else "✅"
|
|
print(f"| {r['name']} | {status} | {r['passed']} | {r['failed']} | {r['skipped']} | {r['total']} |")
|
|
return 0
|
|
|
|
|
|
if __name__ == "__main__":
|
|
sys.exit(main(sys.argv[1] if len(sys.argv) > 1 else "TestResults"))
|