FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

ci: Touchstone LWS conformance scoreboard (#621) by melvincarvalho · Pull Request #626 · JavaScriptSolidServer/JavaScriptSolidServer · GitHub

Repository navigation

ci: Touchstone LWS conformance scoreboard (#621) - #626

Closed
melvincarvalho wants to merge 3 commits into
gh-pagesfrom
ci/lws-conformance-621
Closed

melvincarvalho wants to merge 3 commits into
gh-pagesfrom
ci/lws-conformance-621

Conversation

Copy link
Copy Markdown
Contributor

Part of #621.

Adds .github/workflows/lws-conformance.yml — the repo's first workflow — which starts JSS in single-user mode and runs Touchstone's composite action against it on every push to gh-pages, every PR, and on demand (workflow_dispatch with a module input: all, core, auth, core/containers, or one test id).

This is a scoreboard, not a gate. fail-on-nonconformance is off because JSS implements none of the LWS core protocol yet; expect the first run to fail most MUSTs. The job only goes red on Touchstone exit 2 — misconfigured workflow or unreachable server — so a broken scoreboard is visible rather than silently empty.

What you get per run:

  • the Touchstone markdown report in the job summary
  • a touchstone-report artifact with run.json, earl.ttl, junit.xml, report.html, report.pdf
  • the JSS log

Not done here, deliberately:

Related: #622 #623 #624 #625

Run ebremer/touchstone against a freshly started JSS on every push and
PR, publish the EARL/HTML/JUnit report as an artifact and the markdown
summary to the job page. fail-on-nonconformance is off: JSS has none of
the LWS core protocol yet, so this is a scoreboard for #621, not a gate.
Exit 2 (no verdict) still fails so a broken workflow is visible.
…ents

master's pom.xml lists the harness-clients module (added 7b13c27, 5 Oct)
but the Dockerfile never COPYs it, so the action's image build fails
before the harness runs. Pin to the parent commit until upstream fixes it.

Copy link
Copy Markdown
Contributor Author

First run failed inside Touchstone's own Docker build, not in JSS: master's pom.xml declares the harness-clients module (added in 7b13c27, 5 Oct) but the Dockerfile only COPYs harness-core, harness-fixtures, harness-cli and harness-mcp poms, so the reactor dies with Child module /src/harness-clients of /src/pom.xml does not exist. Pinned the action to the parent commit 5c49679 for now; upstream needs one line (COPY harness-clients/pom.xml harness-clients/) after line 16 of the Dockerfile.

The harness provisions its run root by POSTing to the base URL as alice,
and on a target that enforces no authentication alice and bob send
nothing. JSS's default root ACL is public-read, so the POST got 401 and
Touchstone exited 2 with no verdict. Seed a public-write .acl before
start; verified locally that the run-root POST, nested container POST
and PUT all return 201.

Copy link
Copy Markdown
Contributor Author

Closing: the conformance run should not live on GitHub Actions. Replaced by a local script (scripts/lws-conformance.sh) in a follow-up PR. Keeping this PR for the record — three runs here gave the first scoreboard, posted on #621 — and for the Touchstone Dockerfile diagnosis (ebremer/touchstone#2, fixed by ebremer/touchstone#3).

This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant


Back | FazBrowse Home | New Git URL