FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

Report the environment under test at the top of e2e reports and run summaries by ronblum · Pull Request #18655 · rstudio/rstudio · GitHub

Report the environment under test at the top of e2e reports and run summaries - #18655

Open
ronblum wants to merge 6 commits into
mainfrom
test/ron/e2e-workflow-report-version-header
Open

Report the environment under test at the top of e2e reports and run summaries#18655
ronblum wants to merge 6 commits into
mainfrom
test/ron/e2e-workflow-report-version-header

Conversation

ronblum commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

Addresses #18654.

A Playwright report and a CI run page don't currently say what they ran against. Answering "which RStudio was this?" means digging through a job log for the installer filename.

The harness now reads the build under test from the live session and reports it in two places:

  • The GitHub Actions run summary, as a "Run under test" block at the top of the page.
  • The Playwright HTML report, as report metadata.

Both carry RStudio's long version and release name, the R version, the edition (Desktop or Server), and the OS with its architecture:

Ubuntu 24 (x86_64) Desktop · RStudio 2026.09.0-daily+124 "Autumn Hawkbit" · R 4.6.1

The RStudio and R versions come from the window.rstudio.version automation bridge; the release name comes from .rs.api.versionInfo(), which is the only place it's exposed. A source build reports its synthetic version (99.9.9-pr+<run> in CI), so it can't be mistaken for a daily.

In the report, each engine gets its own metadata entry keyed by OS and edition, so a merged multi-engine report keeps every engine's line instead of the last one overwriting the rest. The OS name comes from a new PW_OS_LABEL, set per engine; on a Linux engine it reuses the existing pretty_name from the engine config, so all sixteen are covered by one line.

Two supporting changes:

  • os-e2e-deps no longer writes its own ### R version summary block. It runs before the tests, so leaving it would duplicate the R version and push the new block off the top of an append-only summary. Its r-version.txt artifact and step outputs are unchanged, so the certification workflow still reads what it expects.
  • The S3 report URL published by os-publish-e2e-report now ends in #?show-metadata-other. Playwright renders metadata keys it doesn't recognize only behind that flag.

Verified on Ubuntu 24 x86_64: run 33005666605.

github-actions Bot commented Aug 26, 2026
edited
Loading

Copy link
Copy Markdown

RStudio E2E - all platforms

All tests passed!

#################### 100% pass rate

Passed Failed Skipped Flaky
2429 0 152 2
Platform ✅ Passed ❌ Failed ⚠️ Skipped 🔁 Flaky
✅ auth-teardown 2 0 10 0
✅ desktop-linux 603 0 31 0
✅ desktop-macos 609 0 26 0
✅ desktop-windows 608 0 31 1
✅ server-linux 581 0 44 1
✅ setup 26 0 10 0
View / download the full report

View report online -- opens in the browser, no download needed. Available for 14 days.

Download playwright-report.zip -- extract and open index.html

Includes screenshots, traces, and step-by-step details for every test. Expires in 15 days.


All platforms - commit 44d52d9b272ad53afa39758a06ed419c4b093e39 - Run #738

This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant


Back | FazBrowse Home | New Git URL