FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

perf: better wcc by SemyonSinchenko · Pull Request #888 · graphframes/graphframes · GitHub

/ graphframes Public

perf: better wcc - #888

Open
SemyonSinchenko wants to merge 2 commits into
graphframes:mainfrom
SemyonSinchenko:887-rc-perf
ConversationCommits (2)ChecksFiles changed
Open

perf: better wcc#888
SemyonSinchenko wants to merge 2 commits into
graphframes:mainfrom
SemyonSinchenko:887-rc-perf

Conversation

SemyonSinchenko commented Aug 24, 2026

Copy link
Copy Markdown
Collaborator

What changes were proposed in this pull request?

See #887

Why are the changes needed?

Close #887

It is 1.5x faster on local benchmarks while consuming 2x less amount of RAM. At scale should be ~2x faster than the two-phase-AQE and around 4x faster than the default.

codecov-commenter commented Aug 24, 2026

Copy link
Copy Markdown

⚠️ Please install the to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 79.27%. Comparing base (28d181c) to head (9ac98fa).
⚠️ Report is 5 commits behind head on main.
❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files 
@@           Coverage Diff           @@
##             main     #888   +/-   ##
=======================================
  Coverage   79.26%   79.27%           
=======================================
  Files          81       81           
  Lines        4712     4713    +1     
  Branches      554      561    +7     
=======================================
+ Hits         3735     3736    +1     
  Misses        977      977

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

SauronShepherd commented Aug 24, 2026

Copy link
Copy Markdown
Contributor

lgtm

SemyonSinchenko commented Aug 24, 2026

Copy link
Copy Markdown
Collaborator Author

@james-willis this one is really around 2x better perf and 2x less RSS. I think you should consider to use it in Sedona instead of the default one.

This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Show hidden characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

james-willis Awaiting requested review from james-willis

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

feat: randomized contraction can be faster

3 participants

Back | FazBrowse Home | New Git URL