FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

feat: fix memory leaks in GraphX by SemyonSinchenko · Pull Request #687 · graphframes/graphframes · GitHub

feat: fix memory leaks in GraphX - #687

Merged
SemyonSinchenko merged 2 commits into
graphframes:masterfrom
SemyonSinchenko:686-memory-graphx
Sep 15, 2025
Merged

feat: fix memory leaks in GraphX#687
SemyonSinchenko merged 2 commits into
graphframes:masterfrom
SemyonSinchenko:686-memory-graphx

Conversation

Copy link
Copy Markdown
Collaborator

What changes were proposed in this pull request?

  • graphs are not cached on creation
  • GraphFrames unpersist GraphX objects after conversion
  • No more memory leaks

Why are the changes needed?

Close #686
Close #360

SemyonSinchenko self-assigned this Sep 15, 2025
SemyonSinchenko added scala graphx Anything related to GraphX labels Sep 15, 2025

Copy link
Copy Markdown
Collaborator Author

cc: @SauronShepherd this one is fixing issue from #360

SemyonSinchenko merged commit d72ef0f into graphframes:master Sep 15, 2025
5 checks passed
SemyonSinchenko deleted the 686-memory-graphx branch September 15, 2025 19:04
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

graphx Anything related to GraphX scala

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: improve memory management in GraphX bug: Graphframes with Structured Streaming results in OOM even with very low data volumes

2 participants


Back | FazBrowse Home | New Git URL