FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

Optimize HDF5 I/O performance by using collective I/O operations by sanathkeshav · Pull Request #105 · DataAnalyticsEngineering/FANS · GitHub

Optimize HDF5 I/O performance by using collective I/O operations - #105

Merged
sanathkeshav merged 10 commits into
developfrom
patch-write-transpose
Oct 27, 2025
Merged

Optimize HDF5 I/O performance by using collective I/O operations#105
sanathkeshav merged 10 commits into
developfrom
patch-write-transpose

Conversation

sanathkeshav commented Oct 26, 2025
edited
Loading

Copy link
Copy Markdown
Member

As the title suggests, we use parallel HDF5 I/O to write field data. Previously, it was serialized and was in general very suboptimal and slow when it came to large problems. This PR provides a fix along with a bit of decluttering the postprocessing function in the solver.

Checklist:

  • I made sure that the CI passed before I ask for a review.
  • I added a summary of the changes (compared to the last release) in the CHANGELOG.md.
  • If necessary, I made changes to the documentation and/or added new content.
  • I will remember to squash-and-merge, providing a useful summary of the changes of this PR.

sanathkeshav self-assigned this Oct 26, 2025
sanathkeshav changed the title Use eigen shuffle to permute in WriteSlab Optimize HDF5 I/O performance by using collective I/O operations Oct 26, 2025
sanathkeshav marked this pull request as ready for review October 26, 2025 19:52
sanathkeshav merged commit 6ba936c into develop Oct 27, 2025
8 checks passed
sanathkeshav deleted the patch-write-transpose branch October 27, 2025 11:37
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant


Back | FazBrowse Home | New Git URL