Skip to content

Move output.csv file open to the the main function and limit to rank 0#132

Open
jprorama wants to merge 3 commits into
hpc-io:masterfrom
jprorama:fix-csv-open
Open

Move output.csv file open to the the main function and limit to rank 0#132
jprorama wants to merge 3 commits into
hpc-io:masterfrom
jprorama:fix-csv-open

Conversation

@jprorama

@jprorama jprorama commented Oct 3, 2024

Copy link
Copy Markdown
Contributor

This avoids opening the file in all ranks, causing file open contention between ranks. Contention increases with rank count and stripe count.

Proposed partial fix for #131 for base write benchmarks.

jprorama and others added 3 commits October 3, 2024 10:39
This avoids opening the file in all ranks, causing file open contention
between ranks.  Contention increases with rank count and stripe count.

Proposed partial fix for hpc-io#131 for base write benchmarks.

@jeanbez jeanbez left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the contribution! If we do move this, we need to make the same changes to all the other patterns that output a CSV.

@jeanbez jeanbez added enhancement New feature or request help wanted Extra attention is needed labels Jul 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request help wanted Extra attention is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants