Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide an option to chunk files #13

Open
ThomasThelen opened this issue Jan 7, 2025 · 0 comments · May be fixed by #15
Open

Provide an option to chunk files #13

ThomasThelen opened this issue Jan 7, 2025 · 0 comments · May be fixed by #15
Assignees

Comments

@ThomasThelen
Copy link
Member

ThomasThelen commented Jan 7, 2025

At higher s2 levels, the program generates so many files that it fills the inode table. My computer lags, I can't create new files, etc. Add a flag to chunk the results into N files. Because the triples have to live in memory before they're written to disk - N will vary computer to computer.

@ThomasThelen ThomasThelen self-assigned this Jan 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant