Repository navigation
Add phase 2 streaming PLINK mount via vcztools.BedEncoder - #3
Merged
Merged
Conversation
Serves .bed on demand from a per-FUSE-handle BedEncoder over a shared VczReader, with .bim/.fam precomputed once into in-memory bytes. Multiple processes opening the mount each get an independent encoder; iterators do not interfere across handles. Mount is refactored to accept a pyfuse3.Operations directly so phase-1 and phase-2 share the mount-loop machinery, and a new mount-plink-streaming CLI command is added. The fx_mounted_plink fixture is parametrised over passthrough/streaming so the plink1.9 / plink2 byte-identity assertions run in both modes.
jeromekelleher
force-pushed
the
use-vcztools-api
branch
3 times, most recently
from
May 3, 2026 20:17
83d7c59 to
f854093
Compare
Update ci.yml to mirror bio2zarr conventions: weekly cron run, action SHA version comments, fetch-depth: 0 in test job checkout, --locked and --no-default-groups flags throughout, biofuse --help smoke test, and Coveralls coverage upload. Rewrite the packaging job to install the built wheel into a fresh venv and exercise the CLI; drop the unnecessary libfuse3-dev/pkg-config install (biofuse is pure-Python). Add .github/dependabot.yml for monthly github-actions updates, and a new cd.yml that builds sdist+wheel and publishes to PyPI on release and TestPyPI on tag pushes via trusted publishing.
jeromekelleher
force-pushed
the
use-vcztools-api
branch
from
May 4, 2026 14:11
33f1022 to
9d476fd
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Serves .bed on demand from a per-FUSE-handle BedEncoder over a shared VczReader, with .bim/.fam precomputed once into in-memory bytes. Multiple processes opening the mount each get an independent encoder; iterators do not interfere across handles.
Mount is refactored to accept a pyfuse3.Operations directly so phase-1 and phase-2 share the mount-loop machinery, and a new mount-plink-streaming CLI command is added. The fx_mounted_plink fixture is parametrised over passthrough/streaming so the plink1.9 / plink2 byte-identity assertions run in both modes.