feat(dataset_tools): prototype mutable (resizable) steps (#1483) - #1601

Draft

NJManganelli wants to merge 14 commits into

scikit-hep:masterfrom

NJManganelli:feat/mutable-steps-prototype

Commits on Jul 20, 2026

feat(dataset_tools): add preprocess_rntuple with TTree/RNTuple auto-detection
Nick Manganelli
committed
bc81c4c
feat(dataset_tools): switchable preprocessing backends + dask-free TTree forms
Nick Manganelli
committed
21e156b
fix(dataset_tools): validate step_size >= 1 at preprocess entrypoints
Nick Manganelli
committed
9378e97
feat(dataset_tools): dask-free RNTuple form extraction
Nick Manganelli
committed
bdae2ed
refactor(dataset_tools): order-agnostic reduce + Task.partial_result; rename backends module
Nick Manganelli
committed
ba4493e
docs(notebooks): showcase switchable backends + parquet/rntuple preprocessing
Nick Manganelli
committed
f81a21a
docs(notebooks): fully re-render filespec.ipynb on the advanced stack
Nick Manganelli
committed
8d1a7b0
test(dataset_tools): skip uproot.dask form-parity test when dask is absent

NJManganelli
authored and
Nick Manganelli
committed
67b1376
fix(dataset_tools): apply review fixes to rntuple/backends preprocessing

NJManganelli
authored and
Nick Manganelli
committed
3e9788e
feat(dataset_tools): union forms via DatasetSpec addition + per-file field bitsets

NJManganelli
authored and
Nick Manganelli
committed
65b6a7c
test(dataset_tools): GenModel union-form regression fixtures (ROOT + parquet)
NJManganelli
committed
0f2a715
test(dataset_tools): prove GenModel union form preserves masked events

NJManganelli
authored and
Nick Manganelli
committed
4b087e3
feat(dataset_tools): user-supplied metadata extraction during preprocessing

NJManganelli
authored and
Nick Manganelli
committed
89692fc
feat(dataset_tools): prototype mutable steps with consumer-driven resizing

NJManganelli
authored and
Nick Manganelli
committed
241e551

Navigation Menu

Uh oh!

feat(dataset_tools): prototype mutable (resizable) steps (#1483) - #1601

feat(dataset_tools): prototype mutable (resizable) steps (#1483)#1601
NJManganelli wants to merge 14 commits into
scikit-hep:masterfrom
NJManganelli:feat/mutable-steps-prototype

Commits on Jul 20, 2026

feat(dataset_tools): add preprocess_rntuple with TTree/RNTuple auto-detection

feat(dataset_tools): switchable preprocessing backends + dask-free TTree forms

fix(dataset_tools): validate step_size >= 1 at preprocess entrypoints

feat(dataset_tools): dask-free RNTuple form extraction

refactor(dataset_tools): order-agnostic reduce + Task.partial_result; rename backends module

docs(notebooks): showcase switchable backends + parquet/rntuple preprocessing

docs(notebooks): fully re-render filespec.ipynb on the advanced stack

test(dataset_tools): skip uproot.dask form-parity test when dask is absent

fix(dataset_tools): apply review fixes to rntuple/backends preprocessing

feat(dataset_tools): union forms via DatasetSpec addition + per-file field bitsets

test(dataset_tools): GenModel union-form regression fixtures (ROOT + parquet)

test(dataset_tools): prove GenModel union form preserves masked events

feat(dataset_tools): user-supplied metadata extraction during preprocessing

feat(dataset_tools): prototype mutable steps with consumer-driven resizing