perf: use PyArrow fast path for JSONL reads - #2325

Open

praateekmahajan wants to merge 6 commits into

NVIDIA-NeMo:mainfrom

praateekmahajan:codex/pr2303-jsonl-arrow

Commits on Aug 21, 2026

perf: use PyArrow fast path for JSONL reads
praateekmahajan
committed
ba603f5
refactor: preserve Arrow JSONL batches
praateekmahajan
committed
5ca436e
docs: note legacy file task ID keys
praateekmahajan
committed
dc17cde
Support Arrow batches in length sorting
praateekmahajan
committed
bc77913
Drop legacy pandas string compatibility
praateekmahajan
committed
01423d0
Relax JSON timestamp unit assertion
praateekmahajan
committed
befb941