Skip to content

RelBench 3.0.1

Latest

Choose a tag to compare

@rishabh-ranjan rishabh-ranjan released this 25 Aug 05:33
· 10 commits to main since this release

Patch release on top of 3.0.0.

  • python -m relbench.submit no longer crashes on Windows consoles that cannot print
    the report's check-mark glyphs (ASCII fallback).
  • Autocomplete train splits start a whole timedelta before the earliest row, so the
    first rows are included on every duckdb version.
  • The trivial example scripts no longer import torch; CI runs one of them and the
    quickstart notebook on every push.
  • provenance/check_provenance.py checks several datasets in one run, skips external and
    autocomplete tasks, and fails loudly on drift.
  • Hosted labels regenerated where the provenance check found drift (rel-event/user-repeat,
    rel-stack/post-votes, rel-stack/user-post-comment); see the 3.0.0 notes below.