head_size = getattr(model.config, "head_dim",...)#149

Open

rzbhatti wants to merge 22 commits intomainfrom

config_head_dim

Commits on Oct 6, 2025

head_size = getattr(model.config, "head_dim", model.config.emb_dim // model.config.nheads )
Rashed Z. Bhatti, PhD
committed

Commits on Oct 15, 2025

[dpp] store enforce_sizes in log name and added generic kwargs to get_default_validation_prefix, enable sample_key

kcirred
authored and
Rashed Z. Bhatti, PhD
committed
[utils] added doc string, refactor sample_key, added return_key to squad_v2 sampler

kcirred
authored and
Rashed Z. Bhatti, PhD
committed
[dpp/validation] restore sample_key in logic after rebase of main

kcirred
authored and
Rashed Z. Bhatti, PhD
committed
[validation] Modified final file string to hash due to OSError name too long

kcirred
authored and
Rashed Z. Bhatti, PhD
committed
[test_validation] remove unused line

kcirred
authored and
Rashed Z. Bhatti, PhD
committed
[validation] removed enforce_sizes from find_validation_info_path

kcirred
authored and
Rashed Z. Bhatti, PhD
committed
[dpp] added handling of return_key for __custom_line_sampler

kcirred
authored and
Rashed Z. Bhatti, PhD
committed
updated llama model expectation tests using v1.0.0 aiu software stack as modeling code changed

JRosenkranz
authored and
Rashed Z. Bhatti, PhD
committed
[testing] changed get_default_validation_prefix to generic kwargs, file names now sorted, testing of file names modified for new order

kcirred
authored and
Rashed Z. Bhatti, PhD
committed
fixed test_scripts program assertion

JRosenkranz
authored and
Rashed Z. Bhatti, PhD
committed
Add test case for caching

avery-blanchard
authored and
Rashed Z. Bhatti, PhD
committed
Update cache test, add validation for cached run

avery-blanchard
authored and
Rashed Z. Bhatti, PhD
committed
Squashed commit of the following:

alex-jw-brooks
authored and
Rashed Z. Bhatti, PhD
committed
don't skip save on aiu iter0

alex-jw-brooks
authored and
Rashed Z. Bhatti, PhD
committed
fix fp8 dtype, always use persistent model fixture

alex-jw-brooks
authored and
Rashed Z. Bhatti, PhD
committed
remove model path from get_cpu_model args

alex-jw-brooks
authored and
Rashed Z. Bhatti, PhD
committed
fix casing error

alex-jw-brooks
authored and
Rashed Z. Bhatti, PhD
committed
Rebase fixes, linting

alex-jw-brooks
authored and
Rashed Z. Bhatti, PhD
committed
fix input prep

alex-jw-brooks
authored and
Rashed Z. Bhatti, PhD
committed
use setdefault for torch sendnn cache dir

alex-jw-brooks
authored and
Rashed Z. Bhatti, PhD
committed

Commits on Oct 16, 2025

Added head_dim override option to inference.py
Rashed Z. Bhatti, PhD
committed