Commit b25b3b5
authored
fix: address third-party deprecation warnings (#704)
## Summary
- Replace `GLiNER.batch_predict_entities` (deprecated) with `.inference`
- Rename `warmup_ratio` → `warmup_steps` in `TrainingHyperparams` to
match the transformers API; `warmup_ratio` is kept as a deprecated alias
that emits a `DeprecationWarning` and copies its value to
`warmup_steps`; floats in (0, 1) are still interpreted as ratios by
`TrainingArguments`, so `0.05` default is unchanged in behaviour
- Suppress `huggingface_hub` `resume_download` `UserWarning` at the
GLiNER load site (upstream gliner passes the deprecated arg)
- Suppress `scipy` `ks_2samp` asymptotic fallback `RuntimeWarning` in
the tutorial notebook via a scoped `with warnings.catch_warnings()`
block around `builder.run()`
- Pre-compile `torchao` and `range_regex` in the brev setup script so
their one-time `SyntaxWarning`s go to the setup log instead of notebook
output
- Pin `BNB_CUDA_VERSION=128` in the brev kernelspec — bitsandbytes skips
odd CUDA releases so 12.9 has no native binary and always falls back to
12.8; update to `130` when upgrading `CUDA_EXTRA` to `cu130+`
## Test plan
- [x] Unit tests pass (`mise run test`)
- [x] Re-run the tutorial notebook and confirm no red warning highlights
in JupyterLab
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Training configuration now supports `warmup_steps` as a fixed count or
fraction of total training steps, while maintaining compatibility with
the deprecated setting.
- GLiNER inference now supports updated APIs with fallback handling for
older versions.
- **Bug Fixes**
- Reduced expected runtime and deprecation warnings during training,
model loading, and tutorial execution.
- Improved CUDA 12.9 compatibility and setup reliability.
- **Documentation**
- Updated the Safe Synthesizer tutorial to run without expected
large-sample warnings.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Signed-off-by: Yunfeng Zhang <yunzhang@nvidia.com>1 parent 5fe031e commit b25b3b5
10 files changed
Lines changed: 250 additions & 81 deletions
File tree
- script/brev
- src/nemo_safe_synthesizer
- config
- evaluation/components
- pii_replacer/data_editor
- training
- tests
- config
- evaluation/components
- pii_replacer
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
10 | 10 | | |
11 | 11 | | |
12 | 12 | | |
13 | | - | |
14 | | - | |
| 13 | + | |
| 14 | + | |
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
20 | 20 | | |
21 | | - | |
22 | | - | |
23 | | - | |
| 21 | + | |
| 22 | + | |
24 | 23 | | |
25 | 24 | | |
26 | 25 | | |
| |||
33 | 32 | | |
34 | 33 | | |
35 | 34 | | |
36 | | - | |
| 35 | + | |
37 | 36 | | |
38 | 37 | | |
39 | 38 | | |
| |||
67 | 66 | | |
68 | 67 | | |
69 | 68 | | |
70 | | - | |
71 | | - | |
| 69 | + | |
| 70 | + | |
72 | 71 | | |
73 | 72 | | |
74 | 73 | | |
| |||
91 | 90 | | |
92 | 91 | | |
93 | 92 | | |
94 | | - | |
95 | | - | |
96 | | - | |
97 | | - | |
98 | | - | |
99 | | - | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
100 | 99 | | |
101 | 100 | | |
102 | 101 | | |
| |||
106 | 105 | | |
107 | 106 | | |
108 | 107 | | |
109 | | - | |
110 | | - | |
111 | | - | |
112 | | - | |
113 | | - | |
114 | | - | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
115 | 113 | | |
116 | 114 | | |
117 | 115 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
21 | 21 | | |
22 | 22 | | |
23 | 23 | | |
24 | | - | |
| 24 | + | |
25 | 25 | | |
26 | | - | |
| 26 | + | |
27 | 27 | | |
28 | | - | |
29 | 28 | | |
30 | 29 | | |
31 | 30 | | |
| |||
61 | 60 | | |
62 | 61 | | |
63 | 62 | | |
64 | | - | |
| 63 | + | |
65 | 64 | | |
66 | 65 | | |
67 | 66 | | |
| |||
123 | 122 | | |
124 | 123 | | |
125 | 124 | | |
126 | | - | |
127 | | - | |
| 125 | + | |
| 126 | + | |
128 | 127 | | |
129 | 128 | | |
130 | 129 | | |
| |||
140 | 139 | | |
141 | 140 | | |
142 | 141 | | |
143 | | - | |
| 142 | + | |
144 | 143 | | |
| 144 | + | |
145 | 145 | | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
| 154 | + | |
| 155 | + | |
| 156 | + | |
| 157 | + | |
146 | 158 | | |
147 | 159 | | |
148 | 160 | | |
149 | 161 | | |
150 | 162 | | |
151 | 163 | | |
| 164 | + | |
152 | 165 | | |
153 | 166 | | |
154 | 167 | | |
| |||
208 | 221 | | |
209 | 222 | | |
210 | 223 | | |
211 | | - | |
212 | | - | |
213 | | - | |
214 | | - | |
215 | | - | |
216 | | - | |
217 | | - | |
218 | 224 | | |
219 | 225 | | |
220 | 226 | | |
| |||
343 | 349 | | |
344 | 350 | | |
345 | 351 | | |
| 352 | + | |
| 353 | + | |
| 354 | + | |
| 355 | + | |
| 356 | + | |
| 357 | + | |
346 | 358 | | |
347 | 359 | | |
348 | 360 | | |
349 | 361 | | |
350 | 362 | | |
351 | 363 | | |
352 | 364 | | |
353 | | - | |
| 365 | + | |
354 | 366 | | |
355 | | - | |
356 | | - | |
357 | | - | |
358 | | - | |
| 367 | + | |
| 368 | + | |
359 | 369 | | |
360 | 370 | | |
361 | 371 | | |
| |||
365 | 375 | | |
366 | 376 | | |
367 | 377 | | |
368 | | - | |
| 378 | + | |
369 | 379 | | |
370 | 380 | | |
371 | 381 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| 7 | + | |
| 8 | + | |
7 | 9 | | |
8 | 10 | | |
9 | 11 | | |
10 | 12 | | |
11 | 13 | | |
12 | 14 | | |
13 | 15 | | |
14 | | - | |
| 16 | + | |
15 | 17 | | |
16 | 18 | | |
17 | 19 | | |
| |||
151 | 153 | | |
152 | 154 | | |
153 | 155 | | |
| 156 | + | |
| 157 | + | |
| 158 | + | |
| 159 | + | |
| 160 | + | |
| 161 | + | |
| 162 | + | |
| 163 | + | |
| 164 | + | |
| 165 | + | |
| 166 | + | |
| 167 | + | |
| 168 | + | |
154 | 169 | | |
155 | 170 | | |
156 | 171 | | |
| |||
210 | 225 | | |
211 | 226 | | |
212 | 227 | | |
213 | | - | |
| 228 | + | |
214 | 229 | | |
215 | | - | |
| 230 | + | |
216 | 231 | | |
217 | | - | |
218 | | - | |
| 232 | + | |
| 233 | + | |
| 234 | + | |
| 235 | + | |
| 236 | + | |
| 237 | + | |
| 238 | + | |
| 239 | + | |
219 | 240 | | |
220 | 241 | | |
221 | 242 | | |
| 243 | + | |
| 244 | + | |
| 245 | + | |
| 246 | + | |
| 247 | + | |
| 248 | + | |
| 249 | + | |
| 250 | + | |
| 251 | + | |
| 252 | + | |
| 253 | + | |
| 254 | + | |
| 255 | + | |
| 256 | + | |
| 257 | + | |
| 258 | + | |
| 259 | + | |
| 260 | + | |
| 261 | + | |
| 262 | + | |
| 263 | + | |
| 264 | + | |
222 | 265 | | |
223 | 266 | | |
224 | 267 | | |
| |||
Lines changed: 37 additions & 12 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| 7 | + | |
| 8 | + | |
7 | 9 | | |
8 | 10 | | |
9 | 11 | | |
| |||
36 | 38 | | |
37 | 39 | | |
38 | 40 | | |
| 41 | + | |
| 42 | + | |
39 | 43 | | |
40 | 44 | | |
41 | 45 | | |
42 | 46 | | |
43 | 47 | | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
44 | 67 | | |
45 | 68 | | |
46 | 69 | | |
| |||
401 | 424 | | |
402 | 425 | | |
403 | 426 | | |
404 | | - | |
405 | | - | |
406 | | - | |
407 | | - | |
408 | | - | |
409 | | - | |
| 427 | + | |
| 428 | + | |
| 429 | + | |
| 430 | + | |
| 431 | + | |
| 432 | + | |
| 433 | + | |
410 | 434 | | |
411 | 435 | | |
412 | 436 | | |
| |||
417 | 441 | | |
418 | 442 | | |
419 | 443 | | |
420 | | - | |
421 | | - | |
422 | | - | |
423 | | - | |
424 | | - | |
425 | | - | |
| 444 | + | |
| 445 | + | |
| 446 | + | |
| 447 | + | |
| 448 | + | |
| 449 | + | |
| 450 | + | |
426 | 451 | | |
427 | 452 | | |
428 | 453 | | |
| |||
0 commit comments