fix more panics

[davidhewitt]

Auditing and removing / fixing more .unwrap() / .expect() calls. Will probably add linting etc to defend against this.

[codspeed-hq]

Merging this PR will not alter performance

✅ 16 untouched benchmarks
⏩ 15 skipped benchmarks¹

---

_{Comparing dh/fix-more-panics (0384c0d) with main (8aa308e)}

Footnotes

1. 15 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩