text-embeddings-inference 1.8.0

[BrewTestBot]

Created by brew bump

---

Created with brew bump-formula-pr.

release notes

## Notable Changes

Qwen3 support for 0.6B, 4B and 8B on CPU, MPS, and FlashQwen3 on CUDA and Intel HPUs
NomicBert MoE support
JinaAI Re-Rankers V1 support
Matryoshka Representation Learning (MRL)
Dense layer module support (after pooling)


[!NOTE]

Some of the aforementioned changes were released within the patch versions on top of v1.7.0, whilst both Matryoshka Representation Learning (MRL) and Dense layer module support have been recently included and were not released yet.

What's Changed

[Docs] Update quick tour by @NielsRogge in [Docs] Update quick tour huggingface/text-embeddings-inference#574
Update README.md and supported_models.md by @alvarobartt in Update README.md and supported_models.md huggingface/text-embeddings-inference#572
Back with linting. by @Narsil in Back with linting. huggingface/text-embeddings-inference#577
[Docs] Add cloud run example by @NielsRogge in [Docs] Add cloud run example huggingface/text-embeddings-inference#573
Fixup by @Narsil in Fixup huggingface/text-embeddings-inference#578
Fixing the tokenization routes token (offsets are in bytes, not in by @Narsil in Fixing the tokenization routes token (offsets are in bytes, not in huggingface/text-embeddings-inference#576
Removing requirements file. by @Narsil in Removing requirements file. huggingface/text-embeddings-inference#585
Removing candle-extensions to live on crates.io by @Narsil in Removing candle-extensions to live on crates.io huggingface/text-embeddings-inference#583
Bump sccache to 0.10.0 and sccache-action to 0.0.9 by @alvarobartt in Bump sccache to 0.10.0 and sccache-action to 0.0.9 huggingface/text-embeddings-inference#586
optimize the performance of FlashBert Path for HPU by @kaixuanliu in optimize the performance of FlashBert Path for HPU huggingface/text-embeddings-inference#575
Revert "Removing requirements file. (#585)" by @Narsil in Revert "Removing requirements file. (#585)" huggingface/text-embeddings-inference#588
Get opentelemetry trace id from request headers by @kozistr in Get opentelemetry trace id from request headers huggingface/text-embeddings-inference#425
Add argument for configuring Prometheus port by @kozistr in Add argument for configuring Prometheus port huggingface/text-embeddings-inference#589
Adding missing head. prefix in the weight name in ModernBertClassificationHead by @kozistr in Adding missing head. prefix in the weight name in ModernBertClassificationHead huggingface/text-embeddings-inference#591
Fixing the CI (grpc path). by @Narsil in Fixing the CI (grpc path). huggingface/text-embeddings-inference#593
fix xpu env issue that cannot find right libur_loader.so.0 by @kaixuanliu in fix xpu env issue that cannot find right libur_loader.so.0 huggingface/text-embeddings-inference#595
enable flash mistral model for HPU device by @kaixuanliu in enable flash mistral model for HPU device huggingface/text-embeddings-inference#594
remove optimum-habana dependency by @kaixuanliu in remove optimum-habana dependency huggingface/text-embeddings-inference#599
Support NomicBert MoE by @kozistr in Support NomicBert MoE huggingface/text-embeddings-inference#596
Remove duplicate short option '-p' to fix router executable by @cebtenzzre in Remove duplicate short option '-p' to fix router executable huggingface/text-embeddings-inference#602
Update text-embeddings-router --help output by @alvarobartt in Update text-embeddings-router --help output huggingface/text-embeddings-inference#603
Warmup padded models too. by @Narsil in Warmup padded models too. huggingface/text-embeddings-inference#592
Add support for JinaAI Re-Rankers V1 by @alvarobartt in Add support for JinaAI Re-Rankers V1 huggingface/text-embeddings-inference#582
Gte diffs by @Narsil in Gte diffs huggingface/text-embeddings-inference#604
Fix the weight name in GTEClassificationHead by @kozistr in Fix the weight name in GTEClassificationHead huggingface/text-embeddings-inference#606
upgrade pytorch and ipex to 2.7 version by @kaixuanliu in upgrade pytorch and ipex to 2.7 version huggingface/text-embeddings-inference#607
upgrade HPU FW to 1.21; upgrade transformers to 4.51.3 by @kaixuanliu in upgrade HPU FW to 1.21; upgrade transformers to 4.51.3 huggingface/text-embeddings-inference#608
Patch DistilBERT variants with different weight keys by @alvarobartt in Patch DistilBERT variants with different weight keys huggingface/text-embeddings-inference#614
add offline modeling for model jinaai/jina-embeddings-v2-base-code to avoid auto_map to other repository by @kaixuanliu in add offline modeling for model jinaai/jina-embeddings-v2-base-code to avoid auto_map to other repository huggingface/text-embeddings-inference#612
Add mean pooling strategy for Modernbert classifier by @kwnath in Add mean pooling strategy for Modernbert classifier huggingface/text-embeddings-inference#616
Using serde for pool validation. by @Narsil in Using serde for pool validation. huggingface/text-embeddings-inference#620
Preparing the update to 1.7.1 by @Narsil in Preparing the update to 1.7.1 huggingface/text-embeddings-inference#623
Adding suggestions to fixing missing ONNX files. by @Narsil in Adding suggestions to fixing missing ONNX files. huggingface/text-embeddings-inference#624
Add Qwen3Model by @alvarobartt in Add Qwen3Model huggingface/text-embeddings-inference#627
Add HiddenAct::Silu (remove serde alias) by @alvarobartt in Add HiddenAct::Silu (remove serde alias) huggingface/text-embeddings-inference#631
Add CPU support for Qwen3-Embedding models by @randomm in Add CPU support for Qwen3-Embedding models huggingface/text-embeddings-inference#632
refactor the code and add wrap_in_hpu_graph to corner case by @kaixuanliu in refactor the code and add wrap_in_hpu_graph to corner case huggingface/text-embeddings-inference#625
Support Qwen3 w/ fp32 on GPU by @kozistr in Support Qwen3 w/ fp32 on GPU huggingface/text-embeddings-inference#634
Preparing the release. by @Narsil in Preparing the release. huggingface/text-embeddings-inference#639
Default to Qwen3 in README.md and docs/ examples by @alvarobartt in Default to Qwen3 in README.md and docs/ examples huggingface/text-embeddings-inference#641
Fix Qwen3 by @kozistr in Fix Qwen3 huggingface/text-embeddings-inference#646
Add integration tests for Gaudi by @baptistecolle in Add integration tests for Gaudi huggingface/text-embeddings-inference#598
Fix Qwen3-Embedding batch vs single inference inconsistency by @lance-miles in Fix Qwen3-Embedding batch vs single inference inconsistency huggingface/text-embeddings-inference#648
Fix FlashQwen3 by @kozistr in Fix FlashQwen3 huggingface/text-embeddings-inference#650
Make flake work on metal by @Narsil in Make flake work on metal huggingface/text-embeddings-inference#654
Fixing metal backend. by @Narsil in Fixing metal backend. huggingface/text-embeddings-inference#655
Qwen3 hpu support by @kaixuanliu in Qwen3 hpu support huggingface/text-embeddings-inference#656
change HPU warmup logic: seq length should be with exponential growth by @kaixuanliu in change HPU warmup logic: seq length should be with exponential growth huggingface/text-embeddings-inference#659
Update version to 1.7.3 by @alvarobartt in Update version to 1.7.3 huggingface/text-embeddings-inference#666
Add last token pooling support for ORT. by @tpendragon in Add last token pooling support for ORT. huggingface/text-embeddings-inference#664
Fix Qwen3 Embedding Float16 DType by @tpendragon in Fix Qwen3 Embedding Float16 DType huggingface/text-embeddings-inference#663
Fix fmt by re-running pre-commit by @alvarobartt in Fix fmt by re-running pre-commit huggingface/text-embeddings-inference#671
Update version to 1.7.4 by @alvarobartt in Update version to 1.7.4 huggingface/text-embeddings-inference#677
Support MRL (Matryoshka Representation Learning) by @kozistr in Support MRL (Matryoshka Representation Learning) huggingface/text-embeddings-inference#676
Add Dense layer for 2_Dense/ modules by @alvarobartt in Add Dense layer for 2_Dense/ modules huggingface/text-embeddings-inference#660
Update version to 1.8.0 by @alvarobartt in Update version to 1.8.0 huggingface/text-embeddings-inference#686

New Contributors

@NielsRogge made their first contribution in [Docs] Update quick tour huggingface/text-embeddings-inference#574
@cebtenzzre made their first contribution in Remove duplicate short option '-p' to fix router executable huggingface/text-embeddings-inference#602
@kwnath made their first contribution in Add mean pooling strategy for Modernbert classifier huggingface/text-embeddings-inference#616
@randomm made their first contribution in Add CPU support for Qwen3-Embedding models huggingface/text-embeddings-inference#632
@lance-miles made their first contribution in Fix Qwen3-Embedding batch vs single inference inconsistency huggingface/text-embeddings-inference#648
@tpendragon made their first contribution in Add last token pooling support for ORT. huggingface/text-embeddings-inference#664

Full Changelog: huggingface/text-embeddings-inference@v1.7.0...v1.8.0

View the full release notes at https://github.com/huggingface/text-embeddings-inference/releases/tag/v1.8.0.

---

[github-actions]

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. To keep this pull request open, add a help wanted or in progress label.