📝 add guide on using TPU with TGI in the docs (#2907)

huggingface · Jan 15, 2025 · 46994b3 · 46994b3
1 parent dc9b8e9
commit 46994b3
Show file tree

Hide file tree

Showing 2 changed files with 5 additions and 0 deletions.
diff --git a/docs/source/_toctree.yml b/docs/source/_toctree.yml
@@ -13,6 +13,8 @@
     title: Using TGI with Intel Gaudi
   - local: installation_inferentia
     title: Using TGI with AWS Inferentia
+  - local: installation_tpu
+    title: Using TGI with Google TPU
   - local: installation_intel
     title: Using TGI with Intel GPUs
   - local: installation

diff --git a/docs/source/installation_tpu.md b/docs/source/installation_tpu.md
@@ -0,0 +1,3 @@
+# Using TGI with Google TPU
+
+Check out this [guide](https://huggingface.co/docs/optimum-tpu) on how to serve models with TGI on TPUs.
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1,3 @@
		# Using TGI with Google TPU

		Check out this [guide](https://huggingface.co/docs/optimum-tpu) on how to serve models with TGI on TPUs.