Skip to content

Commit

Permalink
Update LLM Infeference demo README.md
Browse files Browse the repository at this point in the history
Update model links to litert Hugging Face.
  • Loading branch information
junjiang-lab authored Feb 18, 2025
1 parent bbd3781 commit fd5adee
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions examples/llm_inference/android/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,9 +34,9 @@ This application must be run on a physical Android device to take advantage of t

### Models used

You can download one of the [compatible models](https://developers.google.com/mediapipe/solutions/genai/llm_inference#models).
You can download compatible models from [LiteRT on Hugging Face](https://huggingface.co/litert-community), e.g. [deepseek_q8_ekv1280.task](https://huggingface.co/litert-community/DeepSeek-R1-Distill-Qwen-1.5B/resolve/main/deepseek_q8_ekv1280.task?download=true) for DeepSeek model.

Once you download it, place it under the path defined as MODEL_PATH in InferenceModel on the Android device
Once you download it, place it under the path defined as `Model.path` in `Model.kt` on the Android device
(eg. /data/local/tmp/llm/model.bin).

The easiest way to do that would be to use Android Studio's [Device Explorer](https://developer.android.com/studio/debug/device-file-explorer).
Expand Down

1 comment on commit fd5adee

@sanezek
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi, link to huggingface seems broken. Is this private repo?

Please sign in to comment.