Skip to content

Learning path review for Distributed inference using llama.cpp #2207

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

armwaheed
Copy link
Contributor

@armwaheed armwaheed commented Aug 4, 2025

Before submitting a pull request for a new Learning Path, please review Create a Learning Path

  • I have reviewed Create a Learning Path

Please do not include any confidential information in your contribution. This includes confidential microarchitecture details and unannounced product information.

  • I have checked my contribution for confidential information

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the Creative Commons Attribution 4.0 International License.

@armwaheed
Copy link
Contributor Author

@pareenaverma this pull request is a review of the learning path submitted in PR #2150 "Adding learning path for distributed inference with llama.cpp on Arm"

@armwaheed
Copy link
Contributor Author

Hi @aryan8433! I just reviewed the learning path you submitted in PR #2150.

May you please review the recommended changes, in this PR that I just created?

  • Sensitive words
  • Missing libcurl install step
  • Spaces in bash commands
  • Consider adding Hugging Face instructions, including link to quantized model
  • Also consider adding a step that the model.gguf needs to be present on all 3 nodes

@pareenaverma
Copy link
Contributor

Final tech review in #2226

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants