QC SeqMSE Draft

[haowhsu-quic]

Summary

SeqMSE prototype.
Author: @winskuo-quic, @haowhsu-quic

Test plan

python examples/qualcomm/oss_scripts/llama/llama.py -b build-android -s 5f396958 -m SM8750 --prompt "Could you tell me about Facebook?" --temperature 0 --model_mode kv --max_seq_len 128 --ptq 16a4w_block --decoder_model llama3_2 --compile_only --checkpoint ../.llama/checkpoints/Llama3.2-1B-Instruct/consolidated.00.pth --tokenizer_model ../.llama/checkpoints/Llama3.2-1B-Instruct/tokenizer.model --params ../.llama/checkpoints/Llama3.2-1B-Instruct/params.json

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/12700

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• linux.aws.h100.8 instance is down, potentially longer queue on linux.aws.h100

❌ 2 New Failures

As of commit 7481013 with merge base e31eb56 ():

NEW FAILURES - The following jobs have failed:

• Lint / lintrunner / linux-job (gh)
  >>> Lint for examples/qualcomm/utils.py:
• pull / test-static-llama-qnn-linux / linux-job (gh)
  test_llama_stories_110m

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.