[ExecuTorch][WebGPU] Add et_vk.prepack (constant-tensor packing) for E2E weight loading

[JulianCloudNTH]

Stack from ghstack (oldest at bottom):

• -> [ExecuTorch][WebGPU] Add et_vk.prepack (constant-tensor packing) for E2E weight loading #20265
• [ExecuTorch][WebGPU] Add et_vk.apply_rotary_emb (interleaved RoPE) + ValueList multi-output #20264
• [ExecuTorch][WebGPU] Add et_vk.embedding_q4gsw (4-bit groupwise-symmetric quantized embedding) #20263
• [ExecuTorch][WebGPU] linear_q4gsw test suite: Llama-1B shapes + 4k/8k sweep #20227

Adds the WebGPU backend handler for et_vk.prepack.default, the node the VulkanPartitioner wraps around every constant feeding a delegated op so the constant is materialized into its dedicated GPU buffer before inference.

For the WebGPU backend's buffer-flat/fp32 model, prepack is an identity layout (same dims, dtype, and bytes), so the handler runs no compute shader: it validates that src and out match (dims, elem_size, nbytes, non-null buffers; every check throws fail-loud) and records a one-time src->out buffer-to-buffer copy via the new WebGPUGraph::add_prepack_copy. The recorded copies run once in a new build() Phase 4 (after the op-dispatch chain is recorded), mirroring the Vulkan delegate's separate prepack() init phase (distinct from per-inference execute()). Ordering is guaranteed by the WebGPU queue -- the prepack submit precedes the first execute() submit on the same queue, so the copied data is visible without an explicit device poll (Dawn has no wgpuDevicePoll, and the backend relies on queue ordering plus the output-map wait elsewhere).

src.elem_size is the WebGPUTensor field added by the embedding op lower in this stack, so prepack stacks above it.

Differential Revision: D108428754

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/20265

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• [ROCm] MI350 CI jobs will have longer queue times due to CI migration

❌ 21 New Failures, 2 Unrelated Failures

As of commit bf5c220 with merge base 5526971 ():

NEW FAILURES - The following jobs have failed:

• pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t bc4f423581a446eddd4120144cef5ae358c49b5850c0c4efb37a9bfa5e8a7f9e /exec failed with exit code 1
• pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t b7670ea36249eab4da44fc28af276c35860a786cdb8f3971213f2e994da64cca /exec failed with exit code 1
• pull / test-phi-3-mini-runner-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 1ec0b30b8663ec37c4116988092a051392e2191e6d4b841afb3925ec0bf726f0 /exec failed with exit code 1
• pull / test-qnn-buck-build-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 9810e258cf1aa4cc0b2ff4858bb619b64d6d0f7c8179a5994d1f0f55f32d99d4 /exec failed with exit code 1
• pull / test-qnn-delegate-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 8c7794d053a36817ea08eba7e2b58285d26ab3997a6f5774ee73dff457115889 /exec failed with exit code 1
• pull / test-qnn-direct-build-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 9b5c2883d534db7517e2448099d9ef814b30d37d1b66468a26cfc08035becef6 /exec failed with exit code 1
• pull / test-qnn-models-linux (dl3) / linux-job (gh)
  RuntimeError: Command docker exec -t 091c975902ee4c629d33b7f82ca23a27bf73453b71a929be93ebf67f01b2b34a /exec failed with exit code 1
• pull / test-qnn-models-linux (mv2) / linux-job (gh)
  RuntimeError: Command docker exec -t 120ace0364797457d88d58f77bc9388a966ee1aa24c282b54ae0c74d1835e047 /exec failed with exit code 1
• pull / test-qnn-models-linux (mv3) / linux-job (gh)
  RuntimeError: Command docker exec -t 776acfc9b039bdba920a998a49cf9352c691867a71c143207eb5868389610f7e /exec failed with exit code 92
• pull / test-qnn-passes-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 6399b152237bc48f64ae90139804dbea3b84ef7af01be77d7a541e4b20ab57f4 /exec failed with exit code 1
• pull / test-qnn-python-imports-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 5fd72efa27bf4ba9839f8e911d59a7f5e8a339e1d4104a4949e5dd8530386dca /exec failed with exit code 1
• pull / test-qnn-testsuite-linux / test-backend-linux (qnn, models) / linux-job (gh)
  RuntimeError: Command docker exec -t 0c9d40d100183b4e0df5cc2bcaeaa710323b59f251a0802d62f5fad63fbaa008 /exec failed with exit code 1
• pull / test-qnn-testsuite-linux / test-backend-linux (qnn, operators) / linux-job (gh)
  RuntimeError: Command docker exec -t ba4676dbdbee97739d423909cb8eb25d6d315fbb4e0971576aa7ef49935eb027 /exec failed with exit code 1
• pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
  RuntimeError: Command docker exec -t da1135e636f4e0434125f9e22fb54b40d308b553018cc54cdab57783f0dccf60 /exec failed with exit code 1
• pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
  RuntimeError: Command docker exec -t e7ab956c468bd37827e0357740e3e8dfb99c3ef9ff1e674c85f8475b28cb7957 /exec failed with exit code 1
• pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
  RuntimeError: Command docker exec -t 09071c89797ee5ca4b9c8f7b8ba246985c1331ed8eda7cb67de1eba48de97452 /exec failed with exit code 1
• pull / test-sqnr-static-llm-qnn-linux (smollm2_135m) / linux-job (gh)
  RuntimeError: Command docker exec -t 70700f2e4c39682572d7fd71783d9c920f70199ceaaa00bccac3b868bd0080e2 /exec failed with exit code 1
• pull / test-static-llama-qnn-linux (stories_110m) / linux-job (gh)
  RuntimeError: Command docker exec -t f2c415647bfb914ae0a07b65ff42acf14e1f1c24689a81d353976d68c57584f4 /exec failed with exit code 1
• pull / test-static-llama-qnn-linux (stories_260k_bc) / linux-job (gh)
  RuntimeError: Command docker exec -t ef75dcfa69a7081b6fc220b0030d147e1fa34c26a5b4d445cc0876f87dbacc7e /exec failed with exit code 1
• Test QNN Backend / test-qnn / test-backend-linux (qnn, models) / linux-job (gh)
  RuntimeError: Command docker exec -t 29e6e8b45f6fa3e9a15b7b7afb4314a95af10542fb165b11f67937bd9f6f8ac3 /exec failed with exit code 1
• Test QNN Backend / test-qnn / test-backend-linux (qnn, operators) / linux-job (gh)
  RuntimeError: Command docker exec -t 50980366695ccf9c1a80c4788a6aeb447e6daf51fd2ed569f4eb74625fe6fe29 /exec failed with exit code 1

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• pull / test-qnn-wheel-packages-linux (3.13) / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

BROKEN TRUNK - The following job failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / android / build-android (gh) (trunk failure)
  Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.