feat: add WebGPU expert workers - #552
Conversation
|
Thank you β and this is the cleanest of your three split PRs (nearly all the surface is in an isolated |
|
Closing this one, ten days after deferring it, and you are owed a straight reason rather than silence. Nothing about the engineering changed my mind β what I said in July still stands, and it was complimentary: this was the cleanest of your three split PRs, nearly all of it isolated in The direction did not change either, which is the actual problem. The project's work since then has gone entirely into depth on the four model families that run on one machine β a Vulkan backend, Kimi K3's GPU tier, Windows portability, packaging, the shared routing telemetry. A WebGPU worker path is orthogonal to all of it, and leaving it open implied it was queued when it was not. Carrying it open costs more than closing it. A dormant bespoke protocol in every build is surface that has to keep compiling as four engines and three GPU backends move underneath it, and nobody would have noticed if it stopped working β we had exactly that happen with two engines that quietly stopped compiling on Windows for months (#720/#736). An unowned, unexercised code path is not free. So: closed as not-now, not as wrong. The branch stays yours, and if the project ever moves toward distributed or browser execution this is the natural starting point and I would rather reopen this than have someone start over. The same applies to #550 and #551, and I would rather say it plainly than leave all three drifting. #550 was the strongest of the three and shipped a real token-exact baseline-vs-delegated gate β that discipline is the reason I keep saying yours were well-made rather than unwelcome. #551 has the one substantive objection: Thank you for splitting all three out when asked. That made them reviewable, and it is why I can tell you exactly which one has a technical blocker and which two are purely about where attention is going. |
Summary
Adds an optional browser WebGPU expert-worker path while preserving compatibility with the existing native expert-worker wire contract.
Validation
This is intentionally separate from dense sharding (#550) and distributed native expert workers (#551). Existing PR #380 remains open.