Skip to content

xrt: Add at v2.21.75#9264

Open
GZGavinZhao wants to merge 1 commit into
mainfrom
gzgz/jj-mxywyzkuvmyn
Open

xrt: Add at v2.21.75#9264
GZGavinZhao wants to merge 1 commit into
mainfrom
gzgz/jj-mxywyzkuvmyn

Conversation

@GZGavinZhao

@GZGavinZhao GZGavinZhao commented Jun 13, 2026

Copy link
Copy Markdown
Member

Summary

Fixes #9262.

Now people can run ML models (mostly LLMs these days) on their Ryzen AI processors' NPU without eating up GPU resources (i.e. those AMD processors with NPUs, all the Ryzen AI XXX models).

Test Plan

  • xrt-smi examine shows my NPU correctly.
  • Built FastFlowLM from source and ran Qwen3-8B, producing reasonable results at reasonable performance.

Checklist

  • Package was built and tested against unstable
  • This change could gainfully be listed in the weekly sync notes once merged
  • I agree to license this contribution and all my previous contributions under the licensing terms in LICENSE.md and have the power and authority to grant those licenses.

@GZGavinZhao GZGavinZhao self-assigned this Jun 13, 2026
@github-project-automation github-project-automation Bot moved this to Triage in Solus Jun 13, 2026
Comment thread packages/x/xrt/pspec_x86_64.xml
@GZGavinZhao GZGavinZhao force-pushed the gzgz/jj-mxywyzkuvmyn branch from dd62a5c to 03e34cf Compare June 13, 2026 23:49
@GZGavinZhao

GZGavinZhao commented Jun 14, 2026

Copy link
Copy Markdown
Member Author

Investigating static library shenanigans...

@GZGavinZhao GZGavinZhao force-pushed the gzgz/jj-mxywyzkuvmyn branch 3 times, most recently from 9e7add1 to d58857f Compare June 15, 2026 01:19
Comment thread packages/x/xrt/monitoring.yaml Outdated
Comment thread packages/x/xrt/monitoring.yaml Outdated
Comment thread packages/x/xrt/pspec_x86_64.xml Outdated
@EbonJaeger

Copy link
Copy Markdown
Member

I wonder if either the library portion or the /usr/bin portion should be split into a separate package. How is this meant to be used?

@GZGavinZhao GZGavinZhao force-pushed the gzgz/jj-mxywyzkuvmyn branch from d58857f to 004089c Compare June 16, 2026 02:01
@GZGavinZhao

Copy link
Copy Markdown
Member Author

Thanks for the feedback, will address them later today.

@GZGavinZhao

Copy link
Copy Markdown
Member Author

Usually downstream consumers (e.g. LLM runtimes like FastFlowLM) link against the dynamic library, However, if you're using the NPU, you almost always want the command-line tools like xrt-smi as well to inspect and manage the state of the NPU. Therefore, I'm inclined to not split the libraries and binaries.

@GZGavinZhao GZGavinZhao force-pushed the gzgz/jj-mxywyzkuvmyn branch from 004089c to 39fc5c3 Compare June 17, 2026 04:38
@GZGavinZhao GZGavinZhao requested a review from EbonJaeger June 17, 2026 05:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Triage

Development

Successfully merging this pull request may close these issues.

xrt

2 participants