ryzen-ai

The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)

The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B Q4_K_XL: 656.33pp, 70.56tg tok/s single user with DFlash2

A close-to-metal Python API for programming AMD Ryzen™ AI NPUs (AI Engines), built on an open-source MLIR-based compiler toolchain.

The fastest way to run Qwen3.8 27B on Strix Halo (gfx1151)

Active and open development fork of FastFlowLM.

A two-day, non-expert guide to running local LLMs on an AMD Strix Halo (Ryzen AI Max+ 395) box — full ~120GB memory pool, ROCm backend, NPU in parallel via FastFlowLM, one OpenAI-compatible endpoint.

Run LLMs and Ollama Qwen across AMD XDNA1 NPU, CPU, and GPU on Ryzen AI Linux systems.

vLLM + Qwen3.6-27B (BF16) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). Vision input, 256K context, /v1/responses with separated reasoning, via TheRock ROCm.

Xian-VL monorepo - Multilingual Assistant for Gaming Environments 🧙‍♂️ and other AI translation/research tools. Powered by Lemonade. 🍋

ROCmFPX llama.cpp fork for Windows 🏆 — native build, headless OpenAI-compatible server & benchmarks. Tested on AMD Strix Halo (gfx1151), runs on other GPUs too.

Fix internal speakers on the ASUS ProArt PX13 (HN7306, Strix Halo) under Linux: TAS2783 firmware + ALSA UCM Speaker profile + ACP/SoundWire reset for boot and suspend/resume.

AMD ISP4 camera driver module for Ryzen AI laptops

Stable Diffusion image generation on AMD Ryzen AI NPUs for Linux

llama.cpp + Qwen3.6-27B (Q8_0 GGUF) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). 256K context, ~7.5 t/s decode via TheRock ROCm Docker.

Run large LLMs locally on AMD Ryzen AI Max+ 395 (Strix Halo, gfx1151) with ROCmFP4 4-bit quantization. Measured benchmarks, build + serving recipes, and 118 ready-to-run GGUF models.

1bit engine: local LLM inference for AMD Ryzen AI (Strix Halo) inside Lemonade. HRX with our Loom kernels on the Radeon iGPU, plus the XDNA 2 NPU; OpenAI-compatible API. Runs Qwen3.8, Zyphra ZAYA1, ternary Bonsai.

ComfyUI on AMD Strix Halo (RDNA 3.5 / gfx1151) via Docker. Ubuntu 26.04 LTS + uv-managed Python 3.12 + pinned TheRock ROCm 7.13 wheels. Fixes the silent CPU fallback Debian / Python 3.13 images hit on gfx1151.

Reproducible RDNA reference for Meta Muse-Glimmer-30B — adapting MI-series ROCm recipes to Ryzen AI and Radeon with vLLM, llama.cpp, DFlash and auditable benchmarks.

LLM and speech-to-text on the AMD Ryzen AI NPU with custom AI Engine kernels: LFM2.5-230M at 58 tok/s, Parakeet TDT 0.6B encoder at 185 ms per 10 s audio with FP32 accuracy. IRON/MLIR-AIE, XRT.

AI Engine RunTime, lite: language models and image generation on the NPU of AMD Ryzen AI processors