Hands-On with the AMD Ryzen AI Halo

This is more of an ad, not a review, and reads like the author has hardly any experience with the things he's trying out. That Z Image Turbo diffusion model would've also run on many consumer GPUs and with way higher performance for a fraction of the price.

Phoronix is more useful: https://www.phoronix.com/review/amd-ryzen-ai-halo

Unfortunately, the table of models and tokens per second (TPS) and time to first token (TTFT) is not helpful without specifying the quantization of the model.

Until RAM prices drop and can economically get machines with 256GB, 512GB and higher bandwidth... I frankly think the local AI story is going to be still fairly muted for most people.

My Spark can do Qwen3.6 MoE A3B at 60 to 70-ish token/second and that's really good, but there's limits the usefulness of that model. It's not useful for coding, in any case.

Once people can run something like GLM 5.2 at lower quants (512GB could do a passable job), then I think the story changes.

Whether we ever see DRAM as cheap as it was ever again, I don't know.