AMD just bought a company that makes chips with a strange catch built right into them. The company is Taalas, a small outfit out of Toronto, and once you hear what they actually do, the catch makes a weird kind of sense.

Normal AI chips are general purpose. While they work, they keep pulling a model’s weights out of memory, over and over, millions of times a second, and that back and forth is a big part of what slows everything down. Taalas skips the whole step. Instead of storing the model in memory, they burn its weights straight into the transistors, so the chip and the model become the same object.

Their demo chip runs Meta’s Llama 3.1 8B and Taalas says it hits around 17,000 tokens a second per user, on a die built from 53 billion transistors. In their own tests, Nvidia’s Blackwell hardware managed roughly 350 tokens a second on the same task. That is not a small gap.

There is a real catch though. That chip only runs Llama 3.1 8B. Nothing else, not a newer version, not a different model. Want to switch models? You need a new chip. Taalas says it can turn one around in about two months, which is fast for silicon, but it is still silicon. You cannot patch it overnight the way you patch software.

AMD did not say what it paid, and the deal still has to close. What is clear is the bet behind it: for the handful of models that get run trillions of times a day, giving up flexibility for raw speed and lower power might be worth the trade.

I like that this option exists now. Most of the industry runs on chips built to do anything, and that flexibility costs real energy and money. A chip built to do exactly one thing, extremely well, is a fair trade for a company whose workload never changes. Just do not expect it to replace the general purpose chip in your laptop anytime soon.

——

Follow: @Ali Demi
Book your free AI clarity call, NOW!
https://buff.ly/TpWy277

——

Sources:
https://newsroom.amd.com/news/amd-acquires-taalas-ai-inference/
https://www.cnbc.com/2026/08/06/amd-buys-taalas-startup-that-hardwires-ai-models-into-its-silicon.html
https://www.eetimes.com/ai-chip-startup-taalas-acquired-by-amd/

Repost this. Thanks.