Taalas HC1, explained from zero

This chip can only think one thought.
That's why it's 100× faster.

A normal AI chip is a printer: it can print any page, slowly. This chip is a rubber stamp: one page only, instantly. Five steps to see why that works, and what it costs.

1What an AI chip actually does all day

your question (as numbers) multiply × 8 billion weights then add everything up next word repeat per word
Everything an AI chip does: multiply by fixed numbers, add up, spit out a word. Repeat.

2Why GPUs are slow: the numbers live far away

MEMORY CHIPS the 8 billion numbers live here GPU does the math here, mostly sits waiting haul 8 billion numbers… …again, for every word the bridge is the bottleneck: ~90% of time and power is spent here
The GPU's problem is a commute. The workers are fast; the highway is jammed.

3Taalas' move: print the numbers into the chip itself

ONE CHIP numbers, etched into the wiring calculators right beside them distance to fetch a number: zero. That's the whole trick.
Same math, no commute. The number and the calculator that uses it are fused together.

4How can a wire "multiply"? Watch one weight work

Say this spot in the model has weight = 5. Input x flows in: 8x — 4x — x — free copies of the input, made by wire position alone no plug → ignored plug! → 4x flows down plug! → x flows down ADD 4x + x = 5x ✓ multiplied by 5, nothing fetched
Two metal plugs = the number 5. A different weight would be a different plug pattern on the same wires. This happens 8 billion times across the chip, all at once.

5How they build a new chip in 2 months, not 2 years

model weights 8B numbers software weights → plug map blank chips + punch the plugs done ~2 months
Like a book printer that keeps pre-bound blank books and only prints the final page of ink. Only the plug pattern is custom.

6Your remaining questions, straight answers

Can it be fine-tuned later?

  • Partly. The etched numbers can never change.
  • But the chip keeps a small patch of normal, rewritable memory for add-on corrections (LoRA: a thin extra layer, under 1% of the model's size, whose output gets added on top).
  • You train that patch on regular GPUs, then load it onto the card like a settings file.
  • Want a truly new model? New chip. No way around it.

What does the shrinking cost in quality?

  • To fit on one chip, each number is rounded from 16-bit precision down to 3 to 6 bits.
  • Expect a small but real quality drop vs. the original model, like a heavily compressed photo: fine normally, artifacts in hard cases.
  • On a GPU you could re-tune this. Here the rounding is etched in, permanently.

Could this run Kimi-K3-sized models?

  • One chip is already at the maximum size a factory can make, and holds 8 billion numbers.
  • A frontier model has ~1 trillion numbers: roughly 100+ chips, wired together with the cable ports on the card's edge.
  • Models like Kimi only use ~3% of their numbers per word, but every number must still physically exist on some chip.
  • Doable, and it's their late-2026 roadmap. But each big model becomes a 100-chip, multi-million-dollar bet.

What's the payoff and the risk?

  • Payoff: ~17,000 words/second per user, ~200 watts per card, ordinary air cooling, ~100× cheaper per word than GPUs.
  • Risk: the chip is unbeatable on its one model and worthless on every other.
  • If labs release better models faster than Taalas can re-print chips, stock dies on the shelf.
  • So their real product isn't the chip. It's the 2-month re-printing pipeline.
If you remember one thing

GPUs waste 90% of their effort hauling the model's numbers back and forth from memory. Taalas etches the numbers into the chip's wiring, so there is nothing to haul. Printer vs. rubber stamp: they gave up the ability to print any page, and got a 100× faster stamp.

Sources: taalas.com · Forbes · NYU Shanghai RITS · EE Times