Subscribe

SiMa.ai's Palette 3.0 runs several AI models at once on one robot chip

Chip company SiMa.ai has released Palette 3.0, software that lets a robot or drone run its vision, reasoning and action models side by side on a single low-power chip.

Image: via Developer Tech News

SiMa.ai, a US company that makes chips for machines that run AI on board, has announced Palette 3.0. It is a software release for the company's Modalix chip, and its job is to let several AI models run at the same time on that one chip without going over the power and memory a drone or robot can spare. That includes large language models and vision-language models, the kind that look at a scene and decide what to do about it.

The company reports that text generation gets up to 3.5 times faster through a technique called speculative decoding, where a small model drafts ahead and a larger one checks the work. It also says OpenAI's open GPT-OSS-20B model now fits on its 16GB Modalix module. Developer Tech News points out that the headline number counts tokens per second, so it does not tell you how accurately a robot navigates or how quickly it reacts. The Palette code is open source and available on GitHub.

Why it matters

A robot that has to send every decision to a data centre is slow, and it stops working when the connection drops. Running perception and reasoning together on a small on-board chip is what makes a drone or mobile robot independent. The figures here are SiMa.ai's own and measure chip speed, not robot behaviour, so the real test is whether robot makers ship products built on it.

ELiA Weekly

The robot news that mattered, every Sunday.

The videos, the stories explained in plain words and the headlines worth your time. Free, in your inbox.

More news

All news