Underdog shows off a 32MB speech model in new demo

AI companies across the world are racing to make bigger and better models, but the problem is all of them need massive amounts of processing power. On the other end, some researchers and startups are creating smaller models that can run on edge devices, like your phone or computer.

One such startup, Underdog, has released a game built with its new voice model called Woof that’s only 32MB large.

The game features a room with a retro tech theme, a typewriter, and a CRT monitor. There is a desk lamp, which makes a sound when you click its switch. The intro warns users about “intrusive” cloud providers in the town — ostensibly a jab at cloud-based models.

You can interact with the typewriter and music tuner.

You can type anything on the typewriter using your keyboard, and the game will speak it back. You can also rotate the tuner to generate different kinds of music.

All of this works within the browser through Underdog’s speech generation model, which, the company says, can run on most devices without any internet connection. The model has 31 million parameters and is open for everyone to download.

While such a small model likely won’t replace bigger models, it may still be enough to drive local assistant experiences or create personalized podcasts.

This demo comes weeks after Underdog launched Bark, a 167 MB speech-to-text model also designed to run on edge devices for transcription and dictation.

Sigil Wen, the founder of Underdog, told TechCrunch that he started building the app because, instead of using notetakers like Granola, he wanted to build his own system with AI models that can run on users’ devices and let them own their data.

“I think we will be able to run most capable models of today on the devices you already own within months. We just want to train the best open models that are American-made, that are open, that are capable and allow people to have private AI,” he said, referring to his manifesto.