Amazon will launch software on Monday that lets developers run PyTorch code on its Trainium AI chips. This move challenges Nvidia by simplifying the process for users. Colin Brace said, "This has been about meeting customers where they're at." Many early customers already use the tool to get cost savings.
TorchNeuron lets developers run code written in a language called PyTorch on Amazon's Trainium AI chips with a single configuration change and no rewriting needed, according to Amazon's Annapurna Labs chip unit.
Sign up here.
Amazon, which plans to announce the software at a developer conference in Silicon Valley on Monday, said the software will be publicly released as a free and open-source offering.
Colin Brace, vice president of software for Annapurna Labs, said the move was aimed at reducing the number of steps AI developers must take to try Amazon's in-house chips.
"This has been about meeting customers where they're at," he told Reuters in an interview.
Brace said more than 30 early customers — spanning robotics, world models and voice AI — are using the new software, and that the switch to Amazon's chips can result in steep cost savings.