What is Kimi K3, China’s first open AI model to reach 2.8 trillion parameters?

Chinese AI firm Moonshot AI announced its Kimi K3 model, the first open model to reach 2.8 trillion parameters. “Kimi K3 is a 2.8T-parameter model built on our Kimi Delta Attention,” the company said. It features a 1-million-token context window. The firm plans to release full model weights by July 27.