Kimi K3

Moonshot open-sources a 2.8-trillion-parameter, 1M-context model — billed as the largest open-weight model released so far, with only 104B parameters active per token.