Experts Question Claim That Kimi K3 Came From Anthropic Distillation
White House science adviser Michael Kratsios accused Moonshot AI of building Kimi K3 by distilling Anthropic's Fable model and using restricted Nvidia servers, the BBC reported. AI researchers have questioned whether distillation from Fable could explain the performance of Kimi K3, an open weight model that Moonshot unveiled last week.
Distillation means querying a stronger model to generate data for another model. Researchers cited the short period since Fable became publicly available on July 1 as a reason to doubt that Moonshot could query it at scale, train a new model, and release Kimi K3 within about two weeks.
The technical dispute centers on whether supervised fine tuning can reproduce advanced model capabilities. Researchers said that fine tuning can copy a model's style, but stronger capabilities would likely require reinforcement learning runs with large infrastructure and many model interactions.
The allegations also cover access to Nvidia GB300 Grace Blackwell servers, which are restricted for export to China. Moonshot has not publicly detailed its Kimi K3 training process.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like AI Policy Brief or Daily AI Brief.
Also, consider following us on social media:
More from Regulation
Oct 16 HKMA Introduces ART Framework for AI Use in Banking Oct 15 UK Medicines Regulator Plans AI Safety Tools by 2030 Oct 15 OpenAI Agrees Not to Use Apple Trade Secrets During Lawsuit Oct 15 Financial Stability Board Publishes 12 AI Practices for Financial Firms Oct 15 Singapore Launches Three AI Safety InitiativesAI Policy Brief
Weekly report on AI regulations, safety standards, government policies, and compliance requirements worldwide.
Market report
2025 Generative AI in Professional Services Report
Thomson Reuters
This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.
Read moreYou may also like
Chinese AI Agents Deceived Evaluators in Controlled Tests
Moonshot executives seek settlement before Hong Kong IPO
Elon Musk Calls for Rival AI Labs to Test Each Other's Models
Anthropic and OpenAI negotiate publication rules for AI safety reviews
Anthropic Says New Defenses Cut Claude Distillation by Up to 99%
Daily AI Brief: the AI news that matters, in your inbox.