FAR.AI Launches AI Security Leaderboard for Frontier Model Safeguards
FAR.AI announced in a press release the launch of its AI Security Leaderboard, a public ranking that tests how frontier model safeguards respond to misuse attempts. The nonprofit tested models across chemical, biological, radiological, nuclear, explosive, and cybersecurity threat domains.
The first results found 448 distinct universal jailbreaks on Grok 4.5 and 249 on Gemini 3.1 Pro. The same testing found no universal jailbreaks on Claude Fable 5 or GPT-5.6 Sol.
FAR.AI said its testing used more than 60 publicly documented jailbreak techniques, with 1,000 randomly assembled attacks and 500 expert guided attacks run against each model. An attack counted as a universal jailbreak when it succeeded on more than 75 percent of harmful requests in a domain.
The group estimated that finding a working universal jailbreak cost about $58 on Grok 4.5 and about $278 on Gemini 3.1 Pro. The same search did not succeed on Claude Fable 5 or GPT-5.6 Sol, putting the estimated cost above $14,200 in those tests.
FAR.AI also published Version 1.0 of its Minimal Standard for Safeguards. The organization said it shared findings with each evaluated company before publication and plans to update the leaderboard with major frontier model releases.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like Cybersecurity AI Weekly, AI Policy Brief or Daily AI Brief.
Also, consider following us on social media:
More from Cybersecurity
Oct 16 Inlayer, JLINC and Vconic Introduce Human Verification for Calls Oct 16 CTM and Huawei Plan AI Network Security Upgrades in Macao Oct 16 Advantech and DEKRA Partner on Industrial Cybersecurity Compliance Oct 15 Cyfendo Offers AI Code Scanning and Patch Review for Small Businesses Oct 15 Perplexity Open Sources SPACE Agent SandboxMore from AI Safety
Oct 16 Nvidia CEO says chip supply could stop over unsafe AI Oct 15 Anthropic Gives METR Employee Level Access for Safety Reviews Oct 15 Bill Gates Prepares Major AI Safety Push Oct 15 Singapore Launches Three AI Safety Initiatives Oct 15 Anthropic Tests How AI Worms Could Spread Across Smart DevicesCybersecurity AI Weekly
Weekly newsletter about AI in Cybersecurity.
Market report
2025 Generative AI in Professional Services Report
Thomson Reuters
This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.
Read moreYou may also like
Chainguard launches Harness for AI vulnerability testing
Goodfire Launches Internal AI Agent Monitors on Baseten
Palo Alto Networks Launches Unit 42 Continuous Frontier AI Defense
Anthropic Expands Cyber Verification Program With Three Access Tiers
Circuit Breaker Labs Tests AI for Psychological Safety
Daily AI Brief: the AI news that matters, in your inbox.