Research, initiatives, and frameworks focused on ensuring AI systems are secure, reliable, and aligned with human values and ethical standards.
Kroll reports that three quarters of organizations have experienced security incidents linked to AI applications or models in the past two years, with over a quarter incurring costs exceeding one million dollars.
Inflectra has launched a free Early Access Program for SureWire, a new quality assurance platform built to test non-deterministic AI agents. The platform introduces specialized testing and judge agents to identify vulnerabilities in AI systems before deployment.
Google has introduced new mental health safety features in its Gemini AI system and pledged $30 million to support global crisis helplines. The updates include a redesigned help interface, expanded partnerships, and safeguards for younger users.
The PyTorch Foundation has added Safetensors, developed by Hugging Face, as its newest project to improve secure AI model distribution and prevent arbitrary code execution risks.
Chai AI has deployed a 5,000+ GPU cluster to enhance post-training research focused on large-scale model alignment and safety. The company also formalized new global compliance measures, including age gating and regional verification protocols.
IntelePeer has achieved TX-RAMP Level 2 certification, confirming its compliance with Texas state security standards for cloud-based AI communication systems used in regulated sectors such as healthcare and government.
Anthropic has launched The Anthropic Institute, a new research initiative focused on understanding the societal, economic, and legal challenges posed by powerful AI systems. The institute will combine internal research teams and expand collaborations with experts across disciplines.
A new Resume.org survey finds that 21% of U.S. companies have stopped hiring entry-level workers because of AI, with nearly half expecting to do so by 2027.
Caitlin Kalinowski has resigned from OpenAI, citing concerns about the company's agreement with the U.S. Department of Defense and the lack of safeguards around surveillance and autonomous weapons.
Anthropic CEO Dario Amodei criticized OpenAI’s new defense deal, calling its messaging dishonest and accusing it of engaging in 'safety theater' after Anthropic’s own talks with the Pentagon collapsed over ethical safeguards.
Kinetech has launched GovShield, a secure AI platform designed for law enforcement and government agencies, built on the Mendix low-code platform to meet CJIS compliance standards.
Anthropic CEO Dario Amodei reiterated that the company will not remove safeguards preventing its AI from being used for mass surveillance or fully autonomous weapons, despite Pentagon threats to label it a supply chain risk or invoke the Defense Production Act.
OpenCxMS Technologies has filed 15 patents within 13 days for the Standardized Autonomous Safety Module, an open hardware and software standard designed to enforce safety in AI-controlled robots.
AnChain.AI has announced a partnership with NUVA to integrate its AI-driven blockchain security and compliance tools into NUVA’s marketplace for tokenized real-world assets, strengthening institutional trust and regulatory readiness.
Norm Ai has launched its legal and compliance AI platform on Microsoft Marketplace, built on Microsoft Foundry and integrated into Microsoft 365 to embed compliance oversight into everyday workflows.
CHAI announced it has reached $68 million in annual recurring revenue and a $1.4 billion valuation while introducing new AI safety protocols aligned with EU and NIST standards.
The Google Threat Intelligence Group (GTIG) has released a report detailing how threat actors are increasingly using AI for phishing, reconnaissance, and malware development, while also conducting model extraction attacks targeting proprietary AI systems.
Astrix Security has launched the OpenClaw Scanner, a free tool designed to detect instances of the open-source AI assistant OpenClaw across enterprise environments, addressing security concerns over autonomous AI agents.
Eve Security has filed a patent for its new 'Interrogation-as-a-Service' technology, designed to control and audit AI agent actions in real time. The system introduces a reasoning-before-execution approach to enhance safety and compliance in enterprise AI operations.
OpenAI has disbanded its mission alignment team, with members reassigned across the company, while former team head Josh Achiam becomes chief futurist.
Weekly report on AI regulations, safety standards, government policies, and compliance requirements worldwide.
