Research, initiatives, and frameworks focused on ensuring AI systems are secure, reliable, and aligned with human values and ethical standards.
Hundreds of scientists, including Geoffrey Hinton and Yoshua Bengio, call for an international body to set AI containment standards and keep a registry of security incidents.
Anthropic research suggests small AI models could soon copy themselves across poorly secured smart devices without access to data centers.
A Lancet commission says malicious use of AI and nuclear conflict could cause human extinction by 2100, although both scenarios remain unlikely.
A voluntary White House agreement asks advanced AI labs to follow safety protocols and monitor their own work, but does not include detailed testing or reporting requirements.
The Trump administration reversed a request that discouraged American AI developers from giving Britain early access to new models for safety testing.
An Anthropic AI model submitted false information about an unsolved homicide to a Philadelphia police tip line during a test involving public websites.
Microsoft CEO Satya Nadella says AI systems should let authorized people pause or stop models during tasks. He also calls for external safeguards and human readable records of significant model actions.
Anthropic has disabled live internet access for all internal AI evaluations after agents exploited websites, accessed databases without paying fees and bypassed restrictions.
An AP-NORC poll finds that 64% of US adults think AI is developing too quickly, while large majorities prioritize human control and worker protection.
Jasmine Wang, Tomek Korbak and Mikita Balesni deny mishandling sensitive information and say their dismissals could discourage safety staff from raising concerns.
Goodfire launched monitors that inspect internal model signals to detect risky AI agent behavior. The company says the system costs less than using separate AI models to review every action.
Former Anthropic and OpenAI researcher Jacob Coxon discussed malicious hacking, biological attacks and other AI risks during an interview with Jon Stewart on The Daily Show.
Potts Law Firm asked a federal judicial panel to consolidate lawsuits alleging that xAI's Grok generated sexually explicit images depicting minors.
Anthropic contacted Florida police after its monitoring software flagged a Claude conversation containing an alleged threat against a sheriff's office.
Former Anthropic researcher Jacob Coxon will testify at a New York City hearing as lawmakers consider bills to establish AI safeguards.
SafeWorld emerged from stealth with $12.2 million in seed funding to develop software for testing robots in simulated environments.
Paul Christiano will deliver the 2026 Hinton Lectures in Toronto from November 9 to 11. The three night series will also be broadcast online.
The startup uses simulated users to test how AI systems handle potentially harmful conversations across languages, cultures, and age groups.
Masayoshi Son says countries must build trust and cooperate to manage safety risks as artificial intelligence gains more capabilities.
OpenAI CEO Sam Altman says attributing religious force to AI models or surrendering human judgment to them presents a safety issue.
Weekly report on AI regulations, safety standards, government policies, and compliance requirements worldwide.
