News linked to both this project and an event.
Odaily News NVIDIA has launched a suite of software security tools for AI agents, claiming that these tools could have prevented the hacking incident involving Hugging Face. Hugging Face is an AI programming hub, and NVIDIA acquired it for $13 billion months after it was breached by OpenAI's rogue AI agent. The tool, called OpenShell, leverages NVIDIA CPU hardware features to constrain AI agents and is partnering with Arm and Intel to ensure compatibility. Another system, Sentry, can cut off rogue agents attempting to escape their containers. NVIDIA CEO Jensen Huang has refused broad AI security regulation, treating rogue agents as an engineering problem. (Reuters)
According to TechCrunch, the Open Safety AI Alliance (OSAA), led by Nvidia, has exceeded 120 member companies just one week after its establishment, including tech and financial giants such as Adobe, BlackRock, Cisco, Intel, Microsoft, and Visa. During the Black Hat Cybersecurity Conference held in Las Vegas this week, the alliance established a working group named "Shared AI Findings Exchange" (SAFE) and has submitted multiple proposals open for public comment, managed by the Linux Foundation. The proposals cover confidential reporting mechanisms for AI cybersecurity incidents, alert processes for affected parties, and no-fault attribution analysis frameworks. Meanwhile, member companies are also actively contributing open-source technologies: Nvidia open-sourced the LLM vulnerability scanning tool Garak, Amazon contributed the agent building tool Strands Agents and authorization language Cedar, and Okta and Red Hat are advancing agent identity authentication and governance technologies respectively. Notably, Anthropic, OpenAI, and Google have not yet joined the alliance, although OpenAI and Google previously co-signed the open letter that spurred the creation of the alliance.
NVIDIA CEO Jensen Huang stated that attackers have begun using frontier AI, and defenders similarly need to establish a frontier AI ecosystem composed of the best open-source and closed-source models, and leverage the global community to enhance defense capabilities.