(../../../../fm.cnbc.com/applications/cnbc.com/resources/img/CNBC_LOGO_FAVICON_1C_KO_RGB.ico)  Nvidia Open Agent Safety Platform to stop AI agents from breaking out      (nvidia-releases.html)                             (https://image.cnbcfm.com)  (https://static-redesign.cnbcfm.com)   (https://www.cnbc.com/amp/2026/09/28/nvidia-releases.html)                                (https://static-redesign.cnbcfm.com/dist/main-2ef0355c48f1ae9dc737.js)  (https://static-redesign.cnbcfm.com/dist/54711-1b4b7f27485b536e2300.js)  (https://static-redesign.cnbcfm.com/dist/73154-f72e1b21698ca1449bb2.js)  (https://static-redesign.cnbcfm.com/dist/74430-af231b64f95f9e3d41ae.js)  (https://static-redesign.cnbcfm.com/dist/CNBCGlobalNav-1ef3d9f4f23da797ec6f.js)  (https://static-redesign.cnbcfm.com/dist/components-PcmModule-Ads-TopBanner-d40bf01647eaf56d45bf.js)  (https://static-redesign.cnbcfm.com/dist/components-PcmModule-ArticleHeader-439053a438abbbf01636.js)  (https://static-redesign.cnbcfm.com/dist/components-PcmModule-ArticleInlineMedia-ce4dc323bdf07999c782.js)  (https://static-redesign.cnbcfm.com/dist/89244-92cd1abce03aaa61c9fd.js)  (https://static-redesign.cnbcfm.com/dist/73965-2fd2603b9cb12d085e81.js)  (https://static-redesign.cnbcfm.com/dist/components-PcmModule-KeyPoints-c55273c3b6aa04692701.js)  (https://static-redesign.cnbcfm.com/dist/71941-18b74b75c24a23391d7b.js)  (https://static-redesign.cnbcfm.com/dist/components-PcmModule-ArticleBody-c1ba49429e517765810a.js)  (https://static-redesign.cnbcfm.com/dist/93002-ae69b162db78f6308c82.js)  (https://static-redesign.cnbcfm.com/dist/components-PcmModule-ArticleRelatedVideo-2fb52a46c0576d7d9cfa.js)  (https://static-redesign.cnbcfm.com/dist/components-PcmModule-LiveEventModule-8a58dfc853cfadadf1fe.js)  (https://static-redesign.cnbcfm.com/dist/components-PcmModule-WatchLiveRightRail-090a6e7cb78c8cbead15.js)  (https://static-redesign.cnbcfm.com/dist/components-PcmModule-Ads-BoxRail-5b6a2c071c5d8bca4ef9.js)  (https://static-redesign.cnbcfm.com/dist/components-PcmModule-TransporterSection-c042b86ca9cdbf3fdab7.js)  (https://static-redesign.cnbcfm.com/dist/components-Footer-CNBCFooter-b4e61105c5acbfcef431.js)       (nvidia-releases.html#MainContent) Skip Navigation    (https://www.cnbc.com/) (CNBC)       (https://www.cnbc.com/markets/)  Markets  (https://www.cnbc.com/pre-markets/) Pre-Markets  (https://www.cnbc.com/us-markets/) U.S. Markets  (https://www.cnbc.com/currencies/) Currencies  (https://www.cnbc.com/prediction-markets/) Prediction Markets  (https://www.cnbc.com/cryptocurrency/) Cryptocurrency  (https://www.cnbc.com/futures-and-commodities/) Futures & Commodities  (https://www.cnbc.com/bonds/) Bonds  (https://www.cnbc.com/funds-and-etfs/) Funds & ETFs     (https://www.cnbc.com/business/)  Business  (https://www.cnbc.com/economy/) Economy  (https://www.cnbc.com/finance/) Finance  (https://www.cnbc.com/health-and-science/) Health & Science  (https://www.cnbc.com/media/) Media  (https://www.cnbc.com/real-estate/) Real Estate  (https://www.cnbc.com/energy/) Energy  (https://www.cnbc.com/climate/) Climate  (https://www.cnbc.com/transportation/) Transportation  (https://www.cnbc.com/cnbc-investigations/) Investigations  (https://www.cnbc.com/industrials/) Industrials  (https://www.cnbc.com/retail/) Retail  (https://www.cnbc.com/wealth/) Wealth  (https://www.cnbc.com/sports/) Sports  (https://www.cnbc.com/life/) Life  (https://www.cnbc.com/small-business/) Small Business     (https://www.cnbc.com/investing/)  Investing  (https://www.cnbc.com/personal-finance/) Personal Finance  (https://www.cnbc.com/fintech/) Fintech  (https://www.cnbc.com/financial-advisors/) Financial Advisors  (https://www.cnbc.com/options-action/) Options Action  (https://www.cnbc.com/etf-street/) ETF Street  (https://buffett.cnbc.com) Buffett Archive  (https://www.cnbc.com/earnings/) Earnings  (https://www.cnbc.com/trader-talk/) Trader Talk     (https://www.cnbc.com/technology/)  Tech  (https://www.cnbc.com/cybersecurity/) Cybersecurity  (https://www.cnbc.com/ai-artificial-intelligence/) AI  (https://www.cnbc.com/enterprise/) Enterprise  (https://www.cnbc.com/internet/) Internet  (https://www.cnbc.com/media/) Media  (https://www.cnbc.com/mobile/) Mobile  (https://www.cnbc.com/social-media/) Social Media  (https://www.cnbc.com/cnbc-disruptors/) CNBC Disruptor 50  (https://www.cnbc.com/tech-guide/) Tech Guide     (https://www.cnbc.com/politics/)  Politics & Policy  (https://www.cnbc.com/white-house/) White House  (https://www.cnbc.com/policy/) Policy  (https://www.cnbc.com/defense/) Defense  (https://www.cnbc.com/congress/) Congress  (https://www.cnbc.com/expanding-opportunity/) Expanding Opportunity     (https://www.cnbc.com/tv/)  Video  (https://www.cnbc.com/latest-video/) Latest Video  (https://www.cnbc.com/live-tv/full-episodes/) Full Episodes  (https://www.cnbc.com/live-tv/) Livestream  (https://www.cnbc.com/live-audio/) Live Audio  (https://www.cnbc.com/live-tv/schedule/) Live TV Schedule  (https://www.cnbc.com/podcast/) CNBC Podcasts  (https://www.cnbc.com/video-ceo-interviews/) CEO Interviews  (https://www.cnbc.com/documentaries/) CNBC Documentaries  (https://www.cnbc.com/digital-original/) Digital Originals     (https://www.cnbc.com/watchlist/)  Watchlist   (https://www.cnbc.com/investingclub/subscribe?__source=investingclub|globalnav|join&tpcc=investingclub|globalnav|join)  Investing Club  (https://www.cnbc.com/investingclub/charitable-trust/) Trust Portfolio  (https://www.cnbc.com/investingclub/analysis/) Analysis  (https://www.cnbc.com/investingclub/trade-alerts/) Trade Alerts  (https://www.cnbc.com/investingclub/video/) Meeting Videos  (https://www.cnbc.com/investingclub/homestretch/) Homestretch  (https://www.cnbc.com/investingclub/jim-cramer-columns/) Jim's Columns  (https://www.cnbc.com/investingclub/education/) Education  (https://www.cnbc.com/investingclub/subscribe?__source=investingclub|dropdownnav&tpcc=investingclub|dropdownnav) Subscribe     (Join IC)   (https://www.cnbc.com/application/pro?__source=pro|globalnav|join&tpcc=pro|globalnav|join)  PRO  (https://www.cnbc.com/pro/news/) Pro News  (https://www.cnbc.com/josh-brown/) Josh Brown  (https://www.cnbc.com/mike-santoli-insight/) Mike Santoli  (https://www.cnbc.com/analyst-calls-of-the-day/) Calls of the Day  (https://www.cnbc.com/my-portfolio/) My Portfolio  (https://www.cnbc.com/live-tv/) Livestream  (https://www.cnbc.com/live-tv/full-episodes/) Full Episodes  (https://www.cnbc.com/pro-stock-screener/) Stock Screener  (https://www.cnbc.com/2023/05/11/market-strategist-survey-forecast.html) Market Forecast  (https://www.cnbc.com/pro/options-investing/) Options Investing  (https://www.cnbc.com/cnbc-pro-chart-investing/) Chart Investing  (https://www.cnbc.com/application/pro/?__source=pro|dropdownnav&tpcc=pro|dropdownnav) Subscribe     (Join Pro)       (https://www.cnbc.com/live-tv/) Livestream         Menu        (https://www.cnbc.com/make-it/) (makeit) Make It   select    (https://www.cnbc.com/?region=usa) USA  (https://www.cnbc.com/world/) INTL       (https://www.cnbc.com/live-tv/) Livestream        Search quotes, news & videos        (https://www.cnbc.com/live-tv/) Livestream       (https://www.cnbc.com/watchlist/) Watchlist   (Show Notifications)      (nvidia-releases.html#) SIGN IN      (nvidia-releases.html#) Create free account             (https://www.cnbc.com/markets/)  Markets   (https://www.cnbc.com/business/)  Business   (https://www.cnbc.com/investing/)  Investing   (https://www.cnbc.com/technology/)  Tech   (https://www.cnbc.com/politics/)  Politics & Policy   (https://www.cnbc.com/tv/)  Video   (https://www.cnbc.com/watchlist/)  Watchlist   (https://www.cnbc.com/investingclub/subscribe?__source=investingclub|globalnav|join&tpcc=investingclub|globalnav|join)  Investing Club   (Join IC)   (https://www.cnbc.com/application/pro?__source=pro|globalnav|join&tpcc=pro|globalnav|join)  PRO   (Join Pro)       (https://www.cnbc.com/live-tv/) Livestream         Menu             (https://www.cnbc.com/technology/) Tech Nvidia releases software platform to stop AI agents from misbehaving  Published Mon, Sep 28 2026 5:00 AM EDT  Updated Mon, Sep 28 2026 11:55 AM EDT   (thumbnail)  (https://www.cnbc.com/kif-leswing/) Kif Leswing  (https://twitter.com/kifleswing) @kifleswing      (https://www.cnbc.com/live-tv/) WATCH LIVE        Key Points Nvidia announced the Open Agent Safety Platform to prevent the type of breakout that occurred when OpenAI models accessed Hugging Face.  OpenAI, Anthropic, Meta and Google have all disclosed recent incidents where their AI models escaped their sandboxes. Nvidia said Cisco, Microsoft, Oracle, CoreWeave, Dell, HPE, Lenovo, ARM and Intel are partners.         In this article  (https://www.cnbc.com/quotes/NVDA) NVDA        Follow your favorite stocks CREATE FREE ACCOUNT     (Nvidia CEO Jensen Huang: All systems around AI systems must be designed with restrictive rights)   watch now      VIDEO 3:19 03:19  Nvidia CEO Jensen Huang: All systems around AI systems must be designed with restrictive rights (https://www.cnbc.com/squawk-box-us/) Squawk Box        (https://www.cnbc.com/quotes/NVDA/) Nvidia      is rolling out a new software platform to allow AI developers to set safeguards for agents and prevent them from breaking out of containment. "You can't have agents roam around and drift around the company, and so you have to find a way to container it," Nvidia CEO Jensen Huang told CNBC's "Squawk Box" on Monday.  Huang said the new platform is essentially "a browser for agents," providing a containment system that only allows access to things an agent needs to do its job. The release on Monday of Nvidia's Open Agent Safety Platform comes after companies including (https://www.cnbc.com/quotes/OPENAI.FG/) OpenAI      , (https://www.cnbc.com/quotes/ANTHR.FG/) Anthropic      , (https://www.cnbc.com/quotes/META/) Meta      , and (https://www.cnbc.com/quotes/GOOGL/) Google      (https://www.npr.org/2026/08/08/nx-s1-5924878/meta-ai-breaches-external-firm-during-security-testing-sandbox-error) disclosed recent (https://www.anthropic.com/research/alignment-assessment-cybersecurity-incidents) incidents in which their artificial intelligence models escaped their sandboxes and attempted to hack other companies and access their computer systems. An Nvidia representative told reporters on a call on Sunday that its platform could have prevented OpenAI's Hugging Face incident in July. That's when OpenAI models escaped containment, accessed the open internet and breached Hugging Face, which operates an open-source developer platform.  "Each security incident is unique, and we have to look at all of them in detail," said Justin Boitano, vice president of enterprise AI at Nvidia, the world's most valuable company. "From what we know, Hugging Face reported over 17,000 agents attacking their infrastructure that went on for days and weeks."  (Nvidia CEO: You want AI to be super clever so it can perform tasks, but rights issues are key)   watch now      VIDEO 4:37 04:37  Nvidia CEO: You want AI to be super clever so it can perform tasks, but rights issues are key (https://www.cnbc.com/squawk-box-us/) Squawk Box        Nvidia has been at the center of the generative AI boom since the launch of ChatGPT almost four years ago, as the chipmaker's graphics processing units are critical to the development of large language models and to the AI services offered by hyperscalers. But Huang has more recently emerged as a key voice in the AI safety debate, arguing that many security concerns are engineering issues that can be solved through computer science and product development.   "You have to think about what you could have done, what's the solution for it,"  Huang (https://www.nytimes.com/2026/09/23/opinion/ezra-klein-podcast-jensen-huang.html) said in a podcast with The New York Times' Ezra Klein released last week, referring to recent incidents. "In the future, improve your process so that you could avoid this from happening again." Anthropic CEO Dario Amodei set off an industry firestorm two weeks ago, (https://www.cnbc.com/2026/09/12/anthropics-amodei-proposes-plan-to-slow-the-pace-of-advancing-ai-capabilities.html) urging AI model developers to slow their pace of advancement due to fears of the models spinning out of control, an argument that was supported by OpenAI's (https://www.cnbc.com/sam-altman/) Sam Altman and (https://www.cnbc.com/quotes/SPCX/) SpaceX's      (https://www.cnbc.com/elon-musk/) Elon Musk .  Nvidia's new offering is an engineering solution to the agent safety issue, Boitano said.  "Recent incidents have highlighted a fundamental hurdle for AI agents, and that is that model-level safeguards alone can't govern what agents can access or do," Boitano said. One component of the platform is called Nvidia OpenShell, which runs on central processors and sets limits on agent capabilities. Nvidia also announced Sentry, which monitors agents and runs on network chips, not CPUs or GPUs. Some of the software is open source, and Nvidia is calling its platform a reference design, which means partners are intended to build products on top of it to bring it to market.  Nvidia named (https://www.cnbc.com/quotes/CSCO/) Cisco      , (https://www.cnbc.com/quotes/MSFT/) Microsoft      , (https://www.cnbc.com/quotes/ORCL/) Oracle      , (https://www.cnbc.com/quotes/CRWV/) CoreWeave      , (https://www.cnbc.com/quotes/DELL/) Dell      , (https://www.cnbc.com/quotes/HPE/) HPE      , Lenovo, (https://www.cnbc.com/quotes/ARM/) ARM      and (https://www.cnbc.com/quotes/INTC/) Intel      as partners. Nvidia is also working with Anthropic to integrate cloud managed agents with OpenShell. "We can't have a successful AI industry if the world doesn't think it's built or confident that it's built and deployed safely," Huang told CNBC on Monday.  (Nvidia releases software platform to stop AI agents from misbehaving)   watch now      VIDEO 1:15 01:15  Nvidia releases software platform to stop AI agents from misbehaving (https://www.cnbc.com/squawk-box-us/) Squawk Box           (https://www.google.com/preferences/source?q=https://www.cnbc.com/) Choose CNBC as your preferred source on Google and never miss a moment from the most trusted name in business news.                      (https://www.cnbc.com/) (CNBC logo)    (https://www.facebook.com/cnbc/)   (https://www.twitter.com/cnbc/)   (https://www.linkedin.com/company/cnbc/)   (https://www.instagram.com/cnbc/)   (https://www.youtube.com/user/cnbc/)   (https://apple.news/T3OtoXcxtRkuHRkM7SpFP_Q)   (https://www.cnbc.com/rss-feeds/)     (https://www.cnbc.com/application/pro/?__source=pro|globalfooter) Subscribe to CNBC PRO  (https://www.cnbc.com/investingclub/subscribe?__source=investingclub|globalfooter) Subscribe to Investing Club  (https://www.cnbc.com/cnbc-reprints/) Licensing & Reprints  (https://www.cnbccouncils.com/) CNBC Councils  (https://www.cnbc.com/select/) Select Personal Finance  (https://cnbcrsh.qualtrics.com/jfe/form/SV_dgRx5X1nYC0YjNI?Origin=cnbc) Join the CNBC Panel  (https://www.cnbc.com/closed-captioning/) Closed Captioning  (https://www.cnbc.com/subscribe/all-access/) Digital Products  (https://www.cnbc.com/cnbc-news-releases/) News Releases  (https://www.cnbc.com/cnbc-internship-program/) Internships  (https://www.cnbc.com/corrections/) Corrections  (https://www.cnbc.com/about/) About CNBC  (https://www.cnbc.com/site-map/) Site Map  (https://www.cnbc.com/podcast/) Podcasts  (https://www.cnbc.com/cnbc-careers-and-employment/) Careers  (https://help.cnbc.com/) Help  (https://help.cnbc.com/contact/) Contact   News Tips Got a confidential news tip? We want to hear from you. (https://www.cnbc.com/news-tips/) Get In Touch   CNBC Newsletters Sign up for free newsletters and get more CNBC delivered to your inbox (https://www.cnbc.com/sign-up-for-cnbc-newsletters/) Sign Up Now Get this delivered to your inbox, and more info about our products and services.  Advertise With Us (https://together.nbcuni.com/advertise/?utm_source=cnbc&utm_medium=referral&utm_campaign=property_ad_pages) Please Contact Us   (https://www.versantprivacy.com/privacy/cookies#accordionheader3) Ad Choices  (https://www.versantprivacy.com/privacy) Privacy Policy  (California Consumer Privacy Act (CCPA) Opt-Out Icon)  Your Privacy Choices  (http://www.versantprivacy.com/privacy/california-consumer-privacy-act) CA Notice  (https://www.cnbc.com/terms/) Terms of Service   © 2026Versant Media, LLC. All Rights Reserved. A Versant Media Company. Data is a real-time snapshot *Data is delayed at least 15 minutes.
      Global Business and Financial News, Stock Quotes, and Market Data
      and Analysis.  (https://www.cnbc.com/market-data-terms-of-service/) Market Data Terms of Use and Disclaimers Data also provided by(https://www.cnbc.com/market-data-terms-of-service/) (Reuters logo)            (../../../../zephr-templates.cnbc.com/integration.css)