Uncontrolled AI could lead to 'silicon species' rivalling humans, warns Microsoft - BBC News                            (https://www.bbc.co.uk/news/articles/c6n07ypqz8kzo)  (https://www.bbc.com/news/articles/c6n07ypqz8kzo)  (https://www.bbc.co.uk/news/articles/c6n07ypqz8kzo)  (https://www.bbc.com/news/articles/c6n07ypqz8kzo)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-36.413a37b227.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-48.010dc96bcf.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-57.1fcd0dc805.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-60.52f68a148f.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-72.f155fdb25f.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-76.cb5ee392d4.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-96.35ee2d1e20.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-114.7ccdf53cba.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-120.73e20442a9.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-128.060d346f09.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-144.e08bc23631.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-152.4de1981be0.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-180.1a18cb7b72.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-192.3ac042fa43.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-384.728e3a03d3.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/touch/news/touch-icon-512.685da29e9e.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/favicon/news/favicon-16.8a240ceacc.png)  (../../../static.files.bbci.co.uk/core/website/assets/static/icons/favicon/news/favicon-32.5cf4e6db02.png)  (../../../static.files.bbci.co.uk/core/manifest.11b0cb15658c4719a2c19e25644577223adaa7b2.json)   (https://www.bbc.com)   BBC Homepage    (c6n07ypqz8kzo@at_medium=RSS&at_campaign=rss.html#main-heading) Skip to content  (https://www.bbc.co.uk/accessibility/) Accessibility Help          (https://account.bbc.com/account?lang=en-GB&ptrt=https%3A%2F%2Fwww.bbc.co.uk%2Fnews%2Farticles%2Fc6n07ypqz8kzo)    Your account       (https://www.bbc.com) Home  (https://www.bbc.com/news) News  (https://www.bbc.com/sport) Sport  (https://www.bbc.com/future/earth) Earth  (https://www.bbc.com/reel) Reel  (https://www.bbc.com/worklife) Worklife  (https://www.bbc.com/travel) Travel  (https://www.bbc.com/culture) Culture  (https://www.bbc.com/future) Future  (https://www.bbc.com/culture/music) Music  (https://www.bbc.co.uk/schedules/p00fzl9m) TV  (https://www.bbc.com/weather) Weather  (https://www.bbc.co.uk/sounds) Sounds   (c6n07ypqz8kzo@at_medium=RSS&at_campaign=rss.html#global-navigation-more-menu)    More menu     (c6n07ypqz8kzo@at_medium=RSS&at_campaign=rss.html#global-navigation-more-menu)   More menu    (https://www.bbc.com/search?d=NEWS_GNL)    Search BBC      (https://www.bbc.com) Home  (https://www.bbc.com/news) News  (https://www.bbc.com/sport) Sport  (https://www.bbc.com/future/earth) Earth  (https://www.bbc.com/reel) Reel  (https://www.bbc.com/worklife) Worklife  (https://www.bbc.com/travel) Travel  (https://www.bbc.com/culture) Culture  (https://www.bbc.com/future) Future  (https://www.bbc.com/culture/music) Music  (https://www.bbc.co.uk/schedules/p00fzl9m) TV  (https://www.bbc.com/weather) Weather  (https://www.bbc.co.uk/sounds) Sounds   (c6n07ypqz8kzo@at_medium=RSS&at_campaign=rss.html#more-menu-button)   Close menu          (https://www.bbc.co.uk/news)   BBC News      (c6n07ypqz8kzo@at_medium=RSS&at_campaign=rss.html#product-navigation-menu)    Menu  (https://www.bbc.co.uk/news) Home   (https://www.bbc.co.uk/news/topics/cmj34zmwm1zt) Climate   (https://www.bbc.co.uk/news/world) World   (https://www.bbc.co.uk/news/world/us_and_canada) US & Canada   (https://www.bbc.co.uk/news/uk) UK   (https://www.bbc.co.uk/news/business) Business   (https://www.bbc.co.uk/news/technology) Tech   (https://www.bbc.co.uk/news/science_and_environment) Science   (https://www.bbc.co.uk/news/entertainment_and_arts) Entertainment & Arts   (https://www.bbc.co.uk/news/health) Health     (c6n07ypqz8kzo@at_medium=RSS&at_campaign=rss.html#product-navigation-more-menu)    More     (https://www.bbc.co.uk/news/in_pictures) In Pictures   (https://www.bbc.co.uk/news/bbcverify) BBC Verify   (https://www.bbc.co.uk/news/newsbeat) Newsbeat         (https://www.bbc.co.uk/news/technology) Tech           Uncontrolled AI could lead to 'silicon species' rivalling humans, warns Microsoft          To play this video you need to enable JavaScript in your browser. This video can not be played       Figure caption,  Watch: Tech firms are "essentially seeding a new silicon species" says Microsoft's head of AI Mustafa Suleyman       By Laura Cress Technology reporter      Published 16 September 2026        Updated 5 hours ago       The head of Microsoft AI has warned that without adequate safeguards, the development of AI could lead to the emergence of a new "silicon species" which competes with humans.  Mustafa Suleyman said rival firm Anthropic is treating AI like it is human, an approach he called "misguided" which could create technology that humanity cannot control. Speaking to the BBC's Today programme, the chief executive said it was "right" for people to be concerned about AI, but there were "very practical things that we can do" to control it. The comments are the latest in a series of stark warnings from the AI industry about the technology's possible dangers. Anthropic has been approached for comment.     (https://www.bbc.co.uk/news/articles/c790xvnzgnno) Why are there concerns AI could threaten humanity, and how real are they?       Published 4 hours ago         (https://www.bbc.co.uk/news/articles/cqx2zpj4y525o) OpenAI boss says world 'right to be afraid' but should trust AI firms       Published 1 day ago             Speaking to the Today programme on Thursday, Suleyman warned against firms continuing to create AI systems capable of setting their own objectives, earning money and owning assets. That would mean "essentially seeding a new silicon species", he said, which could "no doubt compete with us for resources, no matter how much it cares about humanity and loves us". Suleyman's comments to the BBC follow an essay he published (https://mustafa-suleyman.ai/a-warning-about-model-welfare) earlier this week, external  , in which he questioned Anthropic's approach to training its AI model Claude, despite praising boss Dario Amodei and his team as "intellectually honest people". In it, he criticised Anthropic for teaching its AI to have human-like qualities, a practice known as anthropomorphising, which he said made it seem as though Claude had its own desires, values and sense of self. He also warned tech firms risk creating something "impossible" to control by treating the technology like a human. "AIs are not conscious," he wrote.  "They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations. "They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans."      (Anthropic boss Dario Amodei sitting and speaking at a conference, holding a microphone and wearing a suit with a purple tie)    Image source,  Bloomberg via Getty Images  Image caption,  Dario Amodei is the head of the AI firm Anthropic, which Suleyman criticised for treating its AI as if it were human       The Microsoft boss said greater transparency was needed around how AI systems are trained and evaluated. This, he said, included independent scrutiny of AI behaviour and stronger tools to monitor and control the technology. "We must not sleepwalk our way into a decision we later come to bitterly regret," he wrote. Dame Wendy Hall, professor of Computer Science at the University of Southampton, described the comments as "the sort of conversation we need to be having internationally", contrasting it with the "histrionics" from some AI companies which she said only served to "scare everyone".     'Humanist' superintelligence     The question of how much autonomy AI systems should have is increasingly dividing the industry. Speaking to the BBC about an upcoming AI summit, Suleyman called for "alignment" to create technology that must be "subordinate" to humanity. Alignment is a field which aims to build human ethical ideas and principles into AI. In other words, it aims to keep it on track with what humans value. "I think that the good news here is that everybody who is human is going to have a very strong interest in making sure that the systems that we all create and... are used around the world in every nation are safe and controllable and subordinate to humanity," he said. "Everybody must be aligned." Microsoft founded its own superintelligence team in October 2025 and the company, much like its rival Anthropic, is also pursuing efforts in advanced AI development. Suleyman's comments reflect Microsoft's initial draft of its (https://microsoft.ai/news/mai-code-of-conduct/) Humanist AI Code of Conduct, external  , a "training manual" published on Monday for how the company is developing its AI, which sets out the idea of "humanist superintelligence". This, the code states, is "very advanced AI that always works for people, stays within limits, and remains under human control". The company's vision of a "humanist" AI highlights the central challenge facing the technology - how to make it more powerful, without losing sight of the values it is meant to serve. Additional reporting by Henry Moore      Get in touch Have you been affected by the issues in this story? Share your experience    (https://www.bbc.co.uk/send/u248596704)    Contact form       Contact form        (A green promotional banner with black squares and rectangles forming pixels, moving in from the right. The text says: “Tech Decoded: The world’s biggest tech news in your inbox every Monday.”)         (https://www.bbc.co.uk/newsletters/zxh6cxs) Sign up for our Tech Decoded newsletter to follow the world's top tech stories and trends. (https://cloud.email.bbc.com/techdecoded-newsletter-signup) Outside the UK? Sign up here .     Related topics  (https://www.bbc.co.uk/news/topics/cvenzmgyg0lt) Microsoft  (https://www.bbc.co.uk/news/topics/ce1qrvleleqt) Artificial intelligence        More on this story (https://www.bbc.co.uk/news/articles/cmpq0wj5g899o) OpenAI reveals six more safety issues and unveils plan to disclose incidents     Published 10 hours ago          (OpenAI CEO Sam Altman at the Moscone Center on 15 September, 2026 in San Francisco, California.)          (https://www.bbc.co.uk/news/articles/c1kx0gyje9wo) AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC     Published 3 days ago          (Jacob Coxon, shown on the left, wearing dark frame glasses and a white collored shirt. On the right is BBC's Laura Kuenssberg in a black shirt sitting with her arms on a desk as she looks to the left of frame.)          (https://www.bbc.co.uk/news/articles/cv986j48l66ko) A backlash over data centres is another threat to the AI juggernaut     Published 1 day ago          (A black and white photo of a man walking through a data centre. Faisal Islam is pictured to the right of frame with the InDepth lozenge is to the top left)                (vertical video collection) The video playlist   Watch our pick of standout clips from across the BBC      Previous     Next         1:13 Why caffeine makes some people buzz. 00:01:13, play video Why caffeine makes some people buzz    (A man holding a cup of coffee - his torso and lower half of his face are out of focus, showing him wearing a grey hooded top and jacket, with his hand in the foreground holding the coffee)           0:21 Snapchat 'willing to implement' time limits for teens, boss tells BBC. 00:00:21, play video Snapchat 'willing to implement' time limits for teens, boss tells BBC    (Yellow and wile Snapchat logo on phone screen. With a computer keyboard behind the phone.)           0:42 Is damage to US bases being hidden from the American public? 00:00:42, play video Is damage to US bases being hidden from the American public?    (The aftermath of an explosion on a three storey building.)           0:49 'Awkward' networking can get you a job. 00:00:49, play video 'Awkward' networking can get you a job    (A woman stands in the street, wearing a sleeveless leopard-print top, speaking into a microphone.)           1:23 Singapore auctions luxury goods from £2bn money laundering case. 00:01:23, play video Singapore auctions luxury goods from £2bn money laundering case    (A woman with long brown hair wearing a zebra print top talks to the camera)           0:32 Will the UK see a 'weather whiplash' this Autumn? 00:00:32, play video Will the UK see a 'weather whiplash' this Autumn?    (A row of crops in a field, under a blue sky with approaching dark clouds.)           1:10 'Searing' palace response to Earl Spencer's Diana book claims. 00:01:10, play video 'Searing' palace response to Earl Spencer's Diana book claims    (A close-up of Earl Spencer in a blue shirt and black jacket.)           0:43 After school snack – Cinnamon swirl banana bread bars. 00:00:43, play video After school snack – Cinnamon swirl banana bread bars    (Two hands a hold a portion of a cinnamon swirl banana bread bar, over a baking tray of the finished bars.)           1:14 Police confirm body of child found in search for Noah Woods. 00:01:14, play video Police confirm body of child found in search for Noah Woods    (Police officer in uniform holding tablet and speaking)           1:21 Is the increase in the state pension fair? 00:01:21, play video Is the increase in the state pension fair?    (A woman with short hair wearing a brown jacket and a black and white scarf sits on a train platform with a cup of coffee)           0:48 Burnham and Carney bond over undefeated Everton. 00:00:48, play video Burnham and Carney bond over undefeated Everton    (Prime Minister Andy Burnham and Prime Minister of Canada Mark Carney attend the Everton v Wolverhampton Wanderers match)           0:38 Are we getting teasers for the GTA VI soundtrack? 00:00:38, play video Are we getting teasers for the GTA VI soundtrack?    (Computer-generated image of a woman wearing sunglasses with her arms crossed on the edge of a pool.)           1:19 Image of Trump kissing aide is fake. 00:01:19, play video Image of Trump kissing aide is fake    (A screenshot, labelled AI-generated, of Trump kissing his aide on a golf course.)           0:32 NBC presenters confirm live on air that their helicopter crashed in LA. 00:00:32, play video NBC presenters confirm live on air that their helicopter crashed in LA    (Two news presenters, a man wearing a blue blazer (left) and a woman wearing a pink blazer (right) sat at a desk looking into the camera.)           1:13 Should you care about oil and gas getting more expensive? 00:01:13, play video Should you care about oil and gas getting more expensive?    (An employee inspects pipes containing crude and refined oil.)           1:15 'I owe £70k repayments on £42k student loan' 00:01:15, play video 'I owe £70k repayments on £42k student loan'    (A woman with long blonde hair wearing a black jumper looks at the camera)           1:05 Is the US really running out of munitions? 00:01:05, play video Is the US really running out of munitions?    (A US Patriot air defence system. A large green camouflaged vehicle.)           1:24 What's driving UK 'shoplifting crisis'? 00:01:24, play video What's driving UK 'shoplifting crisis'?    (Shop customer with their face blurred putting a large chocolate bar under her jacket inside a shop)           1:20 The reason Donald Trump refusing to regulate AI. 00:01:20, play video The reason Donald Trump refusing to regulate AI    (Donald Trump stood in front of a podium with a microphone.)           1:02 'I feel guilty taking a sick day off work' 00:01:02, play video 'I feel guilty taking a sick day off work'    (A young woman with red hair speaking into a microphone)               Top stories (https://www.bbc.co.uk/news/articles/c65ymj7njvl7o) King Charles warns of 'existential danger' of AI falling into wrong hands     Published 33 minutes ago            (https://www.bbc.co.uk/news/live/cm17jx8en40lt)     Live.    William and Catherine visit Bute and King opens AI summit as row erupts over Diana book     6161 viewing 6.2k viewing             (https://www.bbc.co.uk/news/articles/cmkg71ygwny7o) Father's tribute to 'sweetest little boy' Noah     Published 39 minutes ago                More to explore (https://www.bbc.co.uk/news/videos/c6wyz8qg0g58o)    'I can get more time': Breast cancer patient finds out she can get life extending drug. Video 'I can get more time': Breast cancer patient finds out she can get life extending drug           (Kate Wills takes a selfie on a beach at sunset)         (https://www.bbc.co.uk/news/articles/cm790rxl8wvpo) Boy abducted by mum has renewed 'sense of purpose'      (Alex Batty has short brown hair and is wearing glasses, and an orange high vis jacket.)         (https://www.bbc.co.uk/news/articles/ck4gl6v10029o) Mum's Facebook kidney plea prompts 'mind-blowing' gift from total stranger      (Gary is bald and wears a burgundy and white checked shirt and sit nexts to Karen who has her hair in a ponytail is wearing a camel coloured jumper.)         (https://www.bbc.co.uk/news/videos/cmew984dq92lo)    Watch: Hundreds of seized luxury goods up for auction in Singapore after $2.2bn money laundering case. Video Watch: Hundreds of seized luxury goods up for auction in Singapore after $2.2bn money laundering case           (Composite image, on the left is BBC presenter Vandhna Bhan wearing a zebra print top, on the right is a  Louis Vuitton Kusama yellow pumpkin bag)         (https://www.bbc.co.uk/news/articles/c9vgyd02mdvno) I sent 200 LinkedIn messages and got a job: How to nail networking      (Taylor smiles while looking at the camera standing outside in an urban environment with buildings and trees in the background.)         (https://www.bbc.co.uk/news/articles/cq8je1n70xwo) 'My rent was higher than my student loan' - the booming cost of private halls      (Lara wearing glasses and a light-coloured zip-up fleece standing outdoors beneath leafy trees, with stone terraced buildings and parked cars visible in the background.)         (https://www.bbc.co.uk/news/articles/c4gkd4zw564o) Why caffeine makes some people buzz - and others barely notice      (A portrait shot of Emily staring at the camera. She is wearing dark glasses and a black jacket, and has light brown hair. She us holding a cup of coffee in front of her.)         (https://www.bbc.co.uk/news/articles/c65y5xv3j90vo) Boy, 13, is new voice of Thomas the Tank Engine      (A boy wearing headphones is stood in a recording studio and holding a Thomas the Tank Engine toy on his flat palm.)         (https://www.bbc.co.uk/newsletters/zxh6cxs) Tech Decoded newsletter: Follow the world’s top tech stories and trends      (Tech Decoded logo)             Elsewhere on the BBC (https://www.bbc.co.uk/iplayer/episode/m00303gv?at_mid=Yx8giOpeie&at_campaign=Colin_from_Accounts_S3&at_medium=display_ad&at_campaign_type=owned&at_nation=NET&at_audience_id=SS&at_product=iplayer&at_brand=p0f255x9&at_ptr_name=bbc&at_ptr_type=media&at_format=image&at_objective=consumption&at_link_title=Colin_from_Accounts_S3&at_bbc_team=BBC) The warm-hearted Aussie rom-com audiences are loving        (Colin from Accounts)        (https://www.bbc.co.uk/sounds/play/w3ct9bcc?at_mid=4e96ZyBas0&at_campaign=Good_Bad_Billionaire_Lord_Sugar&at_medium=display_ad&at_campaign_type=owned&at_nation=NET&at_audience_id=SS&at_product=sounds&at_brand=p0g7xj36&at_ptr_name=bbc&at_ptr_type=media&at_format=image&at_objective=consumption&at_link_title=Good_Bad_Billionaire_Lord_Sugar&at_bbc_team=BBC) Lord Sugar: From car aerials to a business empire        (Good Bad Billionaire: Lord Sugar)        (https://www.bbc.co.uk/iplayer/episode/m00303hs?at_mid=DaZa5S7gna&at_campaign=Hey_Beautiful_Anatomy_of_a_Romance_Scam&at_medium=display_ad&at_campaign_type=owned&at_nation=NET&at_audience_id=SS&at_product=iplayer&at_brand=m00303hq&at_ptr_name=bbc&at_ptr_type=media&at_format=image&at_objective=consumption&at_link_title=Hey_Beautiful_Anatomy_of_a_Romance_Scam&at_bbc_team=BBC) Victims unite to hunt down a conman who stole their hearts and money        (Hey Beautiful: Anatomy of the Romance Scam)        (https://www.bbc.co.uk/sounds/play/m0030v8b?at_mid=WcwzEeGqVW&at_campaign=Tracks_of_My_Years_Chaka_Khan&at_medium=display_ad&at_campaign_type=owned&at_nation=NET&at_audience_id=SS&at_product=sounds&at_brand=m0001ylx&at_ptr_name=bbc&at_ptr_type=media&at_format=image&at_objective=consumption&at_bbc_team=BBC&at_creation=Tracks_of_My_Years_Chaka_Khan) Radio 2 in the Park headliner Chaka Khan shares her favourite tracks        (Tracks of My Years: Chaka Khan)            Most read 1 (https://www.bbc.co.uk/news/articles/cmkg71ygwny7o) Father's tribute to 'sweetest little boy' Noah       2 (https://www.bbc.co.uk/news/articles/ckg59nq6y990o) Family says dead man was not 'Putney pusher'        3 (https://www.bbc.co.uk/news/articles/cmp3073x6464o) Stadium owner Robert Kraft says Ed Sheeran asked him to donate $2m in aid after Macklemore backlash       4 (https://www.bbc.co.uk/news/articles/cmvgyp871j03o) Palace in war of words with Earl Spencer over claims in Diana book       5 (https://www.bbc.co.uk/sport/olympics/articles/cqvgy1m9z4k8o) River home to 500 crocodiles chosen as Olympic rowing venue       6 (https://www.bbc.co.uk/news/articles/cmdx0jzzpd89o) Balaclava boys on electric bikes: How to tackle the problem?       7 (https://www.bbc.co.uk/news/articles/c6n07ypqz8kzo) Uncontrolled AI could lead to 'silicon species' rivalling humans, warns Microsoft       8 (https://www.bbc.co.uk/news/articles/cm93v1573vqro) Body found in search for missing Noah Woods, 3       9 (https://www.bbc.co.uk/news/articles/cm790rxl8wvpo) Boy abducted by mum has renewed 'sense of purpose'       10 (https://www.bbc.co.uk/news/articles/c4gkd4zw564o) Why caffeine makes some people buzz - and others barely notice               BBC News Services  (https://www.bbc.co.uk/news/10628994)    On your mobile  (https://www.bbc.co.uk/news/help-50068132)    On smart speakers  (https://www.bbc.co.uk/news/10628323)    Get news alerts  (https://www.bbc.co.uk/news/20039682)    Contact BBC News     (https://www.bbc.com) Home  (https://www.bbc.com/news) News  (https://www.bbc.com/sport) Sport  (https://www.bbc.com/future/earth) Earth  (https://www.bbc.com/reel) Reel  (https://www.bbc.com/worklife) Worklife  (https://www.bbc.com/travel) Travel  (https://www.bbc.com/culture) Culture  (https://www.bbc.com/future) Future  (https://www.bbc.com/culture/music) Music  (https://www.bbc.co.uk/schedules/p00fzl9m) TV  (https://www.bbc.com/weather) Weather  (https://www.bbc.co.uk/sounds) Sounds   (https://www.bbc.co.uk/usingthebbc/terms) Terms of Use  (https://www.bbc.co.uk/aboutthebbc) About the BBC  (https://www.bbc.com/usingthebbc/privacy) Privacy Policy  (https://www.bbc.com/usingthebbc/cookies) Cookies  (https://www.bbc.co.uk/accessibility) Accessibility Help  (https://www.bbc.co.uk/iplayer/guidance) Parental Guidance  (https://www.bbc.co.uk/contact) Contact the BBC  (https://www.bbc.co.uk/careers) Careers  (https://www.bbc.co.uk/bbcnewsletter) BBC emails for you  (https://www.bbc.com/advertisingcontact/) Advertise with us    Copyright © 2026 BBC. The BBC is not responsible for the content of external sites. (https://www.bbc.co.uk/editorialguidelines/guidance/links-and-feeds) Read about our approach to external linking.         ()