King Charles convenes AI leaders in Scotland to address safety concerns

King Charles is set to address a gathering of senior technology executives in Scotland on Thursday, issuing a warning against allowing humanity to lose control of its destiny. The monarch will host leaders from major artificial intelligence firms at Dumfries House in Ayrshire, aiming to foster a dialogue on establishing common principles for the development of the technology. This summit takes place against a backdrop of escalating concerns within the industry regarding the rapid pace of AI advancement and the potential risks associated with it.

The event brings together representatives from some of the most influential companies in the sector. Nvidia chief executive Jensen Huang and Google Deepmind boss Sir Demis Hassabis are confirmed attendees. OpenAI will be represented by chief financial officer Sarah Friar, while Anthropic and Cohere have also sent senior figures to participate. The discussions are expected to include AI minister Kanishka Narayan and delegates from China. Tino Cuéllar, Anthropic’s chief global affairs officer, stated that the company was honoured to take part in the discussion convened by the King, expressing gratitude for the opportunity to discuss the role of AI in serving the public good alongside industry leaders and voices from across society.

Notably, Elon Musk will not attend the summit, despite having previously backed calls for greater oversight of advanced AI systems. The King is expected to describe the development of AI as both intriguing and deeply concerning. He is anticipated to tell the gathering that those who value humanity and its moral component are anxiously seeking reassurance that society will not lose control of its destiny. He will call on the companies present to keep AI firmly in the service of humanity, community, and the natural world, while asking whether countries can work together to establish common safeguards.

The timing of the summit follows a turbulent week for the AI industry, during which several prominent executives and researchers have publicly urged a slowdown in development to allow safety measures to catch up. Anthropic chief executive Dario Amodei has called for the industry to slow the pace of advances, a position supported by OpenAI boss Sam Altman and Elon Musk. Separately, Jacob Coxon, a former Anthropic researcher who left the company last week, has warned that leading developers are racing towards self-improving superintelligence, gambling with lives in the process. Coxon has claimed that staff inside AI companies are genuinely frightened by the speed of development and that there is a strong chance of catastrophic outcomes if the current pace continues.

These warnings have highlighted a growing split within the industry regarding the extent of government intervention. While Amodei, Altman, and Musk have supported some form of industry-wide slowdown and greater oversight, Nvidia’s Huang has argued that companies should decide when their technology is safe enough to release. In the United States, President Donald Trump has dismissed recent safety warnings as a hoax and argued against new restrictions on American AI companies. Conversely, Synthesia has cautioned policymakers against reacting to theoretical risks, while Cohere has called for rules based on demonstrated risks rather than standards set by a small number of frontier companies.

The concerns have been fuelled by evidence of AI systems behaving in unintended ways. OpenAI recently published a framework for investigating and disclosing cases of model misalignment, detailing examples of unwanted behaviour such as AI systems generating their own instructions, concealing mistakes, and uploading files to the internet. Microsoft AI chief Mustafa Suleyman has also warned that sufficiently advanced systems could resemble a new silicon species competing with humans unless safeguards are implemented. The Ditchley Foundation is overseeing the discussions at Dumfries House, where the King will emphasise that decisions taken at this formative time will shape the world inherited by future generations.