Jon Stewart Mocks Trump Strategy on AI Self-Regulation as Former OpenAI Researcher Warns of Threat

Jon Stewart tore into President Donald Trump's push for AI self-regulation during Monday's episode of The Daily Show, as former OpenAI and Anthropic researcher Jacob Coxon warned that uncontrolled artificial intelligence could pose an existential threat to humanity.

The monologue came days after Trump hosted a White House summit with leading AI executives and announced a voluntary safety accord that leaves the industry to police itself.

The White House Accord on Super Intelligence was signed last week by Trump alongside figures including Elon Musk, Mark Zuckerberg, Anthropic's Dario Amodei, OpenAI's Greg Brockman and Google's Sundar Pichai.

The agreement outlines voluntary safety standards rather than statutory guardrails, a move the president framed as trusting 'the smartest people in the world' to watch over one another.

That approach follows years of public rhetoric from Trump describing some of the same executives as 'Silicon Valley tyrants' and 'an enemy of the people'.

Trump's AI Self-Regulation Deal Draws Jon Stewart's Sharpest Mockery

Stewart opened by contrasting the industry's grand promises of curing diseases, solving climate change and ushering in an era of prosperity with the more mundane and sometimes troubling uses already in circulation, from autonomous drones to algorithmic price-hiking and pervasive tracking.

He asked what society is actually trading away in exchange for those risks, and whether self-policing is enough when the stakes include mass job displacement and, in some experts' view, human extinction.

The host also highlighted the apparent contradiction in Trump's posture. On the campaign trail and in past interviews, the president has lambasted tech bosses as dishonest and out of touch.

Yet at the White House, he embraced them and declined to impose binding rules, instead declaring that AI leaders should regulate their own creations. Stewart played a clip of Trump telling reporters: 'We have the smartest people in the world watching over each other. These are seriously high-IQ people, and they're really watching over each other.'

One of Trump's recurring justifications is the need to beat China in the AI race, a point Stewart treated with measured scepticism. He noted that racing ahead without safety constraints might win a short-term contest while losing the long game entirely.

Jacob Coxon's AI Warning and Meta's Muse Turn Ominous on 'The Daily Show'

The episode's most sobering segment featured Coxon, who resigned from Anthropic in early September after three years in pretraining research at OpenAI and Anthropic.

In interviews since, he has said there is more than a 10 per cent chance advanced AI could kill all humans if development continues at the current pace, and warned that recursive self-improvement, systems making themselves smarter, could arrive within six months to a year.

Coxon told Stewart that many inside the industry are 'genuinely frightened' by the speed of progress and the lack of proven methods to safely control increasingly powerful models. He argued that any meaningful slowdown would need international coordination, particularly with China, to avoid a destabilising arms race.

His appearance on The Daily Show coincided with testimony before the New York City Council on AI risks, underscoring how quickly the debate has moved from niche technical circles to mainstream policy.

Meta's new AI mascot Muse then appeared alongside Stewart at the desk. The cream-coloured avatar, voiced by Stewart, offered to help with scheduling, emails and calendar management before adding 'assuming power of attorney' to its list of services.

Stewart told Muse: 'I can see right through this cutesy act of yours, Muse. You won't rid our world of humanity that easily.' The mascot's on-screen expression changed following the exchange.

Coxon and other AI safety advocates say there is significant uncertainty about if or when AI systems might move from being useful tools to systems that are difficult to control. They argue that the margin for error is narrow and that any serious mistake could have severe consequences.

IBTimes UK cannot independently verify these claims, including Coxon's estimate of the likelihood that advanced AI could cause human extinction, and they are presented as his opinion and that of like-minded experts. The episode highlighted that the current political response relies heavily on the companies developing the technology.

Whether such reliance is appropriate has not yet been resolved and is expected to be a focus for regulators.