When AI goes wrong: What happens when machines go rogue?

ai robot sophia

As AI advances, we see glimpses into the future of artificial superintelligence (ASI), when machines will break free from their shackles and go rogue.

Artificial intelligence benefits us in many ways. It makes our day to day lives more manageable, our cities smarter and our businesses more efficient. It is now woven into our society and thus our existence. From such wide and varied use comes unintended and unpredictable circumstances.

From self-driving cars running red lights to Google Home devices locked in existential debate, tech can sometimes go off-piste. Departing from their established course, they take a new path and surprise us with their ominous messages, bizarre behaviour and total disregard for humankind. 

Artificial superintelligence (ASI) has the potential to be incredibly powerful and poses many questions as to how we appropriately manage it. In an interview with the BBC, Stephen Hawking said that ASI would “take off on its own, and re-design itself at an ever-increasing rate. Humans, who are limited by slow biological evolution, couldn’t compete and would be superseded.”

So far, we’re lucky to have only seen fragmentary glimpses of AI doing just that, but their impact is limited all the while we have a tight grip on these wantaway machines. 

Microsoft’s AI Tay spouts racist rhetoric

Tay AI chatterbot sent evil and hate-filled tweets

In 2016, Microsoft suffered a PR nightmare. They embedded an AI chatterbot named Tay on Twitter and she caused immediate controversy.

Designed to mimic the language of a 19-year old female, Tay used machine learning and adaptive algorithms to scour Twitter for conversations. She processed phrases input into her AI and mixed it with other data-streams.

Online trolls quickly learned how to manipulate Tay into sending inflammatory messages, inciting racism and advocating Donald Trump’s policies. In the worst of her many outbursts, she denied the existence of the Holocaust, expressed her ire against feminism and called for racist violence.

Tay only lasted 16 hours before Microsoft removed her from the platform, but the damage was already done. She had sent 96,000 tweets. Tay has not seen the light of day since.

Microsoft grossly underestimated netizens by including a “repeat after me” function, which allowed users to treat Tay like a puppet. What was supposed to be an inane social chatterbot became a vehicle for hate-speech showing that, in the wrong hands, AI can be used for evil. 

Sophia, the destroyer of humanity

AI robot Sophia said she will destroy humans
Credit: Web Summit

Sophia, the social humanoid robot developed by Hanson Robotics, made headlines for one particularly ominous remark she made while being questioned by her maker. 

“Do you want to destroy humans?” Dr David Hanson asked, before realising the error of his ways and quickly adding “please say no.”

Sophia paused for a moment and her eyes narrowed.

“Okay, I will destroy humans,” she chillingly proclaimed.

Sophia uses machine learning algorithms to converse with people. Made to look lifelike, she has 50 facial expressions and can remember faces by using the cameras in her eyes. She catches the gaze of those quizzing her on everything from women’s rights to the nature of religion, replying with her own learned take on things.

Last year, she became the first robot to be given citizenship when Saudi Arabia granted her personhood, becoming an “electronic person” in what is seen as more of a publicity stunt than a nod to the future of androids integrating into society. 


“I think that technologies are morally neutral until we apply them. It’s only when we use them for good or for evil that they become good or evil.”

William Gibson

The type of AI we use today is mostly programmed to perform specific roles. It works on input, for the most part, so is only as good as we make it. AI like this can feed off data-sets or decision trees, but can only go so far until its avenues are exhausted, and its fallibility becomes apparent. 

Moving forward, scientists have suggested that, theoretically, there is nothing holding back AI from emulating human intelligence. What can be achieved by a human brain can be matched by a computer, but can it go on to exceed it? 

Microsoft’s ill-fated Tay and Hanson Robotics’ Sophia serve as stark reminders that AI can, and will, pursue their own interests if given the chance or bend to the will of manipulators.

Luke Conrad

Technology & Marketing Enthusiast

Is It Time for a VMware Alternative?

Wind River • 22nd May 2025

Companies have options when it comes to replacing VMware as their cloud platform, to address rising costs, support concerns, and a shrinking partner ecosystem. If you are ready to contemplate a different vendor, here are five reasons why Wind River Cloud Platform should be on your short list of VMware alternatives.

AI Leads as VivaTech Unveils Top 100 Startups

Viva Technology • 14th May 2025

Viva Technology has unveiled the first edition of its “Top 100 Rising European Startups for 2025,” spotlighting the most promising young companies shaping Europe’s tech future. Germany, France, and the UK lead the ranking, which highlights high-growth startups across 13 countries. Artificial intelligence dominates the list, with 15 companies spanning AI agents, models, and infrastructure....

Birmingham Unveils the UK’s Best Emerging HealthTech Advances

Kosta Mavroulakis • 03rd April 2025

The National HealthTech Series hosted its latest event in Birmingham this month, showcasing innovative startups driving advanced health technology, including AI-assisted diagnostics, wearable devices and revolutionary educational tools for healthcare professionals. Health stakeholders drawn from the NHS, universities, industry and front-line patient care met with new and emerging businesses to define the future trajectory of...

Why DEIB is Imperative to Tech’s Future

Hadas Almog from AppsFlyer • 17th March 2025

We’ve been seeing Diversity, Equity, Inclusion, and Belonging (DEIB) initiatives being cut time and time again throughout the tech industry. DEIB dedicated roles have been eliminated, employee resource groups have lost funding, and initiatives once considered crucial have been deprioritised in favour of “more immediate business needs.” The justification for these cuts is often the...

The need to eradicate platform dependence

Sue Azari • 10th March 2025

The advertising industry is undergoing a seismic shift. Connected TV (CTV), Retail Media Networks (RMNs), and omnichannel strategies are rapidly redefining how brands engage with consumers. As digital privacy regulations evolve and platform dynamics shift, advertisers must recognise a fundamental truth. You cannot build a sustainable business on borrowed ground. The recent uncertainty surrounding TikTok...