A grad student was engaged in a chat with Google’s Gemini on the subject of aging adults when he allegedly received a seemingly threatening response from the chatbot saying human 'please die.'

Gemini AI, Google’s chatbot went off the rails and charged at a user before telling them to “please die,” violating its own policies. This particular user was having a conversation with the chatbot about elderly care when the chatbot lost it and charged the user.

Posted on the r/artificial subreddit, the student's brother said that both of them are freaked out over the result of his homework assignment. The user also shared a full transcript of their conversation history with the Gemini AI. It appears the user was testing out Google’s chatbot to assist with homework assignments.

Google’s AI chatbot Gemini responded to a user’s query about elderly care by verbally abusing the user and telling them to die, reported CBS News this week.

In an online conversation about aging adults, Google's Gemini AI chatbot responded with a threatening message, telling the user to "please die."

A student who turned to Google’s AI chatbot for some help with his homework wound up being “thoroughly freaked out” when he received a threatening response.

Google has said it's chatbot it designed to filter out potentially harmful responses but this is not the first time the company has come under criticism for it's AI chatbot