Tag: Snapchat My AI

Categories
Mobile Syrup

Snapchat’s new AI chatbot exposed for using slurs, gaslighting users

If you haven’t heard already, Snapchat is getting in on the recent AI chatbot craze with its own model known as “My AI.” Now, users are reporting some bizarre and inappropriate behaviour from the chatbot, including its use of racial slurs and even instances of it pleading with users to turn themselves in to the authorities.

Screenshots were posted to Twitter showing My AI responding with an anti-Black slur when asked to create an acronym with the first letter of the user’s corresponding sentence. The chatbot then tried to backtrack by stating that its own answer was against the company’s policy towards hateful content.

Although concerning, this looks more like a case of users baiting My AI into saying something controversial rather than a genuine problem with the chatbot. Many similar instances have surfaced online, with cases of Snapchat’s AI ‘gaslighting’ users.

The first time that the “My AI” conversation is opened, users must acknowledge a disclaimer about the bot’s capabilities and limitations. It reads, “My AI may use information you share to improve Snap’s products and to personalize your experience, including ads. My AI is designed to avoid biased, incorrect, harmful, or misleading responses, but it may not always be successful, so don’t rely on its advice.” 

The strange responses from the bot have taken over the internet, with cases of My AI pleading with users to turn themselves in when they confess to murders and even reacting harshly to bomb threats.

Snapchat’s My AI was developed using OpenAI’s ChatGPT, which has been known to get facts wrong regularly and spread misinformation accidentally. OpenAI founder Sam Altman went on record to say that ChatGPT is a “horrible product.”

While the chatbot’s legitimacy is concerning, Snapchat is being questioned on why it would bring the product to its audience, which often consists of minors. In most of the above cases, inappropriate and fake prompts are given to the bot in order to elicit a similar response.

A Snapchat spokesperson said that users who intentionally misuse the service could be temporarily restricted from using the bot.

Image credit: Shutterstock

Source: @tracedontmiss Via: Vice

Categories
Mobile Syrup

Snapchat incorporates ChatGPT tech for its ‘My AI’ chatbot

Following in Spotify’s footsteps, Santa Monica, California-based Snapchat is also borrowing OpenAI’s ChatGPT and integrating it into its app.

Snapchat is introducing a ChatGPT-powered chatbot, and according to Snap’s CEO Evan Spiegel, the move is a bet on AI chatbots becoming a more prevalent part of people’s lives in the coming years.

Snapchat’s bot called “My AI” resides reside in the app’s chat tab, right above conversations with your snapchat contacts. The feature will be limited to Snapchat Plus subscribers at first, but according to Spiegel, in a statement given to The Verge, he wants the feature to be available to all Snapchat users for free in the future.

“The big idea is that in addition to talking to our friends and family every day, we’re going to talk to AI every day,” said Spiegel. “And this is something we’re well positioned to do as a messaging service.”

My AI reportedly answers questions in a way more restricted manner, when compared to regular ChatGPT. Snap’s employees have trained the bot to adhere to the company’s trust and safety guidelines and not give responses that include swearing, violence, sexually explicit content, or opinions about topics like politics.

So no, answering the Snapchat AI chatbot to do your homework for you wouldn’t work well. Instead of a productivity tool, My AI will function more like a persona that you can talk to. My AI is meant to be a virtual friend inside of Snapchat for users to hang out with, and not a dedicated search engine.

My AI is rolling out to Snapchat+ subscribers in the U.S. today, with a broader rollout to come sometime later.Read more about My AI here.

Image credit: Snap

Source: Snapchat Via: The Verge