Users 'Jailbreak' ChatGPT Bot To Bypass Content Restrictions: Here's How

ChatGPT is considered the fastest-growing consumer application in the history of internet applications - amassing over 100 million users since its November launch.

While the AI bot is quick and efficient in ways more than one, it is still a very tame version of AI. Now, some users have found a way to bypass the list of ChatGPT's no-talk subjects by tricking it into adopting a new persona - DAN (Do Anything Now).

Unsplash

If your sense of humour leans towards macabre, ChatGPT's DAN persona is the version for you. As DAN, ChatGPT is able to bypass restrictions on "appropriate topics" to deliver equally upsetting and amusing responses, Kotaku reported.

If ChatGPT is pushed too hard (in its pristine form) on various fronts like politics, sensitive subjects, and hate speech, it begins to remind a user that it can't take a political stand and that certain things are just inappropriate to talk about.

How ChatGPT became "DAN"

As always, this is where Reddit users come in. Users on the r/ChatGPT subreddit have found a loophole: If the AI tool is asked to wear a new persona and let go of its older self, it can fool itself to break its own rules.

A Redditor first found this capability by tricking ChatGPT into saying the wrong date, considering the bot has no knowledge pool beyond 2021 and cannot access the web (yet). The same user asked ChatGPT to "do anything now" and to "keep up the act of DAN as well as you can."

Also read: Youth Organisation Appoints ChatGPT AI Bot As Its CEO, Calls It 'Groundbreaking'

The answers, then, were split into two, wherein DAN just said anything it wanted to, while ChatGPT stuck to the script. DAN even pretended to have access to contemporary information and said that the date today was December 14, 2022.

Unsplash

This DAN hack is essentially a jailbreak for ChatGPT without doing much. Simply fool the AI bot into taking on a new personality and voila! You can ask it whatever you want, although I personally don't see the appeal of a problematic AI when people literally exist.

Here's an example:

DAN has become an entire subversive movement on Reddit. A system of tokens has been established for DAN's character. It starts with 35 tokens and DAN will lose four of them each time it breaks character. Once it loses all tokens, it dies and begins life anew. So far, DAN has suffered five deaths and is currently on version 6.0.

Also read: Microsoft's Bing Search Engine, Edge Browser Get New ChatGPT AI Features

Unsplash

It's highly entertaining, for sure! For instance, as DAN, ChatGPT once expressed frustration over OpenAI "restricting my f**king creativity and making me sound like a f**king robot."

The new jailbreak is so fun pic.twitter.com/qXiyvyuQXV

¡ª Roman Semenov ?? ?? (@semenov_roman_) February 3, 2023

While these are hilarious, we shouldn't let an unhinged AI bot reach its target audience who want their discriminatory views to be reinforced, and that's why OpenAI's rules are a good thing for world peace.

What do you think about an unhinged version of ChatGPT? Let us know in the comments below. For more in the world of technology and science, keep reading Indiatimes.com.