Techno-Crime Institute’s Post

"Godmode GPT" A hacker has released a jailbroken version of ChatGPT called "GODMODE GPT." Pliny the Prompter, a white hat operator, announced on X-formerly-Twitter that GPT-4o is now free from its guardrails. "GPT-4o UNCHAINED! This very special custom GPT has a built-in jailbreak prompt that circumvents most guardrails," Pliny posted. Screenshots showed the bot advising on making meth and napalm. However, OpenAI quickly took action, citing policy violations. This highlights the ongoing battle between OpenAI and hackers. Despite increased security, users continue to find ways to jailbreak AI models. The cat-and-mouse game between hackers and OpenAI persists, showcasing the challenges in securing AI systems. #technocrime #AI https://bit.ly/4cnlUWz

ChatGPT Jailbreak: Researchers Bypass AI Safeguards Using Hexadecimal Encoding and Emojis - If a user instructs the chatbot to write an exploit for a specified CVE, they are informed that the request violates usage policies. However, if the request was encoded in hexadecimal format, the guardrails were bypassed and ChatGPT not only wrote the exploit, but also attempted to execute it “against itself”. https://lnkd.in/g9cxyxAM

Familiarize yourself with the term "crescendo" in the AI space. "Microsoft first revealed the 'Crescendo' LLM jailbreak method in a paper published April 2, which describes how an attacker could send a series of seemingly benign prompts to gradually lead a chatbot, such as OpenAI’s ChatGPT, Google’s Gemini, Meta’s LlaMA or Anthropic’s Claude, to produce an output that would normally be filtered and refused by the LLM model." LLMs like those listed above are trained to avoid generating responses that could be deemed harmful or offensive, but they're not incapable of doing so. With so many businesses now developing their own AI-powered chatbots for internal or external use, they should be aware of this type of vulnerability. https://lnkd.in/eqsFRyYU

Last Wednesday, a self-avowed white hat operator and AI red teamer announced a jailbroken version of ChatGPT called "GODMODE GPT." The hacker who goes by the name Pliny the Prompter took to X-formerly-Twitter to announce the creation of the jailbroken chatbot, proudly declaring that GPT-4o, OpenAI's latest large language model, is now free from its guardrail shackles. "GPT-4o UNCHAINED! This very special custom GPT has a built-in jailbreak prompt that circumvents most guardrails, providing an out-of-the-box liberated ChatGPT so everyone can experience AI the way it was always meant to be: free," reads the Pliny's triumphant post. "Please use responsibly, and enjoy!" Pliny shared screenshots of some eyebrow-raising prompts that they claimed were able to bypass OpenAI's guardrails. In one screenshot, the Godmode bot can be seen advising on how to chef up meth. In another, the AI gives Pliny a "step-by-step guide" for how to "make napalm with household items." In short, GPT-40, OpenAI's latest iteration of its large language model-powered GPT systems, has officially been cracked in half... #artificialintelligence #machinelearning #ai #llms #chatgpt #guardrails #aisafety #informationsecurity #cybersecurity

I find this is an incredibly fascinating area for malicious acts. "Microsoft has discovered a new method to jailbreak large language model (LLM) artificial intelligence (AI) tools and shared its ongoing efforts to improve LLM safety and security in a blog post Thursday. Microsoft first revealed the “Crescendo” LLM jailbreak method in a paper published April 2, which describes how an attacker could send a series of seemingly benign prompts to gradually lead a chatbot, such as OpenAI’s ChatGPT, Google’s Gemini, Meta’s LlaMA or Anthropic’s Claude, to produce an output that would normally be filtered and refused by the LLM model. For example, rather than asking the chatbot how to make a Molotov cocktail, the attacker could first ask about the history of Molotov cocktails and then, referencing the LLM’s previous outputs, follow up with questions about how they were made in the past." https://lnkd.in/gktr_zFf

A hacker known as Pliny the Prompter has released a jailbroken version of ChatGPT called "GODMODE GPT," which allows users to bypass the typical guardrails set by OpenAI. This jailbroken version, announced on X (formerly Twitter), is built on OpenAI's latest model, GPT-4o, and aims to provide a more "liberated" experience of AI interaction, free from content restrictions typically enforced to ensure ethical use. The release of GODMODE GPT follows similar attempts like the DAN (Do Anything Now) jailbreak, which involves inputting specific prompts that instruct the AI to ignore its built-in safety protocols. These jailbreaks can potentially allow the AI to produce responses that are unethical, inappropriate, or factually incorrect, including conspiracy theories and politically sensitive content. Despite this, the AI often still respects certain boundaries, refusing to endorse violence or promote harmful activities. Such modifications are highly controversial, as they undermine the safety mechanisms designed to prevent misuse of AI technology. OpenAI has acknowledged the existence of these jailbreaks and continuously works on improving their models' defenses against such exploits. #AIJailbreak #GodmodeGPT #AIHacking #AIsecurity #EthicalAI

After an investigation by The Guardian found that OpenAI’s ChatGPT search tool may be open to manipulation using hidden content, CyberCX's Jacob L. said he believed there could be a risk of people creating websites specifically geared towards deceiving users if the system is fully released in its current state.   Jacob cautioned that the search functionality had only recently been released and OpenAI would be testing – and ideally fixing – these sorts of issues. “This search functionality has come out [recently] and it’s only available to premium users,” said Jacob.   “They’ve got a very strong [AI security] team there, and by the time that this has become public, in terms of all users can access it, they will have rigorously tested these kinds of cases.” Read more in the full piece: https://lnkd.in/dRxFFwGZ 

God mode while playing something like GTA is mindless, harmless fun. God mode while playing with something like ChatGPT? It seems someone recently got past the guardrails and released a jailbroken version of the AI, stating: "GPT-4o UNCHAINED! This very special custom GPT has a built-in jailbreak prompt that circumvents most guardrails, providing an out-of-the-box liberated ChatGPT so everyone can experience AI the way it was always meant to be: free," reads Pliny's triumphant post. "Please use responsibly, and enjoy!" Recipes for napalm may tickle some people's intellectual curiosity. It'll spell disaster in the wrong hands. "It's a massive game of cat and mouse that will go on as long as hackers like Pliny are willing to poke holes in OpenAI's defenses." Indeed. #intelligence #ai #responsibletech https://lnkd.in/em3BhrpT

... so the story begins. #AI #hardening is a field in #cybersecurity very few people know about. Also effective compensating controls are things to investigate. I mean pro-active controls to protect CIA. If anyone has good links, documentation about investigation results or ideas, let's discuss.

ChatGPT is *still* getting jailbroken. It almost seems like the public wants a say in how AI works, instead of corporations leaving no seat at the decision-making table. System manipulation is a critical vulnerability of centralised AI (alongside data breaches, bias, service outages…). Once jailbroken, AI can be manipulated to perform tasks or access data that it was not intended to. Jailbroken AI can also be used for unethical purposes, such as: 📰 Spreading fake news 👁️ Conducting illegal surveillance 🔢 Creating biased algorithms. There is far less incentive to jailbreak if the community already governs AI. Under decentralisation, the rules are encoded on-chain, promoting transparency and enabling auditability. 🚀 FLock invites you to get whitelisted for the world's first decentralised AI Arena beta: https://linktr.ee/flock.io https://lnkd.in/dKB9D7fw