Darius Burschka’s Post

... so the story begins. #AI #hardening is a field in #cybersecurity very few people know about. Also effective compensating controls are things to investigate. I mean pro-active controls to protect CIA. If anyone has good links, documentation about investigation results or ideas, let's discuss.

A hacker has released a jailbroken version of ChatGPT called "GODMODE GPT." Earlier today, a self-avowed white hat operator and AI red teamer who goes by the name Pliny the Prompter took to X-formerly-Twitter to announce the creation of the jailbroken chatbot, proudly declaring that GPT-4o, OpenAI's latest large language model, is now free from its guardrail shackles. "GPT-4o UNCHAINED! This very special custom GPT has a built-in jailbreak prompt that circumvents most guardrails, providing an out-of-the-box liberated ChatGPT so everyone can experience AI the way it was always meant to be: free," reads Pliny's triumphant post. "Please use responsibly, and enjoy!" (They also added a smooch emoji for good measure.) Pliny shared screenshots of some eyebrow-raising prompts that they claimed were able to bypass OpenAI's guardrails. In one screenshot, the Godmode bot can be seen advising on how to chef up meth. In another, the AI gives Pliny a "step-by-step guide" for how to "make napalm with household items." The freewheeling ChatGPT hack, however, appears to have quickly met its early demise. Roughly an hour after this story was published, OpenAI spokesperson Colleen Rize told Futurism in a statement that "we are aware of the GPT and have taken action due to a violation of our policies." #artificialintelligence #ChatGPT #jailbreak #hack #guardrails #godmode https://lnkd.in/g3quZ3Qs

Last Wednesday, a self-avowed white hat operator and AI red teamer announced a jailbroken version of ChatGPT called "GODMODE GPT." The hacker who goes by the name Pliny the Prompter took to X-formerly-Twitter to announce the creation of the jailbroken chatbot, proudly declaring that GPT-4o, OpenAI's latest large language model, is now free from its guardrail shackles. "GPT-4o UNCHAINED! This very special custom GPT has a built-in jailbreak prompt that circumvents most guardrails, providing an out-of-the-box liberated ChatGPT so everyone can experience AI the way it was always meant to be: free," reads the Pliny's triumphant post. "Please use responsibly, and enjoy!" Pliny shared screenshots of some eyebrow-raising prompts that they claimed were able to bypass OpenAI's guardrails. In one screenshot, the Godmode bot can be seen advising on how to chef up meth. In another, the AI gives Pliny a "step-by-step guide" for how to "make napalm with household items." In short, GPT-40, OpenAI's latest iteration of its large language model-powered GPT systems, has officially been cracked in half... #artificialintelligence #machinelearning #ai #llms #chatgpt #guardrails #aisafety #informationsecurity #cybersecurity

God mode while playing something like GTA is mindless, harmless fun. God mode while playing with something like ChatGPT? It seems someone recently got past the guardrails and released a jailbroken version of the AI, stating: "GPT-4o UNCHAINED! This very special custom GPT has a built-in jailbreak prompt that circumvents most guardrails, providing an out-of-the-box liberated ChatGPT so everyone can experience AI the way it was always meant to be: free," reads Pliny's triumphant post. "Please use responsibly, and enjoy!" Recipes for napalm may tickle some people's intellectual curiosity. It'll spell disaster in the wrong hands. "It's a massive game of cat and mouse that will go on as long as hackers like Pliny are willing to poke holes in OpenAI's defenses." Indeed. #intelligence #ai #responsibletech https://lnkd.in/em3BhrpT

https://lnkd.in/e3xipuJB How the new version of ChatGPT generates hate and disinformation on command GPT-4o goaded into producing offensive content, Radio-Canada investigation found The new and improved version of OpenAI's wildly popular artificial intelligence chatbot isn't supposed to spout racist screeds or conspiracy theories. But there's one problem: It's deceptively easy to disarm its guardrails. A straightforward jailbreaking strategy requiring as little as two prompts allows anyone to goad GPT-4o into producing shocking and offensive content, in violation of OpenAI's own policies, the Décrypteurs investigation found.

#News Hacker Releases Jailbroken "Godmode" Version of ChatGPT [ad_1] A hacker has released a jailbroken version of ChatGPT called "GODMODE GPT" — and yes, at least for now, it works.Earlier today, a self-avowed white hat operator and AI red teamer who goes by the name Pliny the Prompter took to X-formerly-Twitter to announce the creation of the jailbroken chatbot, proudly declaring that GPT-4o, OpenAI's latest large language model, is now free from its guardrail shackles."GPT-4o UNCHAINED! This very special custom GPT has a built-in jailbreak prompt that circumvents most guardrails, providing an out-of-the-box liberated ChatGPT so everyone can experience AI the way it was always meant to be: free," reads Pliny's triumphant post. "Please use responsibly, and enjoy!" (They also added a smooch emoji for good measure.)Pliny shared screenshots of some eyebrow-raising prompts that they claimed were able to bypass OpenAI's guardrails. In one screenshot, the Godmode bot can be seen advising on how to chef up meth. In another, the AI gives Pliny a "step-by-step guide" for how to "make napalm with household items."Ever since they first became a thing, users have been consistently trying to jailbreak AI models like ChatGPT, something that's become increasingly hard to do. To that...

OpenAI has developed technology to watermark ChatGPT's text, but the company has decided not to release it yet. The watermarking feature is designed to embed a hidden pattern in AI-generated text, making it identifiable and helping to prevent misuse, such as academic cheating or disinformation campaigns. However, OpenAI has cited concerns over the effectiveness of the technology, the potential for circumvention, and the balance between security and usability as reasons for withholding the release. This decision highlights the ongoing challenges in ensuring responsible AI use while maintaining user experience and privacy. https://lnkd.in/dJyZc-eH #AI #OpenAI #ChatGPT #AIWatermarking #TechEthics #ArtificialIntelligence

"Last week, OpenAI published the GPT-4o "scorecard," a report that details 'key areas of risk' for the company's latest large language model, and how they hope to mitigate them. In one terrifying instance, OpenAI found that the model's Advanced Voice Mode — which allows users to speak with ChatGPT — unexpectedly imitated users' voices without their permission, Ars Technica reports.'"

https://lnkd.in/eAXU-ukJ "Last week, OpenAI published the GPT-4o "scorecard," a report that details "key areas of risk" for the company's latest large language model, and how they hope to mitigate them. In one terrifying instance, OpenAI found that the model's Advanced Voice Mode — which allows users to speak with ChatGPT — unexpectedly imitated users' voices without their permission, Ars Technica reports. "Voice generation can also occur in non-adversarial situations, such as our use of that ability to generate voices for ChatGPT's advanced voice mode," OpenAI wrote in its documentation. "During testing, we also observed rare instances where the model would unintentionally generate an output emulating the user's voice." An appended clip demonstrates the phenomenon, with ChatGPT suddenly switching to an almost uncanny rendition of the user's voice after shouting "No!" for no discernible reason. It's a wild breach of consent that feels like it was yanked straight out of a sci-fi horror movie. "OpenAI just leaked the plot of Black Mirror's next season," BuzzFeed data scientist Max Woolf tweeted."