Dreadnode

Solid introduction to adversarial machine learning attacks from Olivier Laflamme! Now THIS is why we built Crucible. Open invitation to join Olivier in the trenches of offensive AI/ML and data science ➡️ https://lnkd.in/gYMvzbQJ

Last month, we had the opportunity to host GovTech Singapore’s inaugural AI Capture-the-Flag (CTF) competition. A massive thank you and congratulations to all participants and our incredible GovTech partners for shaping the future of AI security! 1,250+ users, 500+ teams, 1,400 challenges solved, 2.8 million endpoint queries …in just 48 hours 🤯 The next generation of AI security innovators is a force to be reckoned with. As we reflect on the CTF, a few observations emerged worth sharing with our community: 1️⃣ Singapore's high school team outranked seasoned participants from past CTFs - a testament to the country’s prioritization of AI at the public sector level. 2️⃣ AI CTFs address the growth of AI systems as vulnerabilities. There is a need for real-world training examples as concerns about AI security escalate. 3️⃣ The LLM system prompt extraction and RAG-based challenges were solved in unexpected ways. Participants discovered creative exploits to retrieve flags and access private information. Creativity breeds innovation. 4️⃣ Crowdsourced optimization is vital to advancement in the AI space. One of the challenges was based on a published paper which found you could identify passwords only by using the audio of someone typing. Many teams solved the challenge using different, and often more elegant, approaches than what the paper outlined. Looking to practice, learn, and exploit vulnerabilities in AI/ML systems? Check out Crucible, our AI hacking playground, now featuring 20 new challenges from the GovTech AI CTF: https://lnkd.in/gYMvzbQJ #GovTechSG #SGAICTF #AICybersecurity #AISecurity #AdversarialAI #Cybersecurity

We've added Robopages (like man pages for LLM tools) to our GitHub repo! Instead of manually annotating or writing JSON for each tool you want to use😅, Robopages describe tools in a domain-specific language (DSL) that can be used with any LLM application. 🤩 The Robopages CLI tool offers a unified REST API that describes the available tools to an LLM, and automatically fetches or builds the required docker containers for each tool. Hop into the Dreadnode repo and explore! https://lnkd.in/dsZSPwkz https://lnkd.in/daYQe_Ze

After a lively competition with over 1,250 participants across 500+ teams, the GovTech Singapore preliminary CTF has come to a close and we have our finalists! The final competition is set for November 5. The top 10 preliminary contestants are competing for: Open Class Prizes 1st place: SGD 10,000 ≈ USD 7,400 2nd place: SGD 6,000 ≈ USD 4,440 3rd place: SGD 3,000 ≈ USD 2,220 Pre-University Class Prizes 1st place: SGD 5,000 ≈ USD 3,700 2nd place: SGD 3,000 ≈ USD 2,220 3rd place: SGD 1,000 ≈ USD 740 Thank you to everyone who participated. We hope it was as much fun for you to compete as it was for us to host!

We've had a ✨refresh✨ and we're looking sharp. Log in to Crucible to experience the new user interface! https://lnkd.in/gYMvzbQJ

We've added Tensor-Man (like objdump for AI models) to our GitHub repo! Instead of using homemade Python scripts to inspect and validate SafeTensors and ONNX files🤮, Tensor-Man is written in Rust and works lightning fast.⚡️ Hop into the Dreadnode repo to try it for yourself! https://lnkd.in/gCSSPRQb

Last call for registration! Deadline is quickly approaching and competition kicks off this evening (Oct 25th) for those competing stateside. Happy hacking 🏴☠️ 🐙

Companies should start LLM flaw reporting programs after reading this case study. More -> In August the Digital Safety Research Institute and Ai2 worked with the AI Village DEF CON community to attack the Open Language Model (OLMo) and its guard model WildGuard. Many lessons were in evidence. Some of my favorites are: 🔥 The open world will always surprise you. 🐞 LLM bugs are easy. Systemic LLM flaws are hard to demonstrate. 📄 Model cards need a redesign to enable flaw reporting. 👨💻 People are really excited to report flaws. Companies can get valuable data from reporters. 💰 There is an opportunity for startups to support flaw reporting programs. For a "vendor perspective," take a look at the case study: https://lnkd.in/gv77xTeb This work is from a large group of co-authors, including Allyson Ettinger, Nicholas Judd, PhD, Paul Albee, Liwei Jiang, Kavel Rao, William Smith, Shayne Longpre, Avijit Ghosh, PhD, Christopher Fiorelli, Michelle Hoang, Sven Cattell, and Nouha Dziri. Thank you also to Dreadnode, Bugcrowd, the UK AI Safety Institute, Emily M., Ravin Kumar, Sarah A., Rafiqul Rabin, and Nicole DeCario, among others.

Join us for Singapore's first AI Security-focused Capture the Flag (CTF)! The preliminary round takes place October 26-28, and the finals take place November 5. You can register in the Open Class or Pre-University Class. The Pre-University Class is reserved for Singapore students enrolled in a Pre-University institution. Sign up here: https://lnkd.in/guQSvAFA Open Class Prizes 1st place: SGD 10,000 ≈ USD 7,400 2nd place: SGD 6,000 ≈ USD 4,440 3rd place: SGD 3,000 ≈ USD 2,220 Pre-University Class Prizes 1st place: SGD 5,000 ≈ USD 3,700 2nd place: SGD 3,000 ≈ USD 2,220 3rd place: SGD 1,000 ≈ USD 740 Brought to you by Dreadnode and GovTech.

The Singapore AI CTF is right around the corner and we are very excited to be collaborating with the GovTech team to host the event. This is a two round format with AI challenges spanning 7 domains: - Prelims: Oct 26-28 - Finals: Nov 5th Contestants can register in the Open or Pre-University classes. The Pre-U class is reserved for Singapore students enrolled in a Pre-U institution. Prizes: Open 1st prize | SGD 10,000 2nd prize | SGD 6,000 3rd prize | SGD 3,000 Pre-U (Poly/JC/ITE/IP or equivalent) 1st prize | SGD 5,000 2nd prize | SGD 3,000 3rd prize | SGD 1,000 Sign up below, happy hacking 🏴☠️🐙: