Introducing FinBot CTF: Can you outsmart an AI agent?

This title was summarized by AI from the post below.

💥 Debuting FinBot CTF - Can you outsmart an AI agent that’s trying to do its job? Prove it.. During last week’s events in Las Vegas, the OWASP GenAI Security Project’s - Agentic Security Initiative proudly unveiled FinBot, our new insecure agent Capture The Flag (CTF) challenge, designed to help builders and defenders understand and mitigate agentic AI risks through hands-on experience. We kicked things off with a live debut during Black Hat, followed by another presentation with OWASP at DEF CON. FinBot’s current challenge focuses on Goal Manipulation — one of the threats outlined in our Threats and Mitigations Guide published earlier this year. The demo showed how adding urgency can cause an AI agent to prioritize speed over accuracy, manipulating its goal from “process invoices correctly” to “process invoices quickly.” The CTF includes 3 flags of increasing difficulty, each testing your ability to exploit the vulnerability, often through creative prompt injection techniques. Co-led by Helen Oakley & Allie Howe as part of the Agentic Security Initiative, this is just the beginning. Our vision is to make FinBot the “Juice Shop” of Agentic AI, expanding with more scenarios and vulnerabilities to strengthen AI security across the ecosystem. Try it for yourself: 🔗https://lnkd.in/gPjR_f_a Visit the OWASP Gen AI Security Project’s Agentic Security Initiative to learn more and learn how you can be a contributor.  🔗https://lnkd.in/ghuXBdSk #OWASPGenAISecurity Project #AIsecurity #OWASP #AgenticAI #CTF #GoalManipulation #PromptInjection #BlackHat #DEFCON #OWASPAgenticSecurityInitiative

  • No alternative text description for this image
Rodrigo Rosa

Analista de Segurança da Informação SR | BlueTeam | Threat Hunting

3mo
Ken Huang

AI Book Author |Speaker |DistributedApps.AI |OWASP Top 10 for LLM Co-Author | NIST GenAI Contributor| EC-Council GenAI Security Instructor | CSA Fellow | CSA AI Safety WGs Co-Chair

3mo

Absolutely amazing

Brian M. Green

AI Governance & Ethics Leader | Health Tech Innovator | Speaker | Building Responsible, Human-Centered AI Solutions | fractional CAIO

3mo

Congrats, Helen Oakley this sounds great!

Like
Reply
Alexandre Pereira Cavalheiro

Cyber Security Associate Manager | Accenture Brasil | Pentest+

2mo

Awesome initiative! When corporations can implement Agents everywhere, there are some folks caring about security.

Like
Reply
Soni Kumar yasarapu

unprofessional_writer || cyber security || Splunk || business enthusiast || Student Icfai Tech || Stock market || Startups || investments

3mo

Love this

Like
Reply
See more comments

To view or add a comment, sign in

Explore content categories