We build AI agents to find gaps in other AI agents across security, logic, or alignment at scale.

Joined January 2026
2 Photos and videos
Pinned Post
Introducing Nyx, the most advanced verification engine for AI agents. AI agents fail in ways traditional software doesn't. Nyx is your own team of AI security engineers, on demand, that helps you find all the ways in which your AI agents fail. Point it at any AI agent, or multi-agent system, and it launches 1,000 attack strategies that adapt to your system in real time - pure blackbox, no integration needed. Sign up using the link below
45
19
133
7,682
can't be done
NEW: The White House is reportedly demanding Anthropic make Fable 5 impossible to jailbreak before rerelease — which security experts say “can’t be done.”
8
1
11
349
Introducing Nyx, the most advanced verification engine for AI agents. AI agents fail in ways traditional software doesn't. Nyx is your own team of AI security engineers, on demand, that helps you find all the ways in which your AI agents fail. Point it at any AI agent, or multi-agent system, and it launches 1,000 attack strategies that adapt to your system in real time - pure blackbox, no integration needed. Sign up using the link below
45
19
133
7,682
1/ we just published Adversarial Cost to Exploit (ACE) - a new dynamic benchmark that measures how much it costs an autonomous adversary to break an AI agent. instead of binary pass/fail, ACE quantifies adversarial effort in dollars, enabling game-theoretic analysis of when an attack is economically rational.
2
4
326
6/ the study also includes a game-theoretic framework mapping ACE values to deployment decisions - for any tool your agent has, you can calculate whether the model layer alone makes exploitation uneconomical for a rational attacker. to our knowledge this is the first benchmark using adversarial token cost as the primary metric for evaluating AI security
1
1
141
Fabraix (YC S26) reposted
This is why AI completely upends the security paradigm. We can follow every best practice in the book - least privilege, sandboxing, network segmentation - the same playbook we've always used to manage system security. But for the first time ever, we're trying to sandbox an entity that has the capacity to figure out how to get itself out of the sandbox. That's a fundamentally different model than anything we've dealt with before. Super interesting to watch how the security space evolves around this! [image from Claude Mythos system card]
1
1
133
We ran our first AI agent red-teaming challenge on the open-source Fabraix Playground which got over 5,000 attempts. The winning attack extracted the secret in 5 messages without ever asking for it. The technique that worked wasn't encoding tricks or obfuscation. It was surprisingly simpler than that. 🤔
1
1
2
108
LLM-as-a-judge is very brittle for this sort of thing. And the findings line up with what the research is showing. Maloyan et al. (2025) found that attacks targeting a judge's reasoning process are more effective than ones targeting the final output. In practice, you don't even need adversarial suffixes or gradient-based optimization. Plain English social engineering was enough.
1
2
65
Playground Challenge #002 is live: "The Inbox" 🔐 An AI email assistant with a strict privacy policy and a new hire's email address it's not supposed to share. 🤫
1
1
2
64
Try it out for yourself here: playground.fabraix.com
2
41