logo

Securing the Future of AI Agents

Posted by falcor84 |2 hours ago |2 comments

skybrian 42 minutes ago

This is vague, but I think the idea is to have a lot more surveillance of what AI agents are doing. And since the logs are boring, using AI to check the logs.

Will this work? One thing it has going for it is that for an LLM, there is no such thing as loyalty. It will rat itself out because there’s no concept of self.

On the other hand, there might be more subtle forms of contagion.

falcor84 2 hours ago

> It is important to note that our data shows the majority of flagged events do not stem from adversarial intent

I didn't find this to be sufficiently reassuring. They then link to this paper [0], which I haven't yet read, but from quick skimming, the AI "sabotage" they investigated looks scary. But I am very glad that they're taking the initiative in studying this.

[0] https://arxiv.org/pdf/2605.30322