Show HN: Nyx – multi-turn, adaptive, offensive testing harness for AI agents

Nice. Definitely true that evaluating agents behavior is by far the toughest part of building them. Also most eval cases are added without thought and not maintained when agent behaviour updates. Interesting approach.

Where do you draw the line between this and coverage-guided fuzzing? A lot of what you describe (parallel, adaptive, finds edge cases in unbounded input spaces) maps cleanly onto the fuzzing playbook, which has decades of theory behind it - corpus management, mutation scheduling, minimization of found crashes.

Are you borrowing from that literature or treating agent testing as a distinct problem? Feels like there's real transfer available if you're not already pulling from it.

Can I integrate this in my CI/CD pipeline?

I am not sure this will work, seems like added complexity to something simple

i need to try this before mythos comes to attack our service. thanks!

Very cool!