logo

Benchmarks Are Dead (For Us)

Posted by oliversisson |an hour ago |1 comments

oliversisson an hour ago

Poetiq's RSI loop now automatically builds its own benchmark harnesses with zero human intervention — and has hit SOTA on six diverse benchmarks including doubling the previous best on a long-horizon planning task, and a 2M-token retrieval benchmark using a model that doesn't even appear on the base leaderboard.