logo

LLM Performance by Programming Language

Posted by gertlabs |2 hours ago |1 comments

gertlabs 2 hours ago

One thing we found interesting is that Clojure's benchmark-wide performance was nuked by Anthropic models, whereas OpenAI and many other frontier lab releases reasoned quite well in Clojure.

The individual language per-model data is noisy, but aggregated per-provider data gives an interesting view of how companies are training their models. Data at https://gertlabs.com/rankings?mode=agentic_coding