↑
logo

Gemini 4 Neon is the new #1 on the Models Engineering Index

Posted by hn-aarvin |an hour ago |19 comments

largbae a minute ago

Neon is a contender. Neon "high" appears faster and cheaper than Opus 5.5 "medium" with similar results on long-running language porting work in a large monorepo.

The speed is the biggest win IMO. When Carbon came out, I tried to give it a shot, but it was so slow that I went back to Opus just for productivity, nevermind quality. Today I started Neon on one worktree and Opus on another, and Neon did so well that I have now switched for both.

Code quality looks great. Comment-wise it has its own Claudese(exclamations like "this function has a concurrency bug and it's a sharp one!"), but overall I like reading it more than Opus. Might just be because I am not yet tired of its quirks though.

Oh, after a productive day on this particular work I had only spent $30 of Neon vs. $70 of Opus yesterday. YMMV

YuechenLi 17 minutes ago[1 more]

Ok, so I can see that this is a benchmark the submitter made and submitted themselves, which is kinda misleading and should at least be disclosed.

But my question is, what does this benchmark actually measure about the LLM's engineering abilities? It just looks like a page of random bar graphs to me.

25 minutes ago

Comment deleted

quantisan 29 minutes ago[1 more]

When and why should I trust this index over others?

andunieee 10 minutes ago[2 more]

How do I use it? Do I have to create a Google Console account and navigate through 15 menus in order to generate an API key? Or are there another 7 different ways to achieve similar outcomes?

js4ever 24 minutes ago[9 more]

Is it just me or all Google models are terribly bad? They all seems benchmaxed to hell and producing total crap compared to Claude or openai models from my own experience (mostly coding)