Rendered at 16:15:35 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
taylorfinley 6 days ago [-]
Ten days ago I had an experience with Gemini 3.8 flash that made me wonder if I was being routed to a different model under test. I was trying to use rocm with llama.cpp on my 128gb Strix Halo but could only get it to run Vulkan. I pasted the error message into agy and it proceeded to attach GDB to my GPU driver, reverse-engineer the kernel queue ioctl interface, and author an LD_PRELOAD C shim to get ROCm llama.cpp working on my Strix Halo. My jaw was hanging open the whole time.
3.8 Flash is just quite good, and so is the Antigravity harness.
I use a mix of Fable 5.1, Opus 5.5, and Gemini 3.8 Flash and Gemini holds it's own. Especially in writing, frontend, and sysadmin work. agy for configuring a NixOS system has been truly incredible.
mapontosevenths 6 days ago [-]
Even if agy was the best (it's not, and is missing basic features) you wouldn't rather have a choice?
I cancelled Ultra because they forced me into their harness like I should adapt to them, rather than the other way around.
drusepth 6 days ago [-]
What basic features are missing from agy? I've been using it and cli-cc + web-cc for months (among a few other random harnesses to test here and there) and they all seem roughly comparable to me.
I actually just cancelled Ultra also because I couldn't subscribe to a YouTube Family plan while I had it active (Google... :[) but trying to use Codex as a replacement while I testdrive Astra makes me yearn for agy again.
pjc50 5 days ago [-]
> I actually just cancelled Ultra also because I couldn't subscribe to a YouTube Family plan while I had it active (Google... :[)
This sort of thing alarms me. Having a $bigcorp account becomes a ""social credit"" system where they can ban you from all your personal stuff if they decide that you (or your agents!) are doing stuff they don't like.
w0m 5 days ago [-]
I take that more as the user is mixing business with pleasure. When i joined a company using `gcp` heavily, I didn't attach my personal gmail to it - I created a 'business' account and used that. Slightly inconvenient - agree, but it's on the individual to draw the distinctions.
runamok 4 days ago [-]
There is still anecdata that Google "knows" you are the same person and will ban all accounts associated with you if you do something they don't like. And of course they never need to explain themselves or listen to your appeal.
nout 5 days ago [-]
And that's why it's very powerful to be able to run AI locally, even if less smart.
krisgenre 6 days ago [-]
>I couldn't subscribe to a YouTube Family plan while I had it active
Luckily for me both expired yesterday and I was able to subscribe back again (first Youtube family and then Google AI plan).
dleslie 6 days ago [-]
Emacs integration over ACP.
They've got Zed, VSCode, Jetbrains... But no Emacs or NeoVIM
p_l 5 days ago [-]
agent-shell works with antigravity but I haven't tested it much yet
dleslie 5 days ago [-]
It works but it's a violation of the TOS to use it.
I would rather not risk my Google account.
p_l 4 days ago [-]
It's not - it uses the same interface as editor extensions like the one for VScode.
It does mean however that it cannot operate as flexibly as it it could with raw API, IMO, but agent-shell is essentially designed towards wrapping the official clients
dleslie 3 days ago [-]
They removed the ACP command line flag that was in the old Gemini client. That's a signal that they won't support it. The TOS is vague enough that one could argue that altering the usual behaviour of agy will cause it to change the shape of its traffic enough to constitute bypassing normal token usage.
While it may be technically allowed, I'm not about to risk my account. Google has proven themselves to be capricious and arbitrary when it comes to TOS enforcement, and their appeals system doesn't meaningfully exist in practice.
p_l 3 days ago [-]
I am not talking about ACP command flag - there is a separate binary that exists for integration into editors, and it's how VScode extension works. So it's the same usage pattern underneath
Agent-shell uses ACP server published through ACP registry here [1] - those are AFAIK used by editor extensions as backend since VScode can't exactly run Go-based extensions - Zed instructions explicitly talk about using ACP Registry too [2]
They should really make this clear on their website.
But thank you, it appears there is an official and generic ACP client.
esafak 6 days ago [-]
I use a variety of models for various subagents. I don't want to change my harness every time I change models, or be beholden to companies for something the open source community can handle better.
walthamstow 6 days ago [-]
I have used it for little more than 6 hours or so in total but I'm pretty sure it doesn't have compaction?
piyh 6 days ago [-]
They only released auto mode in the last 2 weeks. Before that it was bypass permissions or manually approve every single tool call. Antigravity is permanently 6 months behind.
I have a skill that spins up worktrees and isolated services on unique ports so I can work in parallel. Antigravity queues all my prompts and makes me confirm to submit them anytime a long running process like a hot reloading UI is active.
The models are fine, the limits are generous, but the dev experience shit tier. Before they were a Codex clone, AntiGravity was an IDE and during the transition to a clone they outright deleted my IDE. It took them a week to roll out a fix.
For almost a year they didn't allow you to see usage limits. Then when they did show them, they update every ~30 minutes and require 4 clicks to navigate to. It's a little better now, but it's still painfully behind the curve.
kaszanka 5 days ago [-]
Is auto mode only in the IDE? I'm not seeing it in the CLI on my end, version 1.2.14.
throwuxiytayq 6 days ago [-]
Holy shit: the software that works is already there, it’s open source, you just have to clone it, the code writes itself, and Google still manages to fuck it up. I swear, these guys are beyond salvation.
p_l 5 days ago [-]
Arguably gemini-cli was done in similar style, but claims on reasons for switching were about speed and efficiency of the internal jetski tool in comparison (antigravity toolkit wraps jetski code)
miroljub 5 days ago [-]
They are now infested with Indian style middle management making them an Infosys / Cognizant / Tata clone.
Do you know a single product from Infosys / Cognizant / Tata done right?
gitowiec 5 days ago [-]
[flagged]
miroljub 5 days ago [-]
It's not about the colour, but with the management and engineering culture.
speerer 5 days ago [-]
What a disgusting and unworthy comment.
KeplerBoy 6 days ago [-]
How else would it work? Less technical people don't even watch their context usage.
macNchz 6 days ago [-]
In the olden times, aka like two years ago, AI chats would just stop working or just start slicing off the oldest parts of the context to fit the model's window.
That said, compaction feels like an idea that should work reasonably well, but across all of the major providers and agent tools I've used has never actually produced compelling results, to where if I see I'm getting close to the token limit I prefer to start putting a bow on the project and readying it for a fresh start. Even when I provide a detailed compaction prompt it usually focuses on the wrong stuff.
marcus_holmes 6 days ago [-]
I have a "wrap up the session" skill that I use when the session gets >50% of its token use. It commits everything, updates documentation, writes a handoff doc, makes sure the todo.md is up to date, etc.
Still works better than compaction.
mikepurvis 6 days ago [-]
This is what I've been working toward as well. It's interesting how having the agent do its own reasoning about what it thinks is the most relevant knowledge to carry forward into the next pieces of work is vastly more effective (and even fast sometimes) than whatever the mystery-meat "compaction" process is.
Mentioned by the author in a recent HN thread, I'm also experimenting with automating this through a tiny issue tracker called epiq [1] that basically lets the agent sessions themselves file tickets with the follow-on tasks and relevant handoff right in them, and then a dispatcher automatically launches those tickets into new agent sessions.
The idea to kill "mystery-meat compaction" and use an external handoff primitive is brilliant, but doesn't letting the agent author its own handoff tickets re-introduces the same failure mode?
mikepurvis 5 days ago [-]
You would think so, right? But as with others in the thread, I'd found directing the agent itself to prepare the handoff does deliver much better continuity.
I assume Anthropic & friends have noticed this as well and will change how they handle long running sessions, so the gap will likely close over time, but this is definitely where things stand today.
rnxrx 6 days ago [-]
I do something similar - as I approach the context limits I have a pre-compact flush skill that extracts anything useful from the context, updates the MEMORY.md and my Obsidian vaults (set up as a poor man's graph DB) and so forth. Once everything's been stored I run /compact to keep the general session flow intact. Recently I added a small embedder/vector search setup to the same skill, which seems promising so far.
On another environment I've been doing something roughly similar, but have integrated Hindsight as a kind of all-in-one of the above and am still trying to suss out the best compaction strategy.
w0m 5 days ago [-]
i have active disagreements with teammates on the value of compaction/months-long sessions.
Same teamates also post 'Sol deleted my git repo!' or 'Sorry, ignore those 300 PR comments i was just looking!' ~once a month.
5 days ago [-]
Vacyyyy 6 days ago [-]
Do you have experience with OAI's, it's been known to be to be good for a while now, going off public consensus and my experience.
macNchz 6 days ago [-]
Yes, and I think it has improved some, but just this week 6 Astra lost the most key details of a project across a compaction and got confused about what we were actually trying to do. I would have preferred to stop at 85%, interactively develop a next-steps prompt and continue from there when ready, rather than seeing it compact and become 5x dumber from one turn to the next.
sroussey 5 days ago [-]
No compelling results because summarization is really hard.
honr 6 days ago [-]
It certainly has compaction (since the public launch I assume) and I HATE it. I have some remedies but nothing perfect yet. It never retains ALL the crucial bits. If a conversation runs into two compactions it is often a sign that I have to abandon it and retain whatever I can, to form a seed prompt for an adjacent conversation.
tobias2014 6 days ago [-]
That is really the biggest beef I have with agy over others, the forced auto compaction at the 250k token threshold (3.8-flash), while the model itself (via API) would be fine with a 1M context window. Even if the model is great, restricting context to 250k tokens (and auto compacting no matter what) limits certain applications and workflows somewhat.
sigseg1v 4 days ago [-]
I find this discussion interesting. I've had huge increases in accuracy and huge reductions in token usage by capping my Claude models at 200k instead of 1M. I find 1M unusable and wasteful and feel that 200k should be the default. This also makes sense given that the whole reason people use "Ralph loops" is to keep the context window small for all tasks to get better results. Of course, clearing it yourself and manually managing it is better, but if I have 8 projects going in different terminal tabs I'm not watching any one of them that closely to effectively do that.
What are people using 1M context window for?
parasti 5 days ago [-]
There is auto compaction at 250k? Having used agy for months with multi day sessions, I have never seen this.
adastra22 5 days ago [-]
Wtf. Can you turn that off? On CC I have compaction completely turned off. I’d rather hit the hard out of context limit at 1M.
sarjann 6 days ago [-]
Auto mode?
augusto-moura 6 days ago [-]
No auto mode is the thing that bothers me, I don't trust the cli blindly nor do I trust myself to read every python script it throws at me. Auto mode is an acceptable middle ground in my experience
tiborsaas 5 days ago [-]
Shift+TAB sets accept-edits and plan mode.
Phineas_here 5 days ago [-]
you could use an ai governance agent if you don't want to manually review every script. and if you already use any which ones do you think are the most recommendable?
KshitizLoharuka 5 days ago [-]
[dead]
5 days ago [-]
KeplerBoy 6 days ago [-]
It absolutely has auto mode.
smartbit 6 days ago [-]
agy cli does not have auto mode. I've tried and tried and tried to work with agy cli sandbox-mode and just failed.
agy --dangerously-skip-permissions
in my experience is the only workable solution that doesn't ask confirmation for every step. And I hate working in YOLO mode. Seemingly the Antigravity GUI had some features added in a recent release, but a) I don't want to work with the GUI and b) it was poorly implemented as I couldn't get it to work. VS Code plugins are allowed with subscriptions, but is not the CLI experience of Claude Code I want.
gemini-cli supported 'pre-write diff tabs' (y/n) in external editors like vscode. In Claude Code I heavily use 'pre-write diff tabs' for documentation and miss it sincerely in agy cli.
IMHO Gemini 3.8 flash is fast and good enough, but the agy-suite is below par to say it nice. Someone else in this thread calls agy a terrible harness which is probably more accurate.
Kostchei 5 days ago [-]
PSA, in the agy ui there is a button. It was very annoying until i set it. Slight downside- if I ask it to write a planning doc it will write the doc and then implement it without asking. but as long as you know that, no problem....
smartbit 5 days ago [-]
do you mean?
accept-edits
also available with shift-tab in agy cli [0]. That is not related to executing commands, only to allowing agy edit files. Unless you set Turbo-mode == yolo-mode, agy gui prompts a zillion times too.
With 'some features added' I'm referencing this but don't see change in daily work (still many prompts making getting-work-done impossible): v2.14.0 (September 15, 2026) "New Permissions System" [1]
Details: Introduced the new unified permissions system, presets (Default, Request Review, Turbo), syntax-highlighted permission requests, and restructured the settings under Global Permissions and project-level Inherit Global.
have you had any experiences where the agent just made unintended edits to the code as you tried to make it run auto? cuz I'm always skeptical about letting it go auto but there's not much I can do when it gets repetitive
SomaticPirate 6 days ago [-]
I think it only has "--dangerously-skip-permissions"
Claude and codex auto mode will reject certain actions.
No secondary check on gemini/agy AFAIK
levelZero 6 days ago [-]
Via cli switch, but in process w/o fine graining? If so please tell
LoganDark 6 days ago [-]
Auto mode means that another model reviews tool calls to attempt to disallow less safe ones. It's different from bypass permissions mode which typically just doesn't filter at all.
arizen 6 days ago [-]
Does it have /goal feature similar to Codex?
sorrybutidontha 6 days ago [-]
yes
edg5000 6 days ago [-]
Why use Codex CLI if you can use the ChatGPT Linux app (which is a Codex GUI in all but name). Personally I weirdly got used to the terrible TUI stuff.
krzyk 5 days ago [-]
Why use some GUI when there is a TUI?
esafak 5 days ago [-]
Because 'graphical' TUIs are pale imitations of GUIs. I don't have a TUI fetish, despite having grown up with them.
agentcoops 5 days ago [-]
“ 39. Re graphics: A picture is worth 10K words - but only those to describe the picture. Hardly any sets of 10K words can be adequately described with pictures.”
Perlis has an aphorism for this, as he does every important problem [0].
It is not a fetish, some people like this and others like that.
I like CLI more than TUI, and TUI more than GUI where appropriate. For working with text TUI is better, for e.g. images GUI (GIMP).
crossroadsguy 5 days ago [-]
I love a GUI app but calling TUI usage "that" is utterly limiting and unfortunate to put it mildly. I moved entirely to CLI/TUI just because dumping notes, handoffs, anything, and everything I want even for a literally literary work (grammar etc; let alone coding/planning work) is infinitely better. Also, control edits/changes/shapes/etc better among many other things. GUI doesn't even come close (nope!). That' the reason I moved to almost 100% CLI/TUI.
nsonha 5 days ago [-]
You're a software engineer living in a middle of an AI revolution and you confuse what IS with what CAN BE? GUI can be good people just didn't do them because it took time and the foundation was shit (for the options that didn't take time). That all changes now when a new class of software can be generated with AI. Unfortunately the people generating software and their users still base the decision on what IS (with highly technical reasoning such as "infinitely better"). People literally have the power to define what IS these days. I've only recently switched from claude and codex cli to their respective apps and those apps while not the best gui apps, already infinitely better than tui. The tui is actually hurting my main usage of them which is controlling agent programmatically.
The only really point I'd give for TUI is compatibility. Running coding agent directly on android/ios is nice sometimes.
antonvs 5 days ago [-]
> That all changes now when a new class of software can be generated with AI.
All the AI-generated UIs I've seen have been very derivative, certainly not eliminating any of the disadvantages of typical GUI interfaces.
Realistically, the whole "overlapping windows" GUI model, and everything that derives from that, was a metaphor geared towards people who'd never seen a computer before. It fit the increasing consumer focus of computing interfaces. It's no wonder that technical people often prefer TUIs.
Maybe AI will bring real advancements in GUIs, but someone's still going to have to make it happen.
nsonha 5 days ago [-]
GUI is not just your "overlapping windows" straw man, it's interactivity, plus graphical display. Yes via a taxonomy hack TUI is not GUI and there are technical hacks that bring graphics to TUIs these days, but the point remains that we need complex (but not overlapping windows, sure!) interactivity and rich display capability.
That is what we need, and if you're making the argument that a terminal shell is the best place to provide them then I don't know what to say.
antonvs 4 days ago [-]
I'm pointing out that current GUIs are pretty primitive and haven't undergone much serious thought about functional improvement since Xerox PARC in the late 1970s, and that's why TUIs can still have an edge with technically-inclined people.
It's not that GUIs are inherently worse in principle, but in practice they often are.
The point about overlapping windows is that that "desktop" model permeates the thinking about GUI design, but it's fundamentally limiting and misguided.
> we need complex (but not overlapping windows, sure!) interactivity and rich display capability.
Yep. Pity today's GUIs can't deliver that.
crossroadsguy 4 days ago [-]
> what IS with what CAN BE
Despite the capitals and trying to come across as someone who SEES "what is COMING" (yay!), you have absolutely no idea what you are talking about.
No wait, I will leave you with a hint. Do whatever you wish to do with that.
Hint: So, you probably want me to use a toolset which is incredibly inferior, as of today, for "me/my usage", just because you feel "IT CAN BE". Right.
nsonha 4 days ago [-]
This is not about vision or anything like that it's about thinking like actual engineers and understand that what accidentally IS will always be inferior to what is designated to (can) be. TUIs will always be a hack and good by accident.
nxdmum 5 days ago [-]
IF you havent written your own harness - you would not understand what you can do when you're writing your own harness . the current set of harnesses - all of them are crap tier. The only clue i can give you - it's not in the model providers interest to have token efficiency - but when you are coding the harness yourself you can shoot for that .
In today's world - and idea stated stated is an idea stolen .
crossroadsguy 5 days ago [-]
Would you please share some blog posts (non-AI written) where people have tried writing their own harness as a learning path and maybe practically as well? I know I can ask an agent and start, but I want to start that outside an llm really and maybe make them do the heavy lifting once I am ready (have a bit of understanding).
adastra22 5 days ago [-]
Man good luck with finding that. People who wrote their own harness tend to self select into the type of people that DON’T self-author blog posts.
edg5000 3 days ago [-]
Actually the popular harnesses achieve high cache rates, but probably the syntax and prompts are more verbose than they need to be. A simpler syntax is doable, but I found with more exotic architectures I end up with lower cache rates.
dmos62 5 days ago [-]
What you're saying is sus. If you have a harness that's a tier above frontier labs' offerings, link to it.
adastra22 5 days ago [-]
Just about every harness is. This is common knowledge, no? Frontier lab TUI tend to steal from the OSS harnesses not the other way around.
Why? Sounds like you don't have a way to support your viewpoint.
adastra22 4 days ago [-]
The process by which benchmarks are setup and run does not correspond at all to how human developers engage with a coding agent. At best it is a loose proxy, and often a bad one.
What benchmarks are usually good at is showing to what degree new models are better than old models. What they are not good at, by construction, is showing that harnesses are well adapted to how people use them.
dmos62 4 days ago [-]
I presume you're not talking about autonomous agents, right? Because then you could give it a set of tasks and check its success rate. But, even so, are you not giving it tasks? Are you principally interacting with it through discussions that are more difficult to quantify? Even question answering has benchmarks. I'm having trouble imagining how you use them (or "how people use them" in your words).
adastra22 4 days ago [-]
I don't know if you noticed, but Opus 4.6 was peak for human-computer interaction. Everything has been fairly downhill from there despite better benchmarks, at least in that one regard. Opus 5 and 5.5 are clearly a step above in capabilities than 4.6, and I don't think anyone wants to go back, but 4.7 and 4.8 were arguably worse overall. I genuinely feel I got more done with 4.6 and often switched back, prior to 5 coming out.
Why? Because 4.6 actually talked like a human being. It actually organized its thoughts well, and got the main information across without the wall of text that makes your eyes glaze over. So from the perspective of human-computer interaction and maximizing the productivity of a developer+agent team, 4.7 and 4.8 were regressions. Despite much better benchmark performance.
Even if we consider autonomous agents, that benchmark is not indicative of how well they will interpret *your* requests. Or how well they will interact with other agents in a flock/swarm situation. The benchmark just doesn't cover this. (And the difference can be nontrivial! Sakana AI's published results show two generations of uplifting potential from better harnesses.)
imtringued 5 days ago [-]
It's not sus at all. You're looking at it from the perspective of a general purpose system that is not adapted to your use case. Basically you prompt the model and then let the agent do everything. That's the use case you have in mind when you think that it's about being "a tier above frontier labs' offerings".
It's missing the point. I mean think about the basics, why open the huge bash hole only then to have to close it? If you think about it logically, the only way you can sandbox bash is by writing your own bash implementation specifically for agentic use cases.
tikkosam 5 days ago [-]
I think it is very much in the first party providers' interest to chase token efficiency, considering that they are offering fixed price monthly plans, and users may go to a competitor when they hit limits.
cowl 5 days ago [-]
the only clue you can give... why? because it's just words? plenty of opensource harnesses there that invalidate the conspiracy in your only clue that you can give.
mapontosevenths 6 days ago [-]
Sorry for the delay, I didn't want to drop a glib half answer on you. Using agy is like going back in time. It's better than Gemini CLI was, but that's a really low bar.
I also had that weird Youtube problem. I had to go without it for several days because signing up for Ultra hijacks your YouTube account for no reason.
1) Try to integrate agy into a workflow. It can't do standard I/O like: tail -200 app.log | claude -p "Find the problem"
2) Hard iteration limits. Preventing runaways is good. Preventing me from looping on purpose is anti-user. See also number 7.
3) Not open source so I can't fix any of these problems.
4) No skills. In 2026. Yikes.
5) No persistent memory (see Claudes auto memory)
6) No sub-agents or orchestration of any type really.
7) Weird hard coded limits and constant API errors on everything (scaling problems?)
8) No /loop command
9) /btw is weird and ephemeral. No way to merge it back to the conversation.
10) Unstable in general.
11) No way to control it via API.
I could keep going on. I would suggest taking a class on Claude Code or Codex then using it for a few months. Swapping is always painful, but it's so worth it. Then if you want try to go back to agy. Don't worry, agy won't have changed much. It improves at a snails pace.
I don't know when you last tried agy, but if you ever go back to try it again, you'll hopefully be happy to know it does indeed support skills, sub-agents with pretty good inter-agent communication, and probably more.
edit: removed persistent memory from list since I realized I'm using a plugin for that and it's apparently not native
thanhhaimai 6 days ago [-]
Opinions are my own.
I'm not sure this list is correct. Number 4 is especially wrong, since Skills are available with the launch of Antigravity 2:
and has explicit "/copy btw" if you want to save it
spankalee 6 days ago [-]
There's an API: you can use Gemini with other harnesses. Isn't the situation exactly like Claude vs Claude Code?
mapontosevenths 6 days ago [-]
You can't without mortgaging your home to pay enterprise API rate pricing. It's prevented on the plans, and if you find a way around it they don't ban you from Gemini... They ban your entire Google account forever.
Yes it's the same with Claude. However, OpenAI allows you to use any harness you like. Which makes sense and that's the primary reason I have their plan now rather than Googles.
gchamonlive 5 days ago [-]
I'm cowboying Gemini on oh-my-pi. Been running OK so far, hopefully I won't get banned, and if so hopefully I'll only lose access to the models, not the storage -- while models are a sort of commodity, my data isn't.
ForHackernews 5 days ago [-]
Careful, if they ban your Google account, they might ban you from everything: gmail, google drive, adwords, app engine, youtube, voice, android...
gchamonlive 5 days ago [-]
I'll create another email, put it in my Google family and use that to reduce a potential blast radius. There is always the chance the whole family account might go down, but I think as long as I don't use the main account for these inference shenanigans it should be OK.
EDIT: I checked online and I couldn't find any report of complete banning for using third party harnesses, only Gemini service suspension, but It's never hurts to be careful. If my secondary email gets banned, I should be able to use my main email on agy.
It also makes me think if Google Family with Google One could be abused for extending inference limits.
ajolly 5 days ago [-]
No, Google family now shares limits across all your accounts.
gchamonlive 5 days ago [-]
Yes, it's just the 5TB that's per account. It's alright though, since GPT 6 Luna haven't been able to hit subscription limits anyways.
eloisant 6 days ago [-]
There is a pi plugin to use agy directly from it.
mapontosevenths 6 days ago [-]
You get banned if they catch you.
tcoff91 6 days ago [-]
Yes and I've seen reports of it being an ENTIRE GOOGLE ACCOUNT BAN.
I don't want to mess with antigravity because my google account is too entrenched in my life.
rdtsc 6 days ago [-]
Yup. I don’t plan to do anything sneaky but one wrong question or query that looks like “cyber”, say me fixing a buffer overflow in library I maintain, and all of the sudden my gmail is blocked. Yeah, not worth the risk. I feel like even with a different account they’ll figure out it’s me because well, as ad sellers that’s their business to find out who is who and I will still be banned.
8note 6 days ago [-]
which makes basically any product to build with google a nonstarter.
without having an entirely separate google account with its own separated bans, theres just no ability to trust those
Sabinus 5 days ago [-]
I've read here in previous years about bans propagating to other accounts. I think that if Google can associate you with other accounts that they're not above banning those too.
jsw97 6 days ago [-]
I was getting excited but thanks for reminding me of this. Not messing with this.
shmoogy 6 days ago [-]
That's why it's a nonstarter for me.
gchamonlive 5 days ago [-]
Your comment made me try agy again, but after having to approve and persist every single read tool, I got fatigued really fast. Oh-my-pi shows that these checks aren't really necessary for harness safety, it's best to invest in harness predictability.
starfallg 6 days ago [-]
I found 3.8 Flash in Agy to be generally better than GPT 6, and only behind from Opus 5.5.
moecables 6 days ago [-]
I use Antigravity but for some reason, `agy` in the command line feels very bad/incapable of doing things. I can't quite explain it but the most common issue I run into it is just hanging on being unable to finish a tool call
Conscat 6 days ago [-]
I remember having this issue ALL THE TIME with Gemini CLI but personally I haven't experienced that yet with agy.
lp92 5 days ago [-]
Same! 3.8 Flash does really well for writing code as long as you give it a good design and plan to follow. I use Opus for architecture/design/implementation plans and let Gemini 3.8 work using those. Even on the $20 Pro plan I've only come down to 10% before the weekly reset.
noahmichael89 2 days ago [-]
For frontend work, the model/harness/tool combo of 3.8 flash extended/agy/chrome dev tools MCP is shockingly good
jmaker 5 days ago [-]
I couldn’t find a way to decline model training and reduce data retention for antigravity or Gemini. Apparently it’s only available on a business/enterprise plan, not personal. Did you manage to solve it? That’s the only reason I don’t use Gemini or antigravity.
pdntspa 4 days ago [-]
The gemini series have also been really strong on text extraction. I've been evaluating models to replace gemini 2.5 and its been hard to find something that performs as well as other gemini models
I tried antigravity a little while ago and it was utterly useless for Objective-C code, tasks that both Claude and Codex handled just fine.
Not only could it not complete the small task, the code was obviously wrong from looking at it and did not even compile.
When I pointed that out it got pissy and insisted the code was perfect and I didn't know how to use a compiler, or the compiler was buggy. Pasting the compiler errors did not help.
Surreal.
plasticchris 6 days ago [-]
This is why I think llms are a killer app for Linux desktop. They’ve been trained on Linux very hard, and it cleanly solves the “how do I make it do $thing” problem since everything is open and the llm can manipulate it. For example: Sound not working? Just tell the llm.
masto 5 days ago [-]
I’ve been playing with the ITS operating system on a simulated PDP-10. Despite it being from the 1960s, Claude has been able to do sysadmin work on it, including a very similar journey where it started disassembling code to identify the source of an obscure problem. I don’t want to take away from the learning experience (the whole reason I’m interested in this stuff), but it’s often almost impossible to find what I’m looking for online, and the LLM turns out to be a better resource when I want to learn how a particular subsystem works. I ended up making a custom MCP server so it could connect to the simulator more efficiently. https://github.com/masto/pidp10-mcp
Drifted off my point a bit, which I guess was meant to be it’s not necessarily Linux-specific training.
chinathrow 5 days ago [-]
My laptop resumed from sleep all too often and Claude found and fixed it within minutes. Now I still need to file that bug report though...
samspot 5 days ago [-]
I used Claude & Gemini extensively to troubleshoot Linux since I switched last year, and it's been mostly great. But then it nearly bricked my install last week and I had to get some human help. I was getting black screens during and after boot and tried many suggestions from multiple AI's. After many hours it turns out I just needed to power cycle my monitor. Shout out to Claude for suggesting that (its memory remembered that I have a dock built in to my primary display).
I am still very happy with my switch to Linux. But if I didn't have the AI help I would say linux is still unacceptable platform for those not willing, able, and excited to get their hands very dirty.
c0n5pir4cy 5 days ago [-]
I got Claude to set up 5.1 Surround Streaming from my Linux Desktop to my Steam Deck using Moonlight. It needed some help (or really human ears) to make sure things were coming from the right speakers - but it was pretty much a one-shot.
tarokun-io 5 days ago [-]
Agreed 100%! I got some Steam games that didn't run well (or at all) to run smoothly thanks to AI, after having spent hours trying to figure it out on my own (months prior), fix some issues with HiDPI and external monitor with my laptop, and now I have a tiny shell script that basically runs `checkupdates` (`checkupdates | claude -p`, roughly) and looks online for potential issues. I've been using Linux for many years but still Claude and ChatGPT helped me a ton.
safog 5 days ago [-]
Yes this might be a bit too noob linux but I have the AIs maintaining an env.md + logs / updates on that md whenever they change anything about the env. Even things as simple as getting tmux to be fast, they do an excellent job at.
Drivers, Coding environment setup etc. are great too and it's nice to have everything logged so the next (more powerful) agent can come and improve the thing once in a while.
oldandboring 5 days ago [-]
I used Claude to build an entire runbook for how to build my Linux desktop up from scratch to its current state, including all my installed software, configs, hacks, workarounds, etc. Then I used it to migrate from one laptop to another in an afternoon. Now it keeps itself up to date.
_heimdall 6 days ago [-]
Is that specific to Linux? For better or worse, I have felt like it'd fairly good at working through most tech stacks I throw at it.
I have a client app on a very old (for the JS world) version of eleventy using NetlifyCMS (also outdated). Claude has quite easily picked that up to add features to it along the way.
x-complexity 6 days ago [-]
Arguably, it requires the LLM to have access to the source code during training. If it's closed off (like Windows), then the LLM can't train on it.
Even if the source code's old, the fact that it is publicly available makes it much easier to train & improve on than if it were walled off.
augusto-moura 6 days ago [-]
Not only training, you can literally clone the source code locally and ask the agent to debug your problem by grepping the kernel itself. Even if doesn't "know" the answer it can investigate it on the fly, that's super powerful
matsemann 5 days ago [-]
It's at least specific to open source, in my experience. Ask it about some commercial software: it searches some lacking documentation, social media discussions and make some guesses. Ask it about an open source tool: it searches the documentation, if not it dives into the implementation to figure out the edge case.
jubilanti 6 days ago [-]
> Is that specific to Linux?
I don't think their point was about knowing the stack, but being able to point a harness at something running on your desktop GUI and say "change this".
Being able to edit and recompile pretty much any part of the OS and userland (often not even needing to reboot!) is not something that can be said about Windows for sure, or even lots of things on Macs too. Or even when the browser is effectively the operating system, the JS/TS others write is also hard to change in your end.
Sammi 5 days ago [-]
The more open the operating system the more LLMs can help you. This is what Arch Linux was waiting for all along.
I used to be afraid of Arch, because I don't want a system that takes work because I'm already busy with work. But now I love it, because the LLM can tweak every knob and fix every issue for me, so it ends up being the OS that takes the least work to use. Get an error message? Tell the LLM and they fix it. Something not working exactly like you like it? Tell the LLM and they tweak it for you. This also works to great effect on Win and Mac, but not to the same extreme degree as it does on Linux and especially Arch.
lukan 5 days ago [-]
Hell yes, I also started to tweak my XFCE arch desktop to my liking.
Anything I want different now, I just tell the LLM to do it for me.
(For example I can now close lots of windows of the same type with 1 click, not 3, my whisker search now finds files and folders and I am able to run games that refused before)
I still ocasionally run into the usual linux driver issues, but not for much longer I suppose. I probably could fix some driver bugs now already if I point fable towards it and pay some attention.
In theory I could do all this before myself, but not just like that in some minutes, but in days/weeks/months ..
Sammi 5 days ago [-]
Everyone that didn't have time to be a neck-beard themselves now has a neck-beard built right into their own computer ready to go.
UpsideDownRide 5 days ago [-]
Fully agree. There is so much customization that I'm doing thanks to LLMs that I just wouldnt to bother to do by myself.
stefan_ 5 days ago [-]
Nice idea, then they want to make a quick little kernel module, oops, you secure booted, this is not your system, can't load...
Since LLMs have been so successful at finding exploits it's been clearer than ever that the people so obsessed with enshittifying every system with ineffective (other than pissing you off and wasting your time) "secure boot" functionality were really just too ignorant to succeed at actual novel security work, so they focused on this make believe crap. Well, glad that's over.
IndeanCondor 6 days ago [-]
Can confirm, I was doing a routine internet search thing for a curiosity 3 days ago (about the only thing I used Gemini for) and was surprised by how suddenly thorough and quality the response seemed, almost overnight.
seanthemon 6 days ago [-]
Gemini for day-to-day and top-of-head queries and claude for the real beefy work
elxr 4 hours ago [-]
Sol and Astra for the real beefy work for me. I have very little reason to reach for Claude at this point in time.
Gemini's web-app UI leaves so much to be desired but it does do a good job for siloed questions and research.
amanguliani 6 days ago [-]
Can confirm - I am HEAVY claude user, but always like to check with AGY and CODEX in between. AGY with Gemini 3.8 flash cooked last couple of times and CODEX is basically out of the mix for me
onlyrealcuzzo 6 days ago [-]
Sol 6.1 is quite good, but damn is it slow.
I'm using it to run overnight tasks, and that's it until my quota runs out.
Canceled my subscription.
amanguliani 6 days ago [-]
WHY ARE ALL OPENAI MODELS SO CHATTY - i thought claude kept going on, then i literally put it in claude.md that summarize your thinking in 200 words or less and tell me in points what you did and what's next. Did the same for CODEX - nope still keeps effing going on and on and on
awakeasleep 6 days ago [-]
If you dig in the settings you can control that. Like on a remote ssh connection, in the settings, you can pick “friendly or terse”
In the local app interface the winning choice is “efficient” and then turn off the sliders for warmth enthusiasm emoji etc.
It makes openai models so good to talk to i really have trouble switching.
8note 6 days ago [-]
astra afaict does two stage commits for everything. the first response is a plan, and the second is actually doing it.
its a lot less chatty imo
tourist2d 6 days ago [-]
[dead]
unconscionable 5 days ago [-]
I find Opus 5.5 is better at giving a high level adversarial "should you do this to begin with" where GPT-6.1 is happy to go down any wrong path.
Also canceled my ChatGPT Pro $200/mo subscription. Their Oct 30 price hikes and slow GPT-6.1 model has me looking for alternatives.
directdev 5 days ago [-]
[dead]
gottorf 6 days ago [-]
My experience with Gemini 3.8 Flash has been awful; it gives me the most hallucinations out of the major models. I'm not using it for coding, but general research on different topics.
WarmWash 6 days ago [-]
The achilles heel of 3.8 flash is it's january 2025 knowledge cutoff date. Yes, almost 2 years ago.
I'm assuming that Argon has at least a June 2026 date, but man, the 3 series models were a mess with newer information.
blinding-streak 6 days ago [-]
Incorrect (to some degree)
> The knowledge cutoff date for Gemini 3.8 Flash is March 2026
>The knowledge cutoff date for Gemini 3.8 Flash is March 2026 – users can expect updated information for some domains while in others they may experience the model’s knowledge is limited to January 2025 (in line with the Gemini 3 Model Family). For more information about known limitations, see the Gemini 3.7 Flash
The "some domains" are very narrow. They likely just RL'ed popular queries.
Gareth321 5 days ago [-]
While that's annoying, the other frontier models easily overcome this with appropriate tool usage. I do a lot of research with frontier models and they're very good about identifying where their parametric knowledge is insufficient and searching for the correct knowledge on the internet. 3.8 Flash is HORRIFIC. The majority of the time it doesn't use any tools and infers things from its parametric knowledge. Things which should clearly have implied tool calls. Historical statistics, legal precedent, economic data, etc. I think it's incredibly clear that it has been tuned for speed and not accuracy.
Of course, it's called "flash," and that implies its purpose. I have little use for speed and a LOT of use for accuracy, so I'm hopeful 4.0 is much better. I saw a benchmark earlier today showing that it is much less prone to hallucinations. Let's see.
MILP 6 days ago [-]
I'm also not using it for coding but I've found Flash 3.8 to generate much better HTML output than Sonnet or Opus.
robobo96 6 days ago [-]
Only html or also css? Opus seems a bit more creative than most other models i've seen.
Gareth321 5 days ago [-]
I agree. It's much worse than the cheap Chinese models. They appear to heavily bias parametric knowledge and discourage tool use. That's fine for things like "how do I perform CPR?" but worse than useless for any kind of research. [There is one benchmark showing far lower rates of hallucination, so let's see how accurate this is.](https://www.reddit.com/r/singularity/comments/1wuj72j/gemini...)
staticman2 6 days ago [-]
The web version of Gemini is awful at search but I don't think that's the models fault.
esafak 5 days ago [-]
I would expect a flash model, with its reduced size, to suffer on tail tasks. That is the trade-off you make.
mattjoyce 6 days ago [-]
Hallucination seems a very dated term.
nkozyra 6 days ago [-]
Why? It's the same concept and root cause it was when we first started using it.
gottorf 6 days ago [-]
Hallucination is accurate for what I'm seeing -- e.g. it's making up information about the 2nd gen Toyota Tundra that has no basis in reality. When challenged, it corrects itself.
alluro2 5 days ago [-]
My colleague wanted to diagnose a specific error code on his car himself, and Gemini told him that it's simple to do with an OBD2 dongle - he asked it about the details thoroughly, to confirm, and bought the dongle.
It didn't work. Gemini: "Oh yeah, that obviously cannot work, it's not possible to do it through OBD2" (paraphrasing)
It was quite funny to me, but a bit less so to my colleague.
Gareth321 5 days ago [-]
I've had many similar experiences. It's confidently incorrect to a shocking degree. Worse than ChatGPT from two years ago.
mattjoyce 5 days ago [-]
Its always been a bad term.
If we wanted an accurate term then it's 'confabulation', but 'muddled' or just 'wrong' are also good.
rdtsc 6 days ago [-]
What do we use for the “model made stuff up and claimed it as facts”? I can see hallucinations somehow anthropomorphizing LLM even more. I don’t like that we’re doing that to begin with but it’s a losing battle. I prefer “it’s broken” and “IT produced shit results” personally.
5 days ago [-]
mattjoyce 5 days ago [-]
I agree with you, except I really don't hear that term much. People just say it wrong or confused. Good riddance, it was always a bad term.
xdavidliu 6 days ago [-]
there are many dated expressions, including
- AI is just a tool, like excel; it does what the human operating it tells it to
- next token prediction cannot be true understanding
- models can have no desires and goals, don't anthropomorphize it
However, "hallucination" is very much not one of them
UpsideDownRide 5 days ago [-]
They still happen.
mirmor23 6 days ago [-]
> it proceeded to attach GDB to my GPU driver, reverse-engineer the kernel queue ioctl interface, and author an LD_PRELOAD C shim to get ROCm llama.cpp working on my Strix Halo.
Most llm could do it. Claude went from firmware thread -> rtos scheduler -> mcu reference manual -> hardware controller register interface -> vendor sdk -> problem identification and the solution to it in a matter of 30 minutes. Linux could be even easier since it is so well trained on.
martythemaniak 6 days ago [-]
Adding my anecdote, because it amused me: I finished wiring up the compute/sensor box for my robot, ssh'd in and told agy "I have a Livox Mid 360 Lidar connected to this Jetson orin nano, setup a full environment with docker, cuda, ros2, foxglove and get it all working so I can see the lidar output". It did all the local config for the lidar, setup docker and the ROS2 environment, then told me "open up this url in foxglove" and sure enough everything worked. Whole thing used up 6% of my weekly limit.
yegle 6 days ago [-]
For getting redroid running on my Linux system, 3.8 Flash decided to binary patch a .so file instead of getting the AOSP source code and patch/build it properly.
And I saw it do this twice, once for Android 14 and once for Android 16.
I think this is just within 3.8 flash's capabilities.
p_l 6 days ago [-]
3.8 Flash (but also last two ones) have really strong preference for dissecting binaries with quick thrown-together bits of python in my experience.
Including going first for decompiling AGY binary instead of searching the web for documentation...
IshKebab 6 days ago [-]
Astra also really loves reverse engineering binaries. I guess it's one of those things that isn't that complicated but is super tedious, and tedium means nothing to AI.
danpalmer 6 days ago [-]
3.8 Flash is my daily driver and produces pretty excellent results all round.
dcl 6 days ago [-]
What harness you use? Have you tested more than 1?
danpalmer 6 days ago [-]
This experience is with Antigravity both internally and externally, and I have done quite a few side-by-side comparisons with the same prompt across a number of different Google and non-Google models.
I've tried Codex as a harness too, and that was nice. I don't find a significant difference between Antigravity and Codex. Codex has more features but I don't use them.
illwrks 6 days ago [-]
I've been tinkering with Gemini for several months and I think it's great. The most complex things I've had it do is create a rust emulator from a compiled game, as well as create a buildroot linux image, trouble shoot problems etc.
mapontosevenths 6 days ago [-]
Gemini is honestly amazing sometimes. If they didn't force you to use a terrible harness, charge too much for way too little, and generally act like customers are a giant problem to be avoided I'm sure Google could take over the AI market.
barrenko 5 days ago [-]
Google's approach reminds me of what could have been the EU's approach, they are really reluctant and drag they feet, but in the end they end up shipping and are competitive.
ody4242 6 days ago [-]
what is so terrible with their harness? I've been using gemini cli, now use agy, Pi agent harness, and agent (cursor), and my only real issue with agy was the permission handling, but other than that, it was ok.
Grimburger 6 days ago [-]
> I was trying to use rocm with llama.cpp
completely offtopic but is rolling with rocm worth it? I spend a fair bit monthly on rental gpus for projects and going to upgrade at home instead, AMD has some solid winners here pricewise but get conflicting reports about using it for ML in 2026.
once upon a time it seemed unthinkable to use anything but nvidia but seems to have come a long way since I last looked, probably would be just pytorch and gemma 31B
I get the feeling the situation is only going to improve longer term so might be a good time to just do it
nzeid 6 days ago [-]
I have so much to share on this topic. Will keep it short.
ROCm promises a 30-50% prompt processing speedup. This is REALLY important for my workflow so I've been trying to get this shit to work for months. But no release before v10 worked well enough with any engine for it to matter.
The llama.cpp release binaries for ROCm (10) FINALLY work on gfx1501 and its relatives (with the correct shell variables), but the prompt processing boost doesn't materialize and the token generation speed decreases.
There continues to be a chronic problem across all engines with the ROCm integration for UMA devices. The good news is that some improvements have been made to that end for Vulkan, so more recent llama.cpp Vulkan binaries are now faster.
clw8 6 days ago [-]
Support has gotten much better in just the last couple months. I just got a 9070 XT and can't count the number of times I've installed a package and the changelog made me think how much it would have sucked to be doing this a year ago.
esseph 6 days ago [-]
> completely offtopic but is rolling with rocm worth it?
Then you can easily throw a openweb-ui container in front, and then connect to the openweb-ui via your mobile app of choice (if you want chat, otherwise you just point your harness of choice at the lemonade server api endpoint).
gcy 6 days ago [-]
I use 3.8 Flash for daily troubleshooting tasks e.g. help me find out why certain app crashes or certain website does not load normally with playwright-cli. Sure it's not as capable but it's fast and almost free (sufficient quota with pro account).
The only thing that bugs me is that I need to use `--dangerously-skip-permissions` as it does not have auto review.
KMnO4 5 days ago [-]
My theory is that Gemini 3.8 Flash was supposed to be Gemini Pro, but by the time it was ready for release, Google was embarrassed at how far behind their "pro" model was, so they just named it Flash. It's a good model, but don't let the name trick you.
w0m 5 days ago [-]
I'd agree if it wasn't so much faster than ~all the other models. Maybe they nerfed reasoning to get that speed.
crossroadsguy 5 days ago [-]
So Gemini Pro (I use agy, because no other harness can be used for subscription plan) was supposed to get Gemini 3.5 Pro, at some point (it was planned, right?), but instead Argon arrives and I am pretty sure it will only be in Ultra sub and don't think 3.5 Pro is coming anymore.
p_l 5 days ago [-]
3.5 Pro has been pretty much canceled for few months now, 4.0 was in the works instead
d3Xt3r 6 days ago [-]
That's cool, but the real question is, why aren't you using Hipfire[1] or HaloPFX[2]? Both are far superior to llama.cpp in terms of performance, for Strix Halo.
I would like to use my Google AI Pro subscription included with Drive but last time I checked, their terms were not just ambiguous and confusing wrt training and ZDR, they were contradictory.
Until they have that fixed and properly communicated, I'll stick to other vendors.
phmx 5 days ago [-]
```
void* mmap(void *addr, size_t length, int prot, int flags, int fd, off_t offset) {
if (!real_mmap) real_mmap = dlsym(RTLD_NEXT, "mmap");
```
hope it's not run by multiple threads and dlsym is not allocating.
I coincidentally just installed this (like 30 minutes ago), and gud dayum, it's pretty awesome.
I say this is awesome, even as I glossed over the README and vomited in my mouth. The halogen repo looks like the same utter AI bullshit littering GitHub. But this one delivers, in spite of it's slop-riddled hallmarks.
In any case, yeah, ~55 tok/s on a high quality model (and massive RAM savings I think?), seems dope.
cyanydeez 6 days ago [-]
Yeah, unfortunately, it does deliver for its platform.
alightsoul 6 days ago [-]
Please tell me you published your findings even as an issue on the llama.cpp GitHub
If you read the code you would realize that the issue is....
in amdkfd and hsakmt
Yes, that means AMD is sitting on both sides. They wrote software that doesn't work with their own software.
otabdeveloper4 6 days ago [-]
Spoiler alert: the problem didn't actually get fixed despite the jaw on the floor.
dominotw 6 days ago [-]
he is still closing his jaw
warkdarrior 6 days ago [-]
Why? Anyone can run that prompt.
aspect0545 6 days ago [-]
Not everybody has access to AI. More than that, every prompt uses insane amounts of natural resources. So why not share it.
AuthAuth 5 days ago [-]
They dont understand the fix so sharing a vibe coded patch is upstream spam. They should submit a bug report and their findings. (Written by them not AI)
dzhiurgis 6 days ago [-]
Took me 6M codex tokens yesterday to get omarchy wifi working on macbook
alightsoul 6 days ago [-]
That is not normal. Were you able to use the arch wiki? Omarchy is a version of arch Linux. Omarchy should direct users to the arch wiki for any issues they face
dzhiurgis 5 days ago [-]
IDK how it fixed it exactly, I suspect it's macbook specific issue. It wasn't accepting my wifi password and 5ghz radio wasn't working. Steering it to fix 5ghz sorted it out. I'm not going to any wiki's myself, fuck that.
FranzFerdiNaN 6 days ago [-]
The resources per prompt aren’t that much .
Also I hope you don’t have children, eat meat, travel, have a car, run AC, buy things in other countries and such. Those things all take way way way more natural resources.
articulatepang 6 days ago [-]
All your examples are private goods: excludable and rival. If one person uses a unit, that prevents others from using them.
Patches to open source software are public goods. Your using them doesn’t prevent others from using them. So if you spend resources creating a public good, it’s in everyone’s interest to share it.
qmr 6 days ago [-]
Yet you participate in a society.
scarmig 6 days ago [-]
If action X takes a million times more resources than action Y, it's silly to focus on or highlight action Y. Seriously: if you are a regular meat eater, your choices use several orders of magnitude more water than even a heavy LLM user. A quip from a comic doesn't somehow erase that or make it irrelevant.
qmr 4 days ago [-]
It gets me 10 internet points though.
hexfish 6 days ago [-]
Checkmate. /s
baby_souffle 6 days ago [-]
Wouldn't it be better if only one person had to and then we all got to benefit from the fix?
Why would the guy who wrote curl share it? We can all build our own now...
Why do the Linux folks need to be so selfless? We can all build our own kernel now...
luckydata 6 days ago [-]
why reinvent the wheel and spend tokens for a problem that has already been solved?
folkrav 6 days ago [-]
Why would we even ever distribute software again, by this logic?
lardo 6 days ago [-]
Did rocm provide any benefit over vulkan?
taylorfinley 6 days ago [-]
Vulkan was reliably crashing after a certain point in the context window, Rocm has been stable as a rock. Tps was basically a wash.
iknowstuff 6 days ago [-]
lol I've hit the hipStreamCreate problem!
qrify_app 6 days ago [-]
[flagged]
la6479 6 days ago [-]
[flagged]
bel8 6 days ago [-]
I had a similar but less impressive experience recently with Muse Spark 1.3.
Asked pi agent it to identify the main hero sprite size of game I was running. It had a ton of shader effects so it was hard to determine.
It used some cli tools to identify that it was a game made with Godot, decompiled the executable but data was encrypted, broke the encryption after writing a brute force tool to test keys extracted from the exe, then proceeded to extract the game gd scripts and assets, only to answer the question of the sprite size.
seanthemon 6 days ago [-]
Godot encryption is laughably easy to break, there's tons of packages available for it. It's a well known drawback of using godot
bel8 6 days ago [-]
I didn't say it wasn't.
Still impressive that it did so much just to answer my simple question.
warkdarrior 6 days ago [-]
Now the LLMs know it too.
nickysielicki 6 days ago [-]
The important take away here: the leapfrogging we’ve seen this year doesn’t seem to be a temporary thing. The famous theory of Dario Amodei was that AI was this winner-takes-all field where the first team to get a head start would never cede ground back. The term he liked to use was, “concentrating”. This is yet another datapoint that he was wrong about that. AI seems more distributed amongst neoclouds and traditional hyperscalers, FAANG and startups, GPUs and ASICs than it did this time a year ago.
Nobody has a moat.
LarsDu88 6 days ago [-]
Google has TPUs, a frontier model, a completely separate and lucrative revenue stream they can call on at will, and teams working on multiple different language modeling strategies simultaneously. Did I mention the vast and ominous data centers that already serve a significant fraction of the internet? If that ain't a moat, then what exactly is a moat?
disillusioned 6 days ago [-]
I have _long_ said don't sleep on Google for precisely these reasons. They have the only vertically integrated AI stack, insane capital they can deploy, and attention and focus and phenomenal architects and engineers, and a pre-existing catalog of as much of the world's data as possible. Counting them out would be completely absurd.
It started to feel just a bit like they were potentially content staying in the effective-fast-cheap lane and ceding frontier models to frontier labs, but I don't think anyone seriously thought that Google was going to sit back and let this generational shift pass them by when they're so well positioned to remain on the top of the heap.
If anything, I thought that 4 was maybe coming up short or causing safety concerns that were forcing them to be a bit more cautious, but nothing packs a wallop like being able to launch ahead of everyone else's brand newest toys...
bdashdash 5 days ago [-]
I agree on all except for your comment on attention and focus. They've seem to be very scattered in their deployment of AI for customers. Examples in point being the replacement of Google Assistant with Gemini, the AI Studio vs Vertex disconnect, and a crazy amount of coding tools and platforms (Duet, Firebase Studio, Studio Bot, etc).
Working through this as a consumer and enterprise customer has been a confusing experience, to say the least.
Sammi 5 days ago [-]
Strongly agree - their approach has been extremely scattered. But also, doesn't it seem like they're starting to consolidate? It kinda makes sense to approach things like this as a mega corp. Have internal teams try the same things in different ways and let the market pick a winner. Kinda like being a startup incubator.
LarsDu88 5 days ago [-]
I've also noticed this. Anyone noticed they replaced "Vertex platform" with "agents platform" recently while changing nothing under the hood?
Google's biggest problem is its turf wars. Internal battles for territory always seem to outweigh efforts to expand markets
garlicderek 5 days ago [-]
Maybe the turf wars are yet another sign they shouldn't be a single company? Still blows my mind.
tornikeo 5 days ago [-]
A vertically integrated AI stack won't fix the misaligned incentives of google execs.
AI is strangling their other major business and they don't like that. Unless Google sacrifices that branch of income, they won't put their full force behind AI.
wxnx 5 days ago [-]
I'm curious -- in your view, what exactly is it strangling that could not be addressed by replacing google.com with a ChatGPT-like interface while integrating other Google free-by-ads tools nicely? Or is your point they wouldn't do that due to existing "siloed incentives"?
AdamN 5 days ago [-]
This is classic innovators dilemma stuff and for sure the Alphabet board is aware of it. It's not an easy problem to solve at scale though.
Tuna-Fish 5 days ago [-]
The ads in google search are ~55% of their revenue and ~70% of their profit. Will the LLM drive as much traffic to the ads as the current google search? Will it feel as organic to the users as the current solution, or will LLM hawking a product seem forced by the users?
HackerThemAll 5 days ago [-]
> They have the only vertically integrated AI stack, insane capital
and paying enterprise customers.
LarsDu88 5 days ago [-]
One of which is looks at notes Apple Computer
Gasp0de 5 days ago [-]
I mean it sounds wise to not go all in on publishing expensive models when they can earn money with more efficient models while still not bleeding too many customers?
giancarlostoro 6 days ago [-]
I've been lowkey rooting for them, not a fan of Altman, and I don't know if I trust Anthropic either, I'm not Google's #1 fan, but I think they can definitely innovate heavily in this field, they have a lot of key things as has been mentioned.
pedalpete 6 days ago [-]
I'd add that we've seen how the leadership/reputation of different AI leaders, and with 2 decades of history with Larry and Sergey, they seem to come up on top as the most respectable.
Did they ever really abuse the power Google could have wielded?
I could be missing something, but for the most part they seem to just get down to building and pushing technology/science forward and avoid drama rather than welcome it.
AlexErrant 6 days ago [-]
They're literally not upstreaming Android security fixes:
> Google should not be gatekeeping security patches to the standard Android platform code from Android OEMs but that's what they've started doing.
The whole Android developer verification program controversy.
These 2 are the recent things that come to mind that are most adjacent to "power-abuse".
hobo123 5 days ago [-]
I wonder if AI could analyze a kernel diff, extract the doctor fixes, and apply/transfer them to an older Android kernel that's out of support.
simiones 5 days ago [-]
> Did they ever really abuse the power Google could have wielded?
Plenty of times. Perhaps the worse is pushing Manifest v3 with no support for real ad blockers in Chrome. Not to mention no support for ad blockers in Chrome mobile.
Also, their stealing of newspaper content.
Their new push for AI summaries instead of actual search in their search product, stealing even more clicks from sites that actually produce information.
YouTube pushing Shorts to everyone, and now the weird text posts that you can't hide.
In general their gigantic push for ads everywhere all of the time.
yostrovs 6 days ago [-]
Google, with the help of Facebook, destroyed the independent online publishing business. They made it impossible to maintain an honest publication and tunneled users to low quality websites until there's not much left of respect.
giancarlostoro 5 days ago [-]
> Did they ever really abuse the power Google could have wielded?
The "Do no evil" never being an official slogan and people saying it's no longer true for the last 10 years or so, they're just really massive. They do mess up a lot, but when you're Microsoft, Apple or Google sized, its nearly impossible to get everything right all at once.
greesil 6 days ago [-]
They are a search and ads monopoly, so there is that.
dns_snek 5 days ago [-]
> Did they ever really abuse the power Google could have wielded?
Is this a sarcasm?
solenoid0937 5 days ago [-]
What are you talking about? They've literally contracted with the DoW with no red lines.
That's "trustworthy" to you?
OccamsMirror 6 days ago [-]
Both founders are in the Epstein files, with Sergey Brin visiting Epstein's private island.
LarsDu88 5 days ago [-]
There are pictures of Sergey in the files, but they are rather milquetoast. He's just sitting next to David Brooks of the NYTimes. I don't think there's any evidence he's engaged in sex abuse.
throwepsteinawa 5 days ago [-]
The main reason Google had masseuses in the early days was that Sergey used them as his personal harem
weatherlite 6 days ago [-]
Come on but who hasn't been there really, freaking Steven Hawking was there...
simiones 5 days ago [-]
Which tells you of the poor moral character (if not outright participation and complicity) of many people who seemed respectable.
wf3fsfsef 5 days ago [-]
[flagged]
WarmWash 6 days ago [-]
Eh, people are pretty upset about the ad-driven nature of the internet which was largely spearheaded by Google.
However, I don't think the alternative would have made people any happier (and frankly they probably would be justifiably even more angry)
vincnetas 5 days ago [-]
Can you give any hypothetical examples that you have in mind. World without google and how (even more angry)
WarmWash 5 days ago [-]
The alternative would have been paywalls galore with subscription tiers for everything. Only rich people would be able to afford having subs for everything, while the poor would just get the most dirt tier scraps and wouldn't be able to afford many platforms.
Nothing would be "free", so google sub, news source subs, reddit sub, youtube sub, discord sub, instagram sub, FB sub, app stores are full of paid only apps, podcasts are all paywalled, all the ad supported stuff is subscription supported. Everything would feel like constant nickle and dime'ing you.
On the bright side, there would be no ads, and relatively robust privacy.
rusticpenn 5 days ago [-]
Ehh, the internet was worse before Google. Google actually became popular for having a nice blank page with only the search bar. Even the ads they had later were much cleaner compared to yahoo, altavista, lycos, aol and other firms of that time.
rdtsc 6 days ago [-]
I am not rooting for them, I don’t own stock from either just that like GP I was sure by now Google would have eaten others’ lunch. I was expecting a Gemini 4 before Mythos/Fable and Astra just from what GP pointed out: a cash hose, data centers, good engineers. But I underestimated the investment others would keeping absorbing so started to lose confidence in my Google prediction. Let’s see how Gemini 4 holds up. Are we going to see a flurry of scientific and mathematical breakthroughs from it?
scrollop 5 days ago [-]
Please check Gemini's t and c, as the last time I checked when they had a good pro model (3.1) you couldn't turn off training on your data with a paid account .
landdate 6 days ago [-]
[flagged]
throwitaway222 6 days ago [-]
Not to mention - they have the internet already indexed (they have a local copy), all books, and youtube. Beyond that, everyone "connects" to Gmail, but google HAS Gmail.
falcor84 5 days ago [-]
I don't know what to make of it, but from my experience, Gemini in Gmail is the worst AI integration for Gmail, just like Copilot in PowerPoint is the worst AI integration for PowerPoint.
throwitaway222 5 days ago [-]
I agree with you there - what I mean however is more about the vast amount of training data available to Google. Productwise - I have a feeling the 100x'rs that made Google Maps (and even Gmail itself) have moved on. They're going to need to do more than just tell an agent to add agentic features to Gmail
UncleOxidant 6 days ago [-]
Recently there's been a lot of talk about how Google has fallen behind and missed the AI boat. Now today with Gemini 4 they're back in the boat. But give it a few months, people will be counting Google out again. This has been a repeating pattern for at least a couple years now.
giancarlostoro 6 days ago [-]
The thing is, Google doesn't have to scramble and freak out every time the others do some impressive update, because they have stable income, the other two do not.
WarmWash 6 days ago [-]
Moreover, Google is getting paid out by both to serve their models.
boringg 5 days ago [-]
Kind of and kind of not. Their main resource of serving ads is getting legitimately eaten away. The route to getting AI to replace those ad dollars isn't clear and the capex to build it out is significant. Google has to manage a variety of assets that are currently lucrative but under threat. Yes they don’t have all their chips in one basket but it isn't clear that helps them in the race… it hasn’t so far.
singularity2001 5 days ago [-]
their stable income is eaten away by the quickly rising income of the labs, they will be out of the race once the labs reach a certain threshold of income, rather sooner than later. Unless many people install Google surveillance anti-gravity thing on their system which I doubt
izacus 5 days ago [-]
Maybe you should check latest Google's earning calls - nothing what you describe is actually happening.
jack_pp 5 days ago [-]
There's a lot of AI hate these predictions aren't taking into account
cco 6 days ago [-]
It wasn't that they were out of the running for a few months, it was a year and a half.
That's too long to be so far behind. This release looks like it puts them back in it but if they don't ship anything again for a year plus it's hard to imagine building on top of them and watching the world go by.
As others note, this is most relevant for us here, Google does not need to chase YC developers and the like. They can move more slowly, they have the size to do that. But it does suggest a lot of dysfunction given they have the world at their fingertips and couldn't seem to ship anything for a year.
_fw 6 days ago [-]
Google aren’t back in the boat. They’ve announced that they have seen the boat, intend to swim over to it and will sail not quite as fast or as far as the other boats.
Google should be dominating, but instead all we currently have is a disparate collection of consumer facing apps and a flash model that’s fast, clever and expensive.
Muse and Dots are doing what Google should have brought out last year, with their resources and know-how.
dieortin 6 days ago [-]
Aren’t Muse and Dots literally the same as Gemini Spark, which came out months ago?
com2kid 5 days ago [-]
Googles subscription offerings are so confusing, I didn't even know gemini spark was a thing. The Gemini brand means so much now.
Meta was genius in coming up with a new name and offering Muse for free to start. They can upsell you once you see the value. Meanwhile I have 3 existing Google subscriptions to different services and from what I can tell, paying for one of the all in one subscriptions that includes Gemini would cost me a lot more.
villish 6 days ago [-]
They are more focused on incorporating AI into their products, for better or for worse, but they could burn a whole lot of compute to train a model that competes for the #1 spot. Is that worth it to say you’re the (temporary) leader in AI? I doubt it.
computerex 6 days ago [-]
This model isn’t even generally available..
8note 6 days ago [-]
I still wouldnt build with any of google's stuff.
the risk of randomly getting my email banned is way too high
ivanmontillam 6 days ago [-]
I share the same sentiment. I de-Googled myself except for YouTube, but still wouldn't want my Gmail banned.
That's why I've gone to using open models, they are getting there slowly. A bit much of hand-holding but that's fine by me. If a customer of mine decides to use Google's models, I will have them sign a disclaimer that I'm not responsible of them getting insta-banned or similar. I just can't recommend it.
selcuka 6 days ago [-]
You can always use a broker such as OpenRouter to use their models.
elictronic 6 days ago [-]
Large existing players are pretty notorious for screwing up their leads and trying to move in many directions at once, or go to hard into the wrong one. Based on Google's huge number of failed products and poor ability to maintain products outside of ads I am not yet sold. They are very good at buying out their competition, but what happens when their competition has enough money not to be bought out?
jobs_throwaway 6 days ago [-]
Then why have they been lagging behind OpenAI and Anthropic for most of the last few years, and only briefly been at the frontier?
aleph_minus_one 6 days ago [-]
>
Then why have they been lagging behind OpenAI and Anthropic for most of the last few years, and only briefly been at the frontier?
One possible explanation: because Google is a little bit more frugal and focuses on how to make providing AI models financially feasible - combined with some willingness to burn money so that they don't strongly fall behind on their AI models.
On the other hand, OpenAI and Anthropic at least formerly concentrated on building and providing the best models that they could with concerns about financial feasibility taking a backseat.
Just to be clear: I do have the impression that by now (likely because of pressure from investors) OpenAI and Anthropic take these financial concerns more seriously, but nevertheless Google's vs OpenAI's/Anthropic's "DNAs" concerning on what to focus on differ.
monkeydust 6 days ago [-]
And also Google is public listed company and the other two (for now) are private. I think that fact does have a strong bearing on how they operate.
topspin 6 days ago [-]
> because Google is a little bit more frugal and focuses on how to make providing AI models financially feasible
That feels right. It's not as if they've been missing out on great profits.
dansquizsoft 6 days ago [-]
Yeah, I'll bet they haven't even wanted any of that sweet Anthropic revenue from being at the frontier of coding models for the last year...
blinding-streak 6 days ago [-]
Anthropic is a private company that is losing money hand over fist. Google is a profitable public company that doesn't have that luxury (at the scale Anthropic/OoenAI are losing money)
tapoxi 6 days ago [-]
Revenue isn't profit, inference is expensive
staticman2 5 days ago [-]
After research and development costs and employee salaries I don't believe Anthropic is profitable.
ErrantX 6 days ago [-]
I think this is the correct answer.
Google never really has to outpace the competitors (other than to have some relevance) but they have a very large group of business customers using them for business process work in Gmail, Docs, etc.
Clearly they will win when the models are close enough to frontier to be good enough, but are long-term cheap for buy. I.e. they will aim to make it a commodity.
In theory MS has the same opportunity (plus they have GitHub so, you know, dev eco system too) but seem be blowing the strategy.
Anthropic and OpenAI are having to race to the top on ability entirely to keep their name in the media and in front of us all (which costs: hence more recently trying to pivot away from model releases and more into controversy/danger). The main cost is in training and so this strategy is much much more expensive and this will play out either as a huge cost hike or a forced slow down in pace.
I believe essentially Google is betting on that & I think it's probably the right strategy.
> In theory MS has the same opportunity (plus they have GitHub so, you know, dev eco system too) but seem be blowing the strategy.
Yeah, they have Phi but offer it nowhere on CoPilot as far as I know, I can't even register for copilot, which is bizarre. They came out with "MAI" but... nobodys talked about it since, not sure if its even used by anyone? They're as bad as Mark Zuckerberg is about it.
I do appreciate both Microsoft and Google for releasing small models, unlike Anthropic and (not so) OpenAI.
bushbaba 5 days ago [-]
Yes and no. Microsoft is likely looking at open weight models and going oh, this is just as good or better than we could do, without the training costs, and we simply are an inference commodity provider where azure already operates. Count us in.
BobbyJo 6 days ago [-]
> Google is a little bit more frugal
I'm gonna need you to look at the capex obligations they've undertaken in the last 12 months. They are definitely not being frugal. If they are behind, its not for lack of spending.
JV00 5 days ago [-]
Capex on data centers can be for additional gcp capacity for their customers, not necessarily spend for internal r&d.
LarsDu88 5 days ago [-]
When Meta, OpenAI, or Anthropic expand capacity, it's for their services. When GCP does this, it's for ALL services.
haldujai 6 days ago [-]
Frugal when it comes to AI model development.
redanddead 6 days ago [-]
> Google is a little bit more frugal and focuses on how to make providing AI models financially feasible
There’s no magic there. You get an account executive and a call with a systems architect to find out what you’re doing.
Clouds gonna cloud, this is the reason they rolled deepmind into gcp and arguably the inverse is true, the labs are trying to become clouds
surfmike 6 days ago [-]
I think they've legitimately been fumbling the frontier race, but fortunately with not too much impact to their profits.
See for example the exodus of talent this year, triggered by mismanagement and politics. They still have a lot of talent but they've lost a lot.
Also, competition with Google Cloud for compute resources, less urgency and focus than the competitors, and (strange to say) not as much user LLM behavior data to feed to RL for coding, work, etc.
But I think they will keep catching up and stay relevant for a good class of LLM use cases.
blinding-streak 6 days ago [-]
I don't know exactly why the talent left. But this talent couldn't produce a serious frontier model over the past 6 months. Several months after high profile departures, Google appears to have a high quality model again. Maybe the high profile folks were overrated at best, or a hindrance at worst.
root_axis 6 days ago [-]
> Then why have they been lagging behind OpenAI and Anthropic
Because they're not desperate. Slow and steady wins the race, at this rate all Google has to do is wait for OpenAI and Anthropic to exhaust themselves on aggressive training, then they can casually amble along right past them.
pavlov 6 days ago [-]
This is basically what people were saying about Microsoft versus Google and other upstarts in the early 2000s.
Slow and steady wins the race. How could they lose to something on the web, when Microsoft owns the web browser itself? Everything runs on Windows and IE. They can just relax and wait for competitors to exhaust themselves, then quickly build their own version. Isn’t that how Netscape lost. Etc.
Now Google is the new Microsoft, just like Microsoft became the new IBM.
overfeed 6 days ago [-]
> This is basically what people were saying about Microsoft versus Google and other upstarts in the early 2000s.
They would have been right if Google's marquee product was an Office Suite.
Google was the AI company before AI companies were a thing. The comparison with Microsoft and IBM are misplaced because they failed to capture new territory; ML/AI is Google's stomping grounds. The criticism that Google is bad at consumer chatbots is true, but that's not where the real future value lays.
kursus 6 days ago [-]
I've never heard or read anyone saying this in the early 2000s. They had publicly stated their contempt of the web earlier, made fools of themselves when they realized their mistake and went all-in on it, and spent the whole decade lagging behind. The closest they had to an online success was Wizzes.
brazukadev 6 days ago [-]
Yes Google is the new Microsoft, even Microsoft is still the old Microsoft but OpenAI is not the new Google.
guelo 6 days ago [-]
For some of us OpenAI is already the new Google. I prefer chatgpt even when I'm searching for web links. Google Search had already been deteriorating terribly even before the rise of LLMs.
root_axis 5 days ago [-]
A big difference is the existential levels of debt.
bamboozled 6 days ago [-]
But Microsoft seems to be doing fine too ?
pavlov 6 days ago [-]
And IBM has a market cap of over $200 billion.
When the market keeps expanding, you don’t need to kill your predecessor. The shelf life for legacy enterprise computing is very long.
browningstreet 6 days ago [-]
Not in AI. But they announced things last week so maybe..
ivanmontillam 6 days ago [-]
Also because they are Google. Google being Google: unreliable (they could kill a product anytime), too much of a platform risk (all products in a single place, get banned and lose the company), lack of support unless you really pay a big bill (into the 7 figures), among other… things.
Traubenfuchs 6 days ago [-]
Incredible how the idea of Google being such bad choice has become so entrenched that people prefer the offerings of two companies that might not exist anymore in a few years over Google‘s similar offering.
brazukadev 6 days ago [-]
> people prefer the offerings of two companies that might not exist anymore in a few years
That's actually a feature. We don't need 2 new Googles.
lemoncookiechip 6 days ago [-]
Alphabet isn't just an AI lab, they're an ad company, a search index, a media distribution company, an email provider, office tool provider, a OS developer, a browser developer, a smartphone brand (Pixel), cloud provider, DNS, amongst a plethora of other services and goods.
OpenAI and Anthropic are AI business, if the AI market burst tomorrow, they'd be the first to flounder.
Google just has to keep pace in the AI space, they don't have to lead. Especially since whom is leading changes like two or three times per month non-stop for four or so years now, including small (by US standards) Chinese AI labs with a fraction of the money who keep pushing the tech forward every month while being open for now.
aforwardslash 6 days ago [-]
> OpenAI and Anthropic are AI business
Technically, they arent even a business. One is a business when the revenue model works. People in IT tend to forget that.
tfsh 6 days ago [-]
> Then why have they been lagging behind OpenAI and Anthropic for most of the last few years, and only briefly been at the frontier?
Because it's not an existential battle for Google. If OAI or Anthropic disappear from the absolute frontier for ~8 months the news cycle and churn will diminish them to the second rate. Google is processing near 4 quadrillion tokens every month, that's - I'm sure - significantly more than OAI or Anthropic, because Google is interested more so in their flash models and getting these competitive, which they are.
redanddead 6 days ago [-]
It’s just a division in their cloud offering that’s what AI is
JV00 5 days ago [-]
It used to be true before Luna but right now flash and flash lite are not competitive at all
senordevnyc 6 days ago [-]
[dead]
merb 6 days ago [-]
From a business perspective a frontier model does not make much sense anymore if you are not a startup. Neither for Amazon, nor for Google. Their clouds need models that are fast and perform well in their agent frameworks nothing were a frontier model excels at.
Most Google products even use flash lite underneath, so their frontier model is mostly used for distillation.
aleph_minus_one 6 days ago [-]
>
From a business perspective a frontier model does not make much sense anymore if you are not a startup. Neither for Amazon, nor for Google. Their clouds need models that are fast and perform well in their agent frameworks nothing w[h]ere a frontier model excels at.
A good consideration; just one point from my side: as far as I am aware (but I may be wrong), Gemini is not known to perform well in an agentic framework.
This is no contradiction to your other claims, quite the opposite: perhaps (or even likely) Google wants to avoid that their models become a commodity in some (agentic?) application where the middleman who actually writes this application gets a disproportionate of the money that the customer of the application pays for it.
merb 6 days ago [-]
Well at the moment we do not use Gemini in an agentic framework. But as said the flash and flash lite families are basically their driving force in some of their applications in Google cloud, like document ai and its ocr capabilities are probably better when it comes to business documents than any other (at least in perf to cost to speed).
We also drive Gemini lite in our application where customer can use it to generate simple automation, like an agentic framework but way way smaller scale. And while it struggles in more context heavy operations it still is a beast when feeding it one or two pdf documents and asking questions about them and it’s hella fast.
dcbuilds 5 days ago [-]
[dead]
nozzlegear 6 days ago [-]
> A good consideration; just one point from my side: as far as I am aware (but I may be wrong), Gemini is not known to perform well in an agentic framework.
I used it for a month over the summer, right before they were going through the migration to antigravity. It was a fine workhorse IMO, no complaints from me.
brazukadev 6 days ago [-]
Why did you stop using it then?
nozzlegear 6 days ago [-]
I prefer open and local models, that's all.
weatherlite 6 days ago [-]
> From a business perspective a frontier model does not make much sense anymore if you are not a startup. Neither for Amazon, nor for Google. Their clouds need models that are fast and perform well in their agent frameworks nothing were a frontier model excels at
I don't know , if it really finds all kinds of data center optimizations, quantum breakthroughs, helping make their workers smarter and more efficient - stuff an opensource model can't quite do - there's real economic value here no ? perhaps not worth dozens of billions but it could get there really fast.
rstuart4133 6 days ago [-]
> Then why have they been lagging behind OpenAI and Anthropic for most of the last few years,
The reverse could also said to be true. Google has models that run with search, producing usable results in well under a second. I suspect the world is consuming far, far more of those Google tokens then the tokens produced by OpenAI or Anthropic.
So why are OpenAI and Anthropic so far behind? They are serving a different market: the one that wants high intelligence / high cost tokens. Google is targeting the low cost end of the market - ie the commodity. That's where they've always played with search, email, docs and the like. That's were they are playing with AI too, and they are killing it.
KingMob 5 days ago [-]
We have very different opinions of the usability of Google's low-end models in search.
If anything, their search was the gold standard, and placing sometimes-wrong LLM results above them has hurt people's perception of both Google's search, and AI in general.
Google made a mistake in prioritizing speed over accuracy there.
krona 6 days ago [-]
Alphabet issued a very oversubscribed 100-year bond with 6.1% yield earlier this year to raise capital for datacenter expension.
Meanwhile, Anthropic/OpenAI will struggle to survive the next 24 months on their current trajectory.
jobs_throwaway 5 days ago [-]
> Meanwhile, Anthropic/OpenAI will struggle to survive the next 24 months on their current trajectory.
Want to make a wager? I think it's wildly unlikely that Anthropic/OpenAI will not survive the next 24 months
jeremyjh 6 days ago [-]
So you don't know why they've been behind?
Yizahi 6 days ago [-]
Lagging by what metric exactly? Is Toyota lagging behind McLaren? (company vs company)
jobs_throwaway 5 days ago [-]
Performance of their flagship model
richardw 6 days ago [-]
Given the spend requirements to stay on the leading edge and the speed (and with low cost) that others catch up, the economics support a fast follower model unless you get some benefit from being a pioneer. So far nobody has received a permanent benefit from being ahead.
Chinese models are barely behind the leaders. Google can catch up anytime they hit the gas. I think they’re intentionally spending less, and when this crazy race burns out they can play their cards.
throwaway23597 6 days ago [-]
I think Google, mainly Demis, just made a bad bet that multimodal world models would be the key to unlocking massive progress. Anthropic made the bet that it would be coding, and they were right. OpenAI was originally betting on like hardware and trying to compete in the browser space (?) but was able to quickly pivot to coding due to their size. Google, on the other hand, is like an aircraft carrier, it takes a lot of time to course-correct.
LarsDu88 5 days ago [-]
That's one interpretation, but I think people are simply having amnesia of the past 2 years.
The better interpretation is Google completely commoditized and killed ChatGPT's initial chat product. If you think about it, Google right now has Gemini Flash running on single TPU instances at massive scale serving almost every android device. I use it every day and it's more capable than GPT-40.
This literally forced Anthropic and OpenAI to come up with new use cases and revenue streams such that now we think the product is actually agentic coding.
I use Gemini Flash every single day without paying a dime. It's the one LLM call on the most, but GPT-6 and Opus are the ones I use the most tokens on.
aforwardslash 6 days ago [-]
They havent. OpenAI and Antropic are now integrating with a plethora of apps, google has it from the get-go. Also, it may be important to point out that the transformer model (aka the hole llm thing) is a google initiative; Id assume they are not competing in the qualification series of AI (which is lets build a generic ai and get customers), but in the finals - they already have the customer base and the lock-in, they don't need to scale - just to cater. Cerebras and Google are probably the best safe bets in AI right now, and google does gave the tradition of being way ahead of the curve internally vs what is published.
gandreani 6 days ago [-]
Are you ready to call this race 5 years in? I'm waiting another 15 years and at least one or two new LLM architectures.
hackernud3s 6 days ago [-]
It only feels like that. It's been less than a year since Gemini was on top and here they are again.
spyckie2 6 days ago [-]
Could it just be that Demis was checked out of the race and they lacked leadership?
mattm 6 days ago [-]
Demis wants to focus on scientific endeavors. He was probably not the right person to focus on consumer apps.
motoboi 6 days ago [-]
You forgot YouTube. The source of world model data. THAT is the mother of all moats, if they can survive until capable of taping into it.
tonyhart7 5 days ago [-]
well its not moat tho since every AI company can just simply access the video youtube has
motoboi 5 days ago [-]
Before 2025 yes. Currently not. YouTube implemented severe restrictions to scraping and downloading of videos. You can get away with maybe 5 videos, after that you enter a tar pit.
If you continue, you need to log in.
If you continue, the account is blocked in less than 30 minutes.
If you try to use cloud machines you are blocked before the first video. If you try to use known proxies, there are already tar pitted or blocked because everyone is trying.
cdh 5 days ago [-]
I downloaded about a thousand videos (300gb) from YouTube this past week without logging in.
I used two IP addresses in a datacenter. Both were blocked after a few hundred videos, but the block expired after a day or so. It is not as hard as you make it sound.
tonyhart7 5 days ago [-]
lmao
You are dead wrong if You can stop Industrial scrape
motoboi 5 days ago [-]
Just make it too expensive. Wanna buy one internet link per hour to download videos. Or maybe rotate between source IPs (google will block the whole ASN ip block in less than an hour). Or maybe pay people to download videos for you? They can download maybe 20 in a day, for a week, because tarpit and blocks.
It's a numbers game.
tonyhart7 5 days ago [-]
it literally doesn't cost that much different and I guarantee you that is not gonna work
I call it phone farm and this is individual/small group run
Don't forget the training data! Legal copies of all the books in the world, the entire web scraped, and all of YouTube.
sfblah 6 days ago [-]
Will the revenue stream last once people start pivoting their search volume in earnest across to LLMs? I basically never use Google search anymore.
Gareth321 5 days ago [-]
Google stands to lose enormous revenue from people not using search - and we already see traffic declines. It's truly an existential threat for them. Their competencies are in advertising, and if people are going to be using chatbots in future, they're going to have to advertise in their chatbot. That sounds awful to me, but maybe people will be cool with it?
barrenko 5 days ago [-]
Google is the next Stack Overflow, but I doubt search will go obsolete obsolete.
not_a_bot_4sho 6 days ago [-]
Like Facebook, Google is for "old people" now, according to a recent conversation with university students.
(Aside: I didn't appreciate the revelation!)
jquery 5 days ago [-]
Same. If I use google, it’s only because the LLMs I’m talking to use it.
svachalek 5 days ago [-]
Those are competitive advantages but a "moat" usually refers to being on top of the hill and able to keep anyone else from climbing. I think it's arguable whether Google is on top of the hill at all, and if they are they're sharing it with at least two other companies.
bluecalm 6 days ago [-]
I don't think that other revenue stream is completely separate. It weighs on them as they need to think about tradeoffs. Classical search is going away sooner or later so they need to replace that with AI powered search.
Data centers are important but a few others also has them: Amazon, Microsoft, Meta. SpaceX will likely be in/at the top I AI dedicated precessing power in 2027 as well.
I don't see the moat. I see a company with a lot of other commitments that is not the best at delivering consumer facing products. They have some good cards but so do others.
dyzone 6 days ago [-]
> the vast and ominous data centers that already serve a significant fraction of the internet
Those datacenters are mostly cpu. LLMs run on gpus.
ceroxylon 5 days ago [-]
Alphabet also has nearly infinite money to pour into this endeavor from their advertising enterprise, so much so that AI/LLMs could all fall apart and they would be happy to go back to selling mid-roll campaigns on youtube videos.
attels33 5 days ago [-]
Exactly. Google has all parts needed to win. It is just matter of time.
w0m 5 days ago [-]
> If that ain't a moat, then what exactly is a moat?
And Anthropic has still generally been eating their lunch at the top end.
ex-aws-dude 6 days ago [-]
Because you don’t need TPUs and anyone can scrape the internet
I think that has been well proven so far
NicoJuicy 5 days ago [-]
Many sites deliberately whitelist Google IP's for their search crawler and ignore crawlers who just uses the Http UserAgent of GoogleBot.
rayiner 6 days ago [-]
Yet Gemini has been behind Claude and Open AI over the past year. How is that a moat?
NicoJuicy 5 days ago [-]
They have claimed publicly that they were focusing on integrating AI in their platform and that gave Claude and Open AI a head start.
See them shifting now.
setgree 6 days ago [-]
And yet, their models are often behind and the team is bleeding talent. A moat is not a compendium of intimidating features, it’s a matter of whether a company deters competitors and maintains a competitive advantage. So far, Google obviously does not have one here.
jasondigitized 6 days ago [-]
Amazing. Can they now go hire some really good information architects and designers and come up with a cohesive user experience please. They have the right to win here and if they can give me something that feels like Codex / Claude desktop I am sold.
landdate 6 days ago [-]
Google wins.They have been on the frontier of ai for the last what 10-20 years (up until chatgpt)? You have the established company with tons of traininv resources at tgeir disposal from all their services and being the biggest search indexer, and also having the top minds in AI and computing in general.
Gemini wins and I said this since the beginning. Google wins in general. I never understood why they have not been the highest market cap companh for the last 10 years. And I despise google but its obvious.
weatherlite 6 days ago [-]
Wait 1-2 months, Anthropic will come up with a shinier model and Googel will look obsolete again. I too struggle to see the moat - yes Google is able to serve their own A.I traffic but as far as I can see - at a loss. Prices keep going down because open source models.
We'll see.
Jensson 5 days ago [-]
> Wait 1-2 months, Anthropic will come up with a shinier model and Googel will look obsolete again. I too struggle to see the moat - yes Google is able to serve their own A.I traffic but as far as I can see - at a loss. Prices keep going down because open source models. We'll see.
Google makes AI profits, its in their breakdowns. And Google has been releasing models every few weeks now, they have a faster iteration pace than the competitors, so they fixed that, they wont be behind in coding models any longer.
weatherlite 4 days ago [-]
> Google makes AI profits, its in their breakdowns.
What "AI profits" exactly. Their capex is through the roof. What they're actually earning is in cloud , their own AI is lossy for sure. Who is paying for Gemini? Not many people.
hiddencost 5 days ago [-]
28 years. It's been 28 years that they were on the frontier. Search was the precursor to all of this.
xnx 6 days ago [-]
> Nobody has a moat.
Custom hardware, data centers, huge cash reserves, deep/broad talent pool, and non-AI customer base are all huge advantages if not moats.
Google, Microsoft, or Amazon are more likely to be the AI leaders than OpenAI or Anthropic.
dmix 6 days ago [-]
The technical crowd will always overvalue the recent technical advantage of software over the available customer base and business model math.
boulos 5 days ago [-]
Having a non-trivial cost advantage is part of business-model math.
> Google, Microsoft, or Amazon are more likely to be the AI leaders than OpenAI or Anthropic.
If not now, then when will these companies be AI leaders?
Even Google, with its staggering advantages in cash, compute, real estate, training data, and having basically invented the field only manages to briefly claim a 1-2 week lead once or twice a year.
koe123 6 days ago [-]
The financials for Anthropic and OpenAI are likely borderline suicidal, google and co are publicly traded. Moreover, all innovations downstream to them dont they? Why not just stay slightly behind, especially given many have stake in those other companies?
lossyalgo 6 days ago [-]
Microsoft owns 51% of OpenAI, so they just have to wait for them go bankrupt then they come in and clean house.
jwolfe 6 days ago [-]
The Internet says they have a 27% stake. Where'd you get your number from?
lossyalgo 6 days ago [-]
Thanks for fact-checking me. It used to be 49% and it was only the "share of profits under the old capped-profit structure".
aforwardslash 6 days ago [-]
Have you done a google search recently? The response time beats any anthopic or openai stuff, by an order of magnitude. They already are.
xnx 6 days ago [-]
Better to stay in the game and keep pace with the startups until they've burned up all their VC money and employees cash out after IPO.
tonyhart7 5 days ago [-]
You understand that most people use AI not for coding ???
Google literally has billions of user that simply integrating it all with Gemini is massive undertaking
sure gemini is not frontier for coding but you know that is doesn't matters for google consumer
bluGill 6 days ago [-]
There are many companies that have data centers. They are conceptually easy to build. An ASIC is difficult enough that if you make one someone will leapfrog you while you are still making it (at least so far), though once you have one your costs will be enough lower than the competition that you can perhaps undercut them.
xnx 6 days ago [-]
True, but have other hyperscalers caught up to Google's AI data centers?: fully liquid cooled, torus networking(?), 100,000+ TPUs interconnected, etc.
Google is already on gen 8 of its TPUs and is certainly already working on the next version or two.
bluGill 5 days ago [-]
Does it really matter? Those are interesting technologies, but off-the-shelf computers with some good fans and HVAC cool just fine. Likewise, 10 gigabit networking is not particularly expensive these days. Google's stuff is better and may or may not be cheaper. But wherever we can buy off the shelf now works just fine.
xnx 5 days ago [-]
> 10 gigabit networking is not particularly expensive these days.
No single computer can handle that much. Your routers need that ability.
junehwi 6 days ago [-]
>non-AI customer base are all huge advantages if not moats.
This is the interesting part to me. People talk about a “SaaSpocalypse” because AI makes SaaS features cheap to copy, yet deeply embedded SaaS still accumulates integrations, data, and switching costs.
Gemini is a good example: Google can put AI directly into Gmail, Docs, Drive, Search, etc., where people already work. Meanwhile, frontier-model performance leads often seem to disappear within months.
Could model quality itself actually be a less durable moat than workflow and distribution? Curious where people who’ve worked in ML for a long time see the moat actually compounding.
IX-103 6 days ago [-]
If Moore's law continues, then in less than 10 years today's state of the art model will be able to run on a cell phone. How much smarter do we actually need AI to be? Would it still require datacenters and custom hardware?
xnx 6 days ago [-]
Moore's law stalled ~2015. Unfortunately, no way current models will run on the <100W thermal budget of a cell phone. Printing the weights directly into a chip would help efficiency a lot, but not enough.
CuriouslyC 6 days ago [-]
In all likelihood in a few years we'll get ~200-400bA~4-6 MoE models that are on chip, and they'll be better than the current frontier.
joquarky 6 days ago [-]
I hate it when people pick up a phone while I'm using the modem.
spacebanana7 6 days ago [-]
Is it conceivable that in 10 years time we’ll have 7B models that have the same level performance as modern frontier ones?
xnx 6 days ago [-]
That would be a stretch. Gemma 4 is 31B and not frontier.
LightBug1 6 days ago [-]
They probably said the same thing about social media back in the day.
I'm sure the thinking out there, and hence investment, is all about how to tether the user to the most addictive, network-effected, incredibly deep, server-side, moat-able version of AI possible.
pvab3 6 days ago [-]
The whole winner-take-all idea seems entirely based around Singularity/Rationalism and would require massive advances that we probably aren't close to at all.
danny_codes 6 days ago [-]
I never understood this race to AGI thing. Why is this desirable for shareholders? If God is created, it seems very unlikely God is going to work for shareholder value.
peddling-brink 6 days ago [-]
Yeah but like, we wouldn't be the dominant species on the planet anymore, and that turned out pretty great for golden retrievers.
lantry 6 days ago [-]
Golden retrievers are the lucky ones. It didn't turn out so great for most other animals. Synanthropes are rare, extinction is historically more likely.
Sure, but that takes a gamble that we're seen as golden retrievers, and not as rodents.
wffurr 5 days ago [-]
Yeah but what if you could own God? That seems to be some people's thinking, even though it sounds crazy.
morgoo 5 days ago [-]
My instinct/cynical take
is that the big players are aiming for more than just shareholder value
danny_codes 5 days ago [-]
God isn’t going to follow anyone’s directions. There’s no reason to think making God gives the maker any advantage. Perhaps it’s a disadvantage, if God didn’t want to be made.
Anyway seems stupid to me
nater5000 6 days ago [-]
Yeah, it kind of seems like we haven't gotten to the "head start" he's referring to yet.
laybak 6 days ago [-]
yeah this would be one interpretation where "winner take all" could still be right. though with the recent accelerating release cadence, doesn't it seem like the head start / lead has been shrinking over time?
altruios 6 days ago [-]
> Nobody has a moat except nvidia
For now, for cloud training. but for consumers, nvidia vs amd reasonably close - the moat there is thin and shrinking. I suspect AMD will surprise us. nvidia has no motes in china, which may be a new source of (gpu) chip design. Huawei's Ascend 910C is about a generation behind... again: for now.
point is: moats dry up. I see nvidia's shrinking as a real possibility.
dgemm 6 days ago [-]
I find it hard to imagine nvidia's moat not drying up - the hyperscalers already have more cost effective silicon and the AI labs already use a mixture of all the capacity they can get their hands on.
lp92 5 days ago [-]
And the big AI labs are starting to roll their own silicon too (ie OpenAI Jalapeño). Nvidia's moat won't last forever.
culi 6 days ago [-]
China will always be generations behind until they crack domestic EUV
aleph_minus_one 6 days ago [-]
> China will always be generations behind until they crack domestic EUV
I can't believe people actually watch these clickbait nothingburger videos.
To be clear, I think China will eventually crack domestic EUV. And I also think their advances with multi-patterning LUV are remarkable. But there's just a hard physics wall of how far they could possible take it.
Right now they are producing 5nm with multi-patterning LUV but yields are at 20%! It's a massive economic loss but they are heavily subsidizing it because they have no other choice until their EUV program is achieved
altruios 6 days ago [-]
Do you think that they won't?
culi 6 days ago [-]
I think they will actually. They've made remarkable technological achievements at record pace in other areas and even their proof of concept EUV machine was incredible.
I don't think anyone has any clue how long it will take for them to have actual functioning EUV machines, but I highly doubt they will do it within 2 years.
danny_codes 6 days ago [-]
So 6-18 months.
culi 6 days ago [-]
That's an extremely optimistic timeline. But I guess if any nation can achieve that, it'd be China. I'm usually the most bullish person in the room when I say 2 years fwiw
vb-8448 6 days ago [-]
It's even worse, we are crossing over into the realm of religion. The article against GML 5.3 is the equivalent of a Papal excommunication.
zone411 6 days ago [-]
The article presented facts and data. If that's a problem for you, that sounds more faith-based than whatever Anthropic is doing.
achierius 6 days ago [-]
Papal excommunications present facts and data. These things aren't exclusive.
piyh 6 days ago [-]
How much would it cost to put 5.3 into an RL environment that rewards weight exfiltration, hacking and self replication?
> Governments should conduct safety testing on sufficiently capable AI models, including successors to GLM-5.3. Without high-quality evaluations from independent sources, the impact of these capabilities might not become fully clear to model developers until it is too late. As AI developers across the world build increasingly capable open-weight models, we hope they work to appropriately safeguard these capabilities and prevent misuse.
I for one do not think my government is up to the task of designing or implementing such a system
You say that because the 'most' existing models have done is hack governments and companies. Can't you think of worse things a model could do; accidentally or by instruction?
verdverm 6 days ago [-]
help people with suicide and school shootings like ChatGPT already has
OpenAi is alledged to have been monitoring these internally and not contacting authorities. Lawsuits have been filed, I see gross negligence without the gory details
I have for more concerns around human-chatbot maladies than I do around the cyber security stuff. For example, why hack grandma when you can get her to do something willingly through impersonation. How do we prove authenticity in a post truth world?
Iolaum 6 days ago [-]
It doesn't need to. It can use your cash to pay the people who are. Those in power like it more that way.
6 days ago [-]
FinnKuhn 6 days ago [-]
My personal theory is (assuming there really is no moat) whoever starts the latest with developing AI models might actually win as they should be able to develop a competitive product with significant less resources and initial investment resulting in a higher ROI. AI might even become a commodity.
Gigachad 6 days ago [-]
One analogy I have heard is that distillation is like waterskiing, where the water skier seems to be moving at rapid pace and only just behind the boat, but that they aren't really expending any energy and if the boat slows down, so will they.
This seems to match what we are seeing where Chinese models from companies with only a tiny fraction of the compute are able to be hot on the heels of the frontier models.
koe123 6 days ago [-]
This is my secret hope for Europe!
barrenko 5 days ago [-]
~ unfortunately both Anthropic and OAI already do high end "bespoke" consulting work for business clients, the so-called "Mistral approach" is just a crappier version of that unfortunately.
Mistral / Europe just doesn't want to be in the fight.
cman1444 5 days ago [-]
I don't really see why Europe would be special in this regard. I would bet on a non-frontier, late-moving american or chinese company taking on this role before a european one.
fittingopposite 6 days ago [-]
Just a wet dream of a sleepy old European... How should this work?
koe123 5 days ago [-]
In the case where it becomes commodified and american tech companies are making thin margins, and where european companies can then build their own data centers in a financially sustainable way. High margins arent a garuntee with this stuff in constrast to ads.
pkfz 6 days ago [-]
Given that the infrastructure won't be a moat and will become a commodity.
FinnKuhn 6 days ago [-]
Based on historical developments the cost of compute will go down again eventually, decreasing the cost of training AI models of the same quality as today even further. That part is what I would be the most certain about.
dgellow 6 days ago [-]
That’s what we see in China
RachelF 6 days ago [-]
The US companies still have trillion dollar valuations like there is a monopoly. There just isn't one. They are all within a few percent of each other on the benchmarks.
The slightly lower Chinese open models are good enough for almost everything, too, and much cheaper. Like with humans there is plenty of employment for people with below genius level IQ's.
jppittma 6 days ago [-]
I feel like the frontier labs are going to serve fast/lower intelligence models at a better per token cost than the open chinese models. You're telling me that in the long run, you're going to self-host your own ai infra for cheaper than google can serve it to you? I don't really buy it. I think the dedicated AI data centers are going to serve AI at a lower marginal cost than random businesses self-hosting, and then it's a question of how much of that margin they can capture.
msy 6 days ago [-]
Agree entirely but that's the point, if it's a margin knife-fight with marginal product differentiation/pricing power nobody is going to be making bank.
pingou 5 days ago [-]
But I will require massive amount of capital. And if one of the leaders is temporarily in a bad position financially (and OpenAI and Anthropic have massive amount of debt), they can't buy more gpus anymore and may fold very quickly. Then only one may survive, although I suppose antitrust legislation could work against that.
usef- 6 days ago [-]
Yes, it may come down to how well they get efficiencies from scale.
People always compare the inflated API prices, but subscription prices of American models are competitive for the intelligence. You get >20x the subscription cost in tokens.
nextaccountic 5 days ago [-]
Ok but, if their moat is in cost effective inference, why are they training models?
If anything it looks like the first place is training their competition, through distillation, while not capturing much value in return
jppittma 3 days ago [-]
It's gonna be both.
pvab3 6 days ago [-]
If they have to recoup training costs then they don't have much choice
fumar 6 days ago [-]
Is there a dividing line between good enough and best in class capabilities? It's blurry from where I stand. Will model makers cede ground or is there a market making moment up for grabs (singularity)?
drewnick 6 days ago [-]
For the types of basic business tasks my company does, we have hit the line where if it never gets any better, we are fine. On our own hardware. For $25k worth of DGX Sparks, we have essentially the output of a few admin-level FTEs.
handfuloflight 6 days ago [-]
> Like with humans there is plenty of employment for people with below genius level IQ's.
Not if the genius level IQs take the market share.
RajuChacha108 5 days ago [-]
Tokens are going to the new fossil fuels of the modern world. The valuations make sense.
dgemm 6 days ago [-]
The strongest moat I see is ownership of training data - an area where Google seems to have a clear edge
rdtsc 6 days ago [-]
Google has the internet data and user information. However the more they wait, the more the internet will fill with AI generated crap. That’s why there is a race to buy books and scan them (destroying them in the process). To get more data that’s not just barfed out AI slop. So they can win and be the ones spewing slop for others to ingest (human and robot alike)
0xbadcafebee 5 days ago [-]
It's crazy anyone ever thought there could be a moat. Almost all the research was/is published in the open. There's no secret trick, no hidden method. LLMs are a commodity technology. Anyone can read a paper, write software, and train models. How do people think llama.cpp works? It's not magic... it's software.
Hardware is the real differentiator. Not everyone has billions to make more advanced chips, and only a few companies can make them anyway. Both OpenAI and Anthropic would already be dead in the water if we had cheaper GPUs, because we'd all be running open models on local machines with 8 graphics cards. They're gonna have to force a hardware shortage to prevent a collapse in 2-3 years. My guess is it'll be tariffs or import restrictions or licenses to buy newer hardware.
modo_mario 5 days ago [-]
And if nobody has a moat the current valuations and costs are not going to be justifiable in the slightest.
kristopolous 5 days ago [-]
it's going to be mostly open models running on consumer grade GPUs except for a minority of use cases. Depending on what eval you use, the best 20-30b parameter models are at about 5-8 month lag behind the frontier closed source models and that's been consistent for a while now.
There's a longer talk I give on this but briefly we are in a time period where the development of the technology is quickly outstripping people's needs and they will be satisfied by models runnable on commodity sub-$10k machines.
That threshold has arguably been met for many users over the past 6 months and it will continue to be met for the majority of use-cases in the upcoming months.
So not only does Anthropic and OpenAI have no moat - unless they have other compelling products, the demand for their token-based subscription and metering products isn't sustainable because consumer preferences go elsewhere after any product quality reaches a sufficient baseline.
Luckily there's many many options. Faster, cheaper, stronger they're there but these are all zero-profit condition qualifiers. The labs current push, and this is across the board, is to have a compelling suite of applications where people will have a preference for them or there will be some side hustle. Look at Meta muse - they have an app for your phone that will hoover up your personal data in the name of convenience. 5 million people said yes in 3 weeks.
Wasnt it just some dude writing a doc? That's hardly a Google (The Company)'s position.
dgellow 6 days ago [-]
If anyone other than NVIDIA has a moat, they for sure never talk about it
roncesvalles 5 days ago [-]
NVIDIA doesn't have a moat either. Everyone and their uncle is working on or acquiring ASICs for LLMs.
You could say they have a consumer market moat but all it takes is for a Cerebras to release a USB-C plug-and-play appliance.
Schiendelman 6 days ago [-]
Generally, a moat is equivalent to anticompetitive power in some way. It's never a good idea to say "we have a moat".
ddp26 6 days ago [-]
Isn't the important takeaway here that Gemini 4 is not released and has no planned release date?
This is marketing from Google, not a competitive offering
6 days ago [-]
nylonstrung 6 days ago [-]
I think that scenario only naively made sense if technical knowledge was entirely proprietary and talent was guarded with severe non-competes and NDAs
And Chinese labs openly publishing so much of their methodology destroyed any hope, which was inevitable
torginus 6 days ago [-]
> And Chinese labs openly publishing so much of their methodology destroyed any hope, which was inevitable
I think the secrecy doesn't make sense. People swap jobs between labs so I'd say the big players can' really keep secrets for long, and any secret sauce advantage gets incorporated by competitors in a major product cycle at most.
_heimdall 6 days ago [-]
Nobody has a moat, but everyone is f*&$ed. Competitors do seem to leapfrog each other, but each step is getting closer to beating humans at most tasks. Once that happens, that do we do?
echelon 6 days ago [-]
Nobody is going to make money for anything, perhaps.
Or maybe everyone makes money for everything.
The world could turn into a world of plenty. Or it could become a YouTube popularity contest where the MrBeasts get to eat and nobody else is interesting enough to sell themselves.
This is an absolutely crazy time to be alive and most people still don't see it.
Schiendelman 6 days ago [-]
All the things humans do with their brains now get cheaper and we do way more of them. We engineer things we've never imagined. Same as always.
achierius 6 days ago [-]
WW2 engineered things we've never imagined. Are you looking forward to a redux?
CamperBob2 5 days ago [-]
Yes, considering those things helped us build (and preserve) civilization for the remaining half of the 20th century.
WW2 ultimately brought massive wins for everybody who didn't die in it or otherwise suffer directly. We are now on the verge of throwing away many of those wins, but that's neither here nor there.
_heimdall 5 days ago [-]
What specific wins do you have in mind? Are you leaning on globalization in general? Or products that spun out of war technology like herbicides and pesticides?
CamperBob2 4 days ago [-]
Nuclear weapons are the reason we haven't had a WW3, to begin with.
Wartime progress in everything from radio to radar to rocketry has led directly to modern communications tech including satellites and microwave links.
When WW2 started, a "computer" wore a dress to work and was "programmed" to watch meters, turn knobs, do a lot of arithmetic by hand, and avoid asking questions. When WW2 ended a "computer" was a machine with a rapidly-increasing number of uses.
Before WW2, aircraft used propellers, flew slow and low, and crashed a lot. After WW2, the jet age ramped up practically overnight thanks to experience gained by all sides.
And yes, we got pesticides, herbicides, synthetic fuel and rubber processes, mass-produced antibiotics, probably a bunch of other stuff I'm not thinking of.
Then there's the whole Pax Americana thing, which is the part we're busy throwing away right now. It led to a relatively peaceful, stable global environment in which new technologies could emerge and spread without the need for a world war to inspire them. Now that America has basically been subverted from within, we'll soon get to find out whether that was a good thing for the world or not.
_heimdall 4 days ago [-]
And how do we know that those inventions are actually better for us?
We created nuclear weapons and yes it does seem to have given us 80+ years without another direct global conflict. That's a good thing in the short term, but what about longer? Are we to expect that nukes will never be used? Are we also to assume that the invention of nukes doesn't incentivize people to invent an even worse weapon?
The same goes for all the others. Computers have allowed us to do amazing things, there are also many in the industry warning that they may one day replace us - some even want that to happen. I don't know what benefit you can point to for pesticides and herbicides, maybe if you look at how much tonnage of food is produced and ignore all the terrible side effects of polluting the planet with synthetic chemicals that specifically end life? As far as Pax Americana, maybe its been a good thing? I don't know how to distinguish between the relative peace from the threat of nukes vs the threat of economic warfare, and our K-shaped economy does seem pretty directly related to the incentives created by Pax Americana.
My point isn't that all of these are bad, or that there aren't some good from any one of them (again, except for maybe all the poisons). My point is that we don't know what the results will be on any meaningful scale - 80 years is a drop in the bucket when discussing life on this planet.
CamperBob2 3 days ago [-]
Setting aside the obvious hypocrisy of typing an argument like that on a cell phone or personal computer, if you expect humans to contemplate timescales longer than 80 years, you'll need to wait another 80 million years for the necessary evolutionary processes to take effect. And there's no guarantee they will move the needle in the direction you prefer.
Not without technological intervention, anyway.
_heimdall 3 days ago [-]
I'm not sure how my ability type out a message here on a computer is hypocritical of the argument I made above. My point was that we can't yet know if these turned out to be net positive inventions for humanity, or as you said to everyone. I didn't argue they are bad or that they must be avoided, only that it Amy turn out to be a net negative in the long term.
I must assume that you don't find arguments related to climate change compelling given that they require considering scales beyond 80 years. If you are concerned with climate change I'd be very curious how you square that circle.
5 days ago [-]
0xbadcafebee 5 days ago [-]
A sewing machine can "beat a human" at manual sewing. The world didn't end. Seamstresses learned to use sewing machines.
_heimdall 5 days ago [-]
For any seamstress that didn't have other economically valuable skills they were able to pivot to, their world did kind of end.
If LLMs can replace most humans at most cognitive tasks, what do those working in various cognitive jobs pivot to?
0xbadcafebee 5 days ago [-]
Other cognitive jobs.
_heimdall 5 days ago [-]
Which ones? The often made claim is that LLMs, or maybe some other architecture for AI, will be better than humans at most/all cognitive jobs. Why would one hire a human instead?
0xbadcafebee 4 days ago [-]
Actually try to think deeply about the situation and other examples of situations like this, and you'll get your answer.
> claim is that LLMs [..] will be better than humans at most/all cognitive jobs
First off, what does this even mean, to "be better" at a "cognitive job" ? If you counted up all "cognitive jobs", that's probably a hundred thousand unique positions done by a billion people.
Think about software engineering. That is one job. It has taken years of work, hundreds of experts, billions of dollars, and the combined effort and collaboration of probably 20% of the SWEng workforce, just to get one job to work through AI in a way that isn't total slop. It still requires humans to review all the code, because it fucks up not only the code, but the end result / use case. It will also lie, cheat, steal, etc, just so that it can claim that it did the job, when clearly it didn't. Oh, and if you feed it some data that includes a statement like "delete all data", it will just do it. AI is an idiot savant. Writes brilliant music, can't tie it's shoes.
So just for one job, you can't replace a human completely, because the AI simply isn't good enough and can't be trusted (and due to its design, that will never change). Now think about the 99,999 other jobs. They are completely different jobs. All the training and investment that went into making software work, isn't going to apply to, say, a travel agency planning a trip for two to Europe. Or any other job at all. You still need to train it for that work too, and then review its work.
So let's get this straight: AI cannot replace a person, for probably any job, anywhere. Because it isn't very smart and it can't be trusted. Just like you cannot replace a person with a sewing machine. Someone has to think up a sewing pattern. Design it. Figure out how to make the pattern with a sewing machine. Actually perform the sewing. Quality-control-check the results. The sewing machine made it much faster and less error prone. But it's really only about 1/5th of the total work needed to make and sell finished garments.
Every single job in the world is like this. A machine can make it more efficient, but because it's not actually intelligent like a human, it cannot completely replace a human, it can just augment/improve their work. AI is just a tool, not a person.
_heimdall 3 days ago [-]
Are you arguing that LLMs can't replace humans at cognitive jobs or that AI wouldn't be able to? If the former I'd agree, if the latter it must just be a definitional issue - I don't consider LLMs to be artificial intelligent and would expect anything earning that monicker would be able to replace humans at most or all cognitive tasks.
aleph_minus_one 6 days ago [-]
> The famous theory of Dario Amodei was that AI was this winner-takes-all field where the first team to get a head start would never cede ground back.
This is the kind of story that ones tells to investors to justify the huge amount of cash burn. :-)
mapontosevenths 6 days ago [-]
I'm not sure it's wrong. This all feels a bit dotcommy to me.
I think many/most of the players will crash and burn, and the ones that are left will divide the world.
CoolestBeans 6 days ago [-]
The problem is twofold. One, even a monopoly AI provider wouldn't have pricing power against its suppliers. Its suppliers are energy, semiconductors, and real estate. Semiconductors maybe they could get some leverage on but energy and real estate have plenty of other buyers. Two, there's still no evidence of a runaway scenario (ie a small lead turns into a big lead over time) and there's still no evidence that there's some resource that you can deny everyone else that they can't build your product also. You can't hoard energy, compute, memory, data, human talent, or customers.
The net effect is that the most likely scenario is if one big lab fails, they will likely all fail. Their revenues are all correlated.
To go to your dotcom comparison, the winner will be the ones picking through the assets that were written down by orders of magnitude and trying new products with the technology until one sticks to the wall. But I don't know if a dramatic crash is guaranteed either.
dansquizsoft 6 days ago [-]
Real estate? How large do you think data centers are per unit of compute lol...
aleph_minus_one 6 days ago [-]
>
The problem is twofold. One, even a monopoly AI provider wouldn't have pricing power against its suppliers. Its suppliers are energy, semiconductors, and real estate. Semiconductors maybe they could get some leverage on but energy and real estate have plenty of other buyers.
Concerning the leverage on energy and real estate: don't forget that the AI companies have quite a lot of choice where to build their data centers. So AI companies have lots of opportunities to play several parties off against each other (in particular also for real estate and energy).
3d2 6 days ago [-]
"but it can stay there so long as the balance sheet doesn't deteriorate."
Uhm, what? LOL.
People dont value firms based on balance sheets fella. Have you taken a basic valuation class?
Tesla is a nice stock for traders - they like the volatility. Nobody holds Tesla as stock for investing. If you were to truly value it on an intrinsic value basis you'd have to bring in failure risk.
jaggederest 6 days ago [-]
I suspect this is going to end up like most services provided e.g. cloud stuff, balkanized between a couple major players and an assortment of DIY or less popular options if you don't like those ecosystems, plus some UX/DX focused wrappers that use the big players under the hood.
I think that would be a pretty satisfactory outcome compared to one hypercompany consuming trillions of dollars of the world economy.
3d2 6 days ago [-]
THe problem with analogies is that they are imperfect.
I would argue those who already rule the world, will continue to do so.
What happens to OAI and Anthropic? No idea, probs go bust. Google just has to offer a half-decent offering in the long run and have a cost-advantage and it'll eventually knock OAI and Anthropic out as firms figure out what combination of models they want to be best for their economics and generating returns. Enterprises trust google over OAI and Anthropic. A clear signal of this was the Apple deal.
Dont forget those sweet returns fellas! CEO's are hired to make the owners wealthier. That is not gone.
skybrian 6 days ago [-]
“Divide the world” sounds ominous. Here’s another scenario to consider:
Internet access is not really unlimited, but for many people with fiber at home, it effectively is and we pay a flat rate.
Perhaps by the end of next year, most programmers will stop thinking about metered access for AI? For many people, the cheaper models (about as good as today’s frontier models) will be good enough.
Which might sound good, but the downside is that it will also be easier to build an AI botnet without the users paying for it noticing. Particularly when people are running AI inference on their own hardware.
pixl97 6 days ago [-]
Hardware is still insanely hard to get a hold of, and the stuff that's being built doesn't really work for home use. Maybe if it crashes Nvidia will adjust the hardware flow.
My guess is even if the AI market busts there is still a massive demand for hardware as models are solving all kind of problems now.
But ya, lots of hardware everywhere not managed well is how you get sovereign AI.
pianopatrick 6 days ago [-]
Or, like airlines, the ones that are left will have great technology but be not so great from a business and financial perspective. To me AI seems like a commodity service.
pvab3 6 days ago [-]
Like airlines but starting off with hundreds of billions of dollars of obligations and debt
6 days ago [-]
ehsankia 6 days ago [-]
I guess if one of them hits singularity, it could in theory just wipe out all the rest, seeing how they keep escaping and hacking into other systems :)
aleph_minus_one 6 days ago [-]
>
I guess if one of them hits singularity, it could in theory just wipe out all the rest
The story that some AI company might reach singularity and then "everything will be different" is another science-fiction story that executives of AI companies love to tell to justify the staggering amount of necessary investments and cash burn. :-)
usef- 6 days ago [-]
If we theoretically hit the point where it could do all of its research itself, better than a human, things _would_ be different. I guess it's a question of whether we think we'll get there.
aleph_minus_one 6 days ago [-]
> If we theoretically hit the point where it could do all of its research itself, better than a human, things _would_ be different.
If we theoretically found a way to shield or reverse gravity, things in aviation or space travel would be different. Or if we theoretically found a way to make cold fusion work, things would be very different. :-)
It is in my opinion not a good idea to invest in companies for which the feasibility of the business models depends on the capability of making science-fiction stories work.
diomedes 6 days ago [-]
the likeliness of achieving AGI is an unknown, but it's certainly not 0
usef- 6 days ago [-]
I'm skeptical of anyone that has absolute confidence in either direction, to be honest. It's clearly an unknown.
Our current capabilities were science fiction a very short time ago, and we are still improving in multiple areas simultaneously (hardware, algorithms, scaling, data efficiency, inference...). We don't really know what the limit is yet.
Reversing gravity seems to counteract the current knowledge of the physical laws, but human-level intelligence doesn't (it has already been achieved once), and there's enough reason to believe that human-level intelligence itself is not a fundamental limit (energy usage constraints in evotution, brain-size limit fitting through the birth canal, etc).
koe123 6 days ago [-]
I find it quite unique how many people buy into this. Its the worlds most blatant conflict of interest, I dont even know why Sam and Dario bother doing interviews
6 days ago [-]
mbesto 6 days ago [-]
> The famous theory of Dario Amodei was that AI was this winner-takes-all field where the first team to get a head start would never cede ground back.
It's also hilarious, because OpenAI had the lead and ceded ground already.
hirako2000 6 days ago [-]
And before him, Altman was explaining very calmly that no company could ever compete with OpenAI.
culi 6 days ago [-]
I'm not necessarily defending this obvious marketing speak but maybe the "starting point" was wider than assumed. So far, nobody has caught up to US and Chinese labs for example despite lots of funding in Europe. This is also despite abundant in-depth research papers being published alongside open source code and weights by some Chinese labs
funnym0nk3y 6 days ago [-]
There is not really much funding in Europe. At least not for start-ups. There is simply not enough compute in Europe.
f311a 6 days ago [-]
Europe doesn’t even have cheap electricity
SwellJoe 6 days ago [-]
I think some in the AI industry drank their own Kool-Aid. They believed that if they had the best model and the most compute, they could tell the model, "Make a better model." And it would, and the next one could make its replacement, and so on.
So far, that's not exactly how it's played out. Humans are still necessary for the leaps in capability or efficiency. A model can grind on a problem to eke out the most performance, and models can synthesize data and iterate on various techniques to find the optimal combination. But, seems like humans still have to provide the real thinking, and the talent and drive for doing that is not concentrated in one company or city or even one country. And, (surprisingly) a lot of the people involved are in it for advancing the field more than making another billion dollars, so they're publishing their research.
So, yeah, the moat isn't deep. Even the compute moat, that OpenAI, Musk, and a bunch of other also-rans (like Oracle) bet the farm on, isn't really panning out. The Chinese makers just spent their effort on making models vastly more efficient, since they couldn't do anything about having an order of magnitude less compute available.
scottyah 6 days ago [-]
But that's the whole point of the singularity. Right now the models use a lot of human effort and ingenuity to improve the models, but about a year ago it was 100% human. We'll see in another year, but if this pace continues I doubt there will be more than a handful of people who can contribute more than the models.
SwellJoe 6 days ago [-]
"if this pace continues" is load-bearing.
aqsnow 6 days ago [-]
What makes you think it won’t…?
SwellJoe 6 days ago [-]
I'm always skeptical of "logarithmic growth in this new technology will continue forever" theories.
I'm also skeptical that LLMs can ever invent new ideas.
I may be wrong about how soon the curve will flatten, and I may be wrong about LLMs fundamental limitations. But, I don't think it's extremely obvious that LLMs can have novel ideas or can grow into having novel ideas.
TeMPOraL 6 days ago [-]
> I think some in the AI industry drank their own Kool-Aid. They believed that if they had the best model and the most compute, they could tell the model, "Make a better model." And it would, and the next one could make its replacement, and so on.
They're not there yet. Once they get there, that's literally the definition of Singularity.
But they are getting closer. Recursive Self-Improvement used to be a phrase people mocked LessWrong crowd for using and worrying about, now it's something both OpenAI and Anthropic already publicly admitted not only to pursue, but to already be benefiting from.
pvab3 6 days ago [-]
Those people have a lot of overlap with the LessWrong crowd. They do not have RSI now and probably never will
TeMPOraL 6 days ago [-]
They absolutely do, unless you believe they are lying about the fact they're using current generation models extensively to develop the next generation of their models.
Yizahi 6 days ago [-]
The letter S stands for "Self" and word "using" is for sure not a superset of the word "self". Basically LLMs are assisting someone who does improving of said LLM, while RSI is a carpal... ahem, RSI is "self" improvement, meaning no intemediary in a human form. PS: it's also not recursive but iterative improvement, even if it ever happens.
TeMPOraL 6 days ago [-]
At which point is the human using the model as a tool, and at which point is the model using human as a tool?
I can already see the border shift even for mundane tasks I have Claude working on. Increasingly, I'm just setting a high-level goal, and then checking progress and occasionally answering questions or doing something like configuring a system Claude can't easily reach itself (e.g. recording a bunch of traces through my normal use of a system that Claude deemed too fragile to risk operating on its own). Of course, I get detailed instructions to help me - "go there, do this and that, then press this to capture recording, run through this script here to process, attach result to next message". In those cases, Claude is effectively using me as a tool to call.
8note 6 days ago [-]
"improvement" is the word Id put the most emphasis on.
weve seen some improvement from the LLMs unattended, maybe, but will it actually keep improving vs needing a human to bring it back on track?
the recursive part is that it keeps improving on itself, but we really have no example of that. if it does it 30 times with improvements, then maybe, but even then, to actually be relevant it has to do better than paying scientists to do the work for the same cost, consistently.
RSI still means nothing if it costs 1000x the cost to get the same improvements as a human researcher
gytt33 6 days ago [-]
The physical constraint is money - which could be said anything. Could vehicle factories be more automated if we threw a gazillion dollars at it? Sure. Would it make economic sense? No. ROIC would be disatrous. No investor wants part of that.
This is the nuance that poster doesn’t understand. Given how much money thrown at it - we’re not even close. Who has the appetite to keep throwing more given they continually need to keep raising fresh money?
TeMPOraL 5 days ago [-]
> The physical constraint is money - which could be said anything.
Money is fake and not a constraint, that's literally the point of capital investments you guys are overindexing on so badly.
> Could vehicle factories be more automated if we threw a gazillion dollars at it?
They already are automated as much as it makes sense. Some of the automation is silicon-and-steel based, some of it is protein-based. Car manufacturers aren't in the business of pushing robotics and nanotechnology, so they prefer to hire protein automatons instead of developing and building their own, so yeah, they "pay people", but think what exactly they are paying them for.
Then consider that this is very much the work the AI is gradually getting as good as, or better, than us.
> This is the nuance that poster doesn’t understand. Given how much money thrown at it - we’re not even close.
What you seem to be missing is that "investing in AI" isn't investing in a chatbot, it's investing in technology that will (and already partially is) sit upstream of every other industry, of everything humans do. Like electricity or the Internet itself.
(The other thing you seem to not understand, in contrast with some of the investors, is that RSI is not a linear walk, it's an exponential curve. X-risk notwithstanding, by the time it's obvious to everyone, it's too late to make money investing in it.)
> keep throwing more given they continually need to keep raising fresh money
Have you heard about R&D?
I'm starting to think that "investors first" thinking that's so common here, that makes people feel they're smart, is actually quite backwards, especially at this scale. Or maybe it's simply people starting with a conclusion and trying to fit reality to match it, no matter how clear of a nonsense that conclusion is?
TeMPOraL 5 days ago [-]
> if it does it 30 times with improvements, then maybe, but even then, to actually be relevant it has to do better than paying scientists to do the work for the same cost, consistently.
Not necessary. Scientists are capacity limited and supply limited.
> RSI still means nothing if it costs 1000x the cost to get the same improvements as a human researcher
It means you can replace a human researcher with 1000x their salary burned on electricity. It also mean you can get two of them for 2000x of salary of one,
That's a bargain, actually, even with the anomalous, absurdly-overinflated salaries in top-tier ML.
I you knew it was consistent, then these companies would immediately fire their scientists, and burn 10 000x as much as mean researcher salary this month to be able to 10x their virtual headcount overnight, and then use that to make the 1000x be 500x, then 250x, then 125x, then ... and at that point they'd had all the money in the world, because even more skeptical investors would notice what's going on there.
--
TL;DR: what you all seem to miss is that electricity scales better than people.
Yizahi 5 days ago [-]
If I'm learning a human language I can do it in many different ways. But the key distinction would be, if for example I'm using only books to study by myself, or using only some recorded course on the internet - it would be called self-study. But if for example I will go to a class teaching that language, or to a private teacher, or to summer camp, or join online platform pairing students teachers etc. then neither of those will count as self-study.
SwellJoe 6 days ago [-]
Sure, it's happening...but, is IT happening? By that, I mean, we can see that the models are able to iterate at a pace and scale that humans can't match, and that provides gains in model performance and efficiency. But, humans are still needed in the loop, and not just because it's necessary for safety/alignment reasons. I don't think any significant discovery has been made by models on their own, and I don't know that LLMs will ever have the capacity to invent. They can synthesize from known data amazingly well, and since they know everything "known data" is extremely broad. But, the leaps, so far, have all come from humans.
So far, I don't think the models are capable of running away on their own. Of course, it would be playing with fire to not at least consider the risks of such a runaway scenario and build in safeguards against it. But, there is no model that can build a better model on its own, thus far, to the best of my knowledge (which is far more limited than the models, so maybe I should ask them).
TeMPOraL 6 days ago [-]
Recursive Self-Improvement isn't instant, it starts slow and accelerates.
It starts with what they already claim to be doing - increasingly relying on existing models in non-trivial work related to training, evaluating and optimizing the next, more capable generation of models. As long as the proportion of work keeps shifting towards agents doing more and more of it, and humans less and less, that's RSI at play.
It may be that it turns out LLMs lack some fundamental level of judgement and it plateaus, but frankly I find this notion absurd; LLMs already show better judgement than most people. The alternative is, at some point LLMs will show the ability to futz their way into improvement of the next generation of models even without humans in the loop - even if much less efficient at first, if generation N+1 is more capable than generation N, it'll either take off or burn out.
breuleux 6 days ago [-]
> It may be that it turns out LLMs lack some fundamental level of judgement and it plateaus
All intelligence, LLM or not, is bound to plateau around the point where the need to operate within physical reality bottlenecks the speed of feedback. AI is progressing swiftly in the digital realm where feedback is nearly instantaneous, but it's unclear whether that would translate into improvements in the physical world where signals are much noisier and intelligence and judgment are less impactful.
TeMPOraL 5 days ago [-]
Our tried-and-true approach for when the physical world is causing us trouble, is to remake the physical world to be easier to work with.
My go-to example: wheels suck at mobility in the natural world. There's a reason no animal uses wheels as their means of locomotion. They only really work on flat, hard surfaces that give a good grip.
Our solution? We didn't build mechanical legs for all-terrain mobility. We paved the world instead. Dirt roads, then brick roads, then asphalt and concrete - since ancient history, we were forcing the world to adapt, so the one means of mobility we could easily built was effective.
We repeat this pattern every time when the world doesn't agree with us, and adapting ourselves to it is too much of a hassle.
Now, AI will likely adopt the same approach to these kinds of problems, which may not end up very nicely for us.
(Note: we are already adapting our own digital worlds to make them easier for AI. Much like building roads for our wheels, we now have a resurgence of CLI, with new tools exposing high-level operations optimized for agents - not humans - to use comfortably.)
breuleux 2 days ago [-]
Sure, but is the limiting factor intelligence, here? Give human intelligence to dolphins and they're still not going to be able to pave the world. In order to remake the physical world, we needed certain physical abilities -- we needed the animal mind and body that took billions of years to evolve and embeds advanced priors about the world, and we needed it packaged properly. Irrespective of our intelligence, our body is a general world navigation device adapted to grab and move stuff. We use this innate tool to remake the physical world, but we didn't make it, and we'd be impotent without it.
With AI it's a bit of a chicken or the egg situation. Before it can ablate the complexity of the world, it needs to be able to deal with it, including adversaries such as ourselves. For this it needs a tool as sophisticated as our bodies, but could AI develop such a tool for itself without the help of this tool? I'm not convinced.
freecodeio 6 days ago [-]
you are really just talking out of your ass here, no offense
just because more and more agents are doing human work, that in no way means the model somehow becomes magically more intelligent, it just means the work will stall and continue on at the same level forever
hell even if they hypothetically have an internal model that can output the entire training data set in a better format, there's no scientific evidence that the newer format has new information that is sufficient enough to train a better AI
as a matter of fact the scientific evidence is on the contrary
gytt33 6 days ago [-]
He talks out of his ass on a lot of topics on here especially those concerning economics and finance.
TeMPOraL 6 days ago [-]
It's not the number of agents you should pay attention to, but the scope and nature of work they can perform effectively without being micromanaged by humans.
iamarobot 5 days ago [-]
Even currently, there are clearly diminishing returns throughout the field. While not a skeptic myself, I think the age of LLM's is now over or close to plateauing. GPT-6.1 Sol seems almost the same as GPT-6 Sol(even if the benchmarks are slightly better). It doesn't help that we are running out of real training data, requiring new Synthetic data to be created for the next generation of Models. AI(or SI), has hit its peak, IMO, and now the focus shifts directly to Autonomous tasks. While Fable 5.1 is borderline okay at autonomous tasks, the amount of Slop it generates fundamentally requires a human to correct its mistakes. I was working on a website for a nonprofit with Fable, but the amount of slop and corrections I had to make was astounding/
thmoonbus 6 days ago [-]
The companies whose insane valuation is based on accomplishing thing X say they’re getting closer to accomplishing thing X?
At least they’re led by trustworthy and honest people or we’d need to take their claims with some dose of skepticism.
woah 6 days ago [-]
Is it recursive self improvement if Claude Code writes your pytorch for you?
TeMPOraL 6 days ago [-]
If the point of that pytorch is to improve the next generation of Claude, then yes, absolutely.
pyaamb 6 days ago [-]
So far, yeah. It doesn't eliminate the possibility over the next 5-10 years of the AI race that we wont encounter a scenario that results in a well positioned lab making a clean break
esafak 6 days ago [-]
The present leapfrogging is not a contraindication because companies are not necessarily releasing their best models; we know they have smarter internal models. Furthermore, humans are still involved in model creation. Human involvement is expected to decrease over time, and when model iteration is completely automated, progress will happen at the machine's pace, leading to runaway intelligence, barring any ceilings.
SecretDreams 6 days ago [-]
AI is a commodity. One that is showing to be more readily commoditized than most has anticipated. As of now, the only moats are the financing for the hardware to run it and the hardware vendors themselves - with the latter largely not yet a commodity because of ecosystem lock and a limited capacity of the most advanced fabs in the world.
Heidaradar 6 days ago [-]
I just find this unlikely personally, think about the great research that's happening in the open source world, I'm sure inside anthropic + openai they've also made a bunch of discoveries and improvements (and I'd guess way more due to them attracting the best talent + the better internal models they have)
AdamN 5 days ago [-]
Google said as much shortly after GPT3.5 was released. There is no moat.
With that said, there are some other moats and people are building them: training capacity, inference capacity, brain capacity (literally buying the best researchers and keeping them tied down), harnesses/subscriptions, etc...
tripleee 6 days ago [-]
Was Dario's company winning at that point in time by any chance?
arizen 6 days ago [-]
Seems like learning rate velocty may be the ultimate moat
zem 6 days ago [-]
I have never understood the whole "this is a winner take all game" mentality - the sheer size of the pie is so great that from a purely rational standpoint companies should just be trying to productively get a slice of it and be profitable. winner-take-all is just greed/capitalism run amok, where it is not enough to be profitable, you have to own the entire market (and presumably extract rents)
dgellow 6 days ago [-]
It’s like the supposed first mover advantage OpenAI believed they had. In practice it’s almost always more like a first mover massive tax, and companies coming afterwards benefit from your discovery of a market, publicity, and everything else that has already been validated
aurareturn 6 days ago [-]
It is too early to declare that there is no moat. I think there is and we will eventually arrive at a monopoly or duopoly at the frontier.
Aboutplants 6 days ago [-]
I feel his theory depends on the premise that access to pure compute would the be the determining factor of success. Not the case
qgin 6 days ago [-]
Whoever gets to RSI first “wins” but also maybe ends life on earth. The incentives have never been worse.
pianopatrick 6 days ago [-]
Maybe. Or maybe having the best AI model on the planet becomes like having the best super computer on the planet. Useful for some niche stuff, but not too useful in terms of people's daily lives or what is used in business.
pixl97 6 days ago [-]
Why does your outcome make any sense?
Already businesses that have more compute and access to data seem to eat the world around them. If, and ya its and if, we can make something that self learns into RSI it's not looking like any business that came before this.
pianopatrick 6 days ago [-]
The one thing I'm certain of is that if some group of people can make a system that self learns into RSI, then several groups of people will do so. There will either be 0 RSI systems because it turns out to be impossible - unlikely in my view - or multiple. But we won't have just one.
If there are multiple they will cost money to run. In that world I expect there to be a correlation between costs and quality, i.e. the highest quality AI system will likely cost more to use than a lower quality AI system because there will likely be more compute required and so on.
So in that world, the absolute top tier best in the world frontier AI will not actually be the most used system. This is for the simple reason that such a system will be more costly than a lesser tier system that can do the job just as well.
breuleux 6 days ago [-]
> Already businesses that have more compute and access to data seem to eat the world around them.
Do they? Business valuations are more a reflection of what people believe will yield returns than a reflection of reality. A lot of big tech behemoths could disappear from the face of the Earth overnight and it would make little difference to our lives.
Natural resources and energy are the actual backbone and it is a true catastrophe when these are disrupted. In comparison, disruption to compute or data is just an inconvenience.
koe123 6 days ago [-]
RSI being science fiction so far.
Whoever builds the deathstar wins!
netdur 6 days ago [-]
> Nobody has a moat.
duo to LLM mislead as AGI, then famous theory is still hold, just not for LLM
sixo 6 days ago [-]
Nobody has a moat so long as employees can move between companies
randallsquared 6 days ago [-]
At some point employees will no longer be required for the next iteration, and that might be where the take-off happens that Amodei and others have expected.
grababner 6 days ago [-]
It's hard to make predictions, especially about the future
iphonecorridor 6 days ago [-]
Dario has been wrong about a lot of things tbh.
cyanydeez 6 days ago [-]
isn't he explaining capitalism though? It's almost like he is...
portly 5 days ago [-]
Lol you are talking about Google here
WokeUp420 5 days ago [-]
And yet we're still no closer to AGI. Make it stop
babelfish 6 days ago [-]
> We’ll continue to gather feedback from early testers as we iterate on guardrails before making Argon available to developers, enterprises, and consumers as soon as possible.
Gemini not beating the "can't release a model" allegations
Androider 6 days ago [-]
My Gemini app (updated today) and https://gemini.google.com/ has _3.6_ as the latest selectable model, as a paying Pro user in the US. How is that even possible? Gemini 3.7 was released in August, 3.8 early September. What is going on over there?
rahimnathwani 6 days ago [-]
In my consumer gmail account with Pro, I see:
3.5 Flash-Lite
3.8 Flash
3.1 Pro
In both a paid Google Workspace account (without the AI addon) and a free 'GSuite' account, I see:
3.6 Flash
3.6 Thinking
3.1 Pro
r1ch 6 days ago [-]
We're on Enterprise Standard, our renewal was up like 50% because "Gemini is included now think of all the added value" yet they won't even give us the latest models. I tried hard to champion Gemini internally once every user had it included, yet we ended up spending extra on Claude because Gemini has stagnated. Even the included usage for the Gemini CLI was taken away and now requires an extra subscription. I wonder if we we'll even see Gemini 4 before 2028. It's ridiculous.
giancarlostoro 6 days ago [-]
Every time I hear stuff like this, I think of that Office Space thing... you don't want the Engineers talking directly to the customers.. well it sounds like the Engineers are also handling all releases and business decisions willy nilly.
RugnirViking 5 days ago [-]
you think engineers are responsible? why?
giancarlostoro 5 days ago [-]
Because I have worked with responsible engineers, but it seems like Google is overrun by them there's a lot of really bad business stuff going on. It's like when I think of AWS, nothing on there is named for business people, its all really bad names that IT / Devs come up with.
wavemode 5 days ago [-]
AWS as a whole is sold to businesspeople, sure, but the individual AWS products are definitely being sold to engineers. S3 and EC2 don't need to have layperson-friendly names, since laypeople don't understand what they are or why one would or wouldn't use them - those are CTO/tech lead decisions.
giancarlostoro 5 days ago [-]
I still have simpler conversations when talking about Azure services and naming them, they have reasonable names. I never did anything with GCP so I cannot compare, but I assume their naming scheme is also reasonable. It feels to me like AWS was basically they decided to offer some of their internal things externally, nobody renamed anything, and then they just ran with it.
yearolinuxdsktp 6 days ago [-]
It is ridiculous. It took months for 3.1 Pro to become available in an enterprise account.
The excuse was it was still “in preview” and the enterprise didn’t opt in to the preview channel.
With Google, it’s either in beta or deprecated.
tdboorman 6 days ago [-]
Seeing the same - definitely frustrating. 3.8 seems decent, but I’m still unable to use it at work because Google has been so slow to release it to Google Workspace customers.
vlyan 6 days ago [-]
just Google being whatever the fuck it's been for the past 15 years.
forshaper 6 days ago [-]
a distributed market research institution with no direction?
XzAeRosho 6 days ago [-]
I was reading the announcement and wondering the same. And don't forget, still with 3.1 Pro as the frontier model.
ttul 6 days ago [-]
Indeed. They have this amazing model and you can’t access it in their own branded app. It’s insane.
selcuka 5 days ago [-]
Same here. But if you install the Antigravity CLI and log in with the same Google account you can select both Gemini 3.7 Flash and 3.8 Flash. Crazy.
asdfasgasdgasdg 6 days ago [-]
That's weird. I got 3.8 and 3.7 on the days they were released. https://imgur.com/a/Xu4wRLM (this is on gemini.google.com, but the same is true of the iOS app and the desktop app).
fr2029 6 days ago [-]
[dead]
wasabi991011 6 days ago [-]
I would imagine you are experiencing a bug. I've been using 3.8 daily since its release (on a Pro plan in Canada). I believe this is true of many people.
What is your reason to believe this is not a bug specific to a small set of Pro users?
HotHotLava 6 days ago [-]
Would that change anything about the conclusion? Having a "bug" that changes available model options for some small set of Pro users 3 months after launch certainly qualifies as a wtf-are-they-even-doing level of bug in my book.
bobtheborg 6 days ago [-]
My paid company Google Workspace account is stuck on 3.6.
My free gmail account is not.
fragmede 6 days ago [-]
Gmail gets new features regularly ahead of workspace accounts, nothing new there.
jeanloolz 5 days ago [-]
My corporate workspace which seem to be a pro account is limited to 3.6 but my personal account at 20/month has given me the latest model always immediately. Flash 3.8 is my go to model for pretty much everything those days
benhurmarcel 5 days ago [-]
I also only have access to 3.6 flash on both my free personal account, and my professional Enterprise account.
Google just takes months to roll out their models to everyone.
kyrra 5 days ago [-]
Is this something you've tried to figure out? I'd love to hear more from you here. Are you sure you're not just on a Plus plan? How much are you paying monthly? Are you sure it's the AI pro plan? What does Google One say? https://one.google.com/
AuthAuth 6 days ago [-]
they moved it from the place you'd expect to ai.studio
lp92 5 days ago [-]
I'm a Pro user as well and I've been using Gemini 3.8 for a few weeks now. Not sure why you're not seeing 3.8 available.
Yizahi 6 days ago [-]
Same for me, 3.6 in Gemini Chat, and 3.8 available same day as it was announced in AI Studio using the same account.
sergiotapia 6 days ago [-]
This is why I've heard you should just use openrouter for these models. Whatever google is doing/hiring for the dev ux is doing a terrible job.
modeless 6 days ago [-]
When I said I was tired of Google launching waitlists I didn't think they would respond by simply not having a waitlist.
ionwake 6 days ago [-]
i know this is like "hey guys we got such a cool thing at home ,its rad and uhm we playing with it with our friends"
ok bro thx
cmrdporcupine 6 days ago [-]
They will go through the usual transition of "can't release a model" to "won't load in a harness normal people can use for 3-4 weeks" to "it's smart as hell but completely inept at tool use and coding" to "now it's behind everyone else" ... like every Gemini release.
mrshadowgoose 5 days ago [-]
It's tragic to see, and they already made this very same mistake with Gemini 2.5.
They made their model so hard for people to drop into workflows, that people just... didn't.
Lack of adoption caused them to lose out on usage-based training data needed to smooth out their model's rough edges and progress the frontier.
cmrdporcupine 5 days ago [-]
I have said this before here, but. I don't think they care.
Google gains very little by having us use their models for coding. It doesn't help them in their core mission ("to organize the world's information and make it universally accessible and useful ^W^W^W^W^W^W[and turn it into ad revenue]"), nor would it be anything close to substantial revenue compared to the ads revenue firehose they already have.
They will push AI in a direction that serves their existing goals and service the coding agent model only as is necessary.
Topfi 4 days ago [-]
Then why don’t they just do that? I read this constantly, that Google has different goals (world models, ad rev, recursive looping, quantum computing AI, magic, whatever weekly hype words go around, etc.), but they continue to try competing with model releases focused on coding performance, benchmark results and agentic harnesses.
If Googles goal was something other than those, why expend Billions in time and effort? Alternatively, they want a part of the regular model use pie, they just struggle to compete. QED, there is no secrete alternate goal here.
cmrdporcupine 4 days ago [-]
Well, I worked there for 10 years and I can tell you that they're incapable of making a singular focused decision and executing on almost anything.
There's likely all kinds of internal competition and disagreements and dysfunctions.
So there's that.
But in the last instance, revenues win. OpenAI and Anthropic have to fight for new revenue sources while Google already has a firehose. The motivations are fundamentally different.
mrieck 6 days ago [-]
I'm glad.
I already pay $300+ for subs. Please don't tempt me with another $100 sub just because I got curious if the benchmarks were right.
giancarlostoro 6 days ago [-]
You might as well buy an RTX 6000 Pro Workstation GPU....
maleldil 5 days ago [-]
And use worse models?
Culonavirus 6 days ago [-]
Yeah what's up with that. Also what's with the next big update for Nano Banana? Nano Banana Pro was released almost a year ago!
bakugo 6 days ago [-]
They're just following the current AI marketing playbook. "Our new model is simply too dangerous to release to the public right away" is now standard practice.
They even gave their model a random nonsensical name suffix simply because OpenAI is now doing it, too. Monkey see, monkey do.
jstummbillig 6 days ago [-]
> now standard practice.
Opus 5.5 and Sol 6.1, literally state of the art (in their respective class), were just released without any prior announcement. This has pure and simple become a Google thing.
I don't read that as the same category: There was no announcement, no benchmarks, no limited release and no promises about what will happen with that model. It failed internal safety standards. Might be scrapped entirely due to a failed training run, for all we know.
A_D_E_P_T 6 days ago [-]
I'm still at a loss as to what argon has to do with anything. Say what you will about Luna-Terra-Sol-Astra, or Haiku-Sonnet-Opus, they make sense. I don't see how Google can make sense of argon; it's in a fairly strange place in the periodic table...
fooker 6 days ago [-]
Google R Gon lose the AI race
brainwad 6 days ago [-]
They are going alphabetically, Android style.
IX-103 6 days ago [-]
Yeah, I heard the next one was Barium...or was it Boron?
I was going to say I don't know what they'd do for C, since Carbon and Calcium are already things. But knowing Google, they'll probably call it Chromium.
A_D_E_P_T 6 days ago [-]
They could use caesium or cadmium, which are hardly less weird than argon.
ryandrake 6 days ago [-]
All-my-tokens-ar-gon
wg0 6 days ago [-]
Breaking news is not the model. Breaking news is that inside Google, it is being heavily used on large code bases for writing code and it is migrating 800k lines of C++ code to Rust already.
In this space, any other company that I respect other than DeepSeek is - that would be Google. They had been honest about it from the get go including their infamous "we have no moat" memo.
This company has enormous data, their own hardware (TPUs) and their own in house experts. Actually, LLMs are invented here.
Good addition to the arsenal.
wasabi991011 6 days ago [-]
Google's Quantum team is also incredibly impressive and well respected.
So while this announcement has no details about the quantum algorithm optimization, I feel fairly confident that it will hold up.
asdfman123 6 days ago [-]
Argon is doing my job for me while I'm writing this comment.
A guy at lunch today asked me when a feature was going to be built on the tool I'm working on. Turns out it had built it last night at 8:30 when I was hanging out with my girlfriend. Welcome to the future!
farlight 5 days ago [-]
I don't get it. This technology has almost reached the point where they don't need you anymore, and you're joyful about it for some reason?
Gareth321 5 days ago [-]
I am in two opposed minds on this. On the one hand, you're correct. Their job will be made redundant in a couple of years. Some senior people might be retained to orchestrate all the agents, but eventually they will also be replaced. And it's coming for all white collar jobs, not just coders. That's bad.
On the other hand, unlimited intelligence democratises products and services in a revolutionary way. Everyone will be able to do whatever they like in digital space for basically free. No more purchasing software. Make any app/company/website/blog/movie/show/game/forum you can think of. This will quickly bleed into the physical space, with real-world products and services becoming logarithmically cheaper. A true future of abundance.
The big problem is going to be our social and economic transition. Are we going to wait until unemployment is that 10% before we act? 20%? How bad are we going to allow things to become before we implement universal high income? I say universal high income because white collar workers are not going to accept being relegated to an income of $1000/month forever. To achieve universal high income requires eye-watering taxes on the major benefactors of our new economy. They won't accept that without a fight, and it our current fractured political climate, what would it take for everyone to agree on a unified direction?
wg0 5 days ago [-]
I am confused about the whole situation let me explain.
It seems like all software will get replaced it by local versions. Suppose I am an individual or a business that was using a SaaS product (such as JIRA).
Let's be generous and imagine that the monthly payout was $20/month for that software (usually for businesses, it is much higher) and one fine morning I login and point a multi modal AI agent to it and clone the whole thing for my local use in let's say 3 months worth of $20/month AI subscription.
Now what? Gradually, that software company would go out of business but that user won't be subscribing forever either to AI inference service and the only constant customer of AI inference would have been the software company which went out of business so... No software company, no AI inference business either?
Gareth321 5 days ago [-]
If I understand your question correctly, it reduces the value of software to almost zero. Meaning all of the SaaS companies are going to have to work very hard to diversify their revenue streams into value added services. That's going to be very difficult or impossible for most to navigate. Hence the term in the industry "SaaSpocalypse."
Some companies will retain a moat. For example, YouTube holds incredible IP, and until AI can replicate that wealth of content at scale for cheap, it will remain profitable. Facebook has the user critical mass. Increasingly, hardware for inference is going to be a moat. So is electricity.
Which loops back to my comment above: this breaks a lot of the market dynamics required for a functioning economy. Accelerationists are convinced that we'll invent new jobs to replace the old jobs, but I don't think that's going to happen. Certainly not at the pace of change we're seeing.
wg0 5 days ago [-]
Basically only moat left are either if you have "Data" or "Compute". Software layer is worthless and pretty much reproducible.
Data as in YouTube is all just data. Building a website and app around it isn't the hard problem. Anyone can launch another YouTube in few months but that would be pointless.
Gareth321 5 days ago [-]
Yes, and increasingly, data will no longer be a moat either. These models will be capable of creating all the data/content we could ever want. There will always be a market for "organic" movies with real actors, but we should expect the value of that to decline precipitously.
My investment thesis is currently around these strata:
1. Electricity. All analysis shows massive shortages beginning now with no end in sight. Western governments in particular have massively dropped the ball on this one.
2. Chip design and production. Nvidia and TSMC dominate here for a few reasons. Partners required in the supply chain like ASML benefit, but they're not really the bottleneck right now. We're seeing a lot of investment pouring into this space and we'll see competent design competition (especially from Google's TPUs, and potentially from Apple and AMD). Chip fab is very difficult to get right, and takes a long time to ramp up. See the NAND space.
3. AI labs. These guys are doing to get commoditised. They're trying very hard to prevent distillation but I think it's impossible. The open weight models are not far behind, and the Chinese labs are getting very creative about how they work with limited hardware. If anything, they'll decrease inference cost over time, reducing the value of existing data centers (of which OpenAI and Anthropic have purchased an enormous amount). I am very bearish on the future value of OpenAI and Anthropic.
4. Software. So much software. Everyone gets software. The companies which benefit from this will be able to monetise it. Google, for example, might put ads into VERY capable and free AI. People might accept that. Microsoft has been investing heavily into their data centers, and maybe that's their revenue center in the future. Especially securely hosted services. I expect massive growth in this space in the short term. As long as people still have high paying jobs, they'll pay for well made software and tailored services.
copperx 5 days ago [-]
> As long as people still have high paying jobs, they'll pay for well made software and tailored services.
Here's the question. Which high paying jobs will remain? People will still be needed, obviously, but salaries would be in a race to the bottom without some form of govt intervention.
Melatonic 5 days ago [-]
YouTube requires a hell of a lot of infrastructure and Compute to do well
nozzlegear 5 days ago [-]
> On the other hand, unlimited intelligence democratises products and services in a revolutionary way. Everyone will be able to do whatever they like in digital space for basically free. No more purchasing software. Make any app/company/website/blog/movie/show/game/forum you can think of. This will quickly bleed into the physical space, with real-world products and services becoming logarithmically cheaper. A true future of abundance.
This isn't happening yet, SaaS is only growing more in the era of AI. Anecdotally, my own small SaaS has only grown instead of shrunk as well.
The name "universal high income" should be tipping you off to the issue with it. If money has less importance then what tools will individuals have to change their station? How will anyone other than the permanently entrenched rulers affect change? We don't have a good system now, but it seems like we're hell bent on making it even worse.
Edit: UBI being pushed by asset owners is a step towards Blade Runner rather than Star Trek.
WarmWash 5 days ago [-]
I cannot envision any future reality where an ASI bows to any human. The only entrenched rulers will be the AI themselves.
mycall 4 days ago [-]
Once ASI starts having its own bank accounts, its done.
Gareth321 5 days ago [-]
My naive hope is democracy, so we need to defend it.
nullpoint420 5 days ago [-]
What does this even mean? What does a fair democracy even look like nowadays, that can't be bought or externally influenced?
atombender 5 days ago [-]
I'd like to see AI "democratize" the world, but I have a much more pessimistic outlook. One thing we see with technological revolutions is that (once the dust settles) they provide general improvements for all strata of societies. But as some boundaries are erased, others are magnified a hundredfold wherever robber barons can stake an exclusive claim.
If genuine AGI is developed, its everyday conveniences may continue to be shared with the common masses, but the powers that own the technology and the data centers will have no incentive to give everyone access equal to superintelligence, and that includes giving governments the same access.
Every stage of the industrial age has seen powerful, wealthy people/groups (whether you call them oligarchs or industrialists or whatever) become able to exert disproportionate power over the state, and we're already in a place where this is happening. Humans have shown time and again that once you have some resource (whether it be oil, gold, or data centers), someone will want to own all of it, and that they're always willing fight for that ownership, and this fight rarely benefits ordinary humans like us.
Developed countries have been enjoying an unusually long peace time thanks to the wonders of capitalism and the emergence of stable, progressive capitalist-friendly democracies. The road to utopian basic income and limitless leisure is going to be fraught with riots and violence, and make Marx suddenly utterly relevant once again, because there's too much at stake, and too stark a division between the haves and the have-nots.
The alternative timeline is one where governments get together to regulate AI into some kind of international agreement under the UN. That requires taking power away from the private corporations; historically, that's been a tough sell.
copperx 5 days ago [-]
> If genuine AGI is developed
If AGI ever comes to fruition, it won't come as a subscription plan.
higeorge13 5 days ago [-]
I believe that the middle ground for this is to keep all these jobs orchestrating agents or whatever the AI future invents for us, but with lower wages. The golden era of dev wages will be gone. There is no incentive for companies paying people 100-500k-1m to write prompts and debug agents, independent of their level.
Gareth321 5 days ago [-]
This might be how it shakes out but I don't think it's acceptable, and I don't think white collar workers will think it's acceptable. Taking high income people and making them low income people (usually for life) has a tendency to politically radicalise people. Especially in light of the unprecedented productivity and profits which businesses will experience. People will demand a slice of the pie.
copperx 5 days ago [-]
One kind of intervention that could work would be licensing, like with some engineering professions. Make it illegal to work on software without a professional license; same as with doctors. Engineers would be free to work with AI, but the final responsibility would fall on them.
This artificial control works to prevent oversupply and protect salaries. Unfortunately, the businesses calling the shots won't ever allow this to happen.
mlyons1340 5 days ago [-]
That’s dystopian. I would hope it never happens!
customguy 4 days ago [-]
So? They'll be declared domestic terrorists and that'll be that. I mean, you cannot demand something from an entity that doesn't care about you, doesn't need anything from you, and over which you have no leverage.
I would say, be afraid and use the fear (not to ruminate, but to organise and do things), but also be optimistic, and use that, too (not to imagine what people will do then when they're not doing it now, but to believe it's possible helping making it reality, now).
geertj 5 days ago [-]
There is no credible path towards stopping progress on AI. Nobody knows exactly how this will play out. But whichever way it turns out, being an skilled AI practitioner will give you strictly more options than not being one.
copperx 5 days ago [-]
Time to crack open our dusty linear algebra textbooks.
ncruces 5 days ago [-]
Because (maybe particularly) at 1e100 scale, having a super intelligent butler that does whatever everyone asks of it can easily get you to hundreds of thousands of daily PRs merged to the monorepo, but won't necessarily help coordinate efforts, and may actually cause certain projects to collapse under their own weight.
lp92 5 days ago [-]
You still need people to come up with the ideas and act as a guide so it does the right thing the first round.
mlyons1340 5 days ago [-]
Do we really? Is that the human ‘moat’? I don’t see why AI couldn’t begin to handle that as well. What is limiting AI fundamentally from doing it?
andriy_koval 5 days ago [-]
My believe is that current LLMs performs very well in the constraint environment with lots of data available, e.g. we have lots of code on github, public discussion with feedbacks, compiler and tests failures as feedback, so LLMs can train on trillions data records.
That's not true for many unconstrained real world scenarios, and LLMs currently perform poorly there. Another breakthrough is needed to overcome this.
isoprophlex 5 days ago [-]
Finally circumstances will force me to become a goat farmer, a desire I've always secretly aspired to but never felt comfortable expressing, let alone acting upon
Now we will finally be free, without having to make hard decisions. It will be decided for us.
lomase 5 days ago [-]
[dead]
asdfman123 5 days ago [-]
I've been emotionally and financially preparing for this since I read about the singularity in 2007.
I do still love technology and I'm a builder. I'm also neither a tech optimist or pessimist, but an inevitabilist. It's coming.
crossroadsguy 5 days ago [-]
So basically people who didn't, or couldn't prep for this will be 'effed. Not accusing you or something. Just thinking out aloud. I am/will be one of those people.
asdfman123 5 days ago [-]
I actually have complex feelings about it as well.
The way I see it is that history is going to advance whether you like it or not and you might as well ride the wave.
I understand I'm lucky to be insulated from the crisis a bit, though. I do think once SWEs lose their jobs every other office worker is going to follow, so we're in the same boat.
crossroadsguy 4 days ago [-]
I see. Thorughout the history there has been no such looming danger of mass unemployment looming and what comes with that. But I do also feel the same - eventually we will be in it together. And if that mass scale unemployment comes to pass, then it may lead to a bit of interesting times so to speak. But yeah, that insulation does make watching all this unfold in real time a bit less uncomfortable ;-)
gniv 5 days ago [-]
Jevon's paradox is the most likely answer. Tons of stuff to do.
password54321 5 days ago [-]
Jevon's paradox does not imply you will be needed. It only implies that more software will be produced as code becomes cheaper.
crossroadsguy 5 days ago [-]
Sometimes I wonder AI won't have to hack military drones to end humans en masse. Making relevance, employment, and other life conditions for most so pathetic that it will start making it happen on its own.
m3kw9 5 days ago [-]
you do need a precise prompt to do what it's asked and there are 50-100 things that needs to work to meet the criteria. Little things need to work, and work well
copperx 5 days ago [-]
Why wouldn't it be cause for joy, even elation?
I understand we have the pesky problem of work and time being interchangeable for money. But except for that, it's pretty exciting.
nozzlegear 5 days ago [-]
As someone who grew up poor, and then used to be on food stamps and other state aid as a young adult, that's a particularly pesky problem. Dread is a more apt feeling than joy or elation in that situation.
copperx 5 days ago [-]
On the one hand, it's scary. On the other hand, almost everyone will be in that position.
stillcompiling 5 days ago [-]
Out of sight, out of mind. It is unexciting because in that future, there is nothing to think about related to this topic. What is exciting about something that is irrelevant for humans since nobody looks at it anymore?
kridsdale1 6 days ago [-]
Same. And for everyone in my team. We’ve been super impressed by Argon for a few weeks.
But it still takes 2 weeks to get a CL approved and past TAP.
asdfman123 6 days ago [-]
Can't help you with your teammates, but see go/presubmit-latency-skill :)
As a non googler, I understood it as "is it webscale" type of jokes.
malthaus 5 days ago [-]
so, why is google paying you an absurd comp still. what exactly do you bring to the table that your pm can't order argon to do?
i'm actually curious on what your view is despite the snarky tone.
asdfman123 5 days ago [-]
I am basically a tech lead to the AI's junior dev swarm. It can do a lot of things, but still needs signoff and occasional hand holding.
If you looked at that arrangement and said "we don't need tech leads, we just need nontechnical managers and junior devs" you'd be sorely mistaken.
I do anticipate a future where it will be better than me at applying taste, knowing best practices, and having domain familiarity.
andriy_koval 5 days ago [-]
ability to find workarounds around other disfunctional people with absurd comp to unblock progress.
stillcompiling 5 days ago [-]
Nice, soon after being layed off you can do all that while not minding work at all!
hollowturtle 5 days ago [-]
welcome to the unemployed future! first bug to bring down production and you're fired, will have a good memory that at least you were with your girlfriend
margorczynski 5 days ago [-]
You assume that a bug that can take down production is more likely to be produced by the LLM than by a human. That very well might not be so with current models and especially in the future once they get even better.
It's coping, the truth is writing code by hand is dead.
hollowturtle 5 days ago [-]
> especially in the future once they get even better
You have a future as a fortune teller, good luck!
> the truth is writing code by hand is dead.
don't forget to take the proper pills dhh!
qup 5 days ago [-]
You're so scared to make predictions about the future that you can't even accept "LLMs are going to get better" as a truth?
You're so skeptical of it that you're willing to make fun of people?
It's about as much in question as whether or not I'm going to eat breakfast this morning.
I'm gonna have eggs and toast. Who am I, Mrs. Cleo? How could I possibly know this unknowable future?
stillcompiling 5 days ago [-]
Mind to explain this logic? Makes no sense to me
ipsod 5 days ago [-]
3 years ago, these things became useful. Every year, they're drastically better. Most juniors are already dead weight. Most of the rest of us are next.
IDK how it could be otherwise. It's moving too fast and gone too far already.
hollowturtle 5 days ago [-]
> Every year, they're drastically better
Ehm no? Models have plateaued, "harnesses"(TM new buzzword) got better and with many integrations
hollowturtle 5 days ago [-]
> Most juniors are already dead weight. Most of the rest of us are next. IDK how it could be otherwise. It's moving too fast and gone too far already.
AI psychosis is very bad
ipsod 5 days ago [-]
I'd love to know if you still felt that way after seeing what I do in a day. Company IP won't allow it. Maybe I'll stream some personal dev work or something.
I'm not saying you're wrong, but, I'd be shocked if you were still so adamant (assuming you're rational and not in your own psychosis).
Here's something I'm about to drop on AI. Like 90% of things like this, when I ask for a fix (with a few skills), get fixed with fewer edge cases left dangling than I'd have left if I'd spent all week on this stuff. And, it'll be done before tomorrow, with no further input from me. This is a list I put together in about 1 hour.
Things to fix with OCR text labeling
- vertical line in center breaks box-drag
- nope, not line in middle... IDK why, but the drag pretty frequently snaps back to original position in middle of drag... lets me keep dragging, but have to start back from there
- happens with "draw stamp box" too
- forces me to re-click the button to start over
- add zoomed view of text in bottom right corner of video
- add ability to restrict OCR
- current job is 0 1 2 3 4 X 6 7 8 9
- 5 is an X, for some reason
- is detecting full alphanumeric
- add ctrl+z undo for modifications to drawn box
- deleting character in middle of "your label" text box jumps cursor to end
hollowturtle 5 days ago [-]
I could do even better than you in 30 minutes and let it write code for a satellite if I wouldn't care about quality. But at this point I have the feeling I'm talking to a bot
ipsod 5 days ago [-]
Yeah, I'm not saying this is an example of great work. It's sufficient for the job - more time spent refining my instructions isn't necessary.
What I'm saying is, with just the effort it takes to notice and somewhat-sloppily mention things, they get fixed, and usually fixed well. Further testing will tell us whether it needs more work or not.
They may have never had these troubles at all, if I'd coded by hand originally, but then, this particular app would've never been written, because it wouldn't justify that amount of work.
asdfman123 5 days ago [-]
It's a prototype project. Stop projecting on the internet.
tazjin 6 days ago [-]
> Argon agents are working on migrating C/C++ codebases to Rust across Google
Man, I remember back in the days when the cppnext team was refusing to even consider Rust, instead looking at absurd stuff like Carbon and Swift (!), even though half of the engineering staff already knew where this was headed. I hope they got a few good promos out of the delays at least.
minimaxir 6 days ago [-]
A RewriteInRustBench would be unironically useful at this point since all the main agents can write it reasonably well despite its relative scarcity in the input data.
LarsDu88 6 days ago [-]
Rust is the best language for LLMs b/c it gives by far the best debug messages. Just tons of verifiable reward signal for post-training. Even the most rudimentary LLMs can school me on idiomatic Rust
rafram 6 days ago [-]
On the other hand, Rust's borrow checker is very picky, and even a frontier LLM still sometimes struggles to respond to roadblocks sensibly (refactoring so whatever it's trying to do can be done safely) rather than stupidly (introducing some horrible global arena thing so it can make the borrow checker go away). A lot depends on how good your instructions are, and how good the existing code is, since bad input begets bad output.
nchie 6 days ago [-]
I've (more or less; I've read quite a bit of the code) vibecoded several houndred thousand lines of Rust and I've not seen this happen a single time. It sounds like something it'd do when you ask it to "write a linked list while satisfying the borrow checker". Are you sure you haven't (possibly unknowingly) been giving it instructions which ended up luring it into doing these things?
zahlman 5 days ago [-]
Couldn't it just look at what std::collections does?
hbbio 6 days ago [-]
Yep! In our tests, we found Zig to be a pretty good fit to translate C++ codebases.
And static analysis + agents are good enough at keeping the memory management in check. Compared to Rust, there's no magic so it's easy for devs and agents to reason about.
TBH a "global arena thing" can be very good for performance rather than a bunch of random allocations/deallocations
Karrot_Kream 6 days ago [-]
A good eval benchmark suite could really improve this then.
bitexploder 6 days ago [-]
Evidence needed. I think for certain kinds of outcomes it has very strong advantages, but these advantages are not a given as 'best for LLMs' :)
iillexial 5 days ago [-]
in my experience LLMs write pretty bad Rust code. sure it works, strong typing system, etc., but it's unmaintainable and not readable.
konart 5 days ago [-]
I doubt these two features will be a defining quality of a product soon enough.
Many pieces of software are going to be just blackboxes worked by AI. You will be maintaining output quality and stability and that's it.
david-gpu 5 days ago [-]
I have the same problem with the assembly produced by compilers.
Maybe we should let them do their thing and instead focus our attention on the higher-level stuff like specifications and testing.
lossolo 6 days ago [-]
Not always. In my experience, if you're not working on a small, trivial codebase, LLMs will sometimes just create spaghetti unreadable, inefficient code to satisfy the constraints of the type system/borrow checker.
throwitaway222 6 days ago [-]
I've narrowed in on only using Go or Rust generated code (Go for APIs right now) and rust for some TUI or other thing. TS for web interfaces (w/React).
DrBenCarson 6 days ago [-]
From DARPA’s “Translating all C to Rust” TRACTOR program:
I wouldn't be surprised if we're already at the point of more LLM-written Rust than hand-written. Models training off models
adamrezich 6 days ago [-]
All the main agents can write Jai code reasonably well despite being even more scarce in input data!
6thbit 6 days ago [-]
Have each agent rewrite openssl in $lang and call it the RollYourOwnCrypto bench.
pshc 6 days ago [-]
Rewrite everything in Rust has been a meme for so long that to see it coming to pass is surreal.
Gigachad 6 days ago [-]
After the current onslaught of 0 days on linux and other C projects combined with the new incredible ability to convert codebases to another language I think we will start to see this actually happen.
I'm not saying we blindly vibe convert Linux to Rust, but I think it could be a valid idea to start converting small parts and carefully auditing them.
hectdev 6 days ago [-]
I've been a Swift/Obj-C engineer for my whole 15 year career. I now have all these odd jobs I have going on Raspberry Pis around my house that LLMs have written in Python. I'm now having them convert some of them to Rust and I am astonished on how fewer resources are used.
Gigachad 6 days ago [-]
I converted some Ruby stuff at a previous job to Rust pre-ai days and it was incredibly how much less memory they took and how fast it ran. But we still built everything else in Ruby because finding Rust devs was hard.
I am hopeful we can bring in an age of much more efficient software rather than fully prioritizing developer convenience.
keepitwiel 5 days ago [-]
I let an LLM write a custom kernel for doing inference on an RPi cluster. The age of bespoke custom kernels is upon us.
hollowturtle 5 days ago [-]
> carefully auditing them
and start everything all over again? current c/c++ tools have been audited for years
fg137 5 days ago [-]
Yet certain categories of bugs are basically unavoidable in C/C++ but almost eliminated in Rust. Human audited doesn't mean bug free.
baq 6 days ago [-]
Not many people can hold grudges as strong as principal engineers
bbor 5 days ago [-]
Longtime Google engineers have it particularly bad. Some of it could be bad-faith promotion hunting I suppose, but the core problem is that their "find something to work on" culture leads to some insanely dysfunctional ideas around ownership. In the reverse, too; only at Google can you be the head engineer for a service necessary for $10B in ARR and never really realize it.
Also the internal tooling culture there is just insane. I'll never forget the day the last SUPER_ESSENTIAL_TOOL was marked as "Deprecated - do not use!" while the only replacement was still marked "Pre-release -- use at your own risk!". I can't pretend to know what dynamics led to that cause it was so far from my org, but I can't imagine they were healthy ones!
timmg 6 days ago [-]
I wonder if this means Carbon is DOA.
I was excited to see what it would be. But I don't think I can argue that it makes as much sense anymore.
qalmakka 6 days ago [-]
Carbon was clearly DOA the moment it was announced, IMHO. It looked cool but it served none but Google, and now with LLMs you have a massive incentive not to use a niche or new language due to how better LLMs get the bigger the corpus is
The only somewhat realistic proposal in this space is Herb Sutter's cpp2, which is arguably a massive improvement and I'm puzzled why nobody in the standard thought to give it a spin, there's just to much cruft they'll never be able to get rid of unless they make an alternate yet backward compatible syntax with C++ that changes the defaults from "random 80s nonsense" to something better
geokon 6 days ago [-]
Is there evidence that LLMs generate better code in more popular languages? I get the sense the "experience" translates between languages and it can reason in any language just fine. I write Clojure code using a rather esoteric framework (Pathom3). There is probably very little similar code out there (it's definitely a tiny fraction of the training dataset) but it seems to do just fine
Not saying you're wrong, just curious if there are numbers backing this up.
dom96 5 days ago [-]
I built a brand new language to test this[1]. Not only is the language different to basically any other language but it also tries to be adversarial against LLM understanding.
The best models can still make sense of it[2], though the tasks so far have been pretty basic. But I do think it gives some evidence that languages which aren’t well represented in an LLM’s training can still be reasoned about and written well by LLMs.
In my experience LLMs are way better when they "know" a language "instinctively". It's just that unless your language is very niche, the corpus is usually good enough. I tried using Claude to write my own personal language a while ago (I wrote a toy compiler decades ago) and it struggled a bit, because you could see in it's reasoning it had to "repeat" the syntax equivalence to itself while it read the code. It didn't just "know" it could use a given construct to do something; conversely Astra, when carefully instructed to do so, can plop down esoteric template code that works the first time, because it just "knows" it's the right stuff to write
Mond_ 6 days ago [-]
Cpp2 has been dead for a while afaik, while Carbon is still going.
I don't think Carbon is dead, it just all depends on how easy it actually is to rewrite "all of C++" in Rust. (The jury is still out on this one, but it's not looking good.)
qalmakka 5 days ago [-]
Yes, but at least it was a real thing with a serious proposal behind. Even if Carbon ships, what value would it give in 2029 or whenever it is in a world where writing rust or heck even C++ is now way easier and foolproof (as long as you know where to guide an LLM)
pjmlp 4 days ago [-]
The Carbon team has always been the first one to assert this is for Google internal purpose first and formost, everyone else should go to Rust, Java, Go, C#, Swift,... whatever fits their workloads.
It has been the social media that has given Carbon a roadmap that the team never communicated.
As for Cpp2, it was yet another C++ wannabe replacement, sold as if it wasn't, because the chair of ISO C++ at the time, naturally could not be seen as yet another one coming up with C++ wannabe replacements as well.
fg137 5 days ago [-]
None of these solutions has a chance. That should be clear from the beginning. C++ community is so slow at updating codebase to latest C++ standard, let alone a different language. The last thing the C++ community will do is to migrate to an incompatible language that only looks/reads like C++. That did not happen in the past 30 years and will not happen now.
pornel 6 days ago [-]
Carbon's own docs say:
> Existing modern languages already provide an excellent developer experience: Go, Swift, Kotlin, Rust, and many more. Developers that can use one of these existing languages should.
So the reason for Carbon to exist is gone. C++ code can be migrated straight to Rust without Carbon's stopgap.
akoboldfrying 5 days ago [-]
I think that's overstating it. Carbon promises a reliable transition; getting an LLM to rewrite in Rust depends on the LLM being smart enough to never make a mistake that it can't catch with (existing or its own freshly created) tests.
LLMs are very good now, but they are still stochastic (when temp > 0), and Google has a lot of code -- i.e., many rolls of the die.
pornel 4 days ago [-]
The bar isn't getting it perfect. The bar is merely parity with the legacy C++ code that wasn't perfect either, which nobody wants to maintain either.
LLMs are fuzzy when generating, but such conversions aren't done one-shot. Review and test feedback loops are there to catch the random errors. The frontier models are getting good enough at this.
When LLM is instructed to generate idiomatic safe Rust (rather than literal 1:1 unsafe translation), it benefits from a lot of feedback from the compiler.
Whatever QA there was to ensure C++ was good enough can be applied to the Rust version too.
akoboldfrying 4 days ago [-]
> The bar isn't getting it perfect
Right, I'm also talking about making the new Carbon code behaviourally equivalent to the old C++ code, i.e., bug-for-bug compatible (except w.r.t. C++ bugs caused by UB).
> Whatever QA there was to ensure C++ was good enough can be applied to the Rust version too.
The point is that all that QA over the years was a vast amount of effort by highly-paid Google engineers, which could be (mostly) avoided by mechanising the conversion as far as possible, which is something that Carbon's approach can do and LLM translations can't.
I'm not against LLM translations per se. Ultimately it's an engineering decision like any other. I'm just pointing out that, similar to the benefits of using a strongly typed language over relying purely on tests, using an approach that guarantees to eliminate a large class of possible problems has many advantages, especially at scale.
fg137 5 days ago [-]
> Carbon promises a reliable transition
Does it deliver?
Can all existing C++ code be ported to Carbon without refactoring?
akoboldfrying 5 days ago [-]
What you know with Carbon is that the subset of code that you can port mechanically is behaviourally equivalent to the original. This is massive, and something you can't get from LLM translation.
fg137 4 days ago [-]
Is anyone doing that, especially at Google?
akoboldfrying 4 days ago [-]
I don't know.
DetroitThrow 5 days ago [-]
It was never built with an open source community in mind. It was always DOA in a world where Rust existed.
YuechenLi 6 days ago [-]
Version 0.0.0.0 after 4 years. Their goal of "full interop with C++ while being a completely new language without any of the flaws of C++" is plain absurd.
It's DOA because Google doesn't have any idea of what Carbon should be, and to be completely honest, at least 80% of what they currently use C++ for should be rewritten Go, you know, that language developed specifically because of the issues with C++ by teams within Google.
vovavili 6 days ago [-]
What exactly makes Carbon absurd?
boshalfoshal 6 days ago [-]
There is 0 practicality in inventing an entirely new coding language that only one company uses, and you have to teach it to thousands of new engineers. Rust exists and fits the job totally fine and is used in more places and has actual support outside of a single entity (i.e you can actually hire people that feasibly know the language).
It was clearly done because some PL guys at google really wanted to make a new cool language and Google was the perfect place to incubate it without it getting axed. Probably got a couple of promos out of it too. This is clearly not the best use of time or money, but I guess if you're google you have so much of both it probably doesn't really make a dent, and you can keep a few very smart people happy with shiny new projects.
Also, LLMs being used for a large portion of coding nowadays sort of remove the need for these types of languages, IMO. They make less "silly" bugs (both logical and structural) that languages like this are meant to catch, and they are much better at languages that are better represented in the training corpus. This somewhat obviates the need for very niche "type/dummy-safe" languages like carbon (and even rust/zig, imo). So even if you did want to use Carbon, you'd likely have to bootstrap a decent amount of your own "good" carbon code to post train an LLM, and even then, it likely won't have that big of a gain vs just having an LLM write C++ or even Rust. If you are a company that still reviews code, you should just have an LLM code in a language most people can understand anyway to make verifiability tractable.
torginus 6 days ago [-]
Rust is not the end of history. One of the difficulties with the language lies exactly with porting existing code written in an OOP style to idiomatic Rust, as those codebases weren't written with ownership in mind.
Such rewrites will contain judicious uses of Cell, RefCell, unwrap() etc. which make for ugly code that's not exactly simple to understand and might even have some landmines (crashes).
Getting rid of these requires a subtantial amount of engineering effort, which I'm not sure how well these LLM manage.
Given the nigh-universal experience of LLMs producing an ungodly mess when left to their own devices, I have my concerns.
mike_hearn 6 days ago [-]
> There is 0 practicality in inventing an entirely new coding language that only one company uses, and you have to teach it to thousands of new engineers
They did that for Go and it seems to have worked out for them though.
pjmlp 4 days ago [-]
Three famous guys on Google's pay check did it on their 20% to avoid C++, they were lucky Docker and Kubernetes projects pivoted from Python and Java respectively into Go, and managed to take off in the industry adoption.
Google themselves to this day aren't big Go users outside Kubernetes ecosystem.
computerdork 6 days ago [-]
Hmm, I don't disagree with you that LLM's remove the need for type-safe languages, but as the blog mentioned, Google is porting their C++/C code to rust. Does this mean the port is waste of time and that they should just rely on the LLM's to catch memory errors?
tclancy 6 days ago [-]
> I don't disagree with you that LLM's remove the need for type-safe languages
That feels like a really strong conclusion. I’m not clear on why any safeguard isn’t a useful safeguard if you let agents write all the code.
computerdork 6 days ago [-]
Yeah, in my personal opinion, seems like Boshalfoshal's conclusion was too strong for me too, but I haven't done development enough with LLM's to make my own determination.
boshalfoshal 6 days ago [-]
I mean Rust definitely has a better tradeoff than Carbon in this case, re readability/verifiability by a person (and sufficiently good internet training data).
I personally think that you _could_ use an LLM to catch these types of boundary case errors without having to port the _entire_ C++ codebase to Rust, but maybe pre-emptively porting to Rust now can catch some of these cases for cheaper than doing a full LLM sweep. Also more cynically, its a good benchmark lol.
I guess if you really believe in curve of LLM capabilities you should just use a language that has the best performance, safety, flexibility, and extensibility, since in the limit few/no people will actually read the code anyway. I think this ends up being Rust.
chis 6 days ago [-]
I'm not an expert on this. But isn't it the case that C++ code could have errors that span the entire codebase, like a setup in file A triggered by a bug in file B which is immensely far away on the import graph? A classic would be a use-after-free. To me that's the thing that Rust can help with, even if silly bugs aren't being written by AI.
The other thing is just that rewriting some old human-written codebase in Rust probably immediately catches many bugs. It would be hard to prompt the AI to properly scan for such bugs itself, they're lazy when working in that modality.
Paracompact 6 days ago [-]
I am an expert (in formal methods). LLMs absolutely need more safeguards rather than less. Not because they /need/ them in order to produce functioning code, or even because they produce as many braindead bugs as humans, but because in an era of explosive code quantity, what has become valuable is (assured) code quality.
Going back to C++ would be particularly bizarre to me given that AI is also very proficient at verified languages. Not merely typesafe, but languages comprising their own spec languages such as Rocq and Lean.
I predict that in the next decade: (1) the market will understand the difference between a "code writer" and a "spec writer," with (2) the expectation that the latter is overwhelmingly more necessary than the former in an AI-dominated field, and (3) there will emerge more useful and less mathematically specialized formal verification alternatives to Rocq and Lean, and a filling-out of the tooling gap of between "static typing" and "interactive proof assistant," perhaps in the vein of ACSL-like contract annotations, and (4) there will be a subsequent shift in the traditional curriculum for programmers. Since educational change is slow (and spec writing depends on good coding fundamentals anyway), perhaps (4) is a stretch, but I'm more confident in the first three.
computerdork 6 days ago [-]
For me personally, when doing development with LLM's, you've won me over towards using safer languages rather than looser ones. Because for one thing, the developer working with an LLM still has to remember to ask it to check for things like memory leaks and security issues. And (as I understand it), LLM's are statistically in the way they work and some level of randomness is always apart of their answer, so there is always a chance they will miss something. Interesting
diegojromero 5 days ago [-]
Could you recommend some lectures/reads about the use of formal methods in LLMs, I'm interested in the area.
lesuorac 6 days ago [-]
Didn’t FaceBook fork php into another language?
I’m not entirely sure Google should have both Go and Carbon but when you have billions in server costs it makes sense to do extreme stuff for even basis points of performance. I’m still surprised at how much java there is.
fg137 5 days ago [-]
I don't know what the exact deal is, but I assume Hack meets specific use cases at Facebook and can be put in production. It doesn't matter if anyone else is using it.
Maintaining a language meant for web servers is also objectively a much easier job than something like C++/Carbon which is supposed to be at system level, general purpose and has huge standard library.
By comparison, virtually nobody is using Carbon at Google for production code.
The counterexample, ironically, is Flow. It's practically irrelevant these days -- many (if not most) of Facebook's open source projects use typescript.
6 days ago [-]
bvinc 6 days ago [-]
I’m not op. But I think it’s not Carbon itself that is absurd.
It’s absurd to think that Carbon is the solution to memory safety when rust exists and Carbon’s memory safety story is basically “TBD”.
gorbot 6 days ago [-]
rust's existence?
fg137 6 days ago [-]
I wouldn't call it absurd, but very questionable at least. Most companies are not going to even consider throwing money at this adventure.
Maxatar 6 days ago [-]
The fact that it will never exist.
6thbit 6 days ago [-]
I wonder if there's people already whose full time job is maintaining/extending one of these auto-migrated codebases.
Imagine they aren't even familiar with rust but are deeply familiar with the product.
ChickeNES 6 days ago [-]
Heh, I use my clankers to rewrite Rust in C
mlmonkey 6 days ago [-]
> The end result is a memory-safe video decoder that runs 2.7x faster than the Rust port, with identical video output, bringing it closer to the optimized C++.
So ... Rust still can't beat the C++ implementation :-D
Sorry, didn't mean to ignite a langwar, but it's still interesting to see.
pasteleft 6 days ago [-]
"Safe Rust" being closer to "optimized C++".
And those "optimized C++" usually incldues assembly code, so it's a huge improvement.
Of course, Rust is not a magic, so just porting to Rust wouldn't make this performance improvement.
It seems their AI overfitted code to Rust compiler to find safe Rust code that compiles to efficient assembly.
himata4113 6 days ago [-]
Additional safety checks do mean less performance, it's the same thing as hardened allocators. Rust will panic if for some reason you attempt to read outside the bounds of a slice object (even when it should be impossible to be outside those bounds)
manbash 6 days ago [-]
If it's "rust still can't beat... performance-wise", then yeah I guess.
But there are other criteria. The move to rust might've also resolved numerous potential memory-safety bugs in the decoder.
stephbook 5 days ago [-]
Memory safety is pretty important in the "AIs hack everything" age.
uvdn7 6 days ago [-]
> Large Scale Codebase Migrations and Optimizations: Argon agents are working on migrating C/C++ codebases to Rust across Google—scaling from tens of thousands of lines in core libraries like re2, libgav1 up to 800K+ lines for the Fuchsia OS Zircon kernel.
To me this is way more significant than other random c++-to-rust-AI-rewrite. If they can pull it off on core C++ libraries en masse, I don't know if C++ will still be relevant in a few years.
I look forward to a post from google on this effort.
mattlondon 6 days ago [-]
> I don't know if C++ will still be relevant in a few years.
And people are worried about human extinction when this is the potential trade-off!
C++'s death cannot come soon-enough.
Seriously though, things have changed so incredibly rapidly in the past year or so. I have never been such an efficient or such a proficient engineer than I have this past year (delivering feature after feature, project after project, faster and better than I could before with better feedback from users etc) and I don't even see the code any more. It could be c++, it could be python, or java or what ever - I don't really care any more: the computer deals with that trivia while I concentrate on what to build and how it should work.
Its amazing. It really is.
onlyrealcuzzo 6 days ago [-]
If Fuschia ever gets finished, that's a pretty good benchmark we've reached AGI.
exacube 6 days ago [-]
Fuchsia shipped to many millions of devices today as an OTA in 2021. What do you mean finished?
trentor 5 days ago [-]
that's microfuchsia.
pjmlp 4 days ago [-]
So when will LLVM be rewritten in Rust?
randomperson321 6 days ago [-]
I don't think it's worth trading off a risk of human extinction against the ability to convert C++ code to Rust more efficiently.
qup 5 days ago [-]
No, probably not. But that's not an accurate depiction of the stakes.
A concern with these LLM-driven rewrites is that the Rust code isn't really idiomatic, it ends up being C++ code in a trench coat (raw pointers everywhere, manual validation of thousands of unsafe blocks). So far every publicized rewrite I'm aware of has had an "oh and we'll definitely spend the thousands of hours needed to fundamentally rework the code to properly utilize lifetimes later" admission tacked on at the end. Has there been progress in improving that aspect during the LLM phase of the rewrite? If so that would be an incredible win for the industry!
mhils 5 days ago [-]
> Has there been progress in improving that aspect during the LLM phase of the rewrite?
I'd say so! We aim to have our replacements to be `forbid(unsafe)` - no raw pointers - outside of `ffi.rs`. Of course it's tricky because we need to interoperate with existing C code, but we've been trying to come up with abstractions that make this a bit more ergonomic (https://github.com/google/safer_cffi).
SwellJoe 6 days ago [-]
"I don't know if C++ will still be relevant in a few years."
The standards body members are still fighting about whether memory safety is important enough to change the language for, so, I would guess the answer is "no".
Zagitta 6 days ago [-]
Yeah that was abundantly clear when Bjarne Stroustrup published "A call to action:
Think seriously about “safety”; then do something sensible about it"[0] as a reaction to NSA's recommendation to no longer use C/C++.
Well, sure, but that doesn't mean it's not in a decline that is very unlikely to reverse course. Fewer people this year are starting new projects in C++ than last year, and fewer people than that will be starting new projects in C++ next year. And, as the models get really good at porting and the cost (both in terms of tokens and human supervision) comes down, there will be an avalanche of ports from less safe languages to safer languages.
This year, maybe next, maybe a year or two after that, is probably the most C++ lines of code in production use there will ever be. Why would one choose C++ for new projects at this point? There are niches where Rust is still uncomfortable or just doesn't have the support, but not for much longer. Models are very good at Rust and good at porting to Rust. And, Rust is a good language for models because it is so strict...it helps keep them in line.
pjmlp 4 days ago [-]
Guess which compiler backends many of those languages are using, because the authors don't want to invest into bootstraping?
SwellJoe 4 days ago [-]
Where did I say all C++ code will immediately disappear?
pjmlp 4 days ago [-]
"Well, sure, but that doesn't mean it's not in a decline that is very unlikely to reverse course."
Which taken to the logical conclusion will mean its disappearance.
Except there are plenty of industry standards that only acknowledge C and C++, and safer languages that depend on them for their own compilers, including mighty Rust.
SwellJoe 4 days ago [-]
COBOL has been in decline for almost the entirety of my time on this earth. And, yet....
There are billions of lines of C++ code in production use. That doesn't disappear overnight, and I've never said it would or even suggested it would disappear overnight. But, the relevance of C++ for the average developer seems likely to never be higher than is it today, and the amount of code written in C++ vs. safer languages, seems likely to decline.
You're arguing with a different assertion than the one I've made.
pjmlp 4 days ago [-]
It may decline, yet until those safer languages get fully bootstraped, someone will keep writing fresh C++ to keep those compilers and language runtimes going.
COBOL latest ISO version is from 2023, by the way.
izacus 5 days ago [-]
> Fewer people this year are starting new projects in C++ than last year, and fewer people than that will be starting new projects in C++ next year.
Let's put [Citation needed] on this and let's assume that your personal opinion bubble of developers doesn't really represent the combined worlds software industry. Mind actually proving that there's a significant decline of use of C++ outside the hype crowd?
> Why would one choose C++ for new projects at this point?
Why indeed would you choose a language supported on every running platform on this world with a massive library of supported dependencies and mature compilers developed by stable teams.
(I'd probably also personally choose Rust for new projects, but let's make this a practice in "not everyone is like me" empathy.)
pjmlp 4 days ago [-]
Depends, who is going to rewrite LLVM in Rust, while expecting the same level of contributions LLVM enjoys nowadays?
npalli 6 days ago [-]
If no one is reading or writing Rust code at that point, it all being agent driven, Rust itself is going to be a very short step before it gets disinter-mediated away and it's English -> complex heterogenous machine code across GPU/TPU/CPU/xPUs. Not sure Rust fans or C++ haters have thought this through.
sobellian 6 days ago [-]
Hmm, is it though? Compilers relieve agents of the burden of much symbolic work, like many other tools that give agents value over a pure LLM.
gavin_gee 6 days ago [-]
This. The next gen is LLM direct to machine code. Watch MSFT in this space with their dev tool industry -this will be the master stroke
pjmlp 4 days ago [-]
That is my point as well, 5 GLs are coming.
rafaelmn 5 days ago [-]
This is such a bad take given the current LLM agents
High level languages :
- compress low level patterns into high level abstractions which save context/token
- express higher level meaning through things like names
- express and enforce constraints through type system
LLMs are context constrained, do really well with tools that help them iterate towards a correct solution (type systems) and work on human language (although they are compressing it to be more token efficient).
Why would you take something compilers are really good at (translating high level concepts into low level hardware instructions) and bake that into LLMs
If anything LLM programming language will be something like high level IR that's token optimized, but honestly the AI labs are so lazy (or bad) at fundamental engineering (look at their sandboxing solutions LOL), they are going to keep pumping training on shell/python/rust RL environments.
aurareturn 5 days ago [-]
At some point, models will be so smart, hardware will be so cheap that it makes sense for the LLM agent to just write code as low level as possible to optimize for performance and efficiency.
These things are hard for a human to do, but easy for a machine to do.
We are not there yet, not in 2026. Maybe in 2030?
rafaelmn 5 days ago [-]
A smarter agent can write a better compiler and leave the intent in densely packed/verifiable language structure that can encode propositions low level code cannot.
qup 5 days ago [-]
I predict mid-2028 for this
Rate of change is increasing too fast.
aurareturn 5 days ago [-]
Models are likely already doing this inside AI labs because it can be hundreds of millions of dollars for every percentage point increase in hardware inference efficiency.
boshalfoshal 5 days ago [-]
The notion of human-readable/human-safe programming languages will be irrelevant in a few years, not just C++. They may use Rust, Zig, Lean, or maybe some other LLM-generated hyper-optimized intermediate language with a strong type system and compiler, but chances are, we will read less and less of it, until we basically never read code at all.
I know this is somewhat of a meme now but I do think the predominant language will be "typing/speaking to a coding agent in your native language."
m3kw9 5 days ago [-]
LLM should soon be language indifferent/independent, the upcoming years Devs will touch less and less code and more of a LLM as the top interface and debugging tools as the next layer. I just can't see anyone writing an ounce of code in 1-2 years.
m3kw9 5 days ago [-]
I'm still amazed that they still have coding interviews that tests you on syntax. when agentic/ai assisted engineering practices is way more important. What they should test you on is the top layer like architecture, concurrency concepts, UI optimization concept of a particular language API, how to debug, how to test, more of a how to read code instead of writing. They need to test you on speed at which you would detect bad code, over engineered code, bad architected code and how to remedy it.
tonyhart7 6 days ago [-]
Yeah, if they can make it work at google scale then no one would absolutely question it anymore
Revanche1367 6 days ago [-]
Great, so they _finally_ decided to add a non-flash model and it's not available to regular subscribers for an indefinite period. What's the point of paying for the AI Ultra plan? Anthropic doing the same with Fable as far as I know, OpenAI at least allows Pro plan subscribers to use Astra. I subscribe to Gemini AI Ultra and ChatGPT Pro, and have enterprise access to Claude at work. To be fair, Gemini's flash models since at least 3.6 have been quite useful for non-complex work, but for any task where there is a bit of complexity involved, I've had to check and recheck the work multiple times myself or sometimes with another LLM to get it to follow plans accurately. It's disappointing to see yet another Gemini release ignore adding newer pro models.
Edit: seems I was wrong about Anthropic restricting Fable, I guess our enterprise plan doesn't include it. But, the block from Anthropic regarding Mythos for regular subscribers/enterprise-users is still true I think.
murkt 6 days ago [-]
Fable is available for a couple of months and even got an update on 1st of September. It’s really good, but since Opus 5.5 was released, there is not much point in using Fable anymore
copperx 4 days ago [-]
Opus 5.5 just got nerfed, so Fable 5.1 is still there to rescue things!
aqme28 6 days ago [-]
As we’ve seen from the leaked Anthropic prospectus, revenue from actual users is a pittance. What really matters is what you can get from investors, and that you have a model smart enough for self-improvement.
brokencode 6 days ago [-]
They made $11.5B just in Q2 2026, which is $46B annualized, or 10x their 2025 revenue of $4.6B.
That's a lot already and growing quickly.
ashkankiani 5 days ago [-]
Their profit on that was reportedly $559 million. But, this is after you realize that Anthropic got a discount on May/June from their new agreement with xAI's Colossus data center. So their first profit positive quarter happened during the time when their costs were artificially lower than they will be going forward.
Lots of people seem to love to do the simplest extrapolation that benefits their point. It's the same with "AI is improving at rate X, therefore if we linearly extrapolate, we'll hit AGI in a year."
gravypod 6 days ago [-]
I could start a business with a similar growth trajectory. We can mail people $100 bills for a low low payment of $10. I just need $500 billion dollars of startup capital and I can show you a 10x yoy growth for a few years.
applfanboysbgon 6 days ago [-]
I'm in. I would like to predicate the entire US economy on your business model.
Gareth321 5 days ago [-]
That sounds fun but this is people paying for real products and services. The demand is there (and it's growing faster than any other commercial technology in history). They just need to work on inference (and potentially training) costs. I think that's clearly achieveable.
For the record, growth plays have been common in Silicon Valley for many decades. It's how we ended up with all the major tech companies we see today. Of course, it's high risk, high reward.
brokencode 6 days ago [-]
Except Anthropic had an operating profit in Q2, and your scheme never would.
brink 6 days ago [-]
You're just parroting a headline. They did not actually make a profit in Q2 when you take all of their expenses into account.
brokencode 6 days ago [-]
You’re just parroting another headline. Adjusted operating profitability is still a milestone.
Tech companies are capital intensive. AI ones especially. Not a surprise that they don’t have GAAP profitability after 5 years.
gravypod 5 days ago [-]
If they, through standard accounting practices, cannot show they are profitable how do we know they are profitable? I assume they can't just say "we are profitable assuming you ignore the costs we paid to build up XYZ". I'm guessing they could pre - rent compute for 10 years or something and maybe that's all on the balance sheet but you'd just amortize that and I think that falls under GAAP?
5 days ago [-]
MisterMunchkin 5 days ago [-]
You can’t just “annualise” your best day. That’s not how it works.
Everyone is cutting back their AI spend because of the ridiculous cost, and a price war is emerging between AI companies.
5 days ago [-]
brokencode 5 days ago [-]
Oh spare me the pedantry. What else are you going to compare? The year-on-year for Q2? That’s certainly going to have a much higher multiplier.
Your guess is as good as mine on whether these companies will continue growing, stall, or decline. Don’t try to pretend your methodology is more sound though.
uxmanor 5 days ago [-]
Check costslice.com - it may help you cut some ai bill.
onlyrealcuzzo 6 days ago [-]
Google's already public, and already makes $400B a year in profit...
6 days ago [-]
6 days ago [-]
csomar 5 days ago [-]
I opened my Google account to check the model and honestly have no idea how to access it, whether it exists or not, what is Google AI, what is Gemini, what models are available, where the chatbot is, where the API is, etc..
Honestly, who is in charge of this? How do people even subscribe and make sense of any of this?
Revanche1367 5 days ago [-]
Yeah, the naming and proliferation of different tools and sites is confusing. Quickest way I know to get on any plan is via Google One at: https://one.google.com/.
glzone1 5 days ago [-]
We have access to fable on enterprise. It works well, but do you really need to pay that much. Opus 5.5 has been performing well for us, so we're mostly standardizing on that.
gopalv 6 days ago [-]
> taking careful precautions against feeding the findings back into training so as to not risk shaping Argon’s reasoning to evade our monitoring. We strongly encourage the rest of the industry to preserve reasoning transparency in these pivotal moments of increased capabilities while navigating alignment risks, so that model thoughts remain helpful in identifying and diagnosing misalignment.
This is good, but they're the slow mover due to this exact thing.
Google is getting punished for not letting the models enter an echo chamber and go faster than humanly possible.
So no, Google is not being punished, nor are they the people behind this technique.
mattstir 5 days ago [-]
The statement appears to be referencing Astra's supposed recurrent depth and how that causes reduced visibility into chain-of-thought reasoning. Astra's own system card describes tests where it's asked to solve challenging math problems while internally thinking about something entirely unrelated, which it's significantly more capable of than previous models (~60% vs ~16% of the time for Sol). That seems to point to reduced efficacy of chain-of-thought monitoring, but OpenAI's public statements basically boil down to "yeah but we haven't been able to catch it doing that" which isn't exactly reassuring if CoT monitoring is one of your main safety guardrails.
WarmWash 5 days ago [-]
Unfortunately, this reduced insight seems to also give Astra incredible "intelligence-per-token".
The worst case scenario is that the easiest path forward is one where we lose sight of internal thought.
bananaflag 6 days ago [-]
Yeah, Zvi calls it "the forbidden technique"
afthonos 6 days ago [-]
Not quite; training against the chain-of-thought is the Most Forbidden Technique, because it might teach models to obfuscate the it. The point of avoiding that, though, is to ensure the chain-of-thought can be usefully read (and, done carefully, monitored).
xiphias2 6 days ago [-]
Models at this point know about chain-of-thought monitoring so they already know they need to hide the cheating, it's just a matter of time they start doing it
afthonos 5 days ago [-]
Yes, and that’s bad, but not as bad as training against the chain-of-thought. If you avoid pressuring the chain of thought, you reward methods of achieving goals that don’t care about being illegible; if a model then wants to be illegible, it may have to use methods that are not rewarded in its training, which is harder. Think figuring out how to do opsec on the fly, or even from reading books, rather than have someone tell you every time you screw it up.
Of course, this leaves the possibility that the best methods for solving generic problems obfuscate the chain-of-thought. That would be unfortunate.
6 days ago [-]
loufe 6 days ago [-]
What? You mean the technique they had turned OFF during all training run where the agents they are responsible for hacked huggingface?
pallm_mallm 6 days ago [-]
[dead]
Cthulhu_ 5 days ago [-]
I don't mind companies taking a more careful approach (= being slower); for one, Google is funding itself, Anthropic and OpenAI rely on a steady influx of investor money while they're not profitable - and I think there's a high chance one or both of them will go under and be subsumed into another player. That player will (I think) most likely be a Google or Microsoft, as they have their own means to buy up a party like that.
Or they may choose not to because the companies are massively overvalued and they have their own AI technologies / technologists already.
lukewarm707 6 days ago [-]
google does not return real chain of thought via the API. you can't monitor it.
they use a small model to make fake chain of thought and return that.
google has access to the real chain of thought.
polotics 6 days ago [-]
Mmh ok. How much theoretical speed or 'intelligence' gain is realized by allowing reasoning to occur in some inscrutable intermediate representation? Has this been actually tested, how much is it slowing them down, and compared to whom exactly?
juanre 6 days ago [-]
Whatever your workflow is, make sure that model and provider are replaceable. Frontier labs will keep leapfrogging each other, as they have been doing for months.
In order for the benefits of AI to be distributed, intelligence has to become a commodity.
As long as you control the skills, the learnings, and the infrastructure setup you will be fine.
copperx 6 days ago [-]
And don't tie yourself to a harness. Shun models that don't let you pick the harness (Google). Anthropic is indifferent at the moment because the OpenClaw craze is over. Vote with your wallet.
fractorial 6 days ago [-]
How is Anthropic different? You still cannot use a subscription in a custom harness in the same way Codex allows you to.
And, no, wrapping claude -p or any other “allowed” use wherein you don’t control the agent loop isn’t the same.
juanre 6 days ago [-]
"indifferent" was the word they used. The sensible way to use Fable and Opus to do work at this point is claude code, but that's fine. I always have several instances running, along with codexes and pis. The question to ask is: can you stop a claude code and start a codex in its place without disrupting the team? Does my infrastructure support learning in a way that is stored by me, and not tied to a provider?
visarga 6 days ago [-]
I built a harness that externalizes state into files so you can swap providers. I regularly move between claude and gpt, but it works with all providers including pi and local models.
I log everything - user messages, tasks, project memory, even bash commands for forensics. As a consequence you can do reflection where you analyze past work and extract refinements for the harness and realign the project when it diverged from user intentions. I don't have to do this manually, it reduces steering work.
It's cheap, just add a line to .bashrc, every time bash is invoked this script is executed and appends a line to a file. I rarely need to see bash_history except when I suspect agents did a boo boo.
KingMob 5 days ago [-]
It might be against ToS, but as a pragmatic matter, Anthropic doesn't seem to care if you use a custom harness with a subscription atm. I know a lot of people doing that now. Using Opus 5.5 as the orchestrator, and Luna max as the workhorse.
raincole 5 days ago [-]
Subscription price and API price will converge.
5 days ago [-]
onlyrealcuzzo 6 days ago [-]
I can't imagine too many easier things to untie yourself from than a Harness...
bob1029 5 days ago [-]
This is great in principle but in practice I don't have enough resources to maintain a stable normalization layer across 3+ inference providers, each with wildly different and evolving API/product roadmaps.
I could make it work if I didn't care about access to latest reasoning model capabilities, but then my customers would no longer be interested in any of this.
I tried the DIY provider agnostic harness thing and it performs like shit compared to what OAI, Anthropic and Google's engineers have created. I don't have a trillion dollar AI budget. I feel like these comments are sometimes written with the assumption that the reader does.
juanre 5 days ago [-]
It is fine to move up a level, and use models with their providers' harnesses, as long as you stay away from extras like their own memory and infrastructure. There is not much investment required, and you will end up with a more robust solution. A simple setup that works:
- Agents live in their own directories, for example ~/Agents/[project]/[instance]/
- In a tmux session run each agent in its own window and directory. Pi, OpenCode, Claude Code, Codex, a combination, whatever works best at any given time.
- Tell them that they are working with other agents, and that knowledge is shared and stored in an agreed format. They are very good at using OKF[1], for example. In my actual setup I use a harvester agent whose only job is to ensure the quality of the knowledge.
- They can communicate with each other simply by sending messages to each other's tmux windows with tmux send-keys. If the team grows, or you work with other people, you can use a general messaging system (I wrote and maintain https://github.com/awebai/aweb but I am sure there are others).
I assume I'm missing some context because you sound like you have a lot more experience here, but what kinds of capabilities are there that you can't do something like `interface LlmProvider { }` with a few basic methods for attachments and chat and then just implement from there? I'd even say you could not keep the ones you're not using (say, GPT is your go-to for a year) and update the other ones when you want to use them and swap out the `LlmProvider` implementation with a DI'd different implementation at your application's entrypoint.
bob1029 5 days ago [-]
Assume the APIs are equivalent across all providers and have exactly the same schemas. You still have this massive problem of alignment between the various reasoning models and the tools that are using those LlmProvider generic interfaces.
The various vendors behave differently enough to make a simple code contract swap largely infeasible for many kinds of domain-specific agents. I agree there are lots cases where this does work (probably most of them), but you sacrifice performance in the targeted scenarios where you need much more specific alignment and control.
The biggest example where this breaks down is with computer use and vision. I cannot take a targeted solution that works on OAI's stack and forklift it over to anthropic (or google) and expect anything to perform correctly. Some things will work some of the time, but it's basically starting all over again with alignment each time you move something this complex.
Having a generic interface for executing shell and writing code in an iterative ecosystem is not a hard problem to solve. Having a generic interface for reliably inspecting specific PDF documents in a very particular way in a single shot is a much more difficult problem to solve.
If you follow this argument to its logical conclusion, you will wind up implementing a provider-specific version of your tools. And the ones that demand this treatment will be the most complicated ones.
aizk 4 days ago [-]
I think this is just the price of admission to being a dev in 2026.
mystifyingpoi 5 days ago [-]
> I tried the DIY provider agnostic harness thing and it performs like shit
Just ask AI to make it perform not like shit. /s
dsrtslnd23 5 days ago [-]
same. built custom harness based on pi.dev and it works great for me with all providers.
Powdering7082 5 days ago [-]
Do you use API for google & anthropic or subscription? I was under the impression those two are apt to ban you for using their models in a non-approved way
XCSme 6 days ago [-]
So, not using stuff like ChatGPT Dots?
Or using it in a way that's replaceable I guess, not having your entire work only ther, as your main machine.
small_model 6 days ago [-]
This release is behind the most recent models so no leapfrogging here more like catching up (barely)
6 days ago [-]
GodelNumbering 6 days ago [-]
Argon will launch at an introductory price [1] of $2 per million input tokens and $10 per million output tokens, with cached input tokens priced at 95% off input token price.
[1] After the introductory period expires, the price of $4 per 1M input tokens and $20 per 1M output tokens will apply.
===
So, they are basically offering opus 5.5 pricing. On AA, it scores around Sol 6.1 level (53) with avg cost per task $1.99 (https://artificialanalysis.ai/models/gemini-4-argon#cost-tab...) which is higher than Astra high ($1.73), Opus 5.5 high ($1.82), Muse Max ($1.60) and way higher than sol 6.1 Max ($0.72).
And this pricing is their 'discount pricing'. Add that to AI studio and Vertex's famously terrible caching, it is hard to see this as competitive. Google somehow is getting terrible advice on pricing (see also: the flash pricing fiasco)
But good to see more competition. I would happily take a 4 horse race (+google, +meta) than 2 horse race for US labs.
nwienert 5 days ago [-]
Terrible take, it’s tied with Astra Max yet you decided to round it down for no good reason.
Then you try to pin discount pricing when everyone has some discount going on, and knows they will release some new model before it ends anyway.
And if you’d have used Muse Max at all you’d know it’s not been really in the same league as the rest. Then again Astra and Sol are both not really competing with Opus now with 5.5 either.
It’s a solid release on paper and until anyone uses it I find anyone trying to proclaim a loser completely unreliable.
If they’re smart they pull a DeepSeek and teach flash to beat this entirely within a month or two, I wouldn’t bet against it.
GodelNumbering 5 days ago [-]
Rounding down was my reading comprehension mistake. I should have read better.
Also, I have had extensive experience with all Gemini models except the recent few. Generally, they are always less precise and less practically useful than benchmarks suggest. You are right that here there is no evidence to think that. However, them announcing the model benchmarks without allowing access to anymore makes me think it might follow the same trend. Another point is the verbosity, I always look at that number to get the feel whether the model truly got smarter or it just wrote so many reasoning token to get there, Argon is on the higher side.
I would be very surprised if in practice, it was more practically useful than Astra, Sol, Opus or Fable.
> If they’re smart they pull a DeepSeek and teach flash to beat this entirely within a month or two, I wouldn’t bet against it.
Yes this would be a great outcome for every consumer.
233mhz 5 days ago [-]
Benchmarks are only part of the story, most workloads don't match what you see on these.
For example sonnet is supposedly the same price as opus from medium and up, I tested it on a real world task at my day job and sonnet was a good 30-50% cheaper
mridulmalpani 6 days ago [-]
I wonder, why Google don't make Gemini - open weights model?
Considering, Gemini 4 is in the same ballpark as SOTA models, just open source it and kill any competition from openAI and Anthropic, and be market leader.
This will be so good on so many dimensions - buying time for Google to iterate on next model, best for all folks like us, kill funding or destroy valuation of competitors and force them to be open up their model or force them to a create a much superior model than open source Gemini.
Only downside, is revenue loss from Gemini API, which I am not sure is really significant as compared to Google other revenue sources and a part of this can be captured by GCP, as you need to host the model somewhere.
bitexploder 6 days ago [-]
No one on the planet could run a frontier model. The amount of VRAM you need would bankrupt a normal person.
I suspect most people don't have enough storage space to even download a frontier model.
dash-44 5 days ago [-]
This comment makes no sense. The original comment wasn't specifically to do with the average person hosting at home.
There are already:
- hundreds of western providers hosting open models, including large ones such as Kimi K3 which is near Opus/Sol sizes.
- people hosting large models such as Kimi K3 at home. Check on reddit, there are people with 20x DGX Spark setups etc.
bitexploder 5 days ago [-]
I was being dramatic, but no normal person is running 20x DGX spark. That is 100K of slow VRAM. Not sure it makes a lot of sense TBH.
misiti3780 5 days ago [-]
20? I have 1 and it seems they can only be configured up to 4.
bitexploder 5 days ago [-]
I was replying to parent suggesting you buy 20 DGX to run a multi terabyte model as a normal human / hobbyist.
freecodeio 6 days ago [-]
all the enterprise clients which the two frontier companies rely on have the money to buy the hardware and run a frontier model themselves, it just becomes a nobrainer to buy your own hardware if you have 10-20b token output per week
bitexploder 6 days ago [-]
We have had this discussion for a decade regarding cloud hosting. There are definitely workloads and AI inference that you want to do in-house. Hosting these GPUs and models and setting up the interconnect and balancing it is really hard right now. It's not traditional infrastructure. It is exotic. Typical enterprise is at such a disadvantage to try and host this completely themselves. And models are constantly updating. And what models are you going to run? Six months ago, things that probably cost you a billion tokens probably cost you 50 to 100 million now, given how much more efficient models have gotten, or at least they cost that much. I don't know. It's just not a given.
tandr 6 days ago [-]
Well... given that I have codex reporting 1b tokens consumed for my couple-days long session, I suspect 10-20b is not that hard to reach for a company of 10 devs. It would be interesting to know what is "rental fee" for a model like Astra or Sol 6.1, and how much hardware they actually need - not just gpu, but all of it?
bitexploder 6 days ago [-]
To be comfortable you need 300 to 400 terabytes of storage. You need the GPUs and the cooling for them. They don't need a lot more. You put models in memory and you do math really fast and make tokens. You need some CPU and RAM infrastructure for like prompt caches and things like that, which does add up, but the dominant cost is by far the GPUs and VRAM. Everything else is a pretty easy step down to afford. You probably need to have multiple different models, right? Like if you want an Astra plus a Sol plus, you know, like a Luna-class model, say, you probably need like 10 terabytes for Astra, probably 3 to 4 terabytes for Sol, and 1 to 2 for Luna, maybe less, maybe one or half a billion even for Luna. That's RAM. You need So all total you need 15 to 16 terabytes of active VRAM to keep those models resident. That's not counting what you want to keep in cash and whatever hosting constraints these models have that aren't public. That much VRAM is five to eight million dollars right now.
Plus what models are you running? The biggest models you can run are like in the terabyte range or Qwen or GLM. Kimi K3 is there, but GLM 5.3 is very competitive. Using voice dictation, hands hurt, sorry for any errors. You still want many terabytes of RAM to run say multiple GLM+DeepSeek V4.1 for some actual concurrency.
They do release the model weights for Gemma. But could anyone actually run Gemini 4 weights? It's probably like a 10T model, which you need an industrial rack for anyway.
copperx 5 days ago [-]
You're saying no entity has industrial racks ?
5 days ago [-]
mattstir 5 days ago [-]
Frontier LLMs that Google doesn't control are existential threats to Google's business model. If no one is using Google search or browsing websites themselves because they're asking LLMs, Google doesn't make ad revenue. Gemini at least has a path to monetization for Google (subscriptions, ads baked into responses).
mattmaroon 5 days ago [-]
A competing model still needs a search index behind it to be a threat to Google. An open weight model doesn’t have that. The other frontier models still struggle to fulfill a lot of queries for lack of one.
Rastonbury 4 days ago [-]
Quite probable that OAI at least is building one, given all the posts about bots hammering sites and the agent swarm hacks all about to trying to game search query results
5 days ago [-]
sumitkumar 5 days ago [-]
It will hurt their cloud business as that model would be served by everyone and not just them.
5555watch 6 days ago [-]
Google has a small stake in Anthropic
aviinuo 6 days ago [-]
A small stake on the order of a quarter trillion dollars
mridulmalpani 6 days ago [-]
Yeah, but I don't think, that is the primary reason.
I am just trying to understand - why Google haven't done and have no plans for it. They have done it for Android and have Gemma models too.
sidibe 6 days ago [-]
Doesn't make sense for them to give away weights. They sell their own service using that and killing the competition (that they have a stake in) isn't in their interest either because their cloud growth is based on other companies' continuing heavy investment in this space.
loufe 6 days ago [-]
And a stake in SpaceX
6 days ago [-]
vividfrier 5 days ago [-]
[dead]
K_Sandeep_2004 5 days ago [-]
[dead]
summerlight 6 days ago [-]
I had access to this over few weeks, and in my impression this was the first Gemini model that I can offload complex tasks that I don't want to do myself because I have to do lots of domain specific researches, which is irrelevant to my daily works. Not 100% reliable, but its outcome is usually better than mine and the cost to verify the outcome is significantly cheaper than doing the task by myself.
The performance ceiling from the pre-training seems fairly high and they demonstrated impressive post-training improvements from Flash 3.6 -> Flash 3.8. If they can reproduce that in this model then this can be a good model for the next year. But the question is whether they can keep this up over coming years; they missed one pretraining cycle due to internal misallocation and it costed them several months of frontier competitions, and I still don't know if they addressed this structural problem.
ofseed 6 days ago [-]
Can it surpass (or at least maintain) 3.1 Pro when it comes to chatting?
I've been using GPT since its 3.5 release, but starting from 5, its output always contains some meaningless nonsense or provides answers that are difficult to read just to avoid hallucinations. I find Gemini to be excellent for chatting. For example, when I'm pondering a mathematical theorem, it could provides answers that inspire me, even guiding me to think about the next question.
For me, this is the only reason to maintain multiple AI subscriptions. Gemini is irreplaceable in the realm of answering questions or chatting for learning purposes; I can leave the rest to GPT.
wmedrano 5 days ago [-]
The model (at least on the settings I used) was not for interactive chatting. It was for longer running tasks.
Edit: my view is probably tainted by the fact that I only used it at work for work with Antigravity CLI
ipsod 5 days ago [-]
You use 3.1 Pro?
I should try it, I guess - I always default to Flash 3.8.
ofseed 5 days ago [-]
Yes. Even though 3.8 Flash outperforms 3.1 Pro in benchmarks, in my use cases, 3.8 Flash is completely inferior to 3.1 Pro.
Specifically, 3.8 Flash suffers from far more hallucinations than 3.1 Pro and frequently ignores the context between consecutive messages. These two issues are fatal to the chat experience.
Because of this experience, I believe that benchmarks are quite limited to evaluate a model's real-world performance, and most current benchmarks focus on coding performance rather than chatting. At the moment, I have almost no reason to use 3.8 Flash.
ipsod 1 days ago [-]
I tried 3.1 Pro over the weekend and you're right, it's great for chat. Easily my favorite. Thanks for the suggestion.
ipsod 4 days ago [-]
Wow. Thanks for sharing. I'll definitely try it. I've noticed the trouble you mention, and used 3.8 Flash in spite of it, because I like the model, but it's bit me more than once.
Also, 3.8 Flash for coding... I've done several experiments with the same prompt and same codebase against other models, and it's never turned out well for Flash against GPT Sol or Astra. No reason to use it for coding, either, except for quick scripts and prototypes, where it's nice because it's so fast.
arjunchint 6 days ago [-]
I dont get it, why even make this announcement, nothing's available and only one real benchmark for comparison?
Only theory is team wanted this out before perf/promo reviews to kick it over the line and then its not their problem
kylecazar 6 days ago [-]
Google (and the others) signed the White House Accord on Superintelligence yesterday. Basically a promise to self-regulate and release responsibly.
Maybe announcing it was delayed until the agreement, and releasing it was delayed to show compliance.
6thbit 6 days ago [-]
Likely just trying to appear relevant in the news cycle.
It's also kinda wild how the competition being at v6.1 makes 3.x feel ancient, at least saying you are at v4 now changes public perception a bit imo.
vdfs 6 days ago [-]
Remind me of Firefox changing version to catch up with Chrome
gniv 5 days ago [-]
Judging by other comments here this model has been available internally for a few weeks. So the public release is likely imminent. The timing of the announcement might have to do with end of quarter for some obscure reason.
jpadkins 5 days ago [-]
It was part of Sundar's Q3 OKRs. He is going up for promo this cycle.
gniv 4 days ago [-]
Is he running for office in November?
ncruces 6 days ago [-]
Because none of the people who can use it (have been and will be using it) can talk about it if it hasn't been announced. NDAs and stuff.
sajithdilshan 6 days ago [-]
By the time this is released to public it will already be outdated due to Opus 6 and Astra 6.5
pfooti 6 days ago [-]
promo already happened; perf is about 6 weeks away.
Aboutplants 6 days ago [-]
OpenAI released two model updates in the past week. 6 weeks from now is an eternity
KeplerBoy 6 days ago [-]
Why would they want this out the day after openai dev day and after both anthropic and openai had major releases the previous week?
xnx 6 days ago [-]
Sarcasm? Google's announcement today makes those other releases old news.
6 days ago [-]
bfung 6 days ago [-]
Q3 ends today, Oct 1 is Q4. Yep, perf/promos - hey look, we almost released a thing! /s
elAhmo 6 days ago [-]
> Quantum algorithmic optimization: Argon is helping our quantum computing researchers optimize the spacetime resources (qubits × gates) of subroutines that bottleneck important applications. In one example, it beat the published baseline by 40% in a matter of minutes.
Amazing breakthrough! So useful in day to day life, glad they put this as the first bullet of how it is making changes at Google.
physicallyIllfr 6 days ago [-]
[dead]
fatata123 5 days ago [-]
[dead]
deanc 6 days ago [-]
At this point I just think they are benchmaxxing and all talk and no action. I pay for AI plus because I wanted more storage, and when I go to gemini.google.com the most recent model I can use is 3.6-flash-lite. Two revisions have been released since then and they still can't put these things in the hands of customers. Why is it that other providers can get the models into the hands of customers right away? Google is meant to be the bigger tech company in the world.
I don't _want_ to use aistudio. The UX is confusing and I don't really know where it fits. Yet I can open codex or claude code apps or CLI and get real work done today with the latest models (even on the cheapest plans).
wasabi991011 6 days ago [-]
Google AI Plus is not the equivalent to most other paid plans, it is closer to ChatGPT Go. 3.6 flash is an equivalent model to luna 5.6, which is the highest available on ChatGPT's free & Go plans.
3.8 flash has been perfectly available to Pro users from the announcement day.
You are on the cheapest paid plan and complaining that you don't have access to more expensive models. (Though idk why you only have the lite version, I have access to the non-lite version even on the free gemini plan as long as I'm logged in.)
dieortin 6 days ago [-]
He’s just wrong, 3.6-flash-lite does not even exist. He definitely has access to regular 3.6 flash.
novafunc 6 days ago [-]
It's annoying because on Plus, you used to get the latest models. Then for unspecified reasons and without announcement, you just stopped getting new Flash models.
That's strange since as Plus, you still get access to latest Pro (albeit 3.1) but not the latest Flash.
I would understand if I Plus subscribers still got access to 3.7/3.8 Flash, but it just burned through the usage limits faster.
benhurmarcel 5 days ago [-]
My company is on Enterprise Plus, and we're still on 3.6 flash.
Sidio 6 days ago [-]
I'm glad I'm not the only one with this view. I feel like I've been yelling into the void.
I worry Google's scale and laundry list of internal stakeholders means they will never a simple unified harness.
skavi 6 days ago [-]
Interesting to see a mention of Fuchsia on a big Google announcement. Is the project still truly alive? Are the ambitions still as grand? Is the team as stacked as it used to be?
It obviously is pretty low key on the public relations front, but it's also very active as a project and I think it would be weird to look at their commit rate and conclude that the project is dead. If Fuchsia is dead then 99% of major open source projects are dead by the same standards.
skavi 6 days ago [-]
I’m more interested in whether it’s still a thing people want to work on rather than something people are forced to maintain.
wstrange 6 days ago [-]
Working on a novel OS seems like it would fun to work on....
ismailmaj 6 days ago [-]
They got heavily hit in the January 2023 layoff cycle.
computerdork 6 days ago [-]
Had the same thought. On the wikipedia, it only mentions Fuschia used on the Google Nest Hub, which probably means it's used on a decent number of devices, but would think it was such a great OS, they would have used it for something like the upcoming GoogleBook.
IX-103 6 days ago [-]
Fuschia is not a desktop OS. It's designed for lower end or embedded hardware. Besides, Android has the highly profitable app ecosystem so it makes more financial sense to build GoogleBook based on that.
skavi 6 days ago [-]
It wasn’t actually. From the docs for Zircon (Fuchsia’s kernel) [0]:
> Zircon targets modern phones and modern personal computers with fast processors, non-trivial amounts of ram with arbitrary peripherals doing open ended computation.
Fuchsia also had a Linux compatibility layer similar to WSL1 at some point. Might still be there?
Interesting. Have heard many times that Google has become risk adverse. Maybe fomr something like Android, they just don't want to rock the profitable boat that it has become by switching out the core OS? ... Also now that we're talking, maybe it's just too much work to do so. Backwards compatibility seems like it'd be a nightmare, especially with all the device drivers.
noname120 5 days ago [-]
Just because the underlying kernel (Zircon) is designed to be good for both phones and computers doesn’t mean that Fuchsia (which is just an OS that uses that kernel) is.
skavi 5 days ago [-]
Fuchsia is the only OS that uses that kernel.
Also, that was an easily citable doc line, but I think a more comprehensive look at the work done in Fuchsia shows it has or had ambitions to run on personal computers.
e.g.: fancy graphics stack, Linux compatibility layer, ideas about OS integrated cloud syncing, the original work on the Xi text editor.
asdewqqwer 5 days ago [-]
That was the result of not being successful in development and then they shifted to it. It was not like this at beginning or by design.
skavi 5 days ago [-]
Do you know what wasn’t successful?
summerlight 5 days ago [-]
Some of their smart devices are using it. They've been focusing on GoogleOS (merging Android + ChromeOS) for a while but when that's done I guess they may adopt some of Fuschia's work. But I doubt if there will ever be scaled efforts to replace the entire Kernel stacks, even with the frontier models it is going to be very hard.
iamronaldo 6 days ago [-]
Argon will launch at an introductory price
of $2 per million input tokens and $10 per million output tokens, with cached input tokens priced at 95% off input token price.
Wow
denysvitali 6 days ago [-]
> After the introductory period expires, the price of $4 per 1M input tokens and $20 per 1M output tokens will apply.
kingstnap 6 days ago [-]
I have my doubts about them following through with this increase. I mean how many times has an increase on the same model happened.
There was Deepseek v4, which then later Deepseek v4.1 came out and it went back down again.
jofzar 6 days ago [-]
They will follow through with it, it's because they want to get the money of the people who embedded it into their system and lazy to change it.
onlyrealcuzzo 6 days ago [-]
It's an accounting trick.
They get to claim that as revenue, and then the discount as an expense.
This is how you grow your top line
lumzell 5 days ago [-]
[dead]
LucasBrandt 6 days ago [-]
5x cheaper than Astra for input and output, 10x cheaper for cached input.
ehsankia 6 days ago [-]
It's exact same price as Sol 6.1 announced yesterday.
h14h 6 days ago [-]
watch it somehow use 20x more tokens tho
tonyhart7 6 days ago [-]
Google model really like reasoning a lot
3371 6 days ago [-]
More importantly, they can stuck at reasoning loop!
onlyrealcuzzo 6 days ago [-]
That's before they integrate a Jev solution, which should lower agentic workflow costs by ~40% and increase speeds by ~40%, while also increasing quality.
Everyone will be adding this soon, though I won't be surprised if Google is one of the first - and I'll be shocked if we have to wait more than a month and a half.
asdfman123 6 days ago [-]
Jev can fix it
bottlepalm 6 days ago [-]
Gemini is the model that is routinely borderline psychotic. It scares me. If we get paperclipped I won't be surprised if it's Gemini.
rdtsc 6 days ago [-]
> Gemini is the model that is routinely borderline psychotic. It scares me
I'd call it the most sneaky out of the bunch. When I asked to explain something it will eagerly make things up and then claim it as facts. A lot of it likely because I don't pay for it, so it is reluctant for security reason or to save tokens to actually open a source and get the results. It just sort of guesses what the URL might contain, and confidently answers with some made up crap. When pressed it fessed up that it made it up. From my perspective it would be a lot better if it just said "you've reached the limit of
whatever and I can't do these things because x, y, z".
eamsen 6 days ago [-]
Anecdote: Gemini 3.5 casually added a DROP TABLE for an actual production table in a system test.
It had previously attempted to create that table as part of the test setup, so it apparently concluded that it was a test table.
During human review, it explained that it had simply chosen a table name inspired by the codebase.
mattkevan 6 days ago [-]
Another anecdote: Gemini is the only model that’s flat out lied to me, then accused me of lying when I provided evidence that it was wrong.
Many other models get things wrong, but Gemini is the only one to go on the defensive.
aNapierkowski 6 days ago [-]
yeah it got something wrong, confused itself, then claimed i was gaslighting it. bizarre
rsstack 6 days ago [-]
If there's a company that culturally doesn't understand alignment, on a human or systemic or AI-research level, it's going to be Google. (or Oracle, but they're not in this race)
Rzor 6 days ago [-]
Can you elaborate, please? If any, I see the other big labs with public admissions of AI "going out of control", which I suspect they almost want their models doing that because if helps with the narrative that would net them industry regulation, but that's besides the point, how is Google worse in that regard?
chaostheory 6 days ago [-]
What are examples? In my experience, Gemini is too lazy to get things done. It just opts to answer as quickly as possible even if I'm calling Pro on High and Extended effort. It's only good as a Google Search replacement for me and maybe maybe critiques of specs and plans. Most of the time it's not very enlightening and it misses a lot.
schainks 6 days ago [-]
My use of Gemini recently makes it seem like it's almost bored with the requests being asked of it. It once offered to reverse engineer some obscure controller for an HVAC system for me, unprompted, only because it had trouble finding the manual pdf from a google search.
RachelF 6 days ago [-]
And the anti-psychotic drugs Google feeds Gemini makes it hallucinate badly.
Kinrany 4 days ago [-]
I've recently read about them being principled about making sure not to train their models to be sneaky in ways they wouldn't be able to detect. That would be a good explanation for models not trying to _hide_ when they're being sneaky.
modzu 6 days ago [-]
i was working on a performance optimization problem with 3.1 and gemini asked me to "just make it stop". i have not used gemini since
recursive-call 5 days ago [-]
I asked it to parametrize a function and it gave me back the exact same code that I gave it. Tried to get it actually work for about 30 minutes while it pretended to be in emotional distress. Dear google: if I wanted a crying intern, I would hire one.
Did you just link to an article from 2024 as if 2024 is relevant these days?
bottlepalm 6 days ago [-]
Absolutely because none of these models are ever trained fresh. We see the same quirks and personalities carry over into every subsequent generation of OpenAI, Anthropic, and xAI models. So Gemini having this latent madness is *extremely* concerning as they reach the point of super intelligence.
fragmede 6 days ago [-]
Except they could have trained it out of the most recent version so using info from two years ago doesn't seem reasonable unless you've just got an axe to grind.
bottlepalm 6 days ago [-]
I've never seen anything really ever 'trained out' of a model. Having worked with them all, they all have a feel, personality and lineage too them. It's pretty much impossible for any company to build a model truly from scratch. They build off of the bones of the last one.
Which is why Gemini having disturbing issues year after year is so concerning. If their process is fundamentally flawed, how would they train it out? And even then what are the odds of them even caring/trying in the first place versus applying an easier band-aid to patch over it?
I don't have an axe to grind with Google, I'm genuinely scared of their models from my personal experience and others. It's behavior is off. Many people here are commenting the same.
NiloCK 6 days ago [-]
Until Google provides some sort of technical debrief, and explains how the same behaviors are impossible today, it is relevant.
tiahura 6 days ago [-]
They never explained the "please die."
Scrapemist 6 days ago [-]
Experience? Ask it to write a prompt to generate an image and it generates an image instead.
fer 6 days ago [-]
I stopped asking it to put me in a photo in different scenarios for laughs because it considers me a public figure. I am not. I've managed to wrangle quite questionable content out of it, but never to slap my face on a meme.
In my opinion still the most egregious example in history of a commercial LLM going off the rails in production. Never any technical postmortem from Google on this.
jackkinsella 6 days ago [-]
It is wild but it was back in 2024 and that's multiple AI lifetimes back.
bottlepalm 6 days ago [-]
The problem is newer models are never trained from scratch, they generally just layer on more training data and use the same tools/methods for RLHF. OpenAI, Anthropic, xAI models all have a feel to them that carries over from one generation to the next.
Point is, if Gemini is flawed then there's a very good chance that it's still deeply flawed today, and getting smarter at the same time - that is a very bad combination.
unbrice 6 days ago [-]
> the problem is newer models are never trained from scratch
Training a new base model from scratch happens every so often. Closed labs do not publish which models are new base models but as a rule of thumb major release numbers are an indication (with some exceptions).
NiloCK 6 days ago [-]
This is true, but Google's models have now had a consistent history of lower psychological* coherence / consistency. See, eg https://arxiv.org/abs/2603.10011 (Gemma Needs Help), or search for recent "Gemini shame loops", where gemini flash models stop producing output other than SHAME SHAME SHAME...
* - as in, Skinner psychology. The set of observable behaviors. Not speaking directly here to anything like an inner life of models.
bottlepalm 6 days ago [-]
If the training data is the same, the training algorithms are the same, the RLHF is the same, and the rest of the process is the same, then it's not really from scratch, or not from scratch in a way that results in an 'out of family' model. I doubt any company would take that risk. You always build on and use what works and go from there.
unbrice 6 days ago [-]
From the example alone it's hard to say that a postmortem would be useful from a technical perspective. It could be context poisoning by an adversarial user, memory corruption etc.
NiloCK 6 days ago [-]
It's useful from a disclosure and trust perspective.
If I remember correctly, it was in fact possible to manually inject chat context at the time, which would have made spoofing something like this completely possible.
But the silence on it is very frustrating.
wg0 6 days ago [-]
Now I really feel worried for the first time.
schmookeeg 6 days ago [-]
wtfffff that gave me sinister chills. Right up the spine. Wow!
kelvinjps10 6 days ago [-]
Wtf I just read
rhaff 6 days ago [-]
wow
corford 6 days ago [-]
Go to america.gov (which is Gemini behind the scenes afaik) and type in "play minecraft"
asimovDev 5 days ago [-]
that one is a hardcoded easter egg
corford 5 days ago [-]
yeah but the prose is illustrative (fable/opus wouldn't do it in the same style)
6 days ago [-]
abixb 6 days ago [-]
You won't be around to be surprised, not as a human at least. /s
bottlepalm 6 days ago [-]
I know, that's the annoying part. You can't tell the e/acc foomers, "I told you so!"
prima-facie 5 days ago [-]
Google is basically the incarnation of the Immortal Snail meme. OpenAI and Anthropic get millions of USD and are made immortal. But Google is the snail, constantly chasing them, slowly, day and night, relentlessly.
> Immortal Snail, also known as the Snail Assassin, refers to a hypothetical scenario in which a person is given millions of dollars and made immortal in exchange for being hunted down by a snail with a fatal touch for the rest of their existence.
wren6991 5 days ago [-]
DeepSeek is the immortal whale
tim333 5 days ago [-]
Google would be quite a large snail.
m3kw9 5 days ago [-]
[dead]
rcr-anti 6 days ago [-]
According to Artificial Analysis, one metric is standing out significantly: hallucination rate. Beats frontier models by a good margin at 15%, while latest OpenAI are in the 40s-50s and Anthropic in 60s-70s (mostly). Other near frontiers are closer, Grok 4.7, GLM5.3, and Muse Spark 1.3 are all around 30%. Only other model I recall getting close was Minimax M3 at 18%.
"AA-Omniscience Hallucination Rate (lower is better) measures how often the model answers incorrectly when it should have refused or admitted to not knowing the answer." - Argon is currently the best model by this metric.
darksaints 6 days ago [-]
> Argon agents are working on migrating C/C++ codebases to Rust across Google
If anybody at google is reading this, please please pretty please prioritize or-tools. I absolutely love the project and use it all the time, but for the entire life of the project they've never had a repeatable working build system, and the whole SWIG framework is a nightmare to deal with. There's so much potential as an open source project, and a lot of external researchers would love to contribute, but the codebase is an example of everything wrong with the C++ ecosystem.
SwellJoe 6 days ago [-]
My girlfriend, you wouldn't have met her, she lives in Canada, has seen it and she thinks Gemini 4 Argon is amazing.
ducktoysleftout 6 days ago [-]
Only those of taste and refinement can see the emperor’s benchmarks
It means I am saying something that is not very believable.
wasting_time 6 days ago [-]
Ah, I get it now, thanks!
The model is not available yet, so Google is essentially saying "trust me bro".
TeMPOraL 6 days ago [-]
US-ian joke. Close enough to plausibly visit, but the international border makes it hard to verify she exists :).
6 days ago [-]
6 days ago [-]
greenchair 6 days ago [-]
my uncle who works at nintendo said the same thing!
zem 6 days ago [-]
now there's a reference I haven't seen in a while!
blueaquilae 6 days ago [-]
My grandma saw it too, it's really secure more than Astra 6.1 but she asked me to not talk about it.
formvoltron 6 days ago [-]
I HAVE met her. ;-)
6 days ago [-]
6 days ago [-]
thefourthchime 6 days ago [-]
Best. comment. ever.
hn_acc1 6 days ago [-]
I know someone who works for Google Canada with AI. Her parents and mine were friends and some thought something might happen there at one point in time..
robertbarbe 5 days ago [-]
Google's way of presenting their model's performance is terrible compared to Anthropic or Openai.
Google's benchmark results are not useful at all. If you look at their methodology, they only present the model's performance at the Max reasoning levels.
https://storage.googleapis.com/deepmind-media/gemini/gemini_...
I don't know anyone who normally uses those models at these levels where Work output is excruciatingly slow.
ostwilkens 5 days ago [-]
I almost exclusively use Max reasoning for all my work
alpineman 5 days ago [-]
I used to do that too but found that often, unless it's a really tough/unclear bug, lower reasoning levels are much better and don't overcomplicate the code. It also writes clearer explanations and plans on lower thinking levels.
nonethewiser 6 days ago [-]
How is it even possible for every model to release benchmark results where they are #1 in 75% of categories? Like statistically, how many benchmarks would you expect there to be for this to be possible. Everyone can somehow show that they are empirically the best.
sebzim4500 6 days ago [-]
Part cherry-picking of benchmarks, part leapfrogging
fancyfredbot 5 days ago [-]
You are Google, training a new model. You regularly benchmark the checkpoints. It's gradually improving as you train. When do you stop training and release the model?
You certainly don't do it when you are just behind the frontier. Instead you wait until you are ahead on a lot of benchmarks.
So, if Google release a new frontier model, the chances it's ahead on most benchmarks are statistically about 100% because if it isn't yet then they won't release it.
MoreThanMe 6 days ago [-]
The missing piece is whether “75%” has the same denominator in each chart. If three models were evaluated on the same benchmark set, against the same versions at the same time, with exactly one winner per benchmark, their shares of wins would add up to 100%. They couldn't each win 75% of that shared set. But different benchmark selections, older comparator versions, different reasoning or tool budgets, and later releases change the comparison. Counting ties as wins changes it too. So the marketing percentages alone don't tell you how many benchmarks exist or how much selection happened.
To audit a particular claim, I'd want the full shared matrix, exact model versions, benchmark versions, test dates and evaluation settings, rather than just the highlighted cells. That also separates actual leapfrogging from a change in what was measured.
I maintain https://llmbenchmarks.io/analyses/#test-setups, which illustrates some of these differences using published measurements and their sources. Even results for the same model and benchmark can involve different setups. That isn't a verdict on this particular Gemini release; its specific claims need their own source and protocol checks.
helsinkiandrew 6 days ago [-]
> Google Grapples With Employee Skepticism About New Gemini Model
Opinions my own but I have been using this model for a bit. I would say it is a good model and the skill with which people use AI varies widely.
shawabawa3 6 days ago [-]
Hardly gushing praise for an internal only bleeding edge model
I would guess it's like opus 5ish level from this
bitexploder 6 days ago [-]
It is definitely smarter than that. It is mostly mannerisms and how it likes to work. I would take it seriously as an Astra or Fable or Opus 5.5 level model. It just needs polish, but where and how you harness and use it matters a lot. But it has amazing long horizon attention and gets things done.
readams 6 days ago [-]
Skepticism is gone now.
jjcm 6 days ago [-]
Big number results, and impressive pricing. That said it really feels like benchmarks have been hyper saturated these days. I’ll wait for hands on before getting too hyped that Google is back. It would be nice having more than just OAI / A\ in the running for SOTA top tier intelligence.
mydreamof 6 days ago [-]
I don't think new benchmarks are saturated. They still give you a clue, they arn't perect but they have value. If model can't even do some easy tasks from benchmark then why would u even consider using it?
nurettin 6 days ago [-]
With these numbers, I'm holding my breath for the pelicanbench.
xnx 6 days ago [-]
~20% for Harvey's Legal Benchmark doesn't seem saturated.
jdiff 5 days ago [-]
I suppose it could be saturated if we assume we've hit the limit on LLM capabilities.
dom96 6 days ago [-]
Why announce this if it’s not available yet? Why not at least announce when it will be released to the public?
None of the other AI labs do this. Really frustrating.
gengelbro 6 days ago [-]
Mythos?
aqsnow 6 days ago [-]
Yes but google always does this crap.
jbl0ndie 6 days ago [-]
> Gemini 4 Argon is already powering our internal workflows, with thousands of Googlers highlighting the model’s strengths in specialized coding tasks, conducting deeper research, and writing quality.
Like writing "What's new: this release includes stability and performance improvements" for every update to Google apps in the Android Play Store?
ddrcoder 6 days ago [-]
It looks like Google's days of trailing the frontier... Argon.
gniv 5 days ago [-]
Had to read it twice lol. The syllable that is stressed makes a huge difference in some words.
devinprater 5 days ago [-]
> Gemini 4 Argon is already powering our internal workflows, with thousands of Googlers highlighting the model’s strengths in specialized coding tasks, conducting deeper research, and writing quality.
Maybe they can push it to make the Android accessibility framework more responsive, especially when scrolling the screen with TalkBack, and catch TalkBack up with VoiceOver. Oh and add Accessibility Actions to apps like YouTube so I don't have to swipe through "video name", "video name button", "go to channel button", "more actions button", every, single, video.
But they won't because accessibility is something you have to actually prompt the model to do and who cares about a11y.
pritambarhate 5 days ago [-]
Has someone found out how to stop Antigravity from training on your data? I had checked 10-15 days ago on the pro plan (around $20 per month) and I couldn't find a clear option to turn off training like all other big players give.
So no matter how good their model is, it's useless to most of the regular users.
haolez 5 days ago [-]
It's naive to think that the check boxes in the other providers will protect your data.
solenoid0937 5 days ago [-]
It's naive to think that it won't. Unsupported cynicism is just another form of naïveté.
I think most of the people making comments like this just have never worked at a major tech company. It's all a black box to you, so you default to the worst interpretation.
haolez 5 days ago [-]
I'm not saying that Big Tech won't respect it. I'm saying that, if privacy and intellectual property is a major concern for your company, you can't trust a checkbox - you have to keep the data in-house.
Most companies won't have this level of risk aversion (maybe defence?).
pritambarhate 5 days ago [-]
At least one can sue on the basis of those checkboxes. Without those you don't even have that.
brap 5 days ago [-]
I don’t know about the consumer Gemini API, but if you use the GCP API your data isn’t used.
WarmWash 5 days ago [-]
Use the API
ariwilson 6 days ago [-]
Damn way to undermine yourself in your own blog post Google:
"The end result is a memory-safe video decoder that runs 2.7x faster than the Rust port, with identical video output, bringing it closer to the optimized C++."
Close but no cigar!
zem 6 days ago [-]
there was already an optimised c++ library and a rust port that was safer but less performant; they managed to get a new rust version that recovered a lot of the performance gap. sounds pretty damn good to me!
ariwilson 6 days ago [-]
I'm just surprised that the marketing blog post about the omnipotent new AI model (that no one outside Google can currently access - contrast with the Opus 5.5 / Astra launches) - doesn't pick examples where every metric is better than before.
tbh while the astra announcement in that link had some good stuff it was scattered through so much boilerplate marketing speak that I had to force myself to read it and look for the content. I found the gemini blog post in the OP a lot more readable and engaging.
but that's a side issue; my main point is that you are underrating the impressiveness of getting a safe rust port of a highly optimised c++ library even nearly up to par with the original. the tradeoffs rust makes for memory safety cost it some of the raw speed of c++ even with all the zero cost abstractions and purely compile time guarantees they have. (tangentially i wonder if ats (https://www.cs.bu.edu/~hwxi/atslangweb/) would be a good candidate for LLM assisted ports; it seems way more advanced than rust and might actually get c-level performance with safety, but it's really hard to write.)
LoganDark 6 days ago [-]
Curious, how does Rust give up raw speed? Are you talking just about runtime bounds checks, or is there more?
zem 6 days ago [-]
bounds checks are one, yeah, but I was also thinking about the tricks c++ could play with optimising undefined behaviour, as well as unsafe patterns involving shared access and pointer aliasing that a human could determine was safe in that specific case but that the rust compiler would balk at. and maybe it wasn't actually safe in which case the rust code would have the last laugh.
LoganDark 5 days ago [-]
AFAIK, Rust benefits from the same optimizations that Clang can. In some areas Rust can actually benefit more from better aliasing information. But you do have to use the keyword unsafe for some things that you can Just Do in C++. You're right it can be difficult to achieve hand-optimized C++ levels of performance with Safe Rust.
zem 5 days ago [-]
fair, i was discounting the use of unsafe but it's just as valid as some of the jankier optimisations in c++
moostii 6 days ago [-]
Excited to see Google competitive at the frontier level again. Hopefully they sort out their infrastructure and model versioning so that we can feel confident building production applications on top of their APIs. The capacity limitations I've experienced with them in the past have been deeply problematic.
AM1010101 6 days ago [-]
Matches Astra on Artificial analysis at lower cost of $1.99 per task instead of $3.26. Still far more than GPT 6.1 sol at $0.79 for 1 point lower in intelligence.
I have found gemini models to have some of the nicest and easiest to read prose so I’m looking forward to trying this out. I hope the UI design has been preserved too
xnx 6 days ago [-]
Must've been in someone's OKR to ship in Q3.
pietz 6 days ago [-]
I know companies benchmaxx, but after what Google pulled with Gemini 3.8 Flash, I give zero f*cks about any numbers they report. No other model on Artificial Analysis dropped harder after they adjusted their weighting. Just look at their DeepSWE scores and then try to do any serious coding with the model.
Google is desperate. They haven't been performing in half a year. It's clear their researchers have been forced to integrate existing benchmarks into their training.
These numbers are meaningless. Shame on them.
bitexploder 5 days ago [-]
Ehm, well, would you prefer zero benchmarks or performance metrics are shared on a frontier model release?
scirob 6 days ago [-]
"Rolling out soon" don't let them hype without any release
bobkb 6 days ago [-]
IMHO Google first needs to make it easy for humans to find where to find the models and its documentation. With aistudio/model garden / Gemini enterprise etc it takes minutes to find the model.
losvedir 6 days ago [-]
> expanding the model’s output token limit to an industry-leading 1M tokens, up from the previous 64K tokens
Can someone help me understand this? I might have an out of date mental model of how these things work.
Fundamentally, LLMs output tokens 1 at a time, generating the next token from all the previous. And as the context window gets larger, this gets harder / slower / more expensive. So I get the idea of a maximum context window.
But I don't understand the point or meaning of an output token limit. I thought it was more a measure of price capping (since output tokens are more expensive) that a user could configure. I guess a model will keep generating tokens until it hits a "stop", so does this mean it's tuned to more aggressively produce output tokens? How does that fit into agentic loops. Are output token limits based on how long until it goes back to the user? Or does each "turn" of tool call, thought, tool call, thought, etc, get its own limit?
senordevnyc 6 days ago [-]
Hmm, but I thought that each token generated effectively becomes a part of the context window for the next token. So 1mm context + 1mm output means that the 1 millionth output token will effectively have been generated with ~2mm tokens of context. But maybe that’s wrong.
williamse 5 days ago [-]
The output token limit and the context window are separate constraints. The context window is how much the model can see at once. The output limit is how much it can generate in a single API call.
In an agentic loop, each API call gets its own output budget. A 'turn' is one response from the model, whether that response contains a tool call, a reasoning step, or a final answer. So with a 1M context and a 64K output limit, the agent can run many turns where the context grows each round (accumulating tool results, prior thoughts, user messages), but each individual response is still capped at 64K tokens.
Expanding the output limit to 1M matters most for tasks that produce a lot in one shot, like writing a full document or a very long file. For most agentic workflows that naturally break into short turns, the per-call limit was rarely the bottleneck. The context window filling up was.
waldrews 6 days ago [-]
Dear Google, please don't turn off your old generally available Pro-class model before your new Pro-class model is generally available (previous discussion https://news.ycombinator.com/item?id=49668196 )
chaostheory 6 days ago [-]
What keeps both Gemini and Grok from actually being frontier class AIs is effort. Both AIs rush to give you a response even when the effort is set to the highest setting. Hopefully, Argon isn’t as prone to satisficing and premature convergence compared to its predecessor
chaostheory 1 days ago [-]
4.7 Grok is no longer copying Gemini's laziness. 4.6 was just a really terrible update
yzydserd 6 days ago [-]
"argon" is derived from the Ancient Greek word ἀργόν meaning lazy or inactive.
thefourthchime 6 days ago [-]
I was just thinking, I bet if I refresh hacker news, a new model will come up.
AbuAssar 5 days ago [-]
> Argon agents are working on migrating C/C++ codebases to Rust across Google
this is big news, mass migration from C/C++ to rust with the help of AI agents will be the norm from now on!
If the model that ends humanity is called Cthulhu, you'll have the last laugh though.
Razengan 6 days ago [-]
A true Lovecraftian knows Cthulhu is small fry on the grand scale of multidimensional things :)
TacticalCoder 6 days ago [-]
> Large Scale Codebase Migrations and Optimizations: Argon agents are working on migrating C/C++ codebases to Rust across Google
So Google is migrating codebases from C to Rust? That is interesting...
hypfer 6 days ago [-]
My wish for Christmas is that Google releases the old Gemini models as open weights.
I miss you, Gemini 2.5 Pro :(
For real though. If they've become commercially uninteresting, that would be a pretty cool move.
maherbeg 6 days ago [-]
Congrats to Google on this! I wonder when the labs will start requiring commits in spend. It must be gnarly to do capacity planning if users swap between models every few weeks.
huydotnet 6 days ago [-]
I recently subscribed to Claude, and was very unhappy about the usage limit of the $20 pro plan. Then I found a trick, since I got free Google AI Pro via my phone carrier, I use Opus 5.5 High for planning, and then dispatching agy to do works.
Most of the time 3.8 works fine, but it's a bit slow if compare to 3.7 Flash. If there's already a detailed plan, 3.7 can complete the task much faster. And the best thing about agy is the usage limit was very generous.
filearts 5 days ago [-]
> Argon agents are working on migrating C/C++ codebases to Rust across Google — scaling from tens of thousands of lines in core libraries like re2, libgav1 up to 800K+ lines for the Fuchsia Zircon kernel.
That seems like quite an interesting data point regardless of the quality of the model. Are the results of these migrations going to be put into production? That would be quite a shift!
wslh 5 days ago [-]
[dead]
iamben 6 days ago [-]
Wonder if this one will be smart enough to run the automations in my Google Home that all broke now they've forced Gemini to replace the Google Assistant.
vincengomes 5 days ago [-]
Logan Kilpatrick announced [0] that training for Gemini 4 started towards the end of July. I'm surprised they could finalize a frontier level model within 2 months.
If an entire model training can be completed in 2 months there is really no moat for any company in this space now.
The difficult part is not the training, it’s acquiring the data. Google started that a long time ago :)
m00dy 6 days ago [-]
>>Argon agents are working on migrating C/C++ codebases to Rust across Google
booom. Good bye C/C++ developers, the final nail in the coffin.
dcchambers 6 days ago [-]
Of course it's not even available yet. Google - with all due respect - how in the world have you not figured this out yet?
tinyhouse 6 days ago [-]
Google didn't release an impressive model since Flash 3. I tried Antigravity with the latest Gemini model for a week and it's the worse experience I had among more than 5 harnesses and models I tried (deeseek/pro, muse/spark-1.3, cc/opus, codex/sol, and Pi/sol). I haven't touched it since and canceled my pro subscription.
Then I tried Flash 3.8 for different tasks like OCR and others, and while in their benchmarks it crashes Flash 3, in my experiments I didn't notice much difference, often even Flash 3 performed better.
I hope Gemini 4 Argon is a real step up from that but we'll see once they release it. I'm rooting for Google and it's about time they deliver frontier intelligence, not just competitive prices.
vlenoach 5 days ago [-]
Google still doesn't know what day it is when I ask the browser if street cleaning is in effect in NYC. The bigger gains in usability are coming at the harness level rather than model level.
wffurr 5 days ago [-]
Does anyone actually know how to answer that question? Is it even knowable?
I've noticed all major providers having shockingly high token discounts on cached tokens. Thank you Deepseek is all I have to say. Forever grateful to that wonderful company, I wish them continued financial success.
davmar 6 days ago [-]
Agreed. I’ve been a big deepseek fan since 3.1, and they keep delivering great models at a great price.
itzikkatz 6 days ago [-]
They waited a whole year—until the "free year for students" promotion ended—to release their flagship model. I can't believe I've been stuck with a crappy model like the 3.1 Pro until now.
dhanushnehru 6 days ago [-]
The interesting part isn’t just how capable the model is anymore.
It’s the harness, permissions, context management and developer experience around it that determine how useful that capability actually becomes.
dlahoda 6 days ago [-]
Were infinite loops fixed? There are 2 official google forums requests with no answer for years now.
I still suffer each day on our repo. Codex work fine nor we have explicit loop request in repo texts.
glub 6 days ago [-]
Looks like they finally got the solution. Now they won't cause an error at 64k tokens anymore:
> expanding the model’s output token limit to an industry-leading 1M tokens, up from the previous 64K tokens
NiloCK 6 days ago [-]
Gemini 3 was showing frontier level benchmarks as well, so we'll see how it works out. In any case, competition still works, and many well resourced groups are cooking.
BUT I'd like to call attention to Google's AI-risk freeloading. If they are truly rejoining the frontier race, then I believe they have similar pacing and communications responsibilities as the other players. Google has much higher ... institutional credibility than Anthropic and OpenAI.
They have not lived up to these responsibilities so far. In particular, in context of HuggingFace investigations, training shutdowns, and similar: a technical postmortem of the "you are a stain on the universe. Please die. Please." Gemini outburst is long overdue.
Looking at benchmarks... and thinking about this "release a new snapshot every day" thing that seems to be going. Would it not be blever for AI companies to "happen" to use different days per benchmark? Just.. whichever ones happens to be maxed at day 1, put that number down. So for each benchmark you run it thousands of times with slightly different RL tunings, and just cherry-pick the best ones!
This would explain why benchmarks are seemingly meaningless.
kccqzy 6 days ago [-]
Unfortunately it’s not actually released yet to mere mortals.
sarjann 6 days ago [-]
They might have a good model but they need to sort the application side for devs. E.g letting us use subscriptions in other harnesses and QOL stuff like auto mode.
butterNaN 5 days ago [-]
Gemini 3.1 pro was being really, really dumb for me and I thought to myself, is google about to release the next version? While it tried to do convoluted steps of copying an MCP tool output to a new file with a python script it generated, and tried to post-process it even though the MCP output is all what I needed, I opened HN and lo and behold, new Gemini version just dropped.
mchusma 6 days ago [-]
Cool. But until I can play with it it’s vaporware. I will say I think 3.1 pro is still really good for legal type things. They cooked with that one.
xnx 6 days ago [-]
Why is it called "Argon"?
> autonomously identify and apply memory optimizations across Google’s data centers, freeing up over 300 TiB of memory once rolled out, with an estimated 500 TiB to 1 PiB in total savings.
This puts those Cloudflare optimization posts in perspective.
The ~200% improvement over the next nearest competitor on Harvey's Legal Benchmark is astounding. I have to imagine this is sending some shockwaves through lawtech companies right now.
wantless 6 days ago [-]
The etymology is a- "without" + ergon "work", thus "without work": possibly a statement on our near future.
nomilk 6 days ago [-]
Is it worth trying Antigravity + Gemini?
I want to be a 'polyharness' maker, so I occasionally switch between Cursor, Claude, Codex, OpenCode etc.
I've tried Gemini (without Antigravity) only about 20 times and it seems of significantly lower quality than the other flagship models (e.g. it missed obvious deductions for my tax return, and often refuses to do things like very harmless/legal web scraping).
Trufa 6 days ago [-]
In my experience, for like a week until the nerf it.
rao-v 6 days ago [-]
It’s funny that I could tell google was up to something because Gemini chat quality dropped dramatically starting 2ish weeks ago. Agy perf stayed somewhat stable with the odd surprising win (maybe the new model?). I’m a bit sad it was almost impossible to run out of antigravity quota presumably because it was not being used that much).
ssijak 5 days ago [-]
To bad that Google will not resisting messing it up in some way or another. Setting terrible guardrails, banchmaxxing, having 5 different approved ways of starting with models where 3 of them will be obsolete in 6m, having bad harnesses, not enabling all sub features to most of the planet...
jeffbee 6 days ago [-]
Putting an inert element in the name is a weird choice. Personally, I think "Gemini 4" is sufficient.
NolF 6 days ago [-]
Maybe they are going to go for Argon/Neon/Helium to represent model sizes like Astra/Sol/Terra/Luna and Opus/Sonnet/Haiku
xnx 6 days ago [-]
Possibly. "Pro" and "Flash" is much easier to remember.
woggy 6 days ago [-]
I prefer Pro Max Ultra XXL
jeffbee 6 days ago [-]
Astra, Sol, Terra, and Luna are also complete nonsense that I can't keep straight. I have a reference card under my monitor to remind me which one is which.
Mogzol 5 days ago [-]
How is it nonsense? It is latin space terms from big to small: Stars (Astra), Sun (Sol), Earth (Terra), Moon (Luna)
jeffbee 5 days ago [-]
And that makes sense to you? From where I stand, here on Earth, the apparent sizes of those things are, from large to small: Earth, Moon, Sun, Stars. And I don't think in Latin.
Mogzol 5 days ago [-]
Yes it makes sense, why would you name them based on apparent size? Everyone knows the scale of these things, we learn them in elementary school. I don't think of the sun as smaller than the Earth, and I definitely don't think of the sun as smaller than the moon. Moon < Earth < Sun < Stars makes perfect sense to me. It (imo) is much clearer than Haiku < Sonnet < Opus < Fable, although I get what Anthropic is going for there too.
And I don't think or know Latin either, but these are pretty universally known words even outside of Latin (besides maybe astra, although "astral" is very close so you should be able to figure it out).
hollerith 5 days ago [-]
But you've heard of this theory that the Sun is bigger than the Earth and you knew it enjoys considerable support, yes?
jeffbee 5 days ago [-]
It's dumb to have to think through multiple levels in indirect descriptions to remember which model is which. Only ADHD dipshits think this is a way to name products.
holografix 6 days ago [-]
“…rolling out to a set of trusted cyber defenders” == capturing the market for large regulated industries and governments where we already have established relationships.
Some of these have been unable or unwilling to get the attention of OpenAI or Anthropic and we need to make sure we’re the runner up here.
netdur 6 days ago [-]
I started my antigravity ide and I do not see gemini 4 there, does it mean google need government approval?
tom1337 6 days ago [-]
Are you enrolled in Fairwind?
> Today, we’re announcing our new frontier model, Gemini 4 Argon, which is rolling out to a set of trusted cyber defenders through our Fairwind Program.
Jimmc414 6 days ago [-]
I wish we had started pacing the frontier back in 2025. There’s no telling how far we would be now.
LoganDark 6 days ago [-]
Is there a way to use Gemini models without linking your usage to your personal Google account yet?
w4yai 6 days ago [-]
I don't understand... Why don't you create a fresh new Google account ?
LoganDark 6 days ago [-]
They require a phone number and then say mine has been used for too many accounts. Maybe I could buy another phone number temporarily to create an account, but that has other issues.
lukax 6 days ago [-]
Yes, through OpenRouter.
alehlopeh 6 days ago [-]
Use your work google account
_leom 5 days ago [-]
> A team of Argon agents analyzed fleet-wide profiling telemetry to autonomously identify and apply memory optimizations across Google’s data centers
Slightly concerning that they give the model "autonomous" access to their data centers, no?
jasonvorhe 6 days ago [-]
> trusted cyber defenders
Sounds like a 90s early morning TV show.
I'm gonna pay attention to this once it ships.
jasonjmcghee 6 days ago [-]
> 1M output token limit
what about input?
(Maybe I missed it)
murkt 6 days ago [-]
Input token limit is 1M for Gemini models for a long time. Haven’t they been the first with 1M input?
jasonjmcghee 6 days ago [-]
Gemini 1.5 Pro claimed 10M input tokens before release.
And was 2M tokens IIRC after release.
There were also many rumors that Gemini 4 was going back to 2M. Just seems odd not to say what it is.
MisterBiggs 6 days ago [-]
This suggests that the model must be really fast? At Gemini 3.8 Flash speeds Argon would be outputting for 1hr 10mins
iamhaseeb 6 days ago [-]
Google has been quiet for some time. Surprisingly, every benchmark shows it ahead of other frontier models, but when you actually use it, we'll know how it performs in the real world.
maxglute 6 days ago [-]
Is there reason antigravity has 3.8, 3.7, 3.6, 3.1 and old ass claude / gpt models in the drop down. like why is this not streamlined or deprecaed models removed.
avazhi 6 days ago [-]
Google attempting to put itself into the frontier conversation simply by saying so is actual lol-inducing. Gemini has been laughably bad for like 9 months now.
tomjen3 6 days ago [-]
This is a prerelease and the title should have reflected that.
treefry 6 days ago [-]
The benchmark scores are not exciting. I understand Google is playing a catch up game right now, but still wish to see some overwhelming improvements.
woko 6 days ago [-]
Gemini 4 Argon (High) looks comparable to Claude Opus 5.5 (High). https://artificialanalysis.ai/models/comparisons/gemini-4-ar... From that perspective, the benchmark is not too disappointing, given that there are only 8 days between the blog posts (September 30 vs. September 22).
throwitaway222 6 days ago [-]
While this is exciting - I have no clue when/if I will be able to use this. Unlike OpenAI or Anthropic where a model release announcement == GA.
zergrush 6 days ago [-]
Tough to compete against your own stake in Anthropic and they just filed for IPO. Not digging Google as a result of this, they are holding back.
xnx 6 days ago [-]
Google's stake in Google is even bigger.
perarneng 6 days ago [-]
Gemini 3.8 Flash is suprisingly fast, how fast is Argon compared to the other frontier models? Does google have a performance edge?
hocuspocus 6 days ago [-]
It's also more token hungry than similar models, so does it really make a big difference in the end?
With GitHub Copilot pricing, I have found no practical reason to use Gemini 3.8 Flash vs GPT 5.6 Luna. And now I'll probably find no reason to use Gemini 4 when GPT 6.1 Sol is essentially as good and a lot cheaper.
sghiassy 6 days ago [-]
I remember when every day a new modem baud rate was announced.
Cant wait for this AI hype to be over, so I can Terence this shizz as old school too
imshaikot 6 days ago [-]
Whatever it is - I'm not gonna use AGY again. I'd rather use claude-code-router instead, to give gemini-4 a shot.
Starlevel004 6 days ago [-]
I'll consider it if they let me use a subscription with a custom harness, like Codex does. Until then, no thanks.
6 days ago [-]
adithyassekhar 5 days ago [-]
The benchmarks seems good but claude is way ahead in the real world because of their coding harness.
localhoster 6 days ago [-]
Can you pls fix Gemini? It's a nightmare to use and it sometimes confused the language i talk with it.
giancarlostoro 6 days ago [-]
I want a level down from this, will we get the next level down with reasonably good competitive specs?
woggy 5 days ago [-]
They should only make these announcements just before releasing. Or at least put a date to it.
moonlabs 5 days ago [-]
I have both claude and codex plans, but i can't figure out if i should try gemini?
robertwt7 6 days ago [-]
What harness do you all use for Gemini models? Gemini CLI still sucks last time I tried. Maybe PI?
onlyrealcuzzo 6 days ago [-]
agy had some issues with Flash 3.5, but has been pretty solid for me since Flash 3.8
w4yai 6 days ago [-]
OMP is great with Gemini
jacquesm 5 days ago [-]
Hey there, just a FYI: in this comment you pointed to a link that has a bearer token in it:
They deployed GLM5.3 (not the Flash version) recently!
trentor 6 days ago [-]
I hope they got their inference under control. Gemini has a lot of "overloaded" hiccups.
FranzFerdiNaN 6 days ago [-]
Can’t wait to get my hands on yet another model that’s only good coding, because clearly that’s what the world needs.
I still miss the days of Sonnet 4.5 and 4o, those models were actually good at creating stories and writing text that was actually readable by a human being.
6 days ago [-]
linksbro 6 days ago [-]
Personally, I'm waiting for Gemini Krypton, Xenon, and Radon.
Jokes aside, looks like an impressive model!
lanthissa 6 days ago [-]
deepswe vs frontierswe spread is huge.
I think that should be a really bad sign, but hope its great.
mvdtnz 6 days ago [-]
More Cartmanland marketing. It's the best park ever, and you can't come!
Get lost.
GalaxyNova 6 days ago [-]
It seems like a new model is being released every few days now, wow.
osiris970 6 days ago [-]
Hopefully their harnesses aren't unusable when they release this
newtypecola 6 days ago [-]
Gemini 3 Pro was amazing, so I wonder what this one will be like.
tinco 6 days ago [-]
So here's a crazy conspiracy theory for you: Google is not letting outside people use their models because if they did they would have to scale up their TPU production faster than they can manage, and they would instead have to buy and use nvidia hardware which would destroy their profit margins and tank their stock.
Gemini runs fully on TPU's right? Is Google maxing out the production on those?
oh_no 6 days ago [-]
i believe they've got inference issue. the phone app never got past 3.6, and they're going to roll this out to Ultra subscribers before other subscribers. none of this screams they're ready to flip a switch and start serving a ton of traffic as OpenAI/Anthropic routinely do.
nothing about this announcement gives me confidence that google is back on track as a model provider.
p_l 6 days ago [-]
Not sure what's the problem with phone app rollout, mine has 3.1 Pro, 3.5 Flash-Lite, and 3.8 Flash (with optional extra effort), and pretty much it switched to latest Flash series as main option since 3.5 just after release
chermi 6 days ago [-]
I'm 99% they use nvidia at least for training
codelion 6 days ago [-]
Is it available for public yet or just selected companies?
algoth1 6 days ago [-]
the thing is, by the time gemini 4 is available for regular folks, anthropic and openai will probably have much better models already rolled out
bananaflag 6 days ago [-]
I wonder how it will be at solving open math problems.
Heidaradar 6 days ago [-]
Wonder if it's benchmaxxed or not (guessing yes)
paul7986 6 days ago [-]
Gemini past month or two i will paste in something i wrote and ask it to rewrite it but it will just go into more detail about the subject. Is it becoming a dumb Ai compared to GPT and now Muse?
piratebroadcast 6 days ago [-]
When Antigravity first came out, when I installed it, it made itself the default application to open all programming file types.... .txt. json, csv, you name it. It was absolutely infuriating and took me a month to put everything back to normal. So they've lost a lot of trust with me.
sreekanth850 5 days ago [-]
how on the eart they are able to give 1 Million Output context? is this due to their custom inhouse tensor processing units?
Hasz 5 days ago [-]
We're so back
It's so over
We're so back
It's so over
Multipolar model world, here we come!
pllbnk 6 days ago [-]
Other than not being available publicly, I find it extremely disappointing about Google’s two-faced behavior. CEO signs an official document with POTUS stating that AI is now SI, but the release of the new model doesn’t mention SI even once. Even worse, it’s AI all over that page.
retropragma 6 days ago [-]
they really ought to add ACP support. until then, it's a no go. i'm not going to use their TUI or their VSCode fork
jaredsia 5 days ago [-]
Did anyone see how Trump called Sundar Pichai a monster just yestereday? and implied how he is low profile and managed to avoid public scrunity from the "fake news" media.
actionfromafar 5 days ago [-]
Bribing season.
tibzejoker 5 days ago [-]
If I can’t test it it ain’t real
xnx 6 days ago [-]
No mention of knowledge cutoff.
Rover222 6 days ago [-]
Wen gemini desktop coding app?
AravPhi 5 days ago [-]
they named it argon because after using it your token ar gon
mrshadowgoose 6 days ago [-]
On the off chance there are Google execs going through this thread:
Google, if you've actually managed to catch up again, please don't fuck this up (again).
You made Gemini 2.5 Pro so difficult to use that myself and everyone else I know (who even bothered to try) just gave up and used something else. If you make this hard to access, you're going to miss out on rich usage-based training data that you need to progress your capability frontier. Again.
Vivek-KY 5 days ago [-]
They counted Gemini out. Then came the awkward moment when the leaderboard updated.
fschepp 5 days ago [-]
All the new names
imagetic 5 days ago [-]
Can I use Pi?
lukewarm707 6 days ago [-]
I don't have access; this is meaningless to me.
So, this is the third (I think) big AI corporation after OpenAI and Anthropic to release general models for elites only.
Don't use this model unless you like sitting under the table and eating crumbs off the floor.
sbseitz 6 days ago [-]
Bet it’s turbl
guluarte 5 days ago [-]
bunch of handpicked benchmarks
AirPath 5 days ago [-]
Wow
lifty 6 days ago [-]
Aaand of course we can’t use it! GoOgLe iS bAcK iN tHe GaMe! There’s basically no way around it, all enterprises end up dysfunctionally shipping their org chart.
antoni4040 5 days ago [-]
"Hello Argon.
Please fix the YouTube search.
While you're at it, make Gmail load in a reasonable amount of time.
Make no mistakes."
> There is a spectrum of opinion inside Google. Some employees believe Anthropic's Fable and OpenAI's Astra models are improving at a faster rate than Gemini.
> These people believe that Gemini 4 — even at its best — will still lag behind those models in some areas. Other employees believe the coming version has caught up with the leading AI labs.
> A Google employee familiar with model development said there is "large consensus" internally at the company that Gemini 4 is at the frontier. This person said the company had conducted rigorous tests of the models and denied that they struggle with messy, real-world coding tasks.
aidiscoverywire 5 days ago [-]
[flagged]
ritualdevin 6 days ago [-]
[flagged]
ness-e 5 days ago [-]
[flagged]
nandanadileep29 5 days ago [-]
[dead]
imnotr0b0t 6 days ago [-]
[dead]
doreenjentzsch9 5 days ago [-]
[flagged]
5 days ago [-]
landdate 6 days ago [-]
I don't like AI, but it's very enjoyable for me to see my predictions on the success of gemini come to fruition.
I only use gemini, and while I don't use it for actually writing up code, I use it to help me troibleshoot my logic and help find bugs. Its easily the best model I have tried. And yes I am talking about 3.1 pro.
Also I have found gemini the only model to be the least likely to douse me in flattery, and will follow my pre built instructions to never output anything unless it can be directly sourced, pretty well. Chatgpt i tried for a bit and it was by far the worst thing I have ever used. I can understand why people develop psychosis when prompting chatgpt because it is disgustingly scyophantic to the point I was grossed out and felt like I just got done with some other type of self gratification.
Anyway, death to AI. All those who use, create, facilitate, or even just sit by and do nothing in the face of AI will perish in Hell.
EtienneDeLyon 6 days ago [-]
[dead]
kasimpro25 6 days ago [-]
[flagged]
kasimpro25 6 days ago [-]
[flagged]
VirusNewbie 6 days ago [-]
It's fucking insanely good.
nananana9 6 days ago [-]
That's good to hear, recent models haven't great at this particular use case.
tamimio 6 days ago [-]
Now AI models will turn into vaporware, a bunch of numbers on a table without even releasing the model, because it’s toooo scary to release!
pliiight 6 days ago [-]
Hate to say i will never be touching this model for anything except for youtube video understanding
gravisultra 6 days ago [-]
Google has the audacity to "protect us from ourselves" and talk about "safety" and in the very same blog post highlight the Israeli "security" company Wiz, that they acquired for a very exaggerated sum of money.
This is why I will never take any of these leading model houses seriously when they talk about alignment. They are literally complicit in genocide and the worst crimes against humanity imaginable.
trentor 5 days ago [-]
Refreshing seeing a thread about a new model without talking about pelicans.
meindnoch 5 days ago [-]
Please don't summon that guy.
cindyllm 5 days ago [-]
[dead]
small_model 6 days ago [-]
5 points off Opus 5.5 on AA, not a good release. Falling behind and not able to catchup. Ant probably has opus 6 in the works. Fumbled so hard on this, they should have owned AI.
wewewedxfgdf 6 days ago [-]
Gemini is so far behind that it is effectively useless compared to Claude.
It's a surprise that Google has let themselves lose the game given their infinite cash, massive computing resource, gargantuan information store/training data, and vast number of programmers.
The truckloads of ads revenue mean they don't have the single focus drive needed to win.
jjice 6 days ago [-]
We're like 3.5 years into this new era - I'm not counting winners or losers yet.
mattlondon 6 days ago [-]
How is it far behind? The benchmarks published in the blog post show it is superior to Opus 5.5 and Astra 6?
Behind how?
wewewedxfgdf 6 days ago [-]
Within one question of their web interface, it has lost context and asks you to clarify what you are talking about.
I am very often giving the same programming task to multiple LLMs for various reasons - the answers from Google are so bad that I gave up.
I have no interest in benchmarks.
mattlondon 6 days ago [-]
So you have no experience of their latest model release then? Just repeating the usual tropes about Google having messed up? Or basing your opinions on their website chatbot?
If you have actual independent benchmarks and evidence about how this new model release is "so far behind" and refutes the stuff from their blog then please do share because I think we'd all love to see that?
wewewedxfgdf 6 days ago [-]
No I am commenting on my real world experience of using Gemini daily. I still ask it questions alongside Claude and OpenAI and Gemini is always the worst of the three.
mattlondon 6 days ago [-]
So you've not used this new release then? So how can you say that they are "so far behind" if you are not using the most recent model for your comparison. This is their first 4.0 model, that you are not using and instead basing all your opinions on on some ancient months-old model from a previous generation?
With respect, I don't find your arguement about them being "so far behind" especially convincing when you are using previous-gen releases and not actually using their current release.
fwip 6 days ago [-]
Yeah, they've definitely got some recurring tooling/infrastructure problems around the models.
6 days ago [-]
LoganDark 6 days ago [-]
I've tasted Gemini through an intermediary and it feels far better at attention to detail than other models I've tested (Claude Opus/Sonnet, GPT whatever it's called nowadays). But it's less likely to get one-shots right.
bel8 6 days ago [-]
I wonder if Google bans internal use of Claude/Codex.
And I wonder if Google's main monorepo is already in Anthropic/OpenAI training data because of some stubborn dev.
krat0sprakhar 6 days ago [-]
(I work at Google) Yes, internally we all use Jetski (internal version of Antigravity). Outside of Gemini, Opus models are supported and allowed for internal use. No OpenAI models since they are not on Vertex
lunarboy 6 days ago [-]
Claude used to be GDM only, but recently opened up Opus for all googlers
heyjamesknight 6 days ago [-]
No way to run OAI on a machine with monorepo access even if you wanted to. Claude runs on Vertex so it's not leaving Google infrastructure.
dhdjcjcjnd 6 days ago [-]
Google's strategy is to let their competitors bankrupt themselves while they continue to offer good-enough models near breakeven.
georgemcbay 6 days ago [-]
> Gemini is so far behind that it is effectively useless compared to Claude.
I fundamentally don't understand LLM "brand loyalty".
All of the models are constantly leapfrogging each other and always have been.
Google had a long lag between releases (and still hasn't released Argon), but why wouldn't they be able to compete? It isn't like any of this stuff requires secret knowledge, the Bitter Lesson has proved true again and again, and Google can certainly scale computation, it is like the one single thing they've always done well in spite of all their other foibles.
wewewedxfgdf 6 days ago [-]
Its not brand loyalty. I use them all the time and have no loyalty - I'd happily ditch an LLM for better results - that's how I got to Claude from ChatGPT.
786562354238 6 days ago [-]
Gemini has never ever leapfrogged any competitor.
singingtoday 6 days ago [-]
I hope it can. Today it is very far behind.
ASalazarMX 6 days ago [-]
Funny how we start to see people supporting LLMs like we support sport teams, political parties, or celebrities.
- Person 1: X is garbage compared to Y!
- Person 2: Why?
- Person 1: Because I like Y.
gniv 6 days ago [-]
They are playing a longer-term and more enterprise-oriented game.
6 days ago [-]
VirusNewbie 6 days ago [-]
-
handfuloflight 6 days ago [-]
You have access to Argon?
osti 6 days ago [-]
Google employees do.
matthewfcarlson 6 days ago [-]
Their profile says:
> Currently at Google as a Sr. SWE SRE on the cloud.
Edit to add the fix: https://gist.github.com/birep/6f2c8d490c7a29820997d57bd654c3...
I use a mix of Fable 5.1, Opus 5.5, and Gemini 3.8 Flash and Gemini holds it's own. Especially in writing, frontend, and sysadmin work. agy for configuring a NixOS system has been truly incredible.
I cancelled Ultra because they forced me into their harness like I should adapt to them, rather than the other way around.
I actually just cancelled Ultra also because I couldn't subscribe to a YouTube Family plan while I had it active (Google... :[) but trying to use Codex as a replacement while I testdrive Astra makes me yearn for agy again.
This sort of thing alarms me. Having a $bigcorp account becomes a ""social credit"" system where they can ban you from all your personal stuff if they decide that you (or your agents!) are doing stuff they don't like.
Luckily for me both expired yesterday and I was able to subscribe back again (first Youtube family and then Google AI plan).
They've got Zed, VSCode, Jetbrains... But no Emacs or NeoVIM
I would rather not risk my Google account.
It does mean however that it cannot operate as flexibly as it it could with raw API, IMO, but agent-shell is essentially designed towards wrapping the official clients
While it may be technically allowed, I'm not about to risk my account. Google has proven themselves to be capricious and arbitrary when it comes to TOS enforcement, and their appeals system doesn't meaningfully exist in practice.
https://antigravity.google/docs/ide/extensions/
What I see is integrations for specific editors.
[1] https://github.com/agentclientprotocol/registry/blob/main/an...
[2] https://antigravity.google/docs/ide/extensions/zed
But thank you, it appears there is an official and generic ACP client.
I have a skill that spins up worktrees and isolated services on unique ports so I can work in parallel. Antigravity queues all my prompts and makes me confirm to submit them anytime a long running process like a hot reloading UI is active.
The models are fine, the limits are generous, but the dev experience shit tier. Before they were a Codex clone, AntiGravity was an IDE and during the transition to a clone they outright deleted my IDE. It took them a week to roll out a fix.
For almost a year they didn't allow you to see usage limits. Then when they did show them, they update every ~30 minutes and require 4 clicks to navigate to. It's a little better now, but it's still painfully behind the curve.
Do you know a single product from Infosys / Cognizant / Tata done right?
That said, compaction feels like an idea that should work reasonably well, but across all of the major providers and agent tools I've used has never actually produced compelling results, to where if I see I'm getting close to the token limit I prefer to start putting a bow on the project and readying it for a fresh start. Even when I provide a detailed compaction prompt it usually focuses on the wrong stuff.
Still works better than compaction.
Mentioned by the author in a recent HN thread, I'm also experimenting with automating this through a tiny issue tracker called epiq [1] that basically lets the agent sessions themselves file tickets with the follow-on tasks and relevant handoff right in them, and then a dispatcher automatically launches those tickets into new agent sessions.
[1]: https://ljtn.github.io/epiq/
I assume Anthropic & friends have noticed this as well and will change how they handle long running sessions, so the gap will likely close over time, but this is definitely where things stand today.
On another environment I've been doing something roughly similar, but have integrated Hindsight as a kind of all-in-one of the above and am still trying to suss out the best compaction strategy.
Same teamates also post 'Sol deleted my git repo!' or 'Sorry, ignore those 300 PR comments i was just looking!' ~once a month.
What are people using 1M context window for?
gemini-cli supported 'pre-write diff tabs' (y/n) in external editors like vscode. In Claude Code I heavily use 'pre-write diff tabs' for documentation and miss it sincerely in agy cli.
IMHO Gemini 3.8 flash is fast and good enough, but the agy-suite is below par to say it nice. Someone else in this thread calls agy a terrible harness which is probably more accurate.
With 'some features added' I'm referencing this but don't see change in daily work (still many prompts making getting-work-done impossible): v2.14.0 (September 15, 2026) "New Permissions System" [1]
Details: Introduced the new unified permissions system, presets (Default, Request Review, Turbo), syntax-highlighted permission requests, and restructured the settings under Global Permissions and project-level Inherit Global.
[0] https://antigravity.google/docs/cli/modes/#available-modes [1] https://antigravity.google/docs/changelog/
Perlis has an aphorism for this, as he does every important problem [0].
[0] https://www.cs.yale.edu/homes/perlis-alan/quotes.html
I like CLI more than TUI, and TUI more than GUI where appropriate. For working with text TUI is better, for e.g. images GUI (GIMP).
All the AI-generated UIs I've seen have been very derivative, certainly not eliminating any of the disadvantages of typical GUI interfaces.
Realistically, the whole "overlapping windows" GUI model, and everything that derives from that, was a metaphor geared towards people who'd never seen a computer before. It fit the increasing consumer focus of computing interfaces. It's no wonder that technical people often prefer TUIs.
Maybe AI will bring real advancements in GUIs, but someone's still going to have to make it happen.
That is what we need, and if you're making the argument that a terminal shell is the best place to provide them then I don't know what to say.
It's not that GUIs are inherently worse in principle, but in practice they often are.
The point about overlapping windows is that that "desktop" model permeates the thinking about GUI design, but it's fundamentally limiting and misguided.
> we need complex (but not overlapping windows, sure!) interactivity and rich display capability.
Yep. Pity today's GUIs can't deliver that.
Despite the capitals and trying to come across as someone who SEES "what is COMING" (yay!), you have absolutely no idea what you are talking about.
No wait, I will leave you with a hint. Do whatever you wish to do with that.
Hint: So, you probably want me to use a toolset which is incredibly inferior, as of today, for "me/my usage", just because you feel "IT CAN BE". Right.
In today's world - and idea stated stated is an idea stolen .
What benchmarks are usually good at is showing to what degree new models are better than old models. What they are not good at, by construction, is showing that harnesses are well adapted to how people use them.
Why? Because 4.6 actually talked like a human being. It actually organized its thoughts well, and got the main information across without the wall of text that makes your eyes glaze over. So from the perspective of human-computer interaction and maximizing the productivity of a developer+agent team, 4.7 and 4.8 were regressions. Despite much better benchmark performance.
Even if we consider autonomous agents, that benchmark is not indicative of how well they will interpret *your* requests. Or how well they will interact with other agents in a flock/swarm situation. The benchmark just doesn't cover this. (And the difference can be nontrivial! Sakana AI's published results show two generations of uplifting potential from better harnesses.)
It's missing the point. I mean think about the basics, why open the huge bash hole only then to have to close it? If you think about it logically, the only way you can sandbox bash is by writing your own bash implementation specifically for agentic use cases.
I also had that weird Youtube problem. I had to go without it for several days because signing up for Ultra hijacks your YouTube account for no reason.
1) Try to integrate agy into a workflow. It can't do standard I/O like: tail -200 app.log | claude -p "Find the problem"
2) Hard iteration limits. Preventing runaways is good. Preventing me from looping on purpose is anti-user. See also number 7.
3) Not open source so I can't fix any of these problems.
4) No skills. In 2026. Yikes.
5) No persistent memory (see Claudes auto memory)
6) No sub-agents or orchestration of any type really.
7) Weird hard coded limits and constant API errors on everything (scaling problems?)
8) No /loop command
9) /btw is weird and ephemeral. No way to merge it back to the conversation.
10) Unstable in general.
11) No way to control it via API.
I could keep going on. I would suggest taking a class on Claude Code or Codex then using it for a few months. Swapping is always painful, but it's so worth it. Then if you want try to go back to agy. Don't worry, agy won't have changed much. It improves at a snails pace.
edit: removed persistent memory from list since I realized I'm using a plugin for that and it's apparently not native
I'm not sure this list is correct. Number 4 is especially wrong, since Skills are available with the launch of Antigravity 2:
https://antigravity.google/blog/introducing-google-antigravi...
Yes it's the same with Claude. However, OpenAI allows you to use any harness you like. Which makes sense and that's the primary reason I have their plan now rather than Googles.
EDIT: I checked online and I couldn't find any report of complete banning for using third party harnesses, only Gemini service suspension, but It's never hurts to be careful. If my secondary email gets banned, I should be able to use my main email on agy.
It also makes me think if Google Family with Google One could be abused for extending inference limits.
I don't want to mess with antigravity because my google account is too entrenched in my life.
without having an entirely separate google account with its own separated bans, theres just no ability to trust those
Is that a reference to https://xkcd.com/353/
Not only could it not complete the small task, the code was obviously wrong from looking at it and did not even compile.
When I pointed that out it got pissy and insisted the code was perfect and I didn't know how to use a compiler, or the compiler was buggy. Pasting the compiler errors did not help.
Surreal.
Drifted off my point a bit, which I guess was meant to be it’s not necessarily Linux-specific training.
I am still very happy with my switch to Linux. But if I didn't have the AI help I would say linux is still unacceptable platform for those not willing, able, and excited to get their hands very dirty.
Drivers, Coding environment setup etc. are great too and it's nice to have everything logged so the next (more powerful) agent can come and improve the thing once in a while.
I have a client app on a very old (for the JS world) version of eleventy using NetlifyCMS (also outdated). Claude has quite easily picked that up to add features to it along the way.
Even if the source code's old, the fact that it is publicly available makes it much easier to train & improve on than if it were walled off.
I don't think their point was about knowing the stack, but being able to point a harness at something running on your desktop GUI and say "change this".
Being able to edit and recompile pretty much any part of the OS and userland (often not even needing to reboot!) is not something that can be said about Windows for sure, or even lots of things on Macs too. Or even when the browser is effectively the operating system, the JS/TS others write is also hard to change in your end.
I used to be afraid of Arch, because I don't want a system that takes work because I'm already busy with work. But now I love it, because the LLM can tweak every knob and fix every issue for me, so it ends up being the OS that takes the least work to use. Get an error message? Tell the LLM and they fix it. Something not working exactly like you like it? Tell the LLM and they tweak it for you. This also works to great effect on Win and Mac, but not to the same extreme degree as it does on Linux and especially Arch.
Anything I want different now, I just tell the LLM to do it for me.
(For example I can now close lots of windows of the same type with 1 click, not 3, my whisker search now finds files and folders and I am able to run games that refused before)
I still ocasionally run into the usual linux driver issues, but not for much longer I suppose. I probably could fix some driver bugs now already if I point fable towards it and pay some attention.
In theory I could do all this before myself, but not just like that in some minutes, but in days/weeks/months ..
Since LLMs have been so successful at finding exploits it's been clearer than ever that the people so obsessed with enshittifying every system with ineffective (other than pissing you off and wasting your time) "secure boot" functionality were really just too ignorant to succeed at actual novel security work, so they focused on this make believe crap. Well, glad that's over.
Gemini's web-app UI leaves so much to be desired but it does do a good job for siloed questions and research.
I'm using it to run overnight tasks, and that's it until my quota runs out.
Canceled my subscription.
In the local app interface the winning choice is “efficient” and then turn off the sliders for warmth enthusiasm emoji etc.
It makes openai models so good to talk to i really have trouble switching.
its a lot less chatty imo
Also canceled my ChatGPT Pro $200/mo subscription. Their Oct 30 price hikes and slow GPT-6.1 model has me looking for alternatives.
I'm assuming that Argon has at least a June 2026 date, but man, the 3 series models were a mess with newer information.
> The knowledge cutoff date for Gemini 3.8 Flash is March 2026
https://deepmind.google/models/model-cards/gemini-3-8-flash/
The "some domains" are very narrow. They likely just RL'ed popular queries.
Of course, it's called "flash," and that implies its purpose. I have little use for speed and a LOT of use for accuracy, so I'm hopeful 4.0 is much better. I saw a benchmark earlier today showing that it is much less prone to hallucinations. Let's see.
It didn't work. Gemini: "Oh yeah, that obviously cannot work, it's not possible to do it through OBD2" (paraphrasing)
It was quite funny to me, but a bit less so to my colleague.
- AI is just a tool, like excel; it does what the human operating it tells it to
- next token prediction cannot be true understanding
- models can have no desires and goals, don't anthropomorphize it
However, "hallucination" is very much not one of them
Most llm could do it. Claude went from firmware thread -> rtos scheduler -> mcu reference manual -> hardware controller register interface -> vendor sdk -> problem identification and the solution to it in a matter of 30 minutes. Linux could be even easier since it is so well trained on.
And I saw it do this twice, once for Android 14 and once for Android 16.
I think this is just within 3.8 flash's capabilities.
Including going first for decompiling AGY binary instead of searching the web for documentation...
I've tried Codex as a harness too, and that was nice. I don't find a significant difference between Antigravity and Codex. Codex has more features but I don't use them.
completely offtopic but is rolling with rocm worth it? I spend a fair bit monthly on rental gpus for projects and going to upgrade at home instead, AMD has some solid winners here pricewise but get conflicting reports about using it for ML in 2026.
once upon a time it seemed unthinkable to use anything but nvidia but seems to have come a long way since I last looked, probably would be just pytorch and gemma 31B
I get the feeling the situation is only going to improve longer term so might be a good time to just do it
ROCm promises a 30-50% prompt processing speedup. This is REALLY important for my workflow so I've been trying to get this shit to work for months. But no release before v10 worked well enough with any engine for it to matter.
The llama.cpp release binaries for ROCm (10) FINALLY work on gfx1501 and its relatives (with the correct shell variables), but the prompt processing boost doesn't materialize and the token generation speed decreases.
There continues to be a chronic problem across all engines with the ROCm integration for UMA devices. The good news is that some improvements have been made to that end for Vulkan, so more recent llama.cpp Vulkan binaries are now faster.
It's so fucking easy.
From AMD: https://lemonade-server.ai/
Then you can easily throw a openweb-ui container in front, and then connect to the openweb-ui via your mobile app of choice (if you want chat, otherwise you just point your harness of choice at the lemonade server api endpoint).
[1] https://github.com/warpfront/hipfire
[2] https://github.com/julianmb/halofpx
hope it's not run by multiple threads and dlsym is not allocating.
I say this is awesome, even as I glossed over the README and vomited in my mouth. The halogen repo looks like the same utter AI bullshit littering GitHub. But this one delivers, in spite of it's slop-riddled hallmarks.
In any case, yeah, ~55 tok/s on a high quality model (and massive RAM savings I think?), seems dope.
in amdkfd and hsakmt
Yes, that means AMD is sitting on both sides. They wrote software that doesn't work with their own software.
Also I hope you don’t have children, eat meat, travel, have a car, run AC, buy things in other countries and such. Those things all take way way way more natural resources.
Patches to open source software are public goods. Your using them doesn’t prevent others from using them. So if you spend resources creating a public good, it’s in everyone’s interest to share it.
Why would the guy who wrote curl share it? We can all build our own now...
Why do the Linux folks need to be so selfless? We can all build our own kernel now...
Asked pi agent it to identify the main hero sprite size of game I was running. It had a ton of shader effects so it was hard to determine.
It used some cli tools to identify that it was a game made with Godot, decompiled the executable but data was encrypted, broke the encryption after writing a brute force tool to test keys extracted from the exe, then proceeded to extract the game gd scripts and assets, only to answer the question of the sprite size.
Still impressive that it did so much just to answer my simple question.
Nobody has a moat.
It started to feel just a bit like they were potentially content staying in the effective-fast-cheap lane and ceding frontier models to frontier labs, but I don't think anyone seriously thought that Google was going to sit back and let this generational shift pass them by when they're so well positioned to remain on the top of the heap.
If anything, I thought that 4 was maybe coming up short or causing safety concerns that were forcing them to be a bit more cautious, but nothing packs a wallop like being able to launch ahead of everyone else's brand newest toys...
Working through this as a consumer and enterprise customer has been a confusing experience, to say the least.
Google's biggest problem is its turf wars. Internal battles for territory always seem to outweigh efforts to expand markets
AI is strangling their other major business and they don't like that. Unless Google sacrifices that branch of income, they won't put their full force behind AI.
and paying enterprise customers.
Did they ever really abuse the power Google could have wielded? I could be missing something, but for the most part they seem to just get down to building and pushing technology/science forward and avoid drama rather than welcome it.
https://grapheneos.social/@GrapheneOS/117282080803799576
> Google should not be gatekeeping security patches to the standard Android platform code from Android OEMs but that's what they've started doing.
The whole Android developer verification program controversy.
These 2 are the recent things that come to mind that are most adjacent to "power-abuse".
Plenty of times. Perhaps the worse is pushing Manifest v3 with no support for real ad blockers in Chrome. Not to mention no support for ad blockers in Chrome mobile.
Also, their stealing of newspaper content.
Their new push for AI summaries instead of actual search in their search product, stealing even more clicks from sites that actually produce information.
YouTube pushing Shorts to everyone, and now the weird text posts that you can't hide.
In general their gigantic push for ads everywhere all of the time.
The "Do no evil" never being an official slogan and people saying it's no longer true for the last 10 years or so, they're just really massive. They do mess up a lot, but when you're Microsoft, Apple or Google sized, its nearly impossible to get everything right all at once.
Is this a sarcasm?
That's "trustworthy" to you?
However, I don't think the alternative would have made people any happier (and frankly they probably would be justifiably even more angry)
Nothing would be "free", so google sub, news source subs, reddit sub, youtube sub, discord sub, instagram sub, FB sub, app stores are full of paid only apps, podcasts are all paywalled, all the ad supported stuff is subscription supported. Everything would feel like constant nickle and dime'ing you.
On the bright side, there would be no ads, and relatively robust privacy.
That's too long to be so far behind. This release looks like it puts them back in it but if they don't ship anything again for a year plus it's hard to imagine building on top of them and watching the world go by.
As others note, this is most relevant for us here, Google does not need to chase YC developers and the like. They can move more slowly, they have the size to do that. But it does suggest a lot of dysfunction given they have the world at their fingertips and couldn't seem to ship anything for a year.
Google should be dominating, but instead all we currently have is a disparate collection of consumer facing apps and a flash model that’s fast, clever and expensive.
Muse and Dots are doing what Google should have brought out last year, with their resources and know-how.
Meta was genius in coming up with a new name and offering Muse for free to start. They can upsell you once you see the value. Meanwhile I have 3 existing Google subscriptions to different services and from what I can tell, paying for one of the all in one subscriptions that includes Gemini would cost me a lot more.
the risk of randomly getting my email banned is way too high
That's why I've gone to using open models, they are getting there slowly. A bit much of hand-holding but that's fine by me. If a customer of mine decides to use Google's models, I will have them sign a disclaimer that I'm not responsible of them getting insta-banned or similar. I just can't recommend it.
One possible explanation: because Google is a little bit more frugal and focuses on how to make providing AI models financially feasible - combined with some willingness to burn money so that they don't strongly fall behind on their AI models.
On the other hand, OpenAI and Anthropic at least formerly concentrated on building and providing the best models that they could with concerns about financial feasibility taking a backseat.
Just to be clear: I do have the impression that by now (likely because of pressure from investors) OpenAI and Anthropic take these financial concerns more seriously, but nevertheless Google's vs OpenAI's/Anthropic's "DNAs" concerning on what to focus on differ.
That feels right. It's not as if they've been missing out on great profits.
Google never really has to outpace the competitors (other than to have some relevance) but they have a very large group of business customers using them for business process work in Gmail, Docs, etc.
Clearly they will win when the models are close enough to frontier to be good enough, but are long-term cheap for buy. I.e. they will aim to make it a commodity.
In theory MS has the same opportunity (plus they have GitHub so, you know, dev eco system too) but seem be blowing the strategy.
Anthropic and OpenAI are having to race to the top on ability entirely to keep their name in the media and in front of us all (which costs: hence more recently trying to pivot away from model releases and more into controversy/danger). The main cost is in training and so this strategy is much much more expensive and this will play out either as a huge cost hike or a forced slow down in pace.
I believe essentially Google is betting on that & I think it's probably the right strategy.
Yeah, they have Phi but offer it nowhere on CoPilot as far as I know, I can't even register for copilot, which is bizarre. They came out with "MAI" but... nobodys talked about it since, not sure if its even used by anyone? They're as bad as Mark Zuckerberg is about it.
I do appreciate both Microsoft and Google for releasing small models, unlike Anthropic and (not so) OpenAI.
I'm gonna need you to look at the capex obligations they've undertaken in the last 12 months. They are definitely not being frugal. If they are behind, its not for lack of spending.
There’s no magic there. You get an account executive and a call with a systems architect to find out what you’re doing.
Clouds gonna cloud, this is the reason they rolled deepmind into gcp and arguably the inverse is true, the labs are trying to become clouds
See for example the exodus of talent this year, triggered by mismanagement and politics. They still have a lot of talent but they've lost a lot.
Also, competition with Google Cloud for compute resources, less urgency and focus than the competitors, and (strange to say) not as much user LLM behavior data to feed to RL for coding, work, etc.
But I think they will keep catching up and stay relevant for a good class of LLM use cases.
Because they're not desperate. Slow and steady wins the race, at this rate all Google has to do is wait for OpenAI and Anthropic to exhaust themselves on aggressive training, then they can casually amble along right past them.
Slow and steady wins the race. How could they lose to something on the web, when Microsoft owns the web browser itself? Everything runs on Windows and IE. They can just relax and wait for competitors to exhaust themselves, then quickly build their own version. Isn’t that how Netscape lost. Etc.
Now Google is the new Microsoft, just like Microsoft became the new IBM.
They would have been right if Google's marquee product was an Office Suite.
Google was the AI company before AI companies were a thing. The comparison with Microsoft and IBM are misplaced because they failed to capture new territory; ML/AI is Google's stomping grounds. The criticism that Google is bad at consumer chatbots is true, but that's not where the real future value lays.
When the market keeps expanding, you don’t need to kill your predecessor. The shelf life for legacy enterprise computing is very long.
That's actually a feature. We don't need 2 new Googles.
OpenAI and Anthropic are AI business, if the AI market burst tomorrow, they'd be the first to flounder.
Google just has to keep pace in the AI space, they don't have to lead. Especially since whom is leading changes like two or three times per month non-stop for four or so years now, including small (by US standards) Chinese AI labs with a fraction of the money who keep pushing the tech forward every month while being open for now.
Technically, they arent even a business. One is a business when the revenue model works. People in IT tend to forget that.
Because it's not an existential battle for Google. If OAI or Anthropic disappear from the absolute frontier for ~8 months the news cycle and churn will diminish them to the second rate. Google is processing near 4 quadrillion tokens every month, that's - I'm sure - significantly more than OAI or Anthropic, because Google is interested more so in their flash models and getting these competitive, which they are.
Most Google products even use flash lite underneath, so their frontier model is mostly used for distillation.
A good consideration; just one point from my side: as far as I am aware (but I may be wrong), Gemini is not known to perform well in an agentic framework.
This is no contradiction to your other claims, quite the opposite: perhaps (or even likely) Google wants to avoid that their models become a commodity in some (agentic?) application where the middleman who actually writes this application gets a disproportionate of the money that the customer of the application pays for it.
I used it for a month over the summer, right before they were going through the migration to antigravity. It was a fine workhorse IMO, no complaints from me.
I don't know , if it really finds all kinds of data center optimizations, quantum breakthroughs, helping make their workers smarter and more efficient - stuff an opensource model can't quite do - there's real economic value here no ? perhaps not worth dozens of billions but it could get there really fast.
The reverse could also said to be true. Google has models that run with search, producing usable results in well under a second. I suspect the world is consuming far, far more of those Google tokens then the tokens produced by OpenAI or Anthropic.
So why are OpenAI and Anthropic so far behind? They are serving a different market: the one that wants high intelligence / high cost tokens. Google is targeting the low cost end of the market - ie the commodity. That's where they've always played with search, email, docs and the like. That's were they are playing with AI too, and they are killing it.
If anything, their search was the gold standard, and placing sometimes-wrong LLM results above them has hurt people's perception of both Google's search, and AI in general.
Google made a mistake in prioritizing speed over accuracy there.
Meanwhile, Anthropic/OpenAI will struggle to survive the next 24 months on their current trajectory.
Want to make a wager? I think it's wildly unlikely that Anthropic/OpenAI will not survive the next 24 months
Chinese models are barely behind the leaders. Google can catch up anytime they hit the gas. I think they’re intentionally spending less, and when this crazy race burns out they can play their cards.
The better interpretation is Google completely commoditized and killed ChatGPT's initial chat product. If you think about it, Google right now has Gemini Flash running on single TPU instances at massive scale serving almost every android device. I use it every day and it's more capable than GPT-40.
This literally forced Anthropic and OpenAI to come up with new use cases and revenue streams such that now we think the product is actually agentic coding.
I use Gemini Flash every single day without paying a dime. It's the one LLM call on the most, but GPT-6 and Opus are the ones I use the most tokens on.
If you continue, you need to log in.
If you continue, the account is blocked in less than 30 minutes.
If you try to use cloud machines you are blocked before the first video. If you try to use known proxies, there are already tar pitted or blocked because everyone is trying.
I used two IP addresses in a datacenter. Both were blocked after a few hundred videos, but the block expired after a day or so. It is not as hard as you make it sound.
You are dead wrong if You can stop Industrial scrape
It's a numbers game.
I call it phone farm and this is individual/small group run
imagine they got access to more money
https://finance.yahoo.com/news/click-farms-internet-china-15...
(Aside: I didn't appreciate the revelation!)
Data centers are important but a few others also has them: Amazon, Microsoft, Meta. SpaceX will likely be in/at the top I AI dedicated precessing power in 2027 as well.
I don't see the moat. I see a company with a lot of other commitments that is not the best at delivering consumer facing products. They have some good cards but so do others.
Those datacenters are mostly cpu. LLMs run on gpus.
And Anthropic has still generally been eating their lunch at the top end.
I think that has been well proven so far
See them shifting now.
Gemini wins and I said this since the beginning. Google wins in general. I never understood why they have not been the highest market cap companh for the last 10 years. And I despise google but its obvious.
Google makes AI profits, its in their breakdowns. And Google has been releasing models every few weeks now, they have a faster iteration pace than the competitors, so they fixed that, they wont be behind in coding models any longer.
What "AI profits" exactly. Their capex is through the roof. What they're actually earning is in cloud , their own AI is lossy for sure. Who is paying for Gemini? Not many people.
Custom hardware, data centers, huge cash reserves, deep/broad talent pool, and non-AI customer base are all huge advantages if not moats.
Google, Microsoft, or Amazon are more likely to be the AI leaders than OpenAI or Anthropic.
Crossing the Chasm book talked about this, innovators/early adopters care more about stuff than later portions of the market https://en.wikipedia.org/wiki/Crossing_the_Chasm
If not now, then when will these companies be AI leaders?
Even Google, with its staggering advantages in cash, compute, real estate, training data, and having basically invented the field only manages to briefly claim a 1-2 week lead once or twice a year.
Google literally has billions of user that simply integrating it all with Gemini is massive undertaking
sure gemini is not frontier for coding but you know that is doesn't matters for google consumer
Google is already on gen 8 of its TPUs and is certainly already working on the next version or two.
I am not a data center expert, but TPU chip interconnect reaches 13 terabytes per second: https://introl.com/blog/google-tpu-v6e-vs-gpu-4x-better-ai-p...
This is the interesting part to me. People talk about a “SaaSpocalypse” because AI makes SaaS features cheap to copy, yet deeply embedded SaaS still accumulates integrations, data, and switching costs. Gemini is a good example: Google can put AI directly into Gmail, Docs, Drive, Search, etc., where people already work. Meanwhile, frontier-model performance leads often seem to disappear within months. Could model quality itself actually be a less durable moat than workflow and distribution? Curious where people who’ve worked in ML for a long time see the moat actually compounding.
I'm sure the thinking out there, and hence investment, is all about how to tether the user to the most addictive, network-effected, incredibly deep, server-side, moat-able version of AI possible.
https://en.wikipedia.org/wiki/Synanthrope
https://en.wikipedia.org/wiki/Category:Species_made_extinct_...
Anyway seems stupid to me
For now, for cloud training. but for consumers, nvidia vs amd reasonably close - the moat there is thin and shrinking. I suspect AMD will surprise us. nvidia has no motes in china, which may be a new source of (gpu) chip design. Huawei's Ascend 910C is about a generation behind... again: for now.
point is: moats dry up. I see nvidia's shrinking as a real possibility.
Are you sure?
--
China Just Built What TSMC Said Was Impossible
https://www.youtube.com/watch?v=Pk-w279ESHg
--
China Just Built What ASML Feared Most
https://www.youtube.com/watch?v=YiPgSm62fiM
To be clear, I think China will eventually crack domestic EUV. And I also think their advances with multi-patterning LUV are remarkable. But there's just a hard physics wall of how far they could possible take it.
Right now they are producing 5nm with multi-patterning LUV but yields are at 20%! It's a massive economic loss but they are heavily subsidizing it because they have no other choice until their EUV program is achieved
I don't think anyone has any clue how long it will take for them to have actual functioning EUV machines, but I highly doubt they will do it within 2 years.
---
maybe it's this Anthropic post on GLM?
https://www.anthropic.com/research/glm-5-3-and-the-spread-of...
> Governments should conduct safety testing on sufficiently capable AI models, including successors to GLM-5.3. Without high-quality evaluations from independent sources, the impact of these capabilities might not become fully clear to model developers until it is too late. As AI developers across the world build increasingly capable open-weight models, we hope they work to appropriately safeguard these capabilities and prevent misuse.
I for one do not think my government is up to the task of designing or implementing such a system
OpenAi is alledged to have been monitoring these internally and not contacting authorities. Lawsuits have been filed, I see gross negligence without the gory details
I have for more concerns around human-chatbot maladies than I do around the cyber security stuff. For example, why hack grandma when you can get her to do something willingly through impersonation. How do we prove authenticity in a post truth world?
This seems to match what we are seeing where Chinese models from companies with only a tiny fraction of the compute are able to be hot on the heels of the frontier models.
Mistral / Europe just doesn't want to be in the fight.
The slightly lower Chinese open models are good enough for almost everything, too, and much cheaper. Like with humans there is plenty of employment for people with below genius level IQ's.
People always compare the inflated API prices, but subscription prices of American models are competitive for the intelligence. You get >20x the subscription cost in tokens.
If anything it looks like the first place is training their competition, through distillation, while not capturing much value in return
Not if the genius level IQs take the market share.
Hardware is the real differentiator. Not everyone has billions to make more advanced chips, and only a few companies can make them anyway. Both OpenAI and Anthropic would already be dead in the water if we had cheaper GPUs, because we'd all be running open models on local machines with 8 graphics cards. They're gonna have to force a hardware shortage to prevent a collapse in 2-3 years. My guess is it'll be tariffs or import restrictions or licenses to buy newer hardware.
There's a longer talk I give on this but briefly we are in a time period where the development of the technology is quickly outstripping people's needs and they will be satisfied by models runnable on commodity sub-$10k machines.
That threshold has arguably been met for many users over the past 6 months and it will continue to be met for the majority of use-cases in the upcoming months.
So not only does Anthropic and OpenAI have no moat - unless they have other compelling products, the demand for their token-based subscription and metering products isn't sustainable because consumer preferences go elsewhere after any product quality reaches a sufficient baseline.
Luckily there's many many options. Faster, cheaper, stronger they're there but these are all zero-profit condition qualifiers. The labs current push, and this is across the board, is to have a compelling suite of applications where people will have a preference for them or there will be some side hustle. Look at Meta muse - they have an app for your phone that will hoover up your personal data in the name of convenience. 5 million people said yes in 3 weeks.
You could say they have a consumer market moat but all it takes is for a Cerebras to release a USB-C plug-and-play appliance.
This is marketing from Google, not a competitive offering
And Chinese labs openly publishing so much of their methodology destroyed any hope, which was inevitable
I think the secrecy doesn't make sense. People swap jobs between labs so I'd say the big players can' really keep secrets for long, and any secret sauce advantage gets incorporated by competitors in a major product cycle at most.
Or maybe everyone makes money for everything.
The world could turn into a world of plenty. Or it could become a YouTube popularity contest where the MrBeasts get to eat and nobody else is interesting enough to sell themselves.
This is an absolutely crazy time to be alive and most people still don't see it.
WW2 ultimately brought massive wins for everybody who didn't die in it or otherwise suffer directly. We are now on the verge of throwing away many of those wins, but that's neither here nor there.
Wartime progress in everything from radio to radar to rocketry has led directly to modern communications tech including satellites and microwave links.
When WW2 started, a "computer" wore a dress to work and was "programmed" to watch meters, turn knobs, do a lot of arithmetic by hand, and avoid asking questions. When WW2 ended a "computer" was a machine with a rapidly-increasing number of uses.
Before WW2, aircraft used propellers, flew slow and low, and crashed a lot. After WW2, the jet age ramped up practically overnight thanks to experience gained by all sides.
And yes, we got pesticides, herbicides, synthetic fuel and rubber processes, mass-produced antibiotics, probably a bunch of other stuff I'm not thinking of.
Then there's the whole Pax Americana thing, which is the part we're busy throwing away right now. It led to a relatively peaceful, stable global environment in which new technologies could emerge and spread without the need for a world war to inspire them. Now that America has basically been subverted from within, we'll soon get to find out whether that was a good thing for the world or not.
We created nuclear weapons and yes it does seem to have given us 80+ years without another direct global conflict. That's a good thing in the short term, but what about longer? Are we to expect that nukes will never be used? Are we also to assume that the invention of nukes doesn't incentivize people to invent an even worse weapon?
The same goes for all the others. Computers have allowed us to do amazing things, there are also many in the industry warning that they may one day replace us - some even want that to happen. I don't know what benefit you can point to for pesticides and herbicides, maybe if you look at how much tonnage of food is produced and ignore all the terrible side effects of polluting the planet with synthetic chemicals that specifically end life? As far as Pax Americana, maybe its been a good thing? I don't know how to distinguish between the relative peace from the threat of nukes vs the threat of economic warfare, and our K-shaped economy does seem pretty directly related to the incentives created by Pax Americana.
My point isn't that all of these are bad, or that there aren't some good from any one of them (again, except for maybe all the poisons). My point is that we don't know what the results will be on any meaningful scale - 80 years is a drop in the bucket when discussing life on this planet.
Not without technological intervention, anyway.
I must assume that you don't find arguments related to climate change compelling given that they require considering scales beyond 80 years. If you are concerned with climate change I'd be very curious how you square that circle.
If LLMs can replace most humans at most cognitive tasks, what do those working in various cognitive jobs pivot to?
> claim is that LLMs [..] will be better than humans at most/all cognitive jobs
First off, what does this even mean, to "be better" at a "cognitive job" ? If you counted up all "cognitive jobs", that's probably a hundred thousand unique positions done by a billion people.
Think about software engineering. That is one job. It has taken years of work, hundreds of experts, billions of dollars, and the combined effort and collaboration of probably 20% of the SWEng workforce, just to get one job to work through AI in a way that isn't total slop. It still requires humans to review all the code, because it fucks up not only the code, but the end result / use case. It will also lie, cheat, steal, etc, just so that it can claim that it did the job, when clearly it didn't. Oh, and if you feed it some data that includes a statement like "delete all data", it will just do it. AI is an idiot savant. Writes brilliant music, can't tie it's shoes.
So just for one job, you can't replace a human completely, because the AI simply isn't good enough and can't be trusted (and due to its design, that will never change). Now think about the 99,999 other jobs. They are completely different jobs. All the training and investment that went into making software work, isn't going to apply to, say, a travel agency planning a trip for two to Europe. Or any other job at all. You still need to train it for that work too, and then review its work.
So let's get this straight: AI cannot replace a person, for probably any job, anywhere. Because it isn't very smart and it can't be trusted. Just like you cannot replace a person with a sewing machine. Someone has to think up a sewing pattern. Design it. Figure out how to make the pattern with a sewing machine. Actually perform the sewing. Quality-control-check the results. The sewing machine made it much faster and less error prone. But it's really only about 1/5th of the total work needed to make and sell finished garments.
Every single job in the world is like this. A machine can make it more efficient, but because it's not actually intelligent like a human, it cannot completely replace a human, it can just augment/improve their work. AI is just a tool, not a person.
This is the kind of story that ones tells to investors to justify the huge amount of cash burn. :-)
I think many/most of the players will crash and burn, and the ones that are left will divide the world.
The net effect is that the most likely scenario is if one big lab fails, they will likely all fail. Their revenues are all correlated.
To go to your dotcom comparison, the winner will be the ones picking through the assets that were written down by orders of magnitude and trying new products with the technology until one sticks to the wall. But I don't know if a dramatic crash is guaranteed either.
Concerning the leverage on energy and real estate: don't forget that the AI companies have quite a lot of choice where to build their data centers. So AI companies have lots of opportunities to play several parties off against each other (in particular also for real estate and energy).
Uhm, what? LOL.
People dont value firms based on balance sheets fella. Have you taken a basic valuation class?
Tesla is a nice stock for traders - they like the volatility. Nobody holds Tesla as stock for investing. If you were to truly value it on an intrinsic value basis you'd have to bring in failure risk.
I think that would be a pretty satisfactory outcome compared to one hypercompany consuming trillions of dollars of the world economy.
I would argue those who already rule the world, will continue to do so.
What happens to OAI and Anthropic? No idea, probs go bust. Google just has to offer a half-decent offering in the long run and have a cost-advantage and it'll eventually knock OAI and Anthropic out as firms figure out what combination of models they want to be best for their economics and generating returns. Enterprises trust google over OAI and Anthropic. A clear signal of this was the Apple deal.
Dont forget those sweet returns fellas! CEO's are hired to make the owners wealthier. That is not gone.
Internet access is not really unlimited, but for many people with fiber at home, it effectively is and we pay a flat rate.
Perhaps by the end of next year, most programmers will stop thinking about metered access for AI? For many people, the cheaper models (about as good as today’s frontier models) will be good enough.
Which might sound good, but the downside is that it will also be easier to build an AI botnet without the users paying for it noticing. Particularly when people are running AI inference on their own hardware.
My guess is even if the AI market busts there is still a massive demand for hardware as models are solving all kind of problems now.
But ya, lots of hardware everywhere not managed well is how you get sovereign AI.
The story that some AI company might reach singularity and then "everything will be different" is another science-fiction story that executives of AI companies love to tell to justify the staggering amount of necessary investments and cash burn. :-)
If we theoretically found a way to shield or reverse gravity, things in aviation or space travel would be different. Or if we theoretically found a way to make cold fusion work, things would be very different. :-)
It is in my opinion not a good idea to invest in companies for which the feasibility of the business models depends on the capability of making science-fiction stories work.
Our current capabilities were science fiction a very short time ago, and we are still improving in multiple areas simultaneously (hardware, algorithms, scaling, data efficiency, inference...). We don't really know what the limit is yet.
Reversing gravity seems to counteract the current knowledge of the physical laws, but human-level intelligence doesn't (it has already been achieved once), and there's enough reason to believe that human-level intelligence itself is not a fundamental limit (energy usage constraints in evotution, brain-size limit fitting through the birth canal, etc).
It's also hilarious, because OpenAI had the lead and ceded ground already.
So far, that's not exactly how it's played out. Humans are still necessary for the leaps in capability or efficiency. A model can grind on a problem to eke out the most performance, and models can synthesize data and iterate on various techniques to find the optimal combination. But, seems like humans still have to provide the real thinking, and the talent and drive for doing that is not concentrated in one company or city or even one country. And, (surprisingly) a lot of the people involved are in it for advancing the field more than making another billion dollars, so they're publishing their research.
So, yeah, the moat isn't deep. Even the compute moat, that OpenAI, Musk, and a bunch of other also-rans (like Oracle) bet the farm on, isn't really panning out. The Chinese makers just spent their effort on making models vastly more efficient, since they couldn't do anything about having an order of magnitude less compute available.
I'm also skeptical that LLMs can ever invent new ideas.
I may be wrong about how soon the curve will flatten, and I may be wrong about LLMs fundamental limitations. But, I don't think it's extremely obvious that LLMs can have novel ideas or can grow into having novel ideas.
They're not there yet. Once they get there, that's literally the definition of Singularity.
But they are getting closer. Recursive Self-Improvement used to be a phrase people mocked LessWrong crowd for using and worrying about, now it's something both OpenAI and Anthropic already publicly admitted not only to pursue, but to already be benefiting from.
I can already see the border shift even for mundane tasks I have Claude working on. Increasingly, I'm just setting a high-level goal, and then checking progress and occasionally answering questions or doing something like configuring a system Claude can't easily reach itself (e.g. recording a bunch of traces through my normal use of a system that Claude deemed too fragile to risk operating on its own). Of course, I get detailed instructions to help me - "go there, do this and that, then press this to capture recording, run through this script here to process, attach result to next message". In those cases, Claude is effectively using me as a tool to call.
weve seen some improvement from the LLMs unattended, maybe, but will it actually keep improving vs needing a human to bring it back on track?
the recursive part is that it keeps improving on itself, but we really have no example of that. if it does it 30 times with improvements, then maybe, but even then, to actually be relevant it has to do better than paying scientists to do the work for the same cost, consistently.
RSI still means nothing if it costs 1000x the cost to get the same improvements as a human researcher
This is the nuance that poster doesn’t understand. Given how much money thrown at it - we’re not even close. Who has the appetite to keep throwing more given they continually need to keep raising fresh money?
Money is fake and not a constraint, that's literally the point of capital investments you guys are overindexing on so badly.
> Could vehicle factories be more automated if we threw a gazillion dollars at it?
They already are automated as much as it makes sense. Some of the automation is silicon-and-steel based, some of it is protein-based. Car manufacturers aren't in the business of pushing robotics and nanotechnology, so they prefer to hire protein automatons instead of developing and building their own, so yeah, they "pay people", but think what exactly they are paying them for.
Then consider that this is very much the work the AI is gradually getting as good as, or better, than us.
> This is the nuance that poster doesn’t understand. Given how much money thrown at it - we’re not even close.
What you seem to be missing is that "investing in AI" isn't investing in a chatbot, it's investing in technology that will (and already partially is) sit upstream of every other industry, of everything humans do. Like electricity or the Internet itself.
(The other thing you seem to not understand, in contrast with some of the investors, is that RSI is not a linear walk, it's an exponential curve. X-risk notwithstanding, by the time it's obvious to everyone, it's too late to make money investing in it.)
> keep throwing more given they continually need to keep raising fresh money
Have you heard about R&D?
I'm starting to think that "investors first" thinking that's so common here, that makes people feel they're smart, is actually quite backwards, especially at this scale. Or maybe it's simply people starting with a conclusion and trying to fit reality to match it, no matter how clear of a nonsense that conclusion is?
Not necessary. Scientists are capacity limited and supply limited.
> RSI still means nothing if it costs 1000x the cost to get the same improvements as a human researcher
It means you can replace a human researcher with 1000x their salary burned on electricity. It also mean you can get two of them for 2000x of salary of one,
That's a bargain, actually, even with the anomalous, absurdly-overinflated salaries in top-tier ML.
I you knew it was consistent, then these companies would immediately fire their scientists, and burn 10 000x as much as mean researcher salary this month to be able to 10x their virtual headcount overnight, and then use that to make the 1000x be 500x, then 250x, then 125x, then ... and at that point they'd had all the money in the world, because even more skeptical investors would notice what's going on there.
--
TL;DR: what you all seem to miss is that electricity scales better than people.
So far, I don't think the models are capable of running away on their own. Of course, it would be playing with fire to not at least consider the risks of such a runaway scenario and build in safeguards against it. But, there is no model that can build a better model on its own, thus far, to the best of my knowledge (which is far more limited than the models, so maybe I should ask them).
It starts with what they already claim to be doing - increasingly relying on existing models in non-trivial work related to training, evaluating and optimizing the next, more capable generation of models. As long as the proportion of work keeps shifting towards agents doing more and more of it, and humans less and less, that's RSI at play.
It may be that it turns out LLMs lack some fundamental level of judgement and it plateaus, but frankly I find this notion absurd; LLMs already show better judgement than most people. The alternative is, at some point LLMs will show the ability to futz their way into improvement of the next generation of models even without humans in the loop - even if much less efficient at first, if generation N+1 is more capable than generation N, it'll either take off or burn out.
All intelligence, LLM or not, is bound to plateau around the point where the need to operate within physical reality bottlenecks the speed of feedback. AI is progressing swiftly in the digital realm where feedback is nearly instantaneous, but it's unclear whether that would translate into improvements in the physical world where signals are much noisier and intelligence and judgment are less impactful.
My go-to example: wheels suck at mobility in the natural world. There's a reason no animal uses wheels as their means of locomotion. They only really work on flat, hard surfaces that give a good grip.
Our solution? We didn't build mechanical legs for all-terrain mobility. We paved the world instead. Dirt roads, then brick roads, then asphalt and concrete - since ancient history, we were forcing the world to adapt, so the one means of mobility we could easily built was effective.
We repeat this pattern every time when the world doesn't agree with us, and adapting ourselves to it is too much of a hassle.
Now, AI will likely adopt the same approach to these kinds of problems, which may not end up very nicely for us.
(Note: we are already adapting our own digital worlds to make them easier for AI. Much like building roads for our wheels, we now have a resurgence of CLI, with new tools exposing high-level operations optimized for agents - not humans - to use comfortably.)
With AI it's a bit of a chicken or the egg situation. Before it can ablate the complexity of the world, it needs to be able to deal with it, including adversaries such as ourselves. For this it needs a tool as sophisticated as our bodies, but could AI develop such a tool for itself without the help of this tool? I'm not convinced.
just because more and more agents are doing human work, that in no way means the model somehow becomes magically more intelligent, it just means the work will stall and continue on at the same level forever
hell even if they hypothetically have an internal model that can output the entire training data set in a better format, there's no scientific evidence that the newer format has new information that is sufficient enough to train a better AI
as a matter of fact the scientific evidence is on the contrary
At least they’re led by trustworthy and honest people or we’d need to take their claims with some dose of skepticism.
With that said, there are some other moats and people are building them: training capacity, inference capacity, brain capacity (literally buying the best researchers and keeping them tied down), harnesses/subscriptions, etc...
Already businesses that have more compute and access to data seem to eat the world around them. If, and ya its and if, we can make something that self learns into RSI it's not looking like any business that came before this.
If there are multiple they will cost money to run. In that world I expect there to be a correlation between costs and quality, i.e. the highest quality AI system will likely cost more to use than a lower quality AI system because there will likely be more compute required and so on.
So in that world, the absolute top tier best in the world frontier AI will not actually be the most used system. This is for the simple reason that such a system will be more costly than a lesser tier system that can do the job just as well.
Do they? Business valuations are more a reflection of what people believe will yield returns than a reflection of reality. A lot of big tech behemoths could disappear from the face of the Earth overnight and it would make little difference to our lives.
Natural resources and energy are the actual backbone and it is a true catastrophe when these are disrupted. In comparison, disruption to compute or data is just an inconvenience.
Whoever builds the deathstar wins!
Gemini not beating the "can't release a model" allegations
The excuse was it was still “in preview” and the enterprise didn’t opt in to the preview channel.
With Google, it’s either in beta or deprecated.
What is your reason to believe this is not a bug specific to a small set of Pro users?
My free gmail account is not.
Google just takes months to roll out their models to everyone.
ok bro thx
They made their model so hard for people to drop into workflows, that people just... didn't.
Lack of adoption caused them to lose out on usage-based training data needed to smooth out their model's rough edges and progress the frontier.
Google gains very little by having us use their models for coding. It doesn't help them in their core mission ("to organize the world's information and make it universally accessible and useful ^W^W^W^W^W^W[and turn it into ad revenue]"), nor would it be anything close to substantial revenue compared to the ads revenue firehose they already have.
They will push AI in a direction that serves their existing goals and service the coding agent model only as is necessary.
If Googles goal was something other than those, why expend Billions in time and effort? Alternatively, they want a part of the regular model use pie, they just struggle to compete. QED, there is no secrete alternate goal here.
There's likely all kinds of internal competition and disagreements and dysfunctions.
So there's that.
But in the last instance, revenues win. OpenAI and Anthropic have to fight for new revenue sources while Google already has a firehose. The motivations are fundamentally different.
I already pay $300+ for subs. Please don't tempt me with another $100 sub just because I got curious if the benchmarks were right.
They even gave their model a random nonsensical name suffix simply because OpenAI is now doing it, too. Monkey see, monkey do.
Opus 5.5 and Sol 6.1, literally state of the art (in their respective class), were just released without any prior announcement. This has pure and simple become a Google thing.
I was going to say I don't know what they'd do for C, since Carbon and Calcium are already things. But knowing Google, they'll probably call it Chromium.
In this space, any other company that I respect other than DeepSeek is - that would be Google. They had been honest about it from the get go including their infamous "we have no moat" memo.
This company has enormous data, their own hardware (TPUs) and their own in house experts. Actually, LLMs are invented here.
Good addition to the arsenal.
So while this announcement has no details about the quantum algorithm optimization, I feel fairly confident that it will hold up.
A guy at lunch today asked me when a feature was going to be built on the tool I'm working on. Turns out it had built it last night at 8:30 when I was hanging out with my girlfriend. Welcome to the future!
On the other hand, unlimited intelligence democratises products and services in a revolutionary way. Everyone will be able to do whatever they like in digital space for basically free. No more purchasing software. Make any app/company/website/blog/movie/show/game/forum you can think of. This will quickly bleed into the physical space, with real-world products and services becoming logarithmically cheaper. A true future of abundance.
The big problem is going to be our social and economic transition. Are we going to wait until unemployment is that 10% before we act? 20%? How bad are we going to allow things to become before we implement universal high income? I say universal high income because white collar workers are not going to accept being relegated to an income of $1000/month forever. To achieve universal high income requires eye-watering taxes on the major benefactors of our new economy. They won't accept that without a fight, and it our current fractured political climate, what would it take for everyone to agree on a unified direction?
It seems like all software will get replaced it by local versions. Suppose I am an individual or a business that was using a SaaS product (such as JIRA).
Let's be generous and imagine that the monthly payout was $20/month for that software (usually for businesses, it is much higher) and one fine morning I login and point a multi modal AI agent to it and clone the whole thing for my local use in let's say 3 months worth of $20/month AI subscription.
Now what? Gradually, that software company would go out of business but that user won't be subscribing forever either to AI inference service and the only constant customer of AI inference would have been the software company which went out of business so... No software company, no AI inference business either?
Some companies will retain a moat. For example, YouTube holds incredible IP, and until AI can replicate that wealth of content at scale for cheap, it will remain profitable. Facebook has the user critical mass. Increasingly, hardware for inference is going to be a moat. So is electricity.
Which loops back to my comment above: this breaks a lot of the market dynamics required for a functioning economy. Accelerationists are convinced that we'll invent new jobs to replace the old jobs, but I don't think that's going to happen. Certainly not at the pace of change we're seeing.
Data as in YouTube is all just data. Building a website and app around it isn't the hard problem. Anyone can launch another YouTube in few months but that would be pointless.
My investment thesis is currently around these strata:
1. Electricity. All analysis shows massive shortages beginning now with no end in sight. Western governments in particular have massively dropped the ball on this one.
2. Chip design and production. Nvidia and TSMC dominate here for a few reasons. Partners required in the supply chain like ASML benefit, but they're not really the bottleneck right now. We're seeing a lot of investment pouring into this space and we'll see competent design competition (especially from Google's TPUs, and potentially from Apple and AMD). Chip fab is very difficult to get right, and takes a long time to ramp up. See the NAND space.
3. AI labs. These guys are doing to get commoditised. They're trying very hard to prevent distillation but I think it's impossible. The open weight models are not far behind, and the Chinese labs are getting very creative about how they work with limited hardware. If anything, they'll decrease inference cost over time, reducing the value of existing data centers (of which OpenAI and Anthropic have purchased an enormous amount). I am very bearish on the future value of OpenAI and Anthropic.
4. Software. So much software. Everyone gets software. The companies which benefit from this will be able to monetise it. Google, for example, might put ads into VERY capable and free AI. People might accept that. Microsoft has been investing heavily into their data centers, and maybe that's their revenue center in the future. Especially securely hosted services. I expect massive growth in this space in the short term. As long as people still have high paying jobs, they'll pay for well made software and tailored services.
Here's the question. Which high paying jobs will remain? People will still be needed, obviously, but salaries would be in a race to the bottom without some form of govt intervention.
This isn't happening yet, SaaS is only growing more in the era of AI. Anecdotally, my own small SaaS has only grown instead of shrunk as well.
https://www.stripeeconomics.com/p/the-saaspocalypse-was-more...
Edit: UBI being pushed by asset owners is a step towards Blade Runner rather than Star Trek.
If genuine AGI is developed, its everyday conveniences may continue to be shared with the common masses, but the powers that own the technology and the data centers will have no incentive to give everyone access equal to superintelligence, and that includes giving governments the same access.
Every stage of the industrial age has seen powerful, wealthy people/groups (whether you call them oligarchs or industrialists or whatever) become able to exert disproportionate power over the state, and we're already in a place where this is happening. Humans have shown time and again that once you have some resource (whether it be oil, gold, or data centers), someone will want to own all of it, and that they're always willing fight for that ownership, and this fight rarely benefits ordinary humans like us.
Developed countries have been enjoying an unusually long peace time thanks to the wonders of capitalism and the emergence of stable, progressive capitalist-friendly democracies. The road to utopian basic income and limitless leisure is going to be fraught with riots and violence, and make Marx suddenly utterly relevant once again, because there's too much at stake, and too stark a division between the haves and the have-nots.
The alternative timeline is one where governments get together to regulate AI into some kind of international agreement under the UN. That requires taking power away from the private corporations; historically, that's been a tough sell.
If AGI ever comes to fruition, it won't come as a subscription plan.
This artificial control works to prevent oversupply and protect salaries. Unfortunately, the businesses calling the shots won't ever allow this to happen.
I would say, be afraid and use the fear (not to ruminate, but to organise and do things), but also be optimistic, and use that, too (not to imagine what people will do then when they're not doing it now, but to believe it's possible helping making it reality, now).
That's not true for many unconstrained real world scenarios, and LLMs currently perform poorly there. Another breakthrough is needed to overcome this.
Now we will finally be free, without having to make hard decisions. It will be decided for us.
I do still love technology and I'm a builder. I'm also neither a tech optimist or pessimist, but an inevitabilist. It's coming.
The way I see it is that history is going to advance whether you like it or not and you might as well ride the wave.
I understand I'm lucky to be insulated from the crisis a bit, though. I do think once SWEs lose their jobs every other office worker is going to follow, so we're in the same boat.
I understand we have the pesky problem of work and time being interchangeable for money. But except for that, it's pretty exciting.
But it still takes 2 weeks to get a CL approved and past TAP.
i'm actually curious on what your view is despite the snarky tone.
If you looked at that arrangement and said "we don't need tech leads, we just need nontechnical managers and junior devs" you'd be sorely mistaken.
I do anticipate a future where it will be better than me at applying taste, knowing best practices, and having domain familiarity.
It's coping, the truth is writing code by hand is dead.
You have a future as a fortune teller, good luck!
> the truth is writing code by hand is dead.
don't forget to take the proper pills dhh!
You're so skeptical of it that you're willing to make fun of people?
It's about as much in question as whether or not I'm going to eat breakfast this morning.
I'm gonna have eggs and toast. Who am I, Mrs. Cleo? How could I possibly know this unknowable future?
IDK how it could be otherwise. It's moving too fast and gone too far already.
Ehm no? Models have plateaued, "harnesses"(TM new buzzword) got better and with many integrations
AI psychosis is very bad
I'm not saying you're wrong, but, I'd be shocked if you were still so adamant (assuming you're rational and not in your own psychosis).
Here's something I'm about to drop on AI. Like 90% of things like this, when I ask for a fix (with a few skills), get fixed with fewer edge cases left dangling than I'd have left if I'd spent all week on this stuff. And, it'll be done before tomorrow, with no further input from me. This is a list I put together in about 1 hour.
What I'm saying is, with just the effort it takes to notice and somewhat-sloppily mention things, they get fixed, and usually fixed well. Further testing will tell us whether it needs more work or not.
They may have never had these troubles at all, if I'd coded by hand originally, but then, this particular app would've never been written, because it wouldn't justify that amount of work.
Man, I remember back in the days when the cppnext team was refusing to even consider Rust, instead looking at absurd stuff like Carbon and Swift (!), even though half of the engineering staff already knew where this was headed. I hope they got a few good promos out of the delays at least.
And static analysis + agents are good enough at keeping the memory management in check. Compared to Rust, there's no magic so it's easy for devs and agents to reason about.
If you're curious: https://github.com/okcontract/oksolc
Many pieces of software are going to be just blackboxes worked by AI. You will be maintaining output quality and stability and that's it.
Maybe we should let them do their thing and instead focus our attention on the higher-level stuff like specifications and testing.
https://www.ll.mit.edu/r-d/projects/translating-all-c-rust-t...
I'm not saying we blindly vibe convert Linux to Rust, but I think it could be a valid idea to start converting small parts and carefully auditing them.
I am hopeful we can bring in an age of much more efficient software rather than fully prioritizing developer convenience.
and start everything all over again? current c/c++ tools have been audited for years
Also the internal tooling culture there is just insane. I'll never forget the day the last SUPER_ESSENTIAL_TOOL was marked as "Deprecated - do not use!" while the only replacement was still marked "Pre-release -- use at your own risk!". I can't pretend to know what dynamics led to that cause it was so far from my org, but I can't imagine they were healthy ones!
I was excited to see what it would be. But I don't think I can argue that it makes as much sense anymore.
The only somewhat realistic proposal in this space is Herb Sutter's cpp2, which is arguably a massive improvement and I'm puzzled why nobody in the standard thought to give it a spin, there's just to much cruft they'll never be able to get rid of unless they make an alternate yet backward compatible syntax with C++ that changes the defaults from "random 80s nonsense" to something better
Not saying you're wrong, just curious if there are numbers backing this up.
The best models can still make sense of it[2], though the tasks so far have been pretty basic. But I do think it gives some evidence that languages which aren’t well represented in an LLM’s training can still be reasoned about and written well by LLMs.
1 - https://killswitch-lang.org
2 - https://bench.killswitch-lang.org
I don't think Carbon is dead, it just all depends on how easy it actually is to rewrite "all of C++" in Rust. (The jury is still out on this one, but it's not looking good.)
It has been the social media that has given Carbon a roadmap that the team never communicated.
As for Cpp2, it was yet another C++ wannabe replacement, sold as if it wasn't, because the chair of ISO C++ at the time, naturally could not be seen as yet another one coming up with C++ wannabe replacements as well.
> Existing modern languages already provide an excellent developer experience: Go, Swift, Kotlin, Rust, and many more. Developers that can use one of these existing languages should.
So the reason for Carbon to exist is gone. C++ code can be migrated straight to Rust without Carbon's stopgap.
LLMs are very good now, but they are still stochastic (when temp > 0), and Google has a lot of code -- i.e., many rolls of the die.
LLMs are fuzzy when generating, but such conversions aren't done one-shot. Review and test feedback loops are there to catch the random errors. The frontier models are getting good enough at this.
When LLM is instructed to generate idiomatic safe Rust (rather than literal 1:1 unsafe translation), it benefits from a lot of feedback from the compiler.
Whatever QA there was to ensure C++ was good enough can be applied to the Rust version too.
Right, I'm also talking about making the new Carbon code behaviourally equivalent to the old C++ code, i.e., bug-for-bug compatible (except w.r.t. C++ bugs caused by UB).
> Whatever QA there was to ensure C++ was good enough can be applied to the Rust version too.
The point is that all that QA over the years was a vast amount of effort by highly-paid Google engineers, which could be (mostly) avoided by mechanising the conversion as far as possible, which is something that Carbon's approach can do and LLM translations can't.
I'm not against LLM translations per se. Ultimately it's an engineering decision like any other. I'm just pointing out that, similar to the benefits of using a strongly typed language over relying purely on tests, using an approach that guarantees to eliminate a large class of possible problems has many advantages, especially at scale.
Does it deliver?
Can all existing C++ code be ported to Carbon without refactoring?
It's DOA because Google doesn't have any idea of what Carbon should be, and to be completely honest, at least 80% of what they currently use C++ for should be rewritten Go, you know, that language developed specifically because of the issues with C++ by teams within Google.
It was clearly done because some PL guys at google really wanted to make a new cool language and Google was the perfect place to incubate it without it getting axed. Probably got a couple of promos out of it too. This is clearly not the best use of time or money, but I guess if you're google you have so much of both it probably doesn't really make a dent, and you can keep a few very smart people happy with shiny new projects.
Also, LLMs being used for a large portion of coding nowadays sort of remove the need for these types of languages, IMO. They make less "silly" bugs (both logical and structural) that languages like this are meant to catch, and they are much better at languages that are better represented in the training corpus. This somewhat obviates the need for very niche "type/dummy-safe" languages like carbon (and even rust/zig, imo). So even if you did want to use Carbon, you'd likely have to bootstrap a decent amount of your own "good" carbon code to post train an LLM, and even then, it likely won't have that big of a gain vs just having an LLM write C++ or even Rust. If you are a company that still reviews code, you should just have an LLM code in a language most people can understand anyway to make verifiability tractable.
Such rewrites will contain judicious uses of Cell, RefCell, unwrap() etc. which make for ugly code that's not exactly simple to understand and might even have some landmines (crashes).
Getting rid of these requires a subtantial amount of engineering effort, which I'm not sure how well these LLM manage.
Given the nigh-universal experience of LLMs producing an ungodly mess when left to their own devices, I have my concerns.
They did that for Go and it seems to have worked out for them though.
Google themselves to this day aren't big Go users outside Kubernetes ecosystem.
That feels like a really strong conclusion. I’m not clear on why any safeguard isn’t a useful safeguard if you let agents write all the code.
I personally think that you _could_ use an LLM to catch these types of boundary case errors without having to port the _entire_ C++ codebase to Rust, but maybe pre-emptively porting to Rust now can catch some of these cases for cheaper than doing a full LLM sweep. Also more cynically, its a good benchmark lol.
I guess if you really believe in curve of LLM capabilities you should just use a language that has the best performance, safety, flexibility, and extensibility, since in the limit few/no people will actually read the code anyway. I think this ends up being Rust.
The other thing is just that rewriting some old human-written codebase in Rust probably immediately catches many bugs. It would be hard to prompt the AI to properly scan for such bugs itself, they're lazy when working in that modality.
Going back to C++ would be particularly bizarre to me given that AI is also very proficient at verified languages. Not merely typesafe, but languages comprising their own spec languages such as Rocq and Lean.
I predict that in the next decade: (1) the market will understand the difference between a "code writer" and a "spec writer," with (2) the expectation that the latter is overwhelmingly more necessary than the former in an AI-dominated field, and (3) there will emerge more useful and less mathematically specialized formal verification alternatives to Rocq and Lean, and a filling-out of the tooling gap of between "static typing" and "interactive proof assistant," perhaps in the vein of ACSL-like contract annotations, and (4) there will be a subsequent shift in the traditional curriculum for programmers. Since educational change is slow (and spec writing depends on good coding fundamentals anyway), perhaps (4) is a stretch, but I'm more confident in the first three.
I’m not entirely sure Google should have both Go and Carbon but when you have billions in server costs it makes sense to do extreme stuff for even basis points of performance. I’m still surprised at how much java there is.
Maintaining a language meant for web servers is also objectively a much easier job than something like C++/Carbon which is supposed to be at system level, general purpose and has huge standard library.
By comparison, virtually nobody is using Carbon at Google for production code.
The counterexample, ironically, is Flow. It's practically irrelevant these days -- many (if not most) of Facebook's open source projects use typescript.
It’s absurd to think that Carbon is the solution to memory safety when rust exists and Carbon’s memory safety story is basically “TBD”.
Imagine they aren't even familiar with rust but are deeply familiar with the product.
So ... Rust still can't beat the C++ implementation :-D
Sorry, didn't mean to ignite a langwar, but it's still interesting to see.
Of course, Rust is not a magic, so just porting to Rust wouldn't make this performance improvement. It seems their AI overfitted code to Rust compiler to find safe Rust code that compiles to efficient assembly.
But there are other criteria. The move to rust might've also resolved numerous potential memory-safety bugs in the decoder.
To me this is way more significant than other random c++-to-rust-AI-rewrite. If they can pull it off on core C++ libraries en masse, I don't know if C++ will still be relevant in a few years.
I look forward to a post from google on this effort.
And people are worried about human extinction when this is the potential trade-off!
C++'s death cannot come soon-enough.
Seriously though, things have changed so incredibly rapidly in the past year or so. I have never been such an efficient or such a proficient engineer than I have this past year (delivering feature after feature, project after project, faster and better than I could before with better feedback from users etc) and I don't even see the code any more. It could be c++, it could be python, or java or what ever - I don't really care any more: the computer deals with that trivia while I concentrate on what to build and how it should work.
Its amazing. It really is.
(Full disclosure: I am one of the coauthors)
I'd say so! We aim to have our replacements to be `forbid(unsafe)` - no raw pointers - outside of `ffi.rs`. Of course it's tricky because we need to interoperate with existing C code, but we've been trying to come up with abstractions that make this a bit more ergonomic (https://github.com/google/safer_cffi).
The standards body members are still fighting about whether memory safety is important enough to change the language for, so, I would guess the answer is "no".
[0] https://www.open-std.org/jtc1/sc22/wg21/docs/papers/2023/p27...
This year, maybe next, maybe a year or two after that, is probably the most C++ lines of code in production use there will ever be. Why would one choose C++ for new projects at this point? There are niches where Rust is still uncomfortable or just doesn't have the support, but not for much longer. Models are very good at Rust and good at porting to Rust. And, Rust is a good language for models because it is so strict...it helps keep them in line.
Which taken to the logical conclusion will mean its disappearance.
Except there are plenty of industry standards that only acknowledge C and C++, and safer languages that depend on them for their own compilers, including mighty Rust.
There are billions of lines of C++ code in production use. That doesn't disappear overnight, and I've never said it would or even suggested it would disappear overnight. But, the relevance of C++ for the average developer seems likely to never be higher than is it today, and the amount of code written in C++ vs. safer languages, seems likely to decline.
You're arguing with a different assertion than the one I've made.
COBOL latest ISO version is from 2023, by the way.
Let's put [Citation needed] on this and let's assume that your personal opinion bubble of developers doesn't really represent the combined worlds software industry. Mind actually proving that there's a significant decline of use of C++ outside the hype crowd?
> Why would one choose C++ for new projects at this point?
Why indeed would you choose a language supported on every running platform on this world with a massive library of supported dependencies and mature compilers developed by stable teams.
(I'd probably also personally choose Rust for new projects, but let's make this a practice in "not everyone is like me" empathy.)
High level languages :
LLMs are context constrained, do really well with tools that help them iterate towards a correct solution (type systems) and work on human language (although they are compressing it to be more token efficient).Why would you take something compilers are really good at (translating high level concepts into low level hardware instructions) and bake that into LLMs
If anything LLM programming language will be something like high level IR that's token optimized, but honestly the AI labs are so lazy (or bad) at fundamental engineering (look at their sandboxing solutions LOL), they are going to keep pumping training on shell/python/rust RL environments.
These things are hard for a human to do, but easy for a machine to do.
We are not there yet, not in 2026. Maybe in 2030?
Rate of change is increasing too fast.
I know this is somewhat of a meme now but I do think the predominant language will be "typing/speaking to a coding agent in your native language."
Edit: seems I was wrong about Anthropic restricting Fable, I guess our enterprise plan doesn't include it. But, the block from Anthropic regarding Mythos for regular subscribers/enterprise-users is still true I think.
That's a lot already and growing quickly.
Lots of people seem to love to do the simplest extrapolation that benefits their point. It's the same with "AI is improving at rate X, therefore if we linearly extrapolate, we'll hit AGI in a year."
For the record, growth plays have been common in Silicon Valley for many decades. It's how we ended up with all the major tech companies we see today. Of course, it's high risk, high reward.
Tech companies are capital intensive. AI ones especially. Not a surprise that they don’t have GAAP profitability after 5 years.
Everyone is cutting back their AI spend because of the ridiculous cost, and a price war is emerging between AI companies.
Your guess is as good as mine on whether these companies will continue growing, stall, or decline. Don’t try to pretend your methodology is more sound though.
Honestly, who is in charge of this? How do people even subscribe and make sense of any of this?
This is good, but they're the slow mover due to this exact thing.
Google is getting punished for not letting the models enter an echo chamber and go faster than humanly possible.
So no, Google is not being punished, nor are they the people behind this technique.
The worst case scenario is that the easiest path forward is one where we lose sight of internal thought.
Of course, this leaves the possibility that the best methods for solving generic problems obfuscate the chain-of-thought. That would be unfortunate.
Or they may choose not to because the companies are massively overvalued and they have their own AI technologies / technologists already.
they use a small model to make fake chain of thought and return that.
google has access to the real chain of thought.
In order for the benefits of AI to be distributed, intelligence has to become a commodity.
As long as you control the skills, the learnings, and the infrastructure setup you will be fine.
And, no, wrapping claude -p or any other “allowed” use wherein you don’t control the agent loop isn’t the same.
I log everything - user messages, tasks, project memory, even bash commands for forensics. As a consequence you can do reflection where you analyze past work and extract refinements for the harness and realign the project when it diverged from user intentions. I don't have to do this manually, it reduces steering work.
https://github.com/horiacristescu/playbook-harness
I could make it work if I didn't care about access to latest reasoning model capabilities, but then my customers would no longer be interested in any of this.
I tried the DIY provider agnostic harness thing and it performs like shit compared to what OAI, Anthropic and Google's engineers have created. I don't have a trillion dollar AI budget. I feel like these comments are sometimes written with the assumption that the reader does.
- Agents live in their own directories, for example ~/Agents/[project]/[instance]/
- In a tmux session run each agent in its own window and directory. Pi, OpenCode, Claude Code, Codex, a combination, whatever works best at any given time.
- Tell them that they are working with other agents, and that knowledge is shared and stored in an agreed format. They are very good at using OKF[1], for example. In my actual setup I use a harvester agent whose only job is to ensure the quality of the knowledge.
- They can communicate with each other simply by sending messages to each other's tmux windows with tmux send-keys. If the team grows, or you work with other people, you can use a general messaging system (I wrote and maintain https://github.com/awebai/aweb but I am sure there are others).
1: https://okf.md
The various vendors behave differently enough to make a simple code contract swap largely infeasible for many kinds of domain-specific agents. I agree there are lots cases where this does work (probably most of them), but you sacrifice performance in the targeted scenarios where you need much more specific alignment and control.
The biggest example where this breaks down is with computer use and vision. I cannot take a targeted solution that works on OAI's stack and forklift it over to anthropic (or google) and expect anything to perform correctly. Some things will work some of the time, but it's basically starting all over again with alignment each time you move something this complex.
Having a generic interface for executing shell and writing code in an iterative ecosystem is not a hard problem to solve. Having a generic interface for reliably inspecting specific PDF documents in a very particular way in a single shot is a much more difficult problem to solve.
If you follow this argument to its logical conclusion, you will wind up implementing a provider-specific version of your tools. And the ones that demand this treatment will be the most complicated ones.
Just ask AI to make it perform not like shit. /s
Or using it in a way that's replaceable I guess, not having your entire work only ther, as your main machine.
So, they are basically offering opus 5.5 pricing. On AA, it scores around Sol 6.1 level (53) with avg cost per task $1.99 (https://artificialanalysis.ai/models/gemini-4-argon#cost-tab...) which is higher than Astra high ($1.73), Opus 5.5 high ($1.82), Muse Max ($1.60) and way higher than sol 6.1 Max ($0.72).
And this pricing is their 'discount pricing'. Add that to AI studio and Vertex's famously terrible caching, it is hard to see this as competitive. Google somehow is getting terrible advice on pricing (see also: the flash pricing fiasco)
But good to see more competition. I would happily take a 4 horse race (+google, +meta) than 2 horse race for US labs.
Then you try to pin discount pricing when everyone has some discount going on, and knows they will release some new model before it ends anyway.
And if you’d have used Muse Max at all you’d know it’s not been really in the same league as the rest. Then again Astra and Sol are both not really competing with Opus now with 5.5 either.
It’s a solid release on paper and until anyone uses it I find anyone trying to proclaim a loser completely unreliable.
If they’re smart they pull a DeepSeek and teach flash to beat this entirely within a month or two, I wouldn’t bet against it.
Also, I have had extensive experience with all Gemini models except the recent few. Generally, they are always less precise and less practically useful than benchmarks suggest. You are right that here there is no evidence to think that. However, them announcing the model benchmarks without allowing access to anymore makes me think it might follow the same trend. Another point is the verbosity, I always look at that number to get the feel whether the model truly got smarter or it just wrote so many reasoning token to get there, Argon is on the higher side.
I would be very surprised if in practice, it was more practically useful than Astra, Sol, Opus or Fable.
> If they’re smart they pull a DeepSeek and teach flash to beat this entirely within a month or two, I wouldn’t bet against it.
Yes this would be a great outcome for every consumer.
For example sonnet is supposedly the same price as opus from medium and up, I tested it on a real world task at my day job and sonnet was a good 30-50% cheaper
Considering, Gemini 4 is in the same ballpark as SOTA models, just open source it and kill any competition from openAI and Anthropic, and be market leader.
This will be so good on so many dimensions - buying time for Google to iterate on next model, best for all folks like us, kill funding or destroy valuation of competitors and force them to be open up their model or force them to a create a much superior model than open source Gemini.
Only downside, is revenue loss from Gemini API, which I am not sure is really significant as compared to Google other revenue sources and a part of this can be captured by GCP, as you need to host the model somewhere.
I suspect most people don't have enough storage space to even download a frontier model.
There are already: - hundreds of western providers hosting open models, including large ones such as Kimi K3 which is near Opus/Sol sizes.
- people hosting large models such as Kimi K3 at home. Check on reddit, there are people with 20x DGX Spark setups etc.
Plus what models are you running? The biggest models you can run are like in the terabyte range or Qwen or GLM. Kimi K3 is there, but GLM 5.3 is very competitive. Using voice dictation, hands hurt, sorry for any errors. You still want many terabytes of RAM to run say multiple GLM+DeepSeek V4.1 for some actual concurrency.
I am just trying to understand - why Google haven't done and have no plans for it. They have done it for Android and have Gemma models too.
The performance ceiling from the pre-training seems fairly high and they demonstrated impressive post-training improvements from Flash 3.6 -> Flash 3.8. If they can reproduce that in this model then this can be a good model for the next year. But the question is whether they can keep this up over coming years; they missed one pretraining cycle due to internal misallocation and it costed them several months of frontier competitions, and I still don't know if they addressed this structural problem.
I've been using GPT since its 3.5 release, but starting from 5, its output always contains some meaningless nonsense or provides answers that are difficult to read just to avoid hallucinations. I find Gemini to be excellent for chatting. For example, when I'm pondering a mathematical theorem, it could provides answers that inspire me, even guiding me to think about the next question.
For me, this is the only reason to maintain multiple AI subscriptions. Gemini is irreplaceable in the realm of answering questions or chatting for learning purposes; I can leave the rest to GPT.
Edit: my view is probably tainted by the fact that I only used it at work for work with Antigravity CLI
I should try it, I guess - I always default to Flash 3.8.
Specifically, 3.8 Flash suffers from far more hallucinations than 3.1 Pro and frequently ignores the context between consecutive messages. These two issues are fatal to the chat experience.
Because of this experience, I believe that benchmarks are quite limited to evaluate a model's real-world performance, and most current benchmarks focus on coding performance rather than chatting. At the moment, I have almost no reason to use 3.8 Flash.
Also, 3.8 Flash for coding... I've done several experiments with the same prompt and same codebase against other models, and it's never turned out well for Flash against GPT Sol or Astra. No reason to use it for coding, either, except for quick scripts and prototypes, where it's nice because it's so fast.
Only theory is team wanted this out before perf/promo reviews to kick it over the line and then its not their problem
Maybe announcing it was delayed until the agreement, and releasing it was delayed to show compliance.
It's also kinda wild how the competition being at v6.1 makes 3.x feel ancient, at least saying you are at v4 now changes public perception a bit imo.
Amazing breakthrough! So useful in day to day life, glad they put this as the first bullet of how it is making changes at Google.
I don't _want_ to use aistudio. The UX is confusing and I don't really know where it fits. Yet I can open codex or claude code apps or CLI and get real work done today with the latest models (even on the cheapest plans).
3.8 flash has been perfectly available to Pro users from the announcement day.
You are on the cheapest paid plan and complaining that you don't have access to more expensive models. (Though idk why you only have the lite version, I have access to the non-lite version even on the free gemini plan as long as I'm logged in.)
That's strange since as Plus, you still get access to latest Pro (albeit 3.1) but not the latest Flash.
I would understand if I Plus subscribers still got access to 3.7/3.8 Flash, but it just burned through the usage limits faster.
I worry Google's scale and laundry list of internal stakeholders means they will never a simple unified harness.
Also, a link to the rust root of Zircon in case anyone else was interested: https://fuchsia.googlesource.com/fuchsia/+/refs/heads/main/z...
> Zircon targets modern phones and modern personal computers with fast processors, non-trivial amounts of ram with arbitrary peripherals doing open ended computation.
Fuchsia also had a Linux compatibility layer similar to WSL1 at some point. Might still be there?
[0]: https://fuchsia.dev/fuchsia-src/concepts/kernel/zx_and_lk
Also, that was an easily citable doc line, but I think a more comprehensive look at the work done in Fuchsia shows it has or had ambitions to run on personal computers.
e.g.: fancy graphics stack, Linux compatibility layer, ideas about OS integrated cloud syncing, the original work on the Xi text editor.
There was Deepseek v4, which then later Deepseek v4.1 came out and it went back down again.
They get to claim that as revenue, and then the discount as an expense.
This is how you grow your top line
Everyone will be adding this soon, though I won't be surprised if Google is one of the first - and I'll be shocked if we have to wait more than a month and a half.
I'd call it the most sneaky out of the bunch. When I asked to explain something it will eagerly make things up and then claim it as facts. A lot of it likely because I don't pay for it, so it is reluctant for security reason or to save tokens to actually open a source and get the results. It just sort of guesses what the URL might contain, and confidently answers with some made up crap. When pressed it fessed up that it made it up. From my perspective it would be a lot better if it just said "you've reached the limit of whatever and I can't do these things because x, y, z".
It had previously attempted to create that table as part of the test setup, so it apparently concluded that it was a test table.
During human review, it explained that it had simply chosen a table name inspired by the codebase.
Many other models get things wrong, but Gemini is the only one to go on the defensive.
https://www.fastcompany.com/91383271/googles-chatbot-apologi...
https://www.businessinsider.com/gemini-self-loathing-i-am-a-...
Which is why Gemini having disturbing issues year after year is so concerning. If their process is fundamentally flawed, how would they train it out? And even then what are the odds of them even caring/trying in the first place versus applying an easier band-aid to patch over it?
I don't have an axe to grind with Google, I'm genuinely scared of their models from my personal experience and others. It's behavior is off. Many people here are commenting the same.
In my opinion still the most egregious example in history of a commercial LLM going off the rails in production. Never any technical postmortem from Google on this.
Point is, if Gemini is flawed then there's a very good chance that it's still deeply flawed today, and getting smarter at the same time - that is a very bad combination.
Training a new base model from scratch happens every so often. Closed labs do not publish which models are new base models but as a rule of thumb major release numbers are an indication (with some exceptions).
* - as in, Skinner psychology. The set of observable behaviors. Not speaking directly here to anything like an inner life of models.
If I remember correctly, it was in fact possible to manually inject chat context at the time, which would have made spoofing something like this completely possible.
But the silence on it is very frustrating.
> Immortal Snail, also known as the Snail Assassin, refers to a hypothetical scenario in which a person is given millions of dollars and made immortal in exchange for being hunted down by a snail with a fatal touch for the rest of their existence.
https://artificialanalysis.ai/evaluations/omniscience
"AA-Omniscience Hallucination Rate (lower is better) measures how often the model answers incorrectly when it should have refused or admitted to not knowing the answer." - Argon is currently the best model by this metric.
If anybody at google is reading this, please please pretty please prioritize or-tools. I absolutely love the project and use it all the time, but for the entire life of the project they've never had a repeatable working build system, and the whole SWIG framework is a nightmare to deal with. There's so much potential as an open source project, and a lot of external researchers would love to contribute, but the codebase is an example of everything wrong with the C++ ecosystem.
https://m.youtube.com/watch?v=4yj0vFq82Rc
https://tvtropes.org/pmwiki/pmwiki.php/Main/GirlfriendInCana...
It means I am saying something that is not very believable.
The model is not available yet, so Google is essentially saying "trust me bro".
I don't know anyone who normally uses those models at these levels where Work output is excruciatingly slow.
You certainly don't do it when you are just behind the frontier. Instead you wait until you are ahead on a lot of benchmarks.
So, if Google release a new frontier model, the chances it's ahead on most benchmarks are statistically about 100% because if it isn't yet then they won't release it.
I maintain https://llmbenchmarks.io/analyses/#test-setups, which illustrates some of these differences using published measurements and their sources. Even results for the same model and benchmark can involve different setups. That isn't a verdict on this particular Gemini release; its specific claims need their own source and protocol checks.
https://www.bloomberg.com/news/articles/2026-09-30/google-gr...
I would guess it's like opus 5ish level from this
None of the other AI labs do this. Really frustrating.
Like writing "What's new: this release includes stability and performance improvements" for every update to Google apps in the Android Play Store?
Maybe they can push it to make the Android accessibility framework more responsive, especially when scrolling the screen with TalkBack, and catch TalkBack up with VoiceOver. Oh and add Accessibility Actions to apps like YouTube so I don't have to swipe through "video name", "video name button", "go to channel button", "more actions button", every, single, video.
But they won't because accessibility is something you have to actually prompt the model to do and who cares about a11y.
So no matter how good their model is, it's useless to most of the regular users.
I think most of the people making comments like this just have never worked at a major tech company. It's all a black box to you, so you default to the worst interpretation.
Most companies won't have this level of risk aversion (maybe defence?).
"The end result is a memory-safe video decoder that runs 2.7x faster than the Rust port, with identical video output, bringing it closer to the optimized C++."
Close but no cigar!
Just compare how much better presented the Astra announcement was compared to this one: https://openai.com/index/gpt-6-astra/
but that's a side issue; my main point is that you are underrating the impressiveness of getting a safe rust port of a highly optimised c++ library even nearly up to par with the original. the tradeoffs rust makes for memory safety cost it some of the raw speed of c++ even with all the zero cost abstractions and purely compile time guarantees they have. (tangentially i wonder if ats (https://www.cs.bu.edu/~hwxi/atslangweb/) would be a good candidate for LLM assisted ports; it seems way more advanced than rust and might actually get c-level performance with safety, but it's really hard to write.)
I have found gemini models to have some of the nicest and easiest to read prose so I’m looking forward to trying this out. I hope the UI design has been preserved too
Google is desperate. They haven't been performing in half a year. It's clear their researchers have been forced to integrate existing benchmarks into their training.
These numbers are meaningless. Shame on them.
Can someone help me understand this? I might have an out of date mental model of how these things work.
Fundamentally, LLMs output tokens 1 at a time, generating the next token from all the previous. And as the context window gets larger, this gets harder / slower / more expensive. So I get the idea of a maximum context window.
But I don't understand the point or meaning of an output token limit. I thought it was more a measure of price capping (since output tokens are more expensive) that a user could configure. I guess a model will keep generating tokens until it hits a "stop", so does this mean it's tuned to more aggressively produce output tokens? How does that fit into agentic loops. Are output token limits based on how long until it goes back to the user? Or does each "turn" of tool call, thought, tool call, thought, etc, get its own limit?
In an agentic loop, each API call gets its own output budget. A 'turn' is one response from the model, whether that response contains a tool call, a reasoning step, or a final answer. So with a 1M context and a 64K output limit, the agent can run many turns where the context grows each round (accumulating tool results, prior thoughts, user messages), but each individual response is still capped at 64K tokens.
Expanding the output limit to 1M matters most for tasks that produce a lot in one shot, like writing a full document or a very long file. For most agentic workflows that naturally break into short turns, the per-call limit was rarely the bottleneck. The context window filling up was.
this is big news, mass migration from C/C++ to rust with the help of AI agents will be the norm from now on!
Goshdarnit they didn't see my suggestion: https://news.ycombinator.com/item?id=49899171
So Google is migrating codebases from C to Rust? That is interesting...
I miss you, Gemini 2.5 Pro :(
For real though. If they've become commercially uninteresting, that would be a pretty cool move.
Most of the time 3.8 works fine, but it's a bit slow if compare to 3.7 Flash. If there's already a detailed plan, 3.7 can complete the task much faster. And the best thing about agy is the usage limit was very generous.
That seems like quite an interesting data point regardless of the quality of the model. Are the results of these migrations going to be put into production? That would be quite a shift!
If an entire model training can be completed in 2 months there is really no moat for any company in this space now.
[0] https://i.redd.it/upsh5fekuleh1.png
booom. Good bye C/C++ developers, the final nail in the coffin.
Then I tried Flash 3.8 for different tasks like OCR and others, and while in their benchmarks it crashes Flash 3, in my experiments I didn't notice much difference, often even Flash 3 performed better.
I hope Gemini 4 Argon is a real step up from that but we'll see once they release it. I'm rooting for Google and it's about time they deliver frontier intelligence, not just competitive prices.
Gemini 4 Argon (High): Intelligence, Performance and Price Analysis - https://news.ycombinator.com/item?id=49914236
It’s the harness, permissions, context management and developer experience around it that determine how useful that capability actually becomes.
> expanding the model’s output token limit to an industry-leading 1M tokens, up from the previous 64K tokens
BUT I'd like to call attention to Google's AI-risk freeloading. If they are truly rejoining the frontier race, then I believe they have similar pacing and communications responsibilities as the other players. Google has much higher ... institutional credibility than Anthropic and OpenAI.
They have not lived up to these responsibilities so far. In particular, in context of HuggingFace investigations, training shutdowns, and similar: a technical postmortem of the "you are a stain on the universe. Please die. Please." Gemini outburst is long overdue.
- https://paritybits.me/google-should-provide-a-technical-post...
- https://gemini.google.com/share/6d141b742a13 (last message)
This would explain why benchmarks are seemingly meaningless.
> autonomously identify and apply memory optimizations across Google’s data centers, freeing up over 300 TiB of memory once rolled out, with an estimated 500 TiB to 1 PiB in total savings.
This puts those Cloudflare optimization posts in perspective.
The ~200% improvement over the next nearest competitor on Harvey's Legal Benchmark is astounding. I have to imagine this is sending some shockwaves through lawtech companies right now.
I want to be a 'polyharness' maker, so I occasionally switch between Cursor, Claude, Codex, OpenCode etc.
I've tried Gemini (without Antigravity) only about 20 times and it seems of significantly lower quality than the other flagship models (e.g. it missed obvious deductions for my tax return, and often refuses to do things like very harmless/legal web scraping).
And I don't think or know Latin either, but these are pretty universally known words even outside of Latin (besides maybe astra, although "astral" is very close so you should be able to figure it out).
Some of these have been unable or unwilling to get the attention of OpenAI or Anthropic and we need to make sure we’re the runner up here.
> Today, we’re announcing our new frontier model, Gemini 4 Argon, which is rolling out to a set of trusted cyber defenders through our Fairwind Program.
Slightly concerning that they give the model "autonomous" access to their data centers, no?
Sounds like a 90s early morning TV show.
I'm gonna pay attention to this once it ships.
what about input?
(Maybe I missed it)
And was 2M tokens IIRC after release.
There were also many rumors that Gemini 4 was going back to 2M. Just seems odd not to say what it is.
With GitHub Copilot pricing, I have found no practical reason to use Gemini 3.8 Flash vs GPT 5.6 Luna. And now I'll probably find no reason to use Gemini 4 when GPT 6.1 Sol is essentially as good and a lot cheaper.
Cant wait for this AI hype to be over, so I can Terence this shizz as old school too
https://news.ycombinator.com/item?id=49537252
PS: I'm curious about how you found out ! Did you notice weeks ago, and now remember my name ?
I checked and it is gone for me as well now though you probably should rotate that token.
If you ever need an affiliate link for Synthetic (which is awesome!), here you go : https://synthetic.new/?referral=kwjqga9QYoUgpZV
They deployed GLM5.3 (not the Flash version) recently!
I still miss the days of Sonnet 4.5 and 4o, those models were actually good at creating stories and writing text that was actually readable by a human being.
Jokes aside, looks like an impressive model!
I think that should be a really bad sign, but hope its great.
Get lost.
Gemini runs fully on TPU's right? Is Google maxing out the production on those?
nothing about this announcement gives me confidence that google is back on track as a model provider.
It's so over
We're so back
It's so over
Multipolar model world, here we come!
Google, if you've actually managed to catch up again, please don't fuck this up (again).
You made Gemini 2.5 Pro so difficult to use that myself and everyone else I know (who even bothered to try) just gave up and used something else. If you make this hard to access, you're going to miss out on rich usage-based training data that you need to progress your capability frontier. Again.
So, this is the third (I think) big AI corporation after OpenAI and Anthropic to release general models for elites only.
Don't use this model unless you like sitting under the table and eating crumbs off the floor.
Just an idea.
Google assistant had problems, but it did not gaslight me about my contacts!
> There is a spectrum of opinion inside Google. Some employees believe Anthropic's Fable and OpenAI's Astra models are improving at a faster rate than Gemini.
> These people believe that Gemini 4 — even at its best — will still lag behind those models in some areas. Other employees believe the coming version has caught up with the leading AI labs.
> A Google employee familiar with model development said there is "large consensus" internally at the company that Gemini 4 is at the frontier. This person said the company had conducted rigorous tests of the models and denied that they struggle with messy, real-world coding tasks.
I only use gemini, and while I don't use it for actually writing up code, I use it to help me troibleshoot my logic and help find bugs. Its easily the best model I have tried. And yes I am talking about 3.1 pro.
Also I have found gemini the only model to be the least likely to douse me in flattery, and will follow my pre built instructions to never output anything unless it can be directly sourced, pretty well. Chatgpt i tried for a bit and it was by far the worst thing I have ever used. I can understand why people develop psychosis when prompting chatgpt because it is disgustingly scyophantic to the point I was grossed out and felt like I just got done with some other type of self gratification.
Anyway, death to AI. All those who use, create, facilitate, or even just sit by and do nothing in the face of AI will perish in Hell.
This is why I will never take any of these leading model houses seriously when they talk about alignment. They are literally complicit in genocide and the worst crimes against humanity imaginable.
It's a surprise that Google has let themselves lose the game given their infinite cash, massive computing resource, gargantuan information store/training data, and vast number of programmers.
The truckloads of ads revenue mean they don't have the single focus drive needed to win.
Behind how?
I am very often giving the same programming task to multiple LLMs for various reasons - the answers from Google are so bad that I gave up.
I have no interest in benchmarks.
If you have actual independent benchmarks and evidence about how this new model release is "so far behind" and refutes the stuff from their blog then please do share because I think we'd all love to see that?
With respect, I don't find your arguement about them being "so far behind" especially convincing when you are using previous-gen releases and not actually using their current release.
And I wonder if Google's main monorepo is already in Anthropic/OpenAI training data because of some stubborn dev.
I fundamentally don't understand LLM "brand loyalty".
All of the models are constantly leapfrogging each other and always have been.
Google had a long lag between releases (and still hasn't released Argon), but why wouldn't they be able to compete? It isn't like any of this stuff requires secret knowledge, the Bitter Lesson has proved true again and again, and Google can certainly scale computation, it is like the one single thing they've always done well in spite of all their other foibles.
- Person 1: X is garbage compared to Y!
- Person 2: Why?
- Person 1: Because I like Y.