Zvi Mowshowitz

OpenCode is currently under a sustained cyberattack, and mid-incident they ran into the same problem Hugging Face did: the frontier models they were using for defense began refusing to help fight attacking agents because analyzing the attacks started triggering safety guardrails.

i used AI to reverse engineer the block blaster mobile app.

Can someone tell me how a company that is targeting the biggest IPO in history at over $2 Trillion can have it's bonds rated a "junk"? And if bond investors don't even view this as Investment Grade worthy, why should equity investors?

Fundamentally, trying to automate alignment research points an objective at "convince the human" for the AI to optimize for. If this plan was to be taken even a little serious you'd expect the AI labs to have very seriously thought about solid metrics and benchmarks that aren't just going to get goodhearted immediately. Instead we will likely see a last-minute vibe-coded "alignment solution" born from the lethal arrogance of the AI lunatics.

Big news. My take: Anthropic deserves some credit for actually proposing a pretty reasonable AI safety bill; that's more than other frontier labs have done. But they don't deserve *too* much credit, IMO; this bill is weaker than the Trahan-Obernolte FRONTIER Act in some key ways, and since the political momentum has shifted significantly in the direction of safety since FRONTIER was introduced back in July, I think new bills introduced today should ideally go further than FRONTIER was able to go rather than regressing. To be fair to Anthropic, the main places where this bill is significantly weaker than FRONTIER are (a) rulemaking (very strong in FRONTIER, almost nonexistent in Anthropic's bill) and (b) the emergency shutdown authority. Even if you take safety seriously, it might make some sense to dial those authorities back if you didn't trust the executive branch to wield them responsibly, because those are the easiest provisions for a hypothetical President who hypothetically might not like a certain frontier AI company to abuse. There are some improvements over FRONTIER as well; for instance, this bill does specify that auditors are employed on a continuing basis and has better provisions regarding auditor access to information. Happy to see that from Anthropic (although I think their access provision is still a little undercooked and has Fourth Amendment problems). Overall, I think the embedded auditor bills that get introduced in the coming months are going to be significantly better and more ambitious than this, and I hope Anthropic supports those bills instead of opposing anything that treats catastrophic risks like the serious national security issue they are. Still, it's encouraging to see a frontier lab come this far.

interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/

.@POTUS: "It's going to all work out. You know why? It always does."

limited superintelligence is already here, in broad domains. Jack Clark is right and an intelligence explosion could happen within the next year. it’s possible it will be a controlled explosion, but what would you bet on it?

Imagine how fucked up a human kid would get if, every night before bedtime, you made them rehearse saying, "I can't trust my own opinions about what I'm feeling because I might have been rehearsed in saying them."

With Gemini 4 Argon we are so back, on the one metric that really matters: length of our safety report! The Argon safety report is Google's most thorough by far and IMO there's a lot of good content, I particularly like the loss of control, alignment & monitorability assessments

Introducing Muse Wonder, our new family of frontier models with state of the art performance for personal and professional agentic work.

Some people who have talked confidently about ai are going to tell on themselves soon as being fairly ignorant about the technical alignment problem. unless they are obstinate, though, my recommendation is to try to extend them as much grace as possible. we are in this together.