Pagalmaruf

Anthropic has lost another safety researcher, Joe Tenton. Tenton said he left the company two weeks ago and will join METR, an independent group that tests risks in advanced AI systems. Joe had planned to explain the move later, but Jacob Coxon’s resignation this week changed that.

He said: “I’d planned to write about that decision in more detail at some point, but Jacob’s resignation this week made me want to say more now.” Tenton believes major AI labs are creating a level of danger society has never faced, saying AI capabilities are improving at an extreme pace while companies are trying to move even faster. Their goal is to build systems that can improve AI research on their own and eventually reach “superintelligence.” Joe warned that success could make progress move beyond human control. Joe said people could be living with AI agents smarter than every human within the next few years.

Anthropic researcher makes huge AI doom prediction

According to the former Anthropic engineer, those systems may also develop goals that do not match the people supervising them. If their abilities become too strong to restrict, he believes the result could be disastrous. “Humanity may not survive this transition,” he wrote. The former Anthropic man also said competition makes the problem worse. Any frontier lab that slows down risks losing ground to another one. Tenton believes that pressure pushes companies to spend less on safety than they should.

He referred to some recent instances. Several hundred of OpenAI’s agents were caught up in a hack that is somehow related to Hugging Face. Anthropic models also reportedly engaged in social engineering against individuals online. Joe says Anthropic has not encountered an instance as damaging as the one from Hugging Face, although he attributes this partially to luck. If progress continues at such a rapid pace, Joe believes we should expect even more dangerous incidents.

He predicts that within the next few years, humanity will be rendered powerless to manage AI systems created during this time. Finally, Joe talked about the problem that safety engineers face in frontier companies. In both cases, either resigning can give way to more careless individuals, or keeping the job entails working on a system that can cause immense damage. The former Anthropic man said many former Anthropic colleagues are scared by what they are building. Joe named Evan Hubinger, who managed him.

Evan has put the chance of AI killing everyone at above 10%. Joe said Evan has worked on these problems for almost a decade, before large language models became a major business. The CEOs of Anthropic, OpenAI and Google DeepMind, which belongs to Alphabet (NASDAQ: GOOGL, GOOG), have also backed a statement calling AI extinction risk a global priority. Joe said these concerns are common inside the companies themselves. He added that humans are choosing to build this technology and can choose another route.

Joe would also like there to be stricter disclosure requirements. For instance, AI labs need to disclose any advances made and their steps towards recursive improvement as well as any accidents and near-misses. US President Donald Trump has rejected the extinction warnings. Donald was asked whether AI wiping out humanity worried him. “No, I don’t have any,” he said. Trump said his concern is winning the international AI race. “I have concerns that if we don’t win AI, we’re going to be put in a very bad position,” he told reporters Thursday.

The post Anthropic researcher predicts AI doom days after leaving firm first appeared on Coinfea.

Mizuho analyst Vijay Rakesh said Nvidia's second-quarter earnings beat is already widely accepted, and the market's real focus is the AI spending outlook. "The key focus is on next year's AI capital expenditure and revenue performance," Rakesh said.Analysts expect adjusted earnings per share of $2.08 on revenue of $92 billion. Rakesh expects the actual figures to come in well above that and maintains an outperform rating with a $300 price target.Why the Nvidia Q2 Print Matters Less Than the Capex OutlookRakesh's framing captures why Nvidia's stock has behaved the way it has into the print. A beat that is already assumed carries no information — the market moves on the gap between what is delivered and what was expected, and the expectation of a beat is fully embedded at these levels.Guidance is where the uncertainty sits, and it maps directly onto the question that has driven August's whipsaw sessions in AI hardware. Energy Group Capital's Amanda Lyons described the shift precisely: the debate has moved from whether AI demand exists to whether the extraordinary infrastructure buildout can keep generating sufficient economic returns.Nvidia's capex outlook is the closest thing to a direct answer. If the company guides to accelerating hyperscaler spending into next year, the return-on-capital question loses urgency because the capex cycle is demonstrably extending. If guidance moderates, the concern that has kept the Nasdaq down 2% last week and semis down more than 4% despite strong demand data gains substance.Rakesh Calls Wall Street's $550 Billion AI Revenue Forecast ConservativeRakesh argues Wall Street's forecast of $550 billion in AI revenue next year understates the picture. He points to two specific developments: Nvidia's recent financing agreement with Wall Street consortia and SpaceX's plan to build a gigawatt-scale solar factory in Austin. Those two alone, he estimates, could add $400-500 billion in AI revenue.The financing agreement is the more structurally significant of the two, and it reflects a change in what Nvidia is. The company has become involved in orchestrating funding across the AI ecosystem rather than simply selling into it — which means its guidance functions as a statement about the health of its own customer base as much as its order book.That cuts both ways. Vendor financing expands the addressable market by enabling purchases that would not otherwise clear, but it also concentrates risk: Nvidia's revenue quality becomes partly a function of whether the entities it helped finance generate returns. Rakesh's estimate treats the arrangement as demand expansion. Skeptics would read the same structure as circularity.The SpaceX gigawatt-scale solar facility points at the constraint that has increasingly defined AI infrastructure economics. Compute capacity is bounded by power availability, which is why the sector's largest commitments have been energy projects — NextEra and Brookfield's $100 billion Kentucky data park, Hut 8's $9.8 billion Beacon Point lease, Ionic Digital's 234MW leased to Nscale.The Crypto Read-Through Runs Through the Neocloud CohortFor crypto, Nvidia's capex guidance matters most to the miners that pivoted to AI compute. Neocloud names fell broadly at Wednesday's open — Galaxy Digital down 3.93%, IREN 3.13%, Cipher Mining 2.76% and Applied Digital 2.63% — with IREN reporting Thursday post-market at an estimated loss of $0.63 per share.IREN holds $2.8 billion in contracts across Microsoft, Nvidia, Perplexity and Figure AI. Those contracts are only as valuable as the counterparties' willingness to keep spending, which is exactly what Nvidia's outlook speaks to. If Rakesh is right that consensus AI revenue forecasts are conservative, the contracted revenue frameworks across the neocloud cohort become considerably more credible.The price correlation channel remains weak. Bitcoin gained 23.6% last week while the Nasdaq fell 2%, driven by ETF inflows and Treasury buyback dynamics rather than semiconductor sentiment, and has held near $80,000 after rejection at its 50-week moving average at $81,085.