Anthropic Researcher Quits Over 'Out-of-Control' AI Fears Anthropic 研究员因担忧 AI "失控"而辞职
一、核心摘要(English,95 词)
二、核心摘要(中文版)
三、语言学习价值(核心词汇 · 构词 / 词源 / 例句)
四、完整文章正文
An AI researcher has quit his job and warned that the technology "could kill us all by the end of the decade". Jacob Coxon, a researcher at American AI safety and research company Anthropic, made the chilling warning on X and is urging people to "not underestimate the power of this technology."
Mr Coxon said in the post on Wednesday (September 9): "I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below."
He continued: "The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible — but I hear the same people express fear privately. No other human activity poses this level of danger."
Evan Hubinger, Anthropic's staff lead on keeping the technology aligned with human goals and values, replied to the post and said Mr Coxon is correct. He believes there is less than a 10% chance of AI killing all humans within the next decade. He wrote: "Jacob is correct here — we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to."
According to the Wall Street Journal, Mr Coxon quit Anthropic over concerns about the push to build self-improving AI systems that have the capability to threaten humanity. The researcher told the publication that he believes the world is on track for a "lot of the most aggressive of these scenarios where by the end of next year things could be out of control already."
Anthropic builds advanced AI systems and aims to make them more reliable, understandable and safe. The company was started by former OpenAI researchers, including siblings Dario Amodei (CEO) and Daniela Amodei (President), in 2021.
Mr Coxon said the "stakes are well-understood" within the company. However, they are "locked in a race" to develop the technology first as "they believe no one else will act responsibly, so they must do it themselves, despite the risk."
He continued: "If you are a lab researcher, I urge you to consider what the next few years will actually feel like. Do you want to kick off a superintelligent RL run without a rigorous understanding of its mind? Should you put your head down because 'it's happening anyway' — or take this moment to call for different conditions?"
There are multiple theories on how AI could cause human extinction. They range from goal misalignment and autonomous weaponisation to the collapse of critical infrastructure and loss of control. Experts say that AI could calculate when humans plan to turn it off or alter its programming. As this would prevent it from achieving its goals, the technology could then opt to eliminate the threat of being shut down. The integration of AI into military systems and weapons could lead to escalation. They have the potential to trigger conflicts faster than human decision-makers.
AI also has the ability to weaponise code which could shut down electric grids, healthcare systems and water facilities. This could lead to society collapse or mass conflict.
Anthropic and OpenAI have been approached for comment.
五、长难句拆解
| 原句 | "Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives." |
|---|---|
| 语法结构 |
1) Neither company — 主语("两家都不",对 OpenAI 与 Anthropic 全部否定)。2) is acting responsibly — 主句谓语(现在进行时表"持续行事")。3) They are racing straight to self-improving superintelligence and gambling with our lives — 第二句:主语 They(回指前文的 two companies),谓语 are racing 与 are gambling(被省略的 and 连接)并列。4) straight to … — 直奔、毫不迟疑地冲向。5) self-improving superintelligence — 作 to 的介词宾语,由 self- 引导的复合形容词修饰 superintelligence;gambling 后接 with our lives 作宾语。
|
| 翻译 | (两家公司)"没有一家行为是负责任的,它们正径直冲向自我改进型超级智能,并把我们所有人的命拿来豪赌。" |
原文链接:https://www.wsj.com/tech/ai/anthropic-researcher-quits-over-out-of-control-ai-fears-707b7628