科技英語：“OpenAI很好，但它不重視安全”前安全主管爆料

A former top safety executive at OpenAI is laying it all out.
OpenAI前頂級安全主管正公開披露一切。

Jan Leike, a leader on the artificial intelligence company's superalignment group, announced he was quitting on Tuesday night with a blunt post on X: "I resigned."
人工智能公司超級對齊組的領(lǐng)導(dǎo)者Jan Leike于周二晚在X（前身為Twitter）上發(fā)表了一條直接的帖子宣布辭職：“我辭職了。”

Leike has now shared more about his exit — and said OpenAI isn't taking safety seriously enough.
Leike現(xiàn)在分享了更多關(guān)于他離職的原因，并表示OpenAI對安全的重視不夠。

"Over the past years, safety culture and processes have taken a backseat to shiny products," Leike wrote in a lengthy X thread on Friday.
“過去幾年，安全文化和流程被華麗的產(chǎn)品所掩蓋，”Leike在周五的一篇長X帖子中寫道。

In his posts, Leike said he joined OpenAI because he thought it would be the best place to research how to "steer and control" artificial general intelligence, a thus far hypothetical version of AI that would be able to think faster than a human.
在他的帖子中，Leike表示他加入OpenAI是因為他認為這是研究如何“引導(dǎo)和控制”通用人工智能（AGI）的最佳地點，AGI是一種尚處于假設(shè)階段的人工智能版本，能夠比人類思考得更快。

"However, I have been disagreeing with OpenAI leadership about the company's core priorities for quite some time, until we finally reached a breaking point," Leike wrote.
“然而，我已經(jīng)與OpenAI領(lǐng)導(dǎo)層在公司核心優(yōu)先事項上爭論了很長時間，直到我們最終達到了一個臨界點，”Leike寫道。

The former OpenAI executive said the company should be keeping most of its attention on issues of "security, monitoring, preparedness, safety, adversarial robustness, (super)alignment, confidentiality, societal impact, and related topics."
這位前OpenAI高管表示，公司應(yīng)該將大部分注意力放在“安全、監(jiān)控、準備、安全性、對抗魯棒性、（超級）對齊、保密性、社會影響等相關(guān)問題”上。

But Leike said his team, which was working on how to align AI systems with what's best for humanity, was "sailing against the wind" at OpenAI.
但Leike表示，他的團隊一直在OpenAI內(nèi)部“逆風航行”，致力于將AI系統(tǒng)與人類最佳利益對齊。

"We are long overdue in getting incredibly serious about the implications of AGI," he wrote, adding that, "OpenAI must become a safety-first AGI company."
“我們早就應(yīng)該非常認真地對待AGI的影響了，”他寫道，并補充說，“OpenAI必須成為一個安全第一的AGI公司。”

Leike capped off his thread with a note to OpenAI employees, encouraging them to shift the company's safety culture. "I am counting on you. The world is counting on you," he said.
Leike在他的帖子結(jié)尾向OpenAI員工發(fā)出呼吁，鼓勵他們轉(zhuǎn)變公司的安全文化。 “我指望你們。世界在指望你們，”他說。

OpenAI CEO Sam Altman responded to Leike's thread on X. "I'm super appreciative of @janleike's contributions to OpenAI's alignment research and safety culture, and very sad to see him leave," Altman said on X. "He's right we have a lot more to do; we are committed to doing it. I'll have a longer post in the next couple of days."
OpenAI首席執(zhí)行官薩姆·奧特曼在X上回應(yīng)了Leike的帖子。 “我非常感謝@janleike對OpenAI對齊研究和安全文化的貢獻，非常難過看到他離開，”奧特曼在X上說。“他是對的，我們還有很多事情要做；我們承諾會做到這些。我將在接下來的幾天里發(fā)一篇更長的帖子。”