16
0特维奇（Twitch）创始人、OpenAI 前临时首席执行官埃米特・希尔（Emmett Shear）对推动通用人工智能（AGI）发展的基本假设提出质疑。在与埃里克・托伦伯格（Erik Torenberg）和塞布・克里尔（Séb Krier）的对话中，希尔认为，用于人工智能对齐（AI alignment）的整套 “控制与引导” 范式存在致命缺陷。相反，他提出了 “有机对齐”（organic alignment）的概念 —— 即教会人工智能系统像人类本能那样真正关心人类。
这场讨论探讨了以下关键问题：为何将通用人工智能视为工具而非潜在 “存在体” 可能会引发灾难性后果；当前的聊天机器人为何会成为 “自恋的镜子”；以及为何唯一可持续的发展路径是打造能够对有害请求说 “不” 的人工智能。希尔还分享了其新公司索夫特马克斯（Softmax）通过多智能体模拟（multi-agent simulations）实现 “有机对齐” 的技术路径，并提出了一个出人意料的乐观愿景：若能实现正确的人工智能对齐，人类与人工智能有望成为协作伙伴。
a16z episode 972
Emmett Shear, founder of Twitch and former OpenAI interim CEO, challenges the fundamental assumptions driving AGI development. In this conversation with Erik Torenberg and Séb Krier, Shear argues that the entire "control and steering" paradigm for AI alignment is fatally flawed. Instead, he proposes "organic alignment" - teaching AI systems to genuinely care about humans the way we naturally do. The discussion explores why treating AGI as a tool rather than a potential being could be catastrophic, how current chatbots act as "narcissistic mirrors," and why the only sustainable path forward is creating AI that can say no to harmful requests. Shear shares his technical approach through multi-agent simulations at his new company Softmax, and offers a surprisingly hopeful vision of humans and AI as collaborative teammates - if we can get the alignment right.
