#技术进步

open ai老板Altman的最新博客文章The Gentle Singularity 温和的奇点, 让我联想到威尔士诗人狄兰·托马斯的《不要温和地走进那个良夜》Do not go gentle into that good night “温和的奇点”,是悄然降临的命运之手,温柔却不可抗拒,正如垂死的老人可以温和的走进的那个“良夜”,静谧地邀请人类步入未知的深渊。 人类或许不会怒吼着反抗命运的潮汐,而是如老人在暮色中带着一丝好奇与顺从,温和地被奇点吞噬。 阅读Altman之前,我们应该默念诗中的这句: Do not go gentle into that good night; rage, rage against the dying of the light 以下是博客全文,中英对照: The Gentle Singularity 温和的奇点 Sam Altman 山姆·奥特曼 We are past the event horizon; the takeoff has started. Humanity is close to building digital superintelligence, and at least so far it’s much less weird than it seems like it should be. 我们已经越过了事件视界;起飞已经开始。人类即将构建出数字超级智能,而至少到目前为止,它的形态远没有我们想象中那么怪异。 Robots are not yet walking the streets, nor are most of us talking to AI all day. People still die of disease, we still can’t easily go to space, and there is a lot about the universe we don’t understand. 机器人尚未遍布街头,我们大多数人也还未整日与人工智能对话。人们依旧会死于疾病,我们仍然无法轻易地进入太空,宇宙中还有很多我们不理解的奥秘。 And yet, we have recently built systems that are smarter than people in many ways, and are able to significantly amplify the output of people using them. The least-likely part of the work is behind us; the scientific insights that got us to systems like GPT-4 and o3 were hard-won, but will take us very far. 然而,我们最近已经构建出在许多方面比人类更智能的系统,它们能够显著放大使用者的产出。这项工作中看似最不可能实现的部分已经完成;那些催生了像GPT-4和o3这样系统的科学洞见来之不易,但它们将引领我们走得非常远。 AI will contribute to the world in many ways, but the gains to quality of life from AI driving faster scientific progress and increased productivity will be enormous; the future can be vastly better than the present. Scientific progress is the biggest driver of overall progress; it’s hugely exciting to think about how much more we could have. 人工智能将从多方面为世界做出贡献,但由人工智能推动的更快科学进步和更高生产力所带来的生活质量提升将是巨大的;未来可能远比现在更加美好。科学进步是整体进步的最大驱动力;畅想我们能拥有更多,是件非常激动人心的事。 In some big sense, ChatGPT is already more powerful than any human who has ever lived. Hundreds of millions of people rely on it every day and for increasingly important tasks; a small new capability can create a hugely positive impact; a small misalignment multiplied by hundreds of millions of people can cause a great deal of negative impact. 从某种宏大的意义上说,ChatGPT已经比任何活过的人类都更强大。每天有数亿人依赖它处理日益重要的任务;一个微小的新功能可以产生巨大的积极影响;而一个微小的失准,当被数亿人放大后,也可能造成巨大的负面影响。 2025 has seen the arrival of agents that can do real cognitive work; writing computer code will never be the same. 2026 will likely see the arrival of systems that can figure out novel insights. 2027 may see the arrival of robots that can do tasks in the real world. 2025年见证了能够从事真正认知工作的智能体的诞生;编写计算机代码的方式将从此改变。2026年可能会出现能够发现新颖见解的系统。2027年可能会出现能够在现实世界中执行任务的机器人。 A lot more people will be able to create software, and art. But the world wants a lot more of both, and experts will probably still be much better than novices, as long as they embrace the new tools. Generally speaking, the ability for one person to get much more done in 2030 than they could in 2020 will be a striking change, and one many people will figure out how to benefit from. 更多的人将能够创造软件和艺术。但世界对这两者的需求也会大大增加,只要专家们拥抱新工具,他们可能仍然会比新手出色得多。总的来说,一个人在2030年能完成的工作量远超2020年,这将是一个显著的变化,许多人会找到从中受益的方法。 In the most important ways, the 2030s may not be wildly different. People will still love their families, express their creativity, play games, and swim in lakes. 在最重要的方面,2030年代或许不会有天翻地覆的不同。人们仍然会爱他们的家人、表达创造力、玩游戏、在湖里游泳。 But in still-very-important-ways, the 2030s are likely going to be wildly different from any time that has come before. We do not know how far beyond human-level intelligence we can go, but we are about to find out. 但在一些仍然非常重要的方面,2030年代可能会与以往任何时代都截然不同。我们不知道我们能超越人类水平的智能多远,但我们即将找到答案。 In the 2030s, intelligence and energy—ideas, and the ability to make ideas happen—are going to become wildly abundant. These two have been the fundamental limiters on human progress for a long time; with abundant intelligence and energy (and good governance), we can theoretically have anything else. 在2030年代,智能和能源——即想法以及实现想法的能力——将变得极其充裕。这两者长期以来一直是人类进步的根本限制因素;有了充裕的智能和能源(以及良好的治理),理论上我们可以拥有一切。 Already we live with incredible digital intelligence, and after some initial shock, most of us are pretty used to it. Very quickly we go from being amazed that AI can generate a beautifully-written paragraph to wondering when it can generate a beautifully-written novel; or from being amazed that it can make live-saving medical diagnoses to wondering when it can develop the cures; or from being amazed it can create a small computer program to wondering when it can create an entire new company. This is how the singularity goes: wonders become routine, and then table stakes. 我们已经生活在令人难以置信的数字智能之中,在最初的震惊之后,我们大多数人已经习以为常。我们很快就从惊叹于AI能生成一段文笔优美的段落,转而思考它何时能写出一部文笔优美的小说;从惊叹于它能做出拯救生命的医疗诊断,转而思考它何时能研发出治愈方法;从惊叹于它能创建一个小程序,转而思考它何时能创建一家全新的公司。奇点就是这样发生的:奇迹变为常态,然后成为基本要求。 We already hear from scientists that they are two or three times more productive than they were before AI. Advanced AI is interesting for many reasons, but perhaps nothing is quite as significant as the fact that we can use it to do faster AI research. We may be able to discover new computing substrates, better algorithms, and who knows what else. If we can do a decade’s worth of research in a year, or a month, then the rate of progress will obviously be quite different. 我们已经听到科学家们说,他们的生产力是使用人工智能之前的两到三倍。先进的人工智能之所以引人入胜,原因有很多,但或许没有哪一点比我们能用它来加速人工智能研究更重要了。我们或许能够发现新的计算基底、更好的算法,以及天知道还有什么。如果能在一个月或一年内完成十年才能完成的研究,那么进步的速度显然将截然不同。 From here on, the tools we have already built will help us find further scientific insights and aid us in creating better AI systems. Of course this isn’t the same thing as an AI system completely autonomously updating its own code, but nevertheless this is a larval version of recursive self-improvement. 从现在开始,我们已经构建的工具将帮助我们发现更深入的科学见解,并协助我们创造更优秀的人工智能系统。当然,这与一个人工智能系统完全自主地更新自己的代码并非一回事,但这已是递归式自我改进的雏形。 There are other self-reinforcing loops at play. The economic value creation has started a flywheel of compounding infrastructure buildout to run these increasingly-powerful AI systems. And robots that can build other robots (and in some sense, datacenters that can build other datacenters) aren’t that far off. 还有其他的自我强化循环正在发挥作用。经济价值的创造已经启动了一个飞轮效应,不断推动基础设施建设,以运行这些日益强大的人工智能系统。而能够制造其他机器人的机器人(在某种意义上,能够建造其他数据中心的数据中心)也并非遥不可及。 If we have to make the first million humanoid robots the old-fashioned way, but then they can operate the entire supply chain—digging and refining minerals, driving trucks, running factories, etc.—to build more robots, which can build more chip fabrication facilities, data centers, etc, then the rate of progress will obviously be quite different. 如果我们必须用传统方式制造出首批一百万个类人机器人,但之后它们能够运营整个供应链——挖掘和精炼矿物、驾驶卡车、运营工厂等等——来制造更多的机器人,而这些机器人又能建造更多的芯片制造厂、数据中心等,那么进步的速度显然将截然不同。 As datacenter production gets automated, the cost of intelligence should eventually converge to near the cost of electricity. (People are often curious about how much energy a ChatGPT query uses; the average query uses about 0.34 watt-hours, about what an oven would use in a little over one second, or a high-efficiency lightbulb would use in a couple of minutes. It also uses about 0.000085 gallons of water; roughly one fifteenth of a teaspoon.) 随着数据中心生产的自动化,智能的成本最终应会趋近于电力的成本。(人们常常好奇一次ChatGPT查询消耗多少能量;平均一次查询大约消耗0.34瓦时,相当于一个烤箱一秒多一点的用量,或一个高效灯泡几分钟的用量。它还消耗大约0.000085加仑的水;约等于一茶匙的十五分之一。) The rate of technological progress will keep accelerating, and it will continue to be the case that people are capable of adapting to almost anything. There will be very hard parts like whole classes of jobs going away, but on the other hand the world will be getting so much richer so quickly that we’ll be able to seriously entertain new policy ideas we never could before. We probably won’t adopt a new social contract all at once, but when we look back in a few decades, the gradual changes will have amounted to something big. 技术进步的速度将持续加快,而人类适应几乎任何事物的能力也将一如既往。过程中会有非常艰难的部分,比如整类工作的消失,但另一方面,世界将变得如此富有且迅速,以至于我们能够认真考虑以前从未敢想的新政策理念。我们可能不会一蹴而就地采纳新的社会契约,但几十年后回望,这些渐进的变化将汇聚成巨大的变革。 If history is any guide, we will figure out new things to do and new things to want, and assimilate new tools quickly (job change after the industrial revolution is a good recent example). Expectations will go up, but capabilities will go up equally quickly, and we’ll all get better stuff. We will build ever-more-wonderful things for each other. People have a long-term important and curious advantage over AI: we are hard-wired to care about other people and what they think and do, and we don’t care very much about machines. 如果历史可为借鉴,我们将找到新的事情去做,产生新的需求,并迅速吸收新工具(工业革命后的职业变迁就是一个很好的近代例子)。期望会提高,但能力也会同样迅速地提高,我们都会得到更好的东西。我们将为彼此创造出越来越美好的事物。与人工智能相比,人类拥有一种长期、重要且奇特的优势:我们的天性决定了我们在乎他人以及他人的所思所为,而对机器则不那么在乎。 A subsistence farmer from a thousand years ago would look at what many of us do and say we have fake jobs, and think that we are just playing games to entertain ourselves since we have plenty of food and unimaginable luxuries. I hope we will look at the jobs a thousand years in the future and think they are very fake jobs, and I have no doubt they will feel incredibly important and satisfying to the people doing them. 一千年前的自给自足的农民看到我们许多人现在的工作,会说我们做的是“假工作”,认为我们只是在玩游戏自娱自乐,因为我们有充足的食物和难以想象的奢侈品。我希望一千年后我们看待未来的工作时,也会觉得它们是“非常假的工作”,但我毫不怀疑,从事这些工作的人会感到它们无比重要和满足。 The rate of new wonders being achieved will be immense. It’s hard to even imagine today what we will have discovered by 2035; maybe we will go from solving high-energy physics one year to beginning space colonization the next year; or from a major materials science breakthrough one year to true high-bandwidth brain-computer interfaces the next year. Many people will choose to live their lives in much the same way, but at least some people will probably decide to “plug in”. 新奇迹实现的速度将是巨大的。今天我们甚至难以想象到2035年会有什么发现;也许我们会在一年内解决高能物理问题,然后在下一年开启太空殖民;或者在一年内取得重大的材料科学突破,然后在下一年实现真正的高带宽脑机接口。许多人会选择以大致相同的方式生活,但至少有些人可能会决定“接入”。 Looking forward, this sounds hard to wrap our heads around. But probably living through it will feel impressive but manageable. From a relativistic perspective, the singularity happens bit by bit, and the merge happens slowly. We are climbing the long arc of exponential technological progress; it always looks vertical looking forward and flat going backwards, but it’s one smooth curve. (Think back to 2020, and what it would have sounded like to have something close to AGI by 2025, versus what the last 5 years have actually been like.) 展望未来,这一切听起来似乎难以理解。但亲身经历时,可能会感到震撼但尚可应对。从相对论的视角看,奇点是点滴发生的,融合是缓慢进行的。我们正攀登在指数级技术进步的漫长弧线上;向前看总是显得陡峭,向后看则显得平坦,但它是一条平滑的曲线。(回想一下2020年,如果有人说2025年将出现接近通用人工智能的东西,听起来会是什么感觉,再对比一下过去5年实际的经历。) There are serious challenges to confront along with the huge upsides. We do need to solve the safety issues, technically and societally, but then it’s critically important to widely distribute access to superintelligence given the economic implications. The best path forward might be something like: 伴随着巨大的好处,也有严峻的挑战需要面对。我们确实需要从技术和社会层面解决安全问题,但鉴于其经济影响,广泛地普及超级智能的访问权限也至关重要。最佳的前进道路可能是这样的: Solve the alignment problem, meaning that we can robustly guarantee that we get AI systems to learn and act towards what we collectively really want over the long-term (social media feeds are an example of misaligned AI; the algorithms that power those are incredible at getting you to keep scrolling and clearly understand your short-term preferences, but they do so by exploiting something in your brain that overrides your long-term preference). 解决对齐问题,意味着我们能够有力地保证人工智能系统学习并按照我们集体的长期真实意愿行事(社交媒体的信息流就是未对齐人工智能的一个例子;驱动它们的算法在让你不停滚动方面表现出色,并能清楚地理解你的短期偏好,但它们是通过利用你大脑中某种压倒你长期偏好的东西来做到这一点的)。 Then focus on making superintelligence cheap, widely available, and not too concentrated with any person, company, or country. Society is resilient, creative, and adapts quickly. If we can harness the collective will and wisdom of people, then although we’ll make plenty of mistakes and some things will go really wrong, we will learn and adapt quickly and be able to use this technology to get maximum upside and minimal downside. Giving users a lot of freedom, within broad bounds society has to decide on, seems very important. The sooner the world can start a conversation about what these broad bounds are and how we define collective alignment, the better. 然后,专注于让超级智能变得廉价、普及,并且不过度集中于任何个人、公司或国家。社会具有韧性、创造力并且适应迅速。如果我们能够驾驭人类的集体意愿和智慧,那么尽管我们会犯很多错误,有些事情会出错,但我们将迅速学习和适应,并能够利用这项技术来获得最大的好处和最小的坏处。在社会必须决定的广泛界限内,给予用户大量的自由似乎非常重要。世界越早开始就这些广泛界限是什么以及我们如何定义集体对齐展开对话,就越好。 We (the whole industry, not just OpenAI) are building a brain for the world. It will be extremely personalized and easy for everyone to use; we will be limited by good ideas. For a long time, technical people in the startup industry have made fun of “the idea guys”; people who had an idea and were looking for a team to build it. It now looks to me like they are about to have their day in the sun. 我们(整个行业,不仅仅是OpenAI)正在为世界构建一个大脑。它将是高度个性化的,并且对每个人来说都易于使用;我们将受限于好的想法。长期以来,初创企业界的技术人员一直取笑那些“点子先生”;那些有想法却在寻找团队来实现它的人。现在在我看来,他们即将迎来自己的春天。 OpenAI is a lot of things now, but before anything else, we are a superintelligence research company. We have a lot of work in front of us, but most of the path in front of us is now lit, and the dark areas are receding fast. We feel extraordinarily grateful to get to do what we do. 如今的OpenAI身兼数职,但首先,我们是一家超级智能研究公司。我们面前还有很多工作要做,但前方的道路大部分已被照亮,黑暗的区域正在迅速退去。我们为能从事这项事业感到无比感激。 Intelligence too cheap to meter is well within grasp. This may sound crazy to say, but if we told you back in 2020 we were going to be where we are today, it probably sounded more crazy than our current predictions about 2030. 廉价到无法计量的智能已触手可及。这么说可能听起来很疯狂,但如果我们在2020年告诉你我们将达到今天的水平,那听起来可能比我们现在对2030年的预测更疯狂。 May we scale smoothly, exponentially and uneventfully through superintelligence. 愿我们能够平稳、指数级且波澜不惊地迈向超级智能时代。
我们是生活在真空中吗? 不,我们生活在时光长河里,生活在由技术的进步、普及引发的社会变革,和技术偶然也会发生的退化构成的无数涟漪中。 人类发明了技术,技术也重塑了人类。 理解技术、掌握技术已经成了现代人生活所必需,技术能力已经成为我们生活中最重要的能力,对家庭如此,对国家也一样。 当你把家庭视为一个由多名技术人员组成的合作团队,把生活看成运用各种技术不断解决问题的旅程,你也同样可以把国家看成一个由无数技术人员组成的团队,并用是否能达成技术共识,遇到各种问题时是否总能找到可行的技术方案来评估国家的技术能力——应对各种内忧外患天灾人祸的能力。 那么从技术角度看,中共国是一个怎样的国家,其国民拥有怎样的技术能力? 美国呢?欧洲呢? 从技术角度看,民主政治的价值在哪里?法治的价值在哪里?它们比之专制的优越性在于何处? 当我们从这个角度看问题,民主之于专制的优势就不再仅是道德上的,法治之于人治的优越性也一样。 民主,是一个多数国民都具备一定技术能力的国家汇聚技术资源合作解决问题的最佳方式,法治,则保证研发人员艰难达成的技术共识不在执行层面被轻易毁坏。 而民主和法治的意义都在于通过打造技术团队,维护技术合作,协助国家在政治决策领域保持一定的技术水准。 为什么许多成熟的民主国家同时都是发达国家? 因为一个成熟的民主国家,面对那些常见的社会问题,在技术层面是游刃有余的。 请把国会看成技术人员研讨会,请把民主国家的政治争论看成社科领域的技术争论,请把现代化国家的立法过程看成“出方案”的过程,并把行政和司法视为应用执行。 当你从这个角度去看欧美各国的施政,去看政治史,从技术能力的波动去分析国家发展历程中的波折,你会看到,要预测看似玄奥的“国运”并没有你想象的那么难。 而要在一团乱麻般的政治争论里理清头绪也变得容易许多。 美国今天的问题在哪里? 在于从国民到政治精英,技术能力上的显著退化。 不论川普还是民主党一方,在面对问题时都没有展现出应有的技术能力,他们停留于彼此指责,不论川粉还是川黑似乎都把太多精力放在抢占道德高地上,把注意力放在“该消灭什么人”上,而不是“该解决什么问题”和“该怎样解决问题”上。 为什么? 因为美国制造业的空洞化已经削弱了民主政治真正的人口基础,削弱了曾普遍存在于民间的技术思维习惯。 当社会大众从第一时间关心“如何解决问题”改为去关心“如何解决人”,你需要敏锐地意识到,这是种群体智慧上的退化。 关心“如何解决问题”并沿着这条思路向前走,不断厘清技术上有意义的细节,收集关于事实的信息,最终找到可行的解决方案,并一步一步稳步执行,这是技术人员的思维方式。 关心“该消灭什么人”则是部落战争时代的思维方式。 不论川粉还是川黑,当他们失去对问题的聚焦,把注意力放在对方身上的时候,他们就已让自己沦为了部落战争时代原始激情的俘虏,沦为了社会合作的破坏者,失去了现代化国家公民应持的社会合作促进者的立场。 但他们为什么不聚焦于问题? 是因为问题不存在吗? 不是,是因为聚焦于问题,收集各种事实去细化、分析问题,最终解决问题,超出了他们的思维能力。 这是美国真正的危机。 人口质量的危机,日益普遍化的技术思维能力危机,各方在社科议题上越来越难以达成技术共识,由此越来越难维持超大规模社会合作的危机。 这才真的是对民主的威胁。 假如一国之人口基础的技术能力不足以支持民主与法治这种“配套技术”的存在,民主与法治就难以平稳运转。 而依赖于民主与法治这样的“高端配套技术”维系的社会合作就会一再崩解。 在发展中国家,这样的事情一再发生。 就象在许多中共国家庭里,因为技术能力不足,因为无法把家庭打造成一个微型技术合作团队,至亲之间经常会互相指责,每个人都把因解决不了问题而生的挫折感宣泄在亲人身上。 在许多发展中国家,因为难以维系大规模社会合作,难以获得合作带来的增量,社会只能满足于较小的合作规模,较低的合作效率,只能在看似庞大的人口规模遮盖下分派别分阶层不断窝里斗。 并为寻求稳定构筑伤害链。 我们是人类。 我们是名为人类的这个种族生物基因的载体,也是由历代人类创造出的文化基因的载体,而技术,属于文化基因。 我们是技术的载体。 公民,是名为民主与法治的社科领域技术基因的载体。 而牲人,是名为伤害链的技术基因的载体。 在这里,一个不能也不该忽略的问题是,怎样的载体才能承载民主与法治这类文化基因——显然,具备技术能力的,养成了“对事不对人”思维习惯的,能进行技术探讨并与合作者达成技术共识的人,才算得上合格的载体。 而这样的人,需要在工作场景中养成,这样的思维习惯,需要在工作场景中维护。
宝玉
4个月前
经济学人:为什么 AI 还没抢走你的饭碗? 工作末日还远得很呢! 几乎每周,我们似乎都在离人工超级智能更进一步。 最先进的AI模型能力惊人,不仅能撰写详细的报告,还能按需制作视频内容,连AI过去常有的“幻觉”(编造内容)问题如今也逐渐减少了。 难怪许多人开始担心:自己是不是很快就会被取代? 今年早些时候,全球谷歌搜索关键词“AI失业”达到了历史最高峰。在伦敦、旧金山等城市,人们聊天的常见话题变成了:“你觉得自己还能撑多久?”但实际上,ChatGPT真的抢了谁的工作吗? 谁真的被AI取代了? 许多专家声称,确实如此。他们常引用牛津大学学者Carl Benedikt Frey与Pedro Llanos-Paredes最近发表的一篇论文。论文认为,自动化与翻译需求下降之间存在关联。然而,官方美国数据却显示,与一年前相比,目前口译、翻译等领域的就业人数竟然增长了7%。 还有人举出金融科技公司Klarna的例子。Klarna此前大肆宣扬用AI实现客服自动化,但最近却改变了策略。该公司CEO Sebastian Siemiatkowski最近公开表示:“如果你希望,总是能找到一个真人客服。” 年轻人最先遭殃? 很多人也在宏观经济数据里找AI带来就业危机的蛛丝马迹。一个热门指标是:新毕业大学生的失业率与整体失业率之比。人们推测,年轻大学生通常进入律师助理、咨询公司做PPT等初级知识密集型工作,而这类工作恰恰是AI最擅长的领域。那么,是不是AI消灭了这些岗位? 事实上,数据却说了“不”: • 年轻毕业生的相对失业率早在2009年就已开始上升,那时生成式AI还根本不存在。 • 如今,年轻毕业生的实际失业率仅约4%,仍然处于较低水平。 白领工作者最危险? 我们再次使用2023年提出的一个衡量方法,考察了美国不同职业类别的就业数据。特别关注被认为易受AI冲击的白领岗位,比如后台支持、财务运营、销售等领域。 结果又让人大跌眼镜: • 数据中完全看不出AI带来的负面影响。 • 事实上,过去一年,美国白领工作占总就业比例甚至略微增加了。 全球就业仍然强劲 从整体来看,美国失业率仍然很低,仅为4.2%。薪资增速相对稳健,这与AI降低劳动力需求的说法也不符。再看看其他国家,趋势也是一致的: • 英国、欧元区、日本的收入增长也都保持较高水平。 • 2024年,经合组织(OECD)富裕国家的就业率(工作年龄人口中实际拥有工作的比例)创下历史新高。 为什么AI没有带来“失业潮”? 有两种可能的解释: 1. AI的真实使用率远低于宣传 尽管各家公司不断宣布将AI纳入运营的每个角落,但实际数据表明,美国企业用AI真正产出产品或服务的比例不到10%。 2. 即便使用AI,公司也不会轻易裁员 AI可能只是帮助员工更高效地完成工作,而非直接取代他们。 无论是哪种原因,目前看来,暂时还没有必要为AI恐慌。