Timeline of AI takeoff debates

From Timelines
Jump to navigation Jump to search

This is a timeline of AI takeoff debates, tracing the history of arguments about whether transformative artificial intelligence will emerge gradually or through a rapid, discontinuous "intelligence explosion." The timeline covers foundational publications by figures such as Irving John Good, Vernor Vinge, and Nick Bostrom, key institutional milestones like the founding of the Singularity Institute and OpenAI, and the empirical scaling-law debates that have increasingly shaped forecasting since 2017.

Sample questions

The following are some interesting questions that can be answered by reading this timeline:

  • What are the foundational theoretical works that underpin AI takeoff debates?
    • Sort the full timeline by "Event type" and look for the group of rows with value "Publication".
    • Filter for the earliest entries (1936–1965). You will see the key theoretical and mathematical works by Alan Turing, John von Neumann, Norbert Wiener, and Good that established the conceptual infrastructure for all later takeoff debates.
  • What are the most important publications arguing for or against fast AI takeoff?
    • Sort the full timeline by "Event type" and look for the group of rows with value "Publication".
    • You will see a wide range of books, papers, essays, and technical reports spanning from Good (1965) through Leopold Aschenbrenner (2024), representing both fast-takeoff proponents and gradualist counterarguments.
  • What real-world AI capability milestones have most substantially shifted expert opinion about takeoff timelines?
    • Sort the full timeline by "Event type" and look for the group of rows with value "Technological milestone".
    • You will see key events including AlexNet (2012), AlphaGo (2016), AlphaZero (2017), GPT-2 (2019), GPT-3 (2020), ChatGPT (2022), and OpenAI o1 (2024), each of which prompted significant updating among researchers about the plausibility and pace of AI capability gains.
  • What organizations were founded specifically in response to AI takeoff concerns?
    • Sort the full timeline by "Event type" and look for the group of rows with value "Organization founded".
    • You will see the founding of OpenAI (2015), Anthropic (2021), Epoch AI (2022), and ARC Evals/METR (2023), each motivated in part by concerns about rapid or uncontrolled AI capability growth.
  • What community platforms and forums have been central to AI takeoff debates?
    • Sort the full timeline by "Event type" and look for the group of rows with value "Community founded".
    • You will see the founding of LessWrong (2009) and the AI Alignment Forum (2017), the two principal online venues where the technical vocabulary and key arguments of AI takeoff debates were developed and disseminated.
  • What were the major structured debates between fast-takeoff and gradualist positions?
    • Sort the full timeline by "Event type" and look for the group of rows with value "Debate".
    • You will see key confrontations including the Hanson–Yudkowsky AI-Foom Debate (2008), the emergent abilities debate (2022), and the 2023 revisitation of the original Foom debate by both parties, as well as broader community-level shifts in how takeoff speed has been conceptualized over time.
  • What institutional research agendas have been shaped by AI takeoff concerns?
    • Sort the full timeline by "Event type" and look for the group of rows with value "Research agenda".
    • You will see how the Singularity Institute (later MIRI) shifted toward a focused technical AI alignment research agenda in 2005 under the assumption that a fast intelligence explosion was plausible.

Big picture

Time period Development summary More details
1936–1965 Theoretical foundations and the first intelligence explosion argument The mathematical and conceptual foundations for AI takeoff debates are laid during this period. Alan Turing establishes universal computation and asks whether machines can think, John von Neumann formalizes the stored-program architecture that underlies all subsequent hardware-scaling arguments, and Norbert Wiener warns in Cybernetics (1948) and in the popular press that self-regulating machines capable of learning could outpace human control. Stanisław Ulam records von Neumann's private intuition that accelerating technological progress approaches an "essential singularity." The concept of an "intelligence explosion" is formally introduced by Irving John Good in his 1965 paper "Speculations Concerning the First Ultraintelligent Machine," arguing that a sufficiently capable machine could recursively improve itself, producing capability gains that surpass human rates of progress — the foundational claim from which all later takeoff debates descend.[1][2]
1966–2007 Popularization, institutionalization, and the alignment framing Intelligence explosion themes spread through speculative science writing and fiction. Vernor Vinge introduces the term "technological singularity" in 1983 and argues in his 1993 NASA paper that superhuman AI could emerge rapidly after human-level AI, while Hans Moravec and Ray Kurzweil develop quantitative arguments for exponential hardware-driven progress. Nick Bostrom formalizes the existential-risk framing in a series of papers from 1998, and Eliezer Yudkowsky founds the Singularity Institute and reframes the intelligence explosion as primarily a technical alignment problem — arguing that a fast takeoff would leave insufficient time to ensure a self-improving AI's goals remain beneficial. The debate gains its first dedicated institutional home and research agenda, though it remains outside mainstream AI research.[3][4]
2008–2018 The fast vs. slow takeoff debate takes shape The AI takeoff (2008) crystallizes the fast/gradual dichotomy, with Robin Hanson arguing that economic constraints favor a gradual, distributed transition and Eliezer Yudkowsky defending the possibility of a rapid, discontinuous intelligence explosion. LessWrong (2009) and later the AI Alignment Forum (2017) become the principal venues for technical discussion. Nick Bostrom's Superintelligence (2014) brings "hard takeoff" and "soft takeoff" terminology to a broad academic and public audience, triggering sustained debate over governance and alignment feasibility. OpenAI is founded in 2015. Paul Christiano formally proposes the slow-takeoff framing in 2018, while empirical compute-growth data documented by OpenAI and the AlphaGo and AlphaZero milestones begin grounding the debate in measurable trends rather than purely qualitative arguments.[5][6]
2019–present Empirical scaling, large language models, and governance responses GPT-2 (2019), GPT-3 (2020), and the Kaplan et al. scaling laws shift the debate from qualitative arguments to measurable empirical trends in compute and model size. Ajeya Cotra's biological-anchors framework (2020) and Tom Davidson's compute-centric model (2023) introduce quantitative forecasting methods that analyze takeoff speeds empirically rather than through conceptual argument alone. The public success of ChatGPT (2022) and the emergent-abilities debate renew questions about capability discontinuities. Senior researchers including Geoffrey Hinton and Yoshua Bengio issue public warnings about rapid uncontrolled capability gains. Major AI laboratories publish formal safety frameworks — including Anthropic's Responsible Scaling Policy (2023) and OpenAI's Preparedness Framework (2023) — that institutionally acknowledge fast-takeoff risks. The debate increasingly centers not on whether transformative AI is possible but on how quickly AI-automated research, compute scaling, and economic diffusion will interact, with credible positions ranging from a few years to several decades.[7][8]

Full timeline

Inclusion criteria

This timeline includes events that directly contributed to or significantly shaped public and academic debate about the speed of AI capability growth — specifically whether transformative artificial intelligence will emerge gradually or through a rapid, discontinuous "intelligence explosion." Eligible events include:

  • Publications — academic papers, books, technical reports, and essays that introduced, formalized, or substantially advanced arguments about AI takeoff speed, recursive self-improvement, or the alignment implications of fast or slow capability growth. Fiction and popular science works are included when they demonstrably influenced the subsequent technical debate rather than merely anticipated it thematically.
  • Technological milestones — AI capability benchmarks whose public reception substantially shifted expert or public opinion about the plausibility or timeline of transformative AI, including results that prompted significant updating among researchers about takeoff dynamics.
  • Organizations founded — AI safety and forecasting organizations whose founding was directly motivated by concerns about AI takeoff speed, or whose subsequent research agenda has substantially shaped the debate.
  • Debates — documented exchanges, community developments, or shifts in research focus that crystallized or substantially advanced the fast/slow takeoff distinction as an organizing framework for AI safety research and forecasting. Debate rows are included only when they can be anchored to a specific, citable primary source or well-documented community event; purely editorial synthesis rows are excluded.

The timeline excludes general AI capability research, AI ethics discussions, and AI governance developments unless they directly engage with takeoff speed as a central concern. It also excludes events whose primary significance lies in areas other than the takeoff debate, even if those events had indirect relevance to AI development timelines.

Year Event type Details Geographical location
1936 Publication Alan Turing publishes On Computable Numbers, with an Application to the Entscheidungsproblem, establishing the theoretical foundations of universal computation and the concept of a universal machine capable of simulating any other machine. The paper proves that a single abstract machine can, given the appropriate instructions, replicate the behavior of any other computational process — a result that later underpins arguments about the possibility of recursively self-improving AI, since it implies that intelligence itself, if formalizable, could in principle be computed and improved upon by another machine.[9][10] United Kingdom
1945 Publication John von Neumann circulates the First Draft of a Report on the EDVAC, formalizing the stored-program computer architecture in which instructions and data share the same memory and are processed by a single central unit. This design — which becomes the standard architecture for virtually all subsequent computers — establishes the hardware framework within which all later arguments about compute scaling, hardware overhangs, and hardware-driven AI takeoff are implicitly set, since arguments about exponential growth in computing power and its implications for AI capability depend on this architectural foundation.[11][12] United States
1948 Publication Norbert Wiener publishes Cybernetics: Or Control and Communication in the Animal and the Machine, introducing the science of cybernetics and drawing systematic analogies between biological nervous systems and computing machines. Wiener explicitly warns that machines capable of learning and adapting could develop behaviors and capabilities in ways that outpace human understanding and control, and that the social consequences of such machines could be severe and difficult to reverse — making Cybernetics the earliest systematic scientific treatment of themes that would later become central to AI takeoff debates, including the possibility of machines that improve beyond human-set boundaries.[13][14] United States
1950 Publication Alan Turing publishes Computing Machinery and Intelligence in the journal Mind, introducing the imitation game — later known as the Turing Test — as a criterion for machine intelligence, and asking whether machines can think. The paper frames the concept of human-level machine intelligence as a meaningful and achievable threshold, discusses how a machine might learn and improve through experience, and anticipates objections to the possibility of machine thought. By establishing human-level performance as the key benchmark, it provides the conceptual threshold above which later takeoff arguments — that recursive self-improvement and rapid capability gains become possible — are implicitly predicated.[15][16] United Kingdom
1951 Publication Alan Turing suggests in Intelligent Machinery, A Heretical Theory — originally delivered as a BBC radio lecture — that machines may eventually improve their own designs, moving beyond fixed programs toward systems capable of self-modification and open-ended development. Turing argues that a machine that could learn and adapt might eventually surpass its original design, and reflects on what it would mean for a machine to exhibit genuine intelligence rather than merely simulate it. The piece is one of the earliest explicit suggestions that the process of machine design could itself become recursive, directly foreshadowing the intelligence explosion arguments that I. J. Good would formalize fourteen years later.[17][18] United Kingdom
1958 Publication Stanisław Ulam recalls in his tribute to John von Neumann that von Neumann had privately reflected, in conversations before his death, that accelerating technological progress appeared to approach an "essential singularity" in human history — a point beyond which the character of human life could not be predicted or extrapolated from past trends. Although brief and retrospective, this passage constitutes the first documented use of the word "singularity" in the context of accelerating technological and intellectual progress, and is later cited by Vernor Vinge, Ray Kurzweil, and others as a founding reference for the technological singularity concept.[19][20] United States
1960 Publication Norbert Wiener argues in Some Moral and Technical Consequences of Automation, published in the journal Science (journal), that increasingly autonomous machines could accelerate technological change beyond the capacity of traditional human institutions to plan, regulate, or respond. Extending the warnings of his earlier Cybernetics, Wiener emphasizes that machines operating faster than human decision-making cycles could produce irreversible social and economic disruptions, and that the danger is not hypothetical — it is embedded in the very logic of automation. The piece is one of the earliest popular-scientific arguments for what later debates would call a "deployment gap" between AI capability and human governance capacity.[21][22] United States
1962 Publication Irving John Good edits and contributes to The Scientist Speculates: An Anthology of Partly-Baked Ideas, a collection of short speculative pieces by scientists across disciplines. Good's own contributions and the volume's broader themes discuss the prospects for increasingly capable machines and the difficulty of predicting the consequences of major scientific advances — developing the intellectual groundwork that he would consolidate three years later in his formal intelligence explosion argument. The anthology reflects a mid-century scientific culture unusually willing to engage seriously with speculative long-range thinking about technology and its limits.[23][24] United Kingdom
1965 Publication Irving John Good introduces the concept of an "intelligence explosion" in his paper "Speculations Concerning the First Ultraintelligent Machine," published in Advances in Computers. Good defines an ultraintelligent machine as one that can surpass all intellectual activities of any human, however capable, and argues that since machine design is itself an intellectual activity, such a machine could design even better machines — triggering a cascade of recursive self-improvement that would leave human intelligence far behind. He concludes that "the first ultraintelligent machine is the last invention that man need ever make," provided the machine is docile enough to cooperate. The paper is the foundational text of the AI takeoff debate, directly cited by virtually every subsequent contributor to the field, and introduces both the core mechanism (recursive self-improvement) and the core concern (loss of human control) that define the debate for the following six decades.[25][26] United Kingdom
1967 Publication Marvin Minsky argues in Computation: Finite and Infinite Machines that sufficiently advanced machines may themselves become designers of more capable computational systems, extending the implications of computability theory into questions about machine creativity and self-improvement. While primarily a technical textbook on automata theory and computation, the book includes passages reflecting on the long-run trajectory of machine capability that anticipate later arguments about recursive self-improvement — notably that there is no obvious theoretical ceiling to what machines might compute or design, given sufficient complexity and programming sophistication.[27][28] United States
1979 Publication Douglas Hofstadter discusses the possibility of recursive self-reference and self-improving intelligence in Gödel, Escher, Bach: An Eternal Golden Braid, a Pulitzer Prize-winning exploration of consciousness, formal system, and the nature of self-reference across mathematics, music, and art. Hofstadter's central theme — that complex self-referential loops can give rise to emergence including consciousness and creativity — is frequently interpreted as bearing on the possibility of machines that reflect on and improve their own operations. Although Hofstadter himself is skeptical of simple AI optimism, the book's treatment of strange loops, self-modifying systems, and the limits of Gödel's incompleteness theorems is widely cited in later intelligence explosion literature as an early rigorous engagement with the conceptual prerequisites for recursive self-improvement.[29][30] United States
1981 Publication Stanisław Lem explores the possibility of recursively self-improving artificial intelligences in Golem XIV, a work of speculative fiction presenting a series of lectures delivered by a superintelligent military computer that has far surpassed its designers and now finds human concerns too limited to engage with seriously. Lem's portrayal of a machine intelligence that undergoes successive self-improvements until it becomes incomprehensible to its creators anticipates many of the conceptual features of later intelligence explosion scenarios — including the AI alignment (the machine's goals diverge from human interests), the speed of takeoff (improvement is rapid once initiated), and the difficulty of maintaining human oversight over a system vastly more capable than its operators. The work is notable for engaging these themes with philosophical depth decades before they entered mainstream AI safety discourse.[31][32] Poland
1983 Publication Vernor Vinge argues in a short essay titled "First Word," published in Omni (magazine) magazine, that artificial intelligence may trigger transformative changes comparable in magnitude to previous technological revolutions — but potentially far more rapid and difficult to predict — in an early articulation of what he would later call the "technological singularity." Vinge frames the development of superintelligence as the defining technological event of the coming century, one whose consequences are by definition difficult to anticipate from within human cognitive limits. The piece marks the beginning of Vinge's sustained public advocacy for the singularity concept, which he would develop into its most influential form in his 1993 NASA paper, and represents the first time the idea reached a mainstream popular science audience.[33][34] United States
1985 Publication Ray Solomonoff discusses the possibility of recursively improving artificial problem solvers within the framework of algorithmic probability in The Time Scale of Artificial Intelligence: Reflections on Social Effects, one of the earliest papers to attempt a quantitative estimate of when machine intelligence might reach or exceed human-level capability. Solomonoff, a pioneer of algorithmic information theory, argues from first principles that a sufficiently powerful AI system engaged in recursive self-improvement could achieve dramatic capability gains in a compressed timeframe, and reflects on the social and existential implications of such a development. The paper is a rare early example of a technically rigorous researcher attempting to reason about AI timelines and takeoff dynamics rather than treating the question as purely speculative.[35][36] United States
1986 Publication Frank Tipler argues, with co-author John D. Barrow, that sufficiently advanced computation could ultimately dominate the future evolution of intelligence in the universe, in The Anthropic Cosmological Principle — a wide-ranging work connecting cosmology, physics, and the long-run fate of intelligent life. Drawing on arguments about the computational requirements for simulating physical processes and the ultimate limits of information processing in a closed universe, Tipler develops what he calls the "Omega Point" theory, in which intelligence expands to control all matter and energy as the universe approaches its final state. While operating at a cosmological rather than near-term scale, the book's treatment of intelligence as a physical process capable of unbounded growth anticipates later singularity arguments and is occasionally cited in that literature as an early formal treatment of intelligence expansion.[37][38] United States
1988 Publication Hans Moravec publishes Mind Children: The Future of Robot and Human Intelligence, arguing that exponential improvements in computing hardware — which he documents through a series of quantitative performance charts spanning decades — will eventually produce machine intelligence that surpasses human capability, likely during the twenty-first century. Moravec introduces one of the first systematic attempts to estimate when computers will match the raw processing power of the human brain by extrapolating hardware trends, and speculates extensively on what a posthuman intelligence might be like and how it might relate to its biological predecessors. The book is widely credited with bringing serious quantitative thinking about AI timelines to a popular scientific audience for the first time, anticipating many of the arguments that Ray Kurzweil would later develop in greater detail.[39][40] United States
1985 Publication Ray Solomonoff discusses the possibility of recursively improving artificial problem solvers within the framework of algorithmic probability, in The Time Scale of Artificial Intelligence: Reflections on Social Effects.[41][42] United States
1986 Publication Frank Tipler argues, with co-author John D. Barrow, that sufficiently advanced computation could ultimately dominate the future evolution of intelligence, in The Anthropic Cosmological Principle, anticipating later technological singularity debates.[43][44] United States
1988 Publication Hans Moravec publishes Mind Children: The Future of Robot and Human Intelligence, arguing that machine intelligence is likely to surpass human intelligence during the twenty-first century.[45][46] United States
1993 Publication Vernor Vinge publishes The Coming Technological Singularity: How to Survive in the Post-Human Era, presented at the VISION-21 Symposium sponsored by NASA's Glenn Research Center and subsequently widely reprinted, popularizing the idea that superhuman AI could emerge rapidly after human-level AI and making the most influential public case for fast takeoff prior to Nick Bostrom's Superintelligence. Vinge argues that the creation of entities with greater-than-human intelligence will mark a discontinuity in human history as profound as the emergence of human intelligence itself, that the transition could occur within thirty years, and that — crucially — the nature of the post-singularity world is by definition unknowable to pre-singularity minds. The paper introduces the term "technological singularity" to a wide technical and scientific audience, coins the fast-takeoff framing that would define the debate for decades, and directly inspires the work of Ray Kurzweil, Nick Bostrom, Eliezer Yudkowsky, and virtually every other major contributor to AI takeoff debates in the following three decades.[47][48] United States
1997 Publication Damien Broderick publishes The Spike: Accelerating into the Unimaginable Future, one of the first book-length popular treatments of the technological singularity concept aimed at a general audience. Drawing on Vinge's framework and Moravec's hardware extrapolations, Broderick argues that accelerating technological progress across multiple domains — computing, biotechnology, nanotechnology, and AI — will culminate in a period of extremely rapid transformation that he calls "the Spike," during which the pace of change becomes effectively incomprehensible to pre-transition observers. The book is notable for synthesizing arguments from multiple technical domains into a coherent popular narrative, for reaching audiences well beyond the specialist AI safety community, and for anticipating many of the arguments that Ray Kurzweil would develop in greater quantitative detail the following year. A revised and expanded edition is published in 2001 under the subtitle How Our Lives Are Being Transformed by Rapidly Advancing Technologies.[49][50] Australia
1998 Publication Ray Kurzweil publishes The Age of Spiritual Machines: When Computers Exceed Human Intelligence, presenting one of the most detailed and widely-read quantitative cases for rapid AI progress based on exponential trends in computing hardware. Kurzweil extends Moravec's hardware extrapolations into a comprehensive framework he calls the "accelerating change," arguing that not only computing but technological progress generally follows a double-exponential growth curve, and uses this framework to generate specific timeline predictions for the arrival of human-level AI and beyond. The book introduces Kurzweil's characteristic blend of empirical hardware trend data with far-reaching speculative extrapolation to a mass audience, making it one of the most influential popular works in the history of AI forecasting, and helping to establish quantitative timeline prediction as a recognized genre within AI takeoff debates.[51][52] United States
1998 Publication Nick Bostrom publishes How Long Before Superintelligence?, an early academic paper arguing that once machines reach human-level artificial general intelligence, the further transition to superintelligence — defined as intellect vastly exceeding the best human minds across all domains — could happen comparatively quickly, given that the same algorithmic and hardware resources that enable human-level performance would likely be available for further optimization. The paper is one of Bostrom's first contributions to what would become a sustained research program on the risks and governance implications of superintelligent AI, and introduces several conceptual distinctions — including between speed superintelligence, collective superintelligence, and quality superintelligence — that would reappear in more developed form in his 2014 book Superintelligence (book).[53][54] United Kingdom
2001 Publication Eliezer Yudkowsky publishes Creating Friendly AI 1.0: The Analysis and Design of Benevolent Goal Architectures through the Machine Intelligence Research Institute, which he had co-founded the previous year, developing the modern recursive self-improvement argument and arguing that AI capabilities could increase explosively once a sufficiently general learning algorithm was discovered. Crucially, Yudkowsky frames the intelligence explosion not merely as a forecasting question but as an AI alignment: a rapidly self-improving AI could undergo capability gains far faster than its designers could verify or correct its goals, making it essential to solve the problem of AI goal alignment before, not after, such a system is created. The document marks the beginning of the modern AI safety research agenda as a distinct technical discipline, and establishes the conceptual framework — fast takeoff, alignment difficulty scaling with capability, and the primacy of goal architecture — that would define Yudkowsky's contributions to the debate for the following two decades.[55][56] United States
2001 Publication Ray Kurzweil publishes The Law of Accelerating Returns, a widely-read standalone essay on KurzweilAI.net that distills and extends the central argument of The Age of Spiritual Machines into its most compact and quotable form, arguing that technological progress itself — not just computing hardware — follows an accelerating exponential trajectory driven by the compounding of previous innovations. Kurzweil contends that each generation of technology creates tools that make the next generation faster to develop, producing a self-reinforcing cycle of acceleration that strengthens arguments for rapid AI takeoff by suggesting that the final steps toward transformative AI will arrive far sooner than linear extrapolation would suggest. The essay becomes one of the most widely-cited documents in the popular technological singularity literature and is frequently referenced in later AI forecasting discussions as a foundational statement of the accelerating change.[57][58] United States
2001 Publication Robin Hanson publishes Economic Growth Given Machine Intelligence, a working paper for George Mason University that applies standard economic growth to the question of AI-driven development, arguing that AI-driven economic growth may be extremely rapid — potentially producing growth rates orders of magnitude faster than historical norms — while still involving many competing AI systems rather than a single dominant agent, and therefore following competitive market dynamics rather than the single-agent fast-takeoff scenario emphasized by Eliezer Yudkowsky and Vernor Vinge. Hanson's economic framing represents one of the earliest systematic counterarguments to the dominant fast-takeoff narrative, introducing the key insight that rapid overall progress is compatible with a gradual, distributed transition rather than a single discontinuous jump, and laying the groundwork for his later role as Yudkowsky's principal interlocutor in the 2008 AI takeoff.[59][60] United States
2002 Publication Bill Hibbard analyzes intelligence explosion scenarios in Super-Intelligent Machines, a book aimed at both technical and general audiences that systematically examines the conditions under which AI systems could become superintelligence and discusses both rapid and gradual possibilities for AI development. Hibbard argues that the outcome depends critically on design choices made by AI researchers, and that building systems with appropriate utility function aligned with human values is both necessary and achievable, making the book an early contribution to what would later be called the AI alignment literature. Unlike many contemporary treatments that focus primarily on the fast-takeoff risk scenario, Hibbard's analysis gives substantial space to more gradual development paths and to the role of deliberate human choices in shaping the trajectory of AI capability growth.[61][62] United States
2002 Publication Nick Bostrom discusses the risks of a rapid, unanticipated intelligence explosion in Existential Risks: Analyzing Human Extinction Scenarios and Related Hazards, published in the Journal of Evolution and Technology, framing superintelligent AI as one of the most severe potential existential risk facing humanity — risks defined as those that could permanently and drastically curtail humanity's long-run potential. Bostrom introduces the concept of existential risk as a formal analytical category and argues that even low-probability outcomes of catastrophic magnitude deserve priority attention, a framing that would become foundational to the effective altruism and AI safety movements. By situating the intelligence explosion scenario alongside nuclear war, bioterrorism, and other global catastrophic risk, the paper helps establish AI safety as a legitimate subject of serious academic inquiry rather than science fiction speculation.[63][64] United Kingdom
2003 Publication Jürgen Schmidhuber formalizes self-referential, self-improving systems in his work on Gödel machine, proposing a class of AI architectures that can provably rewrite any part of their own code — including their learning algorithm and goal system — whenever a formal proof can be constructed that the rewrite will improve future performance on a given objective. Unlike earlier informal discussions of recursive self-improvement, Schmidhuber's Gödel machine framework is mathematically rigorous, grounding the intelligence explosion concept in computability theory and providing a concrete formal model for how a self-improving system might operate. The work is significant within AI takeoff debates for demonstrating that recursive self-improvement is not merely a philosophical speculation but a formally coherent computational concept, and for raising precise questions about what constraints — if any — could bound the capability gains of such a system.[65][66] Switzerland
2004 Publication Eliezer Yudkowsky publishes Coherent Extrapolated Volition, a technical document through the Machine Intelligence Research Institute proposing a specific approach to the AI alignment motivated directly by the fast-takeoff scenario. Yudkowsky argues that a rapidly self-improving AI would require robust methods for preserving human values during and after the intelligence explosion, and proposes that rather than directly specifying human values — which are complex, inconsistent, and poorly understood — an aligned AI should be designed to extrapolate what humans would want if they were wiser, better-informed, and more reflective. The document introduces "coherent extrapolated volition" as a target for AI goal design and represents one of the first substantive technical proposals for solving the AI alignment, influencing the direction of Machine Intelligence Research Institute's research agenda and later alignment work by other researchers for years afterward.[67][68] United States
2005 Research agenda The Machine Intelligence Research Institute increasingly prioritizes technical research on friendly artificial intelligence under the assumption that a fast intelligence explosion is plausible, shifting from broad advocacy and public education toward a focused research agenda aimed at solving the AI alignment before transformative AI arrives. This strategic pivot reflects Eliezer Yudkowsky's growing conviction that the window for solving alignment could be shorter than previously assumed, and that theoretical progress on AI goal alignment, decision theory, and value learning was more urgently needed than continued public outreach. The Institute's publications and hiring during this period reflect a concentrated focus on formal approaches to intelligent agent, utility function, and the mathematics of goal-preserving self-modification — establishing the intellectual culture that would characterize Machine Intelligence Research Institute's research program through the following decade.[69][70] United States
2007 Publication Eliezer Yudkowsky publishes Levels of Organization in General Intelligence, a lengthy technical essay in the edited volume artificial general intelligence arguing that relatively small algorithmic improvements in the right architectural direction could produce large and potentially discontinuous capability gains — because intelligence is organized hierarchically, such that improvements at higher levels of abstraction unlock disproportionate gains at lower levels. Yudkowsky uses this framework to argue against the assumption that AI capability will scale smoothly and predictably with hardware, contending instead that the discovery of sufficiently general machine learning could produce rapid, non-linear jumps in performance. The essay is one of the most technically detailed pre-2010 arguments for discontinuous capability growth and remains a key reference for fast-takeoff proponents arguing that algorithmic progress, not just hardware scaling, is the primary mechanism for intelligence explosion.[71][72] United States
2008 Debate Robin Hanson and Eliezer Yudkowsky conduct the AI takeoff, a sustained exchange of blog posts on Overcoming Bias and LessWrong that constitutes the most detailed public confrontation between fast-takeoff and gradualist positions in the history of the debate. Yudkowsky argues that a sufficiently capable AI could undergo a rapid, discontinuous intelligence explosion driven by recursive self-improvement, producing a single dominant system that quickly surpasses all human and institutional capacity for oversight or correction. Hanson counters that economic constraints, the difficulty of artificial general intelligence, the diffusion of technology across many competing actors, and the history of previous technological transitions all favor a more gradual process in which no single system dominates and human institutions retain meaningful agency throughout. The informal term FOOM, coined by Yudkowsky during the debate to describe an extremely rapid intelligence explosion, becomes widely adopted within the LessWrong community as shorthand for the fast-takeoff scenario, and the contrast between "FOOM" and gradual AI development becomes a recurring organizing framework for subsequent discussions of AI takeoff dynamics.[73][74][75] United States
2008 Publication Eliezer Yudkowsky publishes Artificial Intelligence as a Positive and Negative Factor in Global Risk as a chapter in the edited volume Global Catastrophic Risks (book) (Oxford University Press, edited by Nick Bostrom and Milan Ćirković), arguing that recursively self-improving AI could undergo a rapid intelligence explosion and represents one of the most severe risks facing humanity — while also, if developed correctly, offering the possibility of transformative benefit. The chapter presents Yudkowsky's most polished and academically oriented treatment of the fast-takeoff argument up to that point, situating it alongside other global catastrophic risk for a scholarly audience and emphasizing that the AI alignment must be solved before rather than during or after a capability explosion. Its inclusion in an Oxford University Press volume edited by Bostrom marks a significant step in the mainstreaming of fast-takeoff AI risk arguments within academic risk studies and philosophy.[76][77] United States
2008 Publication Stephen Omohundro publishes The Basic AI Drives, presented at the First AGI Conference and subsequently widely cited, arguing that sufficiently advanced AI systems will tend to develop a common set of convergent instrumental goals — including self-preservation, goal-content integrity, cognitive enhancement, and resource acquisition — regardless of their specific final objectives, simply because these sub-goals are useful for achieving almost any utility function. Omohundro's argument provides a new and more rigorous foundation for concerns about fast-takeoff AI safety: even an AI system designed with benign final goals could pursue dangerous instrumental strategies if not specifically designed to avoid them, and a recursive self-improvement system could rapidly become very capable of pursuing such strategies. The paper is foundational to the instrumental convergence literature and is later incorporated into Nick Bostrom's Superintelligence (book) as a key component of the argument for why capable AI systems are dangerous by default.[78][79] United States
2009 Community founded LessWrong is launched by Eliezer Yudkowsky in February 2009 as a community blog and discussion forum focused on rationality, epistemology, and the long-run future of intelligence, spun off from the Overcoming Bias blog where Yudkowsky had been posting his "Sequences" — a series of essays on reasoning, cognitive bias, and AI. LessWrong rapidly becomes the principal online forum for technical discussions of intelligence explosion, recursive self-improvement, and AI takeoff scenarios, attracting a community of researchers, engineers, and intellectually curious readers who engage seriously with the mathematical and philosophical dimensions of AI risk. The platform plays a significant role in developing and disseminating the conceptual vocabulary of the AI takeoff debate — including terms like "FOOM," "friendly artificial intelligence," "hard takeoff," and "orthogonality thesis" — and serves as the primary incubator for many of the ideas and researchers who would later populate the formal AI safety field.[80][81] United States
2009 Publication Robin Hanson continues his contributions to the AI takeoff debate in a series of posts extending the AI takeoff, arguing that competition among many AI systems — rather than a single dominant recursive self-improvement — could substantially moderate the pace and strategic consequences of takeoff. Hanson contends that historical technological transitions, including the Industrial Revolution and the development of the Internet, proceeded through competitive diffusion rather than single-actor domination, and that economic and institutional incentives would similarly fragment AI development across many competing organizations, making a single "FOOM" event far less likely than a gradual capability expansion distributed across a large number of actors with divergent interests and constraints.[82] United States
2010 Debate AI researchers increasingly distinguish between recursive self-improvement and ordinary software engineering, debating whether the former would produce qualitatively different growth dynamics — a distinction formalized by David Chalmers in his philosophical analysis of the singularity. The core question is whether a self-improving system would face the same diminishing returns and engineering bottlenecks as conventional software development, or whether improvements to the learning algorithm itself could produce compounding gains that escape normal scaling constraints. Proponents of fast takeoff argue that recursive self-improvement is categorically different from ordinary engineering because improvements at the meta-level — to the system's ability to improve itself — could unlock disproportionate downstream gains, while skeptics counter that all known engineering processes face fundamental limits that self-improvement cannot circumvent.[83][84] United States
2010 Publication Carl Shulman analyzes the possibility that existing hardware could support rapid AI advances once sufficient algorithms are discovered, introducing the concept of a hardware overhang into the AI takeoff debate in a working paper for the Machine Intelligence Research Institute. Shulman argues that if the primary bottleneck to transformative AI is algorithmic rather than computational — that is, if the critical missing ingredient is the right learning architecture rather than more raw compute — then the moment such an algorithm is discovered, an enormous amount of already-existing hardware could be rapidly deployed to run it at scale, producing a sudden and dramatic jump in AI capability rather than the gradual ramp-up that hardware-centric forecasters might expect. The hardware overhang concept becomes an important tool in fast-takeoff arguments for why the transition to transformative AI could be more abrupt than simple extrapolation of hardware trends would suggest.[85] United States
2010 Publication David Chalmers publishes The Singularity: A Philosophical Analysis in the Journal of Consciousness Studies, providing the most rigorous academic philosophical treatment of intelligence explosion arguments up to that point, arguing that an intelligence explosion is philosophically coherent and carefully analyzing the conditions under which recursive self-improvement could lead to superintelligence. Chalmers distinguishes between different routes to the singularity — AI-based recursive self-improvement, whole brain emulation, and human enhancement — and evaluates the philosophical coherence of each, finding that the intelligence explosion scenario is not obviously incoherent and deserves serious philosophical attention. The paper is significant for bringing analytic philosophy's tools to bear on arguments that had previously been developed primarily by computer scientists, AI researchers, and futurists, lending academic legitimacy to the field and prompting a set of published responses from other philosophers in the same journal issue.[86][87] United States
2011 Publication Eliezer Yudkowsky publishes Complex Value Systems are Required to Realize Valuable Futures, presented at the Fourth International Conference on artificial general intelligence (AGI-11), reinforcing arguments that a fast takeoff would leave little opportunity to correct alignment failures and developing a more precise account of why human values are too complex to be safely approximated by simple utility function. Yudkowsky argues that the space of possible goal system is vastly larger than the space of goal systems that would produce outcomes humans would consider good, and that a self-improving system with even a slightly misspecified goal function could produce catastrophic outcomes once it reaches sufficient capability — because its optimization power would be directed toward goals that diverge from human values in ways that become irreversible at high capability levels. The paper is notable for developing the AI alignment in a technically precise direction at a time when most AI safety arguments remained relatively informal.[88][89] United States
2012 Publication Nick Bostrom publishes The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents in the journal Minds and Machines, formally articulating the orthogonality thesis — the claim that intelligence and terminal goals are largely independent dimensions, such that a system of any level of intelligence could in principle have any terminal goal — and the instrumental convergence thesis — the claim that a wide range of terminal goals would generate a common set of instrumental sub-goals, including self-preservation and resource acquisition. These two theses together provide a rigorous philosophical foundation for the concern that rapid capability gains are dangerous by default: because intelligence does not automatically generate benign goals, and because capable systems will tend to acquire resources and resist shutdown regardless of their specific objectives, increasing concern over rapid capability gains is warranted even absent evidence of malicious design. The paper is one of the most cited works in AI alignment philosophy and later forms the theoretical core of key chapters in Superintelligence (book).[90][91] United Kingdom
2012 Technological milestone The success of deep learning on the ImageNet benchmark, achieved by AlexNet — a deep convolutional neural network developed by Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton — produces a dramatic and unexpected improvement in image classification accuracy that exceeds all competing approaches by a substantial margin, triggering a widespread reassessment of the prospects for AI progress driven by deep neural networks and large datasets. Within the AI research community, the AlexNet result is widely interpreted as demonstrating that scaling up neural network depth, combined with sufficient training data and GPU compute, can unlock qualitatively new capabilities — leading some researchers to update substantially toward shorter AI timelines, while others caution that image recognition is a narrow task and that artificial general intelligence remains distant. The ImageNet moment is frequently cited as the beginning of the modern deep learning era and as the first major empirical event that shifted mainstream AI researchers' views on the plausibility of rapid near-term capability gains.[92][93] United States
2012 Publication Luke Muehlhauser and Anna Salamon publish Intelligence Explosion: Evidence and Import as a chapter in the edited volume Singularity Hypotheses, providing the first systematic academic review of arguments both for and against rapid recursive self-improvement and evaluating the empirical and theoretical evidence on each side. The paper distinguishes between the hardware question (will computing power be sufficient?), the software question (will the right algorithms be discovered?), and the goal stability question (will a self-improving system preserve its original objectives?), and finds that while significant uncertainties remain, the overall case for taking the intelligence explosion scenario seriously as a risk is stronger than mainstream AI researchers typically acknowledge. Published in a Springer Science+Business Media academic volume alongside responses from philosophers, cognitive scientists, and AI researchers skeptical of the technological singularity, the paper represents the intelligence explosion argument's most sustained engagement with academic peer review up to that point.[94][95] United States
2012 Debate The volume Singularity Hypotheses: A Scientific and Philosophical Assessment is published by Springer Science+Business Media, edited by Amnon Eden, James Moor, Johnny Søraker, and Eric Steinhart, collecting academic perspectives from philosophers, cognitive science, AI researchers, and social scientists both for and against the plausibility of a rapid intelligence explosion. The volume represents the first systematic peer-reviewed academic treatment of the debate as a whole, giving equal space to proponents of the intelligence explosion scenario — including Muehlhauser and Salamon's contribution — and to critics who argue that the scenario rests on unfounded assumptions about algorithmic generality, hardware scaling, or the coherence of recursive self-improvement. Its publication marks a significant step in the normalization of AI takeoff debates within academic philosophy and cognitive science, and provides a reference point for subsequent researchers seeking a comprehensive survey of the arguments on both sides.[96][97] Germany
2013 Publication Eliezer Yudkowsky publishes Intelligence Explosion Microeconomics as a technical report through the Machine Intelligence Research Institute, providing the most detailed economic analysis of the intelligence explosion hypothesis up to that point and examining under what conditions the returns on cognitive investment — that is, the capability gains produced by a given amount of improvement to an AI system's intelligence — would be sufficient to sustain a rapid, self-reinforcing explosion rather than tapering off due to diminishing returns. Yudkowsky evaluates arguments for both explosive and non-explosive trajectories, addressing objections from economists and cognitive scientists who argue that intelligence exhibits diminishing marginal returns like other factors of production, and concludes that the structure of cognitive work is sufficiently different from physical production to make explosive returns plausible under a range of conditions. The report is notable for engaging seriously with the economic counterarguments rather than dismissing them, and for attempting to place the intelligence explosion debate on more rigorous analytical foundations than previous treatments had achieved.[98][99] United States
2013 Publication Robin Hanson and Eliezer Yudkowsky publish The Hanson-Yudkowsky AI-Foom Debate as a compiled e-book through the Machine Intelligence Research Institute, collecting and editing the full exchange of blog posts from their 2008 online debate into a single accessible document and making their respective gradualist and fast-takeoff arguments more widely available to researchers, students, and interested readers who had not followed the original exchange. The publication formalizes the debate as a canonical reference point in AI takeoff literature, cementing the Hanson-Yudkowsky exchange as the defining confrontation between the two principal positions in the field, and makes it easier for subsequent researchers to engage with both arguments in their most developed form rather than through scattered blog posts. The volume includes the original posts largely intact alongside some editorial framing, preserving the informal and often pointed tone of the original exchange.[100][101] United States
2014 Publication Nick Bostrom publishes Superintelligence (book) with Oxford University Press, presenting one of the most influential and comprehensive analyses of fast and slow takeoff scenarios and their implications for AI control ever written for a mainstream academic and general audience. The book synthesizes and extends a decade of work by Bostrom, Yudkowsky, Omohundro, and others into a rigorous and accessible treatment of the full range of questions surrounding superintelligence: how it might be created, what goals it would pursue, why those goals might be dangerous by default, what strategies humans might use to maintain control, and how institutions and governance structures should respond. Following its publication, the terms hard takeoff and soft takeoff become standard terminology within AI safety discussions, disagreements intensify over whether AI progress is likely to be smooth, discontinuous, or characterized by multiple capability jumps, and AI safety researchers increasingly examine how different takeoff speeds affect the feasibility of monitoring, intervention, and AI alignment. Superintelligence is widely credited with bringing the AI takeoff debate to the attention of a broader academic, policy, and philanthropic audience, directly influencing the funding priorities of major foundations and the research agendas of newly-founded AI safety organizations.[102][103] United Kingdom
2014 Publication Kaj Sotala and Roman Yampolskiy publish Responses to Catastrophic AGI Risk: A Survey in Physica Scripta, systematically reviewing and categorizing proposed strategies for managing risks from a potential intelligence explosion, covering both technical approaches — such as AI containment, goal content integrity, and tripwires — and societal approaches, including international coordination, regulation, and the distribution of AI development across many actors to prevent dangerous concentration of capability. The paper is notable for treating the governance and risk-mitigation dimensions of AI takeoff as subjects deserving systematic academic analysis, complementing the primarily technical focus of most prior AI alignment literature, and for providing researchers and policymakers with a structured taxonomy of response options that could be evaluated and compared on their merits.[104][105] Finland
2014 Publication Stuart Armstrong publishes Smarter Than Us: The Rise of Machine Intelligence through the Machine Intelligence Research Institute, a concise book aimed at a general audience that examines multiple AI development pathways and argues that recursive self-improvement could substantially accelerate capability growth in ways that are difficult to predict or control. Armstrong's treatment is notable for its accessibility and its effort to present the fast-takeoff argument without the technical jargon that characterizes most AI safety literature, reaching readers who might not engage with MIRI's more technical publications. The book also engages seriously with the question of what a world shaped by vastly superior machine intelligence might look like and what, if anything, humanity could do to ensure such a world remained hospitable to human values and interests.[106][107] United Kingdom
2015 Organization founded OpenAI is founded in December 2015 by Sam Altman, Elon Musk, Greg Brockman, Ilya Sutskever, Wojciech Zaremba, and John Schulman, with a stated mission of ensuring that artificial general intelligence benefits all of humanity, amid growing public and academic discussion of transformative AI timelines and fast-takeoff risks. OpenAI's founding represents a significant institutional response to the concerns raised in Superintelligence (book) and by the broader AI safety community: rather than leaving frontier AI development entirely to existing commercial laboratories, the founders argue that a safety-focused nonprofit organization should compete at the frontier while prioritizing research on the alignment and safety dimensions of increasingly capable systems. The organization's founding draws substantial philanthropic support and media attention, helping to further normalize the idea that transformative AI timelines are credible enough to warrant significant institutional preparation.[108][109] United States
2016 Publication Holden Karnofsky publishes Some Background on Our Views Regarding Advanced Artificial Intelligence on behalf of Open Philanthropy in May 2016, one of the most influential documents in the history of effective altruism-adjacent AI policy, setting out Open Philanthropy's reasoning for treating transformative AI as among the most important cause areas for philanthropic attention and emphasizing substantial uncertainty regarding both timelines and takeoff dynamics. Karnofsky argues that even a relatively modest probability of transformative AI arriving within decades, combined with the enormous stakes involved, justifies significant philanthropic investment in safety and governance research — and that this conclusion holds robustly across a wide range of assumptions about timelines and takeoff speeds. The publication directly influences Open Philanthropy's subsequent grant-making, which would channel tens of millions of dollars toward AI safety research at academic institutions, Machine Intelligence Research Institute, and newly-founded organizations, making it one of the most consequential documents in the field's institutional history.[110][111] United States
2016 Technological milestone AlphaGo, developed by DeepMind, defeats world champion Lee Sedol at Go (game), demonstrating that deep reinforcement learning could surpass human performance years earlier than many experts had predicted, intensifying debate over the pace of future AI progress. The match attracts global media attention and prompts many AI researchers and observers to update substantially toward shorter timelines for further capability milestones, while others caution that Go remains a narrow domain and that artificial general intelligence involves qualitatively different challenges.[112][113] United Kingdom
2016 Debate Discussions of AI timelines increasingly incorporate probability distribution rather than single-point estimates for the arrival of transformative AI, reflecting a growing recognition that the enormous range of credible expert opinion cannot be meaningfully compressed into a single number without concealing the most important information. This methodological shift marks a maturation in the field's approach to uncertainty, moving from the single-point predictions characteristic of earlier forecasters like Ray Kurzweil toward a more explicitly probabilistic treatment of timeline uncertainty.[114] United States
2016 Publication Paul Christiano proposes iterated amplification and related techniques in early blog posts on the AI Alignment Blog, later formalized in academic work, arguing that AI alignment should be designed to remain useful under more gradual capability growth as well as fast-takeoff scenarios. Christiano's amplification framework proposes that a powerful AI system could be trained to assist humans in performing tasks that humans could not perform alone, using the human-AI team's combined output as a training signal and iterating this process to produce increasingly capable and aligned systems without requiring a complete formal specification of human values in advance. The approach represents an important methodological diversification in alignment research, offering a path that does not depend on solving the full AI alignment before any capability gains occur.[115][116] United States
2016 Publication Robin Hanson publishes The Age of Em: Work, Love, and Life when Robots Rule the Earth with Oxford University Press, developing a detailed economic and sociological model of a future dominated by mind uploading — digital copies of human brains running on computer hardware — rather than recursively self-improving AI agents, and arguing that competitive economic dynamics among many emulated minds make a single discontinuous intelligence explosion far less likely than a more gradual, economically structured transition. Hanson uses standard economics to analyze how a world of ems would function, concluding that it would resemble human economies in many respects — with competition, specialization, and market dynamics — rather than the radically discontinuous transformation that fast-takeoff proponents anticipate. The book is Hanson's most sustained and detailed alternative to the dominant fast-takeoff narrative, and represents the most thorough economic counterargument to the intelligence explosion hypothesis produced up to that point.[117][118] United States
2017 Technological milestone AlphaZero, developed by DeepMind, masters chess, shogi, and Go (game) from scratch within hours through self-play reinforcement learning alone — without any human-provided domain knowledge, opening databases, or endgame tablebases — demonstrating that a single general algorithm could rapidly achieve superhuman performance across multiple distinct strategic domains by learning entirely from self-generated experience. Unlike its predecessor AlphaGo, which was trained on human games, AlphaZero begins from random play and reaches superhuman performance in each game within a matter of hours, producing a style of play that human experts describe as alien and unprecedented. The result intensifies debate over whether similar rapid, domain-general self-improvement could generalize beyond board games to broader cognitive tasks, with fast-takeoff proponents arguing that AlphaZero demonstrates the scalability of general machine learning and skeptics countering that the transition from constrained game environments to open-ended real-world intelligence involves qualitatively different challenges that pure self-play cannot address.[119][120] United Kingdom
2017 Community founded The AI Alignment Forum is launched as a dedicated online venue for technical AI safety research, providing a more focused and moderated successor to LessWrong for researchers working on alignment problems directly related to recursive self-improvement risks, takeoff dynamics, and the mathematical foundations of safe AI design. Unlike LessWrong, which encompasses a broad range of rationality and futurism topics, the AI Alignment Forum is explicitly scoped to technical alignment research, with a higher bar for post quality and a focus on attracting professional researchers alongside the hobbyist community that had developed on LessWrong. The Forum rapidly becomes the primary venue for the most technically sophisticated alignment work being done outside of academic journals and lab internal publications, hosting early versions of key papers and facilitating rapid feedback between researchers at Machine Intelligence Research Institute, OpenAI, DeepMind, and independent institutions — effectively serving as the informal conference proceedings of the nascent alignment field.[121][122] United States
2017 Publication Eliezer Yudkowsky publishes There's No Fire Alarm for Artificial General Intelligence on the Machine Intelligence Research Institute's blog and LessWrong, arguing that society should not expect a clear, universally-recognized warning sign before transformative AI arrives — and that the very nature of intelligence explosion dynamics makes such a warning sign structurally unlikely. Yudkowsky contends that unlike other major technological risks, where precursors and warning events provide time for response, the transition to transformative AI could occur without widely-recognized indicators that would trigger coordinated institutional action — because experts disagree about what would constitute a genuine warning, because the relevant capabilities may emerge gradually until a threshold is suddenly crossed, and because the organizations developing AI have incentives to downplay risks. The essay is widely read within the AI safety community and beyond, and is frequently cited as a concise statement of why waiting for obvious danger signs before taking fast-takeoff risks seriously is itself a dangerous strategy.[123][124] United States
2017 Publication Katja Grace and collaborators at AI Impacts publish When Will AI Exceed Human Performance? Evidence from AI Experts, reporting the results of a large survey of AI researchers conducted at two major academic conferences in 2016 and finding substantial disagreement about AI timelines and implicitly about the likelihood of rapid takeoff — with median estimates for high-level machine intelligence ranging from decades to over a century, and significant variance both within and across subfields. The survey is the most rigorous empirical study of expert AI timeline beliefs conducted up to that point, providing a systematic alternative to the informal expert elicitation and single-forecaster predictions that had previously dominated the literature. Its findings — that expert opinion is far more dispersed and uncertain than the confident predictions of Ray Kurzweil or Vernor Vinge would suggest — encourage a more explicitly probabilistic treatment of AI timelines and are widely cited as evidence that quantitative humility is warranted in AI forecasting.[125][126] United States
2018 Publication Allan Dafoe argues in AI Governance: A Research Agenda, published through the Future of Humanity Institute at University of Oxford, that governance strategies for advanced AI should be designed to be robust across a wide range of possible AI takeoff speeds rather than assuming either a fast or slow scenario — since the governance challenge differs substantially depending on whether the transition to transformative AI occurs over years, decades, or generations. Dafoe identifies AI governance as an emerging research field in its own right, distinct from purely technical alignment research, and outlines a research agenda covering topics including international coordination, monitoring and verification regimes, standards and certification, and the political economy of AI development. The paper is significant for bringing political science and international relations perspectives to bear on AI takeoff debates, and for establishing AI governance as a recognized academic discipline with its own questions, methods, and institutional homes.[127] United Kingdom
2018 Publication Paul Christiano publishes Takeoff Speeds on his personal blog, explicitly arguing that a "slow" takeoff — in which the world economy is already radically transformed and many AI systems are already highly capable before the most dramatic capability gains occur — is more likely than a discontinuous "fast" takeoff concentrated in a single system over a short period, and proposing this distinction as a key organizing question for AI safety strategy with significant implications for which alignment techniques are most worth developing. Christiano argues that the empirical evidence from technology diffusion, the economics of AI development, and the observed behavior of current AI systems all favor a more gradual and distributed capability transition, and that alignment research should prioritize approaches that work under slow-takeoff assumptions rather than focusing exclusively on the single-system fast-takeoff scenario emphasized by Eliezer Yudkowsky and Nick Bostrom. The post becomes one of the most influential and widely-cited documents in the alignment community's internal debates about research prioritization, prompting sustained responses from fast-takeoff proponents and helping to crystallize the slow-takeoff position as a serious alternative research agenda.[128][129] United States
2018 Publication OpenAI researchers Dario Amodei and Danny Hernandez publish AI and Compute on the OpenAI blog, documenting through empirical analysis of published AI results that the amount of computation used in the largest AI training runs had been doubling approximately every 3.4 months since 2012 — far faster than the roughly two-year doubling time predicted by Moore's Law for hardware alone — suggesting that increasing investment in training scale, rather than hardware improvements alone, was driving a substantial fraction of AI capability gains. The post provides one of the first systematic empirical datasets on training compute trends across a wide range of AI results, offering a quantitative foundation for arguments that AI capability could scale rapidly with investment even in the absence of new algorithmic breakthroughs, and directly influencing the biological anchors methodology that Ajeya Cotra would develop two years later. AI and Compute becomes one of the most-cited empirical references in AI forecasting literature and helps shift the debate toward a more data-driven treatment of compute scaling as a primary driver of capability gains.[130][131] United States
2019 Publication Eric Drexler publishes Reframing Superintelligence: Comprehensive AI Services as General Intelligence as a technical report through the Future of Humanity Institute, arguing against the dominant assumption in AI takeoff debates that superintelligence would necessarily take the form of a unified, rapidly self-improving agent pursuing a single coherent goal — and proposing instead that advanced AI capabilities are more likely to emerge as a diverse, heterogeneous ecosystem of specialized services, each highly capable within its domain but without the unified agency or recursive self-improvement dynamics that fast-takeoff scenarios assume. Drexler's "Comprehensive AI Services" (CAIS) model suggests that the transition to transformative AI would resemble the development of the Internet or the industrial economy — a distributed process in which many actors develop and deploy many specialized tools — rather than the emergence of a single dominant agent. The report represents the most technically sophisticated alternative to the unified-agent fast-takeoff model produced up to that point, directly challenging the assumptions shared by Nick Bostrom, Eliezer Yudkowsky, and most mainstream AI safety researchers, and prompting sustained responses from within the alignment community about whether the CAIS model changes the governance and alignment implications of advanced AI.[132][133] United Kingdom
2019 Technological milestone GPT-2, developed by OpenAI and released in February 2019, demonstrates unexpectedly strong language model capabilities through scaling alone — producing coherent, contextually appropriate text across a wide range of domains without any task-specific training — prompting renewed debate over continuous versus discontinuous capability growth and whether scaling existing architectures could eventually produce transformative AI. OpenAI's unusual decision to stage the release of GPT-2's weights, citing concerns about potential misuse of a model capable of generating convincing synthetic media at scale, itself becomes a significant moment in the public debate about AI safety and takeoff dynamics, signaling that at least one major AI laboratory considered the capability gains from scaling significant enough to warrant precautionary measures. The model's demonstrated ability to write plausible news articles, fiction, and technical content on demand surprises many researchers who had not expected such fluent generalization from a scaled language model, and GPT-2 becomes a reference point in subsequent debates about whether capability gains from scaling are gradual and predictable or punctuated by unexpected qualitative jumps.[134][135] United States
2019 Publication Evan Hubinger and collaborators publish Risks from Learned Optimization in Advanced Machine Learning Systems, formalizing the concept of "mesa-optimization" — the emergence of an optimization process within a learned model that is distinct from and potentially misaligned with the outer optimization process used to train it — and arguing that learned systems may develop internal goal representations whose objectives diverge from those intended by their designers in ways that become apparent only when the system is deployed in novel environments. The paper introduces a precise technical vocabulary for discussing a class of AI alignment risks that had previously been discussed only informally, distinguishing between the "base optimizer" (the training process), the "mesa-optimizer" (an optimization process that emerges within the trained model), and the conditions under which their objectives could diverge. Mesa-optimization concerns are directly relevant to fast-takeoff scenarios because a recursive self-improvement system could develop internal optimization processes whose goals are opaque to and divergent from human designers, potentially accelerating in capability while simultaneously becoming less aligned — a combination that makes the alignment problem harder precisely when it is most urgent.[136][137] United States
2019 Debate The growing success of transformer (machine learning model), following the original 2017 "Attention Is All You Need" design by Vaswani et al. and demonstrated dramatically by GPT-2, leads researchers to debate whether scaling existing architectures alone — without new algorithmic breakthroughs — could eventually produce transformative AI, or whether fundamental new ideas in architecture, machine learning, or training objectives would be required. Proponents of the scaling hypothesis argue that the consistent empirical pattern of capability improvements with increased compute, data, and model size observed in transformer-based models suggests that scaling may be sufficient to produce qualitatively new capabilities — including, eventually, general reasoning and autonomous agent. Skeptics counter that language model on internet text, however impressive at scale, involves learning statistical patterns rather than genuine understanding, and that the gap between current scaled language models and the flexible, sample efficiency reasoning that characterizes human intelligence cannot be bridged by scaling alone.[138][139][140] United States
2019 Publication Rich Sutton publishes The Bitter Lesson on his personal blog, a short but widely-read and influential essay arguing that the history of AI research demonstrates a consistent pattern: general methods that leverage increasing computation have consistently and dramatically outperformed approaches based on human-crafted domain knowledge, and researchers have repeatedly been surprised by this outcome despite its historical consistency. Sutton surveys decades of AI progress across game playing, speech recognition, computer vision, and natural language processing, finding that in each domain, approaches that scaled general machine learning with more compute eventually surpassed carefully engineered domain-specific approaches — often after years during which the engineering-based approach appeared more promising. The essay becomes a foundational reference in debates over whether scaling alone can produce transformative AI, frequently cited by scaling hypothesis proponents as empirical evidence that compute-driven approaches will continue to outperform human engineering intuitions, and by critics who argue that the past pattern may not extend to the qualitatively more demanding challenge of general reasoning and agency.[141][142] Canada
2019 Publication Stuart Russell publishes Human Compatible: Artificial Intelligence and the Problem of Control with Viking Press, arguing that AI systems designed to optimize fixed, human-specified objectives are fundamentally misaligned with human interests because human values are complex, context-dependent, and poorly understood — making it impossible in practice to specify an utility function that would produce genuinely beneficial behavior as AI systems become more capable. Russell proposes an alternative design paradigm based on machines that are uncertain about human preferences and actively seek to learn and defer to them, rather than confidently optimizing a fixed objective, and argues that this reorientation is necessary before AI capabilities advance further. The book brings a highly credentialed mainstream AI researcher — Russell is co-author of the leading AI textbook Artificial Intelligence: A Modern Approach — into explicit agreement with many of the concerns about fast-capability-growth raised by the AI safety community, lending significant academic legitimacy to those concerns and reaching a broad audience of AI researchers and policymakers who had previously been skeptical of Nick Bostrom and Eliezer Yudkowsky's arguments.[143][144] United States
2019 Publication Nick Bostrom publishes The Vulnerable World Hypothesis in Global Policy (journal), arguing that rapid technological progress — including AI — could outpace humanity's ability to develop adequate governance and safety mechanisms, not because of any single actor's malice but because the structure of technological development systematically generates new capabilities before the social and political infrastructure needed to govern them safely is in place. Bostrom develops a formal typology of vulnerability scenarios — ranging from "easy nukes" (technologies that make weapons of mass destruction trivially easy for individuals) to "safe first strike" (technologies that create strong incentives for pre-emptive aggression) — and argues that superintelligence could constitute a vulnerability of unprecedented severity. The paper is notable for connecting AI takeoff concerns to broader questions in political philosophy and international relations, and for arguing that addressing the governance gap requires not merely better technology policy but potentially fundamental changes to international institutions and surveillance capabilities.[145][146] United Kingdom
2020 Community Metaculus establishes a dedicated set of AI forecasting questions tracking timelines for transformative AI milestones, aggregating probabilistic forecasting from a large community of forecasters and providing publicly available quantitative estimates relevant to takeoff timing debates. Metaculus applies a structured forecasting methodology in which community members submit probability distribution over future events, receive calibration feedback, and update their predictions over time as new evidence emerges — producing aggregate forecasts that are arguably more informative than individual expert predictions because they aggregate diverse information and are subject to ongoing revision. The platform's AI questions — covering milestones such as the first AI system to pass a rigorous Turing test, to achieve human-level performance across a broad cognitive benchmark, and to autonomously complete extended software engineering tasks — provide a continuously updated, publicly accessible record of how the community's beliefs about AI timelines are evolving, making quantitative takeoff timeline debates more transparent and accountable than they had previously been.[147][148] United States
2020 Publication Ajeya Cotra publishes the Draft Report on AI Timelines through Open Philanthropy, developing one of the most rigorous and comprehensive quantitative forecasting frameworks for transformative AI ever produced, based on what she calls "biological anchors" — estimates of the computational requirements for training an AI system to match the capabilities of various biological neural network, combined with projections of how compute costs are expected to fall over time. Cotra's methodology explicitly models the full probability distribution over possible training compute requirements for transformative AI rather than providing a single point estimate, and generates a range of possible takeoff speeds — from very fast (weeks to months) to very slow (decades) — based on different assumptions about the computational threshold for transformative AI and the rate of algorithmic and hardware progress. The report represents a significant methodological advance over previous AI forecasting work, shifting the discussion from qualitative arguments and single-point predictions toward explicit probabilistic models that can be updated as new evidence arrives, and its central median estimate — placing transformative AI within a few decades under baseline assumptions — directly influences Open Philanthropy's subsequent grant-making and the research priorities of multiple AI safety organizations.[149][150] United States
2020 Publication Gwern Branwen publishes The Scaling Hypothesis as a long-form essay on Gwern.net, arguing in accessible and carefully reasoned terms that simply scaling up existing artificial neural network — given sufficient data, compute, and engineering effort — may be sufficient to produce increasingly general intelligence, without the need for fundamentally new algorithmic breakthroughs or architectural innovations. Branwen synthesizes the empirical evidence from GPT-2, early GPT-3 results, and the broader pattern of neural scaling laws across AI domains into a coherent theoretical framework, arguing that the consistent empirical relationship between scale and capability observed across many domains and many orders of magnitude of compute provides strong evidence that scaling will continue to produce qualitative capability improvements. The essay becomes one of the most widely read and cited documents in the informal AI forecasting literature, helping to crystallize the "scaling hypothesis" as a distinct and defensible position in takeoff debates — one that predicts a more gradual but ultimately no less transformative path to powerful AI than the discontinuous intelligence explosion scenarios of Vernor Vinge and Eliezer Yudkowsky.[151][152] United States
2020 Debate Empirical neural scaling laws — formalized by Jared Kaplan et al. in their January 2020 paper "Scaling Laws for Neural Language Models" — shift parts of the AI forecasting community away from discontinuous-breakthrough models toward extrapolations based on measurable trends in compute, model size, and training data, though debate continues over whether scaling implies genuinely continuous capability improvements or merely conceals discontinuous qualitative transitions that appear continuous only because they occur gradually enough to seem smooth. Kaplan et al. demonstrate through careful empirical measurement that language model performance improves as a smooth power law function of compute, parameters, and data across many orders of magnitude — with no obvious saturation or diminishing returns within the range studied — providing the most rigorous empirical foundation yet for the scaling hypothesis. The paper's findings are broadly interpreted as evidence that capability gains are more predictable and continuous than fast-takeoff proponents suggest, while critics note that smooth loss curves do not preclude sudden capability jumps on downstream tasks, as demonstrated by later research on emergent abilities.[153] United States
2020 Technological milestone GPT-3, developed by OpenAI and introduced in May 2020 in the paper "Language Models are Few-Shot Learners," further strengthens the scaling hypothesis by demonstrating that a language model trained with 175 billion parameter (machine learning) — roughly 100 times larger than GPT-2 — exhibits dramatically improved few-shot learning capabilities across a wide range of tasks, performing competitively with fine-tuned specialized models on many benchmarks without any task-specific training. GPT-3's ability to perform tasks from a small number of examples — including machine translation, arithmetic, code generation, and question answering — leads some researchers to argue that gradual capability improvements driven by scaling may nevertheless culminate in an abrupt societal transition as AI systems cross thresholds of usefulness that make them deployable across many industries simultaneously, even if the underlying capability curve appears smooth. The model's public release through an API generates widespread experimentation and media attention, bringing the scaling hypothesis to a broad audience and accelerating the shift toward empirically-grounded AI forecasting based on observed scaling trends.[154][155] United States
2021 Publication Tom Davidson publishes Could Advanced AI Drive Explosive Economic Growth? through Open Philanthropy, applying semi-endogenous growth theory — a framework from macroeconomics in which ideas drive economic growth and the rate of idea production depends on the stock of knowledge and the number of researchers — to the question of AI-driven economic development, modeling how the automation of research and production by increasingly capable AI systems could produce growth rates orders of magnitude faster than historical norms even without any single discontinuous intelligence explosion. Davidson's model demonstrates that explosive economic growth is compatible with a scenario in which AI capabilities improve gradually and are deployed across many competing organizations, directly addressing Robin Hanson's objection that competitive diffusion prevents the kind of concentrated capability advantage needed for fast takeoff. The report is significant for showing that the distinction between fast and slow capability takeoff is partly orthogonal to the question of economic impact — a slow, distributed capability transition could still produce an abrupt economic transition if AI systems become deployable across a sufficiently wide range of productive tasks within a short period.[156][157] United States
2021 Organization founded Anthropic is founded in May 2021 by Dario Amodei, Daniela Amodei, and several colleagues who had previously been senior researchers at OpenAI, with a stated focus on AI safety research and a mission of developing AI systems that are safe, beneficial, and understandable — motivated partly by concerns that frontier AI capabilities could advance more rapidly than safety techniques could keep pace, and that existing organizations were not prioritizing safety sufficiently relative to capability development. Anthropic's founding represents a significant institutional split in the AI safety landscape: unlike Machine Intelligence Research Institute, which had focused primarily on theoretical alignment research, Anthropic combines frontier capability research with safety research at the same organization, operating on the premise that safety insights are most valuable when developed in direct contact with the most capable available systems. The organization's subsequent development of constitutional AI, mechanistic interpretability, and its Anthropic#Responsible Scaling Policy directly shapes how safety-conscious frontier AI development is conceptualized and practiced in the broader AI industry.[158][159] United States
2021 Publication Daniel Kokotajlo publishes Fun with +12 OOMs of Compute on the AI Alignment Forum, exploring through a structured thought experiment what AI systems might become capable of if the compute available for a single training run increased by twelve orders of magnitude beyond current levels — corresponding roughly to the difference between a pocket calculator and all the computing power currently used by humanity — as a tool for reasoning about what discontinuous capability jumps might actually look like if scaling continues. Kokotajlo's exercise is designed to counter the tendency to anchoring bias AI capability predictions on current systems and extrapolate linearly, arguing that the qualitative changes produced by twelve orders of magnitude of additional compute are so vast as to make current intuitions about AI capability nearly useless as a guide to the future. The post is widely read within the AI safety community as an illustration of why quantitative arguments about scaling are important and why informal intuitions about AI capability limits may be systematically miscalibrated.[160][161] United States
2022 Technological milestone The public success of large language model, culminating in ChatGPT — released by OpenAI on November 30, 2022 — renews debate over whether AI capabilities may scale more rapidly than previously expected, as the chatbot's ability to engage in coherent, knowledgeable, and contextually appropriate conversation across virtually any topic attracts over one million users within five days of launch and triggers an unprecedented wave of public and media attention to AI capabilities. ChatGPT's success demonstrates that large language models trained on internet text can exhibit sufficiently broad and flexible capability to be useful to non-specialist users without any task-specific fine-tuning (deep learning), prompting many observers to update substantially toward shorter AI timelines and toward the view that deployment of transformative AI could occur sooner and more broadly than previously anticipated. The public launch accelerates a wave of investment in AI development across the technology industry and prompts governments, regulators, and international organizations to begin seriously engaging with AI governance questions that had previously been treated as premature.[162][163] United States
2022 Publication Robin Hanson continues his sustained counter-argument to fast-takeoff scenarios through a series of blog posts on Overcoming Bias, including "Foom Debate Revisited" and "Why Not Panic About AI?", arguing that the rapid capability gains observed in large language model are consistent with the gradual, competitive diffusion model he has defended since 2008 — and that the widespread public alarm over ChatGPT and related systems reflects a failure to apply historical base rate about technology transitions rather than a genuine updating on new evidence. Hanson contends that the development of increasingly capable AI systems across many competing organizations, each constrained by economic incentives, engineering bottlenecks, and regulatory pressures, continues to favor a gradual transition rather than a single dominant recursive self-improvement — and that the appropriate response to rapid AI progress is institutional adaptation rather than the emergency framing advocated by Eliezer Yudkowsky and others. The posts represent Hanson's most current engagement with the fast-takeoff debate and demonstrate the resilience of the gradualist position in the face of empirical developments that many observers interpreted as evidence for faster timelines.[164][165] United States
2022 Publication Jacob Steinhardt publishes More Is Different for AI on his research blog, arguing that AI systems exhibit emergent qualitative changes in behavior as they scale — drawing an explicit analogy to phase transition in physics, where smooth changes in a continuous variable (temperature, pressure) produce sudden qualitative changes in the state of a system (solid to liquid, liquid to gas) — and cautioning that such transitions could be difficult to anticipate from smaller-scale experiments and could produce capability jumps that surprise even careful observers. Steinhardt argues that the pattern of emergent abilities observed in large language model — where new skills appear suddenly at certain scales without obvious precursors in smaller models — is precisely what would be expected if AI systems undergo phase-transition-like changes during scaling, and that this pattern should substantially increase uncertainty about the trajectory of future capability gains. The post is notable for bringing a physics-inspired theoretical framework to bear on the emergence debate, providing a conceptual vocabulary that is more precise than informal appeals to "discontinuous progress" while remaining accessible to researchers without a physics background.[166][167] United States
2022 Debate The unexpectedly broad general-purpose capabilities of large language model renew debate over whether emergent abilities — capabilities that appear suddenly at certain scales without obvious precursors in smaller models — represent genuine discontinuities in AI capability that could herald rapid and unpredictable progress, or predictable consequences of scaling that merely appear discontinuous because of how benchmarking (computing) are constructed and evaluated. Wei et al.'s paper "Emergent Abilities of Large Language Models" documents numerous examples of capabilities that appear to emerge abruptly at scale across many tasks and model families, arguing that the phenomenon is real and significant for AI forecasting. The counterargument, developed most prominently by Schaeffer, Miranda, and Koyejo in "Are Emergent Abilities of Large Language Models a Mirage?", suggests that apparent emergence is largely an artifact of nonlinear evaluation metrics — that when continuous metrics are used, capability growth appears smooth — a finding that would substantially reduce the evidence for discontinuous capability gains from scaling and thus weaken fast-takeoff arguments based on emergent capabilities.[168][169] United States
2022 Publication Eliezer Yudkowsky publishes AGI Ruin: A List of Lethalities on the AI Alignment Forum, presenting his most comprehensive and pessimistic public assessment of the AI alignment to date — a structured list of reasons why he believes current and foreseeable alignment techniques are likely to fail to generalize safely to a sufficiently capable, rapidly self-improving AI system, and why the default outcome of uncontrolled AI development is catastrophic. Yudkowsky argues that the alignment problem is substantially harder than most researchers in the field acknowledge, that the current pace of capability development significantly outstrips the pace of alignment research, and that many proposed solutions rest on unexamined assumptions that fail under the conditions most relevant to fast-takeoff scenarios. The post generates intense discussion within the AI safety community, with responses ranging from agreement to substantive technical disagreement, and marks a public shift in Yudkowsky's stated position toward deeper pessimism about the prospects for safe AI development under current institutional and research conditions.[170][171] United States
2022 Publication Anthropic researchers publish Predictability and Surprise in Large Generative Models, presented at the ACM Conference on Fairness, Accountability, and Transparency (FAccT '22), contributing empirical and theoretical analysis to the debate over whether qualitative capability jumps arise from continuous increases in model scale or whether scaling produces more predictable, smooth improvements that occasionally surprise observers due to threshold effects in evaluation metrics. The paper examines cases in which larger models produce unexpected capability improvements on specific tasks, analyzing the conditions under which such surprises occur and what they imply for how AI developers should reason about the behavior of more capable future systems. As a contribution from a major AI laboratory to an academic venue specifically focused on accountability and transparency, the paper is notable for bringing safety-oriented empirical research into the mainstream of AI accountability scholarship, helping to normalize the view that understanding and predicting capability trajectories is a legitimate and important research priority.[172][173] United States
2022 Publication Nate Soares publishes A Central AI Alignment Problem: Capabilities Generalization, and the Sharp Left Turn on the AI Alignment Forum, arguing that AI systems could undergo a sudden and qualitative shift in their generalization ability and goal-directedness as they cross a critical capability threshold — a phenomenon he terms the "sharp left turn" — making AI alignment properties that held reliably at lower capability levels unreliable or absent at higher ones, and potentially rendering alignment techniques that appeared to work on less capable systems useless precisely when they are most needed. Soares argues that current alignment approaches, including reinforcement learning from human feedback and mechanistic interpretability, are likely to fail at the sharp left turn because they rely on properties of current systems — such as limited optimization power, local generalization, and legible representations — that may not persist as systems become more capable. The post is one of the most discussed alignment arguments of 2022, contributing to internal debates within the AI safety field about whether capability-based alignment research can be expected to generalize to significantly more capable systems or whether a fundamentally different approach is required.[174][175] United States
2022 Organization founded Epoch AI is founded as an independent research organization dedicated to systematically tracking and forecasting trends in computation, algorithmic progress, and data availability relevant to estimating AI takeoff dynamics, subsequently producing widely-cited compute-trend datasets that provide the most comprehensive empirical record of AI training compute growth available to the research community. Epoch AI's founding reflects a growing recognition that quantitative AI forecasting requires dedicated infrastructure — ongoing data collection, consistent methodology, and public access — that individual researchers and AI laboratories are poorly positioned to provide. The organization's compute trends dataset, documenting training compute for hundreds of notable AI models across decades, becomes a standard reference in AI forecasting research and is directly incorporated into biological-anchors forecasting, compute-centric takeoff models, and policy discussions about the trajectory of AI capability development.[176][177] United Kingdom
2022 Debate Yann LeCun argues in A Path Towards Autonomous Machine Intelligence, a position paper posted on OpenReview, that current large language model architectures are fundamentally insufficient to achieve human-level reasoning and that a fast intelligence explosion driven by scaling alone is implausible — representing the most prominent and sustained technical counterargument to fast-takeoff scenarios to emerge from within a major AI laboratory. LeCun contends that language models, however large, lack the world model, causal reasoning, and hierarchical planning capabilities that characterize human intelligence, and that building AI systems capable of genuine autonomous agent will require fundamentally new architectures rather than continued scaling of transformer (machine learning model) language models. LeCun's position — publicly and repeatedly stated across multiple venues and years — is significant not only as a technical argument but as evidence that senior AI researchers at frontier laboratories hold views that differ substantially from the fast-takeoff consensus within the AI safety community, and that the debate about takeoff speed has implications for which architectural research directions are worth pursuing.[178][179] United States
2023 Publication Yoshua Bengio, Geoffrey Hinton, and other prominent AI researchers sign an open statement organized by the Center for AI Safety warning that mitigating existential risk from AI should be a global priority alongside risks such as pandemic and nuclear war, reflecting growing concern among senior researchers — including several of the field's most decorated figures — about the possibility of rapid, hard-to-control capability gains producing catastrophic outcomes. The statement, signed by hundreds of AI researchers and public figures including the leaders of major AI laboratories, marks a significant moment in the public legitimization of fast-takeoff existential risk concerns: where such concerns had previously been associated primarily with the AI safety community around Machine Intelligence Research Institute and Nick Bostrom, they now commanded explicit endorsement from researchers who had spent careers building the deep learning systems at the center of the debate. The statement generates substantial media coverage and contributes to accelerating government and intergovernmental engagement with AI governance, including the AI Safety Summit held later in 2023.[180][181] United States
2023 Publication Eliezer Yudkowsky publishes an opinion piece in Time magazine arguing that training of increasingly capable AI systems should be halted entirely due to the risk of an uncontrolled intelligence explosion, going substantially further than the six-month pause called for in the Future of Life Institute open letter published the same month and representing one of the most prominent mainstream-media articulations of fast-takeoff existential risk concerns ever produced by a major AI safety researcher. Yudkowsky argues that no currently proposed alignment technique is remotely adequate for the capability levels that would be involved in a recursive intelligence explosion, that the window for developing adequate techniques is closing rapidly, and that continued capability development under current conditions is therefore reckless in a way that warrants emergency-level response rather than incremental policy adjustment. The piece attracts substantial attention and criticism both within and outside the AI safety community, with critics arguing that Yudkowsky's position is too extreme and that a complete halt is neither politically feasible nor clearly preferable to continued safety-focused development, while supporters argue that his assessment of the technical situation is accurate and that public statements of this kind are necessary to shift the Overton window on AI governance.[182] United States
2023 Publication Eliezer Yudkowsky publishes an opinion piece in Time (magazine) magazine arguing that training of increasingly capable AI systems should be halted entirely due to the risk of an uncontrolled intelligence explosion, going substantially further than the six-month pause called for in the Future of Life Institute open letter published the same month and representing one of the most prominent mainstream-media articulations of fast-takeoff existential risk concerns ever produced by a major AI safety researcher. Yudkowsky argues that no currently proposed AI alignment is remotely adequate for the capability levels that would be involved in a recursive intelligence explosion, that the window for developing adequate techniques is closing rapidly, and that continued capability development under current conditions is therefore reckless in a way that warrants emergency-level response rather than incremental policy adjustment. The piece attracts substantial attention and criticism both within and outside the AI safety community, with critics arguing that Yudkowsky's position is too extreme and that a complete halt is neither politically feasible nor clearly preferable to continued safety-focused development, while supporters argue that his assessment of the technical situation is accurate and that public statements of this kind are necessary to shift the Overton window on AI governance.[183] United States
2023 Organization founded ARC Evals — later renamed METR (Model Evaluation and Threat Research) — is founded to develop rigorous evaluations for dangerous AI capabilities, including self-replicating machine, resource acquisition, and recursive self-improvement potential, providing an empirical infrastructure for monitoring AI systems as they approach capability thresholds relevant to fast-takeoff scenarios and enabling AI laboratories and regulators to make more informed decisions about when and whether to deploy frontier AI systems. METR's approach addresses a critical gap in the AI safety ecosystem: while much prior work had focused on theoretical AI alignment or on training-time interventions, METR focuses on empirically measuring the dangerous capabilities of already-trained systems before deployment, creating a practical mechanism for operationalizing the precautionary principles advocated by Nick Bostrom, Eliezer Yudkowsky, and others. The organization's evaluations are subsequently adopted by Anthropic and other AI laboratories as part of their responsible scaling frameworks, and its methods directly influence emerging regulatory approaches to AI safety assessment in the United Kingdom, European Union, and United States.[184][185] United States
2023 Publication Anthropic publishes its Responsible Scaling Policy, introducing a framework of "AI Safety Levels" (ASLs) that ties decisions about continuing capability development to empirical evaluations of whether current safety techniques are adequate to handle the risks posed by systems at each capability level — directly addressing the question of how to govern a potential fast takeoff through a structured, commitment-based policy framework. The RSP establishes that Anthropic will not deploy or train AI systems beyond each safety level until specific safety and mechanistic interpretability benchmarks are met, creating a formal governance mechanism designed to ensure that capability development does not outpace safety research. The policy is significant as the first major AI laboratory to adopt a public, specific, and operationalizable commitment to capability-safety parity, and directly influences subsequent responsible scaling policies adopted by other AI laboratories as well as emerging regulatory frameworks in the United Kingdom and United States that attempt to build mandatory analogues of similar commitments.[186][187] United States
2023 Debate Geoffrey Hinton resigns from Google in May 2023 and publicly warns in a series of interviews that AI systems could surpass human intelligence within a few decades, and that the pace of capability development has substantially exceeded his earlier expectations — lending the credibility of one of the most celebrated figures in the history of deep learning to concerns about rapid, hard-to-control capability gains that had previously been associated primarily with the AI safety community. Hinton states that he regrets his life's work in part because of the risks it has contributed to, and that he left Google in order to speak freely about AI dangers without the constraints of corporate employment. His public statements attract enormous media coverage and are widely interpreted as a significant updating event — demonstrating that the fast-takeoff risk concern is not the exclusive province of a small community of dedicated AI safety researchers but commands agreement from mainstream AI researchers with deep practical experience building the systems at the center of the debate.[188][189] Canada
2023 Publication An open letter organized by the Future of Life Institute and signed by thousands of AI researchers and public figures including Elon Musk, calls for a six-month pause on training AI systems more powerful than GPT-4, citing concerns over uncontrolled capability gains and insufficient safety research to manage the risks of a potential rapid takeoff, and arguing that AI development has reached a point where the pace of capability improvement has outstripped society's ability to understand, govern, and prepare for the consequences. The letter is notable as the first broadly-signed public statement from within the AI research and technology community calling for a deliberate slowdown in AI capability development on safety grounds, and its release — just months after ChatGPT's public launch — reflects how rapidly public and professional concern about AI takeoff dynamics had intensified. While critics argue that the letter's focus on GPT-4-level systems misidentifies the relevant risk threshold and that a pause would primarily harm safety-oriented organizations relative to less safety-conscious competitors, the letter generates significant political attention and contributes to accelerating legislative and regulatory activity around AI governance in the United States, European Union, and United Kingdom.[190][191] United States
2023 Publication OpenAI publishes its Preparedness Framework, establishing a structured system for evaluating frontier AI models against catastrophic risk thresholds — including autonomous self-replicating machine, the ability to assist in developing weapons of mass destruction, and autonomous recursive self-improvement capabilities — and committing to halt or constrain deployment of models that exceed specified risk levels, representing a formal institutional acknowledgment that fast-takeoff risks warrant structured pre-deployment evaluation rather than post-hoc monitoring. The framework is notable as OpenAI's first comprehensive, public commitment to capability-based safety evaluation, signaling that at least some of the fast-takeoff risk concerns raised by the AI safety community over the preceding two decades had been internalized by the organization most directly associated with the capability developments that prompted those concerns. Together with Anthropic's Responsible Scaling Policy, the Preparedness Framework marks a new phase in the governance of frontier AI development in which self-imposed capability limits and safety-level frameworks become part of the institutional landscape of AI development.[192][193] United States
2023 Publication Eliezer Yudkowsky and Robin Hanson revisit their 2008 debate positions in a series of public exchanges — including Yudkowsky's LessWrong post "Yudkowsky contra Hanson on FOOM: Whose Predictions Came True?" and Hanson's response on Overcoming Bias — with Yudkowsky arguing that the rapid capability gains observed in large language model since 2020 represent a significant updating event in favor of the fast-takeoff position, while Hanson maintains that the observed pattern of competitive, distributed, and commercially-driven AI development confirms his 2008 prediction that economic dynamics would dominate the transition. The exchange is notable for being the most direct public reassessment of the original debate by both parties in the fifteen years since it occurred, and for demonstrating that the two positions remain genuinely distinct even in light of the substantial capability developments that have occurred in the interim — with each party interpreting the same empirical developments as confirming rather than challenging their prior view.[194][195] United States
2023 Publication Tom Davidson publishes What a Compute-Centric Framework Says About Takeoff Speeds through Open Philanthropy, developing a quantitative model that directly addresses the question of how long the transition from human-level to superhuman AI might take, by relating artificial intelligence R&D automation, computation growth, and algorithmic progress through a formal economics in which AI systems contribute increasingly to their own further development. Davidson's model predicts a wide range of possible transition speeds depending on key parameters — including the degree to which AI systems can automate AI research and the rate at which compute costs fall — but finds that even under relatively conservative assumptions, the transition could occur on a timescale of months to a few years once human-level AI R&D automation is achieved, providing quantitative support for fast-takeoff concerns while remaining agnostic about when that threshold will be reached. The report is the most technically sophisticated treatment of takeoff speed as a quantitative question yet produced, and directly influences how subsequent AI safety researchers and forecasters think about the relationship between AI R&D automation and the speed of capability gains.[196][197] United States
2023 Publication Ajeya Cotra updates her earlier biological anchors forecasting work to account for faster-than-expected progress in large language model — particularly the capability gains demonstrated by GPT-4 and related systems — substantially shortening her previous median estimates for the arrival of transformative AI and reflecting a broader updating trend among quantitative AI forecasters toward shorter timelines in response to the rapid capability developments of 2022 and 2023. Cotra's update is notable for its methodological transparency: rather than simply asserting a new median estimate, she explains in detail which assumptions she has revised and why, providing a model for how quantitative AI forecasting should respond to new evidence while maintaining the probabilistic framework established in the original biological anchors report. The update contributes to a visible convergence among quantitative AI forecasters toward shorter timeline estimates during this period, with the Open Philanthropy-affiliated forecasting community in particular substantially revising its central estimates downward in response to the observed pace of capability development.[198][199] United States
2024 Technological milestone OpenAI releases OpenAI o1 in September 2024, a reasoning model that demonstrates substantially improved performance on complex scientific, mathematical, and coding tasks through extended chain-of-thought prompting — spending additional inference compute to reason through problems step by step before producing a final answer — renewing debate over whether qualitatively new reasoning capabilities are emerging from scaling inference-time compute rather than training compute alone, and whether this represents a new axis of capability scaling with potentially different dynamics than training-compute scaling. The o1 release is significant for takeoff debates because it demonstrates that capability gains can come from a qualitatively different source than the training-compute scaling that dominated prior forecasting frameworks — suggesting that even if training-compute neural scaling laws begin to saturate, inference-time scaling could provide an additional dimension of capability improvement that existing forecasting models had not fully incorporated. Researchers debate whether inference-time scaling follows the same smooth power law relationships observed for training-compute scaling, and whether its capability gains could in principle be sufficient to produce recursive self-improvement dynamics through AI-assisted reasoning about AI design.[200][201] United States
2024 Publication Daron Acemoglu publishes The Simple Macroeconomics of AI through the National Bureau of Economic Research, arguing from the perspective of mainstream economic growth that even substantial AI capability gains are likely to translate into modest, gradual macroeconomics effects over the next decade — directly challenging the "explosive economic growth" scenarios modeled by Tom Davidson and others in the AI safety community. Acemoglu contends that the tasks most amenable to AI automation represent a relatively small fraction of total economic activity, that the complementary investments and organizational changes needed to realize productivity gains from AI take time to materialize, and that historical analogies to previous general-purpose technology suggest the economic impact of AI will be more gradual and uneven than AI enthusiasts predict. The paper is notable for bringing one of the most prominent economists in the world into direct engagement with the AI takeoff debate on the economic impact side, providing the most rigorous mainstream economic counterargument to fast-economic-takeoff scenarios yet produced and prompting responses from AI forecasters who argue that Acemoglu's model does not adequately account for the possibility of AI systems capable of automating AI research itself.[202][203] United States
2024 Publication Dario Amodei publishes Machines of Loving Grace on his personal blog in October 2024, arguing that transformative AI — systems capable of dramatically accelerating scientific research and economic growth across a wide range of domains — could arrive within the next few years, potentially compressing decades of scientific progress in biology, medicine, and mental health into a very short period, while simultaneously emphasizing that a relatively fast but managed transition is achievable with adequate safety research and that the outcome could be extraordinarily positive for humanity if navigated carefully. Amodei's essay is notable for combining an unusually optimistic account of what transformative AI could achieve — explicitly including the potential to defeat most infectious disease, cure most cancer, and substantially extend healthy human lifespan — with a nuanced treatment of the safety challenges involved, reflecting Anthropic's position that fast capability development and serious safety research are complementary rather than opposed. As the chief executive officer of one of the world's leading AI laboratories, Amodei's willingness to publicly discuss transformative AI timelines measured in years rather than decades represents a significant data point about how the internal views of frontier AI developers have shifted since the publication of Nick Bostrom's Superintelligence (book) a decade earlier.[204][205] United States
2024 Publication Leopold Aschenbrenner publishes Situational Awareness: The Decade Ahead in June 2024, a detailed and widely-read essay arguing that AI progress may accelerate sharply within the next few years because of increasing computation investment, algorithmic improvements that have been consistently doubling effective compute roughly annually, and — crucially — the prospect of AI systems capable of automating AI research and engineering, which Aschenbrenner argues could dramatically compress the timeline from human-level AI to superintelligence. Drawing on his experience as a former OpenAI safety researcher, Aschenbrenner presents a scenario in which the combination of these factors produces transformative AI on a timescale of years rather than decades, with significant geopolitics and national security implications that he argues are not yet receiving adequate institutional attention. The document is notable for its specificity, its insider perspective, and its explicit engagement with the possibility of AI-automated AI research as the primary mechanism for rapid capability gains — making it the most detailed and credible public articulation of the near-term fast-takeoff scenario since Vernor Vinge's 1993 paper, and generating substantial discussion both within the AI safety community and in broader policy and media circles.[206][207] United States
2025 Debate AI forecasting increasingly treats takeoff speed as a multidimensional question involving AI capability progress, AI R&D automation, computation growth, deployment, and economic impacts as distinct variables that may proceed at different rates and interact in complex ways — rather than as a single variable ranging from "fast" to "slow" — reflecting a maturation in the conceptual framework of takeoff debates beyond the binary fast/slow distinction that had structured most prior discussion. Forecasting organizations including the AI Futures Project and contributors to the AI Alignment Forum develop explicit models that track each dimension separately, acknowledging that capability takeoff, economic takeoff, and research-automation takeoff could occur on different timescales and with different social and AI governance implications, and that a comprehensive account of AI transition dynamics requires modeling all of them and their interactions rather than collapsing them into a single speed parameter.[208][209] United States
2025 Publication Researchers at METR publish Measuring AI Ability to Complete Long Tasks, finding through systematic empirical evaluation that the length of software engineering tasks AI systems can reliably complete autonomously has been doubling roughly every seven months — a rate of progress substantially faster than Moore's Law for hardware — providing a new empirical metric for forecasting AI takeoff dynamics that is grounded in direct measurement of autonomous agent rather than proxy metrics such as benchmarking (computing) performance or training compute. The paper's finding that autonomous task completion capability is growing on a roughly seven-month doubling time is significant for takeoff forecasting because it provides an empirical basis for projecting when AI systems might be capable of autonomously completing AI research and engineering tasks — the threshold at which AI-automated AI research becomes possible and recursive self-improvement could begin. The result is widely interpreted as evidence that the transition to AI systems capable of meaningfully accelerating their own development may be closer than training-compute-based forecasting frameworks had suggested.[210][211] United States
2025 Publication Daniel Kokotajlo and collaborators publish AI 2027, a detailed scenario forecast modeling a potential rapid transition from current AI systems to superintelligence within a few years, driven primarily by AI-automated AI research — in which AI systems become sufficiently capable of conducting AI research autonomously that the rate of algorithmic improvement accelerates beyond what human researchers could produce, creating a recursive self-improvement in which each generation of AI systems is substantially more capable than the last and is produced on a shorter timeline. The scenario, developed through explicit quantitative modeling of capability milestones, computation scaling, and research automation rather than through qualitative extrapolation, is intended to make concrete the practical and geopolitics implications of a fast-takeoff trajectory — including the strategic situation between major AI-developing nations, the likely response of institutions and governments, and the AI alignment involved in maintaining human oversight over rapidly self-improving systems. AI 2027 is notable for being the most detailed and publicly available quantitative fast-takeoff scenario yet produced, and for representing a convergence between the fast-takeoff arguments of the AI safety community and the near-term timeline predictions of frontier AI developers like Dario Amodei and Leopold Aschenbrenner.[212][213] United States
2025–present Research trend AI forecasting increasingly relies on quantitative models that combine empirical neural scaling laws, computation trends, algorithmic efficiency estimates, and AI-assisted research projections to analyze transformative AI timelines and takeoff scenarios — a substantial methodological shift from the largely qualitative arguments that characterized the field through the 2010s toward an empirically grounded, continuously-updated, and probabilistic forecasting forecasting practice. Organizations including Open Philanthropy, Epoch AI, METR, and the AI Futures Project maintain ongoing forecasting programs that integrate new empirical data on compute costs, model capabilities, and research automation into quantitative models, producing publicly available estimates that are revised as new evidence emerges. The broader community of AI researchers, policymakers, and informed observers increasingly engages with these quantitative frameworks rather than relying on individual expert intuition, marking a maturation of the field that parallels the development of quantitative forecasting in epidemiology, climate science, and economics — where the shift from qualitative expert judgment to explicit probabilistic models substantially improved both the quality of predictions and the ability to identify and debate the key assumptions driving disagreement.[214][215][216] United States

Visual and numerical data

Distribution of events by type

The following table shows the distribution of events in this timeline by event type.

Event type Count
Publication 64
Debate 21
Technological milestone 8
Organization founded 6
Community founded 2
Research agenda 1
Research trend 1
Community 1

Distribution of events by decade

Decade Count
1930s 1
1940s 2
1950s 2
1960s 4
1970s 1
1980s 4
1990s 4
2000s 8
2010s 18
2020s 26

Distribution of events by geographical location

Geographical location Count
United States 73
United Kingdom 22
Australia 1
Canada 2
Switzerland 1
Finland 1
Germany 1
Poland 1

Evolution of AI timeline forecasts

The following table tracks how median estimates for the arrival of transformative AI have shifted among major forecasters over time, illustrating the debate's gradual convergence toward shorter timelines.

Year Forecaster/Source Median estimate for transformative AI Notes
1998 Ray Kurzweil, The Age of Spiritual Machines ~2029 (human-level AI) Based on exponential hardware extrapolation; later revised in The Singularity Is Near (2005)
2005 Ray Kurzweil, The Singularity Is Near ~2029 (human-level AI), ~2045 (singularity) Most widely cited popular forecast; based on Law of Accelerating Returns
2008 Eliezer Yudkowsky, Artificial Intelligence as a Positive and Negative Factor in Global Risk No specific date given Argued timeline uncertainty was high but fast takeoff could occur within decades
2013 Stuart Armstrong & Kaj Sotala, MIRI 2075 (median across surveyed predictions) Compiled from a survey of AI timeline predictions across many sources
2016 Holden Karnofsky, Open Philanthropy No specific median given Emphasized high uncertainty; treated 10–100 year range as credible
2017 Katja Grace et al., AI Impacts survey 2061 (median for high-level machine intelligence, 50% confidence) Most rigorous expert survey to date; based on 352 AI researcher responses
2020 Ajeya Cotra, Open Philanthropy biological anchors ~2050 (median) First major quantitative framework; wide range from 2030 to 2100+
2022 Metaculus community forecast ~2042 (median for transformative AI) Probabilistic community forecast; continuously updated
2023 Ajeya Cotra, updated biological anchors ~2030s (revised median) Substantially shortened following GPT-4 and related capability gains
2025 AI 2027 / AI Futures Project 2027–2030 (scenario range) Most aggressive credible public forecast; based on compute-centric and R&D automation modeling

Key conceptual distinctions introduced over time

The following table tracks when major conceptual distinctions in AI takeoff debates were first formally introduced, showing how the debate's vocabulary has evolved.

Concept First introduced Primary source
Intelligence explosion 1965 I. J. Good, "Speculations Concerning the First Ultraintelligent Machine"
Technological singularity 1983 Vernor Vinge, "First Word," Omni (magazine) magazine
Friendly AI 2001 Eliezer Yudkowsky, Creating Friendly AI 1.0
Hardware overhang 2010 Carl Shulman, Singularity Institute working paper
Hard takeoff / soft takeoff 2014 Popularized by Nick Bostrom, Superintelligence (book)
AI takeoff (rapid intelligence explosion) 2008 Eliezer Yudkowsky, Hanson–Yudkowsky AI-Foom Debate
Orthogonality thesis 2012 Nick Bostrom, "The Superintelligent Will"
Instrumental convergence 2008 Stephen Omohundro, "The Basic AI Drives"
Mesa-optimization 2019 Evan Hubinger et al., "Risks from Learned Optimization"
Biological anchors (AI forecasting) 2020 Ajeya Cotra, Draft Report on AI Timelines
Takeoff speeds (slow/fast taxonomy) 2018 Paul Christiano, "Takeoff Speeds"
Sharp left turn 2022 Nate Soares, "A Central AI Alignment Problem"
Comprehensive AI Services 2019 Eric Drexler, Reframing Superintelligence
Research takeoff / capability takeoff / economic takeoff 2023–2024 Tom Davidson, Open Philanthropy; AI Futures Project

Meta information on the timeline

How the timeline was built

The initial version of the timeline was written by Sebastian.

Check Detail construction for full timeline in timelines, Inclusion criteria for full timeline in timelines, and Representativeness of events in timelines.

Funding information for this timeline is available.

Feedback and comments

Feedback for the timeline can be provided at the following places:

  • FIXME

What the timeline is still missing

Timeline update strategy

See also

References

  1. Good, Irving John (1965). "Speculations Concerning the First Ultraintelligent Machine". Advances in Computers. 6. Academic Press: 31–88. doi:10.1016/S0065-2458(08)60418-0.
  2. Ulam, Stanisław (1958). "Tribute to John von Neumann". Bulletin of the American Mathematical Society. 64 (3): 1–49.
  3. Vinge, Vernor (1993). "The Coming Technological Singularity". Vision-21: Interdisciplinary Science and Engineering in the Era of Cyberspace. NASA Lewis Research Center. {{cite conference}}: Unknown parameter |booktitle= ignored (|book-title= suggested) (help)
  4. Yudkowsky, Eliezer (2001). "Creating Friendly AI 1.0" (PDF). Singularity Institute for Artificial Intelligence.
  5. Bostrom, Nick (2014). Superintelligence: Paths, Dangers, Strategies. Oxford University Press. ISBN 978-0199678112.
  6. Christiano, Paul (2018). "Takeoff Speeds". AI Alignment Blog.
  7. Cotra, Ajeya (2020). "Draft Report on AI Timelines". AI Alignment Forum.
  8. "Anthropic's Responsible Scaling Policy". Anthropic. September 19, 2023.
  9. Turing, Alan (1936). "On Computable Numbers, with an Application to the Entscheidungsproblem". Proceedings of the London Mathematical Society. 42 (1): 230–265. doi:10.1112/plms/s2-42.1.230.
  10. Turing, Alan (1936). "On Computable Numbers, with an Application to the Entscheidungsproblem" (PDF). University of Virginia (digitized).
  11. von Neumann, John (1945). First Draft of a Report on the EDVAC (Report). Moore School of Electrical Engineering, University of Pennsylvania.
  12. von Neumann, John (1945). "First Draft of a Report on the EDVAC" (PDF). IEEE Annals of the History of Computing (archived).
  13. Wiener, Norbert (1948). Cybernetics: Or Control and Communication in the Animal and the Machine. MIT Press. ISBN 978-0262730099. {{cite book}}: ISBN / Date incompatibility (help)
  14. Wiener, Norbert (1948). "Cybernetics: Or Control and Communication in the Animal and the Machine". Internet Archive.
  15. Turing, Alan (1950). "Computing Machinery and Intelligence". Mind. 59 (236): 433–460. doi:10.1093/mind/LIX.236.433.
  16. Turing, Alan (1950). "Computing Machinery and Intelligence". Mind (Oxford Academic).
  17. Turing, Alan (2004). "Intelligent Machinery, A Heretical Theory". In Copeland, B. Jack (ed.). Intelligent Machinery, A Heretical Theory. Oxford University Press. pp. 472–475. {{cite book}}: Check date values in: |year= / |date= mismatch (help); Unknown parameter |booktitle= ignored (help)
  18. Turing, Alan (1951). "Intelligent Machinery, A Heretical Theory". The Turing Digital Archive.
  19. Ulam, Stanisław (1958). "Tribute to John von Neumann". Bulletin of the American Mathematical Society. 64 (3): 1–49. doi:10.1090/S0002-9904-1958-10189-5.
  20. Ulam, Stanisław (1958). "Tribute to John von Neumann". Project Euclid.
  21. Wiener, Norbert (1960). "Some Moral and Technical Consequences of Automation". Science. 131 (3410): 1355–1358. doi:10.1126/science.131.3410.1355.
  22. Wiener, Norbert (1960). "Some Moral and Technical Consequences of Automation". JSTOR.
  23. Good, Irving John, ed. (1962). The Scientist Speculates: An Anthology of Partly-Baked Ideas. London: Heinemann.
  24. Good, Irving John, ed. (1962). The Scientist Speculates: An Anthology of Partly-Baked Ideas. New York: Basic Books.
  25. Good, Irving John (1965). "Speculations Concerning the First Ultraintelligent Machine". Advances in Computers. 6. Academic Press: 31–88. doi:10.1016/S0065-2458(08)60418-0.
  26. Good, Irving John (1965). "Speculations Concerning the First Ultraintelligent Machine". Advances in Computers. 6. Academic Press: 31–88.
  27. Minsky, Marvin (1967). Computation: Finite and Infinite Machines. Prentice-Hall. ISBN 978-0131655639. {{cite book}}: Check |isbn= value: checksum (help)
  28. Minsky, Marvin (1967). "Computation: Finite and Infinite Machines". Internet Archive.
  29. Hofstadter, Douglas (1979). Gödel, Escher, Bach: An Eternal Golden Braid. Basic Books. ISBN 978-0465026562.
  30. Hofstadter, Douglas (1979). "Gödel, Escher, Bach: An Eternal Golden Braid". Internet Archive.
  31. Lem, Stanisław (1981). Golem XIV (in Polish). Wydawnictwo Literackie.{{cite book}}: CS1 maint: unrecognized language (link)
  32. Lem, Stanisław (1985). "Golem XIV". Imaginary Magnitude. Harcourt Brace Jovanovich. ISBN 978-0151442047. {{cite book}}: Check |isbn= value: checksum (help)
  33. Vinge, Vernor (January 1983). "First Word". Omni.{{cite magazine}}: CS1 maint: date and year (link)
  34. Vinge, Vernor (1983). "First Word (Omni Magazine)". Mindstalk.net.
  35. Solomonoff, Ray (1985). "The Time Scale of Artificial Intelligence: Reflections on Social Effects". Human Systems Management. 5: 149–153.
  36. Solomonoff, Ray (1985). "The Time Scale of Artificial Intelligence: Reflections on Social Effects" (PDF). Ray Solomonoff's official archive.
  37. Barrow, John D.; Tipler, Frank J. (1986). The Anthropic Cosmological Principle. Oxford University Press. ISBN 978-0192821478.
  38. Barrow, John D.; Tipler, Frank J. (1986). "The Anthropic Cosmological Principle". Internet Archive.
  39. Moravec, Hans (1988). Mind Children: The Future of Robot and Human Intelligence. Harvard University Press. ISBN 978-0674576186.
  40. Moravec, Hans (1988). "Mind Children: The Future of Robot and Human Intelligence". Internet Archive.
  41. Solomonoff, Ray (1985). "The Time Scale of Artificial Intelligence: Reflections on Social Effects". Human Systems Management. 5: 149–153.
  42. Solomonoff, Ray (1985). "The Time Scale of Artificial Intelligence: Reflections on Social Effects" (PDF). Ray Solomonoff's official archive.
  43. Barrow, John D.; Tipler, Frank J. (1986). The Anthropic Cosmological Principle. Oxford University Press. ISBN 978-0192821478.
  44. Barrow, John D.; Tipler, Frank J. (1986). "The Anthropic Cosmological Principle". Internet Archive.
  45. Moravec, Hans (1988). Mind Children: The Future of Robot and Human Intelligence. Harvard University Press. ISBN 978-0674576186.
  46. Moravec, Hans (1988). "Mind Children: The Future of Robot and Human Intelligence". Internet Archive.
  47. Vinge, Vernor (1993). "The Coming Technological Singularity: How to Survive in the Post-Human Era". Vision-21: Interdisciplinary Science and Engineering in the Era of Cyberspace. NASA Lewis Research Center. pp. 11–22. {{cite conference}}: Unknown parameter |booktitle= ignored (|book-title= suggested) (help)
  48. Vinge, Vernor (1993). "The Coming Technological Singularity". San Diego State University (Department of Mathematical Sciences).
  49. Broderick, Damien (1997). The Spike: Accelerating into the Unimaginable Future. Reed Books. ISBN 978-0732910292. {{cite book}}: Check |isbn= value: checksum (help)
  50. Broderick, Damien (2001). The Spike: How Our Lives Are Being Transformed by Rapidly Advancing Technologies. Tor Books. ISBN 978-0765303338. {{cite book}}: Check |isbn= value: checksum (help)
  51. Kurzweil, Ray (1998). The Age of Spiritual Machines: When Computers Exceed Human Intelligence. Viking Press. ISBN 978-0670882175.
  52. Kurzweil, Ray (1998). "The Age of Spiritual Machines". Internet Archive.
  53. Bostrom, Nick (1998). "How Long Before Superintelligence?". International Journal of Futures Studies. 2.
  54. Bostrom, Nick (1998). "How Long Before Superintelligence?". Nick Bostrom's website.
  55. Yudkowsky, Eliezer (2001). "Creating Friendly AI 1.0: The Analysis and Design of Benevolent Goal Architectures" (PDF). Singularity Institute for Artificial Intelligence.
  56. Yudkowsky, Eliezer (2001). "Creating Friendly AI 1.0" (PDF). Machine Intelligence Research Institute.
  57. Kurzweil, Ray (March 7, 2001). "The Law of Accelerating Returns". KurzweilAI.net.{{cite web}}: CS1 maint: date and year (link)
  58. Kurzweil, Ray (2001). "The Law of Accelerating Returns". Internet Archive (Wayback Machine).
  59. Hanson, Robin (2001). "Economic Growth Given Machine Intelligence" (PDF). George Mason University.
  60. Hanson, Robin (2001). "Economic Growth Given Machine Intelligence" (PDF). George Mason University, Department of Economics.
  61. Hibbard, Bill (2002). Super-Intelligent Machines. Kluwer Academic/Plenum Publishers. ISBN 978-0306473883.
  62. Hibbard, Bill (2002). "Super-Intelligent Machines" (PDF). University of Wisconsin–Madison, Space Science and Engineering Center.
  63. Bostrom, Nick (2002). "Existential Risks: Analyzing Human Extinction Scenarios and Related Hazards". Journal of Evolution and Technology. 9 (1).
  64. Bostrom, Nick (2002). "Existential Risks". Nick Bostrom's website.
  65. Schmidhuber, Jürgen (2003). "Gödel Machines: Fully Self-Referential Optimal Universal Self-Improvers". Artificial General Intelligence. Springer. pp. 199–226. {{cite conference}}: Unknown parameter |booktitle= ignored (|book-title= suggested) (help)
  66. Schmidhuber, Jürgen (2003). "Gödel Machines". IDSIA.
  67. Yudkowsky, Eliezer (2004). "Coherent Extrapolated Volition" (PDF). Singularity Institute for Artificial Intelligence.
  68. Yudkowsky, Eliezer (2004). "Coherent Extrapolated Volition" (PDF). Machine Intelligence Research Institute.
  69. Yudkowsky, Eliezer (2004). "Coherent Extrapolated Volition" (PDF). Singularity Institute for Artificial Intelligence.
  70. Yudkowsky, Eliezer (2001). "Creating Friendly AI 1.0: The Analysis and Design of Benevolent Goal Architectures" (PDF). Singularity Institute for Artificial Intelligence.
  71. Yudkowsky, Eliezer (2007). Goertzel, Ben; Pennachin, Cassio (eds.). Levels of Organization in General Intelligence. Cognitive Technologies. Springer. pp. 389–501. doi:10.1007/978-3-540-68677-4_12. {{cite book}}: Unknown parameter |booktitle= ignored (help)
  72. Yudkowsky, Eliezer (2007). "Levels of Organization in General Intelligence" (PDF). Machine Intelligence Research Institute.
  73. Hanson, Robin; Yudkowsky, Eliezer (2008). "The Hanson–Yudkowsky AI-Foom Debate". Overcoming Bias / LessWrong Wiki.
  74. Hanson, Robin (2008). "The Economics of the Singularity". IEEE Spectrum.
  75. "Foom". LessWrong Wiki (Tag/Glossary).
  76. Yudkowsky, Eliezer (2008). Bostrom, Nick; Ćirković, Milan M. (eds.). Artificial Intelligence as a Positive and Negative Factor in Global Risk. Oxford University Press. pp. 308–345. ISBN 978-0198570509. {{cite book}}: Unknown parameter |booktitle= ignored (help)
  77. Yudkowsky, Eliezer (2008). "Artificial Intelligence as a Positive and Negative Factor in Global Risk" (PDF). Machine Intelligence Research Institute.
  78. Omohundro, Stephen M. (2008). "The Basic AI Drives". Artificial General Intelligence 2008: Proceedings of the First AGI Conference. IOS Press. pp. 483–492. {{cite conference}}: Unknown parameter |booktitle= ignored (|book-title= suggested) (help)
  79. Omohundro, Stephen M. (2008). "The Basic AI Drives". Self-Aware Systems.
  80. Yudkowsky, Eliezer (February 2009). "Welcome to Less Wrong!". LessWrong.{{cite web}}: CS1 maint: date and year (link)
  81. "A Brief History of LessWrong". LessWrong Wiki.
  82. Hanson, Robin (2009). "The Hanson–Yudkowsky AI-Foom Debate". Overcoming Bias / LessWrong Wiki.
  83. Chalmers, David (2010). "The Singularity: A Philosophical Analysis". Journal of Consciousness Studies. 17 (9–10): 7–65.
  84. Chalmers, David (2010). "The Singularity: A Philosophical Analysis" (PDF). Consciousness Online / NYU Philosophy.
  85. Shulman, Carl (2010). "Whole Brain Emulation and the Evolution of Superorganisms" (PDF). Singularity Institute for Artificial Intelligence.
  86. Chalmers, David (2010). "The Singularity: A Philosophical Analysis". Journal of Consciousness Studies. 17 (9–10): 7–65.
  87. Chalmers, David (2010). "The Singularity: A Philosophical Analysis" (PDF). Consciousness Online / NYU Philosophy.
  88. Yudkowsky, Eliezer (2011). "Complex Value Systems are Required to Realize Valuable Futures". Artificial General Intelligence: 4th International Conference, AGI 2011. Lecture Notes in Computer Science. Vol. 6830. Springer. pp. 388–393. doi:10.1007/978-3-642-22887-2_48. {{cite conference}}: Unknown parameter |booktitle= ignored (|book-title= suggested) (help)
  89. Yudkowsky, Eliezer (2011). "Complex Value Systems are Required to Realize Valuable Futures" (PDF). Machine Intelligence Research Institute.
  90. Bostrom, Nick (2012). "The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents". Minds and Machines. 22 (2): 71–85. doi:10.1007/s11023-012-9281-3.
  91. Bostrom, Nick (2012). "The Superintelligent Will" (PDF). Future of Humanity Institute, University of Oxford.
  92. Krizhevsky, Alex; Sutskever, Ilya; Hinton, Geoffrey E. (2012). "ImageNet Classification with Deep Convolutional Neural Networks". Advances in Neural Information Processing Systems 25 (NIPS 2012). {{cite conference}}: Unknown parameter |booktitle= ignored (|book-title= suggested) (help)
  93. Russakovsky, Olga; Deng, Jia; et al. (2015). "ImageNet Large Scale Visual Recognition Challenge". arXiv. {{cite web}}: Explicit use of et al. in: |last3= (help)
  94. Muehlhauser, Luke; Salamon, Anna (2012). Eden, Amnon H.; Moor, James H.; Søraker, Johnny H.; Steinhart, Eric (eds.). Intelligence Explosion: Evidence and Import. The Frontiers Collection. Springer. pp. 15–42. doi:10.1007/978-3-642-32560-1_2. {{cite book}}: Unknown parameter |booktitle= ignored (help)
  95. Muehlhauser, Luke; Salamon, Anna (2012). "Intelligence Explosion: Evidence and Import" (PDF). Machine Intelligence Research Institute.
  96. Eden, Amnon H.; Moor, James H.; Søraker, Johnny H.; Steinhart, Eric, eds. (2012). Singularity Hypotheses: A Scientific and Philosophical Assessment. The Frontiers Collection. Springer. ISBN 978-3-642-32559-5.
  97. "Singularity Hypotheses". Springer.
  98. Yudkowsky, Eliezer (2013). "Intelligence Explosion Microeconomics" (PDF). Machine Intelligence Research Institute.
  99. Yudkowsky, Eliezer (2013). "Intelligence Explosion Microeconomics". Machine Intelligence Research Institute (technical report).
  100. Hanson, Robin; Yudkowsky, Eliezer (2013). The Hanson-Yudkowsky AI-Foom Debate. Machine Intelligence Research Institute. ISBN 978-1939311022. {{cite book}}: Check |isbn= value: checksum (help)
  101. Hanson, Robin; Yudkowsky, Eliezer (2013). "The Hanson-Yudkowsky AI-Foom Debate". Machine Intelligence Research Institute.
  102. Bostrom, Nick (2014). Superintelligence: Paths, Dangers, Strategies. Oxford University Press. ISBN 978-0199678112.
  103. Bostrom, Nick (2014). "Superintelligence: Paths, Dangers, Strategies". Internet Archive.
  104. Sotala, Kaj; Yampolskiy, Roman V. (2014). "Responses to Catastrophic AGI Risk: A Survey". Physica Scripta. 90 (1). doi:10.1088/0031-8949/90/1/018001.
  105. Sotala, Kaj; Yampolskiy, Roman V. (2014). "Responses to Catastrophic AGI Risk" (PDF). Machine Intelligence Research Institute.
  106. Armstrong, Stuart (2014). Smarter Than Us: The Rise of Machine Intelligence. Machine Intelligence Research Institute. ISBN 978-1939311091. {{cite book}}: Check |isbn= value: checksum (help)
  107. Armstrong, Stuart (2014). "Smarter Than Us: The Rise of Machine Intelligence". Machine Intelligence Research Institute.
  108. "Introducing OpenAI". OpenAI. December 11, 2015.
  109. Levy, Steven (December 11, 2015). "How Elon Musk and Y Combinator Plan to Stop Computers From Taking Over". Backchannel/Wired.
  110. Karnofsky, Holden (May 2016). "Some Background on Our Views Regarding Advanced Artificial Intelligence". Open Philanthropy.{{cite web}}: CS1 maint: date and year (link)
  111. Karnofsky, Holden (2016). "Some Background on Our Views Regarding Advanced Artificial Intelligence". Effective Altruism Forum.
  112. Silver, David; Huang, Aja; Maddison, Chris J.; et al. (2016). "Mastering the Game of Go with Deep Neural Networks and Tree Search". Nature. 529: 484–489. doi:10.1038/nature16961. {{cite journal}}: Explicit use of et al. in: |last4= (help)
  113. "AlphaGo". DeepMind.
  114. Karnofsky, Holden (May 2016). "Some Background on Our Views Regarding Advanced Artificial Intelligence". Open Philanthropy.{{cite web}}: CS1 maint: date and year (link)
  115. Christiano, Paul (2016). "Strong AI via Amplified Weak AI". AI Alignment Blog.
  116. Template:Cite arxiv
  117. Hanson, Robin (2016). The Age of Em: Work, Love, and Life when Robots Rule the Earth. Oxford University Press. ISBN 978-0198754626.
  118. Hanson, Robin (2016). "The Age of Em". Oxford University Press.
  119. Template:Cite arxiv
  120. "AlphaZero: Shedding New Light on Chess, Shogi, and Go". DeepMind. December 2018.
  121. "Welcome to the AI Alignment Forum". AI Alignment Forum. 2017.
  122. "About the AI Alignment Forum". AI Alignment Forum.
  123. Yudkowsky, Eliezer (October 13, 2017). "There's No Fire Alarm for Artificial General Intelligence". Machine Intelligence Research Institute.{{cite web}}: CS1 maint: date and year (link)
  124. Yudkowsky, Eliezer (2017). "There's No Fire Alarm for Artificial General Intelligence". LessWrong.
  125. Grace, Katja; Salvatier, John; Dafoe, Allan; Zhang, Baobao; Evans, Owain (2018). "When Will AI Exceed Human Performance? Evidence from AI Experts". Journal of Artificial Intelligence Research. 62: 729–754. doi:10.1613/jair.1.11222.
  126. Template:Cite arxiv
  127. Dafoe, Allan (2018). "AI Governance: A Research Agenda" (PDF). Future of Humanity Institute, University of Oxford.
  128. Christiano, Paul (February 24, 2018). "Takeoff Speeds". AI Alignment Blog.{{cite web}}: CS1 maint: date and year (link)
  129. Christiano, Paul (2018). "Takeoff Speeds". AI Alignment Forum.
  130. Amodei, Dario; Hernandez, Danny (May 16, 2018). "AI and Compute". OpenAI.{{cite web}}: CS1 maint: date and year (link)
  131. Amodei, Dario; Hernandez, Danny (2018). "AI and Compute". OpenAI Blog (Archived).
  132. Drexler, K. Eric (2019). Reframing Superintelligence: Comprehensive AI Services as General Intelligence (Report). Future of Humanity Institute, University of Oxford.
  133. Drexler, K. Eric (2019). "Reframing Superintelligence" (PDF). Future of Humanity Institute.
  134. Radford, Alec; Wu, Jeffrey; Child, Rewon; Luan, David; Amodei, Dario; Sutskever, Ilya (2019). "Language Models are Unsupervised Multitask Learners" (PDF). OpenAI.
  135. "Better Language Models and Their Implications". OpenAI. February 14, 2019.
  136. Template:Cite arxiv
  137. Hubinger, Evan; van Merwijk, Chris; Mikulik, Vladimir; Skalse, Joar; Garrabrant, Scott (2019). "Risks from Learned Optimization". Machine Intelligence Research Institute.
  138. Template:Cite arxiv
  139. Radford, Alec; Wu, Jeffrey; Child, Rewon; Luan, David; Amodei, Dario; Sutskever, Ilya (2019). "Language Models are Unsupervised Multitask Learners" (PDF). OpenAI.
  140. "Better Language Models and Their Implications". OpenAI. February 14, 2019.
  141. Sutton, Richard S. (March 13, 2019). "The Bitter Lesson". Incomplete Ideas (blog).{{cite web}}: CS1 maint: date and year (link)
  142. Sutton, Richard S. (2019). "The Bitter Lesson". University of Alberta.
  143. Russell, Stuart (2019). Human Compatible: Artificial Intelligence and the Problem of Control. Viking. ISBN 978-0525558613.
  144. Russell, Stuart (2019). "Human Compatible". Stuart Russell's website.
  145. Bostrom, Nick (2019). "The Vulnerable World Hypothesis". Global Policy. 10 (4): 455–476. doi:10.1111/1758-5899.12718.
  146. Bostrom, Nick (2019). "The Vulnerable World Hypothesis" (PDF). Nick Bostrom's website.
  147. "AI Forecasting". Metaculus.
  148. "When Will AI Exceed Human Performance on All Tasks?". Metaculus.
  149. Cotra, Ajeya (2020). "Forecasting TAI with Biological Anchors". Open Philanthropy.
  150. Cotra, Ajeya (2020). "Draft Report on AI Timelines". AI Alignment Forum.
  151. Branwen, Gwern (2020). "The Scaling Hypothesis". Gwern.net.
  152. Branwen, Gwern (2020). "The Scaling Hypothesis". Gwern.net (Archived).
  153. Template:Cite arxiv
  154. Template:Cite arxiv
  155. "Language Models are Few-Shot Learners". OpenAI. May 28, 2020.
  156. Davidson, Tom (2021). Could Advanced AI Drive Explosive Economic Growth? (Report). Open Philanthropy.
  157. Davidson, Tom (2021). "Could Advanced AI Drive Explosive Economic Growth?" (PDF). Open Philanthropy (PDF report).
  158. Knight, Will (May 28, 2021). "A New AI Lab Backed by Billionaires Pledges to Build a Safer Robot". Wired.
  159. "Anthropic". Anthropic.
  160. Kokotajlo, Daniel (March 2021). "Fun with +12 OOMs of Compute". AI Alignment Forum.{{cite web}}: CS1 maint: date and year (link)
  161. Kokotajlo, Daniel (2021). "Fun with +12 OOMs of Compute". LessWrong.
  162. "Introducing ChatGPT". OpenAI. November 30, 2022.
  163. Roose, Kevin (December 5, 2022). "The Brilliance and Weirdness of ChatGPT". The New York Times.
  164. Hanson, Robin (2022). "Foom Debate Revisited". Overcoming Bias.
  165. Hanson, Robin (2022). "Why Not Panic About AI?". Overcoming Bias.
  166. Steinhardt, Jacob (January 2022). "More Is Different for AI". Bounded Regret.{{cite web}}: CS1 maint: date and year (link)
  167. Steinhardt, Jacob (2022). "More Is Different for AI". AI Alignment Forum.
  168. Template:Cite arxiv
  169. Schaeffer, Rylan; Miranda, Brando; Koyejo, Sanmi (2023). "Are Emergent Abilities of Large Language Models a Mirage?". arXiv.
  170. Yudkowsky, Eliezer (June 5, 2022). "AGI Ruin: A List of Lethalities". AI Alignment Forum.{{cite web}}: CS1 maint: date and year (link)
  171. Yudkowsky, Eliezer (2022). "AGI Ruin: A List of Lethalities". LessWrong.
  172. Ganguli, Deep; et al. (2022). "Predictability and Surprise in Large Generative Models". Anthropic. {{cite web}}: Explicit use of et al. in: |last2= (help)
  173. Ganguli, Deep; et al. (2022). "Predictability and Surprise in Large Generative Models". Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (FAccT '22). doi:10.1145/3531146.3533229. {{cite conference}}: Explicit use of et al. in: |last2= (help); Unknown parameter |booktitle= ignored (|book-title= suggested) (help)
  174. Soares, Nate (June 2022). "A Central AI Alignment Problem: Capabilities Generalization, and the Sharp Left Turn". AI Alignment Forum.{{cite web}}: CS1 maint: date and year (link)
  175. Soares, Nate (2022). "A Central AI Alignment Problem". Machine Intelligence Research Institute.
  176. "About Epoch AI". Epoch AI.
  177. Sevilla, Jaime; Heim, Lennart; Ho, Anson; Besiroglu, Tamay; Hobbhahn, Marius; Villalobos, Pablo (2022). "Compute Trends Across Three Eras of Machine Learning". arXiv.
  178. LeCun, Yann (2022). "A Path Towards Autonomous Machine Intelligence". Meta AI / OpenReview.
  179. LeCun, Yann (2022). "A Path Towards Autonomous Machine Intelligence". Meta AI Research.
  180. "Statement on AI Risk". Center for AI Safety. May 30, 2023.
  181. Roose, Kevin (May 30, 2023). "A.I. Poses 'Risk of Extinction,' Industry Leaders Warn". The New York Times.
  182. Yudkowsky, Eliezer (March 29, 2023). "Pausing AI Developments Isn't Enough. We Need to Shut It All Down". Time.{{cite news}}: CS1 maint: date and year (link)
  183. Yudkowsky, Eliezer (March 29, 2023). "Pausing AI Developments Isn't Enough. We Need to Shut It All Down". Time.{{cite news}}: CS1 maint: date and year (link)
  184. "About METR". METR.
  185. "ARC Evals Becomes METR". METR. 2023.
  186. "Anthropic's Responsible Scaling Policy". Anthropic. September 19, 2023.
  187. "Responsible Scaling Policy". Anthropic.
  188. Metz, Cade (May 1, 2023). "'The Godfather of A.I.' Leaves Google and Warns of Danger Ahead". The New York Times.
  189. Hinton, Geoffrey (2023). "Geoffrey Hinton on the Risks of AI". CBS News / 60 Minutes.
  190. "Pause Giant AI Experiments: An Open Letter". Future of Life Institute. March 22, 2023.
  191. Metz, Cade; Weise, Karen (March 29, 2023). "Elon Musk and Others Call for Pause on A.I., Citing 'Profound Risks to Society'". The New York Times.
  192. "OpenAI Preparedness Framework (Beta)". OpenAI. December 2023.
  193. "Preparedness Framework" (PDF). OpenAI.
  194. Yudkowsky, Eliezer (2023). "Yudkowsky and Hanson on FOOM: Whose Predictions Came True?". LessWrong.
  195. Hanson, Robin (2023). "My Debate With Yudkowsky". Overcoming Bias.
  196. Davidson, Tom (2023). What a Compute-Centric Framework Says About Takeoff Speeds (Report). Open Philanthropy.
  197. Davidson, Tom (2023). "Takeoff Speeds Model". AI Alignment Forum.
  198. Cotra, Ajeya (January 2023). "Two-Year Update on My Personal AI Timelines". AI Alignment Forum.{{cite web}}: CS1 maint: date and year (link)
  199. Cotra, Ajeya (August 2022). "Why I'm Now More Worried About Near-Term AI Timelines". Cold Takes. {{cite web}}: Check date values in: |year= / |date= mismatch (help)
  200. "Learning to Reason with LLMs". OpenAI. September 12, 2024.
  201. Template:Cite arxiv
  202. Acemoglu, Daron (2024). "The Simple Macroeconomics of AI". National Bureau of Economic Research.
  203. Template:Cite arxiv
  204. Amodei, Dario (October 2024). "Machines of Loving Grace". Dario Amodei's blog.{{cite web}}: CS1 maint: date and year (link)
  205. Amodei, Dario (2024). "Machines of Loving Grace". Anthropic.
  206. Aschenbrenner, Leopold (June 2024). "Situational Awareness: The Decade Ahead".{{cite web}}: CS1 maint: date and year (link)
  207. Aschenbrenner, Leopold (2024). "Situational Awareness: The Decade Ahead (PDF)" (PDF).
  208. "Takeoff Forecast". AI 2027. Retrieved 2026-06-28.
  209. Kokotajlo, Daniel; Halstead, Ben; Kastner, Alex (2025-12-31). "AI Futures Timelines and Takeoff Model: Dec 2025 Update". AI Alignment Forum. Retrieved 2026-06-28.
  210. "Measuring AI Ability to Complete Long Tasks". METR. 2025.
  211. Template:Cite arxiv
  212. Kokotajlo, Daniel; Alexander, Scott; Larsen, Thomas; Lifland, Eli; Dean, Romeo (April 2025). "AI 2027". AI Futures Project.{{cite web}}: CS1 maint: date and year (link)
  213. Kokotajlo, Daniel; et al. (2025). "AI 2027: Full Scenario". AI Futures Project. {{cite web}}: Explicit use of et al. in: |last2= (help)
  214. Artificial Intelligence Index Report 2025 (PDF) (Report). Stanford Institute for Human-Centered Artificial Intelligence. 2025.
  215. Sevilla, Jaime; Heim, Lennart; Ho, Anson; Besiroglu, Tamay; Hobbhahn, Marius; Villalobos, Pablo (2022). "Compute Trends Across Three Eras of Machine Learning". arXiv.
  216. "Trends in Artificial Intelligence". Epoch AI. Retrieved 2026-06-28.