Timeline of Google Brain

From Timelines
Revision as of 14:58, 13 June 2018 by Issa (talk | contribs)
Jump to: navigation, search

This is a timeline of Google Brain.

Big picture

Time period Development summary More details

Full timeline

Year Month and date Event type Details
2011 Andrew Ng launches "the Deep Learning project at Google".[1] This project would eventually become Google Brain.
2011 early in the year Jeff Dean runs into Andrew Ng at a Google campus microkitchen. Ng tells Dean about Project Marvin, an internal effort to experiment with neural networks. Project Marvin was eventually referred to as Google Brain.[2]
2011 November 13 A New York Times article from this day covering Google X mentions that Andrew Ng is at Google X.[3]
2012 "Large Scale Distributed Deep Networks" by Jeff Dean et al. is published. The paper introduces the software framework DistBelief, a precursor to TensorFlow.[4][5]
2012 December Ray Kurzweil joins Google as a director of engineering.[6] When asked whether he is trying to build an artificial "Google Brain" as part of Jeff Dean's program, Kurzweil replies that "Jeff Dean is one of my collaborators".[7] It's not clear whether he was actually part of what would become Google Brain.
2012 June 26 A blog post by Jeff Dean and Andrew Ng is published on the official Google blog. The post covers work done by the two at Google; in particular it announces the paper "Building High-level Features Using Large Scale Unsupervised Learning", which has been called "the cat paper". Neither the blog post nor the paper mentions a "Google Brain" (either as a project name or a team name), but this work was done by the Google Brain project.[8][2]
 ? Andrew Ng leaves Google to lead Baidu's AI team.[2]
2013 March Google hires Geoffrey Hinton and acquires DNNresearch Inc., the neural networks company started by Hinton and two of his graduate students, Alex Krizhevsky and Ilya Sutskever.[9] The news reporting does not mention what Hinton would be working on at Google, but presumably he joined what would become Google Brain.
2013 or 2014? Google Brain graduates out of Google X and into "the broader research organization" (does that mean Google Research?). At this point the Google Brain team has fewer than 10 people.[2]
2015 June 17 The "Inceptionism" blog post is published on the Google Research/AI blog. The post explains a method of gradually tweaking images to see what a neural network has learned, and gives examples of the resulting dream-like images.[10] (The post doesn't explicitly mention Google Brain, but the post has the "Google Brain" label.)
2015 July 1 The DeepDream repository is published on GitHub.[11]
2015 November 9 Google open-sources TensorFlow, a machine learning library. "TensorFlow was originally a project developed by researchers and engineers working on the Google Brain Team within Google's Machine Intelligence research organization".[12][13][14] The TensorFlow preliminary white paper is also published on this day.[15]
2016 February Greg Corrado and Jeff Dean of Google Brain approach Macduff Hughes, the director of Google Translate. Corrado and Dean tell Hughes that Google Translate could be overhauled with a neural network-based approach to machine translation by the end of 2016.[2]
2016 April 8 The Google Brain team page is shared on Hacker News.[16] This is possibly the first verifiable date on which "Google Brain" is used as a team name.
2016 April 16 The first Internet Archive snapshot of the Google Brain team web page is from this day.[17]
2016 June 1 Magenta, a Google Brain project that uses machine learning to generate art and music, is announced.[18]
2016 August 4 The Google Brain team does an AMA ("ask me anything") on Reddit on the subreddit r/MachineLearning.[19]
2016 September 27 The Google Neural Machine Translation system is announced on the Google AI Blog. The post is written by research scientists on the Google Brain team, and the post acknowledges the Google Brain team for contributions to the project.[20]
2017 February 15 TensorFlow 1.0.0 is released.[21] (It's not clear that the Google Brain team still maintains TensorFlow, so this event may not belong on the timeline.)
2017 September 9 The Google Brain team does its second AMA ("ask me anything") on Reddit on the subreddit r/MachineLearning.[22]

Meta information on the timeline

How the timeline was built

The initial version of the timeline was written by Issa Rice.

Funding information for this timeline is available.

Feedback and comments

Feedback for the timeline can be provided at the following places:


What the timeline is still missing

Timeline update strategy

See also

External links


  1. Daniela Hernandez (May 7, 2013). "The Man Behind the Google Brain: Andrew Ng and the Quest for the New AI". Wired Enterprise. Archived from the original on June 1, 2013. Retrieved May 12, 2018. 
  2. 2.0 2.1 2.2 2.3 2.4 Gideon Lewis-Kraus. "The Great A.I. Awakening". The New York Times. Retrieved May 17, 2018. 
  3. Miller, Claire Cain; Bilton, Nick (November 13, 2011). "At Google X, a Top-Secret Lab Dreaming Up the Future". The New York Times. Retrieved May 12, 2018. 
  4. Jeffrey Dean; et al. (2012). "Large Scale Distributed Deep Networks" (PDF). 
  5. "Large Scale Distributed Deep Networks". Retrieved June 13, 2018. 
  6. Taylor, Colleen (December 15, 2012). "Ray Kurzweil Joins Google In Full-Time Engineering Director Role; Will Focus On Machine Learning, Language Processing". TechCrunch. Retrieved May 13, 2018. 
  7. Levy, Steven (April 25, 2013). "How Ray Kurzweil Will Help Google Make the Ultimate AI Brain". WIRED. Retrieved May 13, 2018. 
  8. Dean, Jeff; Ng, Andrew. "Using large-scale brain simulations for machine learning and A.I.". Official Google Blog. Retrieved May 12, 2018. 
  9. U of T Media (March 12, 2013). "Media Room & Blue Book – University of Toronto". Retrieved May 13, 2018. 
  10. "Inceptionism: Going Deeper into Neural Networks". Google AI Blog. Retrieved June 13, 2018. 
  11. "google/deepdream". GitHub. Retrieved June 13, 2018. 
  12. Perez, Sarah (November 10, 2015). "Google Open-Sources The Machine Learning Tech Behind Google Photos Search, Smart Reply And More". TechCrunch. Retrieved May 17, 2018. 
  13. Vanhoucke, Vincent. "Very proud to be open-sourcing TensorFlow, Google's newest Deep Learning fram...". Retrieved May 17, 2018. TensorFlow is what we use every day in the Google Brain team, and while it's still very early days and there are a ton of rough edges to be ironed out, I'm excited about the opportunity to build a community of researchers, developers and infrastructure providers around it. 
  14. "tensorflow/tensorflow". GitHub. Retrieved May 18, 2018. TensorFlow was originally developed by researchers and engineers working on the Google Brain team within Google's Machine Intelligence Research organization for the purposes of conducting machine learning and deep neural networks research. 
  15. Abadi; et al. "TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems" (PDF). Retrieved May 17, 2018. 
  16. "Google Brain Team". Hacker News. Retrieved May 12, 2018. 
  17. "Research at Google". Archived from the original on April 16, 2016. Retrieved May 12, 2018. 
  18. Eck, Douglas (June 1, 2016). "Welcome to Magenta!". Magenta. Retrieved May 17, 2018. 
  19. "AMA: We are the Google Brain team. We'd love to answer your questions about machine learning. • r/MachineLearning". reddit. Retrieved May 12, 2018. 
  20. Le, Quoc V.; Schuster, Mike (September 27, 2016). "A Neural Network for Machine Translation, at Production Scale". Google AI Blog. Retrieved May 13, 2018. 
  21. Feng, Yifei (February 15, 2017). "TensorFlow 1.0.0". GitHub. Retrieved June 13, 2018. 
  22. "We are the Google Brain team. We'd love to answer your questions (again) • r/MachineLearning". reddit. Retrieved May 12, 2018.