Timeline of Google Brain

From Timelines
Jump to: navigation, search

This is a timeline of Google Brain.

Big picture

Time period Development summary More details


Full timeline

Year Month and date Event type Details
2011 Andrew Ng launches "the Deep Learning project at Google".[1] This project would eventually become Google Brain.
2011 early in the year Jeff Dean runs into Andrew Ng at a Google campus microkitchen. Ng tells Dean about Project Marvin, an internal effort to experiment with neural networks. Dean begins working on the project during his "20 percent time". Soon Dean brings in Greg Corrado and Ng invites one of his graduate students, Quoc Le. Project Marvin would eventually be referred to as Google Brain.[2]
2011 November 13 A New York Times article from this day covering Google X mentions that Andrew Ng is at Google X.[3]
2012 "Large Scale Distributed Deep Networks" by Jeff Dean et al. is published. The paper introduces the software framework DistBelief, a precursor to TensorFlow.[4][5]
2012 December Ray Kurzweil joins Google as a director of engineering.[6] When asked whether he is trying to build an artificial "Google Brain" as part of Jeff Dean's program, Kurzweil replies that "Jeff Dean is one of my collaborators".[7] It's not clear whether he was actually part of what would become Google Brain.
2012 June 26 A blog post by Jeff Dean and Andrew Ng is published on the official Google blog. The post covers work done by the two at Google; in particular it announces the paper "Building High-level Features Using Large Scale Unsupervised Learning", which has been called "the cat paper". Neither the blog post nor the paper mentions a "Google Brain" (either as a project name or a team name), but this work was done by the Google Brain project.[8][2]
 ? Andrew Ng leaves Google to lead Baidu's AI team.[2]
2013 March Google hires Geoffrey Hinton and acquires DNNresearch Inc., the neural networks company started by Hinton and two of his graduate students, Alex Krizhevsky and Ilya Sutskever.[9] The news reporting does not mention what Hinton would be working on at Google, but presumably he joined what would become Google Brain.
2013 or 2014? Google Brain graduates out of Google X and into "the broader research organization" (does that mean Google Research?). At this point the Google Brain team has fewer than 10 people.[2]
2015 June 17 The "Inceptionism" blog post is published on the Google Research/AI blog. The post explains a method of gradually tweaking images to see what a neural network has learned, and gives examples of the resulting dream-like images.[10] (The post doesn't explicitly mention Google Brain, but the post has the "Google Brain" label.)
2015 July 1 The DeepDream repository is published on GitHub.[11]
2015 October 2015 The Google Brain Residency, a 12-month program for early-career deep learning researchers, is announced. The first group of residents would begin in June 2016.[12][13][14][15][16]
2015 November 9 Google open-sources TensorFlow, a machine learning library. "TensorFlow was originally a project developed by researchers and engineers working on the Google Brain Team within Google's Machine Intelligence research organization".[17][18][19] The TensorFlow preliminary white paper is also published on this day.[20]
2016 February Greg Corrado and Jeff Dean of Google Brain approach Macduff Hughes, the director of Google Translate. Corrado and Dean tell Hughes that Google Translate could be overhauled with a neural network-based approach to machine translation by the end of 2016.[2]
2016 April 8 The Google Brain team page is shared on Hacker News.[21] This is possibly the first verifiable date on which "Google Brain" is used as a team name.
2016 April 16 The first Internet Archive snapshot of the Google Brain team web page is from this day.[22]
2016 June 1 Magenta, a Google Brain project that uses machine learning to generate art and music, is announced.[23]
2016 August 4 The Google Brain team does an AMA ("ask me anything") on Reddit on the subreddit r/MachineLearning.[24]
2016 September 27 The Google Neural Machine Translation system is announced in a post on the Google AI Blog. The post is written by research scientists on the Google Brain team, and the post acknowledges the Google Brain team for contributions to the project.[25] For more information, see Google Brain § Google Translate.
2016 October 21 "Learning to Protect Communications with Adversarial Neural Cryptography" by Martín Abadi and David G. Andersen of Google Brain is uploaded to the arXiv. The paper trains neural networks to learn encryption and decryption.[26][27] See Google Brain § Artificial-intelligence-devised encryption system for more information.
2017 February 2 "Pixel Recursive Super Resolution" by Ryan Dahl, Mohammad Norouzi and Jonathon Shlens of Google Brain is uploaded to the arXiv. The paper describes a way to use neural networks to enhance pixelated input images into realistic higher-resolution images.[28][29][30][31] For more information, see Google Brain § Image enhancement.
2017 February 15 TensorFlow 1.0.0 is released.[32] (It's not clear that the Google Brain team still maintains TensorFlow, so this event may not belong on the timeline.)
2017 September 9 The Google Brain team does its second AMA ("ask me anything") on Reddit on the subreddit r/MachineLearning.[33]
2018 January The Google Brain Residency program is renamed to the Google AI Residency program as a result of broadening the research groups participating in the program.[34]

Numerical and visual data

Mentions on Google Scholar

The following table summarizes per-year mentions on Google Scholar as of May 30, 2021.

Year DeepMind Google Brain Google AI
2010 97
2011 84 619,000
2012 107 646,000
2013 112 708,000
2014 252 641,000
2015 480 655,000
2016 1,450 558,000
2017 2,430 471,000 206,000
2018 3,810 295,000 195,000
2019 4,760 200,000 134,000
2020 5,570 108,000 94,900
Deepmind gogle brain tb.png

Google Trends

The comparative chart below shows Google Trends data for Google Brain (Topic) and Google Brain (Search termn) from January 2010 to February 2021, when the screenshot was taken. Interest is also ranked by country and displayed on world map.[35]

Google Brain gt.jpg

Google Ngram Viewer

The chart below shows Google Ngram Viewer data for Google Brain from 2010 to 2019.[36]

Google Brain ngram.jpg

Wikipedia Views

The chart below shows pageviews of the English Wikipedia article Google Brain on desktop from December 2007, and on mobile-web, desktop-spider,mobile-web-spider and mobile app, from July 2015; to January 2021.[37]

Google Brain wv.jpg


Meta information on the timeline

How the timeline was built

The initial version of the timeline was written by Issa Rice.

Funding information for this timeline is available.

Feedback and comments

Feedback for the timeline can be provided at the following places:

  • FIXME

What the timeline is still missing

Timeline update strategy

See also

External links

References

  1. ↑ Daniela Hernandez (May 7, 2013). "The Man Behind the Google Brain: Andrew Ng and the Quest for the New AI". Wired Enterprise. Archived from the original on June 1, 2013. Retrieved May 12, 2018. 
  2. ↑ 2.0 2.1 2.2 2.3 2.4 Gideon Lewis-Kraus. "The Great A.I. Awakening". The New York Times. Retrieved May 17, 2018. 
  3. ↑ Miller, Claire Cain; Bilton, Nick (November 13, 2011). "At Google X, a Top-Secret Lab Dreaming Up the Future". The New York Times. Retrieved May 12, 2018. 
  4. ↑ Jeffrey Dean; et al. (2012). "Large Scale Distributed Deep Networks" (PDF). 
  5. ↑ "Large Scale Distributed Deep Networks". Retrieved June 13, 2018. 
  6. ↑ Taylor, Colleen (December 15, 2012). "Ray Kurzweil Joins Google In Full-Time Engineering Director Role; Will Focus On Machine Learning, Language Processing". TechCrunch. Retrieved May 13, 2018. 
  7. ↑ Levy, Steven (April 25, 2013). "How Ray Kurzweil Will Help Google Make the Ultimate AI Brain". WIRED. Retrieved May 13, 2018. 
  8. ↑ Dean, Jeff; Ng, Andrew. "Using large-scale brain simulations for machine learning and A.I.". Official Google Blog. Retrieved May 12, 2018. 
  9. ↑ U of T Media (March 12, 2013). "Media Room & Blue Book – University of Toronto". Retrieved May 13, 2018. 
  10. ↑ "Inceptionism: Going Deeper into Neural Networks". Google AI Blog. Retrieved June 13, 2018. 
  11. ↑ "google/deepdream". GitHub. Retrieved June 13, 2018. 
  12. ↑ Dean, Jeff; Phillips, Leslie (January 5, 2017). "Google Brain Residency Program - 7 months in and looking ahead". Google Research Blog. Archived from the original on January 6, 2017. Retrieved June 13, 2018. In October 2015 we launched the Google Brain Residency, a 12-month program focused on jumpstarting a career for those interested in machine learning and deep learning research. This program is an opportunity to get hands on experience using the state-of-the-art infrastructure available at Google, and offers the chance to work alongside top researchers within the Google Brain team. 
  13. ↑ "Shobeir Fakhraei on Twitter". Twitter. October 22, 2015. Retrieved June 13, 2018. Jeff Dean announced Google Brain Residency Program @googleresearch at #baylearn 
  14. ↑ D'Onfro, Jillian (October 22, 2015). "Google is 're-thinking' all of its products to include machine learning". Business Insider. Retrieved June 13, 2018. As Google was reporting earnings, Google's head of research Jeff Dean announced a new Brain Residency Program. The 12-month role will be similar to a Master's or PhD program in deep learning, a branch of machine learning that aims to mimic the brain. 
  15. ↑ doomie (October 23, 2015). "Google Brain residency program • r/MachineLearning". reddit. Retrieved June 13, 2018. 
  16. ↑ keveman (October 23, 2015). "Google Brain Residency Program". Hacker News. Retrieved June 13, 2018. 
  17. ↑ Perez, Sarah (November 10, 2015). "Google Open-Sources The Machine Learning Tech Behind Google Photos Search, Smart Reply And More". TechCrunch. Retrieved May 17, 2018. 
  18. ↑ Vanhoucke, Vincent. "Very proud to be open-sourcing TensorFlow, Google's newest Deep Learning fram...". Retrieved May 17, 2018. TensorFlow is what we use every day in the Google Brain team, and while it's still very early days and there are a ton of rough edges to be ironed out, I'm excited about the opportunity to build a community of researchers, developers and infrastructure providers around it. 
  19. ↑ "tensorflow/tensorflow". GitHub. Retrieved May 18, 2018. TensorFlow was originally developed by researchers and engineers working on the Google Brain team within Google's Machine Intelligence Research organization for the purposes of conducting machine learning and deep neural networks research. 
  20. ↑ Abadi; et al. "TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems" (PDF). Retrieved May 17, 2018. 
  21. ↑ "Google Brain Team". Hacker News. Retrieved May 12, 2018. 
  22. ↑ "Research at Google". Archived from the original on April 16, 2016. Retrieved May 12, 2018. 
  23. ↑ Eck, Douglas (June 1, 2016). "Welcome to Magenta!". Magenta. Retrieved May 17, 2018. 
  24. ↑ "AMA: We are the Google Brain team. We'd love to answer your questions about machine learning. • r/MachineLearning". reddit. Retrieved May 12, 2018. 
  25. ↑ Le, Quoc V.; Schuster, Mike (September 27, 2016). "A Neural Network for Machine Translation, at Production Scale". Google AI Blog. Retrieved May 13, 2018. 
  26. ↑ "[1610.06918] Learning to Protect Communications with Adversarial Neural Cryptography". Retrieved June 13, 2018. 
  27. ↑ Anthony, Sebastian (October 28, 2016). "Google teaches "AIs" to invent their own crypto and avoid eavesdropping". Ars Technica. Retrieved June 13, 2018. 
  28. ↑ "[1702.00783] Pixel Recursive Super Resolution". Retrieved June 13, 2018. 
  29. ↑ Anthony, Sebastian (February 7, 2017). "Google Brain super-resolution image tech makes "zoom, enhance!" real". Ars Technica. Retrieved June 13, 2018. 
  30. ↑ Hollister, Sean (February 7, 2017). "Google just made 'zoom and enhance' a reality – kinda". CNET. Retrieved June 13, 2018. 
  31. ↑ Fingas, Jon (February 7, 2017). "Google uses AI to sharpen low-res images". Engadget. Retrieved June 13, 2018. 
  32. ↑ Feng, Yifei (February 15, 2017). "TensorFlow 1.0.0". GitHub. Retrieved June 13, 2018. 
  33. ↑ "We are the Google Brain team. We'd love to answer your questions (again) • r/MachineLearning". reddit. Retrieved May 12, 2018. 
  34. ↑ Dean, Jeff (January 12, 2018). "The Google Brain Team — Looking Back on 2017 (Part 2 of 2)". Google AI Blog. Retrieved June 13, 2018. We've now broadened the program to include many other research groups across Google and renamed it the Google AI Residency program (the application deadline for this year's program has just passed; look for information about next year's program at g.co/airesidency/apply). 
  35. ↑ "Google Brain". Google Trends. Retrieved 23 February 2021. 
  36. ↑ "Google Brain". books.google.com. Retrieved 23 February 2021. 
  37. ↑ "Google Brain". wikipediaviews.org. Retrieved 24 February 2021. 
Retrieved from "http://timelines.issarice.com/index.php?title=Timeline_of_Google_Brain&oldid=78986"