Web search was the last big innovative thing they did. The other good shit since was bought up, lol, easier to buy than innovative. Capitalists hate competing because they might lose.
What about “Attention Is A You Need”, the white paper that kick-started the whole generative AI and LLM thing? OpenAI’s GPT models are built off of that architecture, like pretty much everything that came after it.
Like sure, modern Google is notoriously bad at building the actual end products, but it publishes a lot of research and some of it pushes others forward quite a lot.
2017, actually. But the search engine (supposedly the last innovation according to the previous comment) has seen most of its leaps forward in late 90s to early 2000s, which is a lot earlier.
Also it’s pretty hard to find a more clear example of Google sharing well done research than the white paper that started the current AI bubble. But they do publish a lot of stuff.
Yea, and the main discovery being transformers (GPT predecessor). That allowed for the groundbreaking technology of AlphaFold to come into being, for which a Nobel prize was awarded to Demis Hassabis and John Jumper (who just left Google DeepMind to join Anthropic).
Web search was the last big innovative thing they did. The other good shit since was bought up, lol, easier to buy than innovative. Capitalists hate competing because they might lose.
What about “Attention Is A You Need”, the white paper that kick-started the whole generative AI and LLM thing? OpenAI’s GPT models are built off of that architecture, like pretty much everything that came after it.
Like sure, modern Google is notoriously bad at building the actual end products, but it publishes a lot of research and some of it pushes others forward quite a lot.
The LLM page was published in 2019 right? 7 years ago!
2017, actually. But the search engine (supposedly the last innovation according to the previous comment) has seen most of its leaps forward in late 90s to early 2000s, which is a lot earlier.
Also it’s pretty hard to find a more clear example of Google sharing well done research than the white paper that started the current AI bubble. But they do publish a lot of stuff.
I think it was 2017.
Yea, and the main discovery being transformers (GPT predecessor). That allowed for the groundbreaking technology of AlphaFold to come into being, for which a Nobel prize was awarded to Demis Hassabis and John Jumper (who just left Google DeepMind to join Anthropic).
Okay my bad, thx.