Attention Is All You Need
Nothing is loaded from YouTube until you press play, and then without tracking cookies.
About this video
The paper that powers all modern AI.
Before founding NEAR, Illia Polosukhin was an AI researcher at Google.
He was also a co-author of Attention Is All You Need, the paper that introduced the Transformer architecture.
Today, Transformers power modern AI systems like ChatGPT, Gemini, and nearly every major large language model.
The AI story at NEAR didn't start recently. It's been there from the beginning. #NEARProtocol #AI #ChatGPT
Transcript
72 wordsCaptions as YouTube publishes them, usually machine-generated, so product and people names can be misheard.
- 0:00
before actually blockchain uh my background is in AI and machine learning. I was a researcher at Google and I'm one of the co-authors of the paper called attention is all you need. Speaking of attention, uh which introduced the core technology that's powering all of the modern AI. Uh so it's T and GPT. uh it's effectively base for all of the like LLMs and uh kind of modern AI models.