Karpathy Makes GPT from Scratch
by Brian Wang from NextBigFuture.com on (#6AG8R)
X-Tesla AI-Lead shows how to makeGeneratively Pretrained Transformer (GPT). He followed the paper Attention is All You Need" and OpenAI's GPT-2 / GPT-3. He talk about connections to ChatGPT, which has taken the world by storm. We also watch GitHub Copilot, itself a GPT, help us write a GPT. Watch the makemore videos to get ...