Former Tesla AI Director reproduces GPT-2 in 24 hours for only $672 — GPT-4 costs $100 million to train
by from Tomshardware on (#6P6DS)
The project started as an educational video, but the developer got stuck on a few things, so 'raged-quit' and decided to rebuild GPT-2 from scratch.