Microsoft and OpenAI method could make training large neural networks cheaper

Fine-tuning cost using Transfer was 7% of what it would be to pre-train GPT-3

Companies scaling up their neural network models could cut expensive training costs by employing a new technique developed by researchers at Microsoft and OpenAI....