AI Inception for Lower Costs and Compressed Models
by Brian Wang from NextBigFuture.com on (#6A6MP)
The Stanford Alpaca AI demonstrated the use of a larger and more expensive AI model to train a smaller and cheaper model. The cheaper model was as good and in come cases better than the more expensive model. The more expensive AI model generated vast amounts of better training data to improve the smaller model. ...