For the average AI shop, sparse models and cheap memory will win
Massive language models aren't for everyone, but neither is heavy-duty hardware, says AI systems maker Graphcore
As compelling as the leading large-scale language models may be, the fact remains that only the largest companies have the resources to actually deploy and train them at meaningful scale....