For the average AI shop, sparse models and cheap memory will win

Massive language models aren't for everyone, but neither is heavy-duty hardware, says AI systems maker Graphcore

As compelling as the leading large-scale language models may be, the fact remains that only the largest companies have the resources to actually deploy and train them at meaningful scale....