Perplexity shows how to run monster AI models more efficiently on aging GPUs, AWS networks
Some clever networking hacks open the door AI search provider Perplexity's research wing has developed a new set of software optimizations that allows for trillion parameter or large models to run efficiently across older, cheaper hardware using a variety of existing network technologies, including Amazon's proprietary Elastic Fabric Adapter....