Personal ‘AI Supercomputer’ Runs 120B-Parameter LLMs On-Device, Tiiny AI Says

It's often said that supercomputers of a few decades ago pack less power than today's smart watches. Now we have a company, Tiiny AI Inc., claiming to have built the world's smallest personal AI supercomputer that can run a 120-billion-parameter large language model on-device - without cloud connectivity, servers or GPUs.

The post Personal AI Supercomputer' Runs 120B-Parameter LLMs On-Device, Tiiny AI Says appeared first on Inside HPC & AI News | High-Performance Computing & Artificial Intelligence.