Modder crams LLM onto Raspberry Pi Zero-powered USB stick, but it isn't fast enough to be practical
by sayem.ahmed@futurenet.com (Sayem Ahmed) from Latest from Tom's Hardware on (#6VBDG)
A Raspberry Pi Zero can run a local LLM using llama.cpp. But, while functional, slow token speeds make it impractical for real-world use.