Article 6ACMA Llama.cpp 30B runs with only 6GB of RAM now

Llama.cpp 30B runs with only 6GB of RAM now

by
from on (#6ACMA)
Story ImageComments
External Content
Source RSS or Atom Feed
Feed Location http://news.ycombinator.com/rss
Feed Title
Feed Link http://news.ycombinator.com/
Reply 0 comments