Article 6SANS Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inference

Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inference

by
from Hacker News on (#6SANS)
Story ImageComments
External Content
Source RSS or Atom Feed
Feed Location https://news.ycombinator.com/rss
Feed Title Hacker News
Feed Link https://news.ycombinator.com/
Reply 0 comments