Article 6MJR3 SEQUOIA: Exact Llama2-70B on an RTX4090 with half-second per-token latency

SEQUOIA: Exact Llama2-70B on an RTX4090 with half-second per-token latency

by
from Hacker News on (#6MJR3)
Comments
External Content
Source RSS or Atom Feed
Feed Location https://news.ycombinator.com/rss
Feed Title Hacker News
Feed Link https://news.ycombinator.com/
Reply 0 comments