Article 6RNV7 New AI Algorithm Can Reduce LLM Energy Usage by 80-95%

New AI Algorithm Can Reduce LLM Energy Usage by 80-95%

by
Brian Wang
from NextBigFuture.com on (#6RNV7)
Story ImageNew Linear-complexity Multiplication (L-Mul) algorithm claims it can reduce energy costs by 95% for element-wise tensor multiplications and 80% for dot products in large language models. It maintains or even improving precision compared to 8-bit floating point operations. By replacing complex floating-point multiplication with integer addition Solution in this Paper - Approximates floating-point multiplication using ...

Read more

External Content
Source RSS or Atom Feed
Feed Location http://feeds.feedburner.com/blogspot/advancednano
Feed Title NextBigFuture.com
Feed Link https://www.nextbigfuture.com/
Reply 0 comments