Running Deepseek R1 671B Versions Locally or 70B on Groq Remotely
by Brian Wang from NextBigFuture.com on (#6V02J)
The distilled versions of Deepseek are not as good as the full model. They are vastly inferior and other models out perform them handily. Running the full model, with a 16K or greater context window, is possible for about $2000 at about 4 tokens per second. This uses an Machine Specs AMD EPYC 7702 512GB ...