Google "We Have No Moat, And Neither Does OpenAI" (SemiAnalysis)

The SemiAnalysis site has what is said to be aleaked Google document on the state of open-source AI development.Open source, it concludes, is winning.

At the beginning of March the open source community got their handson their first really capable foundation model, as Meta's LLaMA wasleaked to the public. It had no instruction or conversation tuning,and no RLHF. Nonetheless, the community immediately understood thesignificance of what they had been given.

A tremendous outpouring of innovation followed, with just daysbetween major developments (see The Timeline for the fullbreakdown). Here we are, barely a month later, and there arevariants with instruction tuning, quantization, qualityimprovements, human evals, multimodality, RLHF, etc. etc. many ofwhich build on each other.

(Thanks to Dave Taht).