Thursday, May 18, 2023

Google's Non-Moat For AI

"What does a leaked Google memo reveal about the future of AI?" 

"The barrier to entry for training and experimentation has dropped from the total output of a major research organisation to one person, an evening, and a beefy laptop," the Google memo claims. An LLM can now be fine-tuned for $100 in a few hours. With its fast-moving, collaborative and low-cost model, "open-source has some significant advantages that we cannot replicate." Hence the memo's title: this may mean Google has no defensive "moat" against open-source competitors. Nor, for that matter, does OpenAI.

If this assessment is true, regulations like those being proposed by the EU will do little to stop the spread of so-called "high-risk AI".