Lossy compression
I've thought of AI models as a lossily compressed version of the internet for a while, though I hadn't named it as such. Recently, Simon Willison coined a phrase that may more aptly capture the idea I've been circling.
Lossy encyclopedia
Since I love collecting questionable analogies for LLMs, here’s a new one I just came up with: an LLM is a lossy encyclopedia. They have a huge array of facts …
Simon Willison