Supply and demand says otherwise. I think costs are actually going to go up.
Right now they are trying to make sure the AI you run on your phone can't be used for coding or other tasks. They want to keep it expensive. They have no incentive to make it more efficient. No need.
The models aren't designed for efficiency either. There was a little scare with DeepSeek, but it turned out to be nothing. At the end of the day you need a lot of hardware and juice to run these things at scale. The costs aren't coming down any time soon. Nor is the impact to the environment unfortunately either.
Who is they? Even if Anthropic doesn’t have incentive to run their models on your phone (but really why wouldn’t they?), Apple, Google, and Samsung do. And DeepSeek was very much a something. It was a something that demonstrated the barrier to entry can be at least an order of magnitude lower than previously thought. LLM technology is easily commoditized, and moat building will be difficult. Supply and demand is doing just what you would expect.
Right now they are trying to make sure the AI you run on your phone can't be used for coding or other tasks. They want to keep it expensive. They have no incentive to make it more efficient. No need.
The models aren't designed for efficiency either. There was a little scare with DeepSeek, but it turned out to be nothing. At the end of the day you need a lot of hardware and juice to run these things at scale. The costs aren't coming down any time soon. Nor is the impact to the environment unfortunately either.