Dylan Patel: AI Industry Target Is Roughly $100 Million Revenue Per Megawatt Per Year

SemiAnalysis's Dylan Patel said the AI industry target is roughly $100 million of revenue per megawatt per year, with Anthropic approaching that figure and OpenAI getting closer. He said this is why "fast mode" tokens carry a real premium, since a chip costing 10x more per megawatt but running only 3x faster per token requires users to pay a real multiple more for that speed for the megawatt economics to clear.
Patel and co-host Jordan Nanos discussed the edge case on SemiAnalysis, with Patel saying, "It seems pretty clear some people will pay more for fast mode. We at least have been, but I imagine we'll stop being able to afford fast mode at some point," referencing their own eight-figure AI bill as a signal that premium inference pricing has a ceiling. $NVDA