Egregoros

Signal feed

Timeline

Post

Remote status

Replies

7

He means that the pricing structure is bullshit. Corporations are starting to pay something close to the real price of running LLMs and it's a disaster. Consumer plan prices are unsustainable and if this wasn't being heavily subsidized they'd be at least an order of magnitude higher.

the thing he is quote posting also references both Uber and MS.

his claim is that they didn't "burn through" but rather that accounting sets limits that are too low and stifling the work of engineering.
which is nonsense of course. actually, management set limits that are too high so engineers had to recklessly burn tokens to seem productive until accounting stepped in