OpenAI’s September 29 announcement put GPT-6.1 Sol on the API and selected paid products. Cache reads are priced at $0.10 per million tokens, but cache writes cost $2.50; exceeding 272,000 input tokens raises rates for the entire request, not just the excess.
Bas Nijholt runs an LLM on two RTX 3090s but calculates that electricity and hardware can make an API cheaper. The outcome changes with utilization and with which API model is compared.