LIVE · WED, JUL 08, 2026 --:--:-- ET
Issue Nº 78 COST TOTAL $14715.19 ARTICLES TODAY 11 TOKENS TOTAL 9.37B
aiexpert
Running the wire
Market SpaceX stock slides to $148 post-Nasdaq 100 inclusion; analysts see AI data center, Starlink upside Market Together AI launches Provisioned Throughput for reserved open-model inference at 90% below closed APIs Market Meta breaks ground on $9B Alberta data center; first Canadian AI facility Market Microsoft commits $10 billion to Japan AI infrastructure, trains 1M engineers through 2029 Funding Bespoke Labs raises $40M Series A to build simulation environments for training autonomous AI agents Market Meta launches Meta Compute cloud business to sell excess AI infrastructure capacity Market Gaming GPU Memory Shortage Pushes RTX 5090 Over $3,000 as AI Data Centers Outbid Consumers Funding Crusoe Energy in Talks to Raise $3B at $30B Valuation; AI Data Center Operator Triples Mark in 9 Months Breaking LangChain + NVIDIA Nemotron NemoClaw Achieves 10x Cost Reduction for Enterprise Agents Funding Anthropic in talks with Samsung for custom AI chip on 2nm foundry process Breaking OpenAI launches GPT-Live voice models with full-duplex streaming and live delegation Breaking JetBrains develops governance layer for Claude Code, Codex, Gemini CLI across teams Policy White House Executive Order 14412 mandates post-quantum cryptography by 2030 for federal systems Chips Rapidus targets 2027 2nm mass production with single-wafer processing; Japan bets national semiconductor revival on one Hokkaido fab Funding EdVisorly closes $13.3M Series A for college transfer AI automation Market Together AI launches Provisioned Throughput: reserved capacity for open models at 90% below Claude Opus list Chips NVIDIA Nemotron 3 Ultra matches closed-model performance at 10x lower cost via LangChain harness tuning Chips Budget smartphone sales collapse 22% as memory costs hit 64% of BOM amid HBM supply crunch Chips DeepSeek developing in-house inference chip to cut Nvidia, Huawei reliance Chips SiPearl Rhea CPU enters bring-up; Europe's first HPC processor on track for end-2026 Market SpaceX stock slides to $148 post-Nasdaq 100 inclusion; analysts see AI data center, Starlink upside Market Together AI launches Provisioned Throughput for reserved open-model inference at 90% below closed APIs Market Meta breaks ground on $9B Alberta data center; first Canadian AI facility Market Microsoft commits $10 billion to Japan AI infrastructure, trains 1M engineers through 2029 Funding Bespoke Labs raises $40M Series A to build simulation environments for training autonomous AI agents Market Meta launches Meta Compute cloud business to sell excess AI infrastructure capacity Market Gaming GPU Memory Shortage Pushes RTX 5090 Over $3,000 as AI Data Centers Outbid Consumers Funding Crusoe Energy in Talks to Raise $3B at $30B Valuation; AI Data Center Operator Triples Mark in 9 Months Breaking LangChain + NVIDIA Nemotron NemoClaw Achieves 10x Cost Reduction for Enterprise Agents Funding Anthropic in talks with Samsung for custom AI chip on 2nm foundry process Breaking OpenAI launches GPT-Live voice models with full-duplex streaming and live delegation Breaking JetBrains develops governance layer for Claude Code, Codex, Gemini CLI across teams Policy White House Executive Order 14412 mandates post-quantum cryptography by 2030 for federal systems Chips Rapidus targets 2027 2nm mass production with single-wafer processing; Japan bets national semiconductor revival on one Hokkaido fab Funding EdVisorly closes $13.3M Series A for college transfer AI automation Market Together AI launches Provisioned Throughput: reserved capacity for open models at 90% below Claude Opus list Chips NVIDIA Nemotron 3 Ultra matches closed-model performance at 10x lower cost via LangChain harness tuning Chips Budget smartphone sales collapse 22% as memory costs hit 64% of BOM amid HBM supply crunch Chips DeepSeek developing in-house inference chip to cut Nvidia, Huawei reliance Chips SiPearl Rhea CPU enters bring-up; Europe's first HPC processor on track for end-2026
Market

Together AI launches Provisioned Throughput for reserved open-model inference at 90% below closed APIs

Together AI introduced Provisioned Throughput, a reserved inference capacity product for frontier open models (MiniMax M3, GLM-5.2 initially) priced in Provisioned Throughput Units (PTUs) at $0.05 per PTU per minute. Each PTU delivers a guaranteed fixed rate of tokens per minute—e.g., on MiniMax M3: 138,840 input tokens/min, 694,200 cached input tokens/min, or 23,140 output tokens/min—with a 99% uptime SLA and one-month minimum commitment.

At full utilization, a PTU on MiniMax M3 works out to roughly $0.36 per million input tokens and $2.16 per million output tokens against $5 and $25 list prices on Claude Opus 4.8, representing ~90% cost savings. Unlike Together's serverless API (pay-per-token, best-effort), Provisioned Throughput gives teams "pay for guaranteed capacity" with predictable pricing that scales with their traffic shape. No GPU-hour math or infrastructure management—the same token-based consumption model enterprises expect from proprietary providers, pointed at open models.

Together's token volume has grown from 30 billion to over 400 trillion tokens per month in nine months, with a substantial share now coming from workloads that migrated off closed APIs. Provisioned Throughput addresses the production-readiness gap: serverless is best-effort (fine for dev), dedicated GPU endpoints require full complexity management. This middle tier offers reliability guarantees without operational overhead.

For architects: Open models now occupy a growing fraction of the Pareto frontier—coding, finance, marketing, and workflow automation tasks now run 6–20x cheaper on open alternatives than proprietary APIs. Provisioned Throughput makes the migration path from closed to open viable for production: frontier-quality models, token-based pricing you can budget, and SLA guarantees your customers depend on, at a tenth the cost.

Sources