← Observe Developing · Medium

AI Infrastructure Rebuild

Supernodes, Rubin racks, UnifiedBus, CPO, memory, and power are becoming one systems problem.

2026-10-2319 key events
Topic direction
Why watch

The real competition is shifting from single-chip speed to rack, network, memory, power, packaging, protocol, software stack, and deployment economics.

Current read

The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations.

Last updated · 2026-10-23 Key events · 19 Entities · NVIDIA / AMD / Broadcom / Cisco / Arista / Huawei / HPE / SpaceX
AIInfrastructureSupernodeRubinUnifiedBusCPONetworkingInferenceDatacenterMemoryPower
Key events
Timeline axis Latest → Earlier

Scroll right for earlier events

Reverse event list

Product

No New Chips at GTC: What Jensen Huang Told Berlin

GTC Berlin had no new chip: production systems stood on stage; the announcements covered factory delivery, agent runtimes, and enterprise data. NVIDIA turns the engineering problems of AI adoption into product…

1 published post 1 published post The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations. /thinking/gtc-berlin-2026-editorial/
Product

How the Tesla Roadster Goes Airborne: Fans, Thrusters and Limits

Tesla has put tire load, electric power, underbody suction and short-duration gas thrust into one vehicle-motion control problem. This analysis checks the physics and engineering costs of fan suction, cold-gas…

9 published posts 9 published posts The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations. /thinking/tesla-roadster-2026-analysis/
Product

OCP 2026: Racks Keep Getting More Open — Why Platforms Remain Hard to Replace

Chip supply and deployment capacity are now constraining AI infrastructure together. NVIDIA is widening what it opens around racks, facilities, and operations software; AMD is using Helion to organize agents'…

1 published post 1 published post The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations. /thinking/ocp-2026-rack-wars/
Technology

OCP 2026 Panorama: AI Infrastructure’s System Boundaries and Industry Opportunities

A panorama of OCP Global Summit 2026: the system boundary expands from chips to facilities and the grid, while openness diverges across racks, networking, power, liquid cooling, memory, and security. Ten chapt…

1 published post 1 published post The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations. /thinking/ocp-2026-panorama/
Market

Inside a 10,000-GPU Token Factory: Investment, Operations and Exit

A reproducible scenario for 1,250 eight-GPU B300 servers connects rental and token revenue with costs, tax, financing and exit. Project IRR is about 7.3%; procurement prices and cache billing change the invest…

2 published posts 2 published posts The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations. /thinking/token-factory-financial-model/
Market

The Token Factory Ledger: The Other Side of Soaring Demand

In 2026 the compute market raises and cuts prices at once. This article audits compute as a token factory: the token is not a stable unit of account; prices split into deflating old tiers and a firm frontier;…

1 published post 1 published post The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations. /thinking/token-factory-ledger/
Market

The Network Becomes the Backplane: Arista Takes Ethernet Into the Rack

On October 7, Arista announced the SU-144 scale-up architecture: a single-hop domain of up to 144 accelerators, extendable to 1,024 across racks, using Ethernet as the backplane — alongside a liquid-cooled rac…

1 published post 1 published post The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations. /thinking/arista-scale-up-ethernet/
Product

How Do You Judge Whether a Cross-Platform Ecosystem Is Truly Mature?

The testable question: when a team migrates a second model, upgrades a framework, or replaces a hardware generation, how much prior work can be reused? This piece splits reuse into four layers: interface shape…

7 published posts 7 published posts The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations. /thinking/dsa-07-ecosystem-maturity/
Technology

How Big a Training Ground Does a 10,000-GPU Cluster Need? Count Effective Samples Before Se…

Working backward from about 4.1 million trainable trajectories delivered in one week: the inference-side floor is about 74 tokens/s per card, average in-flight environments 7,100 to 13,000, folding to roughly…

1 published post 1 published post The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations. /thinking/dsec-10k-gpu-environment-sizing/
Research

DeepSeek DSec: Training Infrastructure Serving About 3 Million Sandboxes a Day

DeepSeek’s DSec serves about 3 million sandboxes a day, letting agents run training tasks in real environments. This article unpacks how it uses independent environment layers and on-demand reads to cut prepar…

1 published post 1 published post The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations. /thinking/dsec-agent-training-sandbox/
Technology

Yunqi 2026: Alibaba’s Chip-Model-Cloud Full Stack

Yunqi 2026 put three releases on one stage: Zhenwu V900 (3× per generation, 216GB, 2027Q1), Qwen’s zero-human RSI loop (33 rounds, AA 40→45), and a cloud rebuilt for agents (AI storage cost −69%, a 20GW target…

1 published post 1 published post The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations. /thinking/yunqi-2026-chip-model-cloud/
Product

HC 2026 Panorama: The Unit of Competition Shifts from Chip to System

A panorama read of Huawei Connect 2026: six components, from intelligent-computing supernodes and general-purpose supernodes to memory storage, interconnect, cloud services, and industry portfolios, stacked in…

2 published posts 2 published posts The next infrastructure boundary will be decided by the coupled system: accelerator, NIC, switch, protocol, memory locality, runtime, power, storage, and operations. /thinking/hc2026-panorama/
Company

HPE turns AI factory into stack integration

HPE Discover ties AI factory, network, agent workload, and strategy into one systems bet.

4 linked posts The HPE series connects agent workloads, AI factory, networking, and strategy. That makes HPE a useful marker for whether enterprise AI infrastructure becomes an integrated stack rather than a GPU procurement project. Prediction: enterprise AI infrastructure vendors will compete on integration proof, not only benchmark numbers. /thinking/hpe-discover-2026-strategy/
Market

MaaS exposes inference economics

MaaS articles make the cost stack visible: KV cache, batching, routing, utilization, and token distribution.

2 linked posts The MaaS articles expose a layered cost structure: model serving, KV cache, batching, utilization, token distribution, and customer acquisition all interact. Prediction: inference winners will need cost observability and routing intelligence as much as model quality. /thinking/maas-inference-tech-stack/
Technology

KV Cache rewrites the memory hierarchy

Inference forces infrastructure to treat memory, SSD, and scheduling as one hierarchy.

3 linked posts Long-context and agentic workloads make cache size, memory bandwidth, storage tiering, and scheduler policy visible to product economics. Prediction: memory/storage vendors will become direct participants in inference architecture decisions. /thinking/kv-cache-deep-dive/
operation

Colossus shows compute is not battle power

SpaceX Colossus rental signals that raw GPU count does not equal usable AI capacity.

1 linked posts The Colossus signal shows that AI infrastructure value depends on turning capacity into usable service. Idle, mismatched, or hard-to-integrate compute becomes a cost problem. Prediction: utilization and workload fit will become first-class due diligence metrics for AI infra. /thinking/spacex-colossus-compute-reality/
Technology

Optics debate moves into AI fabric timing

CPO/NPO debate shows optical interconnect is now an investment and deployment timing question.

2 linked posts The CPO/NPO debate and Optical Shuffle supplement both point to the same question: when does copper stop scaling economically for AI fabrics? Prediction: optical adoption will be uneven and tied to cluster scale, packaging risk, and operational confidence. /thinking/cpo-vs-npo-semianalysis-optics-debate/
Technology

Topology and protocol become architecture

MRC, ZCube, RailFly, and Lingqu connect transport, topology, NICs, switches, and AI workload shape.

5 linked posts The MRC, ZCube, RailFly, Lingqu, and RNG articles collectively show the same shift: topology, transport, and endpoint intelligence are moving into AI architecture decisions. Prediction: the next cluster design cycle will evaluate NIC, switch, routing, and protocol as one architecture bundle. /thinking/mrc-protocol-when-nic-becomes-the-brain/
Technology

Power, packaging, and memory become the hidden bottleneck

800V power, 3D stacking, Rubin BOM, and CPU comeback point to non-GPU constraints.

5 linked posts The 800V, 3D stacking, Rubin BOM, CPU comeback, and supernode articles all push attention toward power, packaging, host processing, memory, and rack cost. Prediction: the next infrastructure advantage will come from solving cross-layer bottlenecks rather than only buying faster GPUs. /thinking/analog-chip-800v-datacenter-power-revolution/

Open questions

  • Q01 Trend Will infrastructure advantage shift from accelerators to coupled rack-level systems?
  • Q02 Possible path Which layer captures margin first: model, serving stack, memory, network, power, or cloud operations?
  • Q03 Constraint Do NICs, switches, and protocols become part of the accelerator architecture once memory locality dominates?
  • Q04 Validation Will enterprise AI factories be integrated products, or remain custom assembly projects?

Linked Thinking

Core essays 131

October 202624 posts
2026-10-23AI 基础设施 No New Chips at GTC: What Jensen Huang Told Berlin GTC Berlin had no new chip: production systems stood on stage; the… Read 2026-10-18Tesla How the Tesla Roadster Goes Airborne: Fans, Thrusters and Limits Tesla has put tire load, electric power, underbody suction and… Read 2026-10-18OCP OCP 2026: Helion and the Vera CPU Rack — Plan Agent Execution and Model Inference Capacity Separately Plan agent execution and model inference capacity separately Read 2026-10-18OCP OCP 2026: Open Networks Deepen — From Switch-Chip Adaptation to Endpoint Co-Design and Platform Management From switch-chip adaptation to endpoint co-design and platform management Read 2026-10-18OCP OCP 2026: USFP and CPO Advance in Parallel — Optical Interconnect Choice Depends on Link Bottleneck and Service Boundary Optical interconnect choice depends on link bottleneck and service boundary Read 2026-10-18OCP OCP 2026: Liquid-Cooling Interface Standardization — Maintenance Scope and Recovery Time Decide the Compute Hours You Lose Maintenance scope and recovery time decide the compute hours you lose Read 2026-10-18OCP OCP 2026: Power Standardization for the AI Factory — Power Design Must Join Disturbance Response and Service Recovery Power design must join disturbance response and service recovery Read 2026-10-18OCP OCP 2026: Tahan and ESUN — Ethernet Scale-up Ships First, Open Interop Still Unproven Ethernet scale-up ships first, open interop still unproven Read 2026-10-18OCP OCP 2026: KV-Cache Pooling Enters Validation — Returns Depend on Reuse and Transfer Cost Returns depend on reuse and transfer cost Read 2026-10-18OCP OCP 2026: Run:ai Goes Fully Open Source — AI Platform Builders Should Focus on Delivery and Operations AI platform builders should focus on delivery and operations Read 2026-10-17OCP OCP 2026: Racks Keep Getting More Open — Why Platforms Remain Hard to Replace Chip supply and deployment capacity are now constraining AI infrastructure… Read 2026-10-16OCP OCP 2026 Panorama: AI Infrastructure’s System Boundaries and Industry Opportunities A panorama of OCP Global Summit 2026: the system boundary expands from… Read 2026-10-13AI Inside a 10,000-GPU Token Factory: Investment, Operations and Exit A reproducible scenario for 1,250 eight-GPU B300 servers connects rental… Read 2026-10-13AI Investing in a Token Factory: High Rental Rates Do Not Make a Good Investment Scarcity can explain high rents today, but not returns after delivery. A… Read 2026-10-11AI 基础设施 The Token Factory Ledger: The Other Side of Soaring Demand In 2026 the compute market raises and cuts prices at once. This article… Read 2026-10-09AI The Network Becomes the Backplane: Arista Takes Ethernet Into the Rack On October 7, Arista announced the SU-144 scale-up architecture: a… Read 2026-10-08DeepSeek How Do You Judge Whether a Cross-Platform Ecosystem Is Truly Mature? The testable question: when a team migrates a second model, upgrades a… Read 2026-10-08DeepSeek Throughput Up 20%, Why Might Cost Rise? The unit of performance comparison is not tokens per second per device,… Read 2026-10-08DeepSeek Why Can “It Runs” Still Be Wrong? A migrated program that keeps producing output with normal latency is not… Read 2026-10-08DeepSeek Why Is FlashMLA Fast? FlashMLA’s official 410/360 TFLOPS are sparse attention results measured… Read 2026-10-08DeepSeek Why Does MoE Get Stuck on Communication? Measuring MoE communication by GB/s alone is not enough; four things must… Read 2026-10-08DeepSeek Same API, Why Can’t It Be Dropped In Directly? API compatibility reduces calling-layer rework; data layout decides… Read 2026-10-08DeepSeek What Is DeepSeek Actually Migrating? If you understand migration as “load the weights, run generation,” you… Read 2026-10-07DeepSeek How Big a Training Ground Does a 10,000-GPU Cluster Need? Count Effective Samples Before Servers Working backward from about 4.1 million trainable trajectories delivered… Read
September 202615 posts
2026-09-29DeepSeek DeepSeek DSec: Training Infrastructure Serving About 3 Million Sandboxes a Day DeepSeek’s DSec serves about 3 million sandboxes a day, letting agents run… Read 2026-09-23云栖大会 2026 Yunqi 2026: Alibaba’s Chip-Model-Cloud Full Stack Yunqi 2026 put three releases on one stage: Zhenwu V900 (3× per… Read 2026-09-22华为 HC 2026 Panorama: The Unit of Competition Shifts from Chip to System A panorama read of Huawei Connect 2026: six components, from… Read 2026-09-22灵衢 UnifiedBus UnifiedBus 2.1: Compute Interconnect Sets Its Own Pace One day after Huawei Connect 2026 opened, the 586-page UnifiedBus Base… Read 2026-09-21华为 Huawei’s One Network: The HC 2026 Networking Panorama Huawei’s HC 2026 networking launches, mapped onto the five-network… Read 2026-09-19AI The Model Optimizes the System, the System Runs the Model: Building GLM's Frontier Inference on 100,000 Domestic Accelerators All production inference for GLM-5.3-Flash runs on more than 100,000… Read 2026-09-17AI 芯片 Same Node, Double the Compute: How Ascend 960 Rebuilds the Chip, the Supernode, and the Cluster With the process node pinned at N+2, Ascend 960 doubles compute through… Read 2026-09-16AI 基础设施 Fitting a Trillion Parameters into One Machine: HBF and the Three Knobs of Memory Provisioning A September Huawei paper offers a configuration answer for single-node… Read 2026-09-15AI 芯片 Folding Makes the Chip Run Cooler: Reading Huawei's τ-Law V3 Paper Against the Kirin 9050 Pro Measurements Logic folding lifts transistor density by 55 percent, and the instinct… Read 2026-09-13AI 基础设施 Marvell Is Betting on Everything Between the XPUs: Optical Interconnect, a Memory Fabric, and a 97.7% Performance-Vested Warrant The AI infrastructure bottleneck narrative has migrated from compute to… Read 2026-09-12AI 基础设施 From Blueprints to 100,000 GPUs: Matryoshka, Meta's Network Compiler How does a network design blueprint become configuration running on… Read 2026-09-09AI Microsoft Moved "Yield" into AI Infrastructure: Maia 200 and the Yield-Defined Architecture Microsoft's September 1 blog shipped no product; it proposed a new… Read 2026-09-08AI 基础设施 AI Cluster Observability Series: How Meta's RDMATracer Closes the Kernel Blind Spot with 13 eBPF Probes A deep dive into Meta's NAIC '26 RDMATracer paper: 13 curated eBPF probes… Read 2026-09-05AI Looped Transformers Hit the Frontline: Why OpenAI, Zhipu, and Academia Converged on the Same Stack of Layers Recurrent depth turns model depth from an architectural constant into a… Read 2026-09-01AI 基础设施 MetaRoCE in Depth: RDMA Designed for Loss, an Open Standard for Million-GPU Scale MetaRoCE is Meta's clean-sheet RDMA transport protocol, opened through… Read
August 202625 posts
2026-08-31AI 基础设施 The Token Factory Ledger: Inference Economics in SiliconFlow's Prospectus Revenue of RMB 55.3M in 2025 (+653%), gross margin of -24%, net loss of… Read 2026-08-31AI 基础设施 2026Q2 NVIDIA Earnings: From Selling Chips to Selling AI Factories Revenue of $96.2B, guidance above $100B for the first time. The evidence… Read 2026-08-30AI 基础设施 Agents Pull the CPU Back to the Table: Four Questions from Hot Chips 2026 Six Hot Chips 2026 CPU talks distilled into four questions: the serial… Read 2026-08-27AI 基础设施 Five Networks for the AI Factory: Spectrum-X Multi-Plane and the 512K-GPU Scale Spectrum-X multi-plane splits the AI factory network into five dedicated… Read 2026-08-27AI 基础设施 Hyperscaler Silicon, Generation Two: Three Routes to the Training–Inference Split Three clouds all brought second-generation custom silicon: MTIA 400's dual… Read 2026-08-27AI 基础设施 Intel's Triple Launch: 18A Full In-House, 350W Air-Cooled Inference, UCIe Open Packaging Three Intel talks form a complete deployment-cost logic chain: Diamond… Read 2026-08-27AI 基础设施 Four Routes Against the Memory Wall: Hot Chips 2026 Delivers the Answer from the Silicon Side Micron sizes the wall with four bills: about 90% of package area to… Read 2026-08-27AI 基础设施 Hot Chips 2026 Overview: Per-Token Economics Is Forcing Decode Specialization Twenty-seven talks across two days, collected into one map and inventoried… Read 2026-08-26AI 基础设施 OpenAI Turns In Its Scorecard: An Analysis of the First Measured Results for Its In-House Jalapeño Chip At Hot Chips, OpenAI delivered Jalapeño's first measured results: 1.5-1.9×… Read 2026-08-25AI 基础设施 Dissecting SemiAnalysis AgentX: The First Big Exam for Agentic-Era Inference SemiAnalysis spent $3M capturing real Claude Code traces, open-sourced 393… Read 2026-08-25AI From Solo Bet to Consensus: Groq 3 LPX Full Production and Low-Latency Inference's Eight Months Eight months ago, folding an inference-chip company into its platform was… Read 2026-08-22SIGCOMM Protocol Stacks at 1.6T Ports: The Kernel Stack's Last Mile and Four Ways Out As ports head to 1.6Tbps, the protocol-stack CPU tax becomes a cost line… Read 2026-08-22SIGCOMM Collectives Become a Runtime: SIGCOMM 2026's Collective-Communication Turning Point Three production realities — MoE explosion, superpod heterogeneity,… Read 2026-08-22SIGCOMM Scale-Up Is the New Datacenter Network: SIGCOMM 2026 Re-runs 2015-2020 NVL72 and CloudMatrix384 production volumes turned the intra-rack… Read 2026-08-22SIGCOMM KV Cache Becomes a Network Citizen: How SIGCOMM 2026 Rewired LLM Inference as a Networking Problem After PD disaggregation, KV cache became explicit network payload. Six… Read 2026-08-22SIGCOMM SIGCOMM 2026 Close Reading: The Networking Community Moves Its Coordinate System onto AI Infrastructure A session-by-session count of 110 SIGCOMM 2026 papers: AI-workload papers… Read 2026-08-22AI The SubQ Three-Month Audit: The Technology Is Real, the Narrative Ran Ahead On May 5, Subquadratic released a model, SubQ, claiming a 12-million-token… Read 2026-08-11存储 Agent Storage Paradigm Reassessment: After FMS 2026, Projections Became Products About a month later, the four-stage framework is validated and revised… Read 2026-08-11存储 FMS 2026: The Storage Hierarchy Is Being Networked AI is transforming the storage hierarchy from discrete layers into a… Read 2026-08-08AI推理 KV Cache Scheduling Engineering: After Compressing to 7% V4 Flash CSA+HCA architecture-level hot-cold tiering, strategy benchmarks,… Read 2026-08-08AI The Efficiency Limit of Model Memory: From MLA to CSA+HCA First understand Tang et al. three-axis taxonomy, then test against… Read 2026-08-08AI推理 Inference Pricing Teardown: The Physical Cost of a Token Reverse-engineering inference pricing from V4 Flash/Pro dual-model… Read 2026-08-07AI The Model Is the Computer: Why AMD Bought Taalas Taalas etches model weights directly into mask ROM silicon, eliminating… Read 2026-08-06AI Two Paths: Kimi K3 vs DeepSeek V4 Architecture Divergence Kimi K3 and DeepSeek V4 delivered, in the same quarter, two different… Read 2026-08-06AI 基础设施 Physical Constraints in the AI Supply Chain: Four Bottlenecks and the Reshaping Landscape AI investment commitments are not the same as delivered capacity. This… Read
July 202620 posts
2026-07-31AI 基础设施 NVLink's Moat: The Battle for Open Scale-Up Interconnect In a 72-GPU MoE model, every token-routing all-to-all step waits on the… Read 2026-07-31AI 基础设施 Routing and Congestion in 100K-GPU Clusters: When Physics Pushes Back A 100K-GPU cluster network isn't just a bigger network — it's a network… Read 2026-07-29AMD AMD Helios Supernode Teardown: Can Ethernet-Based Scale-Up Crack NVLink's Moat? AMD's Helios rack-scale AI platform is the first credible challenge to… Read 2026-07-28EDA Server Sizing for EDA Engineers: A Hardware Guide That 80% of Buyers Get Wrong Specing an EDA cluster with an AI-cluster mindset is the most common… Read 2026-07-23AI When Alphabet Burns $5.9B in a Quarter: The AI Infrastructure Capex Paradox Google Cloud revenue grew 82% YoY. Alphabet total revenue grew 24%. Then… Read 2026-07-22AI WAIC Revisited: Engineering Choices, Technology Delivery, and Enterprise Decisions in Supernode Design Whether an enterprise should purchase a supernode depends on four things:… Read 2026-07-21AI infrastructure When AI Agents Reinvent the File System: From "Everything Is a File" to "Everything Is Context" Agent workloads are rewriting the foundational assumptions of storage… Read 2026-07-18AI WAIC 2026 Field Notes: Year One of Supernodes, Training on Domestic Silicon, and the Third Path A live examination of China's AI industry after three years of… Read 2026-07-17存储 When Storage Becomes Agent Working Memory: Three Years of FMS Trend Migration and Technology Roadmap Agent storage paradigm analysis: KV Cache cross-tiering, Agent random IOPS… Read 2026-07-16AI Scale-Across: AI Clusters Are Growing Across Cities GPU clusters have already exceeded the power supply limits of a single… Read 2026-07-15AI Silicon Photonics' Three-Year Reshuffle: Component Bottlenecks, Route Divergence, and Supply-Demand Variables AI data center optical interconnect is transitioning from pluggable to… Read 2026-07-14semiconductor When the Best Earnings Meet the Worst Crash: A Structural Anatomy of the Semiconductor Selloff and Memory Market Forecasts SK Hynix plunged 15.37% in its worst single-day drop ever, erasing $1.3… Read 2026-07-12AI KV Cache as Infrastructure: When the Cache Layer Decouples from the Inference Engine Reasoning system design from workload physics. Six cluster challenges,… Read 2026-07-11AI GPU Is Becoming Oil: When Compute Turns from Scarce Resource to Tradable Commodity Ornn launched a GPU spot market, Nvidia lost $1T in market cap in two… Read 2026-07-09AI The Chinese Market Panorama Under Gartner's $2.6T AI Spending Framework A four-layer map of China's AI infrastructure market: accelerators and… Read 2026-07-06AI The $2.60 Trillion AI Infrastructure Stack: A Layer-by-Layer Breakdown of Gartner's 8 Segments Gartner forecasts $2.60 trillion in global AI spending for 2026, with… Read 2026-07-05AI Where the 100x Comes From: Decomposing the Three-Layer Multiplication of AI Hardware-Software Co-Design SemiAnalysis founder Dylan Patel's 100x framework: AI efficiency gains… Read 2026-07-04ODCC The Infrastructure Generation Gap: AI Data Centers at ODCC 2026 In eight years, power density has increased 15-25x. Six technology… Read 2026-07-03semiconductor τ Scaling V2: From Theoretical Framework to Production Evidence Deep read of He Tingbo's τ scaling paper V2. 381 mass-produced chips,… Read 2026-07-01AI $3.1 Billion for Data Infrastructure, Not AI: Schneider’s Acquisition of Cognite and the Value Thesis for Vertical AI Schneider spent $3.1B not on an AI model but on data infrastructure. This… Read
June 202631 posts
2026-06-30AI Corning GlassBridge: Fiber-to-PIC Coupling and the Limits of CPO Manufacturing Claims What GlassBridge changes at the fiber-to-PIC interface, how coupling loss… Read 2026-06-30AI When Tokens Stop Being Costs and Start Being Capital: The Economics of Tokenmaxxing 2.0 Empirical validation of compounding correctness is turning inference from… Read 2026-06-28AI Two Cracks in the Export Control Wall: Apple Courts CXMT, GLM-5.2 Rivals Mythos Apple lobbies to buy chips from blacklisted Chinese memory maker CXMT; WSJ… Read 2026-06-27AI Inside Jalapeño: What Happens When an AI Company Builds Its Own Heart # Inside Jalapeño: What Happens When an AI Company Builds Its Own Heart On… Read 2026-06-26LineShine LineShine Addendum: New Details Confirmed by The Next Platform's Deep Dive An addendum to our LineShine coverage: The Next Platform’s deep teardown… Read 2026-06-25AI4S From ISC 2026 to AI4S: HPC Is Shifting from a "Peak-FLOPS Machine" into a "Scientific Validation Engine" **Declaration:** This article is written based on publicly available… Read 2026-06-24HPC LineShine Tops TOP500: 2 EFLOPS Pure-CPU (6/29 Update) ISC 2026 confirms LineShine #1 in both TOP500 and HPCG. Top 500… Read 2026-06-21AI Inside the Inference Engine From Prefill to CUDA Kernel — a Millisecond-Level Breakdown of an… Read 2026-06-21AI Anatomy of an Inference Bill 85% of your AI bill is infrastructure tax; only 15% creates value Read 2026-06-21AI The Three Blind Spots of AI Observability When your monitoring says "all green" while your AI systems quietly burn… Read 2026-06-18HPE The $14 Billion Bet: HPE Discover 2026 Strategic Overview A decade of divestiture, then all-in on networking and AI factories. HPE's… Read 2026-06-18HPE Network as the AI Control Plane: HPE's Networking Gamble QFX six-tier coverage from training to inference, GreenLake Intelligence… Read 2026-06-18HPE Decoding the HPE AI Factory: Compute, Storage, Software, and the Cray Integration Experiment DL 394 Gen 12, Alletra MPX 10000 MCP-native storage, GreenLake full-stack… Read 2026-06-18HPE When AI Agents Become Workloads: HPE's Agent Infrastructure Blueprint Zero-code registration, three-tier identity, NVIDIA sandbox, MCP-native… Read 2026-06-16MaaS MaaS Inference Tech Stack: How Six Levers Cut Cost by 96% Technical dissection of DeepSeek's 96% per-token cost reduction. Six… Read 2026-06-16MaaS The Token Distribution Era: MaaS Service Models and Business Anatomy China's MaaS break-even line is 5-7 yuan/million tokens, with mainstream… Read 2026-06-15AI The Tyranny of Memory: How KV Cache Is Reshaping Every Layer of AI Inference In the 1M-context era, KV Cache is the defining bottleneck of inference… Read 2026-06-14AI When SSD Becomes Memory: How AI Inference Is Rewriting the Storage Hierarchy Three facts, sitting side by side in the first half of 2026, create a… Read 2026-06-13AI基础设施 Compute Power Is Not Fighting Power: What the SpaceX Colossus Lease Tells Us About AI Infrastructure Reality 220,000 GPUs built and leased out within a year. The SpaceX Colossus lease… Read 2026-06-12CPO One Report Wiped Out Optical Stocks: Is CPO Actually Dead? On June 9, 2026, SemiAnalysis sent a research note to institutional… Read 2026-06-12存储 RAMageddon: The Memory Famine and Storage Supercycle in AI Data Centers AI inference will rewrite the storage hierarchy. HBM margins exceed GPUs,… Read 2026-06-11AI Text Diffusion vs. Autoregressive: The Paradigm War DiffusionGemma at 1,107 tok/s, Mercury in commercial deployment, Dream 7B… Read 2026-06-08AI基础设施 Making K8s Understand Super-Nodes: openFuyao and the Lingqu Cloud-Layer Breakout The Lingqu cloud layer wraps hardware capabilities into K8s-native… Read 2026-06-08AI基础设施 Heart of the Super-Node: How the Lingqu Service Layer Weaves 8,192 Cards Together The Lingqu service layer answers how 8,192 cards cooperate — UBS Engine… Read 2026-06-08AI基础设施 Making Linux Understand Super-Nodes: Technical Anatomy of the Lingqu Kernel Layer Lingqu (UnifiedBus) super-nodes require systemic changes to the Linux… Read 2026-06-07AI Breaking the Transceiver Bottleneck: How Optical Shuffle Reshapes AI Cluster Economics Panduit engineer Castro proposes Optical Shuffle at IEEE 802.3, cutting… Read 2026-06-05AI A New Direction for Data Center Networking: What RNG Opens Up In April 2026, AWS switched all new non-GPU datacenters to a flat topology… Read 2026-06-04AI NVIDIA Rubin Respins: Is AMD GPU Competitiveness for Real? Fubon Research reveals Rubin was respun due to MI450 pressure. Full… Read 2026-06-02AI From CLOS to ZCube: Network Topology Evolution for AI Computing Clusters From Charles Clos's non-blocking telephone switching network in 1953 to… Read 2026-06-02AI MRC: When the NIC Becomes the Brain of the Network OpenAI, together with NVIDIA, AMD, Broadcom, Arista, and Cisco, overturned… Read 2026-06-01NVIDIA The PC, Reinvented: Computex 2026 and NVIDIA's Infrastructure Ambitions At GTC Taipei, Jensen Huang unveiled RTX Spark—33 years of technology… Read
May 202616 posts
2026-05-31AI Data Center The $27 Billion Hidden Thread: AI Data Center Power Distribution Revolution and the New Analog Chip Landscape As rack power consumption surges from 15kW to 1.5MW, power distribution… Read 2026-05-30AI Deep Analysis of the Lingqu Protocol What Huawei Lingqu UnifiedBus does, how its protocol stack connects… Read 2026-05-28AI The CPU Is Back: How Agentic AI Is Rewriting the Server Processor Landscape Three things happened almost simultaneously in May 2026. AMD's Venice… Read 2026-05-27semiconductor From CoWoS to Tau Scaling: 3D Stacked Chips, Technology Evolution, and the Route Fork On May 25, 2026, Huawei's He Tingbo unveiled "Tau Scaling" at ISCAS 2026,… Read 2026-05-27AI The $7.8M AI Rack Estimate: Reading Morgan Stanley's Rubin BOM Assumptions A review of historical Rubin VR200 NVL72 rack estimates attributed to… Read 2026-05-26AI Two Revolutions, One Network: The Co-Evolution of AI Training Cluster Topology and Protocol AI training networks at 100K GPU scale are undergoing simultaneous… Read 2026-05-26AI Starting from ZCube: Network Topology Design for PD Disaggregated Inference As inference replaces training as the primary battlefield for AI… Read 2026-05-25thinking DeepSeek V4 + Ascend: Full-Stack Validation of Domestic AI Inference DeepSeek V4 is the most extreme MoE inference workload in existence: 1.6T… Read 2026-05-25thinking Ascend Supernode Architecture Leap: From Training-First to Agent-First A single Ascend 950 card delivers roughly 23% of the FP8 compute of an… Read 2026-05-25AI RailFly: Network Topology Design for Prefill-Decode Disaggregated Inference Using ZCube as a baseline, we analyze the core value and limitations of… Read 2026-05-24AI PDC Disaggregated Serving for DeepSeek V4-Pro: From Compute Principles to Deployment Configs Targeting NVIDIA B300 and Huawei Ascend 950 Supernode, this article… Read 2026-05-23AI Ascend 950: Huawei's Third Path Calibrated with architect report: B300 36PFLOPS dense FP8, SLA-safe EP… Read 2026-05-21AI Broadcom Tomahawk 6 vs NVIDIA Networking Chips: A Full-Stack Benchmark from Silicon to AI Factory A full-stack comparison from switch chips to optical packaging, from… Read 2026-05-21AI NVIDIA Q1 FY2027 Earnings Deep Analysis: Technical Signals and Strategic Games Behind $81.6B Agentic AI demand has gone parabolic, but NVIDIA faces a triple squeeze:… Read 2026-05-20AI The Death of CPX and the Birth of LPU: A Paradigm Shift in AI Inference Architecture The Death of CPX and the Birth of LPU: A Paradigm Shift in AI Inference… Read 2026-05-20AI NVIDIA Supernode Evolution: From NVL72 to NVL576 — The Leap from Copper Cables to Photonics The 5,000 copper cables of NVL72 were abandoned within two years: Rubin… Read

Cross-topic links 10

August 20263 posts
July 20262 posts
June 20263 posts
May 20262 posts