Intel and SambaNova Demonstrate Air-Cooled Heterogeneous AI Inference Architecture
According to SambaNova: At SuperComputing 2026, Intel and SambaNova demonstrated a heterogeneous inference system pairing Intel GPU D-Series for prompt prefill with SambaNova SN50 RDUs for token decode. This setup creates an air-cooled token factory that runs on existing infrastructure without requiring expensive liquid-cooled retrofits.

Original image temporarily unavailable
According to SambaNova:
Architecture and Hardware Split
Intel and SambaNova introduced an air-cooled heterogeneous inference architecture designed to handle distinct phases of AI workloads. According to the companies, the setup pairs Intel's 350W air-cooled D-Series PCIe GPUs (codenamed Crescent Island) for compute-heavy prompt prefill with SambaNova’s fifth-generation SambaRack SN50 Reconfigurable Dataflow Units (RDUs) for memory-bound token decode.
Software Stack and Integration
The demonstration runs on familiar open-source serving software, utilizing NVIDIA Dynamo for cache-aware request routing, vLLM for serving paths across both hardware types, and NIXL over standard RoCEv2 Ethernet to handle KV cache transfers. By keeping prefill and decode as separate pools, data center operators can independently scale each tier depending on whether traffic requires more prompt processing or output generation.
Impact on Existing Facilities
Citing data from Sightline Climate reported by Axios, up to half of worldwide data center projects slated for 2026 could face delays due to power limits and grid shortages. The companies state that this air-cooled approach allows operators to deploy high-performance inference in existing brownfield data centers, avoiding the time and cost of upgrading to direct liquid cooling.
View selection rationale
Importance 75/100
About this brief
- Content type
- News summary
- Source type
- First-party / official source
- Original source
- SambaNova ↗
- Source published
- Process
- AI-assisted discovery, translation, summarisation, classification and scoring; standards and corrections are maintained by the editorial desk.
- Verification
- The original URL and publication metadata are retained. This brief is not independently fact-checked unless explicitly stated.
- Published by
- Polyemergence Editorial Desk · PolyEmergence Pte Ltd.
- Conflict disclosure
- No financial or commercial conflict declared.