Historical brief · 2026-11-16

Intel and SambaNova Demonstrate Air-Cooled Heterogeneous AI Inference Architecture

According to SambaNova: At SuperComputing 2026, Intel and SambaNova demonstrated a heterogeneous inference system pairing Intel GPU D-Series for prompt prefill with SambaNova SN50 RDUs for token decode. This setup creates an air-cooled token factory that runs on existing infrastructure without requiring expensive liquid-cooled retrofits.

Source image · SambaNova

According to SambaNova:

Architecture and Hardware Split

Intel and SambaNova introduced an air-cooled heterogeneous inference architecture designed to handle distinct phases of AI workloads. According to the companies, the setup pairs Intel's 350W air-cooled D-Series PCIe GPUs (codenamed Crescent Island) for compute-heavy prompt prefill with SambaNova’s fifth-generation SambaRack SN50 Reconfigurable Dataflow Units (RDUs) for memory-bound token decode.

Software Stack and Integration

The demonstration runs on familiar open-source serving software, utilizing NVIDIA Dynamo for cache-aware request routing, vLLM for serving paths across both hardware types, and NIXL over standard RoCEv2 Ethernet to handle KV cache transfers. By keeping prefill and decode as separate pools, data center operators can independently scale each tier depending on whether traffic requires more prompt processing or output generation.

Impact on Existing Facilities

Citing data from Sightline Climate reported by Axios, up to half of worldwide data center projects slated for 2026 could face delays due to power limits and grid shortages. The companies state that this air-cooled approach allows operators to deploy high-performance inference in existing brownfield data centers, avoiding the time and cost of upgrading to direct liquid cooling.

View selection rationale
Official releaseDemonstration

Importance 75/100

Signal75Structure75Consequence75Confidence83Momentum70
About this brief
Content type
News summary
Source type
First-party / official source
Original source
SambaNova ↗
Source published
Process
AI-assisted discovery, translation, summarisation, classification and scoring; standards and corrections are maintained by the editorial desk.
Verification
The original URL and publication metadata are retained. This brief is not independently fact-checked unless explicitly stated.
Published by
Polyemergence Editorial Desk · PolyEmergence Pte Ltd.
Conflict disclosure
No financial or commercial conflict declared.

Editorial standards → · Corrections →

POLYEMERGENCE / EXPLORE

Keep exploring

Follow the topic, not just the headline.

Explore the Artificial Intelligence archive →