CNIPA.AI
返回搜索
档案

Non-Transparent Bridging (NTB) Utilizing Protocol Translations and CXL Fabric Attached Memory

发明专利审中
7浏览
33权利要求 · 5 独立
§ Ⅰ

卷宗概要

发明人

Ronen Aharon Hyatt; Gaya Opal Hyatt; Ethan Sharon Hyatt

IPC 分类

G6F 13/42

CPC 分类

G6F13/4221G6F2213/26

Protocol translation embodiments enabling Memory as a Service (MaaS) and symmetric memory access across heterogeneous computing infrastructures comprising CPUs, GPUs, accelerators, fabric attached memory, and interconnects such as CXL, UALink, NVLink, and Ethernet. The embodiments facilitate NTB or Host-to-Host memory borrowing and symmetric memory flows by translating between CXL and non-CXL protocols, enabling seamless memory sharing between CXL-native and legacy systems, such as PCIe. The embodiments receive non-CXL.cache requests from a first entity, translate them to CXL.cache Device-to-Host Requests for transmission to a second entity, and conversely translate CXL.mem requests to non-CXL.mem requests. This protocol translation enables memory pooling across diverse data center architectures where CPUs, GPUs, and accelerators may share memory resources through Host-to-Host memory borrowing. The embodiments support composable infrastructure for AI/ML workloads, cloud-native applications. The embodiments provide transparent memory disaggregation for multi-tenant environments, enabling dynamic memory provisioning with symmetric memory flows between heterogeneous compute nodes.

原文(中文)

Protocol translation embodiments enabling Memory as a Service (MaaS) and symmetric memory access across heterogeneous computing infrastructures comprising CPUs, GPUs, accelerators, fabric attached memory, and interconnects such as CXL, UALink, NVLink, and Ethernet. The embodiments facilitate NTB or Host-to-Host memory borrowing and symmetric memory flows by translating between CXL and non-CXL protocols, enabling seamless memory sharing between CXL-native and legacy systems, such as PCIe. The embodiments receive non-CXL.cache requests from a first entity, translate them to CXL.cache Device-to-Host Requests for transmission to a second entity, and conversely translate CXL.mem requests to non-CXL.mem requests. This protocol translation enables memory pooling across diverse data center architectures where CPUs, GPUs, and accelerators may share memory resources through Host-to-Host memory borrowing. The embodiments support composable infrastructure for AI/ML workloads, cloud-native applications. The embodiments provide transparent memory disaggregation for multi-tenant environments, enabling dynamic memory provisioning with symmetric memory flows between heterogeneous compute nodes.