跳到正文
NVIDIA ACE· 一手来源· Elizabeth Goodman·· 17 天前AI 评分21

控制您的 GPU 如何与 Green Contexts 共享工作负载

Control How Your GPU Shares Work with Green Contexts

正文 · 原文

GPU applications increasingly consist of multiple independent components running at the same time within a single process: a latency-sensitive operator...

GPU applications increasingly consist of multiple independent components running at the same time within a single process: a latency-sensitive operator alongside a throughput-oriented background kernel; a data preprocessing stage alongside model inference; or multiple stages of a processing workflow sharing a single GPU. Controlling how GPU resources are shared between them remains difficult.

Source

来源:NVIDIA ACE · developer.nvidia.com