Module multi_gpu

Module multi_gpu 

Expand description

Multi-GPU coordination and load balancing.

This module provides infrastructure for coordinating work across multiple GPUs, including device selection, load balancing, and cross-device communication.

Structs§

CrossDeviceTransfer
Helper for cross-device data transfer.
DeviceInfo
Information about a GPU device.
DeviceStatus
Status of a device in the multi-GPU coordinator.
MultiGpuBuilder
Builder for multi-GPU coordinator.
MultiGpuConfig
Configuration for multi-GPU coordination.
MultiGpuCoordinator
Multi-GPU coordinator for managing kernels across devices.
MultiGpuStats
Multi-GPU coordinator statistics.

Enums§

LoadBalancingStrategy
Strategy for balancing load across devices.