Module multi_gpu
Expand description
Multi-GPU coordination and load balancing.
This module provides infrastructure for coordinating work across multiple GPUs, including device selection, load balancing, and cross-device communication.
Structs§
- Cross
Device Transfer - Helper for cross-device data transfer.
- Device
Info - Information about a GPU device.
- Device
Status - Status of a device in the multi-GPU coordinator.
- Multi
GpuBuilder - Builder for multi-GPU coordinator.
- Multi
GpuConfig - Configuration for multi-GPU coordination.
- Multi
GpuCoordinator - Multi-GPU coordinator for managing kernels across devices.
- Multi
GpuStats - Multi-GPU coordinator statistics.
Enums§
- Load
Balancing Strategy - Strategy for balancing load across devices.