Skip to main content

HybridDispatcher

Struct HybridDispatcher 

pub struct HybridDispatcher {
    config: HybridConfig,
    stats: Arc<HybridStats>,
    adaptive_threshold: AtomicUsize,
}
Expand description

Dispatcher for routing workloads between CPU and GPU.

The dispatcher uses the configured ProcessingMode to decide where to execute each workload. In Adaptive mode, it learns the optimal threshold from runtime measurements.

Fields§

§config: HybridConfig§stats: Arc<HybridStats>§adaptive_threshold: AtomicUsize

Implementations§

§

impl HybridDispatcher

pub fn new(config: HybridConfig) -> HybridDispatcher

Creates a new hybrid dispatcher.

pub fn with_defaults() -> HybridDispatcher

Creates a dispatcher with default configuration.

pub fn should_use_gpu(&self, workload_size: usize) -> bool

Returns whether GPU should be used for the given workload size.

pub fn execute<W>( &self, workload: &W, ) -> Result<<W as HybridWorkload>::Result, HybridError>
where W: HybridWorkload,

Executes a workload using the appropriate backend.

Returns the result and records execution statistics.

pub fn execute_measured<W>( &self, workload: &W, ) -> Result<<W as HybridWorkload>::Result, HybridError>

Executes a workload and measures both backends for comparison.

In Adaptive mode, this updates the threshold based on measurements. Returns the result from the faster backend.

pub fn update_adaptive_threshold( &self, _workload_size: usize, cpu_time: Duration, gpu_time: Duration, )

Updates the adaptive threshold based on runtime measurements.

pub fn execute_cpu<W>(&self, workload: &W) -> <W as HybridWorkload>::Result
where W: HybridWorkload,

Forces execution on CPU regardless of mode.

pub fn execute_gpu<W>( &self, workload: &W, ) -> Result<<W as HybridWorkload>::Result, HybridError>
where W: HybridWorkload,

Forces execution on GPU regardless of mode.

pub fn config(&self) -> &HybridConfig

Returns the configuration.

pub fn stats(&self) -> &HybridStats

Returns the execution statistics.

pub fn stats_arc(&self) -> Arc<HybridStats>

Returns a shared reference to the statistics.

pub fn adaptive_threshold(&self) -> usize

Returns the current adaptive threshold.

pub fn set_adaptive_threshold(&self, threshold: usize)

Manually sets the adaptive threshold.

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
§

impl<T> ArchivePointee for T

§

type ArchivedMetadata = ()

The archived version of the pointer metadata for this type.
§

fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata

Converts some archived metadata to the pointer metadata for itself.
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
§

impl<F, W, T, D> Deserialize<With<T, W>, D> for F
where W: DeserializeWith<F, T, D>, D: Fallible + ?Sized, F: ?Sized,

§

fn deserialize( &self, deserializer: &mut D, ) -> Result<With<T, W>, <D as Fallible>::Error>

Deserializes using the given deserializer
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
§

impl<T> LayoutRaw for T

§

fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>

Gets the layout of the type.
§

impl<T> Pointable for T

§

const ALIGN: usize

The alignment of pointer.
§

type Init = T

The type for initializers.
§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
§

impl<T> Pointee for T

§

type Metadata = ()

The type for metadata in pointers and references to Self.
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more