Module rate_limiting 

Rate limiting for enterprise workloads.

This module provides rate limiting capabilities for controlling request rates to GPU kernels and system resources, supporting both global and per-tenant limits.

Features

• Token bucket and sliding window algorithms
• Per-tenant rate limiting
• Global rate limiting
• Configurable burst capacity
• Real-time statistics

Example

use ringkernel_core::rate_limiting::{RateLimiter, RateLimitConfig};

let config = RateLimitConfig::default()
    .with_requests_per_second(100)
    .with_burst_size(50);

let limiter = RateLimiter::new(config);

if limiter.check("tenant_1").is_ok() {
    // Request allowed
}

Structs

FixedWindow 🔒

Fixed window rate limiter state.

LeakyBucket 🔒

Leaky bucket rate limiter state.

RateLimitConfig

Configuration for rate limiting.

RateLimitGuard

RAII guard for rate-limited operations.

RateLimiter

Global rate limiter.

RateLimiterBuilder

Builder for creating rate limiters.

RateLimiterStats 🔒

Internal statistics counters.

RateLimiterStatsSnapshot

Snapshot of rate limiter statistics.

SlidingWindow 🔒

Sliding window rate limiter state.

TenantLimiter 🔒

Per-tenant rate limiter entry.

TokenBucket 🔒

Token bucket rate limiter state.

Enums

LimiterState 🔒

Internal limiter state.

RateLimitAlgorithm

Rate limiting algorithm to use.

RateLimitError

Errors that can occur during rate limiting.

Traits

RateLimiterExt

Extension trait for acquiring guards.

Functions

shared_rate_limiter

Create a shared rate limiter.

Type Aliases

RateLimitResult

Result type for rate limiting operations.

SharedRateLimiter

Thread-safe, shareable rate limiter.