pub struct SlowJobPool {
    internal: Arc<Mutex<InternalSlowJobPool>>,
}
Expand description

Provides a Wrapper around rayon threadpool to execute slow-jobs. slow means, the job doesn’t need to not complete within the same tick. DO NOT USE I/O blocking jobs, but only CPU heavy jobs. Jobs run here, will reduce the ammount of threads rayon can use during the main tick.

Configuration

This Pool allows you to configure certain names of jobs and assign them a maximum number of threads # Example Your system has 16 cores, you assign 12 cores for slow-jobs. Then you can configure all jobs with the name CHUNK_GENERATOR to spawn on max 50% (6 = cores)

Spawn Order

  • At least 1 job of a configuration is allowed to run if global limit isn’t hit.
  • remaining capacities are spread in relation to their limit. e.g. a configuration with double the limit will be sheduled to spawn double the tasks, starting by a round robin.

States

  • queued
  • spawned
  • started
  • finished

let threadpool = rayon::ThreadPoolBuilder::new()
    .num_threads(16)
    .build()
    .unwrap();
let pool = SlowJobPool::new(3, 10, Arc::new(threadpool));
pool.configure("CHUNK_GENERATOR", |n| n / 2);
pool.spawn("CHUNK_GENERATOR", move || println!("this is a job"));

Fields§

§internal: Arc<Mutex<InternalSlowJobPool>>

Implementations§

source§

impl SlowJobPool

source

pub fn new( global_limit: u64, jobs_metrics_cnt: usize, threadpool: Arc<ThreadPool> ) -> Self

source

pub fn configure<F>(&self, name: &str, f: F)
where F: Fn(u64) -> u64,

configure a NAME to spawn up to f(n) threads, depending on how many threads we globally have available

source

pub fn try_run<F>(&self, name: &str, f: F) -> Result<SlowJob, ()>
where F: FnOnce() + Send + Sync + 'static,

spawn a new slow job on a certain NAME IF it can run immediately

source

pub fn spawn<F>(&self, name: &str, f: F) -> SlowJob
where F: FnOnce() + Send + Sync + 'static,

source

pub fn cancel(&self, job: SlowJob) -> Result<(), SlowJob>

source

pub fn take_metrics(&self) -> HashMap<String, Vec<JobMetrics>>

Trait Implementations§

source§

impl Clone for SlowJobPool

source§

fn clone(&self) -> SlowJobPool

Returns a copy of the value. Read more
1.0.0 · source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more

Auto Trait Implementations§

Blanket Implementations§

source§

impl<T> Any for T
where T: 'static + ?Sized,

source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
source§

impl<T> Borrow<T> for T
where T: ?Sized,

source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
source§

impl<T> From<T> for T

source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
source§

impl<T, U> Into<U> for T
where U: From<T>,

source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

§

impl<T> Pointable for T

§

const ALIGN: usize = _

The alignment of pointer.
§

type Init = T

The type for initializers.
§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
source§

impl<T> Same for T

§

type Output = T

Should always be Self
source§

impl<Context> SubContext<Context> for Context

source§

fn sub_context(self) -> Context

source§

impl<T> ToOwned for T
where T: Clone,

§

type Owned = T

The resulting type after obtaining ownership.
source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

§

type Error = Infallible

The type returned in the event of a conversion error.
source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

impl<T> Event for T
where T: Send + Sync + 'static,

§

impl<T> Resource for T
where T: Any + Send + Sync,