enum InferenceEngine::IStreamsExecutor::ThreadBindingType

Overview

Defines inference thread binding type. More…

#include <ie_istreams_executor.hpp>

enum ThreadBindingType
{
    NONE,
    CORES,
    NUMA,
    HYBRID_AWARE,
};

Detailed Documentation

Defines inference thread binding type.

Enum Values

NONE

Don’t bind the inference threads.

CORES

Bind inference threads to the CPU cores (round-robin)

NUMA

Bind to the NUMA nodes (default mode for the non-hybrid CPUs on the Win/MacOS, where the ‘CORES’ is not implemeneted)

HYBRID_AWARE

Let the runtime bind the inference threads depending on the cores type (default mode for the hybrid CPUs)