Option object to configure OpenVINO backend. More...

#include <option.h>

Public Member Functions
void	SetDevice (const std::string &name="CPU")
	Set device name for OpenVINO, default 'CPU', can also be 'AUTO', 'GPU', 'GPU.1'....

void	SetShapeInfo (const std::map< std::string, std::vector< int64_t >> &_shape_infos)
	Set shape info for OpenVINO.

void	SetCpuOperators (const std::vector< std::string > &operators)
	While use OpenVINO backend with intel GPU, use this interface to specify operators run on CPU.

void	SetAffinity (const std::string &_affinity)
	Set Affinity mode.

void	SetPerformanceHint (const std::string &_hint)
	Set the Performance Hint.

void	SetStreamNum (int _num_streams)
	Set the number of streams.

Public Attributes
int	num_streams = 1
	Number of streams while use OpenVINO.

std::string	affinity = "YES"
	Affinity mode.

std::string	hint = "UNDEFINED"
	Performance hint mode.

Detailed Description

Option object to configure OpenVINO backend.

The documentation for this struct was generated from the following file:

Public Member Functions