Adds QAIRT API
Adds GPU Device interface specialization
Adds new DLC context binary handling functions to System.
Adds new UBWC data formats to QnnMem and properties to discover support.
Add ability to alias tensors in GPU custom ops.
Add hinting capability to QnnSystemDlc.
Added new DX12 MemType and a property to discover support for it on a backend.
Rectify accidental ABI breakage in QnnSystemInterface.h.
Add ability to add new records and save them in QnnSystemDlc.
Add support for ArrayOf encoding type.
API 2.34 is backwards compatible with previous releases.
API 2.34 is ABI compatible with API 2.32.
API 2.34 is ABI compatible with API 2.33 except QnnSystemInterface.h rectifying a
> problem introduced in SDK 2.44.0.
Adds QAIRT API
Adds GPU Device interface specialization
Adds new DLC context binary handling functions to System.
Adds new UBWC data formats to QnnMem and properties to discover support.
Add ability to alias tensors in GPU custom ops.
Add hinting capability to QnnSystemDlc.
Added new DX12 MemType and a property to discover support for it on a backend.
Rectify accidental ABI breakage in QnnSystemInterface.h.
Add ability to add new records and save them in QnnSystemDlc.
Add support for ArrayOf encoding type.
API 2.34 is backwards compatible with previous releases.
API 2.34 is ABI compatible with API 2.32.
API 2.34 is ABI compatible with API 2.33 except QnnSystemInterface.h rectifying a
> problem introduced in SDK 2.44.0.
Adds QAIRT API
Adds GPU Device interface specialization
Adds new DLC context binary handling functions to System.
Adds new UBWC data formats to QnnMem and properties to discover support.
Add ability to alias tensors in GPU custom ops.
Add hinting capability to QnnSystemDlc.
Added new DX12 MemType and a property to discover support for it on a backend.
Rectify accidental ABI breakage in QnnSystemInterface.h.
Add ability to add new records and save them in QnnSystemDlc.
Add support for ArrayOf encoding type.
API 2.34 is backwards compatible with previous releases.
API 2.34 is ABI compatible with API 2.32.
API 2.34 is ABI compatible with API 2.33 except QnnSystemInterface.h rectifying a
> problem introduced in SDK 2.44.0.
Add support for datatypes: QNN_DATATYPE_UINT_2, QNN_SFIXED_POINT_2,
QNN_DATATYPE_UFIXED_POINT_2, QNN_DATATYPE_UINT_4, QNN_DATATYPE_FLOAT_4, and
QNN_DATATYPE_FLOAT_8. Support can be queried through backend supported
operations and op defintion supplements.
Add Qnn_MicroscalingEncoding_t to support microscaling floating point encodings.
Support through QNN_PROPERTY_TENSOR_SUPPORT_QUANTIZATION_ENCODING_MICROSCALING.
Add new priority levels: QNN_PRIORITY_HIGH_PLUS, QNN_PRIORITY_CRITICAL,
QNN_PRIORITY_CRITICAL_PLUS, and QNN_PRIORITY_HIGHEST.
API 2.33 is backwards compatible with previous releases.
API 2.33 is ABI compatible with API 2.32.
Add support for BFloat16 datatypes. Operator support of BFloat16 can be queried
through backend supported operations and op definition supplements.
Add support for mapped quantization types: Qnn_BwAxisScaleOffsetMapped_t,
Qnn_BwBlockMapped_t, Qnn_BwBlockwiseExpansionMapped_t, and Qnn_BwFloatBlockEncoding_t
Support can be queried through
QNN_PROPERTY_TENSOR_SUPPORT_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET_MAPPED,
QNN_PROPERTY_TENSOR_SUPPORT_QUANTIZATION_ENCODING_BW_BLOCK_SCALE_OFFSET_MAPPED,
QNN_PROPERTY_TENSOR_SUPPORT_QUANTIZATION_ENCODING_BW_BLOCKWISE_EXPANSION_MAPPED,
QNN_PROPERTY_TENSOR_SUPPORT_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK.
API 2.32 is backwards compatible with previous releases.
API 2.32 is ABI compatible with API 2.31.
Support updates of context binary sections. Can be used to prepare new LoRA updates
for an existing binary section. Updates are retrieved through
QnnContext_getBinarySectionUpdate and freed
through QnnContext_freeBinarySectionUpdate.
API 2.31 is backwards compatible with previous releases.
API 2.31 is ABI compatible with API 2.30.
Support block encodings with float offsets for compatibility with GGUF model formats.
New encoding is added in Qnn_FloatBlockEncoding_t and backend support is queried
through QNN_PROPERTY_TENSOR_SUPPORT_QUANTIZATION_ENCODING_FLOAT_BLOCK.
Support tensor data formats QNN_TENSOR_DATA_FORMAT_UBWC_NV124R,
QNN_TENSOR_DATA_FORMAT_UBWC_NV124R_Y, and QNN_TENSOR_DATA_FORMAT_UBWC_NV124R_UV
to minimize data transformations in procesing pipelines utilizing UBWC. Support is
queried through QNN_PROPERTY_TENSOR_SUPPORT_UBWC_NV124R,
QNN_PROPERTY_TENSOR_SUPPORT_UBWC_NV124R_Y, and
QNN_PROPERTY_TENSOR_SUPPORT_UBWC_NV124R_UV.
API 2.30 is backwards compatible with previous releases.
API 2.30 is ABI compatible with API 2.29.
Add Context configuration QNN_CONTEXT_CONFIG_GRAPH_RETENTION_ORDER to specify order
in which graphs should be retained in memory as multiple graphs are switched.
Support is queried through QNN_PROPERTY_CONTEXT_SUPPORT_GRAPH_RETENTION_ORDER
API 2.29 is backwards compatible with previous releases.
API 2.29 is ABI compatible with API 2.28/2.28.1.
Clarified behavior when using NORMAL priority, which may be restricted by
the platform or backend.
Added QnnContext_createFromBinaryWithCallback to create contexts from a user
provided callback. Enables users to provide custom or platform specific
mechanisms for incremental context binary loading at runtime. Depending on
implementation, users may see memory or performance benefits when compared to
QnnContext_createFromBinary().
API 2.28 is backwards compatible with previous releases.
API 2.28 is ABI compatible with API 2.27. Applications built with API 2.27
(QAIRT 2.36) may be used with API 2.28 (QAIRT 2.37) without recompilation.
Added binary section type QNN_CONTEXT_SECTION_UPDATABLE_WEIGHTS and
QNN_CONTEXT_SECTION_UPDATABLE_QUANT_PARAM. Support for these binary section types
can be queried through QNN_PROPERTY_CONTEXT_SUPPORT_BINARY_WEIGHT_ONLY_UPDATES and
QNN_PROPERTY_CONTEXT_SUPPORT_BINARY_QUANT_ONLY_UPDATES.
Add QnnGlobalConfig component.
Extended Qnn_SocModel_t with more SoC Types.
Added QnnContext_finalize to finish initialization of contexts created with
QNN_CONTEXT_CONFIG_OPTION_DEFER_GRAPH_INIT.
Added tensor data formats QNN_TENSOR_DATA_FORMAT_HMX_WEIGHT.
Added QnnContext_getIncrementalBinary and QnnContext_releaseIncrementalBinary.
Support is queried through QNN_PROPERTY_CONTEXT_SUPPORT_INCREMENTAL_BINARY.
Added tensor data formats QNN_TENSOR_DATA_FORMAT_UBWC_RGBA8888,
QNN_TENSOR_DATA_FORMAT_UBWC_NV12, QNN_TENSOR_DATA_FORMAT_UBWC_NV12_Y, and
QNN_TENSOR_DATA_FORMAT_UBWC_NV12_UV.
Added tensor data format QNN_TENSOR_DATA_FORMAT_MX.
Added tensor types QNN_TENSOR_TYPE_OPTIONAL_APP_WRITE,
QNN_TENSOR_TYPE_OPTIONAL_APP_READ, and QNN_TENSOR_TYPE_OPTIONAL_APP_READ_WRITE.
Support for these tensor types can be queried with
QNN_PROPERTY_TENSOR_SUPPORT_OPTIONAL_APP_WRITE,
QNN_PROPERTY_TENSOR_SUPPORT_OPTIONAL_APP_READ, and
QNN_PROPERTY_TENSOR_SUPPORT_OPTIONAL_APP_READ_WRITE.
Added new tensor memory type QNN_TENSORMEMTYPE_RETRIEVE_RAW. Support can be queried
through QNN_PROPERTY_TENSOR_SUPPORT_RETRIEVE_RAW.
Added QnnBackend_getProperty and QnnContext_getProperty. Support for custom
properties can be queried with QNN_PROPERTY_BACKEND_SUPPORT_CUSTOM_PROPERTY and
QNN_PROPERTY_CONTEXT_SUPPORT_CUSTOM_PROPERTY respectively.
Added Qnn_OpMapping_t type.
Added property QNN_PROPERTY_GRAPH_SUPPORT_ONLINE_PREPARE.
Added error code QNN_GRAPH_ERROR_INVALID_CONTEXT.
Added QnnContext_getBinarySectionSize, QnnContext_getBinarySection, and
QnnContext_applyBinarySection APIs to provide support for producing and applying
updates to context binaries after creation. Support can be queried through
QNN_PROPERTY_CONTEXT_SUPPORT_BINARY_UPDATES.
Added QnnTensor_updateGraphTensors and QnnTensor_updateContextTensors APIs to
modify tensors after graph finalization.
Added QNN_TENSOR_TYPE_UPDATEABLE_<> for STATIC, NATIVE, APP_READ, APP_WRITE
and APP_READWRITE tensors and corresponding properties QNN_SUPPORT_UPDATEABLE_<>
Add GraphInfoV2_t to return updateable tensors in context binary metadata.
Add error code QNN_COMMON_ERROR_SYSTEM_COMMUNICATION_FATAL
Add QnnContext_createFromBinaryListAsync to asynchronously initialize multiple
context binaries.
Add new quantization encoding schemes QNN_QUANTIZATION_ENCODING_BLOCK,
QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION, and QNN_QUANTIZATION_ENCODING_VECTOR.
Support for these encoding schemes is determined through
QNN_PROPERTY_TENSOR_SUPPORT_QUANTIZATION_ENCODING_BLOCK,
QNN_PROPERTY_TENSOR_SUPPORT_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION, and
QNN_PROPERTY_TENSOR_SUPPORT_QUANTIZATION_ENCODING_VECTOR repsectively.
Added QNN_PROFILE_EVENTUNIT_NONE.
Introduced the QnnContext_createFromBinaryWithSignal API.
Added QNN_MEM_TYPE_DMA_BUF QnnMem type.
Clarified QnnProperty capability descriptions.
Introduced Qnn_TensorV2_t. Tensor V2 adds API support for sparse tensors,
dynamically shaped tensors, and graph execution early termination. Please consult
SDK documentation for further details. Support can be queried via
QNN_PROPERTY_TENSOR_SUPPORT_SPARSITY, QNN_PROPERTY_TENSOR_SUPPORT_DYNAMIC_DIMENSIONS,
and QNN_PROPERTY_GRAPH_SUPPORT_EARLY_TERMINATION.
Introduced the QnnContext_validateBinary API.
Introduced the QnnGraph_getProperty API.
Allow QnnGraph_finalize for deserialized graphs created via
QnnContext_createFromBinary.
Introduced the QnnGraph_prepareExecutionEnvironment and
QnnGraph_releaseExecutionEnvironment APIs.
Added QNN_CONTEXT_CONFIG_BINARY_COMPATIBILITY context config and
QNN_CONTEXT_ERROR_BINARY_SUBOPTIMAL context error code.
Introduced the QnnError.h API.
Introduced QNN_GRAPH_CONFIG_OPTION_SET_PROFILING_STATE and
QNN_GRAPH_CONFIG_OPTION_SET_PROFILING_NUM_EXECUTIONS graph configuration options.
Added QNN_PROPERTY_MEMORY_SUPPORT_MEM_TYPE_ION and
QNN_PROPERTY_MEMORY_SUPPORT_MEM_TYPE_CUSTOM capabilities.
Added QNN_CONTEXT_CONFIG_ENABLE_GRAPHS context configuration option,
QNN_PROPERTY_CONTEXT_SUPPORT_CONFIG_ENABLE_GRAPHS capability, and
QNN_GRAPH_ERROR_DISABLED error code.
Added QNN_CONTEXT_CONFIG_MEMORY_LIMIT_HINT context configuration option and
QNN_PROPERTY_CONTEXT_SUPPORT_CONFIG_MEMORY_LIMIT capability.
Added QNN_CONTEXT_CONFIG_PERSISTENT_BINARY context configuration option and
QNN_PROPERTY_CONTEXT_SUPPORT_CONFIG_PERSISTENT_BINARY capability.
Added QNN_DATATYPE_SFIXED_POINT_4 and QNN_DATATYPE_UFIXED_POINT_4 data types.
Added QnnGraph_createSubgraph API and the QNN_PROPERTY_GRAPH_SUPPORT_SUBGRAPH
capability.
Added QnnBackend_setConfig API.
Added QNN_PROFILE_CONFIG_OPTION_ENABLE_OPTRACE and QNN_PROFILE_EVENTTYPE_TRACE.
Added QNN_PROPERTY_BACKEND_SUPPORT_COMPOSITION and
QNN_PROPERTY_TENSOR_SUPPORT_CONTEXT_TENSORS capability.
Added QNN_DATATYPE_FLOAT_64 data type.
Clarified QnnSignal behavior when used with QnnGraph_executeAsync.
Deprecated QNN_TENSOR_ERROR_ALREADY_EXISTS and QNN_TENSOR_ERROR_NAME_HASH_COLLISION
error codes. QnnTensor_createContextTensor and QnnTensor_createGraphTensor will no
longer generate them.
Introduced QnnProfile_ExtendedEventData_t and QnnProfile_getExtendedEventData to
support binary large object data.
Added QnnProfile_setConfig and QNN_PROFILE_CONFIG_OPTION_CUSTOM and
QNN_PROFILE_CONFIG_OPTION_MAX_EVENTS configuration options.
Added the QNN_DATATYPE_STRING data type for scalars.
Added QNN_GRAPH_ERROR_GENERAL error code.
Added QNN_PROPERTY_GRAPH_SUPPORT_PER_API_PROFILING capability.
Added QNN_SIGNAL_ERROR_INCOMPATIBLE_SIGNAL_TYPE error code.
Clarified unconfigured QnnSignal behavior.
Added QNN_COMMON_ERROR_RESOURCE_UNAVAILABLE common error code.
Added QNN_GRAPH_ERROR_TIMED_OUT error code and corrected QnnGraph_execute and
QnnGraph_executeAsync API documentation to reference this error code.
Added QNN_COMMON_ERROR_LOADING_BINARIES common error code.
Added support for timeouts in QnnSignal
QNN_SIGNAL_CONFIG_OPTION_TIMEOUT
QNN_PROPERTY_SIGNAL_SUPPORT_TIMEOUT
Added QNN_CONTEXT_ERROR_MEM_ALLOC error code to QnnContext_getBinarySize and
QnnContext_getBinary
Added QNN_DEVICE_ERROR_INVALID_HANDLE error code to QnnDevice_getPlatformInfo and
QnnDevice_freePlatformInfo
Added QNN_DEVICE_ERROR_MEM_ALLOC error code to QnnDevice_getInfrastructure
Corrected occurrences of QNN_SIGNAL_ERROR_NOT_SUPPORTED to be
QNN_SIGNAL_ERROR_UNSUPPORTED
Added QNN_BACKEND_CONFIG_OPTION_PLATFORM backend config option.
Added QNN_PROPERTY_BACKEND_SUPPORT_PLATFORM_OPTIONS property.
Added QNN_BACKEND_CONFIG_OPTION_PLATFORM backend error code.
Indicated that QNN_PRIORITY_NORMAL_HIGH and QNN_PRIORITY_HIGH can be silently
treated as QNN_PRIORITY_NORMAL in some scenarios.
Cleaned up unused SOC models.
Added QNN_COMMON_ERROR_INCOMPATIBLE_BINARIES common error code.
Added QNN_PROPERTY_GRAPH_SUPPORT_EXECUTE capability.
Added QNN_PROPERTY_GRAPH_SUPPORT_BATCH_MULTIPLE capability.
Clarify that a Qnn_ProfileHandle_t can only be bound to one graph at a time.
Introduced continuous QnnGraph profiling via the
QNN_GRAPH_CONFIG_OPTION_PROFILE_HANDLE config option. Backend support is
communicated via QNN_PROPERTY_GRAPH_SUPPORT_CONTINUOUS_PROFILING.
Added the following QnnProfile event types:
QNN_PROFILE_EVENTTYPE_EXECUTE_QUEUE_WAIT
QNN_PROFILE_EVENTTYPE_EXECUTE_PREPROCESS
QNN_PROFILE_EVENTTYPE_EXECUTE_DEVICE
QNN_PROFILE_EVENTTYPE_EXECUTE_POSTPROCESS
Introduced a new Qnn_Priority_t level: QNN_PRIORITY_NORMAL_HIGH.
Deprecate Qnn_SocModel_t.
Add note to QnnProperty_hasCapability that it can be called at any time.
Introduction of the QnnSignal API.
Added QNN_SOC_MODEL_SM8325.
Added new capabilities for support of QnnSignal in QnnGraph APIs:
QNN_PROPERTY_GRAPH_SUPPORT_FINALIZE_SIGNAL
QNN_PROPERTY_GRAPH_SUPPORT_EXECUTE_SIGNAL
QNN_PROPERTY_GRAPH_SUPPORT_EXECUTE_ASYNC_SIGNAL
Moved QNN_API definition to QnnCommon.h from QnnTypes.h.
Updated QnnGraph_executeAsync() behavior to block until the execution is enqueued
rather than returning early if the queue is full.
Clarified behavior with concurrent calls to QnnGraph_execute() and
QnnGraph_executeAsync().
Introduced a queue depth context config to control the maximum depth of the async
execution queue.
Added QNN_SOC_MODEL_SXR2230P and QNN_SOC_MODEL_SM7475.
Added QNN_SOC_MODEL_SXR1230P, QNN_SOC_MODEL_SSG2115P, and QNN_SOC_MODEL_SM6450.
The following list itemizes updates as compared to QNN API 1.x.
See 1.x to 2.0 migration guide in SDK docs for details.
QnnInterface:
QnnInterface_getProviders function signature update.
QnnTypes:
Qnn_Tensor_t data structure update:
Add versioning (i.e. Qnn_TensorV1_t).
Add name field. ID field is now backend generated.
Consolidate max and current dimensions into one field.
INT4 support (see Qnn_BwScaleOffset_t and Qnn_BwAxisScaleOffset_t).
Qnn_OpConfig_t data structure update:
Add versioning (i.e. Qnn_OpConfigV1_t).
Added Qnn_SocModel_t.
QnnTensor:
Qnn_Tensor_t is now an output argument to QnnTensor_createContextTensor and
QnnTensor_createGraphTensor since the ID is now generated by the backend from
the name.Added QNN_TENSOR_ERROR_NAME_HASH_COLLISION error code.
QnnDevice introduction:
Adds multi-core support.
QnnBackend:
Introduce Qnn_BackendHandle_t.
These APIs now take a Qnn_BackendHandle_t as an argument:
QnnBackend_registerOpPackage
QnnBackend_validateOpConfig
QnnBackend_registerOpPackage
QnnBackend_initialize replaced by QnnBackend_create.
QnnBackend_terminate replaced by QnnBackend_free.
Added QnnBackend_getSupportedOperations and QnnBackend_OperationName_t.
Removed QnnBackend_getPerfInfrastructure (see QnnDevice_getInfrastructure).
Added and removed a variety of error codes.
QnnMem:
QnnMem_register now take a Qnn_ContextHandle_t as an argument.
Add backend specific memory registration extensions.
QnnContext:
Increased maximum context binary size to 64-bit.
Consolidate QnnContext_createFromBinary and
QnnContext_createFromBinaryWithConfig.QnnContext_create and QnnContext_createFromBinary function signature updates:
Qnn_BackendHandle_t association.
Qnn_DeviceHandle_t association.
QnnLog:
Introduce Qnn_LogHandle_t.
QnnLog_setLogLevel now takes a Qnn_LogHandle_t as an argument.
QnnLog_initialize replaced by QnnLog_create.
QnnLog_terminate replaced by QnnLog_free.
Qnn_LogHandle_t is associated to a Qnn_BackendHandle_t in QnnBackend_create.
Added and removed a variety of error codes.
QnnProperty:
Removed QnnProperty_get and QnnProperty_free.
Removed the following capability keys:
QNN_PROPERTY_BACKEND_SUPPORT_BUILD_ID
QNN_PROPERTY_BACKEND_SUPPORT_PERF_INFRASTRUCTURE
QNN_PROPERTY_BACKEND_SUPPORT_OP_VALIDATION
QNN_PROPERTY_CONTEXT_SUPPORT_GET_BINARY
QNN_PROPERTY_CONTEXT_SUPPORT_GET_BINARY_SIZE
QNN_PROPERTY_CONTEXT_SUPPORT_CREATE_BINARY
Added the following capability keys:
QNN_PROPERTY_CONTEXT_SUPPORT_CACHING
QNN_PROPERTY_GRAPH_SUPPORT_PRIORITY_CONTROL
QNN_PROPERTY_GROUP_DEVICE
QNN_PROPERTY_DEVICE_SUPPORT_INFRASTRUCTURE
QNN_PROPERTY_GRAPH_SUPPORT_PRIORITY_CONTROL
Added and removed a variety of error codes.
QnnGraph:
Add priority configuration.
Add QnnGraph_setConfig API.
Removed asynch execution configs.
QnnProfile:
QnnProfile_create associated with a Qnn_BackendHandle_t.
QnnOpPackage:
Introduce Qnn_OpPackageHandle_t.
Introduce 2.0 interface to the backend.
Removed the QNN_OP_PACKAGE_API_VERSION_* macros and replaced them with
QNN_OP_PACKAGE_API_VERSION_1_4_0 and QNN_OP_PACKAGE_API_VERSION_2_0_0.
QnnSystem:
QnnSystemInterface_getProviders function signature update.
QnnSystemContext_getBinaryInfo function signature update for const output.
Added QnnSystemContext_BinaryInfoV2_t to support QnnDevice.
QnnOpDef:
Added op set version.
Other:
Prune header inclusions.
Add APIs to retrieve records from DLCs: QnnSystemDlc_getRecordByName(),
QnnSystemDlc_getRecordsByType(), QnnSystemDlc_getRecordDataSize(),
QnnSystemDlc_readRecordDataMemoryMapped(), and QnnSystemDlc_freeRecord().
Add profile event type
QNN_SYSTEM_PROFILE_METHOD_TYPE_BACKEND_UPDATE_BINARY_SECTION to profile
application of binary sections to context binaries.
Add profile event type
QNN_SYSTEM_PROFILE_METHOD_TYPE_BACKEND_FINALIZE_TENSOR_UPDATES to profile
finalization of tensor updates.
Add profile event types QNN_SYSTEM_PROFILE_METHOD_TYPE_CONTEXT_GET_BINARY_SIZE,
QNN_SYSTEM_PROFILE_METHOD_TYPE_CONTEXT_GET_BINARY, and
QNN_SYSTEM_PROFILE_METHOD_TYPE_CONTEXT_GET_BINARY_SECTION_SIZE for application
profiling of context binary and binary section creation.
Introduce QnnSystemProfile component to enable backend agnostic manipulation of
QNN profiling events. Add QnnSystemProfile_createSerializationTarget,
QnnSystemProfile_serializeEventData and QnnSystemProfile_freeSerializationTarget,
to support serialization of QNN profile events to profile logs. Profile logs produced
from these APIs can be used with qnn-profile-event-viewer.
Improve error code naming across several components. All existing error codes retain
values.
Introduce QnnSystemLog component. Add QnnSystemLog_create, QnnSystemLog_setLogLevel,
and QnnSystemLog_free.
Introduce QnnSystemDlc component. Add QnnSystemDlc_createFromFile,
QnnSystemDlc_createFromBuffer, QnnSystemDlc_composeGraphs,
QnnSystemDlc_getOpMappings and QnnSystemDlc_free.
Introduce QnnSystemTensor component. Add QnnSystemTensor_getMemoryFootprint.
Added QnnSystemContext_GraphInfoV3_t and QnnSystemContext_BinaryInfoV3_t.
Added QnnSystemContext_getMetadata.
Deprecated QnnSystemContext_getBinaryInfo.
Initial release.