# CPU Backend Op Definition Supplement

## ArgbToRgb

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## Argmax

### Datatypes

| Configuration | in[0] | out[0] | axis | keep\_dims |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |  |

## Argmin

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |

## AxisAlignedBboxTransform

### Datatypes

| Configuration | in[0] | in[1] | out[0] | weights |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Support

| Configuration |  |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Param <em>weights</em> only supports default value</p></li><br></ul> |

## Batchnorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## BatchPermutation

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Supports input of Rank greater than 0</p></li><br></ul> | <ul class="simple"><br><li><p>Supports input of Rank equal 1</p></li><br><li><p>Supports input of unique value ranging between 0 and batch-1</p></li><br></ul> |

## BatchToSpace

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## BboxTransform

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] | out[1] |
| --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## BoxWithNmsLimit

### Datatypes

| Configuration | in[0] | in[1] | out[0] | out[1] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## Buffer

### Datatypes

| Configuration | in[0] | in[1] | out[0] | buffer\_size | buffer\_dim | stride | mode |
| --- | --- | --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |

## Cast

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_BOOL\_8, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_BOOL\_8, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_FLOAT\_16 |
| int8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_8, QNN\_DATATYPE\_BOOL\_8, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_8, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_FLOAT\_16 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| int8 | <ul class="simple"><br><li><p>QNN_DATATYPE_UINT_32 must be in the range of 0..INT32_MAX.</p></li><br><li><p>Dynamic Shape: Dynamic dims not supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Dynamic dims not supported.</p></li><br></ul> |

## ChannelShuffle

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## Col2Im

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## CollectRpnProposals

### Datatypes

| Configuration | in[0] | in[1] | in[2] | in[3] | in[4] | in[5] | in[6] | in[7] | in[8] | in[9] | out[0] |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## CombinedNms

### Datatypes

| Configuration | in[0] | in[1] | out[0] | out[1] | out[2] | out[3] | max\_boxes\_per\_class | max\_total\_boxes | iou\_threshold | score\_threshold | pad\_per\_class | clip\_boxes |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

## Concat

### Datatypes

| Configuration | in[0..m] | out[0] | in[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_BOOL\_8 |  |
| int8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0..m] | out[0] |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## ConstantOfShape

### Datatypes

| Configuration | in[0] | out[0] | value |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_64 |

## Conv1d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## Conv2d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## Conv3d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] | group |
| --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |
| int8 | <ul class="simple"><br><li><p>Shape: Input rank must be 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Output rank must be 5</p></li><br></ul> |

## Convert

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_FLOAT\_16, QNN\_DATATYPE\_SFIXED\_POINT\_8, QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_16, QNN\_DATATYPE\_UFIXED\_POINT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_FLOAT\_16, QNN\_DATATYPE\_SFIXED\_POINT\_8, QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_16, QNN\_DATATYPE\_UFIXED\_POINT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_BOOL\_8 |
| int8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_FLOAT\_16, QNN\_DATATYPE\_SFIXED\_POINT\_8, QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_16, QNN\_DATATYPE\_UFIXED\_POINT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_FLOAT\_16, QNN\_DATATYPE\_SFIXED\_POINT\_8, QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_16, QNN\_DATATYPE\_UFIXED\_POINT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_BOOL\_8 |

## Correlation1D

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## CreateSparse

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## CropAndResize

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## CumulativeSum

### Datatypes

| Configuration | in[0] | out[0] | axis | exclusive | reverse |
| --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |  |  |  |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

## DepthToSpace

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## DepthWiseConv1d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## DepthWiseConv2d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## Dequantize

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_SFIXED\_POINT\_8, QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_UFIXED\_POINT\_16, QNN\_DATATYPE\_SFIXED\_POINT\_16, QNN\_DATATYPE\_SFIXED\_POINT\_32, QNN\_DATATYPE\_UFIXED\_POINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>AXIS_SCALE_OFFSET do not support UF32 datatype.</p></li><br></ul> |

## DetectionOutput

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] | out[1] | out[2] | out[3] |
| --- | --- | --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |  |  |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |

## DistributeFpnProposals

### Datatypes

| Configuration | in[0] | out[0] | out[1] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ElementWiseAbs

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ElementWiseAdd

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |

## ElementWiseAnd

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseAsin

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## ElementWiseAtan

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseBinary

### Datatypes

| Configuration | operation |
| --- | --- |
| fp32 | QNN\_DATATYPE\_UINT\_32 |
| int8 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Input 1 data type validation is done based on type of operation</p></li><br></ul> | <ul class="simple"><br><li><p>Input 2 data type validation is done based on type of operation</p></li><br></ul> | <ul class="simple"><br><li><p>Output data type validation is done based on type of operation</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Input 1 data type validation is done based on type of operation</p></li><br></ul> | <ul class="simple"><br><li><p>Input 2 data type validation is done based on type of operation</p></li><br></ul> | <ul class="simple"><br><li><p>Output data type validation is done based on type of operation</p></li><br></ul> |

## ElementWiseCeil

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseCos

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## ElementWiseDivide

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |

## ElementWiseEqual

### Datatypes

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ElementWiseExp

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ElementWiseFloor

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ElementWiseFloorDiv

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## ElementWiseFmod

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## ElementWiseGreater

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ElementWiseGreaterEqual

### Datatypes

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ElementWiseLess

### Datatypes

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ElementWiseLessEqual

### Datatypes

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ElementWiseLog

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseMaximum

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseMinimum

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseMod

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_16 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_16 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_16 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ElementWiseMultiply

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |

## ElementWiseNeg

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseNeuron

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseNot

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseNotEqual

### Datatypes

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseOr

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

## ElementWisePower

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseRound

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseRsqrt

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ElementWiseSelect

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ElementWiseSign

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_64 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_64 |

## ElementWiseSin

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseSoftplus

### Datatypes

| Configuration | in[0] | out[0] | beta | threshold |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | beta |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Value: beta must be &gt; 0</p></li><br></ul> |

## ElementWiseSquaredDifference

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ElementWiseSquareRoot

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Dynamic Shape: Dynamic dims not supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Dynamic dims not supported.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Dynamic Shape: Dynamic dims not supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Dynamic dims not supported.</p></li><br></ul> |

## ElementWiseSubtract

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |

## ElementWiseUnary

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Input[0] data type validation is done based on the type of operation</p></li><br></ul> | <ul class="simple"><br><li><p>Output[0] data type validation is done based on the type of operation</p></li><br></ul> |

## ElementWiseXor

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

## Elu

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## ExpandDims

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ExtractGlimpse

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ExtractPatches

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## FullyConnected

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | out[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Datatype: Must have same data type as in[0]</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Datatype: out[0] must be same Datatype as in[0]</p></li><br></ul> |

## Gather

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_BOOL\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## GatherElements

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64 | QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Supports input of 6D</p></li><br></ul> |

## GatherNd

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64 | QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## Gelu

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## GenerateProposals

### Datatypes

| Configuration | in[0] | in[1] | in[2] | in[3] | out[0] | out[1] | bbox\_xform\_clip |
| --- | --- | --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |

### Support

| Configuration |  |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Param <em>bbox_xform_clip</em> only supports default value</p></li><br></ul> |

## GetSparseIndices

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 |

## GetSparseValues

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## GridSample

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## GroupNorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] | epsilon | group |
| --- | --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |

## Gru

### Datatypes

| Configuration | in[0] | in[1] | in[2] | in[3] | in[4] | in[5] | in[6] | in[7] | in[8] | in[9] | in[10] | in[11] | in[12] | in[13] | in[14] | out[0] | out[1] |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## HadamardTransform

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## HardSwish

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## HeatMapMaxKeyPoint

### Datatypes

| Configuration | in[0] | in[1] | out[0] | out[1] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |  | QNN\_DATATYPE\_UFIXED\_POINT\_8 |  |

## If

### Datatypes

| Configuration | in[0] |
| --- | --- |
| fp32 | QNN\_DATATYPE\_BOOL\_8 |

## Im2Col

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## ImageProjectionTransform

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## InstanceNorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | mode | region |
| --- | --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Only supports input of Rank = 4</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default mode QNN_OP_INSTANCE_NORM_MODE_MU_SIGMA</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default region QNN_OP_INSTANCE_NORM_REGION_ACROSS_SPATIAL</p></li><br></ul> |
| int8 |  | <ul class="simple"><br><li><p>Only support default mode QNN_OP_INSTANCE_NORM_MODE_MU_SIGMA</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default region QNN_OP_INSTANCE_NORM_REGION_ACROSS_SPATIAL</p></li><br></ul> |

### Support

| Configuration |  |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Param <em>mode</em> only supports default value</p></li><br><li><p>Param <em>region</em> only supports default value</p></li><br></ul> |

## IsInf

### Datatypes

| Configuration | in[0] | out[0] | detect\_negative | detect\_positive |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

## IsNan

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |

## L2Norm

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## L2Pool2d

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## LayerNorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## Logit

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## LogSoftmax

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | beta | axis |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Value: Only support beta = 1</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only support value of N-1</p></li><br></ul> |

## Lrn

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## Lstm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | in[3] | in[4] | in[5] | in[6] | in[7] | in[8] | in[9] | in[10] | in[11] | in[12] | in[13] | in[14] | in[15] | in[16] | in[17] | in[18] | in[19] | in[20] | in[21] | in[22] | in[23] | in[24] | out[0] | out[1] | out[2] | out[3] | out[4] | out[5] | out[6] | out[7] | hidden\_state\_offset |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | input\_gate\_qscale | forget\_gate\_qscale | cell\_gate\_qscale | output\_gate\_qscale | hidden\_state\_offset | hidden\_state\_qscale |
| --- | --- | --- | --- | --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Only support default value 0.0f</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default value 0.0f</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default value 0.0f</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default value 0.0f</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default value 0.0f</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default value 0.0f</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Only support default value 0.0f</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default value 0.0f</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default value 0.0f</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default value 0.0f</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default value 0.0f</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default value 0.0f</p></li><br></ul> |

### Support

| Configuration |  |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Param <em>input_gate_qscale</em> only supports default value</p></li><br><li><p>Param <em>forget_gate_qscale</em> only supports default value</p></li><br><li><p>Param <em>cell_gate_qscale</em> only supports default value</p></li><br><li><p>Param <em>output_gate_qscale</em> only supports default value</p></li><br><li><p>Param <em>hidden_state_offset</em> only supports default value</p></li><br><li><p>Param <em>hidden_state_qscale</em> only supports default value</p></li><br></ul> |

## MaskedSoftmax

### Datatypes

| Configuration | in[0] | in[1] | out[0] | mode |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

## MatMul

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## Moments

### Datatypes

| Configuration | in[0] | out[0] | out[1] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## MultiClassNms

### Datatypes

| Configuration | in[0] | in[1] | out[0] | out[1] | in[2] | out[2] | out[3] | out[4] |
| --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |  |  |  |  |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## NonMaxSuppression

### Datatypes

| Configuration | in[0] | in[1] | out[0] | out[1] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |

## NonZero

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32 |

## Nv12ToRgb

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## Nv21ToRgb

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## OneHot

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |

## Pack

### Datatypes

| Configuration | in[0..m] | out[0] | in[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_UINT\_8 |  |
| int8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 3.</p></li><br></ul> |

## Pad

### Datatypes

| Configuration | in[0] | out[0] | pad\_constant\_value |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 6.</p></li><br></ul> |

## PoolAvg2d

### Datatypes

| Configuration | in[0] | out[0] | rounding\_mode |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

### Support

| Configuration |  |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Param <em>rounding_mode</em> only supports default value</p></li><br></ul> |

## PoolAvg3d

### Datatypes

| Configuration | in[0] | out[0] | rounding\_mode |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Input rank must be 5.</p></li><br></ul> |

### Support

| Configuration |  |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Param <em>rounding_mode</em> only supports default value</p></li><br></ul> |

## PoolMax2d

### Datatypes

| Configuration | in[0] | out[0] | rounding\_mode |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

### Support

| Configuration |  |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Param <em>rounding_mode</em> only supports default value</p></li><br></ul> |

## PoolMax3d

### Datatypes

| Configuration | in[0] | out[0] | rounding\_mode |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

### Support

| Configuration |  |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Param <em>rounding_mode</em> only supports default value</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Param <em>rounding_mode</em> only supports default value</p></li><br></ul> |

## Prelu

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## Quantize

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8, QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_UFIXED\_POINT\_16, QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| int8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | out[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>BW_SCALE_OFFSET not supported.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>BW_SCALE_OFFSET not supported.</p></li><br></ul> |

## ReduceMax

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ReduceMean

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ReduceMin

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ReduceProd

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## ReduceSum

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ReduceSumSquare

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |

## Relu

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## Relu1

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## Relu6

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ReluMinMax

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## Reshape

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_BOOL\_8, QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_BOOL\_8, QNN\_DATATYPE\_UINT\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_UINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |

## Resize

### Datatypes

| Configuration | in[0] | out[0] | exclude\_outside | cubic\_coeff |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | exclude\_outside |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: exclude_outside must be equal to false</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: exclude_outside must be equal to false</p></li><br></ul> |

## ResizeBilinear

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## ResizeNearestNeighbor

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## RmsNorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 8.</p></li><br></ul> |

## RoiAlign

### Datatypes

| Configuration | in[0] | in[1] | out[0] | aligned | allow\_invalid\_roi |
| --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Support

| Configuration |  |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Param <em>aligned</em> only supports default value</p></li><br><li><p>Param <em>allow_invalid_roi</em> only supports default value</p></li><br></ul> |

## RoiPooling

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## RotaryEmbedding

### Datatypes

| Configuration | in[0] | in[1] | in[2] | in[3] | out[0] |
| --- | --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## ScatterElements

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |

## ScatterNd

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_BOOL\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## Shape

### Datatypes

| Configuration | in[0] | out[0] | start | end |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_64 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |

## Sigmoid

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## Softmax

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] | axis |
| --- | --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>if Rank == 5 only default N-1 supported</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>if Rank == 5 only default N-1 supported</p></li><br></ul> |

## SpaceToBatch

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## SpaceToDepth

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | block\_size | mode |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Value: block_size[0] and block_size[1] should be equal.</p></li><br></ul> | <ul class="simple"><br><li><p>Only support modes QNN_OP_SPACE_TO_DEPTH_MODE_DCR and QNN_OP_SPACE_TO_DEPTH_MODE_CRD</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Value: block_size[0] and block_size[1] should be equal.</p></li><br></ul> | <ul class="simple"><br><li><p>Only support modes QNN_OP_SPACE_TO_DEPTH_MODE_DCR and QNN_OP_SPACE_TO_DEPTH_MODE_CRD</p></li><br></ul> |

### Support

| Configuration |  |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Param <em>mode</em> only supports default value</p></li><br></ul> |

## SparseToDense

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## Split

### Datatypes

| Configuration | in[0] | out[0..m] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_BOOL\_8 |  |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_16, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## Squeeze

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_UINT\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## Stft

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## StridedSlice

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_INT\_64, QNN\_DATATYPE\_UINT\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_BOOL\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |

## Tanh

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## Tile

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_BOOL\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## TopK

### Datatypes

| Configuration | in[0] | out[0] | largest |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Support

| Configuration |  |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Param <em>largest</em> only supports default value</p></li><br></ul> |

## Transpose

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_BOOL\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_FLOAT\_32, QNN\_DATATYPE\_INT\_32, QNN\_DATATYPE\_UINT\_32, QNN\_DATATYPE\_BOOL\_8, QNN\_DATATYPE\_INT\_8, QNN\_DATATYPE\_UINT\_8 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> |  |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## TransposeConv1d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## TransposeConv2d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_32, QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## TransposeConv3d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| fp32 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| int8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |

## UnPack

### Datatypes

| Configuration | in[0] | out[0..m] | out[0] |
| --- | --- | --- | --- |
| fp32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |  |
| int8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

Last Published: Jun 04, 2026

[Previous Topic
Block Op Definitions](https://docs.qualcomm.com/bundle/publicresource/80-63442-10/topics/blockop_definitions.md) [Next Topic
DSP](https://docs.qualcomm.com/bundle/publicresource/80-63442-10/topics/DspOpDefSupplement.md)