# HTP Backend Op Definition Supplement

## Argmax

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## Argmin

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## Batchnorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 |  | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## BatchToSpace

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Buffer

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | mode |
| --- | --- | --- |
| All |  | <ul class="simple"><br><li><p>Value: Only supported mode is 1 and 2.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |

## Cast

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| BF16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_INT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_FLOAT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_64 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_64 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_64 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_64 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_8 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_16 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>QNN_DATATYPE_UINT_32 must be in the range of 0..INT32_MAX.</p></li><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>QNN_DATATYPE_UINT_32 must be in the range of 0..INT32_MAX.</p></li><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>QNN_DATATYPE_UINT_32 must be in the range of 0..INT32_MAX.</p></li><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |

## ChannelShuffle

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Concat

### Datatypes

| Configuration | in[0..m] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0..m] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## Conv2d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | stride | dilation | group |
| --- | --- | --- | --- | --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Updateable tensor is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable tensor is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable tensor is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable tensor is supported.</p></li><br></ul> |  |  |  |
| FP16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_8 data is supported if the quantization encoding is QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET, QNN_QUANTIZATION_ENCODING_BLOCK, or QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK. For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK (FP16-activation Block Quantization), a minimum arch V69 is required; the weight bitwidth must be 2, 4, or 8; blockSize must have the form [1, 1, block_size, 1] so that only the input-channel axis has blocks, and blockSize must be a multiple of 16 for 2-bit, 8 for 4-bit, or 4 for 8-bit. The weight tensor must be static and the height and width of the weight tensor is [1,1] when QNN_DATATYPE_SFIXED_POINT_8 data is supported.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| FP16 |  |  |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs.</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION is supported with expansion on channel axis only and the block-quant weights are expected to be signed and symmetrically quantized. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION requires minimum arch v69.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0] when minimum arch V73 and filter height &lt;= 8 and filter width &lt;= 8.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized. For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 2bit weights require minimum arch v73. 4bit weights require minimum arch v68.</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_VECTOR is supported with expansion on channel axis only and the vector-quant weights are expected to be signed and symmetrically quantized. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_VECTOR requires minimum arch v69. Vector dimension should be 2, vector stride should be 2 and the index bitwidth should be 6. Additionally, the filter dimensions should be divisible by the VQ block-size and the block size should be multiples of 32.</p></li><br><li><p>Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET_MAPPED. PCQ requires axis=3. QNN_QUANTIZATION_ENCODING_MAPPING_LINEAR_SYMMETRIC_EXCLUDE_ZERO mapping only supports 2-bit weights. 2-bit weights require minimum arch v73.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 16bit Weight must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT16 |  |  |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT16 |  |  |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT16 |  |  |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT16 |  |  |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs.</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION is supported with expansion on channel axis only and the block-quant weights are expected to be signed and symmetrically quantized. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION requires minimum arch v69.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0] when minimum arch V73 and filter height &lt;= 8 and filter width &lt;= 8 and dilation in height and width = [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT8 |  |  |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT8 |  |  |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT8 |  |  |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT8 |  |  |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT8 |  |  |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |
| INT8 |  |  |  |  | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, stride must be [1,1] or [2,2].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, dilation must be [1,1].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK weights, group must be 1.</p></li><br></ul> |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Bitwidth: 2</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Bitwidth: 4</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET_MAPPED</p></li><br><li><p>Bitwidth: 2</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Bitwidth: 2</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Bitwidth: 4</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET_MAPPED</p></li><br><li><p>Bitwidth: 2</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Conv3d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | dilation |
| --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Input rank must be 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Weight rank must be 5.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Shape: Output rank must be 5</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports dilation if stride in height and width = 1</p></li><br><li><p>Value: Only supports dilation of 1 in the depth dimension</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0] when minimum arch V73 and filter height &lt;= 8 and filter width &lt;= 8 and dilation in depth, height, and width = [1,1,1]</p></li><br></ul> |  |
| INT16 |  |  |  | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0] when minimum arch V73 and filter height &lt;= 8 and filter width &lt;= 8 and dilation in depth, height, and width = [1,1,1].</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0] when minimum arch V73 and filter height &lt;= 8 and filter width &lt;= 8 and dilation in height and width = [1,1].</p></li><br></ul> |  |
| INT8 |  |  |  | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0] when minimum arch V73 and filter height &lt;= 8 and filter width &lt;= 8 and dilation in depth, height, and width = [1,1,1].</p></li><br></ul> |  |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Convert

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## CreateSparse

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | out[0] |
| --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported sparse output rank is 5.</p></li><br></ul> |

## CumulativeSum

### Datatypes

| Configuration | in[0] | out[0] | axis | exclusive | reverse |
| --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |  |  |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |  |  |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | out[0] | axis |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Value: Must be in range [0, N - 1] where N is the rank of the input tensor</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  |

## DepthToSpace

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

## DepthWiseConv2d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | dilation |
| --- | --- | --- | --- | --- | --- |
| BF16 |  |  |  |  | <ul class="simple"><br><li><p>Value: Only supports dilation if stride = [1,1]</p></li><br></ul> |
| FP16 |  |  |  |  | <ul class="simple"><br><li><p>Value: Only supports dilation if stride = [1,1]</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 16bit Weight must have 16bit Activation and must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized. For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports dilation if stride = [1,1] or dilation of [2,2] when stride is [2,2] and kernel size is [3,3]</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized. For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports dilation if stride = [1,1] or dilation of [2,2] when stride is [2,2] and kernel size is [3,3]</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 16bit Weight must have 16bit Activation and must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  |  |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Dequantize

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_16 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## DetectionOutput

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] | out[1] | out[2] | out[3] |
| --- | --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |

## ElementWiseAbs

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## ElementWiseAdd

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseAnd

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 4.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 4.</p></li><br></ul> |

## ElementWiseAsin

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseAtan

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseBinary

### Datatypes

| Configuration | in[0] | in[1] | out[0] | operation |
| --- | --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] | operation |
| --- | --- | --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Supported input rank: All: Between 1 and 4. Multiply, Divide, Add, Power, Subtract: Between 1 and 5.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_BFLOAT_16. AND: Not supported. DIVIDE: QNN_DATATYPE_BFLOAT_16. EQUAL: QNN_DATATYPE_BFLOAT_16. FLOORDIV: Not supported. FMOD: Not supported. GREATER: Not supported. GREATEREQUAL: Not supported. LESS: Not supported. LESSEQUAL: Not supported. MAXIMUM: Not supported. MINIMUM: Not supported. MOD: Not supported. MULTIPLY: QNN_DATATYPE_BFLOAT_16. NOTEQUAL: Not supported. OR: Not supported. POWER: Not supported. SQUAREDDIFFERENCE: Not supported. SUBTRACT: QNN_DATATYPE_BFLOAT_16. XOR: Not supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supported input rank: All: Between 1 and 4. Multiply, Divide, Add, Power, Subtract: Between 1 and 5.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_BFLOAT_16. AND: Not supported. DIVIDE: QNN_DATATYPE_BFLOAT_16. EQUAL: QNN_DATATYPE_BFLOAT_16. FLOORDIV: Not supported. FMOD: Not supported. GREATER: Not supported. GREATEREQUAL: Not supported. LESS: Not supported. LESSEQUAL: Not supported. MAXIMUM: Not supported. MINIMUM: Not supported. MOD: Not supported. MULTIPLY: QNN_DATATYPE_BFLOAT_16. NOTEQUAL: Not supported. OR: Not supported. POWER: Not supported. SQUAREDDIFFERENCE: Not supported. SUBTRACT: QNN_DATATYPE_BFLOAT_16. XOR: Not supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supported output rank: All: Between 1 and 4. Multiply, Divide, Add, Power, Subtract: Between 1 and 5.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_BFLOAT_16. AND: Not supported. DIVIDE: QNN_DATATYPE_BFLOAT_16. EQUAL: QNN_DATATYPE_BFLOAT_16. FLOORDIV: Not supported. FMOD: Not supported. GREATER: Not supported. GREATEREQUAL: Not supported. LESS: Not supported. LESSEQUAL: Not supported. MAXIMUM: Not supported. MINIMUM: Not supported. MOD: Not supported. MULTIPLY: QNN_DATATYPE_BFLOAT_16. NOTEQUAL: Not supported. OR: Not supported. POWER: Not supported. SQUAREDDIFFERENCE: Not supported. SUBTRACT: QNN_DATATYPE_BFLOAT_16. XOR: Not supported.</p></li><br></ul> |  |
| FP16 | <ul class="simple"><br><li><p>Shape: Supported input rank: All: Between 1 and 4. Multiply, Divide, Equal, NotEqual, Less, LessEqual, Greater, GreaterEqual: Between 1 and 5.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. AND: Not supported. DIVIDE: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FLOORDIV: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FMOD: Not supported. GREATER: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. GREATEREQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LESS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LESSEQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MAXIMUM: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MINIMUM: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MOD: Not supported. MULTIPLY: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOTEQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. OR: Not supported. POWER: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQUAREDDIFFERENCE: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SUBTRACT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. XOR: Not supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supported input rank: All: Between 1 and 4. Multiply, Divide, Equal, NotEqual, Less, LessEqual, Greater, GreaterEqual: Between 1 and 5.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. AND: Not supported. DIVIDE: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FLOORDIV: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FMOD: Not supported. GREATER: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. GREATEREQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LESS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LESSEQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MAXIMUM: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MINIMUM: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MOD: Not supported. MULTIPLY: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOTEQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. OR: Not supported. POWER: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQUAREDDIFFERENCE: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SUBTRACT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. XOR: Not supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supported output rank: All: Between 1 and 4. Multiply, Divide, Equal, NotEqual, Less, LessEqual, Greater, GreaterEqual: Between 1 and 5.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. AND: Not supported. DIVIDE: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EQUAL: QNN_DATATYPE_BOOL_8. FLOORDIV: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FMOD: Not supported. GREATER: QNN_DATATYPE_BOOL_8. GREATEREQUAL: QNN_DATATYPE_BOOL_8. LESS: QNN_DATATYPE_BOOL_8. LESSEQUAL: QNN_DATATYPE_BOOL_8. MAXIMUM: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MINIMUM: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MOD: Not supported. MULTIPLY: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOTEQUAL: QNN_DATATYPE_BOOL_8. OR: Not supported. POWER: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQUAREDDIFFERENCE: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SUBTRACT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. XOR: Not supported.</p></li><br></ul> |  |
| FP16 | <ul class="simple"><br><li><p>Shape: Supported input rank: All: Between 1 and 4. Multiply, Divide, Add, Power, Subtract: Between 1 and 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supported input rank: All: Between 1 and 4. Multiply, Divide, Add, Power, Subtract: Between 1 and 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supported output rank: All: Between 1 and 4. Multiply, Divide, Add, Power, Subtract: Between 1 and 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support input rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support input rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_INT_32, QNN_DATATYPE_FLOAT_32, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support output rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0] and in[0] type == in[1] type == out[0] type != true.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED supported oper types: ADD</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions of ADD, DIVIDE, MULTIPLY, POWER, and SUBTRACT.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions of ADD, DIVIDE, MULTIPLY, POWER, and SUBTRACT.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions of ADD, DIVIDE, MULTIPLY, POWER, and SUBTRACT.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0] and in[0] type == in[1] type == out[0] type.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support input rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support input rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_INT_32, QNN_DATATYPE_FLOAT_32, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support output rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0] and in[0] type == in[1] type == out[0] type.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0] and in[0] type == in[1] type == out[0] type != true.</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support input rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MOD: QNN_DATATYPE_INT_32 MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support input rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MOD: QNN_DATATYPE_INT_32 MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_INT_32, QNN_DATATYPE_FLOAT_32, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support output rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MOD: QNN_DATATYPE_INT_32 MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br></ul> |  |
| OTHERS |  |  | <ul class="simple"><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MOD: QNN_DATATYPE_INT_32. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MOD: QNN_DATATYPE_INT_32. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br></ul> | <ul class="simple"><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MOD: QNN_DATATYPE_INT_32. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_INT_32, QNN_DATATYPE_FLOAT_32, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br></ul> |  |  |

## ElementWiseCeil

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseCos

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseDivide

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseEqual

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseExp

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## ElementWiseFloor

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseFloorDiv

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 4.</p></li><br></ul> |
| FP16 |  | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> |  |
| INT16 |  | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> |  |
| INT8 |  | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> |  |

## ElementWiseGreater

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseGreaterEqual

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseLess

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseLessEqual

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseLog

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseMaximum

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseMinimum

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseMod

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseMultiply

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All |  |  | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| BF16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |  |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |  |

## ElementWiseMux

### Datatypes

| Configuration | in[0] | in[1..m] | out[0] |
| --- | --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 |

### Quantization

| Configuration | in[1..m] | out[0] |
| --- | --- | --- |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Bitwidth: 4</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Bitwidth: 4</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Bitwidth: 4</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Bitwidth: 4</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## ElementWiseNeg

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseNeuron

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. (Except Relu and Sigmoid support rank 5)</p></li><br><li><p>Supported datatypes: ELU: Not supported. GELU: QNN_DATATYPE_BFLOAT_16. HARDSIGMOID: Not supported. HARDSWISH: Not supported. RELU: QNN_DATATYPE_BFLOAT_16. RELUMINMAX: QNN_DATATYPE_BFLOAT_16. SIGMOID: QNN_DATATYPE_BFLOAT_16. SOFTPLUS: Not supported. TANH: Not supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4 (Except Relu and Sigmoid support rank 5).</p></li><br><li><p>Supported datatypes: ELU: Not supported. GELU: QNN_DATATYPE_BFLOAT_16. HARDSIGMOID: Not supported. HARDSWISH: Not supported. RELU: QNN_DATATYPE_BFLOAT_16. RELUMINMAX: QNN_DATATYPE_BFLOAT_16. SIGMOID: QNN_DATATYPE_BFLOAT_16. SOFTPLUS: Not supported. TANH: Not supported.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. (Except Gelu, Relu, ReluMinMax, and Sigmoid support rank 5)</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. GELU: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. HARDSIGMOID: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. HARDSWISH: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RELU: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RELUMINMAX: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIGMOID: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SOFTPLUS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. TANH: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4 (Except Gelu, Relu, ReluMinMax, and Sigmoid support rank 5).</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. GELU: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. HARDSIGMOID: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. HARDSWISH: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RELU: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RELUMINMAX: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIGMOID: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SOFTPLUS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. TANH: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. Except for HARDSIGMOID, RELU, RELUMINMAX, SIGMOID which support max input rank of 5.</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. GELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. HARDSIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSWISH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. RELUMINMAX: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. SIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SOFTPLUS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. TANH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension of SIGMOID.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: Relu, ReluMinMax, HardSwish Relu, ReluMinMax, HardSwish: QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0]. For Relu and ReluMinMax QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF must be false.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. Except for HARDSIGMOID, RELU, RELUMINMAX, SIGMOID which support max input rank of 5.</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. GELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. HARDSIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSWISH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. RELUMINMAX: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. SIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SOFTPLUS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. TANH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension of SIGMOID.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: Relu, ReluMinMax, HardSwish Relu, ReluMinMax, HardSwish: QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. Except for HARDSIGMOID, RELU, RELUMINMAX, SIGMOID which support max input rank of 5.</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. GELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSWISH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. RELUMINMAX: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. SIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SOFTPLUS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. TANH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: Relu, ReluMinMax, HardSwish Relu, ReluMinMax, HardSwish: QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0]. For Relu and ReluMinMax QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF must be false.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. Except for HARDSIGMOID, RELU, RELUMINMAX, SIGMOID which support max input rank of 5.</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. GELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSWISH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. RELUMINMAX: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. SIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SOFTPLUS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. TANH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: Relu, ReluMinMax, HardSwish Relu, ReluMinMax, HardSwish: QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br><li><p>Min and max obtained from scale and offset of the output must be in range of given min and max of ReluMinMax</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. Except for RELU, RELUMINMAX, SIGMOID which support max input rank of 5.</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. GELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSWISH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELUMINMAX: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. SIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SOFTPLUS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. TANH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. Except for RELU, RELUMINMAX, SIGMOID which support max input rank of 5.</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. GELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSWISH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELUMINMAX: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. SIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SOFTPLUS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. TANH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br></ul> |

## ElementWiseNot

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseNotEqual

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseOr

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWisePower

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseRound

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseRsqrt

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports max input of Rank 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports max output of Rank 4.</p></li><br></ul> |

## ElementWiseSelect

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## ElementWiseSign

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseSin

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseSquaredDifference

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseSquareRoot

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseSubtract

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseUnary

### Datatypes

| Configuration | in[0] | out[0] | operation |
| --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Ops that support input rank 4: Atan, Ceil, Cos, Exp, Floor, Log, Neg, Not, Round, Sign, Sin. Ops that support input rank 5: Abs, Rsqrt, Sqrt.</p></li><br><li><p>Supported datatypes: ABS: Not supported. ASIN: Not supported. ATAN: Not supported. CEIL: Not supported. COS: Not supported. EXP: QNN_DATATYPE_BFLOAT_16. FLOOR: Not supported. LOG: Not supported. NEG: Not supported. NOT: Not supported. RECIPROCAL: Not supported. ROUND: Not supported. RSQRT: QNN_DATATYPE_BFLOAT_16. SIGN: Not supported. SIN: Not supported. SQRT: QNN_DATATYPE_BFLOAT_16.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Ops that support output rank 4: Atan, Ceil, Cos, Exp, Floor, Log, Neg, Not, Round, Sign, Sin. Ops that support output rank 5: Abs, Rsqrt, Sqrt.</p></li><br><li><p>Supported datatypes: ABS: Not supported. ASIN: Not supported. ATAN: Not supported. CEIL: Not supported. COS: Not supported. EXP: Not supported. FLOOR: Not supported. LOG: Not supported. NEG: Not supported. NOT: Not supported. RECIPROCAL: Not supported. ROUND: Not supported. RSQRT: QNN_DATATYPE_BFLOAT_16. SIGN: Not supported. SIN: Not supported. SQRT: QNN_DATATYPE_BFLOAT_16.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Ops that support input rank 4: Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin. Ops that support input rank 5: Abs, Exp, Rsqrt, Sqrt.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. ASIN: Not supported. ATAN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. CEIL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. COS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EXP: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FLOOR: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LOG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NEG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOT: QNN_DATATYPE_BOOL_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RSQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIGN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Ops that support output rank 4: Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin. Ops that support output rank 5: Abs, Exp, Rsqrt, Sqrt.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. ASIN: Not supported. ATAN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. CEIL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. COS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EXP: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FLOOR: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LOG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NEG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOT: QNN_DATATYPE_BOOL_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RSQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIGN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Ops that support input rank 4: Asin, Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin, Sqrt. Ops that support input rank 5: Abs, Exp, Rsqrt.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. ASIN: QNN_DATATYPE_UFIXED_POINT_8. ATAN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. CEIL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. COS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. EXP: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. FLOOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. LOG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NEG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NOT: QNN_DATATYPE_UFIXED_POINT_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RSQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SIGN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SIN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension of SQRT.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Ops that support output rank 4: Asin, Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin, Sqrt. Ops that support output rank 5: Abs, Exp, Rsqrt.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. ASIN: QNN_DATATYPE_UFIXED_POINT_8. ATAN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. CEIL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. COS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. EXP: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. FLOOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. LOG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NEG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NOT: QNN_DATATYPE_UFIXED_POINT_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RSQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SIGN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SIN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension of SQRT.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Ops that support input rank 4: Asin, Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin, Sqrt. Ops that support input rank 5: Abs, Exp, Rsqrt(except QNN_DATATYPE_SFIXED_POINT_16).</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Ops that support output rank 4: Asin, Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin, Sqrt. Ops that support output rank 5: Abs, Exp, Rsqrt(except QNN_DATATYPE_SFIXED_POINT_16).</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Ops that support input rank 4: Asin, Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin, Sqrt. Ops that support input rank 5: Abs, Exp, Rsqrt.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. ASIN: QNN_DATATYPE_UFIXED_POINT_8. ATAN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. CEIL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. COS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. EXP: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. FLOOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. LOG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NEG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NOT: QNN_DATATYPE_UFIXED_POINT_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RSQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SIGN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SIN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Ops that support output rank 4: Asin, Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin, Sqrt. Ops that support output rank 5: Abs, Exp, Rsqrt.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. ASIN: QNN_DATATYPE_UFIXED_POINT_8. ATAN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. CEIL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. COS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. EXP: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. FLOOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. LOG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NEG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NOT: QNN_DATATYPE_UFIXED_POINT_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RSQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SIGN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SIN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Ops that support input rank 4: Atan, Ceil, Cos, Exp, Floor, Log, Neg, Not, Round, Rsqrt, Sign, Sin, Sqrt. Ops that support input rank 5: Abs.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32, QNN_DATATYPE_INT_32. ASIN: Not supported. ATAN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. CEIL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. COS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EXP: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FLOOR: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LOG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NEG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOT: QNN_DATATYPE_BOOL_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RSQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIGN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Ops that support output rank 4: Atan, Ceil, Cos, Exp, Floor, Log, Neg, Not, Round, Rsqrt, Sign, Sin, Sqrt. Ops that support output rank 5: Abs.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32, QNN_DATATYPE_INT_32. ASIN: Not supported. ATAN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. CEIL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. COS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EXP: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FLOOR: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LOG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NEG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOT: QNN_DATATYPE_BOOL_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RSQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIGN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32.</p></li><br></ul> |

## ElementWiseXor

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## Elu

### Datatypes

| Configuration | in[0] | out[0] | alpha |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ExpandDims

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br></ul> |

## ExtractGlimpse

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ExtractPatches

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Input rank must be 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Onput rank must be 4.</p></li><br></ul> |

## FullyConnected

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | keep\_dims |
| --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default value 0</p></li><br></ul> |
| FP16 |  | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_8 data is supported if quantization encoding is QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET, QNN_QUANTIZATION_ENCODING_BLOCK or QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK. For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK (FP16-activation Block Quantization), a minimum arch V69 is required; the weight bitwidth (bwFloatBlockEncoding.bitwidth) must be 2, 4, or 8; the weight tensor is 2D [m, n] where n is the input-channel axis, and bwFloatBlockEncoding.blockSize must have the form [1, block_size] so that only the input-channel axis has blocks. block_size must be a multiple of 16 for 2-bit, 8 for 4-bit, or 4 for 8-bit. The weight tensor must be static in this case.</p></li><br></ul> |  |  |  |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>UFIXED_POINT_8 weights must be 8bit, 4bit or 2bit and must have rank 2. Given a 2D weight of dimensions [m n], QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only axis ‘m’ and the values are expected to be signed and symmetrically quantized. The Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the Tensor must be static, or the chain of ops preceding the Tensor must all have static inputs.</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION is supported with expansion on channel axis only and the block-quant weights are expected to be signed and symmetrically quantized. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION requires minimum arch v69.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> |  |
| INT16 |  | <ul class="simple"><br><li><p>UFIXED_POINT_8 weights must be 8bit, 4bit or 2bit and must have rank 2. Given a 2D weight of dimensions [m n], QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only axis ‘m’ and the values are expected to be signed and symmetrically quantized. The Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the Tensor must be static, or the chain of ops preceding the Tensor must all have static inputs. 16bit Weight must have 16bit Activation and must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  |  |
| INT8 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>UFIXED_POINT_8 weights must be 8bit or 4bit and must have rank 2. Given a 2D weight of dimensions [m n], QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only axis ‘m’ and the values are expected to be signed and symmetrically quantized. The Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the Tensor must be static, or the chain of ops preceding the Tensor must all have static inputs.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION is supported with expansion on channel axis only and the block-quant weights are expected to be signed and symmetrically quantized. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION requires minimum arch v69.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> |  |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Gather

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BFLOAT\_16 |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported index rank is 5.</p></li><br><li><p>Value: Only supports index values in range [0, in[0].dim[axis] - 1].</p></li><br></ul> |  |
| BF16 |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 |  | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT16 |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the channel dimension.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 |  |  | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| OTHERS |  |  | <ul class="simple"><br><li><p>Input quantization must be equal to output quantization.</p></li><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_INT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_INT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## GatherElements

### Datatypes

| Configuration | in[0] | in[1] | out[0] | axis |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] | axis |
| --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported index rank is 5.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Shape: Gather on axis 0 is not supported when rank is 5.</p></li><br></ul> |
| FP16 |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |
| INT16 |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |
| INT8 |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |
| OTHERS |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## GatherNd

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported index rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Gelu

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## GetSparseIndices

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported sparse input rank is 5.</p></li><br></ul> |

## GetSparseValues

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported sparse input rank is 5.</p></li><br></ul> |

## GridSample

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## GroupNorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## Gru

### Datatypes

| Configuration | in[0] | in[1] | in[2] | in[3] | in[4] | in[5] | in[6] | in[7] | in[8] | in[9] | in[10] | in[11] | in[12] | in[13] | in[14] | out[0] | out[1] |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | direction |
| --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Input rank must be 3.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Shape: Input rank must be 3.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only forward direction is supported.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Input rank must be 3.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only forward direction is supported.</p></li><br></ul> |

## HadamardTransform

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## HardSwish

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |

## InstanceNorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | mode | region |
| --- | --- | --- | --- | --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: InstanceNorms of input Rank = 4 are supported. If input Rank &lt; 4 then support is only possible if the outermost dimension is of size 1.</p></li><br></ul> |  |  |  |  |  |
| FP16 | <ul class="simple"><br><li><p>Shape: InstanceNorms of input Rank = 4 are supported. If input Rank &lt; 4 then support is only possible if the outermost dimension is of size 1.</p></li><br></ul> |  |  |  |  |  |
| INT16 | <ul class="simple"><br><li><p>Shape: InstanceNorms of input Rank = 4 are supported. If input Rank &lt; 4 then support is only possible if the outermost dimension is of size 1.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports mode MU_SIGMA</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports region ACROSS_SPATIAL</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |  |
| INT8 | <ul class="simple"><br><li><p>Shape: InstanceNorms of input Rank = 4 are supported. If input Rank &lt; 4 then support is only possible if the outermost dimension is of size 1.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports mode MU_SIGMA</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports region ACROSS_SPATIAL</p></li><br></ul> |

## IsInf

### Datatypes

| Configuration | in[0] | out[0] | detect\_negative | detect\_positive |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

## IsNan

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |

## L2Norm

### Datatypes

| Configuration | in[0] | out[0] | axis | axes | epsilon |
| --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## LayerNorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | axes |
| --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports normalization on final dimension or last three dimensions of 4D inputs</p></li><br></ul> |
| BF16 |  | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  |
| FP16 |  | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  |
| INT16 |  | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT16 |  | <ul class="simple"><br><li><p>16bit Input and 16bit Gamma require minimum arch V73.</p></li><br></ul> |  |  |  |
| INT8 |  | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 |  | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Logit

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported epsilon rank is 1.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## LogSoftmax

### Datatypes

| Configuration | in[0] | out[0] | beta |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] | axis |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>only default N-1 supported</p></li><br></ul> |

## Lrn

### Datatypes

| Configuration | in[0] | out[0] | alpha | beta | bias | radius | region |
| --- | --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 |  |

### Constraints

| Configuration | in[0] | out[0] | region |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |  |
| FP16 |  |  | <ul class="simple"><br><li><p>Value: Only supports Input dimensions where Height x Width is less than 1024 for Within channel cases</p></li><br></ul> |

## Lstm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | in[3] | in[4] | in[5] | in[6] | in[7] | in[8] | in[9] | in[10] | in[11] | in[12] | in[13] | in[14] | in[15] | in[16] | in[17] | in[18] | in[19] | in[20] | in[21] | in[22] | in[23] | in[24] | out[0] | out[1] | out[2] | hidden\_state\_offset |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |  |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |  |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[12] | in[13] | in[14] | in[15] | in[24] |
| --- | --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 3.</p></li><br></ul> |  |  |  |  |  |
| FP16 |  | <ul class="simple"><br><li><p>LayerNorm not currently supported</p></li><br></ul> | <ul class="simple"><br><li><p>LayerNorm not currently supported</p></li><br></ul> | <ul class="simple"><br><li><p>LayerNorm not currently supported</p></li><br></ul> | <ul class="simple"><br><li><p>LayerNorm not currently supported</p></li><br></ul> |  |
| INT16 |  | <ul class="simple"><br><li><p>LayerNorm not currently supported for 3D input</p></li><br></ul> | <ul class="simple"><br><li><p>LayerNorm not currently supported for 3D input</p></li><br></ul> | <ul class="simple"><br><li><p>LayerNorm not currently supported for 3D input</p></li><br></ul> | <ul class="simple"><br><li><p>LayerNorm not currently supported for 3D input</p></li><br></ul> | <ul class="simple"><br><li><p>When input 24 is provided, input 10 quantization parameters must match with output 0 and output 2, and input 11 quantization parameters must match with output 1</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>LayerNorm not currently supported for 3D input</p></li><br></ul> | <ul class="simple"><br><li><p>LayerNorm not currently supported for 3D input</p></li><br></ul> | <ul class="simple"><br><li><p>LayerNorm not currently supported for 3D input</p></li><br></ul> | <ul class="simple"><br><li><p>LayerNorm not currently supported for 3D input</p></li><br></ul> |  |

## MatMul

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 |  | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_8 data is supported if quantization encoding is QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET, QNN_QUANTIZATION_ENCODING_BLOCK or QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK. For QNN_QUANTIZATION_ENCODING_BW_FLOAT_BLOCK (FP16-activation Block Quantization), a minimum arch V69 is requrired; the weight bitwidth (bwFloatBlockEncoding.bitwidth) must be 2, 4, or 8; the weight tensor B is rank 4 [1, 1, M, N] or [1, 1, N, M] when QNN_OP_MAT_MUL_PARAM_TRANSPOSE_IN1 is True where M is the reduction (input-channel) axis, and bwFloatBlockEncoding.blockSize must have the form [1, 1, block_size, 1] or [1, 1, 1, block_size] so that only the M axis has blocks. block_size must be a multiple of 16 for 2-bit, 8 for 4-bit, or 4 for 8-bit. The weight tensor must be static and the height and width of the weight tensor must be [1,1].</p></li><br></ul> |  |  |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Given a tensor of shape […, m, n], QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only axis ‘m’ or ‘n’. The quantization axis is determined by paramater QNN_OP_MAT_MUL_PARAM_TRANSPOSE_IN1. It is ‘m’ if the param is true, else it is ‘n’. Values are expected to be signed and symmetrically quantized. Tensor must be static if using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the Tensor must be static, or the chain of ops preceding the Tensor must all have static inputs.</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION is supported with expansion on channel axis only and the block-quant weights are expected to be signed and symmetrically quantized. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION requires minimum arch v69.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>16bit Weight must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  |
| INT8 |  | <ul class="simple"><br><li><p>Given a tensor of shape […, m, n], QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only axis ‘m’ or ‘n’. The quantization axis is determined by paramater QNN_OP_MAT_MUL_PARAM_TRANSPOSE_IN1. It is ‘m’ if the param is true, else it is ‘n’. Values are expected to be signed and symmetrically quantized. Tensor must be static if using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the Tensor must be static, or the chain of ops preceding the Tensor must all have static inputs.</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION is supported with expansion on channel axis only and the block-quant weights are expected to be signed and symmetrically quantized. QNN_OP_MAT_MUL_PARAM_TRANSPOSE_IN1 must be false with QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION requires minimum arch v69.</p></li><br></ul> |  |  |

### Quantization

| Configuration | in[1] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## MultiClassNms

### Datatypes

| Configuration | in[0] | in[1] | in[2..m] | out[0] | out[1] | out[2] | out[3] | out[4..M] |
| --- | --- | --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## NonMaxSuppression

### Datatypes

| Configuration | in[0] | in[1] | out[0] | out[1] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |

## NonZero

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |

## Nv12ToRgb

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | output\_order |
| --- | --- |
| All | <ul class="simple"><br><li><p>Support only rgb output order</p></li><br></ul> |

## OneHot

### Datatypes

| Configuration | in[0] | out[0] | on\_value | off\_value |
| --- | --- | --- | --- | --- |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 2.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 3.</p></li><br></ul> |

## Pack

### Datatypes

| Configuration | in[0..m] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0..m] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Supports Rank in range [1, 4].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports Rank = rank(in[0]) + 1.</p></li><br></ul> |

## Pad

### Datatypes

| Configuration | in[0] | out[0] | pad\_constant\_value |
| --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |  |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |  |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |  |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] | scheme | pad\_constant\_value |
| --- | --- | --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5 for CONSTANT scheme. Max supported input rank is 4 for schemes MIRROR_REFLECT, MIRROR_SYMMETRIC, EDGE.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5 for CONSTANT scheme. Max supported output rank is 4 for schemes MIRROR_REFLECT, MIRROR_SYMMETRIC, EDGE.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only support schemes CONSTANT, MIRROR_REFLECT, MIRROR_SYMMETRIC, EDGE</p></li><br></ul> |  |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5 for CONSTANT scheme. Max supported input rank is 4 for schemes MIRROR_REFLECT, MIRROR_SYMMETRIC, EDGE.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5 for CONSTANT scheme. Max supported output rank is 4 for schemes MIRROR_REFLECT, MIRROR_SYMMETRIC, EDGE.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only support schemes CONSTANT, MIRROR_REFLECT, MIRROR_SYMMETRIC, EDGE</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  | <ul class="simple"><br><li><p>pad_constant_value is quantizable with quantization params same as in[0]. Results are stored in 32-bit signed integer form.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  | <ul class="simple"><br><li><p>pad_constant_value is quantizable with quantization params same as in[0]. Results are stored in 32-bit signed integer form.</p></li><br></ul> |

## PoolAvg2d

### Datatypes

| Configuration | in[0] | out[0] | rounding\_mode |
| --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

## PoolAvg3d

### Datatypes

| Configuration | in[0] | out[0] | rounding\_mode |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Input rank must be 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Output rank must be 5.</p></li><br></ul> |

## PoolMax2d

### Datatypes

| Configuration | in[0] | out[0] | rounding\_mode |
| --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

## Prelu

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br><li><p>The shape of the in[1] tensor must have all dims = 1 except for the dim at RANK(in[1]) - 1 if QNN_DEFINITION_IMPL_GENERATED is used in in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED is not supported for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br><li><p>The shape of the in[1] tensor must have all dims = 1 except for the dim at RANK(in[1]) - 1 if QNN_DEFINITION_IMPL_GENERATED is used in in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |

## Quantize

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## RandomNormalLike

### Datatypes

| Configuration | in[0] | in[1] | out[0] | mean | scale |
| --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| All | <ul class="simple"><br><li><p>Shape: In[0] must be a 1-D tensor.</p></li><br></ul> |

## RandomUniformLike

### Datatypes

| Configuration | in[0] | in[1] | out[0] | low | high |
| --- | --- | --- | --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | low | high |
| --- | --- | --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: In[0] must be a 1-D tensor.</p></li><br></ul> | <ul class="simple"><br><li><p>Lower boundary of the output values</p></li><br></ul> | <ul class="simple"><br><li><p>Upper boundary of the output values</p></li><br></ul> |

## ReduceMax

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] | axes |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: When input rank is 5, only single axis is supported.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |

## ReduceMean

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## ReduceMin

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] | axes |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: When input rank is 5, only single axis is supported.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |

## ReduceSum

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## Relu

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0] and QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF must be false.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0] and QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF must be false.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |

## Relu1

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## Relu6

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ReluMinMax

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0] and QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF must be false.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0] and QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF must be false.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## Reshape

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Supports Rank in range [1, 5].</p></li><br></ul> |  | <ul class="simple"><br><li><p>Shape: Supports Rank in range [1, 5].</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only when the reshaped dimensions are grouped together.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only when the reshaped dimensions are grouped together.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only when the reshaped dimensions are grouped together.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Dynamic Shape: Supported only when the reshaped dimensions are grouped together.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## Resize

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] | nearest\_mode | interpolation\_mode |
| --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Only supports QNN_OP_RESIZE_NEAREST_MODE_FLOOR, except for when QNN_OP_RESIZE_PARAM_TRANSFORMATION_MODE is set to QNN_OP_RESIZE_TRANSFORMATION_MODE_ALIGN_CORNERS which only supports QNN_OP_RESIZE_NEAREST_MODE_ROUND_PREFER_CEIL. If QNN_OP_RESIZE_PARAM_NEAREST_MODE is not set, HTP follows above rules implicitly.</p></li><br></ul> |  |
| BF16 |  |  |  | <ul class="simple"><br><li><p>For BFLOAT_16, only LINEAR interpolation is supported. LINEAR = 1</p></li><br></ul> |
| FP16 |  |  |  | <ul class="simple"><br><li><p>For BFLOAT_16, only LINEAR interpolation is supported. LINEAR = 1</p></li><br></ul> |
| FP16 |  |  |  | <ul class="simple"><br><li><p>For BFLOAT_16, only LINEAR interpolation is supported. LINEAR = 1</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  | <ul class="simple"><br><li><p>For BFLOAT_16, only LINEAR interpolation is supported. LINEAR = 1</p></li><br></ul> |
| INT8 |  |  |  | <ul class="simple"><br><li><p>For BFLOAT_16, only LINEAR interpolation is supported. LINEAR = 1</p></li><br></ul> |
| INT8 |  |  |  | <ul class="simple"><br><li><p>For BFLOAT_16, only LINEAR interpolation is supported. LINEAR = 1</p></li><br></ul> |

## ResizeBilinear

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

## ResizeNearestNeighbor

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## RmsNorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | axes |
| --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports normalization on channel</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Signed 16bit Gamma must be symmetric quantized.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT16 |  |  | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized.</p></li><br></ul> |  |  |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT8 |  |  | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized.</p></li><br></ul> |  |  |

## RoiAlign

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] | aligned | allow\_invalid\_roi |
| --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

## RotaryEmbedding

### Datatypes

| Configuration | in[0] | in[1] | in[2] | in[3] | out[0] |
| --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Input rank must be 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Output rank must be 4.</p></li><br></ul> |

## ScatterElements

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] | axis | reduction |
| --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_16 | QNN\_DATATYPE\_UINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_16 | QNN\_DATATYPE\_UINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | axis | reduction |
| --- | --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Value: Must be in range [0, N - 1] where N is the rank of the input tensor</p></li><br></ul> |  |
| FP16 |  |  |  |  |  | <ul class="simple"><br><li><p>For FLOAT_16, only NONE reduction is supported. NONE = 0 Indices should not have duplicated values with reduction being NONE.</p></li><br></ul> |
| INT16 |  |  |  |  |  | <ul class="simple"><br><li><p>Values: NONE = 0, ADD = 1, MUL = 2</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updatable quantization should be same for in0, in2 and out0</p></li><br></ul> |  |  |
| INT8 |  |  |  |  |  | <ul class="simple"><br><li><p>Values: NONE = 0, ADD = 1, MUL = 2, MAX = 3</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updatable quantization should be same for in0, in2 and out0</p></li><br></ul> |  |  |
| OTHERS |  |  |  |  |  | <ul class="simple"><br><li><p>For QNN_DATATYPE_INT_32, NONE,ADD,MUL,MAX reduction is supported. Indices should not have duplicated values with reduction being NONE.</p></li><br></ul> |

## ScatterNd

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported first input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported second input rank is 6 for static indices, 5 for non-static indices.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported third input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported first input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported second input rank is 6 for static indices, 5 for non-static indices.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported third input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported first input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported second input rank is 6 for static indices, 5 for non-static indices.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported third input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported first input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported second input rank is 6 for static indices, 5 for non-static indices.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported third input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## Sigmoid

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/65536.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/65536.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Scale: 1/65536.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Scale: 1/65536.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Softmax

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] | axis |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>only default N-1 supported</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> |  |

## SpaceToBatch

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## SpaceToDepth

### Datatypes

| Configuration | in[0] | out[0] | mode |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

## SparseToDense

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported sparse input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## Split

### Datatypes

| Configuration | in[0] | out[0..m] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | out[0..m] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## Squeeze

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height and width dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height and width dimensions.</p></li><br></ul> |

## Stft

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## StridedSlice

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## Tanh

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |
| FP16 |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: -32768</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: -32768</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: -32768</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: -32768</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Tile

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## TopK

### Datatypes

| Configuration | in[0] | out[0] | out[1] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>Input quantization must be equal to output quantization.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Transpose

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Supported datatypes: Transpose 4D: QNN_DATATYPE_BOOL_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32, QNN_DATATYPE_UINT_32. Transpose 5D: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br><li><p>Supported datatypes: Transpose 4D: QNN_DATATYPE_BOOL_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32, QNN_DATATYPE_UINT_32. Transpose 5D: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Supported datatypes: Transpose 4D: QNN_DATATYPE_BOOL_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32, QNN_DATATYPE_UINT_32. Transpose 5D: QNN_DATATYPE_BOOL_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>Supported datatypes: Transpose 4D: QNN_DATATYPE_BOOL_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32, QNN_DATATYPE_UINT_32. Transpose 5D: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32</p></li><br></ul> |  |

## TransposeConv2d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| BF16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 | QNN\_DATATYPE\_BFLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized. For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 16bit Weight must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  |
| INT16 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 16bit Weight must have 16bit Activation and must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  |
| INT8 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized. For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 16bit Weight must have 16bit Activation and must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><dl class="simple"><br><dt>Datatype:</dt><dd><ul><br><li><p>QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>QNN_DATATYPE_SFIXED_POINT_8</p></li><br></ul><br></dd><br></dl><br></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><dl class="simple"><br><dt>Datatype:</dt><dd><ul><br><li><p>QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>QNN_DATATYPE_SFIXED_POINT_8</p></li><br></ul><br></dd><br></dl><br></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## TransposeConv3d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | dilation |
| --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Input rank must be 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Weight rank must be 5.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Shape: Output rank must be 5</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports dilation if stride in height and width = 1</p></li><br><li><p>Value: Only supports dilation of 1 in the depth dimension</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized.</p></li><br></ul> |  |  |
| INT8 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized.</p></li><br></ul> |  |  |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## UnPack

### Datatypes

| Configuration | in[0] | out[0..m] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0..m] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>Input quantization must be equal to output quantization.</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>Input quantization must be equal to output quantization.</p></li><br></ul> |

### Quantization

| Configuration | out[0..m] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

Last Published: Jun 04, 2026

[Previous Topic
GPU](https://docs.qualcomm.com/bundle/publicresource/80-63442-10/topics/GpuOpDefSupplement.md) [Next Topic
HTA](https://docs.qualcomm.com/bundle/publicresource/80-63442-10/topics/HtaOpDefSupplement.md)