# HTP Backend Op Definition Supplement

## Argmax

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## Argmin

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## Batchnorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 |  | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## BatchToSpace

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Buffer

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_16 |

### Constraints

| Configuration | mode |
| --- | --- |
| All | <ul class="simple"><br><li><p>Value: Only supported mode is 1 and 2.</p></li><br></ul> |

## Cast

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_FLOAT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_64 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_64 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_64 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_64 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_8 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_16 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>QNN_DATATYPE_UINT_32 must be in the range of 0..INT32_MAX.</p></li><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>QNN_DATATYPE_UINT_32 must be in the range of 0..INT32_MAX.</p></li><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>QNN_DATATYPE_UINT_32 must be in the range of 0..INT32_MAX.</p></li><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |

## ChannelShuffle

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Concat

### Datatypes

| Configuration | in[0..m] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0..m] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## Conv2d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Updateable tensor is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable tensor is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable tensor is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable tensor is supported.</p></li><br></ul> |
| FP16 |  | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_8 data is supported if the quantization encoding is QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET or QNN_QUANTIZATION_ENCODING_BLOCK. The weight tensor must be static and the height and width of the weight tensor is [1,1] when QNN_DATATYPE_SFIXED_POINT_8 data is supported.</p></li><br></ul> |  |  |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs.</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION is supported with expansion on channel axis only and the block-quant weights are expected to be signed and symmetrically quantized. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION requires minimum arch v69.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized. For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_VECTOR is supported with expansion on channel axis only and the vector-quant weights are expected to be signed and symmetrically quantized. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_VECTOR requires minimum arch v69. Vector dimension should be 2, vector stride should be 2 and the index bitwidth should be 6. Additionally, the filter dimensions should be divisible by the VQ block-size and the block size should be multiples of 32.</p></li><br></ul> |  |  |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 16bit Weight must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0] when in[1] uses 16 bit precision.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs.</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION is supported with expansion on channel axis only and the block-quant weights are expected to be signed and symmetrically quantized. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION requires minimum arch v69.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Conv3d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | dilation |
| --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Input rank must be 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Weight rank must be 5.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Shape: Output rank must be 5</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports dilation if stride in height and width = 1</p></li><br><li><p>Value: Only supports dilation of 1 in the depth dimension</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized.</p></li><br></ul> |  |  |
| INT8 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized.</p></li><br></ul> |  |  |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Convert

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## CreateSparse

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | out[0] |
| --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported sparse output rank is 5.</p></li><br></ul> |

## CumulativeSum

### Datatypes

| Configuration | in[0] | out[0] | axis | exclusive | reverse |
| --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |  |  |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |  |  |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | out[0] | axis |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Value: Must be in range [0, N - 1] where N is the rank of the input tensor</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  |

## DepthToSpace

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

## DepthWiseConv2d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | dilation |
| --- | --- | --- | --- | --- | --- |
| FP16 |  |  |  |  | <ul class="simple"><br><li><p>Value: Only supports dilation if stride = [1,1]</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 16bit Weight must have 16bit Activation and must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized. For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports dilation if stride = [1,1] or dilation of [2,2] when stride is [2,2] and kernel size is [3,3]</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized. For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports dilation if stride = [1,1] or dilation of [2,2] when stride is [2,2] and kernel size is [3,3]</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 16bit Weight must have 16bit Activation and must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  |  |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Dequantize

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_16 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## DetectionOutput

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] | out[1] | out[2] | out[3] |
| --- | --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |

## ElementWiseAbs

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## ElementWiseAdd

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseAnd

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 4.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 4.</p></li><br></ul> |

## ElementWiseAsin

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseAtan

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseBinary

### Datatypes

| Configuration | in[0] | in[1] | out[0] | operation |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] | operation |
| --- | --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supported input rank: All: Between 1 and 4. Multiply, Divide, Equal, NotEqual, Less, LessEqual, Greater, GreaterEqual: Between 1 and 5.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. AND: Not supported. DIVIDE: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FLOORDIV: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FMOD: Not supported. GREATER: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. GREATEREQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LESS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LESSEQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MAXIMUM: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MINIMUM: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MOD: Not supported. MULTIPLY: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOTEQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. OR: Not supported. POWER: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQUAREDDIFFERENCE: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SUBTRACT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. XOR: Not supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supported input rank: All: Between 1 and 4. Multiply, Divide, Equal, NotEqual, Less, LessEqual, Greater, GreaterEqual: Between 1 and 5.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. AND: Not supported. DIVIDE: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FLOORDIV: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FMOD: Not supported. GREATER: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. GREATEREQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LESS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LESSEQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MAXIMUM: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MINIMUM: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MOD: Not supported. MULTIPLY: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOTEQUAL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. OR: Not supported. POWER: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQUAREDDIFFERENCE: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SUBTRACT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. XOR: Not supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supported output rank: All: Between 1 and 4. Multiply, Divide, Equal, NotEqual, Less, LessEqual, Greater, GreaterEqual: Between 1 and 5.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. AND: Not supported. DIVIDE: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EQUAL: QNN_DATATYPE_BOOL_8. FLOORDIV: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FMOD: Not supported. GREATER: QNN_DATATYPE_BOOL_8. GREATEREQUAL: QNN_DATATYPE_BOOL_8. LESS: QNN_DATATYPE_BOOL_8. LESSEQUAL: QNN_DATATYPE_BOOL_8. MAXIMUM: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MINIMUM: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. MOD: Not supported. MULTIPLY: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOTEQUAL: QNN_DATATYPE_BOOL_8. OR: Not supported. POWER: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQUAREDDIFFERENCE: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SUBTRACT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. XOR: Not supported.</p></li><br></ul> |  |
| FP16 | <ul class="simple"><br><li><p>Shape: Supported input rank: All: Between 1 and 4. Multiply, Divide, Add, Power, Subtract: Between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supported input rank: All: Between 1 and 4. Multiply, Divide, Add, Power, Subtract: Between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supported output rank: All: Between 1 and 4. Multiply, Divide, Add, Power, Subtract: Between 1 and 5.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support input rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support input rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_INT_32, QNN_DATATYPE_FLOAT_32, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support output rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0] and in[0] type == in[1] type == out[0] type != true.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED supported oper types: ADD</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions of ADD, DIVIDE, MULTIPLY, POWER, and SUBTRACT.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions of ADD, DIVIDE, MULTIPLY, POWER, and SUBTRACT.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions of ADD, DIVIDE, MULTIPLY, POWER, and SUBTRACT.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0] and in[0] type == in[1] type == out[0] type.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support input rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support input rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_INT_32, QNN_DATATYPE_FLOAT_32, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support output rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0] and in[0] type == in[1] type == out[0] type.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: ADD: QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0] and in[0] type == in[1] type == out[0] type != true.</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support input rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support input rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_INT_32, QNN_DATATYPE_FLOAT_32, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5. Except for AND, FLOORDIV, OR which support output rank between 1 and 4.</p></li><br><li><p>Supported datatypes: ADD: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. AND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8. DIVIDE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. EQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. FLOORDIV: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. FMOD: Not supported. GREATER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. GREATEREQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. LESS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_INT_32, QNN_DATATYPE_BOOL_8. LESSEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. MAXIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MINIMUM: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. MOD: Not supported. MULTIPLY: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_UINT_32, QNN_DATATYPE_INT_32. NOTEQUAL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. OR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_BOOL_8. POWER: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQUAREDDIFFERENCE: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SUBTRACT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. XOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_BOOL_8.</p></li><br></ul> |  |

## ElementWiseCeil

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseCos

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseDivide

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseEqual

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseExp

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## ElementWiseFloor

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseFloorDiv

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 4.</p></li><br></ul> |
| FP16 |  | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> |  |
| INT16 |  | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> |  |
| INT8 |  | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> |  |

## ElementWiseGreater

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseGreaterEqual

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseLess

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseLessEqual

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseLog

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseMaximum

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseMinimum

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseMultiply

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All |  |  | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |  |

## ElementWiseNeg

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseNeuron

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. (Except Relu and Sigmoid support rank 5)</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. GELU: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. HARDSIGMOID: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. HARDSWISH: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RELU: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RELUMINMAX: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIGMOID: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SOFTPLUS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. TANH: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4 (Except Relu and Sigmoid support rank 5).</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. GELU: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. HARDSIGMOID: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. HARDSWISH: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RELU: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RELUMINMAX: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIGMOID: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SOFTPLUS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. TANH: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. Except for HARDSIGMOID, RELU, RELUMINMAX, SIGMOID which support max input rank of 5.</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. GELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. HARDSIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSWISH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. RELUMINMAX: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. SIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SOFTPLUS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. TANH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension of SIGMOID.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: Relu, ReluMinMax, HardSwish Relu, ReluMinMax, HardSwish: QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0]. For Relu and ReluMinMax QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF must be false.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. Except for HARDSIGMOID, RELU, RELUMINMAX, SIGMOID which support max input rank of 5.</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. GELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. HARDSIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSWISH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. RELUMINMAX: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. SIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SOFTPLUS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. TANH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension of SIGMOID.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: Relu, ReluMinMax, HardSwish Relu, ReluMinMax, HardSwish: QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. Except for HARDSIGMOID, RELU, RELUMINMAX, SIGMOID which support max input rank of 5.</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. GELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSWISH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. RELUMINMAX: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. SIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SOFTPLUS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. TANH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: Relu, ReluMinMax, HardSwish Relu, ReluMinMax, HardSwish: QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0]. For Relu and ReluMinMax QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF must be false.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. Except for HARDSIGMOID, RELU, RELUMINMAX, SIGMOID which support max input rank of 5.</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. GELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSWISH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. RELUMINMAX: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. SIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SOFTPLUS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. TANH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED declared oper types: Relu, ReluMinMax, HardSwish Relu, ReluMinMax, HardSwish: QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. Except for RELU, RELUMINMAX, SIGMOID which support max input rank of 5.</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. GELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSWISH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELUMINMAX: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. SIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SOFTPLUS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. TANH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4. Except for RELU, RELUMINMAX, SIGMOID which support max input rank of 5.</p></li><br><li><p>Supported datatypes: ELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. GELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. HARDSWISH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELU: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RELUMINMAX: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_INT_32. SIGMOID: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. SOFTPLUS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16. TANH: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br></ul> |

## ElementWiseNot

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseNotEqual

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseOr

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWisePower

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseRound

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseRsqrt

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports max input of Rank 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports max output of Rank 4.</p></li><br></ul> |

## ElementWiseSelect

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## ElementWiseSign

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseSin

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseSquaredDifference

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseSquareRoot

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ElementWiseSubtract

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports input of Rank between 1 and 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports output of Rank between 1 and 5.</p></li><br></ul> |

## ElementWiseUnary

### Datatypes

| Configuration | in[0] | out[0] | operation |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Ops that support input rank 4: Atan, Ceil, Cos, Exp, Floor, Log, Neg, Not, Round, Sign, Sin. Ops that support input rank 5: Abs, Rsqrt, Sqrt.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. ASIN: Not supported. ATAN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. CEIL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. COS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EXP: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FLOOR: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LOG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NEG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOT: QNN_DATATYPE_BOOL_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RSQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIGN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Ops that support output rank 4: Atan, Ceil, Cos, Exp, Floor, Log, Neg, Not, Round, Sign, Sin. Ops that support output rank 5: Abs, Rsqrt, Sqrt.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. ASIN: Not supported. ATAN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. CEIL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. COS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EXP: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FLOOR: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LOG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NEG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOT: QNN_DATATYPE_BOOL_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RSQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIGN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Ops that support input rank 4: Asin, Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin, Sqrt. Ops that support input rank 5: Abs, Exp, Rsqrt.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. ASIN: QNN_DATATYPE_UFIXED_POINT_8. ATAN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. CEIL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. COS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. EXP: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. FLOOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. LOG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NEG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NOT: QNN_DATATYPE_UFIXED_POINT_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RSQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SIGN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SIN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension of SQRT.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Ops that support output rank 4: Asin, Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin, Sqrt. Ops that support output rank 5: Abs, Exp, Rsqrt.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. ASIN: QNN_DATATYPE_UFIXED_POINT_8. ATAN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. CEIL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. COS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. EXP: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. FLOOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. LOG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NEG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NOT: QNN_DATATYPE_UFIXED_POINT_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RSQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16. SIGN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SIN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension of SQRT.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Ops that support input rank 4: Asin, Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin, Sqrt. Ops that support input rank 5: Abs, Exp, Rsqrt(except QNN_DATATYPE_SFIXED_POINT_16).</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Ops that support output rank 4: Asin, Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin, Sqrt. Ops that support output rank 5: Abs, Exp, Rsqrt(except QNN_DATATYPE_SFIXED_POINT_16).</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Ops that support input rank 4: Asin, Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin, Sqrt. Ops that support input rank 5: Abs, Exp, Rsqrt.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. ASIN: QNN_DATATYPE_UFIXED_POINT_8. ATAN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. CEIL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. COS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. EXP: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. FLOOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. LOG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NEG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NOT: QNN_DATATYPE_UFIXED_POINT_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RSQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SIGN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SIN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Ops that support output rank 4: Asin, Atan, Ceil, Cos, Floor, Log, Neg, Not, Round, Sign, Sin, Sqrt. Ops that support output rank 5: Abs, Exp, Rsqrt.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. ASIN: QNN_DATATYPE_UFIXED_POINT_8. ATAN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. CEIL: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. COS: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. EXP: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. FLOOR: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. LOG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NEG: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. NOT: QNN_DATATYPE_UFIXED_POINT_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. RSQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SIGN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SIN: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16. SQRT: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Ops that support input rank 4: Atan, Ceil, Cos, Exp, Floor, Log, Neg, Not, Round, Rsqrt, Sign, Sin, Sqrt. Ops that support input rank 5: Abs.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32, QNN_DATATYPE_INT_32. ASIN: Not supported. ATAN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. CEIL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. COS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EXP: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FLOOR: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LOG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NEG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOT: QNN_DATATYPE_BOOL_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RSQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIGN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Ops that support output rank 4: Atan, Ceil, Cos, Exp, Floor, Log, Neg, Not, Round, Rsqrt, Sign, Sin, Sqrt. Ops that support output rank 5: Abs.</p></li><br><li><p>Supported datatypes: ABS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32, QNN_DATATYPE_INT_32. ASIN: Not supported. ATAN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. CEIL: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. COS: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. EXP: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. FLOOR: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. LOG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NEG: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. NOT: QNN_DATATYPE_BOOL_8. RECIPROCAL: Not supported. ROUND: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. RSQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIGN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SIN: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32. SQRT: QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32.</p></li><br></ul> |

## ElementWiseXor

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## Elu

### Datatypes

| Configuration | in[0] | out[0] | alpha |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ExpandDims

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br></ul> |

## ExtractGlimpse

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

## ExtractPatches

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Input rank must be 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Onput rank must be 4.</p></li><br></ul> |

## FullyConnected

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | keep\_dims |
| --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Only support default value 0</p></li><br></ul> |
| FP16 |  | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_8 data is supported if quantization encoding is QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET or QNN_QUANTIZATION_ENCODING_BLOCK. The weight tensor must be static in this case.</p></li><br></ul> |  |  |  |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>UFIXED_POINT_8 weights must be 8bit, 4bit or 2bit and must have rank 2. Given a 2D weight of dimensions [m n], QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only axis ‘m’ and the values are expected to be signed and symmetrically quantized. The Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the Tensor must be static, or the chain of ops preceding the Tensor must all have static inputs.</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION is supported with expansion on channel axis only and the block-quant weights are expected to be signed and symmetrically quantized. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION requires minimum arch v69.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> |  |
| INT16 |  | <ul class="simple"><br><li><p>UFIXED_POINT_8 weights must be 8bit, 4bit or 2bit and must have rank 2. Given a 2D weight of dimensions [m n], QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only axis ‘m’ and the values are expected to be signed and symmetrically quantized. The Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the Tensor must be static, or the chain of ops preceding the Tensor must all have static inputs. 16bit Weight must have 16bit Activation and must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  |  |
| INT8 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>UFIXED_POINT_8 weights must be 8bit or 4bit and must have rank 2. Given a 2D weight of dimensions [m n], QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only axis ‘m’ and the values are expected to be signed and symmetrically quantized. The Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the Tensor must be static, or the chain of ops preceding the Tensor must all have static inputs.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION is supported with expansion on channel axis only and the block-quant weights are expected to be signed and symmetrically quantized. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION requires minimum arch v69.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> |  |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 0</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Gather

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported index rank is 5.</p></li><br><li><p>Value: Only supports index values in range [0, in[0].dim[axis] - 1].</p></li><br></ul> |  |
| FP16 |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 |  | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT16 |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the channel dimension.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 |  |  | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| OTHERS |  |  | <ul class="simple"><br><li><p>Input quantization must be equal to output quantization.</p></li><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_INT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_INT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## GatherElements

### Datatypes

| Configuration | in[0] | in[1] | out[0] | axis |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] | axis |
| --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported index rank is 5.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Shape: Gather on axis 0 is not supported when rank is 5.</p></li><br></ul> |
| FP16 |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |
| INT16 |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |
| INT8 |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |
| OTHERS |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## GatherNd

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported index rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Gelu

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## GetSparseIndices

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported sparse input rank is 5.</p></li><br></ul> |

## GetSparseValues

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported sparse input rank is 5.</p></li><br></ul> |

## GridSample

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max Supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## GroupNorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## Gru

### Datatypes

| Configuration | in[0] | in[1] | in[2] | in[3] | in[4] | in[5] | in[6] | in[7] | in[8] | in[9] | in[10] | in[11] | in[12] | in[13] | in[14] | out[0] | out[1] |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Input rank must be 3.</p></li><br></ul> |

## HardSwish

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |

## InstanceNorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | mode | region |
| --- | --- | --- | --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: InstanceNorms of input Rank = 4 are supported. If input Rank &lt; 4 then support is only possible if the outermost dimension is of size 1.</p></li><br></ul> |  |  |  |  |  |
| INT16 | <ul class="simple"><br><li><p>Shape: InstanceNorms of input Rank = 4 are supported. If input Rank &lt; 4 then support is only possible if the outermost dimension is of size 1.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports mode MU_SIGMA</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports region ACROSS_SPATIAL</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |  |
| INT8 | <ul class="simple"><br><li><p>Shape: InstanceNorms of input Rank = 4 are supported. If input Rank &lt; 4 then support is only possible if the outermost dimension is of size 1.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports mode MU_SIGMA</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports region ACROSS_SPATIAL</p></li><br></ul> |

## IsInf

### Datatypes

| Configuration | in[0] | out[0] | detect\_negative | detect\_positive |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

## IsNan

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 |

## L2Norm

### Datatypes

| Configuration | in[0] | out[0] | axis | axes | epsilon |
| --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## LayerNorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | axes |
| --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports normalization on final dimension or last three dimensions of 4D inputs</p></li><br></ul> |
| FP16 |  | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  |
| INT16 |  | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT16 |  | <ul class="simple"><br><li><p>16bit Input and 16bit Gamma require minimum arch V73.</p></li><br></ul> |  |  |  |
| INT8 |  | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 |  | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Logit

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported epsilon rank is 1.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## LogSoftmax

### Datatypes

| Configuration | in[0] | out[0] | beta |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] | axis |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>only default N-1 supported</p></li><br></ul> |

## Lrn

### Datatypes

| Configuration | in[0] | out[0] | alpha | beta | bias | radius | region |
| --- | --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 |  |

### Constraints

| Configuration | in[0] | out[0] | region |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |  |
| FP16 |  |  | <ul class="simple"><br><li><p>Value: Only supports Input dimensions where Height x Width is less than 1024 for Within channel cases</p></li><br></ul> |

## Lstm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | in[3] | in[4] | in[5] | in[6] | in[7] | in[8] | in[9] | in[10] | in[11] | in[12] | in[13] | in[14] | in[15] | in[16] | in[17] | in[18] | in[19] | in[20] | in[21] | in[22] | in[23] | in[24] | out[0] | out[1] | out[2] | hidden\_state\_offset |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |  |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |  |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[12] | in[13] | in[14] | in[15] | direction | time\_major |
| --- | --- | --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 3.</p></li><br></ul> |  |  |  |  |  |  |
| FP16 |  | <ul class="simple"><br><li><p>LayerNorm not currently supported</p></li><br></ul> | <ul class="simple"><br><li><p>LayerNorm not currently supported</p></li><br></ul> | <ul class="simple"><br><li><p>LayerNorm not currently supported</p></li><br></ul> | <ul class="simple"><br><li><p>LayerNorm not currently supported</p></li><br></ul> |  |  |
| INT8 |  |  |  |  |  | <ul class="simple"><br><li><p>Support only forward for direction</p></li><br></ul> | <ul class="simple"><br><li><p>Not applicable for 2D input and is ignored.</p></li><br></ul> |

## MatMul

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 |  | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_8 data is supported if quantization encoding is QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET or QNN_QUANTIZATION_ENCODING_BLOCK. The weight tensor must be static in this case.</p></li><br></ul> |  |  |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Given a tensor of shape […, m, n], QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only axis ‘m’ or ‘n’. The quantization axis is determined by paramater QNN_OP_MAT_MUL_PARAM_TRANSPOSE_IN1. It is ‘m’ if the param is true, else it is ‘n’. Values are expected to be signed and symmetrically quantized. Tensor must be static if using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the Tensor must be static, or the chain of ops preceding the Tensor must all have static inputs.</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION is supported with expansion on channel axis only and the block-quant weights are expected to be signed and symmetrically quantized. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION requires minimum arch v69.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>16bit Weight must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  |
| INT8 |  | <ul class="simple"><br><li><p>Given a tensor of shape […, m, n], QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only axis ‘m’ or ‘n’. The quantization axis is determined by paramater QNN_OP_MAT_MUL_PARAM_TRANSPOSE_IN1. It is ‘m’ if the param is true, else it is ‘n’. Values are expected to be signed and symmetrically quantized. Tensor must be static if using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the Tensor must be static, or the chain of ops preceding the Tensor must all have static inputs.</p></li><br><li><p>QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION is supported with expansion on channel axis only and the block-quant weights are expected to be signed and symmetrically quantized. QNN_OP_MAT_MUL_PARAM_TRANSPOSE_IN1 must be false with QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION. Weight tensor or the chain of ops preceding the weight Tensor must all have static inputs. QNN_QUANTIZATION_ENCODING_BLOCKWISE_EXPANSION requires minimum arch v69.</p></li><br></ul> |  |  |

### Quantization

| Configuration | in[1] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## MultiClassNms

### Datatypes

| Configuration | in[0] | in[1] | in[2..m] | out[0] | out[1] | out[2] | out[3] | out[4..M] |
| --- | --- | --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## NonMaxSuppression

### Datatypes

| Configuration | in[0] | in[1] | out[0] | out[1] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |

## NonZero

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] |
| --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |

## Nv12ToRgb

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | output\_order |
| --- | --- |
| All | <ul class="simple"><br><li><p>Support only rgb output order</p></li><br></ul> |

## OneHot

### Datatypes

| Configuration | in[0] | out[0] | on\_value | off\_value |
| --- | --- | --- | --- | --- |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 2.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 3.</p></li><br></ul> |

## Pack

### Datatypes

| Configuration | in[0..m] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0..m] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Supports Rank in range [1, 4].</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Supports Rank = rank(in[0]) + 1.</p></li><br></ul> |

## Pad

### Datatypes

| Configuration | in[0] | out[0] | pad\_constant\_value |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |  |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |  |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] | scheme | pad\_constant\_value |
| --- | --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5 for CONSTANT scheme. Max supported input rank is 4 for schemes MIRROR_REFLECT, MIRROR_SYMMETRIC, EDGE.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5 for CONSTANT scheme. Max supported output rank is 4 for schemes MIRROR_REFLECT, MIRROR_SYMMETRIC, EDGE.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only support schemes CONSTANT, MIRROR_REFLECT, MIRROR_SYMMETRIC, EDGE</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  | <ul class="simple"><br><li><p>pad_constant_value is quantizable with quantization params same as in[0]. Results are stored in 32-bit signed integer form.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  | <ul class="simple"><br><li><p>pad_constant_value is quantizable with quantization params same as in[0]. Results are stored in 32-bit signed integer form.</p></li><br></ul> |

## PoolAvg2d

### Datatypes

| Configuration | in[0] | out[0] | rounding\_mode |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

## PoolAvg3d

### Datatypes

| Configuration | in[0] | out[0] | rounding\_mode |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Input rank must be 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Output rank must be 5.</p></li><br></ul> |

## PoolMax2d

### Datatypes

| Configuration | in[0] | out[0] | rounding\_mode |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

## Prelu

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br><li><p>The shape of the in[1] tensor must have all dims = 1 except for the dim at RANK(in[1]) - 1 if QNN_DEFINITION_IMPL_GENERATED is used in in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED is not supported for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br><li><p>The shape of the in[1] tensor must have all dims = 1 except for the dim at RANK(in[1]) - 1 if QNN_DEFINITION_IMPL_GENERATED is used in in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |

## Quantize

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## RandomUniformLike

### Datatypes

| Configuration | in[0] | in[1] | out[0] | low | high |
| --- | --- | --- | --- | --- | --- |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | low | high |
| --- | --- | --- | --- |
| OTHERS | <ul class="simple"><br><li><p>Shape: In[0] must be a 1-D tensor.</p></li><br></ul> | <ul class="simple"><br><li><p>Lower boundary of the output values</p></li><br></ul> | <ul class="simple"><br><li><p>Upper boundary of the output values</p></li><br></ul> |

## ReduceMax

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] | axes |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: When input rank is 5, only single axis is supported.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |

## ReduceMean

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## ReduceMin

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] | axes |
| --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: When input rank is 5, only single axis is supported.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |  |

## ReduceSum

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## Relu

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0] and QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF must be false.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0] and QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF must be false.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |

## Relu1

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## Relu6

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

## ReluMinMax

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0] and QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF must be false.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for in[0] and QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF must be false.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for out[0].</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## Reshape

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Supports Rank in range [1, 5].</p></li><br></ul> |  | <ul class="simple"><br><li><p>Shape: Supports Rank in range [1, 5].</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only when the reshaped dimensions are grouped together.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only when the reshaped dimensions are grouped together.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only when the reshaped dimensions are grouped together.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Dynamic Shape: Supported only when the reshaped dimensions are grouped together.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## Resize

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] | nearest\_mode |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Only supports QNN_OP_RESIZE_NEAREST_MODE_FLOOR, except for when QNN_OP_RESIZE_PARAM_TRANSFORMATION_MODE is set to QNN_OP_RESIZE_TRANSFORMATION_MODE_ALIGN_CORNERS which only supports QNN_OP_RESIZE_NEAREST_MODE_ROUND_PREFER_CEIL. If QNN_OP_RESIZE_PARAM_NEAREST_MODE is not set, HTP follows above rules implicitly.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |

## ResizeBilinear

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

## ResizeNearestNeighbor

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## RmsNorm

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | axes |
| --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports normalization on channel</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Signed 16bit Gamma must be symmetric quantized.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT16 |  |  | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized.</p></li><br></ul> |  |  |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT8 |  |  | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized.</p></li><br></ul> |  |  |

## RoiAlign

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] | aligned | allow\_invalid\_roi |
| --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

## ScatterElements

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] | axis | reduction |
| --- | --- | --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_16 | QNN\_DATATYPE\_UINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_16 | QNN\_DATATYPE\_UINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | axis | reduction |
| --- | --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Value: Must be in range [0, N - 1] where N is the rank of the input tensor</p></li><br></ul> |  |
| FP16 |  |  |  |  |  | <ul class="simple"><br><li><p>For FLOAT_16, only NONE reduction is supported. NONE = 0 Indices should not have duplicated values with reduction being NONE.</p></li><br></ul> |
| INT16 |  |  |  |  |  | <ul class="simple"><br><li><p>Values: NONE = 0, ADD = 1, MUL = 2</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updatable quantization should be same for in0, in2 and out0</p></li><br></ul> |  |  |
| INT8 |  |  |  |  |  | <ul class="simple"><br><li><p>Values: NONE = 0, ADD = 1, MUL = 2, MAX = 3</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updatable quantization should be same for in0, in2 and out0</p></li><br></ul> |  |  |

## ScatterNd

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported first input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported second input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported third input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported first input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported second input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported third input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported first input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported second input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported third input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported first input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported second input rank is 6.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported third input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## Sigmoid

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/65536.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/65536.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Scale: 1/65536.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Scale: 1/65536.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Softmax

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] | axis |
| --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>only default N-1 supported</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the width and channel dimensions.</p></li><br></ul> |  |

## SpaceToBatch

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## SpaceToDepth

### Datatypes

| Configuration | in[0] | out[0] | mode |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |

## SparseToDense

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported sparse input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## Split

### Datatypes

| Configuration | in[0] | out[0..m] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | out[0..m] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |

## Squeeze

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height and width dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height and width dimensions.</p></li><br></ul> |

## Stft

### Datatypes

| Configuration | in[0] | in[1] | out[0] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

## StridedSlice

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UINT\_8 | QNN\_DATATYPE\_UINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the width dimension.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br></ul> |

## Tanh

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> |  |
| FP16 |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: -32768</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: -32768</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: -32768</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: -32768</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Scale: 1/32768.0</p></li><br><li><p>Offset: 0</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Tile

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## TopK

### Datatypes

| Configuration | in[0] | out[0] | out[1] |
| --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_INT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_UINT\_32 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_INT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UINT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UINT\_32 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 4.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>Input quantization must be equal to output quantization.</p></li><br></ul> |

### Quantization

| Configuration | out[0] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## Transpose

### Datatypes

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| OTHERS | QNN\_DATATYPE\_BOOL\_8 | QNN\_DATATYPE\_BOOL\_8 |
| OTHERS | QNN\_DATATYPE\_UINT\_32 | QNN\_DATATYPE\_UINT\_32 |
| OTHERS | QNN\_DATATYPE\_INT\_32 | QNN\_DATATYPE\_INT\_32 |
| OTHERS | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |

### Constraints

| Configuration | in[0] | out[0] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 5.</p></li><br></ul> |
| INT16 | <ul class="simple"><br><li><p>Supported datatypes: Transpose 4D: QNN_DATATYPE_BOOL_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32, QNN_DATATYPE_UINT_32. Transpose 5D: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32</p></li><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br></ul> | <ul class="simple"><br><li><p>Updateable quantization is supported.</p></li><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br></ul> |
| INT8 | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br><li><p>Supported datatypes: Transpose 4D: QNN_DATATYPE_BOOL_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32, QNN_DATATYPE_UINT_32. Transpose 5D: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> | <ul class="simple"><br><li><p>Dynamic Shape: Supported only on the height, width, and channel dimensions.</p></li><br><li><p>Updateable quantization is supported.</p></li><br></ul> |
| OTHERS | <ul class="simple"><br><li><p>Supported datatypes: Transpose 4D: QNN_DATATYPE_BOOL_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32, QNN_DATATYPE_UINT_32. Transpose 5D: QNN_DATATYPE_BOOL_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32</p></li><br></ul> |  |
| OTHERS | <ul class="simple"><br><li><p>Supported datatypes: Transpose 4D: QNN_DATATYPE_BOOL_8, QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_SFIXED_POINT_16, QNN_DATATYPE_INT_32, QNN_DATATYPE_UINT_32. Transpose 5D: QNN_DATATYPE_UFIXED_POINT_8, QNN_DATATYPE_SFIXED_POINT_8, QNN_DATATYPE_UFIXED_POINT_16, QNN_DATATYPE_FLOAT_16, QNN_DATATYPE_FLOAT_32</p></li><br></ul> |  |

## TransposeConv2d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8, QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| INT16 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized. For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 16bit Weight must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  |
| INT16 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 16bit Weight must have 16bit Activation and must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  |
| INT8 | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[0].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs.</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[1].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized. For the channel scaling case, bias quantization encodings are expected to be scale = 0, offset = 0</p></li><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is rejected for in[2].</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DEFINITION_IMPL_GENERATED use is accepted for out[0].</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET and QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized. Weight Tensor must be static when using QNN_QUANTIZATION_ENCODING_BW_AXIS_SCALE_OFFSET. When using QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET, either the weight Tensor must be static, or the chain of ops preceding the weight Tensor must all have static inputs. 16bit Weight must have 16bit Activation and must be symmetric quantized. 16bit Activation and 16bit Weight require minimum arch V73.</p></li><br></ul> |  |  |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><dl class="simple"><br><dt>Datatype:</dt><dd><ul><br><li><p>QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>QNN_DATATYPE_SFIXED_POINT_8</p></li><br></ul><br></dd><br></dl><br></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><dl class="simple"><br><dt>Datatype:</dt><dd><ul><br><li><p>QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>QNN_DATATYPE_SFIXED_POINT_8</p></li><br></ul><br></dd><br></dl><br></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 3</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## TransposeConv3d

### Datatypes

| Configuration | in[0] | in[1] | in[2] | out[0] |
| --- | --- | --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_32 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | in[1] | in[2] | out[0] | dilation |
| --- | --- | --- | --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Input rank must be 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Weight rank must be 5.</p></li><br></ul> |  | <ul class="simple"><br><li><p>Shape: Output rank must be 5</p></li><br></ul> | <ul class="simple"><br><li><p>Value: Only supports dilation if stride in height and width = 1</p></li><br><li><p>Value: Only supports dilation of 1 in the depth dimension</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized.</p></li><br></ul> |  |  |
| INT8 |  | <ul class="simple"><br><li><p>QNN_QUANTIZATION_ENCODING_AXIS_SCALE_OFFSET is supported with only channel axis and the weights are expected to be signed and symmetrically quantized.</p></li><br></ul> | <ul class="simple"><br><li><p>QNN_DATATYPE_SFIXED_POINT_32 must be symmetric quantized.</p></li><br></ul> |  |  |

### Quantization

| Configuration | in[1] | in[2] |
| --- | --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |  |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Axis: 4</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_32</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Symmetry: Symmetric</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

## UnPack

### Datatypes

| Configuration | in[0] | out[0..m] |
| --- | --- | --- |
| FP16 | QNN\_DATATYPE\_FLOAT\_16 | QNN\_DATATYPE\_FLOAT\_16 |
| FP16 | QNN\_DATATYPE\_FLOAT\_32 | QNN\_DATATYPE\_FLOAT\_32 |
| INT16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 | QNN\_DATATYPE\_UFIXED\_POINT\_16 |
| INT16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 | QNN\_DATATYPE\_SFIXED\_POINT\_16 |
| INT8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 | QNN\_DATATYPE\_UFIXED\_POINT\_8 |
| INT8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 | QNN\_DATATYPE\_SFIXED\_POINT\_8 |

### Constraints

| Configuration | in[0] | out[0..m] |
| --- | --- | --- |
| All | <ul class="simple"><br><li><p>Shape: Max supported input rank is 5.</p></li><br></ul> | <ul class="simple"><br><li><p>Shape: Max supported output rank is 4.</p></li><br></ul> |
| INT16 |  | <ul class="simple"><br><li><p>Input quantization must be equal to output quantization.</p></li><br></ul> |
| INT8 |  | <ul class="simple"><br><li><p>Input quantization must be equal to output quantization.</p></li><br></ul> |

### Quantization

| Configuration | out[0..m] |
| --- | --- |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT16 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_16</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_UFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |
| INT8 | <ul class="simple"><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_AXIS_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: BW_SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br><li><dl class="simple"><br><dt>Quantization Parameters Config:</dt><dd><ul><br><li><p>Datatype: QNN_DATATYPE_SFIXED_POINT_8</p></li><br><li><p>Encoding: SCALE_OFFSET</p></li><br><li><p>Math Invariant: True</p></li><br></ul><br></dd><br></dl><br></li><br></ul> |

Last Published: Oct 10, 2025

[Previous Topic
UnPack](https://docs.qualcomm.com/bundle/publicresource/80-63442-50/topics/GpuOpDefSupplement.md) [Next Topic
HTA](https://docs.qualcomm.com/bundle/publicresource/80-63442-50/topics/HtaOpDefSupplement.md)